2024-02-16T21:58:55.742 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-16T21:58:55.742 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --archive /home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562719 --verbose --name pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi -- /home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562719/orig.config.yaml 2024-02-16T21:58:55.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T21:58:55.871 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562719 branch: wip-batrick-testing-20240215.160715 description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '7562719' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-batrick-testing-20240215.160715 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: f78a58c0ffd401d1493058a1022c35f011d65275 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f78a58c0ffd401d1493058a1022c35f011d65275 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: i64440 sha1: ed7ab725e1a43615009dfb74a42bf33d80081bc8 owner: scheduled_pdonnell@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 2634 sha1: f78a58c0ffd401d1493058a1022c35f011d65275 sleep_before_teardown: 0 suite: fs:upgrade:mds_upgrade_sequence suite_branch: i64440 suite_path: /home/teuthworker/src/github.com_batrick_ceph_ed7ab725e1a43615009dfb74a42bf33d80081bc8/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: ed7ab725e1a43615009dfb74a42bf33d80081bc8 targets: smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPRm2oJqRrbnMVwWaX3HCwSiw4m0MzyfVmBtelYYWJx6EUtjBfIiLyeiNal6oxcGtXsSUWq8e20/7FBntd0uhGM= smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIUwCJGUGQpkimg0vp1x4XCE+YrSPSYnbzqRZfbgiwp4sd8cFwdg10kAkB9x3w739p5AcVMYPMj4C01ghy54tNo= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - full_sequential_finally: - duration: 3600 sleep: null - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-16_18:26:20 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-02-16T21:58:55.871 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_ed7ab725e1a43615009dfb74a42bf33d80081bc8/qa; will attempt to use it 2024-02-16T21:58:55.872 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_ed7ab725e1a43615009dfb74a42bf33d80081bc8/qa/tasks 2024-02-16T21:58:55.872 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-16T21:58:55.874 INFO:teuthology.task.internal:Checking packages... 2024-02-16T21:58:55.895 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f78a58c0ffd401d1493058a1022c35f011d65275' 2024-02-16T21:58:55.895 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-16T21:58:55.895 INFO:teuthology.packaging:ref: None 2024-02-16T21:58:55.895 INFO:teuthology.packaging:tag: None 2024-02-16T21:58:55.895 INFO:teuthology.packaging:branch: wip-batrick-testing-20240215.160715 2024-02-16T21:58:55.895 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T21:58:55.895 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-batrick-testing-20240215.160715 2024-02-16T21:58:56.042 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1450.gf78a58c0 2024-02-16T21:58:56.044 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-16T21:58:56.051 INFO:teuthology.task.internal:no buildpackages task found 2024-02-16T21:58:56.051 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-16T21:58:56.091 INFO:teuthology.task.internal:Saving configuration 2024-02-16T21:58:56.109 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-16T21:58:56.115 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-16T21:58:56.140 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562719', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-16 21:53:54.369129', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPRm2oJqRrbnMVwWaX3HCwSiw4m0MzyfVmBtelYYWJx6EUtjBfIiLyeiNal6oxcGtXsSUWq8e20/7FBntd0uhGM='} 2024-02-16T21:58:56.160 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562719', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-16 21:53:54.367225', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIUwCJGUGQpkimg0vp1x4XCE+YrSPSYnbzqRZfbgiwp4sd8cFwdg10kAkB9x3w739p5AcVMYPMj4C01ghy54tNo='} 2024-02-16T21:58:56.160 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-16T21:58:56.167 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-02-16T21:58:56.167 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-02-16T21:58:56.167 INFO:teuthology.run_tasks:Running task console_log... 2024-02-16T21:58:56.233 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb89d9c00d0>, signals=[15]) 2024-02-16T21:58:56.234 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-16T21:58:56.240 INFO:teuthology.task.internal:Opening connections... 2024-02-16T21:58:56.240 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T21:58:56.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:58:56.331 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2024-02-16T21:58:56.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:58:56.416 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-16T21:58:56.423 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-02-16T21:58:56.440 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-02-16T21:58:56.440 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-02-16T21:58:56.496 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-02-16T21:58:56.496 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-02-16T21:58:56.496 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-02-16T21:58:56.496 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-02-16T21:58:56.496 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-02-16T21:58:56.496 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-02-16T21:58:56.497 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-16T21:58:56.497 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-02-16T21:58:56.497 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-02-16T21:58:56.497 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-16T21:58:56.497 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-02-16T21:58:56.497 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-16T21:58:56.497 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-16T21:58:56.497 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-16T21:58:56.498 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-02-16T21:58:56.524 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-02-16T21:58:56.541 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-02-16T21:58:56.541 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-02-16T21:58:56.598 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-02-16T21:58:56.598 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-02-16T21:58:56.598 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-02-16T21:58:56.598 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-02-16T21:58:56.598 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-02-16T21:58:56.598 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-02-16T21:58:56.598 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-16T21:58:56.598 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-02-16T21:58:56.598 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-02-16T21:58:56.598 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-16T21:58:56.598 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-02-16T21:58:56.599 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-16T21:58:56.599 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-16T21:58:56.599 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-16T21:58:56.599 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-02-16T21:58:56.615 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-16T21:58:56.625 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-16T21:58:56.631 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-16T21:58:56.631 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-02-16T21:58:56.633 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2024-02-16T21:58:56.654 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-16T21:58:56.660 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-16T21:58:56.660 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-02-16T21:58:56.689 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2024-02-16T21:58:56.795 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-16T21:58:56.847 INFO:teuthology.run_tasks:Running task kernel... 2024-02-16T21:58:56.862 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-16T21:58:56.863 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-16T21:58:56.863 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-16T21:58:56.863 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-16T21:58:56.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T21:58:56.879 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-02-16T21:58:56.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T21:58:56.880 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-02-16T21:58:56.935 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-361.el9.x86_64 2024-02-16T21:58:56.935 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.14.0-361.el9.x86_64 2024-02-16T21:58:56.935 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2024-02-16T21:58:56.938 INFO:teuthology.orchestra.run.smithi173.stdout:5.14.0-361.el9.x86_64 2024-02-16T21:58:56.938 INFO:teuthology.task.kernel:Running kernel on smithi173: 5.14.0-361.el9.x86_64 2024-02-16T21:58:56.938 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum install -y kernel 2024-02-16T21:58:59.624 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - AppStream 6.3 MB/s | 6.7 MB 00:01 2024-02-16T21:58:59.664 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - AppStream 6.5 MB/s | 6.7 MB 00:01 2024-02-16T21:59:01.363 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - BaseOS 3.7 MB/s | 2.0 MB 00:00 2024-02-16T21:59:02.571 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.0 MB 00:00 2024-02-16T21:59:02.607 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - BaseOS 1.2 MB/s | 2.0 MB 00:01 2024-02-16T21:59:03.364 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.0 MB 00:00 2024-02-16T21:59:06.238 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 7.4 MB/s | 19 MB 00:02 2024-02-16T21:59:08.943 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 4.2 MB/s | 19 MB 00:04 2024-02-16T21:59:11.164 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.1 MB 00:01 2024-02-16T21:59:12.806 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 15 kB 00:00 2024-02-16T21:59:12.957 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.1 MB 00:00 2024-02-16T21:59:14.967 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 15 kB 00:00 2024-02-16T21:59:15.619 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 20 MB 00:02 2024-02-16T21:59:16.878 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2024-02-16T21:59:20.465 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-02-16T21:59:21.759 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-02-16T21:59:22.772 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-16T21:59:22.772 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-16T21:59:22.857 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T21:59:22.866 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T21:59:22.866 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-02-16T21:59:22.866 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T21:59:22.866 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T21:59:22.866 INFO:teuthology.orchestra.run.smithi173.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-16T21:59:22.866 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-02-16T21:59:22.867 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-16T21:59:22.867 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-16T21:59:22.867 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-16T21:59:22.867 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T21:59:22.867 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T21:59:22.867 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T21:59:22.867 INFO:teuthology.orchestra.run.smithi173.stdout:Install 4 Packages 2024-02-16T21:59:22.867 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T21:59:22.867 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 100 M 2024-02-16T21:59:22.867 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 123 M 2024-02-16T21:59:22.867 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T21:59:23.725 INFO:teuthology.orchestra.run.smithi173.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 7.1 MB/s | 6.1 MB 00:00 2024-02-16T21:59:24.032 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-16T21:59:24.033 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-16T21:59:24.128 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T21:59:24.137 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T21:59:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-02-16T21:59:24.137 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T21:59:24.137 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T21:59:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-16T21:59:24.137 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-02-16T21:59:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-16T21:59:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-16T21:59:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-16T21:59:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T21:59:24.137 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T21:59:24.137 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T21:59:24.137 INFO:teuthology.orchestra.run.smithi134.stdout:Install 4 Packages 2024-02-16T21:59:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T21:59:24.138 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 100 M 2024-02-16T21:59:24.138 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 123 M 2024-02-16T21:59:24.138 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T21:59:25.043 INFO:teuthology.orchestra.run.smithi134.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 6.7 MB/s | 6.1 MB 00:00 2024-02-16T21:59:25.142 INFO:teuthology.orchestra.run.smithi173.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 9.2 MB/s | 21 MB 00:02 2024-02-16T21:59:25.909 INFO:teuthology.orchestra.run.smithi173.stdout:(3/4): kernel-modules-core-5.14.0-421.el9.x86_6 15 MB/s | 33 MB 00:02 2024-02-16T21:59:25.969 INFO:teuthology.orchestra.run.smithi134.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 11 MB/s | 21 MB 00:01 2024-02-16T21:59:26.359 INFO:teuthology.orchestra.run.smithi173.stdout:(4/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 11 MB/s | 39 MB 00:03 2024-02-16T21:59:26.363 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T21:59:26.363 INFO:teuthology.orchestra.run.smithi173.stdout:Total 28 MB/s | 100 MB 00:03 2024-02-16T21:59:26.363 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T21:59:26.485 INFO:teuthology.orchestra.run.smithi134.stdout:(3/4): kernel-modules-core-5.14.0-421.el9.x86_6 23 MB/s | 33 MB 00:01 2024-02-16T21:59:26.759 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T21:59:26.759 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T21:59:26.986 INFO:teuthology.orchestra.run.smithi134.stdout:(4/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 14 MB/s | 39 MB 00:02 2024-02-16T21:59:26.988 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T21:59:26.989 INFO:teuthology.orchestra.run.smithi134.stdout:Total 35 MB/s | 100 MB 00:02 2024-02-16T21:59:26.989 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T21:59:27.353 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T21:59:27.353 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T21:59:27.793 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T21:59:27.793 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T21:59:28.361 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T21:59:28.362 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T21:59:30.196 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T21:59:30.764 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T21:59:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-16T21:59:30.983 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-16T21:59:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-16T21:59:31.552 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-16T21:59:33.722 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-16T21:59:33.911 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-16T21:59:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-16T21:59:34.447 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-16T21:59:38.603 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-16T21:59:38.724 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-16T21:59:39.156 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-16T21:59:39.284 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-16T21:59:43.446 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-16T21:59:44.007 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-16T22:00:12.622 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-16T22:00:12.622 INFO:teuthology.orchestra.run.smithi173.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-16T22:00:12.622 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:00:12.694 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-16T22:00:13.081 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-16T22:00:13.081 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-16T22:00:13.081 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-16T22:00:13.081 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-16T22:00:13.265 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-16T22:00:13.265 INFO:teuthology.orchestra.run.smithi134.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-16T22:00:13.265 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:00:13.336 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-16T22:00:13.502 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-16T22:00:13.502 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:00:13.502 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:00:13.502 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-16T22:00:13.502 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-16T22:00:13.502 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-16T22:00:13.502 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-16T22:00:13.502 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:00:13.502 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:00:13.791 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-16T22:00:13.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-16T22:00:13.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-16T22:00:13.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-16T22:00:14.016 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel | sort -rV | head -n 1 2024-02-16T22:00:14.150 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-16T22:00:14.151 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-16T22:00:14.151 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-16T22:00:14.151 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-16T22:00:14.151 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-16T22:00:14.151 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-02-16T22:00:14.151 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi173.front.sepia.ceph.com, path=None, version=distro) 2024-02-16T22:00:14.152 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel | sort -rV | head -n 1 2024-02-16T22:00:14.237 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-16T22:00:14.237 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:00:14.237 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:00:14.237 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-16T22:00:14.237 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-16T22:00:14.237 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-16T22:00:14.238 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-16T22:00:14.238 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:00:14.238 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:00:14.259 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-16T22:00:14.259 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-16T22:00:14.259 DEBUG:teuthology.orchestra.run.smithi173:> sudo rpm -qi grub2-tools 2024-02-16T22:00:14.293 INFO:teuthology.orchestra.run.smithi173.stdout:Name : grub2-tools 2024-02-16T22:00:14.293 INFO:teuthology.orchestra.run.smithi173.stdout:Epoch : 1 2024-02-16T22:00:14.293 INFO:teuthology.orchestra.run.smithi173.stdout:Version : 2.06 2024-02-16T22:00:14.293 INFO:teuthology.orchestra.run.smithi173.stdout:Release : 68.el9 2024-02-16T22:00:14.293 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: x86_64 2024-02-16T22:00:14.293 INFO:teuthology.orchestra.run.smithi173.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-16T22:00:14.293 INFO:teuthology.orchestra.run.smithi173.stdout:Group : Unspecified 2024-02-16T22:00:14.293 INFO:teuthology.orchestra.run.smithi173.stdout:Size : 8264254 2024-02-16T22:00:14.293 INFO:teuthology.orchestra.run.smithi173.stdout:License : GPLv3+ 2024-02-16T22:00:14.293 INFO:teuthology.orchestra.run.smithi173.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-16T22:00:14.293 INFO:teuthology.orchestra.run.smithi173.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-16T22:00:14.294 INFO:teuthology.orchestra.run.smithi173.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-16T22:00:14.294 INFO:teuthology.orchestra.run.smithi173.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-16T22:00:14.294 INFO:teuthology.orchestra.run.smithi173.stdout:Packager : builder@centos.org 2024-02-16T22:00:14.294 INFO:teuthology.orchestra.run.smithi173.stdout:Vendor : CentOS 2024-02-16T22:00:14.294 INFO:teuthology.orchestra.run.smithi173.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-16T22:00:14.294 INFO:teuthology.orchestra.run.smithi173.stdout:Summary : Support tools for GRUB. 2024-02-16T22:00:14.294 INFO:teuthology.orchestra.run.smithi173.stdout:Description : 2024-02-16T22:00:14.294 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:00:14.294 INFO:teuthology.orchestra.run.smithi173.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-16T22:00:14.294 INFO:teuthology.orchestra.run.smithi173.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-16T22:00:14.294 INFO:teuthology.orchestra.run.smithi173.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-16T22:00:14.294 INFO:teuthology.orchestra.run.smithi173.stdout:hardware devices. 2024-02-16T22:00:14.294 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:00:14.294 INFO:teuthology.orchestra.run.smithi173.stdout:This subpackage provides tools for support of all platforms. 2024-02-16T22:00:14.295 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-16T22:00:14.295 INFO:teuthology.task.kernel:Updating grub on smithi173 to boot 5.14.0-421.el9.x86_64 2024-02-16T22:00:14.295 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-16T22:00:14.741 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-02-16T22:00:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-16T22:00:14.867 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-16T22:00:14.867 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-16T22:00:14.867 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-16T22:00:14.868 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-16T22:00:14.868 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-02-16T22:00:14.868 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-02-16T22:00:14.868 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-02-16T22:00:14.969 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2024-02-16T22:00:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-16T22:00:14.977 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-16T22:00:14.978 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2024-02-16T22:00:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2024-02-16T22:00:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2024-02-16T22:00:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.06 2024-02-16T22:00:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 68.el9 2024-02-16T22:00:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2024-02-16T22:00:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-16T22:00:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:Group : Unspecified 2024-02-16T22:00:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 8264254 2024-02-16T22:00:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2024-02-16T22:00:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-16T22:00:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-16T22:00:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-16T22:00:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-16T22:00:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : builder@centos.org 2024-02-16T22:00:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2024-02-16T22:00:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-16T22:00:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2024-02-16T22:00:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2024-02-16T22:00:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:00:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-16T22:00:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-16T22:00:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-16T22:00:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2024-02-16T22:00:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:00:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2024-02-16T22:00:15.024 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-16T22:00:15.024 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 5.14.0-421.el9.x86_64 2024-02-16T22:00:15.024 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-16T22:00:15.677 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-02-16T22:00:16.329 INFO:teuthology.orchestra.run.smithi173.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-16T22:00:16.365 INFO:teuthology.orchestra.run.smithi173.stderr:done 2024-02-16T22:00:16.367 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-02-16T22:00:16.404 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.DaXXGqZT8s 2024-02-16T22:00:16.404 DEBUG:teuthology.orchestra.run.smithi173:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DaXXGqZT8s 2024-02-16T22:00:16.473 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.DaXXGqZT8s 2024-02-16T22:00:16.620 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.DaXXGqZT8s is 6KB 2024-02-16T22:00:16.640 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.DaXXGqZT8s 2024-02-16T22:00:16.654 DEBUG:teuthology.orchestra.run.smithi173:> sudo /bin/ls /boot/loader/entries || true 2024-02-16T22:00:16.719 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-16T22:00:16.720 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-16T22:00:16.720 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-16T22:00:16.720 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-16T22:00:16.720 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-16T22:00:16.900 DEBUG:teuthology.orchestra.run.smithi173:> sudo shutdown -r now 2024-02-16T22:00:17.110 INFO:teuthology.orchestra.run.smithi134.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-16T22:00:17.139 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-02-16T22:00:17.141 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-02-16T22:00:17.196 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.WOmVWug0Su 2024-02-16T22:00:17.197 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WOmVWug0Su 2024-02-16T22:00:17.264 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.WOmVWug0Su 2024-02-16T22:00:17.408 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.WOmVWug0Su is 6KB 2024-02-16T22:00:17.457 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.WOmVWug0Su 2024-02-16T22:00:17.471 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2024-02-16T22:00:17.535 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-16T22:00:17.535 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-16T22:00:17.536 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-16T22:00:17.536 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-16T22:00:17.537 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-16T22:00:17.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-02-16T22:00:46.933 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-16T22:00:46.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-02-16T22:00:46.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T22:00:47.680 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-16T22:00:47.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-02-16T22:00:47.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T22:01:05.340 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-02-16T22:01:06.108 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-02-16T22:01:14.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-02-16T22:01:14.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T22:01:15.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-02-16T22:01:15.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T22:01:17.407 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-02-16T22:01:18.172 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-02-16T22:01:29.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-02-16T22:01:29.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T22:01:30.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-02-16T22:01:30.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T22:01:47.836 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-02-16T22:01:48.604 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-02-16T22:02:02.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-02-16T22:02:02.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T22:02:03.188 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-02-16T22:02:03.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-02-16T22:02:03.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T22:02:03.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-02-16T22:02:03.613 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-421.el9.x86_64"... 2024-02-16T22:02:03.613 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-02-16T22:02:03.627 INFO:teuthology.orchestra.run.smithi173.stdout:5.14.0-421.el9.x86_64 2024-02-16T22:02:03.627 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-16T22:02:03.628 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-16T22:02:03.628 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-16T22:02:03.912 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-02-16T22:02:04.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-02-16T22:02:04.337 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-421.el9.x86_64"... 2024-02-16T22:02:04.337 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-02-16T22:02:04.351 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-421.el9.x86_64 2024-02-16T22:02:04.351 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-16T22:02:04.351 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-16T22:02:04.351 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-16T22:02:04.629 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-16T22:02:04.629 DEBUG:teuthology.orchestra.run.smithi173:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-16T22:02:04.720 INFO:teuthology.orchestra.run.smithi173.stdout:ttyS1 2024-02-16T22:02:04.763 DEBUG:teuthology.parallel:result is None 2024-02-16T22:02:05.352 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-16T22:02:05.352 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-16T22:02:05.413 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-02-16T22:02:05.462 DEBUG:teuthology.parallel:result is None 2024-02-16T22:02:05.463 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-16T22:02:05.471 INFO:teuthology.task.internal:Creating test directory... 2024-02-16T22:02:05.471 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-16T22:02:05.473 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-16T22:02:05.490 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-16T22:02:05.500 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-16T22:02:05.511 INFO:teuthology.task.internal:Creating archive directory... 2024-02-16T22:02:05.511 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-16T22:02:05.531 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-16T22:02:05.595 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-16T22:02:05.602 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-16T22:02:05.602 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-16T22:02:05.604 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-16T22:02:05.640 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T22:02:05.653 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T22:02:05.666 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T22:02:05.679 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T22:02:05.681 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-16T22:02:05.687 INFO:teuthology.task.internal:Configuring sudo... 2024-02-16T22:02:05.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-16T22:02:05.702 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-16T22:02:05.730 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-16T22:02:05.738 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-16T22:02:05.738 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-16T22:02:05.772 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-16T22:02:05.788 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-16T22:02:05.869 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-16T22:02:05.925 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-16T22:02:06.010 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-16T22:02:06.054 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:02:06.054 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-16T22:02:06.124 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-16T22:02:06.166 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-16T22:02:06.221 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-16T22:02:06.304 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-16T22:02:06.344 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:02:06.345 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-16T22:02:06.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-02-16T22:02:06.414 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2024-02-16T22:02:06.449 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-16T22:02:06.508 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-16T22:02:06.871 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-16T22:02:06.879 INFO:teuthology.task.internal:Starting timer... 2024-02-16T22:02:06.879 INFO:teuthology.run_tasks:Running task pcp... 2024-02-16T22:02:06.889 INFO:teuthology.run_tasks:Running task selinux... 2024-02-16T22:02:06.896 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-16T22:02:06.896 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-02-16T22:02:07.034 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-02-16T22:02:07.035 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2024-02-16T22:02:07.073 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: 2024-02-16T22:02:07.075 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-16T22:02:07.075 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-02-16T22:02:07.114 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-02-16T22:02:07.115 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2024-02-16T22:02:07.139 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2024-02-16T22:02:07.139 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi134.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi173.front.sepia.ceph.com': 'permissive'} 2024-02-16T22:02:07.139 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-16T22:02:07.202 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T22:02:07.203 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-16T22:02:07.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T22:02:07.230 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-16T22:02:07.230 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-02-16T22:02:07.458 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2024-02-16T22:02:07.499 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-16T22:02:07.508 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-16T22:02:07.523 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-16T22:02:07.525 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi134.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-16T22:06:19.234 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2024-02-16T22:06:19.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-02-16T22:06:19.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T22:06:19.333 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-02-16T22:06:19.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-02-16T22:06:19.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-02-16T22:06:19.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T22:06:19.508 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-02-16T22:06:19.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-02-16T22:06:19.586 INFO:teuthology.run_tasks:Running task clock... 2024-02-16T22:06:19.597 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-16T22:06:19.597 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-16T22:06:19.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T22:06:19.600 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-16T22:06:19.601 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T22:06:19.629 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-16T22:06:19.647 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-16T22:06:19.656 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-16T22:06:19.673 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-16T22:06:19.674 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-02-16T22:06:19.688 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-02-16T22:06:19.702 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2024-02-16T22:06:19.707 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-16T22:06:19.715 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2024-02-16T22:06:19.724 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-16T22:06:19.732 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-16T22:06:19.748 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-16T22:06:19.783 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-02-16T22:06:19.787 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-16T22:06:19.787 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-02-16T22:06:19.787 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T22:06:19.787 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T22:06:19.787 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T22:06:19.787 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T22:06:19.800 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-02-16T22:06:19.803 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-16T22:06:19.804 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-02-16T22:06:19.804 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T22:06:19.804 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T22:06:19.804 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T22:06:19.804 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T22:06:19.804 INFO:teuthology.run_tasks:Running task install... 2024-02-16T22:06:19.817 DEBUG:teuthology.task.install:project ceph 2024-02-16T22:06:19.817 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'}} 2024-02-16T22:06:19.817 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'} 2024-02-16T22:06:19.817 INFO:teuthology.task.install:Using flavor: default 2024-02-16T22:06:19.828 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-16T22:06:19.828 INFO:teuthology.task.install:extra packages: [] 2024-02-16T22:06:19.829 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'tag': None, 'wait_for_package': False} 2024-02-16T22:06:19.829 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-16T22:06:19.829 INFO:teuthology.packaging:ref: None 2024-02-16T22:06:19.830 INFO:teuthology.packaging:tag: None 2024-02-16T22:06:19.830 INFO:teuthology.packaging:branch: quincy 2024-02-16T22:06:19.830 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:06:19.830 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-16T22:06:19.833 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'tag': None, 'wait_for_package': False} 2024-02-16T22:06:19.833 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-16T22:06:19.833 INFO:teuthology.packaging:ref: None 2024-02-16T22:06:19.833 INFO:teuthology.packaging:tag: None 2024-02-16T22:06:19.833 INFO:teuthology.packaging:branch: quincy 2024-02-16T22:06:19.834 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:06:19.834 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-16T22:06:20.060 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/b88fae66e6ad896087939a6bde358f026d85f561/centos/9/flavors/default/ 2024-02-16T22:06:20.060 INFO:teuthology.task.install.rpm:Package version is 17.2.7-513.gb88fae66 2024-02-16T22:06:20.178 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/b88fae66e6ad896087939a6bde358f026d85f561/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/b88fae66e6ad896087939a6bde358f026d85f561/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/b88fae66e6ad896087939a6bde358f026d85f561/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-16T22:06:20.178 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:06:20.179 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-16T22:06:20.207 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-16T22:06:20.207 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-16T22:06:20.207 INFO:teuthology.packaging:ref: None 2024-02-16T22:06:20.207 INFO:teuthology.packaging:tag: None 2024-02-16T22:06:20.207 INFO:teuthology.packaging:branch: quincy 2024-02-16T22:06:20.207 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:06:20.207 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-16T22:06:20.239 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/b88fae66e6ad896087939a6bde358f026d85f561/centos/9/flavors/default/ 2024-02-16T22:06:20.239 INFO:teuthology.task.install.rpm:Package version is 17.2.7-513.gb88fae66 2024-02-16T22:06:20.275 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-16T22:06:20.355 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-16T22:06:20.421 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-02-16T22:06:20.423 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-02-16T22:06:20.436 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/b88fae66e6ad896087939a6bde358f026d85f561/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/b88fae66e6ad896087939a6bde358f026d85f561/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/b88fae66e6ad896087939a6bde358f026d85f561/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-16T22:06:20.436 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:06:20.436 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-16T22:06:20.464 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-16T22:06:20.464 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-16T22:06:20.464 INFO:teuthology.packaging:ref: None 2024-02-16T22:06:20.464 INFO:teuthology.packaging:tag: None 2024-02-16T22:06:20.464 INFO:teuthology.packaging:branch: quincy 2024-02-16T22:06:20.464 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:06:20.464 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-16T22:06:20.534 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-16T22:06:20.614 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-16T22:06:20.668 INFO:teuthology.orchestra.run.smithi134.stdout:74 files removed 2024-02-16T22:06:20.680 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2024-02-16T22:06:20.682 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2024-02-16T22:06:20.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw 2024-02-16T22:06:20.917 INFO:teuthology.orchestra.run.smithi173.stdout:74 files removed 2024-02-16T22:06:20.944 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw 2024-02-16T22:06:21.370 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 217 kB/s | 77 kB 00:00 2024-02-16T22:06:21.584 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 242 kB/s | 77 kB 00:00 2024-02-16T22:06:21.820 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 23 kB/s | 9.1 kB 00:00 2024-02-16T22:06:21.960 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 28 kB/s | 9.1 kB 00:00 2024-02-16T22:06:22.238 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 4.7 kB/s | 1.8 kB 00:00 2024-02-16T22:06:22.394 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 4.5 kB/s | 1.8 kB 00:00 2024-02-16T22:06:23.121 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - AppStream 9.7 MB/s | 6.7 MB 00:00 2024-02-16T22:06:23.608 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - AppStream 5.0 MB/s | 6.7 MB 00:01 2024-02-16T22:06:24.738 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - BaseOS 4.1 MB/s | 2.0 MB 00:00 2024-02-16T22:06:25.049 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.0 MB 00:00 2024-02-16T22:06:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 8.0 MB 00:03 2024-02-16T22:06:30.170 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 8.0 MB 00:05 2024-02-16T22:06:30.340 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 30 MB/s | 19 MB 00:00 2024-02-16T22:06:32.863 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-02-16T22:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.1 MB 00:00 2024-02-16T22:06:35.768 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 15 kB 00:00 2024-02-16T22:06:37.447 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.1 MB 00:00 2024-02-16T22:06:37.488 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2024-02-16T22:06:39.515 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 15 kB 00:00 2024-02-16T22:06:40.725 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2024-02-16T22:06:42.285 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-02-16T22:06:44.895 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:06:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:06:44.909 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-02-16T22:06:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:06:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:06:44.909 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:17.2.7-513.gb88fae66.el9 ceph 14 M 2024-02-16T22:06:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-02-16T22:06:44.910 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:17.2.7-513.gb88fae66.el9 ceph 3.1 M 2024-02-16T22:06:44.910 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:17.2.7-513.gb88fae66.el9 ceph 2.9 M 2024-02-16T22:06:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-02-16T22:06:44.910 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:17.2.7-513.gb88fae66.el9 ceph 5.0 M 2024-02-16T22:06:44.910 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:17.2.7-513.gb88fae66.el9 ceph 23 M 2024-02-16T22:06:44.911 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:17.2.7-513.gb88fae66.el9 ceph 25 k 2024-02-16T22:06:44.911 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-16T22:06:44.911 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:17.2.7-513.gb88fae66.el9 ceph 635 k 2024-02-16T22:06:44.911 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-16T22:06:44.911 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-16T22:06:44.911 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-16T22:06:44.911 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:17.2.7-513.gb88fae66.el9 ceph 458 k 2024-02-16T22:06:44.912 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-16T22:06:44.912 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:17.2.7-513.gb88fae66.el9 ceph 4.9 M 2024-02-16T22:06:44.912 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-16T22:06:44.912 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-16T22:06:44.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:17.2.7-513.gb88fae66.el9 ceph 45 k 2024-02-16T22:06:44.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:17.2.7-513.gb88fae66.el9 ceph 116 k 2024-02-16T22:06:44.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:17.2.7-513.gb88fae66.el9 ceph 156 k 2024-02-16T22:06:44.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-16T22:06:44.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:17.2.7-513.gb88fae66.el9 ceph 320 k 2024-02-16T22:06:44.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:17.2.7-513.gb88fae66.el9 ceph 293 k 2024-02-16T22:06:44.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:17.2.7-513.gb88fae66.el9 ceph 99 k 2024-02-16T22:06:44.914 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-16T22:06:44.914 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:06:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:06:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:06:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:Install 22 Packages 2024-02-16T22:06:44.915 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages 2024-02-16T22:06:44.915 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:06:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 58 M 2024-02-16T22:06:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:06:45.666 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-02-16T22:06:47.136 INFO:teuthology.orchestra.run.smithi134.stdout:(1/24): ceph-base-17.2.7-513.gb88fae66.el9.x86_ 2.4 MB/s | 5.0 MB 00:02 2024-02-16T22:06:47.203 INFO:teuthology.orchestra.run.smithi134.stdout:(2/24): ceph-selinux-17.2.7-513.gb88fae66.el9.x 379 kB/s | 25 kB 00:00 2024-02-16T22:06:47.361 INFO:teuthology.orchestra.run.smithi134.stdout:(3/24): libcephfs2-17.2.7-513.gb88fae66.el9.x86 3.9 MB/s | 635 kB 00:00 2024-02-16T22:06:47.479 INFO:teuthology.orchestra.run.smithi134.stdout:(4/24): libradosstriper1-17.2.7-513.gb88fae66.e 3.8 MB/s | 458 kB 00:00 2024-02-16T22:06:48.179 INFO:teuthology.orchestra.run.smithi134.stdout:(5/24): ceph-radosgw-17.2.7-513.gb88fae66.el9.x 4.5 MB/s | 14 MB 00:03 2024-02-16T22:06:48.287 INFO:teuthology.orchestra.run.smithi134.stdout:(6/24): librgw2-17.2.7-513.gb88fae66.el9.x86_64 6.1 MB/s | 4.9 MB 00:00 2024-02-16T22:06:48.307 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:06:48.312 INFO:teuthology.orchestra.run.smithi134.stdout:(7/24): python3-ceph-argparse-17.2.7-513.gb88fa 338 kB/s | 45 kB 00:00 2024-02-16T22:06:48.322 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:06:48.322 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-02-16T22:06:48.322 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:06:48.322 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:06:48.322 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:17.2.7-513.gb88fae66.el9 ceph 14 M 2024-02-16T22:06:48.322 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2024-02-16T22:06:48.322 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:17.2.7-513.gb88fae66.el9 ceph 3.1 M 2024-02-16T22:06:48.322 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:17.2.7-513.gb88fae66.el9 ceph 2.9 M 2024-02-16T22:06:48.322 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-02-16T22:06:48.323 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:17.2.7-513.gb88fae66.el9 ceph 5.0 M 2024-02-16T22:06:48.323 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:17.2.7-513.gb88fae66.el9 ceph 23 M 2024-02-16T22:06:48.323 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:17.2.7-513.gb88fae66.el9 ceph 25 k 2024-02-16T22:06:48.323 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-16T22:06:48.323 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:17.2.7-513.gb88fae66.el9 ceph 635 k 2024-02-16T22:06:48.323 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-16T22:06:48.323 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-16T22:06:48.323 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-16T22:06:48.323 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:17.2.7-513.gb88fae66.el9 ceph 458 k 2024-02-16T22:06:48.323 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-16T22:06:48.323 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:17.2.7-513.gb88fae66.el9 ceph 4.9 M 2024-02-16T22:06:48.323 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-16T22:06:48.323 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-16T22:06:48.324 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse x86_64 2:17.2.7-513.gb88fae66.el9 ceph 45 k 2024-02-16T22:06:48.324 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:17.2.7-513.gb88fae66.el9 ceph 116 k 2024-02-16T22:06:48.324 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:17.2.7-513.gb88fae66.el9 ceph 156 k 2024-02-16T22:06:48.324 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-16T22:06:48.324 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:17.2.7-513.gb88fae66.el9 ceph 320 k 2024-02-16T22:06:48.324 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:17.2.7-513.gb88fae66.el9 ceph 293 k 2024-02-16T22:06:48.324 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:17.2.7-513.gb88fae66.el9 ceph 99 k 2024-02-16T22:06:48.324 INFO:teuthology.orchestra.run.smithi173.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-16T22:06:48.324 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:06:48.324 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:06:48.324 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:06:48.325 INFO:teuthology.orchestra.run.smithi173.stdout:Install 22 Packages 2024-02-16T22:06:48.325 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 2 Packages 2024-02-16T22:06:48.325 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:06:48.325 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 58 M 2024-02-16T22:06:48.325 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:06:48.379 INFO:teuthology.orchestra.run.smithi134.stdout:(8/24): python3-ceph-common-17.2.7-513.gb88fae6 1.2 MB/s | 116 kB 00:00 2024-02-16T22:06:48.405 INFO:teuthology.orchestra.run.smithi134.stdout:(9/24): python3-cephfs-17.2.7-513.gb88fae66.el9 1.7 MB/s | 156 kB 00:00 2024-02-16T22:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout:(10/24): python3-rados-17.2.7-513.gb88fae66.el9 3.1 MB/s | 320 kB 00:00 2024-02-16T22:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout:(11/24): python3-rbd-17.2.7-513.gb88fae66.el9.x 2.4 MB/s | 293 kB 00:00 2024-02-16T22:06:48.581 INFO:teuthology.orchestra.run.smithi134.stdout:(12/24): python3-rgw-17.2.7-513.gb88fae66.el9.x 990 kB/s | 99 kB 00:00 2024-02-16T22:06:48.914 INFO:teuthology.orchestra.run.smithi134.stdout:(13/24): ceph-common-17.2.7-513.gb88fae66.el9.x 5.9 MB/s | 23 MB 00:03 2024-02-16T22:06:48.989 INFO:teuthology.orchestra.run.smithi134.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 115 kB/s | 44 kB 00:00 2024-02-16T22:06:49.031 INFO:teuthology.orchestra.run.smithi134.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 313 kB/s | 159 kB 00:00 2024-02-16T22:06:49.357 INFO:teuthology.orchestra.run.smithi134.stdout:(16/24): librdkafka-1.6.1-102.el9.x86_64.rpm 1.5 MB/s | 661 kB 00:00 2024-02-16T22:06:49.407 INFO:teuthology.orchestra.run.smithi134.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 677 kB/s | 282 kB 00:00 2024-02-16T22:06:49.432 INFO:teuthology.orchestra.run.smithi134.stdout:(18/24): python3-prettytable-0.7.2-27.el9.noarc 103 kB/s | 41 kB 00:00 2024-02-16T22:06:49.533 INFO:teuthology.orchestra.run.smithi134.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 388 kB/s | 49 kB 00:00 2024-02-16T22:06:49.558 INFO:teuthology.orchestra.run.smithi134.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 538 kB/s | 67 kB 00:00 2024-02-16T22:06:49.583 INFO:teuthology.orchestra.run.smithi134.stdout:(21/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.3 MB/s | 309 kB 00:00 2024-02-16T22:06:49.884 INFO:teuthology.orchestra.run.smithi134.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 4.5 MB/s | 1.6 MB 00:00 2024-02-16T22:06:50.025 INFO:teuthology.orchestra.run.smithi134.stdout:(23/24): librbd1-17.2.7-513.gb88fae66.el9.x86_6 6.6 MB/s | 2.9 MB 00:00 2024-02-16T22:06:50.242 INFO:teuthology.orchestra.run.smithi134.stdout:(24/24): librados2-17.2.7-513.gb88fae66.el9.x86 4.5 MB/s | 3.1 MB 00:00 2024-02-16T22:06:50.247 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:06:50.247 INFO:teuthology.orchestra.run.smithi134.stdout:Total 11 MB/s | 58 MB 00:05 2024-02-16T22:06:50.247 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:06:50.280 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:06:50.280 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:06:50.326 INFO:teuthology.orchestra.run.smithi173.stdout:(1/24): ceph-radosgw-17.2.7-513.gb88fae66.el9.x 7.2 MB/s | 14 MB 00:01 2024-02-16T22:06:50.367 INFO:teuthology.orchestra.run.smithi173.stdout:(2/24): ceph-selinux-17.2.7-513.gb88fae66.el9.x 609 kB/s | 25 kB 00:00 2024-02-16T22:06:50.451 INFO:teuthology.orchestra.run.smithi173.stdout:(3/24): libcephfs2-17.2.7-513.gb88fae66.el9.x86 7.5 MB/s | 635 kB 00:00 2024-02-16T22:06:50.510 INFO:teuthology.orchestra.run.smithi173.stdout:(4/24): libradosstriper1-17.2.7-513.gb88fae66.e 7.7 MB/s | 458 kB 00:00 2024-02-16T22:06:50.750 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:06:50.750 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:06:50.810 INFO:teuthology.orchestra.run.smithi173.stdout:(5/24): librgw2-17.2.7-513.gb88fae66.el9.x86_64 16 MB/s | 4.9 MB 00:00 2024-02-16T22:06:50.852 INFO:teuthology.orchestra.run.smithi173.stdout:(6/24): python3-ceph-argparse-17.2.7-513.gb88fa 1.1 MB/s | 45 kB 00:00 2024-02-16T22:06:50.902 INFO:teuthology.orchestra.run.smithi173.stdout:(7/24): python3-ceph-common-17.2.7-513.gb88fae6 2.3 MB/s | 116 kB 00:00 2024-02-16T22:06:50.953 INFO:teuthology.orchestra.run.smithi173.stdout:(8/24): python3-cephfs-17.2.7-513.gb88fae66.el9 3.1 MB/s | 156 kB 00:00 2024-02-16T22:06:51.011 INFO:teuthology.orchestra.run.smithi173.stdout:(9/24): python3-rados-17.2.7-513.gb88fae66.el9. 5.4 MB/s | 320 kB 00:00 2024-02-16T22:06:51.095 INFO:teuthology.orchestra.run.smithi173.stdout:(10/24): ceph-base-17.2.7-513.gb88fae66.el9.x86 1.8 MB/s | 5.0 MB 00:02 2024-02-16T22:06:51.128 INFO:teuthology.orchestra.run.smithi173.stdout:(11/24): python3-rbd-17.2.7-513.gb88fae66.el9.x 2.4 MB/s | 293 kB 00:00 2024-02-16T22:06:51.179 INFO:teuthology.orchestra.run.smithi173.stdout:(12/24): python3-rgw-17.2.7-513.gb88fae66.el9.x 1.2 MB/s | 99 kB 00:00 2024-02-16T22:06:51.296 INFO:teuthology.orchestra.run.smithi173.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 493 kB/s | 44 kB 00:00 2024-02-16T22:06:51.321 INFO:teuthology.orchestra.run.smithi173.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 827 kB/s | 159 kB 00:00 2024-02-16T22:06:51.371 INFO:teuthology.orchestra.run.smithi173.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-02-16T22:06:51.397 INFO:teuthology.orchestra.run.smithi173.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-02-16T22:06:51.422 INFO:teuthology.orchestra.run.smithi173.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 828 kB/s | 41 kB 00:00 2024-02-16T22:06:51.664 INFO:teuthology.orchestra.run.smithi173.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 201 kB/s | 49 kB 00:00 2024-02-16T22:06:51.789 INFO:teuthology.orchestra.run.smithi173.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 788 kB/s | 309 kB 00:00 2024-02-16T22:06:51.815 INFO:teuthology.orchestra.run.smithi173.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 449 kB/s | 67 kB 00:00 2024-02-16T22:06:51.963 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:06:52.023 INFO:teuthology.orchestra.run.smithi173.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-02-16T22:06:52.352 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-02-16T22:06:52.378 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:17.2.7-513.gb88fae66.el9.x86_64 2/26 2024-02-16T22:06:52.415 INFO:teuthology.orchestra.run.smithi173.stdout:(22/24): librbd1-17.2.7-513.gb88fae66.el9.x86_6 7.5 MB/s | 2.9 MB 00:00 2024-02-16T22:06:52.469 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:17.2.7-513.gb88fae66.el9.x86_64 2/26 2024-02-16T22:06:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:17.2.7-513.gb88fae66.el9.x86_64 3/26 2024-02-16T22:06:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:17.2.7-513.gb88fae66.el9.x86_64 4/26 2024-02-16T22:06:52.641 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:17.2.7-513.gb88fae66.el9.x86_64 4/26 2024-02-16T22:06:52.666 INFO:teuthology.orchestra.run.smithi173.stdout:(23/24): ceph-common-17.2.7-513.gb88fae66.el9.x 5.2 MB/s | 23 MB 00:04 2024-02-16T22:06:52.696 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-02-16T22:06:52.724 INFO:teuthology.orchestra.run.smithi173.stdout:(24/24): librados2-17.2.7-513.gb88fae66.el9.x86 3.4 MB/s | 3.1 MB 00:00 2024-02-16T22:06:52.725 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-02-16T22:06:52.729 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:06:52.729 INFO:teuthology.orchestra.run.smithi173.stdout:Total 13 MB/s | 58 MB 00:04 2024-02-16T22:06:52.729 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:06:52.762 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:06:52.762 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:06:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-02-16T22:06:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:17.2.7-513.gb88fae66.el9.x86_64 8/26 2024-02-16T22:06:53.236 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:06:53.237 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:06:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:17.2.7-513.gb88fae66.el9.x86_64 8/26 2024-02-16T22:06:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-02-16T22:06:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:17.2.7-513.gb88fae66.el9.x 10/26 2024-02-16T22:06:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:17.2.7-513.gb88fae66.el9.x86_64 11/26 2024-02-16T22:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:17.2.7-513.gb88fae66.el9.x86_64 12/26 2024-02-16T22:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:17.2.7-513.gb88fae66.el9.x86_64 13/26 2024-02-16T22:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:17.2.7-513.gb88fae66.el9.x86_64 13/26 2024-02-16T22:06:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-02-16T22:06:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-02-16T22:06:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-02-16T22:06:53.952 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-02-16T22:06:53.980 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:17.2.7-513.gb88fae66.el9.x86_64 18/26 2024-02-16T22:06:54.053 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:17.2.7-513.gb88fae66.el9.x86_64 18/26 2024-02-16T22:06:54.126 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:17.2.7-513.gb88fae66.el9.x86_64 19/26 2024-02-16T22:06:54.150 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:17.2.7-513.gb88fae66.el9.x86 20/26 2024-02-16T22:06:54.550 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:06:54.885 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-02-16T22:06:54.943 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:17.2.7-513.gb88fae66.el9.x86_64 2/26 2024-02-16T22:06:55.018 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:17.2.7-513.gb88fae66.el9.x86_64 2/26 2024-02-16T22:06:55.097 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:17.2.7-513.gb88fae66.el9.x86_64 3/26 2024-02-16T22:06:55.136 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:17.2.7-513.gb88fae66.el9.x86_64 4/26 2024-02-16T22:06:55.209 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:17.2.7-513.gb88fae66.el9.x86_64 4/26 2024-02-16T22:06:55.259 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-02-16T22:06:55.292 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-02-16T22:06:55.726 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-02-16T22:06:55.756 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:17.2.7-513.gb88fae66.el9.x86_64 8/26 2024-02-16T22:06:55.802 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:17.2.7-513.gb88fae66.el9.x86_64 8/26 2024-02-16T22:06:55.831 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-02-16T22:06:55.874 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:17.2.7-513.gb88fae66.el9.x 10/26 2024-02-16T22:06:55.911 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:17.2.7-513.gb88fae66.el9.x86_64 11/26 2024-02-16T22:06:55.973 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:17.2.7-513.gb88fae66.el9.x86_64 12/26 2024-02-16T22:06:56.001 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:17.2.7-513.gb88fae66.el9.x86_64 13/26 2024-02-16T22:06:56.056 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:17.2.7-513.gb88fae66.el9.x86_64 13/26 2024-02-16T22:06:56.099 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-02-16T22:06:56.134 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-02-16T22:06:56.167 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-02-16T22:06:56.464 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-02-16T22:06:56.489 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:17.2.7-513.gb88fae66.el9.x86_64 18/26 2024-02-16T22:06:56.583 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:17.2.7-513.gb88fae66.el9.x86_64 18/26 2024-02-16T22:06:56.631 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:17.2.7-513.gb88fae66.el9.x86_64 21/26 2024-02-16T22:06:56.652 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:17.2.7-513.gb88fae66.el9.x86_64 19/26 2024-02-16T22:06:56.663 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:17.2.7-513.gb88fae66.el9.x86_64 21/26 2024-02-16T22:06:56.683 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:17.2.7-513.gb88fae66.el9.x86 20/26 2024-02-16T22:06:57.207 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:17.2.7-513.gb88fae66.el9.x86_64 21/26 2024-02-16T22:06:57.250 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:17.2.7-513.gb88fae66.el9.x86_64 22/26 2024-02-16T22:06:57.340 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:17.2.7-513.gb88fae66.el9.x86_64 22/26 2024-02-16T22:06:57.340 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-16T22:06:57.340 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-16T22:06:57.340 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:06:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:17.2.7-513.gb88fae66.el9.x86_64 23/26 2024-02-16T22:06:59.036 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:17.2.7-513.gb88fae66.el9.x86_64 21/26 2024-02-16T22:06:59.080 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:17.2.7-513.gb88fae66.el9.x86_64 21/26 2024-02-16T22:06:59.627 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:17.2.7-513.gb88fae66.el9.x86_64 21/26 2024-02-16T22:06:59.667 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:17.2.7-513.gb88fae66.el9.x86_64 22/26 2024-02-16T22:06:59.752 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:17.2.7-513.gb88fae66.el9.x86_64 22/26 2024-02-16T22:06:59.752 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-16T22:06:59.753 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-16T22:06:59.753 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:06:59.785 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:17.2.7-513.gb88fae66.el9.x86_64 23/26 2024-02-16T22:07:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:17.2.7-513.gb88fae66.el9.x86_64 23/26 2024-02-16T22:07:06.910 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-02-16T22:07:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-02-16T22:07:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-02-16T22:07:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-02-16T22:07:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-02-16T22:07:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-02-16T22:07:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-02-16T22:07:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:17.2.7-513.gb88fae66.el9.x86_64 24/26 2024-02-16T22:07:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-513.gb88fae66.el9.x86_64 24/26 2024-02-16T22:07:08.226 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T22:07:08.226 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-16T22:07:08.227 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-16T22:07:08.227 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-16T22:07:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-16T22:07:08.322 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-16T22:07:08.322 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-16T22:07:09.413 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:17.2.7-513.gb88fae66.el9.x86_64 23/26 2024-02-16T22:07:09.414 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2024-02-16T22:07:09.414 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2024-02-16T22:07:09.414 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2024-02-16T22:07:09.414 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2024-02-16T22:07:09.414 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2024-02-16T22:07:09.414 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /root 2024-02-16T22:07:09.414 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2024-02-16T22:07:09.414 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-16T22:07:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:17.2.7-513.gb88fae66.el9.x86_64 1/26 2024-02-16T22:07:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:17.2.7-513.gb88fae66.el9.x86_64 2/26 2024-02-16T22:07:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:17.2.7-513.gb88fae66.el9.x86_64 3/26 2024-02-16T22:07:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:17.2.7-513.gb88fae66.el9.x86_64 4/26 2024-02-16T22:07:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:17.2.7-513.gb88fae66.el9.x86_64 5/26 2024-02-16T22:07:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:17.2.7-513.gb88fae66.el9.x86_64 6/26 2024-02-16T22:07:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:17.2.7-513.gb88fae66.el9.x86_64 7/26 2024-02-16T22:07:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:17.2.7-513.gb88fae66.el9.x 8/26 2024-02-16T22:07:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:17.2.7-513.gb88fae66.el9.x86 9/26 2024-02-16T22:07:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:17.2.7-513.gb88fae66.el9.x86_64 10/26 2024-02-16T22:07:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:17.2.7-513.gb88fae66.el9.x86_64 11/26 2024-02-16T22:07:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:17.2.7-513.gb88fae66.el9.x86_64 12/26 2024-02-16T22:07:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:17.2.7-513.gb88fae66.el9.x86_64 13/26 2024-02-16T22:07:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-02-16T22:07:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-02-16T22:07:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-02-16T22:07:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-02-16T22:07:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-02-16T22:07:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-02-16T22:07:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-02-16T22:07:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-02-16T22:07:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-02-16T22:07:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:17.2.7-513.gb88fae66.el9.x86_64 23/26 2024-02-16T22:07:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-02-16T22:07:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:17.2.7-513.gb88fae66.el9.x86_64 25/26 2024-02-16T22:07:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-02-16T22:07:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:10.616 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-02-16T22:07:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.616 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:07:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-16T22:07:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-16T22:07:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-16T22:07:10.617 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:10.618 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:07:10.671 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:17.2.7-513.gb88fae66.el9.x86_64 24/26 2024-02-16T22:07:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-513.gb88fae66.el9.x86_64 24/26 2024-02-16T22:07:10.750 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T22:07:10.750 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-16T22:07:10.750 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-16T22:07:10.750 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-16T22:07:10.750 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:10.752 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-16T22:07:10.867 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-16T22:07:10.867 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-16T22:07:10.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-test 2024-02-16T22:07:11.505 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:29 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-02-16T22:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:17.2.7-513.gb88fae66.el9 ceph 48 M 2024-02-16T22:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-02-16T22:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-16T22:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:17.2.7-513.gb88fae66.el9 ceph 162 k 2024-02-16T22:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-16T22:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-16T22:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-16T22:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2024-02-16T22:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 49 M 2024-02-16T22:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 196 M 2024-02-16T22:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:07:11.912 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 300 kB 00:00 2024-02-16T22:07:11.967 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2024-02-16T22:07:12.068 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): jq-1.6-16.el9.x86_64.rpm 1.8 MB/s | 186 kB 00:00 2024-02-16T22:07:12.113 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-16T22:07:12.113 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:17.2.7-513.gb88fae66.el9.x86_64 1/26 2024-02-16T22:07:12.113 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:17.2.7-513.gb88fae66.el9.x86_64 2/26 2024-02-16T22:07:12.113 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:17.2.7-513.gb88fae66.el9.x86_64 3/26 2024-02-16T22:07:12.113 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:17.2.7-513.gb88fae66.el9.x86_64 4/26 2024-02-16T22:07:12.113 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:17.2.7-513.gb88fae66.el9.x86_64 5/26 2024-02-16T22:07:12.113 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:17.2.7-513.gb88fae66.el9.x86_64 6/26 2024-02-16T22:07:12.113 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:17.2.7-513.gb88fae66.el9.x86_64 7/26 2024-02-16T22:07:12.113 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:17.2.7-513.gb88fae66.el9.x 8/26 2024-02-16T22:07:12.113 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:17.2.7-513.gb88fae66.el9.x86 9/26 2024-02-16T22:07:12.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:17.2.7-513.gb88fae66.el9.x86_64 10/26 2024-02-16T22:07:12.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:17.2.7-513.gb88fae66.el9.x86_64 11/26 2024-02-16T22:07:12.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:17.2.7-513.gb88fae66.el9.x86_64 12/26 2024-02-16T22:07:12.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:17.2.7-513.gb88fae66.el9.x86_64 13/26 2024-02-16T22:07:12.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-02-16T22:07:12.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-02-16T22:07:12.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-02-16T22:07:12.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-02-16T22:07:12.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-02-16T22:07:12.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-02-16T22:07:12.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-02-16T22:07:12.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-02-16T22:07:12.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-02-16T22:07:12.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:17.2.7-513.gb88fae66.el9.x86_64 23/26 2024-02-16T22:07:12.115 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-02-16T22:07:12.115 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:17.2.7-513.gb88fae66.el9.x86_64 25/26 2024-02-16T22:07:12.151 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.5 MB/s | 217 kB 00:00 2024-02-16T22:07:12.210 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): libcephsqlite-17.2.7-513.gb88fae66.el9.x 304 kB/s | 162 kB 00:00 2024-02-16T22:07:13.140 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-02-16T22:07:13.140 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:13.140 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2024-02-16T22:07:13.140 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.140 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.140 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:07:13.140 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.140 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.141 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.141 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.141 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-16T22:07:13.141 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.141 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-16T22:07:13.141 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-16T22:07:13.141 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-16T22:07:13.141 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.141 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-16T22:07:13.141 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.141 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-16T22:07:13.141 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-16T22:07:13.141 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.142 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.142 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.142 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-16T22:07:13.142 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.142 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.143 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:13.143 INFO:teuthology.orchestra.run.smithi173.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-16T22:07:13.143 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:13.143 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:07:13.512 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-test 2024-02-16T22:07:14.091 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:29 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:07:14.258 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:07:14.259 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:07:14.259 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-02-16T22:07:14.259 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:07:14.259 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:07:14.259 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:17.2.7-513.gb88fae66.el9 ceph 48 M 2024-02-16T22:07:14.260 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-02-16T22:07:14.260 INFO:teuthology.orchestra.run.smithi173.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-16T22:07:14.260 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:17.2.7-513.gb88fae66.el9 ceph 162 k 2024-02-16T22:07:14.260 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-16T22:07:14.260 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-16T22:07:14.261 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-16T22:07:14.261 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:14.261 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:07:14.261 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:07:14.261 INFO:teuthology.orchestra.run.smithi173.stdout:Install 6 Packages 2024-02-16T22:07:14.261 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:14.262 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 49 M 2024-02-16T22:07:14.263 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 196 M 2024-02-16T22:07:14.263 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:07:14.679 INFO:teuthology.orchestra.run.smithi173.stdout:(1/6): socat-1.7.4.1-5.el9.x86_64.rpm 716 kB/s | 300 kB 00:00 2024-02-16T22:07:14.822 INFO:teuthology.orchestra.run.smithi173.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 441 kB/s | 63 kB 00:00 2024-02-16T22:07:14.972 INFO:teuthology.orchestra.run.smithi173.stdout:(3/6): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 186 kB 00:00 2024-02-16T22:07:15.047 INFO:teuthology.orchestra.run.smithi173.stdout:(4/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2024-02-16T22:07:15.347 INFO:teuthology.orchestra.run.smithi173.stdout:(5/6): libcephsqlite-17.2.7-513.gb88fae66.el9.x 149 kB/s | 162 kB 00:01 2024-02-16T22:07:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:(6/6): ceph-test-17.2.7-513.gb88fae66.el9.x86_6 12 MB/s | 48 MB 00:03 2024-02-16T22:07:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:07:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:Total 13 MB/s | 49 MB 00:03 2024-02-16T22:07:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:07:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:07:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:07:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:07:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:07:19.142 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:07:19.214 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-16T22:07:19.254 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-16T22:07:19.297 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-16T22:07:19.338 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-16T22:07:19.365 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:17.2.7-513.gb88fae66.el9.x86_64 5/6 2024-02-16T22:07:23.831 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:17.2.7-513.gb88fae66.el9.x86_64 5/6 2024-02-16T22:07:23.900 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:17.2.7-513.gb88fae66.el9.x86_64 6/6 2024-02-16T22:07:24.943 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): ceph-test-17.2.7-513.gb88fae66.el9.x86_6 3.6 MB/s | 48 MB 00:13 2024-02-16T22:07:24.945 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:07:24.945 INFO:teuthology.orchestra.run.smithi134.stdout:Total 3.7 MB/s | 49 MB 00:13 2024-02-16T22:07:24.945 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:07:24.962 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:07:24.962 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:07:25.342 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:07:25.343 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:07:25.937 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:07:26.017 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-16T22:07:26.050 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-16T22:07:26.094 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-16T22:07:26.134 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-16T22:07:26.161 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:17.2.7-513.gb88fae66.el9.x86_64 5/6 2024-02-16T22:07:26.212 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-test-2:17.2.7-513.gb88fae66.el9.x86_64 6/6 2024-02-16T22:07:26.212 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:17.2.7-513.gb88fae66.el9.x86_64 1/6 2024-02-16T22:07:26.213 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:17.2.7-513.gb88fae66.el9.x86_64 2/6 2024-02-16T22:07:26.213 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-16T22:07:26.213 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-16T22:07:26.213 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-16T22:07:26.557 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-16T22:07:26.557 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:26.557 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:07:26.557 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:26.558 INFO:teuthology.orchestra.run.smithi173.stdout: jq-1.6-16.el9.x86_64 2024-02-16T22:07:26.558 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:26.558 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-16T22:07:26.558 INFO:teuthology.orchestra.run.smithi173.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-16T22:07:26.558 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-16T22:07:26.558 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:26.558 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:07:26.866 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph 2024-02-16T22:07:27.469 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:42 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:07:27.655 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:07:27.658 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================== 2024-02-16T22:07:27.658 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-02-16T22:07:27.658 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================== 2024-02-16T22:07:27.658 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:07:27.658 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:17.2.7-513.gb88fae66.el9 ceph 6.5 k 2024-02-16T22:07:27.658 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-02-16T22:07:27.658 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:17.2.7-513.gb88fae66.el9 ceph 2.1 M 2024-02-16T22:07:27.658 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:17.2.7-513.gb88fae66.el9 ceph 1.4 M 2024-02-16T22:07:27.659 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 239 k 2024-02-16T22:07:27.659 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:17.2.7-513.gb88fae66.el9 ceph 3.7 M 2024-02-16T22:07:27.659 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:17.2.7-513.gb88fae66.el9 ceph 15 M 2024-02-16T22:07:27.659 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-16T22:07:27.659 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-16T22:07:27.659 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-16T22:07:27.659 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-16T22:07:27.659 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-16T22:07:27.659 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-16T22:07:27.659 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-16T22:07:27.659 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-16T22:07:27.659 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-16T22:07:27.659 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-16T22:07:27.659 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-16T22:07:27.660 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-16T22:07:27.660 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-16T22:07:27.660 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-16T22:07:27.660 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-16T22:07:27.660 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-16T22:07:27.660 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-16T22:07:27.660 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-16T22:07:27.660 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-16T22:07:27.660 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-16T22:07:27.660 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-16T22:07:27.660 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-16T22:07:27.660 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-16T22:07:27.660 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-16T22:07:27.661 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-16T22:07:27.661 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-16T22:07:27.661 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-16T22:07:27.661 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:27.661 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:07:27.661 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================== 2024-02-16T22:07:27.661 INFO:teuthology.orchestra.run.smithi173.stdout:Install 33 Packages 2024-02-16T22:07:27.661 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:27.662 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 27 M 2024-02-16T22:07:27.662 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 99 M 2024-02-16T22:07:27.662 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:07:28.107 INFO:teuthology.orchestra.run.smithi173.stdout:(1/33): ceph-17.2.7-513.gb88fae66.el9.x86_64.rp 42 kB/s | 6.5 kB 00:00 2024-02-16T22:07:28.416 INFO:teuthology.orchestra.run.smithi173.stdout:(2/33): ceph-mgr-17.2.7-513.gb88fae66.el9.x86_6 3.0 MB/s | 1.4 MB 00:00 2024-02-16T22:07:28.500 INFO:teuthology.orchestra.run.smithi173.stdout:(3/33): ceph-mds-17.2.7-513.gb88fae66.el9.x86_6 3.8 MB/s | 2.1 MB 00:00 2024-02-16T22:07:28.567 INFO:teuthology.orchestra.run.smithi173.stdout:(4/33): ceph-mgr-modules-core-17.2.7-513.gb88fa 3.5 MB/s | 239 kB 00:00 2024-02-16T22:07:28.700 INFO:teuthology.orchestra.run.smithi173.stdout:(5/33): ceph-mon-17.2.7-513.gb88fae66.el9.x86_6 6.2 MB/s | 3.7 MB 00:00 2024-02-16T22:07:28.759 INFO:teuthology.orchestra.run.smithi173.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 553 kB/s | 32 kB 00:00 2024-02-16T22:07:28.801 INFO:teuthology.orchestra.run.smithi173.stdout:(7/33): python3-mako-1.1.4-6.el9.noarch.rpm 617 kB/s | 144 kB 00:00 2024-02-16T22:07:28.817 INFO:teuthology.orchestra.run.smithi173.stdout:(8/33): python3-pytz-2021.1-5.el9.noarch.rpm 809 kB/s | 47 kB 00:00 2024-02-16T22:07:28.834 INFO:teuthology.orchestra.run.smithi173.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-02-16T22:07:28.868 INFO:teuthology.orchestra.run.smithi173.stdout:(10/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-02-16T22:07:28.927 INFO:teuthology.orchestra.run.smithi173.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 12 MB/s | 1.1 MB 00:00 2024-02-16T22:07:28.952 INFO:teuthology.orchestra.run.smithi173.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-02-16T22:07:28.977 INFO:teuthology.orchestra.run.smithi173.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-02-16T22:07:29.003 INFO:teuthology.orchestra.run.smithi173.stdout:(14/33): python3-requests-2.25.1-8.el9.noarch.r 2.2 MB/s | 113 kB 00:00 2024-02-16T22:07:29.028 INFO:teuthology.orchestra.run.smithi173.stdout:(15/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 187 kB 00:00 2024-02-16T22:07:29.087 INFO:teuthology.orchestra.run.smithi173.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 521 kB/s | 43 kB 00:00 2024-02-16T22:07:29.112 INFO:teuthology.orchestra.run.smithi173.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-02-16T22:07:29.145 INFO:teuthology.orchestra.run.smithi173.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 321 kB/s | 11 kB 00:00 2024-02-16T22:07:29.171 INFO:teuthology.orchestra.run.smithi173.stdout:(19/33): python3-cherrypy-18.6.1-2.el9.noarch.r 4.2 MB/s | 358 kB 00:00 2024-02-16T22:07:29.196 INFO:teuthology.orchestra.run.smithi173.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 351 kB/s | 18 kB 00:00 2024-02-16T22:07:29.222 INFO:teuthology.orchestra.run.smithi173.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-02-16T22:07:29.246 INFO:teuthology.orchestra.run.smithi173.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-02-16T22:07:29.272 INFO:teuthology.orchestra.run.smithi173.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-02-16T22:07:29.297 INFO:teuthology.orchestra.run.smithi173.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-02-16T22:07:29.322 INFO:teuthology.orchestra.run.smithi173.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-02-16T22:07:29.356 INFO:teuthology.orchestra.run.smithi173.stdout:(26/33): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-02-16T22:07:29.381 INFO:teuthology.orchestra.run.smithi173.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 279 kB/s | 16 kB 00:00 2024-02-16T22:07:29.406 INFO:teuthology.orchestra.run.smithi173.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-02-16T22:07:29.432 INFO:teuthology.orchestra.run.smithi173.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 710 kB/s | 36 kB 00:00 2024-02-16T22:07:29.457 INFO:teuthology.orchestra.run.smithi173.stdout:(30/33): python3-webob-1.8.7-6.el9.noarch.rpm 4.4 MB/s | 230 kB 00:00 2024-02-16T22:07:29.491 INFO:teuthology.orchestra.run.smithi173.stdout:(31/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 7.1 MB/s | 427 kB 00:00 2024-02-16T22:07:29.591 INFO:teuthology.orchestra.run.smithi173.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 149 kB/s | 20 kB 00:00 2024-02-16T22:07:29.917 INFO:teuthology.orchestra.run.smithi173.stdout:(33/33): ceph-osd-17.2.7-513.gb88fae66.el9.x86_ 10 MB/s | 15 MB 00:01 2024-02-16T22:07:29.920 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:07:29.920 INFO:teuthology.orchestra.run.smithi173.stdout:Total 12 MB/s | 27 MB 00:02 2024-02-16T22:07:29.920 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:07:29.957 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:07:29.957 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:07:30.304 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:07:30.304 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:07:30.561 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:17.2.7-513.gb88fae66.el9.x86_64 5/6 2024-02-16T22:07:30.636 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:17.2.7-513.gb88fae66.el9.x86_64 6/6 2024-02-16T22:07:31.546 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:07:31.603 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-16T22:07:31.635 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-16T22:07:31.667 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-16T22:07:31.758 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-16T22:07:31.837 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-16T22:07:31.879 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-16T22:07:31.958 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-16T22:07:32.013 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-02-16T22:07:32.051 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-02-16T22:07:32.100 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-02-16T22:07:32.155 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-02-16T22:07:32.347 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-02-16T22:07:32.397 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-02-16T22:07:32.427 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-02-16T22:07:32.462 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-02-16T22:07:32.492 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-16T22:07:32.559 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-02-16T22:07:32.595 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-16T22:07:32.627 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-02-16T22:07:32.667 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-02-16T22:07:32.702 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-02-16T22:07:32.737 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-02-16T22:07:32.826 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-02-16T22:07:32.878 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-02-16T22:07:32.956 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-02-16T22:07:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-test-2:17.2.7-513.gb88fae66.el9.x86_64 6/6 2024-02-16T22:07:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:17.2.7-513.gb88fae66.el9.x86_64 1/6 2024-02-16T22:07:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:17.2.7-513.gb88fae66.el9.x86_64 2/6 2024-02-16T22:07:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-16T22:07:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-16T22:07:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-16T22:07:33.092 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-02-16T22:07:33.208 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-16T22:07:33.364 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-513.gb88fae66.el9.n 28/33 2024-02-16T22:07:33.389 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:17.2.7-513.gb88fae66.el9.x86_64 29/33 2024-02-16T22:07:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-16T22:07:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:33.395 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:07:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: jq-1.6-16.el9.x86_64 2024-02-16T22:07:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-16T22:07:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-16T22:07:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-16T22:07:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:33.395 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:07:33.414 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:17.2.7-513.gb88fae66.el9.x86_64 29/33 2024-02-16T22:07:33.415 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T22:07:33.415 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-16T22:07:33.415 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-16T22:07:33.415 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-16T22:07:33.415 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:33.684 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph 2024-02-16T22:07:34.274 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:52 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:07:34.452 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:07:34.454 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================== 2024-02-16T22:07:34.454 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-02-16T22:07:34.454 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================== 2024-02-16T22:07:34.454 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:07:34.454 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:17.2.7-513.gb88fae66.el9 ceph 6.5 k 2024-02-16T22:07:34.455 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-02-16T22:07:34.455 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:17.2.7-513.gb88fae66.el9 ceph 2.1 M 2024-02-16T22:07:34.455 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:17.2.7-513.gb88fae66.el9 ceph 1.4 M 2024-02-16T22:07:34.455 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 239 k 2024-02-16T22:07:34.455 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:17.2.7-513.gb88fae66.el9 ceph 3.7 M 2024-02-16T22:07:34.455 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:17.2.7-513.gb88fae66.el9 ceph 15 M 2024-02-16T22:07:34.455 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-16T22:07:34.455 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-16T22:07:34.455 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-16T22:07:34.455 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-16T22:07:34.455 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-16T22:07:34.455 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-16T22:07:34.455 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-16T22:07:34.456 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-16T22:07:34.456 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-16T22:07:34.456 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-16T22:07:34.456 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-16T22:07:34.456 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-16T22:07:34.456 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-16T22:07:34.456 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-16T22:07:34.456 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-16T22:07:34.456 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-16T22:07:34.456 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-16T22:07:34.456 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-16T22:07:34.456 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-16T22:07:34.456 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-16T22:07:34.456 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-16T22:07:34.457 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-16T22:07:34.457 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-16T22:07:34.457 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-16T22:07:34.457 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-16T22:07:34.457 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-16T22:07:34.457 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-16T22:07:34.457 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:34.457 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:07:34.457 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================== 2024-02-16T22:07:34.457 INFO:teuthology.orchestra.run.smithi134.stdout:Install 33 Packages 2024-02-16T22:07:34.457 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:34.458 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 27 M 2024-02-16T22:07:34.458 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 99 M 2024-02-16T22:07:34.458 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:07:34.749 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:17.2.7-513.gb88fae66.el9.x86_64 30/33 2024-02-16T22:07:34.775 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:17.2.7-513.gb88fae66.el9.x86_64 30/33 2024-02-16T22:07:34.775 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T22:07:34.775 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-16T22:07:34.775 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-16T22:07:34.775 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-16T22:07:34.775 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:35.001 INFO:teuthology.orchestra.run.smithi134.stdout:(1/33): ceph-17.2.7-513.gb88fae66.el9.x86_64.rp 19 kB/s | 6.5 kB 00:00 2024-02-16T22:07:35.157 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:17.2.7-513.gb88fae66.el9.x86_64 31/33 2024-02-16T22:07:35.181 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:17.2.7-513.gb88fae66.el9.x86_64 31/33 2024-02-16T22:07:35.181 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T22:07:35.181 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-16T22:07:35.181 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-16T22:07:35.181 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-16T22:07:35.181 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:35.383 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:17.2.7-513.gb88fae66.el9.x86_64 32/33 2024-02-16T22:07:35.393 INFO:teuthology.orchestra.run.smithi134.stdout:(2/33): ceph-mgr-17.2.7-513.gb88fae66.el9.x86_6 1.9 MB/s | 1.4 MB 00:00 2024-02-16T22:07:35.406 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:17.2.7-513.gb88fae66.el9.x86_64 32/33 2024-02-16T22:07:35.406 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T22:07:35.406 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-16T22:07:35.406 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-16T22:07:35.406 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-16T22:07:35.407 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:35.472 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:17.2.7-513.gb88fae66.el9.x86_64 33/33 2024-02-16T22:07:36.185 INFO:teuthology.orchestra.run.smithi134.stdout:(3/33): ceph-mds-17.2.7-513.gb88fae66.el9.x86_6 1.4 MB/s | 2.1 MB 00:01 2024-02-16T22:07:36.352 INFO:teuthology.orchestra.run.smithi134.stdout:(4/33): ceph-mgr-modules-core-17.2.7-513.gb88fa 1.4 MB/s | 239 kB 00:00 2024-02-16T22:07:36.469 INFO:teuthology.orchestra.run.smithi134.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 144 kB 00:00 2024-02-16T22:07:36.511 INFO:teuthology.orchestra.run.smithi134.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 757 kB/s | 32 kB 00:00 2024-02-16T22:07:36.561 INFO:teuthology.orchestra.run.smithi134.stdout:(7/33): python3-pytz-2021.1-5.el9.noarch.rpm 948 kB/s | 47 kB 00:00 2024-02-16T22:07:36.628 INFO:teuthology.orchestra.run.smithi134.stdout:(8/33): ceph-mon-17.2.7-513.gb88fae66.el9.x86_6 2.3 MB/s | 3.7 MB 00:01 2024-02-16T22:07:36.653 INFO:teuthology.orchestra.run.smithi134.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 420 kB/s | 39 kB 00:00 2024-02-16T22:07:36.687 INFO:teuthology.orchestra.run.smithi134.stdout:(10/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-02-16T22:07:36.745 INFO:teuthology.orchestra.run.smithi134.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 13 MB/s | 1.1 MB 00:00 2024-02-16T22:07:36.771 INFO:teuthology.orchestra.run.smithi134.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-02-16T22:07:36.796 INFO:teuthology.orchestra.run.smithi134.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-02-16T22:07:36.821 INFO:teuthology.orchestra.run.smithi134.stdout:(14/33): python3-requests-2.25.1-8.el9.noarch.r 2.2 MB/s | 113 kB 00:00 2024-02-16T22:07:36.846 INFO:teuthology.orchestra.run.smithi134.stdout:(15/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2024-02-16T22:07:37.152 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-2:17.2.7-513.gb88fae66.el9.x86_64 33/33 2024-02-16T22:07:37.152 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:17.2.7-513.gb88fae66.el9.x86_64 1/33 2024-02-16T22:07:37.152 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:17.2.7-513.gb88fae66.el9.x86_64 2/33 2024-02-16T22:07:37.152 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:17.2.7-513.gb88fae66.el9.x86_64 3/33 2024-02-16T22:07:37.152 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:17.2.7-513.gb88fae66.el9.x86_64 4/33 2024-02-16T22:07:37.152 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:17.2.7-513.gb88fae66.el9.x86_64 5/33 2024-02-16T22:07:37.152 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-513.gb88fae66.el9.n 6/33 2024-02-16T22:07:37.152 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-02-16T22:07:37.152 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-02-16T22:07:37.153 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-02-16T22:07:37.153 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-02-16T22:07:37.153 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-02-16T22:07:37.153 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-02-16T22:07:37.153 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-02-16T22:07:37.153 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-02-16T22:07:37.153 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 15/33 2024-02-16T22:07:37.153 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-16T22:07:37.154 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-16T22:07:37.155 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-16T22:07:37.847 INFO:teuthology.orchestra.run.smithi134.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 42 kB/s | 43 kB 00:01 2024-02-16T22:07:37.973 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-16T22:07:37.973 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:37.973 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:07:37.973 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:37.974 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:37.974 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:37.974 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:07:37.974 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:37.974 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:37.974 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-16T22:07:37.974 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-16T22:07:37.974 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-16T22:07:37.974 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-16T22:07:37.974 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-16T22:07:37.974 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-16T22:07:37.974 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-16T22:07:37.974 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-16T22:07:37.974 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply-3.11-14.el9.noarch 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-16T22:07:37.975 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-16T22:07:37.976 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-16T22:07:37.976 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-16T22:07:37.976 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-16T22:07:37.976 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:37.976 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:07:38.286 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-base 2024-02-16T22:07:38.314 INFO:teuthology.orchestra.run.smithi134.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 117 kB/s | 172 kB 00:01 2024-02-16T22:07:38.756 INFO:teuthology.orchestra.run.smithi134.stdout:(18/33): python3-cherrypy-18.6.1-2.el9.noarch.r 395 kB/s | 358 kB 00:00 2024-02-16T22:07:38.781 INFO:teuthology.orchestra.run.smithi134.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 23 kB/s | 11 kB 00:00 2024-02-16T22:07:38.868 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:53 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:07:38.980 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-base-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:07:38.981 INFO:teuthology.orchestra.run.smithi134.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 78 kB/s | 18 kB 00:00 2024-02-16T22:07:39.006 INFO:teuthology.orchestra.run.smithi134.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 103 kB/s | 23 kB 00:00 2024-02-16T22:07:39.031 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:07:39.032 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-02-16T22:07:39.032 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:07:39.094 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install cephadm 2024-02-16T22:07:39.215 INFO:teuthology.orchestra.run.smithi134.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 83 kB/s | 19 kB 00:00 2024-02-16T22:07:39.391 INFO:teuthology.orchestra.run.smithi134.stdout:(23/33): ceph-osd-17.2.7-513.gb88fae66.el9.x86_ 3.8 MB/s | 15 MB 00:03 2024-02-16T22:07:39.407 INFO:teuthology.orchestra.run.smithi134.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 49 kB/s | 20 kB 00:00 2024-02-16T22:07:39.449 INFO:teuthology.orchestra.run.smithi134.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 198 kB/s | 46 kB 00:00 2024-02-16T22:07:39.666 INFO:teuthology.orchestra.run.smithi134.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 287 kB/s | 79 kB 00:00 2024-02-16T22:07:39.669 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:54 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:07:39.758 INFO:teuthology.orchestra.run.smithi134.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 777 kB/s | 272 kB 00:00 2024-02-16T22:07:39.775 INFO:teuthology.orchestra.run.smithi134.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 50 kB/s | 16 kB 00:00 2024-02-16T22:07:39.832 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:07:39.833 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:07:39.833 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-02-16T22:07:39.834 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:07:39.834 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:07:39.834 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 80 k 2024-02-16T22:07:39.834 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:39.834 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:07:39.834 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:07:39.834 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-02-16T22:07:39.834 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:39.834 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 80 k 2024-02-16T22:07:39.834 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 364 k 2024-02-16T22:07:39.834 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:07:39.942 INFO:teuthology.orchestra.run.smithi134.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 327 kB/s | 90 kB 00:00 2024-02-16T22:07:40.008 INFO:teuthology.orchestra.run.smithi134.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 143 kB/s | 36 kB 00:00 2024-02-16T22:07:40.084 INFO:teuthology.orchestra.run.smithi134.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 744 kB/s | 230 kB 00:00 2024-02-16T22:07:40.309 INFO:teuthology.orchestra.run.smithi134.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.1 MB/s | 427 kB 00:00 2024-02-16T22:07:40.326 INFO:teuthology.orchestra.run.smithi134.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 63 kB/s | 20 kB 00:00 2024-02-16T22:07:40.332 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:07:40.332 INFO:teuthology.orchestra.run.smithi134.stdout:Total 4.5 MB/s | 27 MB 00:05 2024-02-16T22:07:40.332 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:07:40.371 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:07:40.371 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:07:40.582 INFO:teuthology.orchestra.run.smithi173.stdout:cephadm-17.2.7-513.gb88fae66.el9.noarch.rpm 108 kB/s | 80 kB 00:00 2024-02-16T22:07:40.582 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:07:40.583 INFO:teuthology.orchestra.run.smithi173.stdout:Total 107 kB/s | 80 kB 00:00 2024-02-16T22:07:40.583 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:07:40.588 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:07:40.588 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:07:40.590 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:07:40.590 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:07:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:07:40.713 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:07:40.713 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:07:41.134 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:17.2.7-513.gb88fae66.el9.noarch 1/1 2024-02-16T22:07:41.238 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:17.2.7-513.gb88fae66.el9.noarch 1/1 2024-02-16T22:07:41.611 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:17.2.7-513.gb88fae66.el9.noarch 1/1 2024-02-16T22:07:41.899 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:17.2.7-513.gb88fae66.el9.noarch 1/1 2024-02-16T22:07:41.899 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:41.900 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:07:41.900 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:07:41.900 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:41.900 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:07:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:07:42.004 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-16T22:07:42.036 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-16T22:07:42.069 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-16T22:07:42.096 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-immutable-object-cache 2024-02-16T22:07:42.161 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-16T22:07:42.231 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-16T22:07:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-16T22:07:42.343 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-16T22:07:42.404 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-02-16T22:07:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-02-16T22:07:42.502 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-02-16T22:07:42.556 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-02-16T22:07:42.677 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:57 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:07:42.741 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-02-16T22:07:42.789 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-02-16T22:07:42.820 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-02-16T22:07:42.852 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:07:42.853 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:07:42.853 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-02-16T22:07:42.853 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:07:42.853 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:07:42.853 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-513.gb88fae66.el9 ceph 137 k 2024-02-16T22:07:42.853 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:42.853 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:07:42.853 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:07:42.854 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-02-16T22:07:42.854 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:42.854 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 137 k 2024-02-16T22:07:42.854 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 379 k 2024-02-16T22:07:42.854 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:07:42.854 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-02-16T22:07:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-16T22:07:42.960 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-02-16T22:07:42.995 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-16T22:07:43.028 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-02-16T22:07:43.068 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-02-16T22:07:43.080 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-immutable-object-cache-17.2.7-513.gb88fae6 606 kB/s | 137 kB 00:00 2024-02-16T22:07:43.080 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:07:43.081 INFO:teuthology.orchestra.run.smithi173.stdout:Total 603 kB/s | 137 kB 00:00 2024-02-16T22:07:43.081 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:07:43.088 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:07:43.088 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:07:43.103 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-02-16T22:07:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-02-16T22:07:43.139 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:07:43.139 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:07:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-02-16T22:07:43.272 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-02-16T22:07:43.279 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:07:43.358 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-02-16T22:07:43.361 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-513.gb88fae66.e 1/1 2024-02-16T22:07:43.385 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-513.gb88fae66.e 1/1 2024-02-16T22:07:43.385 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T22:07:43.385 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-16T22:07:43.386 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:43.510 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-02-16T22:07:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-16T22:07:43.800 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-513.gb88fae66.el9.n 28/33 2024-02-16T22:07:43.831 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:17.2.7-513.gb88fae66.el9.x86_64 29/33 2024-02-16T22:07:43.857 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:17.2.7-513.gb88fae66.el9.x86_64 29/33 2024-02-16T22:07:43.857 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T22:07:43.857 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-16T22:07:43.858 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-16T22:07:43.858 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-16T22:07:43.858 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:44.354 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-513.gb88fae66.e 1/1 2024-02-16T22:07:44.354 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:44.354 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:07:44.354 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:44.354 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:44.354 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:07:44.627 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr 2024-02-16T22:07:45.190 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:17.2.7-513.gb88fae66.el9.x86_64 30/33 2024-02-16T22:07:45.215 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:00 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:07:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:17.2.7-513.gb88fae66.el9.x86_64 30/33 2024-02-16T22:07:45.217 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T22:07:45.217 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-16T22:07:45.217 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-16T22:07:45.217 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-16T22:07:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:45.331 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-mgr-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:07:45.382 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:07:45.383 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-02-16T22:07:45.383 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:07:45.455 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-dashboard 2024-02-16T22:07:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:17.2.7-513.gb88fae66.el9.x86_64 31/33 2024-02-16T22:07:45.614 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:17.2.7-513.gb88fae66.el9.x86_64 31/33 2024-02-16T22:07:45.614 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T22:07:45.614 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-16T22:07:45.614 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-16T22:07:45.614 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-16T22:07:45.615 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:45.817 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:17.2.7-513.gb88fae66.el9.x86_64 32/33 2024-02-16T22:07:45.840 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:17.2.7-513.gb88fae66.el9.x86_64 32/33 2024-02-16T22:07:45.841 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T22:07:45.841 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-16T22:07:45.841 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-16T22:07:45.841 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-16T22:07:45.841 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:45.934 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:17.2.7-513.gb88fae66.el9.x86_64 33/33 2024-02-16T22:07:46.027 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:01 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:07:46.194 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:07:46.194 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:07:46.195 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-02-16T22:07:46.195 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:07:46.195 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:07:46.195 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 1.7 M 2024-02-16T22:07:46.195 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-02-16T22:07:46.195 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 23 k 2024-02-16T22:07:46.195 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 15 k 2024-02-16T22:07:46.195 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-16T22:07:46.195 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-16T22:07:46.195 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-16T22:07:46.195 INFO:teuthology.orchestra.run.smithi173.stdout:Installing weak dependencies: 2024-02-16T22:07:46.195 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-16T22:07:46.195 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:46.195 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:07:46.196 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:07:46.196 INFO:teuthology.orchestra.run.smithi173.stdout:Install 7 Packages 2024-02-16T22:07:46.196 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:46.196 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 2.0 M 2024-02-16T22:07:46.196 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 8.1 M 2024-02-16T22:07:46.196 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:07:46.592 INFO:teuthology.orchestra.run.smithi173.stdout:(1/7): ceph-grafana-dashboards-17.2.7-513.gb88f 96 kB/s | 23 kB 00:00 2024-02-16T22:07:46.633 INFO:teuthology.orchestra.run.smithi173.stdout:(2/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 217 kB/s | 9.0 kB 00:00 2024-02-16T22:07:46.675 INFO:teuthology.orchestra.run.smithi173.stdout:(3/7): python3-jwt-2.4.0-1.el9.noarch.rpm 980 kB/s | 41 kB 00:00 2024-02-16T22:07:46.701 INFO:teuthology.orchestra.run.smithi173.stdout:(4/7): ceph-prometheus-alerts-17.2.7-513.gb88fa 41 kB/s | 15 kB 00:00 2024-02-16T22:07:46.726 INFO:teuthology.orchestra.run.smithi173.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 609 kB/s | 31 kB 00:00 2024-02-16T22:07:46.793 INFO:teuthology.orchestra.run.smithi173.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.0 MB/s | 188 kB 00:00 2024-02-16T22:07:47.527 INFO:teuthology.orchestra.run.smithi173.stdout:(7/7): ceph-mgr-dashboard-17.2.7-513.gb88fae66. 1.4 MB/s | 1.7 MB 00:01 2024-02-16T22:07:47.528 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:07:47.529 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.5 MB/s | 2.0 MB 00:01 2024-02-16T22:07:47.529 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:07:47.537 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:07:47.537 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:07:47.602 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:07:47.603 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:07:47.677 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-2:17.2.7-513.gb88fae66.el9.x86_64 33/33 2024-02-16T22:07:47.677 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:17.2.7-513.gb88fae66.el9.x86_64 1/33 2024-02-16T22:07:47.677 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:17.2.7-513.gb88fae66.el9.x86_64 2/33 2024-02-16T22:07:47.677 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:17.2.7-513.gb88fae66.el9.x86_64 3/33 2024-02-16T22:07:47.677 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:17.2.7-513.gb88fae66.el9.x86_64 4/33 2024-02-16T22:07:47.677 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:17.2.7-513.gb88fae66.el9.x86_64 5/33 2024-02-16T22:07:47.677 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-513.gb88fae66.el9.n 6/33 2024-02-16T22:07:47.677 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-02-16T22:07:47.677 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-02-16T22:07:47.677 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-02-16T22:07:47.677 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 15/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-16T22:07:47.678 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-16T22:07:47.679 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-16T22:07:47.680 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-16T22:07:47.680 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-16T22:07:47.680 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-16T22:07:47.680 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-16T22:07:47.680 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-16T22:07:47.680 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-16T22:07:47.905 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:07:47.969 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-16T22:07:48.003 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-16T22:07:48.057 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-16T22:07:48.099 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-16T22:07:48.127 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-513.gb88fae66.el9.no 5/7 2024-02-16T22:07:48.358 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-513.gb88fae66.el9.n 6/7 2024-02-16T22:07:48.389 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-513.gb88fae66.el9.noarch 7/7 2024-02-16T22:07:48.598 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-16T22:07:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:48.599 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:07:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:07:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-16T22:07:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-16T22:07:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-16T22:07:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-16T22:07:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-16T22:07:48.600 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-16T22:07:48.600 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-16T22:07:48.600 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-16T22:07:48.600 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-16T22:07:48.600 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-16T22:07:48.600 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-16T22:07:48.600 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-16T22:07:48.600 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-16T22:07:48.600 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-16T22:07:48.600 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-16T22:07:48.600 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-02-16T22:07:48.600 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-16T22:07:48.600 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-16T22:07:48.600 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-16T22:07:48.601 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-16T22:07:48.601 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-16T22:07:48.601 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-16T22:07:48.601 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-16T22:07:48.601 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-16T22:07:48.601 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-16T22:07:48.601 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-16T22:07:48.601 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-16T22:07:48.601 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:48.601 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:07:48.893 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-513.gb88fae66.el9.noarch 7/7 2024-02-16T22:07:48.893 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-513.gb88fae66.el9.n 1/7 2024-02-16T22:07:48.894 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-513.gb88fae66.el9.noarch 2/7 2024-02-16T22:07:48.894 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-513.gb88fae66.el9.no 3/7 2024-02-16T22:07:48.894 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-16T22:07:48.894 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-16T22:07:48.894 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-16T22:07:48.974 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-base 2024-02-16T22:07:49.197 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-16T22:07:49.198 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:49.198 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:07:49.198 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:07:49.198 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:07:49.198 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:07:49.198 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-16T22:07:49.198 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-16T22:07:49.198 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-16T22:07:49.198 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-16T22:07:49.198 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:49.198 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:07:49.422 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-16T22:07:49.562 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:07 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:07:49.676 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-base-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:07:49.726 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:07:49.727 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-02-16T22:07:49.727 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:07:49.807 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install cephadm 2024-02-16T22:07:49.996 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:04 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:07:50.164 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:07:50.165 INFO:teuthology.orchestra.run.smithi173.stdout:=========================================================================================== 2024-02-16T22:07:50.165 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-02-16T22:07:50.165 INFO:teuthology.orchestra.run.smithi173.stdout:=========================================================================================== 2024-02-16T22:07:50.165 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:07:50.165 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 7.4 M 2024-02-16T22:07:50.165 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-02-16T22:07:50.165 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-16T22:07:50.165 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-16T22:07:50.165 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-16T22:07:50.166 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-16T22:07:50.166 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-16T22:07:50.166 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-16T22:07:50.166 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-16T22:07:50.166 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-16T22:07:50.166 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-16T22:07:50.166 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-16T22:07:50.166 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-16T22:07:50.166 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:50.166 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:07:50.166 INFO:teuthology.orchestra.run.smithi173.stdout:=========================================================================================== 2024-02-16T22:07:50.166 INFO:teuthology.orchestra.run.smithi173.stdout:Install 12 Packages 2024-02-16T22:07:50.166 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:07:50.167 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 37 M 2024-02-16T22:07:50.167 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 209 M 2024-02-16T22:07:50.167 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:07:50.342 INFO:teuthology.orchestra.run.smithi173.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 235 kB/s | 32 kB 00:00 2024-02-16T22:07:50.375 INFO:teuthology.orchestra.run.smithi173.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 538 kB/s | 17 kB 00:00 2024-02-16T22:07:50.384 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:08 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:07:50.417 INFO:teuthology.orchestra.run.smithi173.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 849 kB/s | 34 kB 00:00 2024-02-16T22:07:50.468 INFO:teuthology.orchestra.run.smithi173.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-02-16T22:07:50.547 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:07:50.547 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:07:50.547 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-02-16T22:07:50.547 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:07:50.548 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:07:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 80 k 2024-02-16T22:07:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:50.548 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:07:50.548 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:07:50.548 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-02-16T22:07:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:50.548 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 80 k 2024-02-16T22:07:50.548 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 364 k 2024-02-16T22:07:50.548 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:07:50.676 INFO:teuthology.orchestra.run.smithi173.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2024-02-16T22:07:50.752 INFO:teuthology.orchestra.run.smithi173.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 4.8 MB 00:00 2024-02-16T22:07:50.777 INFO:teuthology.orchestra.run.smithi173.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2024-02-16T22:07:50.981 INFO:teuthology.orchestra.run.smithi134.stdout:cephadm-17.2.7-513.gb88fae66.el9.noarch.rpm 186 kB/s | 80 kB 00:00 2024-02-16T22:07:50.981 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:07:50.981 INFO:teuthology.orchestra.run.smithi134.stdout:Total 186 kB/s | 80 kB 00:00 2024-02-16T22:07:50.981 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:07:50.986 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:07:50.986 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:07:50.988 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:07:50.989 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:07:51.002 INFO:teuthology.orchestra.run.smithi173.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.5 MB/s | 802 kB 00:00 2024-02-16T22:07:51.062 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:07:51.169 INFO:teuthology.orchestra.run.smithi173.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-02-16T22:07:51.194 INFO:teuthology.orchestra.run.smithi173.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 194 kB 00:00 2024-02-16T22:07:51.545 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:17.2.7-513.gb88fae66.el9.noarch 1/1 2024-02-16T22:07:51.643 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:17.2.7-513.gb88fae66.el9.noarch 1/1 2024-02-16T22:07:51.878 INFO:teuthology.orchestra.run.smithi173.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 347 kB/s | 245 kB 00:00 2024-02-16T22:07:51.979 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:17.2.7-513.gb88fae66.el9.noarch 1/1 2024-02-16T22:07:52.279 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:17.2.7-513.gb88fae66.el9.noarch 1/1 2024-02-16T22:07:52.279 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:52.279 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:07:52.279 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:07:52.279 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:52.279 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:07:52.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-immutable-object-cache 2024-02-16T22:07:53.092 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:11 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:07:53.258 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:07:53.258 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:07:53.258 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-02-16T22:07:53.258 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:07:53.258 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:07:53.258 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-513.gb88fae66.el9 ceph 137 k 2024-02-16T22:07:53.258 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:53.259 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:07:53.259 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:07:53.259 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-02-16T22:07:53.259 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:53.259 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 137 k 2024-02-16T22:07:53.259 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 379 k 2024-02-16T22:07:53.259 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:07:53.742 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-immutable-object-cache-17.2.7-513.gb88fae6 284 kB/s | 137 kB 00:00 2024-02-16T22:07:53.742 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:07:53.742 INFO:teuthology.orchestra.run.smithi134.stdout:Total 283 kB/s | 137 kB 00:00 2024-02-16T22:07:53.742 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:07:53.750 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:07:53.750 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:07:53.802 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:07:53.802 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:07:53.936 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:07:54.001 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-513.gb88fae66.e 1/1 2024-02-16T22:07:54.025 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-513.gb88fae66.e 1/1 2024-02-16T22:07:54.026 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T22:07:54.026 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-16T22:07:54.026 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:54.136 INFO:teuthology.orchestra.run.smithi173.stdout:(12/12): ceph-mgr-diskprediction-local-17.2.7-5 1.9 MB/s | 7.4 MB 00:03 2024-02-16T22:07:54.139 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:07:54.139 INFO:teuthology.orchestra.run.smithi173.stdout:Total 9.3 MB/s | 37 MB 00:03 2024-02-16T22:07:54.160 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:07:54.186 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:07:54.187 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:07:54.616 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:07:54.616 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:07:55.009 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-513.gb88fae66.e 1/1 2024-02-16T22:07:55.009 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:55.009 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:07:55.009 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:07:55.010 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:55.010 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:07:55.237 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr 2024-02-16T22:07:55.332 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:07:55.409 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-16T22:07:55.440 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-16T22:07:55.534 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-16T22:07:55.577 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-16T22:07:55.761 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-16T22:07:55.792 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-16T22:07:55.820 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:13 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:07:55.868 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-16T22:07:55.934 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-mgr-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:07:55.985 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:07:55.986 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-02-16T22:07:55.986 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:07:56.061 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-dashboard 2024-02-16T22:07:56.509 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-16T22:07:56.630 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:14 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:07:56.630 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-16T22:07:56.796 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:07:56.796 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:07:56.796 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-02-16T22:07:56.797 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:07:56.797 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:07:56.797 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 1.7 M 2024-02-16T22:07:56.797 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-02-16T22:07:56.797 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 23 k 2024-02-16T22:07:56.797 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 15 k 2024-02-16T22:07:56.797 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-16T22:07:56.797 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-16T22:07:56.797 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-16T22:07:56.797 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-02-16T22:07:56.797 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-16T22:07:56.797 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:56.797 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:07:56.798 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:07:56.798 INFO:teuthology.orchestra.run.smithi134.stdout:Install 7 Packages 2024-02-16T22:07:56.798 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:56.798 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 2.0 M 2024-02-16T22:07:56.798 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 8.1 M 2024-02-16T22:07:56.798 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:07:57.361 INFO:teuthology.orchestra.run.smithi134.stdout:(1/7): ceph-grafana-dashboards-17.2.7-513.gb88f 125 kB/s | 23 kB 00:00 2024-02-16T22:07:57.436 INFO:teuthology.orchestra.run.smithi134.stdout:(2/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 120 kB/s | 9.0 kB 00:00 2024-02-16T22:07:57.487 INFO:teuthology.orchestra.run.smithi134.stdout:(3/7): ceph-prometheus-alerts-17.2.7-513.gb88fa 47 kB/s | 15 kB 00:00 2024-02-16T22:07:57.512 INFO:teuthology.orchestra.run.smithi134.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 542 kB/s | 41 kB 00:00 2024-02-16T22:07:57.554 INFO:teuthology.orchestra.run.smithi134.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 460 kB/s | 31 kB 00:00 2024-02-16T22:07:57.596 INFO:teuthology.orchestra.run.smithi134.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2024-02-16T22:07:57.872 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-16T22:07:58.196 INFO:teuthology.orchestra.run.smithi134.stdout:(7/7): ceph-mgr-dashboard-17.2.7-513.gb88fae66. 1.7 MB/s | 1.7 MB 00:01 2024-02-16T22:07:58.197 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:07:58.198 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.4 MB/s | 2.0 MB 00:01 2024-02-16T22:07:58.198 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:07:58.206 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:07:58.206 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:07:58.270 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:07:58.270 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:07:58.577 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:07:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-16T22:07:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-16T22:07:58.727 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-16T22:07:58.760 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-16T22:07:58.788 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-513.gb88fae66.el9.no 5/7 2024-02-16T22:07:58.900 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-16T22:07:58.933 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-513.gb88fae 12/12 2024-02-16T22:07:59.017 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-513.gb88fae66.el9.n 6/7 2024-02-16T22:07:59.049 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-513.gb88fae66.el9.noarch 7/7 2024-02-16T22:07:59.572 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-513.gb88fae66.el9.noarch 7/7 2024-02-16T22:07:59.572 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-513.gb88fae66.el9.n 1/7 2024-02-16T22:07:59.572 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-513.gb88fae66.el9.noarch 2/7 2024-02-16T22:07:59.572 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-513.gb88fae66.el9.no 3/7 2024-02-16T22:07:59.572 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-16T22:07:59.572 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-16T22:07:59.572 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-16T22:07:59.873 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-16T22:07:59.873 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:07:59.874 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:07:59.874 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:07:59.874 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:07:59.874 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-16T22:07:59.874 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-16T22:07:59.874 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-16T22:07:59.874 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-16T22:07:59.874 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:07:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:00.122 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-16T22:08:00.692 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:18 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:00.859 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:00.860 INFO:teuthology.orchestra.run.smithi134.stdout:=========================================================================================== 2024-02-16T22:08:00.860 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-02-16T22:08:00.860 INFO:teuthology.orchestra.run.smithi134.stdout:=========================================================================================== 2024-02-16T22:08:00.860 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:08:00.861 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 7.4 M 2024-02-16T22:08:00.861 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-02-16T22:08:00.861 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-16T22:08:00.861 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-16T22:08:00.861 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-16T22:08:00.861 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-16T22:08:00.861 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-16T22:08:00.861 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-16T22:08:00.861 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-16T22:08:00.861 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-16T22:08:00.861 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-16T22:08:00.861 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-16T22:08:00.862 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-16T22:08:00.862 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:00.862 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:08:00.862 INFO:teuthology.orchestra.run.smithi134.stdout:=========================================================================================== 2024-02-16T22:08:00.862 INFO:teuthology.orchestra.run.smithi134.stdout:Install 12 Packages 2024-02-16T22:08:00.862 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:00.862 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 37 M 2024-02-16T22:08:00.863 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 209 M 2024-02-16T22:08:00.863 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:08:01.094 INFO:teuthology.orchestra.run.smithi134.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 284 kB/s | 32 kB 00:00 2024-02-16T22:08:01.161 INFO:teuthology.orchestra.run.smithi134.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 389 kB/s | 17 kB 00:00 2024-02-16T22:08:01.203 INFO:teuthology.orchestra.run.smithi134.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 821 kB/s | 34 kB 00:00 2024-02-16T22:08:01.361 INFO:teuthology.orchestra.run.smithi134.stdout:(4/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 30 MB/s | 4.7 MB 00:00 2024-02-16T22:08:01.503 INFO:teuthology.orchestra.run.smithi134.stdout:(5/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2024-02-16T22:08:01.515 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-513.gb88fae 12/12 2024-02-16T22:08:01.515 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-513.gb88fae 1/12 2024-02-16T22:08:01.515 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-16T22:08:01.515 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-16T22:08:01.515 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-16T22:08:01.515 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-16T22:08:01.515 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-16T22:08:01.515 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-16T22:08:01.515 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-16T22:08:01.515 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-16T22:08:01.515 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-16T22:08:01.515 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-16T22:08:01.545 INFO:teuthology.orchestra.run.smithi134.stdout:(6/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 5.3 MB/s | 217 kB 00:00 2024-02-16T22:08:01.596 INFO:teuthology.orchestra.run.smithi134.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.9 MB/s | 3.0 MB 00:00 2024-02-16T22:08:01.746 INFO:teuthology.orchestra.run.smithi134.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 5.3 MB/s | 802 kB 00:00 2024-02-16T22:08:01.913 INFO:teuthology.orchestra.run.smithi134.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2024-02-16T22:08:01.929 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-16T22:08:01.929 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:01.929 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:08:01.930 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:08:01.930 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-16T22:08:01.930 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-16T22:08:01.930 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-16T22:08:01.930 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-16T22:08:01.930 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-16T22:08:01.930 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-16T22:08:01.930 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-16T22:08:01.930 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-16T22:08:01.930 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-16T22:08:01.930 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-16T22:08:01.930 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-16T22:08:01.930 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:01.931 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:01.938 INFO:teuthology.orchestra.run.smithi134.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 194 kB 00:00 2024-02-16T22:08:02.213 INFO:teuthology.orchestra.run.smithi134.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 820 kB/s | 245 kB 00:00 2024-02-16T22:08:02.283 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-rook 2024-02-16T22:08:02.868 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:17 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:02.913 INFO:teuthology.orchestra.run.smithi134.stdout:(12/12): ceph-mgr-diskprediction-local-17.2.7-5 3.8 MB/s | 7.4 MB 00:01 2024-02-16T22:08:02.915 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:02.916 INFO:teuthology.orchestra.run.smithi134.stdout:Total 18 MB/s | 37 MB 00:02 2024-02-16T22:08:02.934 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:08:02.958 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:08:02.958 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:08:03.036 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:03.037 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-02-16T22:08:03.037 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-02-16T22:08:03.037 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-02-16T22:08:03.037 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:08:03.037 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 47 k 2024-02-16T22:08:03.037 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-02-16T22:08:03.037 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-16T22:08:03.037 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-16T22:08:03.037 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-16T22:08:03.037 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-16T22:08:03.037 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-16T22:08:03.038 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-16T22:08:03.038 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-16T22:08:03.038 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-16T22:08:03.038 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-16T22:08:03.038 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-16T22:08:03.038 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-16T22:08:03.038 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-16T22:08:03.038 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:03.038 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:08:03.038 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-02-16T22:08:03.038 INFO:teuthology.orchestra.run.smithi173.stdout:Install 13 Packages 2024-02-16T22:08:03.038 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:03.039 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 2.0 M 2024-02-16T22:08:03.039 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 26 M 2024-02-16T22:08:03.039 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:08:03.373 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:08:03.373 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:08:03.509 INFO:teuthology.orchestra.run.smithi173.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 214 kB/s | 24 kB 00:00 2024-02-16T22:08:03.559 INFO:teuthology.orchestra.run.smithi173.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 110 kB/s | 18 kB 00:00 2024-02-16T22:08:03.609 INFO:teuthology.orchestra.run.smithi173.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 174 kB 00:00 2024-02-16T22:08:03.634 INFO:teuthology.orchestra.run.smithi173.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-02-16T22:08:03.659 INFO:teuthology.orchestra.run.smithi173.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-02-16T22:08:03.685 INFO:teuthology.orchestra.run.smithi173.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 877 kB/s | 43 kB 00:00 2024-02-16T22:08:03.777 INFO:teuthology.orchestra.run.smithi173.stdout:(7/13): python3-certifi-2021.10.8-2.el9.noarch. 163 kB/s | 15 kB 00:00 2024-02-16T22:08:03.802 INFO:teuthology.orchestra.run.smithi173.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 226 kB/s | 32 kB 00:00 2024-02-16T22:08:03.919 INFO:teuthology.orchestra.run.smithi173.stdout:(9/13): python3-google-auth-2.27.0-1.el9.noarch 1.4 MB/s | 203 kB 00:00 2024-02-16T22:08:03.969 INFO:teuthology.orchestra.run.smithi173.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-02-16T22:08:04.003 INFO:teuthology.orchestra.run.smithi173.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 5.1 MB/s | 1.0 MB 00:00 2024-02-16T22:08:04.020 INFO:teuthology.orchestra.run.smithi173.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-02-16T22:08:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:08:04.144 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-16T22:08:04.145 INFO:teuthology.orchestra.run.smithi173.stdout:(13/13): ceph-mgr-rook-17.2.7-513.gb88fae66.el9 63 kB/s | 47 kB 00:00 2024-02-16T22:08:04.147 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:04.147 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2024-02-16T22:08:04.147 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:08:04.161 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:08:04.161 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:08:04.175 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-16T22:08:04.262 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:08:04.263 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:08:04.268 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-16T22:08:04.312 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-16T22:08:04.497 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-16T22:08:04.528 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-16T22:08:04.604 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-16T22:08:04.789 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:08:04.950 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-16T22:08:05.004 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-16T22:08:05.068 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-16T22:08:05.105 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-16T22:08:05.146 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-16T22:08:05.240 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-16T22:08:05.256 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-16T22:08:05.340 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-16T22:08:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-16T22:08:05.389 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-16T22:08:06.112 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-16T22:08:06.162 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-16T22:08:06.195 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-16T22:08:06.241 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-16T22:08:06.265 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:17.2.7-513.gb88fae66.el9.noarch 13/13 2024-02-16T22:08:06.605 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-16T22:08:07.059 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-513.gb88fae66.el9.noarch 13/13 2024-02-16T22:08:07.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:17.2.7-513.gb88fae66.el9.noarch 1/13 2024-02-16T22:08:07.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-16T22:08:07.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-16T22:08:07.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-16T22:08:07.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-16T22:08:07.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-16T22:08:07.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-16T22:08:07.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-16T22:08:07.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-16T22:08:07.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-16T22:08:07.060 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-16T22:08:07.060 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-16T22:08:07.432 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-16T22:08:07.432 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:07.432 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:08:07.432 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:08:07.433 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-16T22:08:07.433 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-16T22:08:07.433 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-16T22:08:07.433 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-16T22:08:07.433 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-16T22:08:07.433 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-16T22:08:07.433 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-16T22:08:07.433 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-16T22:08:07.433 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-16T22:08:07.433 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-16T22:08:07.433 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-16T22:08:07.433 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-16T22:08:07.433 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:07.434 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-16T22:08:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-513.gb88fae 12/12 2024-02-16T22:08:07.661 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-cephadm 2024-02-16T22:08:08.239 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:23 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:08.407 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:08.408 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-02-16T22:08:08.408 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-02-16T22:08:08.408 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-02-16T22:08:08.408 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:08:08.408 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 121 k 2024-02-16T22:08:08.408 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-02-16T22:08:08.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-16T22:08:08.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-16T22:08:08.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-16T22:08:08.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-16T22:08:08.409 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-16T22:08:08.409 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:08.409 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:08:08.409 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-02-16T22:08:08.409 INFO:teuthology.orchestra.run.smithi173.stdout:Install 6 Packages 2024-02-16T22:08:08.409 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:08.410 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 6.8 M 2024-02-16T22:08:08.410 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 33 M 2024-02-16T22:08:08.411 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:08:08.729 INFO:teuthology.orchestra.run.smithi173.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.3 MB/s | 227 kB 00:00 2024-02-16T22:08:09.038 INFO:teuthology.orchestra.run.smithi173.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 5.8 MB 00:00 2024-02-16T22:08:09.238 INFO:teuthology.orchestra.run.smithi173.stdout:(3/6): ceph-mgr-cephadm-17.2.7-513.gb88fae66.el 179 kB/s | 121 kB 00:00 2024-02-16T22:08:09.497 INFO:teuthology.orchestra.run.smithi173.stdout:(4/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 715 kB/s | 548 kB 00:00 2024-02-16T22:08:09.530 INFO:teuthology.orchestra.run.smithi173.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 117 kB/s | 58 kB 00:00 2024-02-16T22:08:09.714 INFO:teuthology.orchestra.run.smithi173.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 108 kB/s | 51 kB 00:00 2024-02-16T22:08:09.718 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:09.718 INFO:teuthology.orchestra.run.smithi173.stdout:Total 5.2 MB/s | 6.8 MB 00:01 2024-02-16T22:08:09.718 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:08:09.727 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:08:09.727 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:08:09.818 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:08:09.818 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:08:10.104 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:08:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-513.gb88fae 12/12 2024-02-16T22:08:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-513.gb88fae 1/12 2024-02-16T22:08:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-16T22:08:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-16T22:08:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-16T22:08:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-16T22:08:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-16T22:08:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-16T22:08:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-16T22:08:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-16T22:08:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-16T22:08:10.202 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-16T22:08:10.270 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-16T22:08:10.323 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-16T22:08:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-16T22:08:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:10.695 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:08:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:08:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-16T22:08:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-16T22:08:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-16T22:08:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-16T22:08:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-16T22:08:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-16T22:08:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-16T22:08:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-16T22:08:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-16T22:08:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-16T22:08:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-16T22:08:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:10.696 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:10.851 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-16T22:08:10.942 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-16T22:08:11.022 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-16T22:08:11.053 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-513.gb88fae66.el9.noarch 6/6 2024-02-16T22:08:11.179 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-rook 2024-02-16T22:08:11.766 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:29 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:11.802 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-513.gb88fae66.el9.noarch 6/6 2024-02-16T22:08:11.802 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-513.gb88fae66.el9.noarch 1/6 2024-02-16T22:08:11.802 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-16T22:08:11.802 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-16T22:08:11.802 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-16T22:08:11.802 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-16T22:08:11.932 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:11.933 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-02-16T22:08:11.933 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-02-16T22:08:11.933 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-02-16T22:08:11.933 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:08:11.934 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 47 k 2024-02-16T22:08:11.934 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-02-16T22:08:11.934 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-16T22:08:11.934 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-16T22:08:11.934 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-16T22:08:11.934 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-16T22:08:11.934 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-16T22:08:11.934 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-16T22:08:11.934 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-16T22:08:11.934 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-16T22:08:11.934 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-16T22:08:11.934 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-16T22:08:11.934 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-16T22:08:11.934 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-16T22:08:11.935 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:11.935 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:08:11.935 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-02-16T22:08:11.935 INFO:teuthology.orchestra.run.smithi134.stdout:Install 13 Packages 2024-02-16T22:08:11.935 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:11.935 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 2.0 M 2024-02-16T22:08:11.935 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 26 M 2024-02-16T22:08:11.936 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:08:12.104 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-16T22:08:12.104 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:12.104 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:08:12.104 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:08:12.104 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-16T22:08:12.104 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-16T22:08:12.104 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-16T22:08:12.104 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-16T22:08:12.104 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-16T22:08:12.104 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:12.104 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:12.351 INFO:teuthology.orchestra.run.smithi134.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 123 kB/s | 24 kB 00:00 2024-02-16T22:08:12.352 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-fuse 2024-02-16T22:08:12.376 INFO:teuthology.orchestra.run.smithi134.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 81 kB/s | 18 kB 00:00 2024-02-16T22:08:12.476 INFO:teuthology.orchestra.run.smithi134.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 174 kB 00:00 2024-02-16T22:08:12.519 INFO:teuthology.orchestra.run.smithi134.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 931 kB/s | 132 kB 00:00 2024-02-16T22:08:12.569 INFO:teuthology.orchestra.run.smithi134.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.2 MB/s | 211 kB 00:00 2024-02-16T22:08:12.594 INFO:teuthology.orchestra.run.smithi134.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 570 kB/s | 43 kB 00:00 2024-02-16T22:08:12.619 INFO:teuthology.orchestra.run.smithi134.stdout:(7/13): ceph-mgr-rook-17.2.7-513.gb88fae66.el9. 102 kB/s | 47 kB 00:00 2024-02-16T22:08:12.845 INFO:teuthology.orchestra.run.smithi134.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 60 kB/s | 15 kB 00:00 2024-02-16T22:08:12.931 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:27 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:12.937 INFO:teuthology.orchestra.run.smithi134.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 88 kB/s | 32 kB 00:00 2024-02-16T22:08:13.054 INFO:teuthology.orchestra.run.smithi134.stdout:(10/13): python3-google-auth-2.27.0-1.el9.noarc 467 kB/s | 203 kB 00:00 2024-02-16T22:08:13.079 INFO:teuthology.orchestra.run.smithi134.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 417 kB/s | 59 kB 00:00 2024-02-16T22:08:13.096 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:13.096 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:13.097 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-02-16T22:08:13.097 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:13.097 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:08:13.097 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:17.2.7-513.gb88fae66.el9 ceph 812 k 2024-02-16T22:08:13.097 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-02-16T22:08:13.097 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-16T22:08:13.097 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:13.097 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:08:13.097 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:13.097 INFO:teuthology.orchestra.run.smithi173.stdout:Install 2 Packages 2024-02-16T22:08:13.097 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:13.098 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 890 k 2024-02-16T22:08:13.098 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 2.6 M 2024-02-16T22:08:13.098 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:08:13.171 INFO:teuthology.orchestra.run.smithi134.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 768 kB/s | 90 kB 00:00 2024-02-16T22:08:13.221 INFO:teuthology.orchestra.run.smithi134.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.7 MB/s | 1.0 MB 00:00 2024-02-16T22:08:13.225 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:13.225 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.6 MB/s | 2.0 MB 00:01 2024-02-16T22:08:13.225 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:08:13.238 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:08:13.238 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:08:13.265 INFO:teuthology.orchestra.run.smithi173.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 470 kB/s | 79 kB 00:00 2024-02-16T22:08:13.337 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:08:13.338 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:08:13.541 INFO:teuthology.orchestra.run.smithi173.stdout:(2/2): ceph-fuse-17.2.7-513.gb88fae66.el9.x86_6 1.8 MB/s | 812 kB 00:00 2024-02-16T22:08:13.542 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:13.542 INFO:teuthology.orchestra.run.smithi173.stdout:Total 2.0 MB/s | 890 kB 00:00 2024-02-16T22:08:13.542 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:08:13.563 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:08:13.563 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:08:13.637 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:08:13.638 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:08:13.819 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:08:13.862 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:08:13.945 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-16T22:08:14.006 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 2/2 2024-02-16T22:08:14.025 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-16T22:08:14.080 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-16T22:08:14.152 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-16T22:08:14.189 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-16T22:08:14.230 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-16T22:08:14.323 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-16T22:08:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-16T22:08:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-16T22:08:14.697 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 2/2 2024-02-16T22:08:14.697 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 1/2 2024-02-16T22:08:15.029 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-16T22:08:15.029 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:15.029 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:08:15.029 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-16T22:08:15.029 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:15.029 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:15.194 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-16T22:08:15.237 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-16T22:08:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-16T22:08:15.304 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados-devel 2024-02-16T22:08:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-16T22:08:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:17.2.7-513.gb88fae66.el9.noarch 13/13 2024-02-16T22:08:15.896 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:30 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:16.063 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:16.064 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:16.064 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-02-16T22:08:16.064 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:16.064 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:08:16.064 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:17.2.7-513.gb88fae66.el9 ceph 126 k 2024-02-16T22:08:16.064 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:16.064 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:08:16.064 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:16.064 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-02-16T22:08:16.064 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:16.065 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 126 k 2024-02-16T22:08:16.065 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 448 k 2024-02-16T22:08:16.065 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:08:16.156 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-513.gb88fae66.el9.noarch 13/13 2024-02-16T22:08:16.156 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:17.2.7-513.gb88fae66.el9.noarch 1/13 2024-02-16T22:08:16.156 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-16T22:08:16.156 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-16T22:08:16.156 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-16T22:08:16.156 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-16T22:08:16.156 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-16T22:08:16.156 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-16T22:08:16.156 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-16T22:08:16.157 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-16T22:08:16.157 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-16T22:08:16.157 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-16T22:08:16.157 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-16T22:08:16.295 INFO:teuthology.orchestra.run.smithi173.stdout:librados-devel-17.2.7-513.gb88fae66.el9.x86_64. 550 kB/s | 126 kB 00:00 2024-02-16T22:08:16.295 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:16.296 INFO:teuthology.orchestra.run.smithi173.stdout:Total 547 kB/s | 126 kB 00:00 2024-02-16T22:08:16.296 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:08:16.301 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:08:16.301 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:08:16.356 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:08:16.357 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:08:16.514 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:08:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-16T22:08:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:16.531 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:16.532 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:16.609 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:16.792 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-cephadm 2024-02-16T22:08:17.041 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados-devel-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:17.350 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:17.350 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:17.350 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:08:17.350 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:08:17.350 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:17.350 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:17.370 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:35 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:17.539 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:17.540 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-02-16T22:08:17.540 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-02-16T22:08:17.540 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-02-16T22:08:17.541 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:08:17.541 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:17.2.7-513.gb88fae66.el9 ceph-noarch 121 k 2024-02-16T22:08:17.541 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-02-16T22:08:17.541 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-16T22:08:17.541 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-16T22:08:17.541 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-16T22:08:17.541 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-16T22:08:17.541 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-16T22:08:17.541 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:17.541 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:08:17.541 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-02-16T22:08:17.541 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2024-02-16T22:08:17.542 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:17.542 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 6.8 M 2024-02-16T22:08:17.542 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 33 M 2024-02-16T22:08:17.542 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:08:17.588 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs2 2024-02-16T22:08:17.855 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.1 MB/s | 227 kB 00:00 2024-02-16T22:08:17.930 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): ceph-mgr-cephadm-17.2.7-513.gb88fae66.el 449 kB/s | 121 kB 00:00 2024-02-16T22:08:18.105 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 5.8 MB 00:00 2024-02-16T22:08:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:33 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:18.180 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 1.6 MB/s | 548 kB 00:00 2024-02-16T22:08:18.205 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 210 kB/s | 58 kB 00:00 2024-02-16T22:08:18.231 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 411 kB/s | 51 kB 00:00 2024-02-16T22:08:18.235 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:18.235 INFO:teuthology.orchestra.run.smithi134.stdout:Total 9.7 MB/s | 6.8 MB 00:00 2024-02-16T22:08:18.235 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:08:18.244 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:08:18.244 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:08:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:Package libcephfs2-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:08:18.335 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:08:18.335 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:08:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-02-16T22:08:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:18.405 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs-devel 2024-02-16T22:08:18.628 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:08:18.787 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-16T22:08:18.832 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-16T22:08:18.979 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:33 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:19.144 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:19.145 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:19.145 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-02-16T22:08:19.145 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:19.145 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:08:19.145 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:17.2.7-513.gb88fae66.el9 ceph 25 k 2024-02-16T22:08:19.145 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:19.145 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:08:19.145 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:19.145 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-02-16T22:08:19.145 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:19.145 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 25 k 2024-02-16T22:08:19.145 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 110 k 2024-02-16T22:08:19.145 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:08:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-16T22:08:19.356 INFO:teuthology.orchestra.run.smithi173.stdout:libcephfs-devel-17.2.7-513.gb88fae66.el9.x86_64 118 kB/s | 25 kB 00:00 2024-02-16T22:08:19.357 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:19.357 INFO:teuthology.orchestra.run.smithi173.stdout:Total 118 kB/s | 25 kB 00:00 2024-02-16T22:08:19.357 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:08:19.360 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:08:19.361 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:08:19.362 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:08:19.362 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:08:19.434 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-16T22:08:19.452 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:08:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-16T22:08:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-513.gb88fae66.el9.noarch 6/6 2024-02-16T22:08:19.578 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:19.955 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:20.226 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:20.226 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:20.226 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:08:20.226 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:08:20.226 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:20.226 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-513.gb88fae66.el9.noarch 6/6 2024-02-16T22:08:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-513.gb88fae66.el9.noarch 1/6 2024-02-16T22:08:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-16T22:08:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-16T22:08:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-16T22:08:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-16T22:08:20.387 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados2 2024-02-16T22:08:20.616 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-16T22:08:20.617 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:20.617 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:08:20.617 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:17.2.7-513.gb88fae66.el9.noarch 2024-02-16T22:08:20.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-16T22:08:20.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-16T22:08:20.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-16T22:08:20.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-16T22:08:20.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-16T22:08:20.617 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:20.617 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:20.913 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-fuse 2024-02-16T22:08:20.966 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:35 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:21.081 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:08:21.132 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:21.133 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-02-16T22:08:21.133 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:21.199 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librbd1 2024-02-16T22:08:21.491 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:39 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:21.659 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:21.659 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:21.659 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-02-16T22:08:21.659 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:21.659 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:08:21.659 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:17.2.7-513.gb88fae66.el9 ceph 812 k 2024-02-16T22:08:21.660 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-02-16T22:08:21.660 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-16T22:08:21.660 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:21.660 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:08:21.660 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:21.660 INFO:teuthology.orchestra.run.smithi134.stdout:Install 2 Packages 2024-02-16T22:08:21.660 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:21.660 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 890 k 2024-02-16T22:08:21.661 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 2.6 M 2024-02-16T22:08:21.661 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:08:21.782 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:36 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:21.790 INFO:teuthology.orchestra.run.smithi134.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 608 kB/s | 79 kB 00:00 2024-02-16T22:08:21.897 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:08:21.948 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:21.949 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-02-16T22:08:21.949 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:22.013 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rados 2024-02-16T22:08:22.149 INFO:teuthology.orchestra.run.smithi134.stdout:(2/2): ceph-fuse-17.2.7-513.gb88fae66.el9.x86_6 1.6 MB/s | 812 kB 00:00 2024-02-16T22:08:22.150 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:22.151 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.8 MB/s | 890 kB 00:00 2024-02-16T22:08:22.151 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:08:22.171 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:08:22.171 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:08:22.246 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:08:22.247 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:08:22.431 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:08:22.577 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-16T22:08:22.592 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:37 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:22.639 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 2/2 2024-02-16T22:08:22.707 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rados-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:08:22.760 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:22.761 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-02-16T22:08:22.761 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:22.824 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rgw 2024-02-16T22:08:23.356 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 2/2 2024-02-16T22:08:23.356 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 1/2 2024-02-16T22:08:23.399 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:38 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:23.513 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rgw-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:08:23.565 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:23.566 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-02-16T22:08:23.566 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:23.632 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-cephfs 2024-02-16T22:08:23.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-16T22:08:23.648 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:23.648 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:08:23.648 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-16T22:08:23.648 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:23.648 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:23.930 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados-devel 2024-02-16T22:08:24.207 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:39 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:24.319 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-cephfs-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:08:24.371 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:24.373 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-02-16T22:08:24.373 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:24.440 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rbd 2024-02-16T22:08:24.525 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:42 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:24.691 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:24.692 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-02-16T22:08:24.692 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:24.692 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:08:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:17.2.7-513.gb88fae66.el9 ceph 126 k 2024-02-16T22:08:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:24.692 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:08:24.692 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:24.692 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-02-16T22:08:24.693 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:24.693 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 126 k 2024-02-16T22:08:24.693 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 448 k 2024-02-16T22:08:24.693 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:08:25.011 INFO:teuthology.orchestra.run.smithi134.stdout:librados-devel-17.2.7-513.gb88fae66.el9.x86_64. 398 kB/s | 126 kB 00:00 2024-02-16T22:08:25.011 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:25.012 INFO:teuthology.orchestra.run.smithi134.stdout:Total 396 kB/s | 126 kB 00:00 2024-02-16T22:08:25.012 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:08:25.017 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:40 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:25.018 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:08:25.018 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:08:25.072 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:08:25.072 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:08:25.131 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rbd-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:08:25.183 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:25.184 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-02-16T22:08:25.184 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:25.233 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:08:25.245 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-fuse 2024-02-16T22:08:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados-devel-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:25.822 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:40 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:25.987 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:25.988 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-02-16T22:08:25.988 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:25.988 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:08:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:17.2.7-513.gb88fae66.el9 ceph 81 k 2024-02-16T22:08:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:25.989 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:08:25.989 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:25.989 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-02-16T22:08:25.989 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:25.989 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 81 k 2024-02-16T22:08:25.989 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 222 k 2024-02-16T22:08:25.989 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:08:26.081 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:26.081 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:26.081 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:08:26.081 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:08:26.081 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:26.081 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:26.192 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-fuse-17.2.7-513.gb88fae66.el9.x86_64.rpm 400 kB/s | 81 kB 00:00 2024-02-16T22:08:26.193 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:26.193 INFO:teuthology.orchestra.run.smithi173.stdout:Total 397 kB/s | 81 kB 00:00 2024-02-16T22:08:26.193 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:08:26.200 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:08:26.200 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:08:26.254 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:08:26.255 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:08:26.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs2 2024-02-16T22:08:26.391 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:08:26.490 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:26.884 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:26.892 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:44 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:27.009 INFO:teuthology.orchestra.run.smithi134.stdout:Package libcephfs2-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:08:27.063 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:27.064 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-02-16T22:08:27.064 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:27.131 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs-devel 2024-02-16T22:08:27.179 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:27.179 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:27.179 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:08:27.179 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:08:27.179 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:27.179 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:27.402 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-mirror 2024-02-16T22:08:27.708 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:45 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:27.875 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:27.876 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-02-16T22:08:27.876 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:27.876 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:08:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:17.2.7-513.gb88fae66.el9 ceph 25 k 2024-02-16T22:08:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:27.877 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:08:27.877 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:27.877 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-02-16T22:08:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:27.877 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 25 k 2024-02-16T22:08:27.877 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 110 k 2024-02-16T22:08:27.877 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:08:27.984 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:42 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:28.140 INFO:teuthology.orchestra.run.smithi134.stdout:libcephfs-devel-17.2.7-513.gb88fae66.el9.x86_64 95 kB/s | 25 kB 00:00 2024-02-16T22:08:28.141 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:28.141 INFO:teuthology.orchestra.run.smithi134.stdout:Total 94 kB/s | 25 kB 00:00 2024-02-16T22:08:28.142 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:08:28.145 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:08:28.145 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:08:28.147 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:08:28.147 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:08:28.156 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:28.156 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:28.156 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-02-16T22:08:28.156 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:28.156 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:08:28.156 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:17.2.7-513.gb88fae66.el9 ceph 2.9 M 2024-02-16T22:08:28.157 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:28.157 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:08:28.157 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:28.157 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-02-16T22:08:28.157 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:28.157 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 2.9 M 2024-02-16T22:08:28.157 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 12 M 2024-02-16T22:08:28.157 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:08:28.232 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:08:28.355 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:28.743 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:28.780 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-mirror-17.2.7-513.gb88fae66.el9.x86_64.rpm 4.7 MB/s | 2.9 MB 00:00 2024-02-16T22:08:28.780 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:28.781 INFO:teuthology.orchestra.run.smithi173.stdout:Total 4.7 MB/s | 2.9 MB 00:00 2024-02-16T22:08:28.781 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:08:28.790 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:08:28.790 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:08:28.862 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:08:28.863 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:08:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:29.011 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:08:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:08:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:29.012 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:29.190 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados2 2024-02-16T22:08:29.268 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:08:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:29.362 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:29.363 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T22:08:29.363 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-16T22:08:29.363 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-16T22:08:29.363 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-16T22:08:29.363 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:29.763 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:47 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:29.877 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:08:29.929 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-02-16T22:08:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:29.996 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librbd1 2024-02-16T22:08:30.549 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:30.549 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:30.549 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:08:30.549 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:08:30.549 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:30.549 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:30.573 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:48 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:30.687 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:08:30.739 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:30.740 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-02-16T22:08:30.740 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:30.793 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-nbd 2024-02-16T22:08:30.804 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rados 2024-02-16T22:08:31.379 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:49 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:31.383 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:46 ago on Fri 16 Feb 2024 10:06:45 PM UTC. 2024-02-16T22:08:31.493 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rados-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:08:31.545 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:31.546 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-02-16T22:08:31.546 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:31.549 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-02-16T22:08:31.550 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:31.550 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-02-16T22:08:31.550 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:31.550 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-02-16T22:08:31.550 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:17.2.7-513.gb88fae66.el9 ceph 165 k 2024-02-16T22:08:31.550 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:31.550 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-02-16T22:08:31.550 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-02-16T22:08:31.550 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-02-16T22:08:31.550 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:31.551 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 165 k 2024-02-16T22:08:31.551 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 477 k 2024-02-16T22:08:31.551 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-02-16T22:08:31.613 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rgw 2024-02-16T22:08:31.933 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-nbd-17.2.7-513.gb88fae66.el9.x86_64.rpm 431 kB/s | 165 kB 00:00 2024-02-16T22:08:31.934 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:31.934 INFO:teuthology.orchestra.run.smithi173.stdout:Total 429 kB/s | 165 kB 00:00 2024-02-16T22:08:31.934 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-02-16T22:08:31.942 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-02-16T22:08:31.942 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-02-16T22:08:31.997 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-02-16T22:08:31.997 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-02-16T22:08:32.150 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-02-16T22:08:32.191 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:50 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:32.256 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:32.306 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rgw-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:08:32.358 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:32.359 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-02-16T22:08:32.360 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:32.436 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-cephfs 2024-02-16T22:08:32.649 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-nbd-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:32.948 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:32.948 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:32.948 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-02-16T22:08:32.949 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:08:32.949 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:08:32.949 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-02-16T22:08:33.015 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:51 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:33.128 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-cephfs-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:08:33.171 DEBUG:teuthology.parallel:result is None 2024-02-16T22:08:33.181 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:33.182 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-02-16T22:08:33.182 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:33.255 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rbd 2024-02-16T22:08:33.831 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:51 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:33.945 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rbd-2:17.2.7-513.gb88fae66.el9.x86_64 is already installed. 2024-02-16T22:08:33.998 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:33.999 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-02-16T22:08:33.999 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:34.070 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-fuse 2024-02-16T22:08:34.651 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:52 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:34.818 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:34.818 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-02-16T22:08:34.818 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:34.818 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:08:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:17.2.7-513.gb88fae66.el9 ceph 81 k 2024-02-16T22:08:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:34.818 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:08:34.819 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:34.819 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-02-16T22:08:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:34.819 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 81 k 2024-02-16T22:08:34.819 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 222 k 2024-02-16T22:08:34.819 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:08:35.201 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-fuse-17.2.7-513.gb88fae66.el9.x86_64.rpm 213 kB/s | 81 kB 00:00 2024-02-16T22:08:35.202 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:35.202 INFO:teuthology.orchestra.run.smithi134.stdout:Total 212 kB/s | 81 kB 00:00 2024-02-16T22:08:35.202 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:08:35.209 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:08:35.209 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:08:35.265 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:08:35.265 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:08:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:08:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:35.945 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:36.233 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:08:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:08:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:36.233 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:36.438 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-mirror 2024-02-16T22:08:37.029 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:55 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:37.201 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:37.202 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-02-16T22:08:37.202 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:37.202 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:08:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:17.2.7-513.gb88fae66.el9 ceph 2.9 M 2024-02-16T22:08:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:37.202 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:08:37.202 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:37.202 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-02-16T22:08:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:37.203 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 2.9 M 2024-02-16T22:08:37.203 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 12 M 2024-02-16T22:08:37.203 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:08:37.579 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-mirror-17.2.7-513.gb88fae66.el9.x86_64.rpm 7.8 MB/s | 2.9 MB 00:00 2024-02-16T22:08:37.579 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:37.580 INFO:teuthology.orchestra.run.smithi134.stdout:Total 7.8 MB/s | 2.9 MB 00:00 2024-02-16T22:08:37.580 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:08:37.589 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:08:37.589 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:08:37.663 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:08:37.664 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:08:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:08:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:38.170 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:38.170 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T22:08:38.170 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-16T22:08:38.170 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-16T22:08:38.170 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-16T22:08:38.170 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:39.321 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:39.321 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:39.321 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:08:39.321 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:08:39.321 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:39.321 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:39.536 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-nbd 2024-02-16T22:08:40.129 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:58 ago on Fri 16 Feb 2024 10:06:42 PM UTC. 2024-02-16T22:08:40.297 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-16T22:08:40.299 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:40.299 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-02-16T22:08:40.299 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:40.299 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-16T22:08:40.299 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:17.2.7-513.gb88fae66.el9 ceph 165 k 2024-02-16T22:08:40.300 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:40.300 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-16T22:08:40.300 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-16T22:08:40.300 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-02-16T22:08:40.300 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:40.300 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 165 k 2024-02-16T22:08:40.300 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 477 k 2024-02-16T22:08:40.300 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-16T22:08:40.656 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-nbd-17.2.7-513.gb88fae66.el9.x86_64.rpm 461 kB/s | 165 kB 00:00 2024-02-16T22:08:40.657 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:08:40.657 INFO:teuthology.orchestra.run.smithi134.stdout:Total 459 kB/s | 165 kB 00:00 2024-02-16T22:08:40.657 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-16T22:08:40.665 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-16T22:08:40.665 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-16T22:08:40.721 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-16T22:08:40.721 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-16T22:08:40.869 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-16T22:08:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:41.430 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-nbd-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:41.764 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:17.2.7-513.gb88fae66.el9.x86_64 1/1 2024-02-16T22:08:41.764 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:41.764 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-16T22:08:41.765 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:17.2.7-513.gb88fae66.el9.x86_64 2024-02-16T22:08:41.765 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:08:41.765 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-16T22:08:42.003 DEBUG:teuthology.parallel:result is None 2024-02-16T22:08:42.003 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-16T22:08:42.003 INFO:teuthology.packaging:ref: None 2024-02-16T22:08:42.004 INFO:teuthology.packaging:tag: None 2024-02-16T22:08:42.004 INFO:teuthology.packaging:branch: quincy 2024-02-16T22:08:42.004 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:08:42.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-16T22:08:42.327 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-16T22:08:42.348 INFO:teuthology.orchestra.run.smithi134.stdout:17.2.7-513.gb88fae66.el9 2024-02-16T22:08:42.349 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-513.gb88fae66.el9 2024-02-16T22:08:42.349 INFO:teuthology.task.install:The correct ceph version 17.2.7-513.gb88fae66 is installed. 2024-02-16T22:08:42.351 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-16T22:08:42.351 INFO:teuthology.packaging:ref: None 2024-02-16T22:08:42.351 INFO:teuthology.packaging:tag: None 2024-02-16T22:08:42.351 INFO:teuthology.packaging:branch: quincy 2024-02-16T22:08:42.351 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:08:42.352 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-16T22:08:42.545 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-16T22:08:42.570 INFO:teuthology.orchestra.run.smithi173.stdout:17.2.7-513.gb88fae66.el9 2024-02-16T22:08:42.570 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-513.gb88fae66.el9 2024-02-16T22:08:42.570 INFO:teuthology.task.install:The correct ceph version 17.2.7-513.gb88fae66 is installed. 2024-02-16T22:08:42.572 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-16T22:08:42.572 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:08:42.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-16T22:08:42.601 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:08:42.601 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-16T22:08:42.643 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-16T22:08:42.643 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:08:42.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-02-16T22:08:42.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-16T22:08:42.738 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:08:42.738 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2024-02-16T22:08:42.768 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-16T22:08:42.837 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-16T22:08:42.837 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:08:42.837 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-16T22:08:42.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-16T22:08:42.931 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:08:42.931 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-16T22:08:42.960 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-16T22:08:43.028 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-16T22:08:43.028 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:08:43.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-02-16T22:08:43.055 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-16T22:08:43.122 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:08:43.122 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2024-02-16T22:08:43.151 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-16T22:08:43.219 INFO:teuthology.run_tasks:Running task print... 2024-02-16T22:08:43.230 INFO:teuthology.task.print:**** done install task... 2024-02-16T22:08:43.231 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-16T22:08:43.320 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'} 2024-02-16T22:08:43.320 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-02-16T22:08:43.320 INFO:tasks.cephadm:Cluster fsid is f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:08:43.320 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-16T22:08:43.320 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-16T22:08:43.321 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi134': '172.21.15.134', 'mon.smithi173': '172.21.15.173'} 2024-02-16T22:08:43.321 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-16T22:08:43.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname $(hostname -s) 2024-02-16T22:08:43.348 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname $(hostname -s) 2024-02-16T22:08:43.376 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-02-16T22:08:43.376 DEBUG:teuthology.orchestra.run.smithi134:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-16T22:08:43.776 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r--. 1 ubuntu ubuntu 367151 Feb 16 22:08 /home/ubuntu/cephtest/cephadm 2024-02-16T22:08:43.776 DEBUG:teuthology.orchestra.run.smithi173:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-16T22:08:43.972 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r--. 1 ubuntu ubuntu 367151 Feb 16 22:08 /home/ubuntu/cephtest/cephadm 2024-02-16T22:08:43.973 DEBUG:teuthology.orchestra.run.smithi134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-16T22:08:43.990 DEBUG:teuthology.orchestra.run.smithi173:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-16T22:08:44.017 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-02-16T22:08:44.017 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-02-16T22:08:44.033 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-02-16T22:08:44.858 INFO:teuthology.orchestra.run.smithi134.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-16T22:08:44.859 INFO:teuthology.orchestra.run.smithi173.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-16T22:09:12.541 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-02-16T22:09:12.541 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)", 2024-02-16T22:09:12.541 INFO:teuthology.orchestra.run.smithi173.stdout: "image_id": "870a0944ccb83fae8829e20e516a8aeec00e19c6a392cc9e32528216b9cb93f0", 2024-02-16T22:09:12.542 INFO:teuthology.orchestra.run.smithi173.stdout: "repo_digests": [ 2024-02-16T22:09:12.542 INFO:teuthology.orchestra.run.smithi173.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c" 2024-02-16T22:09:12.542 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-02-16T22:09:12.542 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-02-16T22:09:17.047 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:09:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)", 2024-02-16T22:09:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "image_id": "870a0944ccb83fae8829e20e516a8aeec00e19c6a392cc9e32528216b9cb93f0", 2024-02-16T22:09:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "repo_digests": [ 2024-02-16T22:09:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c" 2024-02-16T22:09:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-02-16T22:09:17.048 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:09:17.068 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph 2024-02-16T22:09:17.116 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph 2024-02-16T22:09:17.151 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /etc/ceph 2024-02-16T22:09:17.178 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /etc/ceph 2024-02-16T22:09:17.220 INFO:tasks.cephadm:Writing seed config... 2024-02-16T22:09:17.221 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-02-16T22:09:17.221 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-02-16T22:09:17.221 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-16T22:09:17.221 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-16T22:09:17.221 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-16T22:09:17.221 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-16T22:09:17.221 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-16T22:09:17.222 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-16T22:09:17.222 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-16T22:09:17.222 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-16T22:09:17.222 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-16T22:09:17.222 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-16T22:09:17.222 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-16T22:09:17.222 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-16T22:09:17.222 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-16T22:09:17.222 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-16T22:09:17.222 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-16T22:09:17.222 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-16T22:09:17.222 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-16T22:09:17.223 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-16T22:09:17.223 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-16T22:09:17.223 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-16T22:09:17.223 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-16T22:09:17.223 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-02-16T22:09:17.223 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-16T22:09:17.223 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-16T22:09:17.223 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-16T22:09:17.223 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-16T22:09:17.223 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-16T22:09:17.223 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-16T22:09:17.224 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-16T22:09:17.224 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-16T22:09:17.224 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-16T22:09:17.224 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-16T22:09:17.224 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-16T22:09:17.224 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-16T22:09:17.224 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-16T22:09:17.224 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-16T22:09:17.224 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-16T22:09:17.224 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-16T22:09:17.225 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:09:17.225 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-16T22:09:17.240 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f29a5372-cd17-11ee-95ba-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-16T22:09:17.240 DEBUG:teuthology.orchestra.run.smithi134:mon.smithi134> sudo journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi134.service 2024-02-16T22:09:17.283 INFO:tasks.cephadm:Bootstrapping... 2024-02-16T22:09:17.283 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid f29a5372-cd17-11ee-95ba-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.134 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-16T22:09:17.484 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-16T22:09:17.484 INFO:teuthology.orchestra.run.smithi134.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'f29a5372-cd17-11ee-95ba-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.134', '--skip-admin-label'] 2024-02-16T22:09:17.509 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-16T22:09:17.509 INFO:teuthology.orchestra.run.smithi134.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-02-16T22:09:17.509 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying podman|docker is present... 2024-02-16T22:09:17.533 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-16T22:09:17.533 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying lvm2 is present... 2024-02-16T22:09:17.533 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying time synchronization is in place... 2024-02-16T22:09:17.541 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-16T22:09:17.541 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-16T22:09:17.548 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-16T22:09:17.548 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-02-16T22:09:17.554 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout enabled 2024-02-16T22:09:17.561 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout active 2024-02-16T22:09:17.561 INFO:teuthology.orchestra.run.smithi134.stdout:Unit chronyd.service is enabled and running 2024-02-16T22:09:17.561 INFO:teuthology.orchestra.run.smithi134.stdout:Repeating the final host check... 2024-02-16T22:09:17.584 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-16T22:09:17.584 INFO:teuthology.orchestra.run.smithi134.stdout:podman (/bin/podman) version 4.9.3 is present 2024-02-16T22:09:17.584 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl is present 2024-02-16T22:09:17.584 INFO:teuthology.orchestra.run.smithi134.stdout:lvcreate is present 2024-02-16T22:09:17.591 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-16T22:09:17.591 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-16T22:09:17.597 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-16T22:09:17.597 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-02-16T22:09:17.603 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout enabled 2024-02-16T22:09:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout active 2024-02-16T22:09:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:Unit chronyd.service is enabled and running 2024-02-16T22:09:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:Host looks OK 2024-02-16T22:09:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:Cluster fsid: f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:09:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:Acquiring lock 140419294538240 on /run/cephadm/f29a5372-cd17-11ee-95ba-87774f69a715.lock 2024-02-16T22:09:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:Lock 140419294538240 acquired on /run/cephadm/f29a5372-cd17-11ee-95ba-87774f69a715.lock 2024-02-16T22:09:17.611 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying IP 172.21.15.134 port 3300 ... 2024-02-16T22:09:17.611 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying IP 172.21.15.134 port 6789 ... 2024-02-16T22:09:17.611 INFO:teuthology.orchestra.run.smithi134.stdout:Base mon IP(s) is [172.21.15.134:3300, 172.21.15.134:6789], mon addrv is [v2:172.21.15.134:3300,v1:172.21.15.134:6789] 2024-02-16T22:09:17.614 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.134 metric 100 2024-02-16T22:09:17.614 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.134 metric 100 2024-02-16T22:09:17.617 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-16T22:09:17.617 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-02-16T22:09:17.617 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1788sec hoplimit 64 pref medium 2024-02-16T22:09:17.620 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-16T22:09:17.620 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-16T22:09:17.620 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-16T22:09:17.620 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-02-16T22:09:17.620 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2024-02-16T22:09:17.620 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-16T22:09:17.621 INFO:teuthology.orchestra.run.smithi134.stdout:Mon IP `172.21.15.134` is in CIDR network `172.21.0.0/20` 2024-02-16T22:09:17.621 INFO:teuthology.orchestra.run.smithi134.stdout:Mon IP `172.21.15.134` is in CIDR network `172.21.0.0/20` 2024-02-16T22:09:17.621 INFO:teuthology.orchestra.run.smithi134.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-16T22:09:17.621 INFO:teuthology.orchestra.run.smithi134.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-16T22:09:17.622 INFO:teuthology.orchestra.run.smithi134.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-16T22:09:18.115 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stdout 870a0944ccb83fae8829e20e516a8aeec00e19c6a392cc9e32528216b9cb93f0 2024-02-16T22:09:18.115 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-16T22:09:18.115 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Getting image source signatures 2024-02-16T22:09:18.115 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Copying blob sha256:5dfd87a714924b39df09034baf76a9bd7605cb8f0d34cc8ca301fad8be327611 2024-02-16T22:09:18.115 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Copying blob sha256:0f642e61a11afb42c0ccb5b05f5809250ad643ed143780d6ff49a5a4c492fc38 2024-02-16T22:09:18.115 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Copying config sha256:870a0944ccb83fae8829e20e516a8aeec00e19c6a392cc9e32528216b9cb93f0 2024-02-16T22:09:18.115 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Writing manifest to image destination 2024-02-16T22:09:19.035 INFO:teuthology.orchestra.run.smithi134.stdout:ceph: stdout ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable) 2024-02-16T22:09:19.036 INFO:teuthology.orchestra.run.smithi134.stdout:Ceph version: ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable) 2024-02-16T22:09:19.036 INFO:teuthology.orchestra.run.smithi134.stdout:Extracting ceph user uid/gid from container image... 2024-02-16T22:09:20.050 INFO:teuthology.orchestra.run.smithi134.stdout:stat: stdout 167 167 2024-02-16T22:09:20.050 INFO:teuthology.orchestra.run.smithi134.stdout:Creating initial keys... 2024-02-16T22:09:21.022 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph-authtool: stdout AQAQ3c9lDP4nFhAAh7gxKBvXDCHQl/u4UIrybw== 2024-02-16T22:09:21.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph-authtool: stdout AQAR3c9laeuHFBAAxQ9rhbZWmvT+Df5+beP6WA== 2024-02-16T22:09:22.858 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph-authtool: stdout AQAS3c9lZ4b6ChAAzQIFWcrq1yZkZg+ggm7p2w== 2024-02-16T22:09:22.859 INFO:teuthology.orchestra.run.smithi134.stdout:Creating initial monmap... 2024-02-16T22:09:23.798 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-16T22:09:23.798 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-02-16T22:09:23.798 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:09:23.798 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-16T22:09:23.798 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool for smithi134 [v2:172.21.15.134:3300,v1:172.21.15.134:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-16T22:09:23.799 INFO:teuthology.orchestra.run.smithi134.stdout:setting min_mon_release = octopus 2024-02-16T22:09:23.799 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: set fsid to f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:09:23.799 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-16T22:09:23.799 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:09:23.799 INFO:teuthology.orchestra.run.smithi134.stdout:Creating mon... 2024-02-16T22:09:24.836 INFO:teuthology.orchestra.run.smithi134.stdout:create mon.smithi134 on 2024-02-16T22:09:25.051 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-02-16T22:09:25.207 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-16T22:09:25.361 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f29a5372-cd17-11ee-95ba-87774f69a715.target → /etc/systemd/system/ceph-f29a5372-cd17-11ee-95ba-87774f69a715.target. 2024-02-16T22:09:25.361 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f29a5372-cd17-11ee-95ba-87774f69a715.target → /etc/systemd/system/ceph-f29a5372-cd17-11ee-95ba-87774f69a715.target. 2024-02-16T22:09:25.549 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi134 2024-02-16T22:09:25.550 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi134.service: Unit ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi134.service not loaded. 2024-02-16T22:09:25.714 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f29a5372-cd17-11ee-95ba-87774f69a715.target.wants/ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi134.service → /etc/systemd/system/ceph-f29a5372-cd17-11ee-95ba-87774f69a715@.service. 2024-02-16T22:09:26.300 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-16T22:09:26.300 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout disabled 2024-02-16T22:09:26.307 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-16T22:09:26.307 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-02-16T22:09:26.308 INFO:teuthology.orchestra.run.smithi134.stdout:firewalld.service is not enabled 2024-02-16T22:09:26.308 INFO:teuthology.orchestra.run.smithi134.stdout:Not possible to enable service . firewalld.service is not available 2024-02-16T22:09:26.308 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mon to start... 2024-02-16T22:09:26.308 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mon... 2024-02-16T22:09:27.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:27 smithi134 ceph-mon[28497]: from='client.? 172.21.15.134:0/2955821527' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-16T22:09:27.406 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout cluster: 2024-02-16T22:09:27.412 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout id: f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:09:27.413 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-16T22:09:27.413 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-02-16T22:09:27.413 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout services: 2024-02-16T22:09:27.413 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi134 (age 0.562316s) 2024-02-16T22:09:27.413 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-16T22:09:27.413 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-16T22:09:27.413 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-02-16T22:09:27.413 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout data: 2024-02-16T22:09:27.413 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-16T22:09:27.413 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-16T22:09:27.413 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-16T22:09:27.413 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout pgs: 2024-02-16T22:09:27.413 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-02-16T22:09:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.758+0000 7fe1926c5700 1 Processor -- start 2024-02-16T22:09:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.758+0000 7fe1926c5700 1 -- start start 2024-02-16T22:09:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.759+0000 7fe1926c5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18c101670 0x7fe18c101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.759+0000 7fe1926c5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c101fc0 con 0x7fe18c101670 2024-02-16T22:09:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.759+0000 7fe18bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18c101670 0x7fe18c101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.759+0000 7fe18bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18c101670 0x7fe18c101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54730/0 (socket says 172.21.15.134:54730) 2024-02-16T22:09:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.759+0000 7fe18bfff700 1 -- 172.21.15.134:0/2273414929 learned_addr learned my addr 172.21.15.134:0/2273414929 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.759+0000 7fe18bfff700 1 -- 172.21.15.134:0/2273414929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c102100 con 0x7fe18c101670 2024-02-16T22:09:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.760+0000 7fe18bfff700 1 --2- 172.21.15.134:0/2273414929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18c101670 0x7fe18c101a80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0098e0 tx=0x7fe17c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6cc89bf81d323f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.760+0000 7fe18b7fe700 1 -- 172.21.15.134:0/2273414929 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe17c00b860 con 0x7fe18c101670 2024-02-16T22:09:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.760+0000 7fe18b7fe700 1 -- 172.21.15.134:0/2273414929 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c00b9c0 con 0x7fe18c101670 2024-02-16T22:09:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.760+0000 7fe18b7fe700 1 -- 172.21.15.134:0/2273414929 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe17c00bc90 con 0x7fe18c101670 2024-02-16T22:09:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.760+0000 7fe1926c5700 1 -- 172.21.15.134:0/2273414929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18c101670 msgr2=0x7fe18c101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.760+0000 7fe1926c5700 1 --2- 172.21.15.134:0/2273414929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18c101670 0x7fe18c101a80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0098e0 tx=0x7fe17c009250 comp rx=0 tx=0).stop 2024-02-16T22:09:27.415 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.760+0000 7fe1926c5700 1 -- 172.21.15.134:0/2273414929 shutdown_connections 2024-02-16T22:09:27.415 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.760+0000 7fe1926c5700 1 --2- 172.21.15.134:0/2273414929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18c101670 0x7fe18c101a80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:27.415 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.760+0000 7fe1926c5700 1 -- 172.21.15.134:0/2273414929 >> 172.21.15.134:0/2273414929 conn(0x7fe18c0fcdd0 msgr2=0x7fe18c0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:27.415 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.760+0000 7fe1926c5700 1 -- 172.21.15.134:0/2273414929 shutdown_connections 2024-02-16T22:09:27.415 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.760+0000 7fe1926c5700 1 -- 172.21.15.134:0/2273414929 wait complete. 2024-02-16T22:09:27.415 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.761+0000 7fe1926c5700 1 Processor -- start 2024-02-16T22:09:27.415 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.761+0000 7fe1926c5700 1 -- start start 2024-02-16T22:09:27.415 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.761+0000 7fe1926c5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18c101670 0x7fe18c113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:27.415 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.761+0000 7fe1926c5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c071450 con 0x7fe18c101670 2024-02-16T22:09:27.415 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.761+0000 7fe18bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18c101670 0x7fe18c113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:27.415 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.761+0000 7fe18bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18c101670 0x7fe18c113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54744/0 (socket says 172.21.15.134:54744) 2024-02-16T22:09:27.415 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.761+0000 7fe18bfff700 1 -- 172.21.15.134:0/2955821527 learned_addr learned my addr 172.21.15.134:0/2955821527 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:27.415 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.761+0000 7fe18bfff700 1 -- 172.21.15.134:0/2955821527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c0094f0 con 0x7fe18c101670 2024-02-16T22:09:27.416 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.762+0000 7fe18bfff700 1 --2- 172.21.15.134:0/2955821527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18c101670 0x7fe18c113a80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe17c003080 tx=0x7fe17c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:27.416 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.762+0000 7fe1897fa700 1 -- 172.21.15.134:0/2955821527 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe17c01c5c0 con 0x7fe18c101670 2024-02-16T22:09:27.416 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.762+0000 7fe1897fa700 1 -- 172.21.15.134:0/2955821527 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c01c720 con 0x7fe18c101670 2024-02-16T22:09:27.416 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.762+0000 7fe1926c5700 1 -- 172.21.15.134:0/2955821527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18c071650 con 0x7fe18c101670 2024-02-16T22:09:27.416 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.762+0000 7fe1897fa700 1 -- 172.21.15.134:0/2955821527 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe17c01ca30 con 0x7fe18c101670 2024-02-16T22:09:27.416 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.762+0000 7fe1926c5700 1 -- 172.21.15.134:0/2955821527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18c114180 con 0x7fe18c101670 2024-02-16T22:09:27.416 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.762+0000 7fe1897fa700 1 -- 172.21.15.134:0/2955821527 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe17c01a450 con 0x7fe18c101670 2024-02-16T22:09:27.416 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.762+0000 7fe1897fa700 1 -- 172.21.15.134:0/2955821527 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe17c02e790 con 0x7fe18c101670 2024-02-16T22:09:27.416 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.763+0000 7fe1926c5700 1 -- 172.21.15.134:0/2955821527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18c109440 con 0x7fe18c101670 2024-02-16T22:09:27.416 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.765+0000 7fe1897fa700 1 -- 172.21.15.134:0/2955821527 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe17c01a890 con 0x7fe18c101670 2024-02-16T22:09:27.416 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.834+0000 7fe1926c5700 1 -- 172.21.15.134:0/2955821527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fe18c02b340 con 0x7fe18c101670 2024-02-16T22:09:27.416 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.834+0000 7fe1897fa700 1 -- 172.21.15.134:0/2955821527 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7fe17c01aa30 con 0x7fe18c101670 2024-02-16T22:09:27.416 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.835+0000 7fe1926c5700 1 -- 172.21.15.134:0/2955821527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18c101670 msgr2=0x7fe18c113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:27.416 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.835+0000 7fe1926c5700 1 --2- 172.21.15.134:0/2955821527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18c101670 0x7fe18c113a80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe17c003080 tx=0x7fe17c016000 comp rx=0 tx=0).stop 2024-02-16T22:09:27.417 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.835+0000 7fe1926c5700 1 -- 172.21.15.134:0/2955821527 shutdown_connections 2024-02-16T22:09:27.417 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.835+0000 7fe1926c5700 1 --2- 172.21.15.134:0/2955821527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe18c101670 0x7fe18c113a80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:27.417 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.835+0000 7fe1926c5700 1 -- 172.21.15.134:0/2955821527 >> 172.21.15.134:0/2955821527 conn(0x7fe18c0fcdd0 msgr2=0x7fe18c1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:27.417 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.835+0000 7fe1926c5700 1 -- 172.21.15.134:0/2955821527 shutdown_connections 2024-02-16T22:09:27.417 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:26.835+0000 7fe1926c5700 1 -- 172.21.15.134:0/2955821527 wait complete. 2024-02-16T22:09:27.417 INFO:teuthology.orchestra.run.smithi134.stdout:mon is available 2024-02-16T22:09:27.417 INFO:teuthology.orchestra.run.smithi134.stdout:Assimilating anything we can from ceph.conf... 2024-02-16T22:09:28.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:28 smithi134 ceph-mon[28497]: from='client.? 172.21.15.134:0/1111711392' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-16T22:09:28.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:28 smithi134 ceph-mon[28497]: from='client.? 172.21.15.134:0/1111711392' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-16T22:09:28.520 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-02-16T22:09:28.520 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [global] 2024-02-16T22:09:28.520 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout fsid = f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:09:28.520 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.134:3300,v1:172.21.15.134:6789] 2024-02-16T22:09:28.520 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-16T22:09:28.520 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-16T22:09:28.520 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-16T22:09:28.520 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-16T22:09:28.520 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-02-16T22:09:28.521 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-16T22:09:28.521 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-16T22:09:28.521 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-02-16T22:09:28.521 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [osd] 2024-02-16T22:09:28.521 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-16T22:09:28.521 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-16T22:09:28.521 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-16T22:09:28.521 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-16T22:09:28.521 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-16T22:09:28.521 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.822+0000 7fb58e866700 1 Processor -- start 2024-02-16T22:09:28.521 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.823+0000 7fb58e866700 1 -- start start 2024-02-16T22:09:28.521 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.823+0000 7fb58e866700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb588078cc0 0x7fb5880771d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.823+0000 7fb58e866700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5880790d0 con 0x7fb588078cc0 2024-02-16T22:09:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.823+0000 7fb587fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb588078cc0 0x7fb5880771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.823+0000 7fb587fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb588078cc0 0x7fb5880771d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54752/0 (socket says 172.21.15.134:54752) 2024-02-16T22:09:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.823+0000 7fb587fff700 1 -- 172.21.15.134:0/3694697912 learned_addr learned my addr 172.21.15.134:0/3694697912 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.823+0000 7fb587fff700 1 -- 172.21.15.134:0/3694697912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb588077710 con 0x7fb588078cc0 2024-02-16T22:09:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.823+0000 7fb587fff700 1 --2- 172.21.15.134:0/3694697912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb588078cc0 0x7fb5880771d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb5700098e0 tx=0x7fb570009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0c57a5586d6fe6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.823+0000 7fb586ffd700 1 -- 172.21.15.134:0/3694697912 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb57000b860 con 0x7fb588078cc0 2024-02-16T22:09:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.824+0000 7fb586ffd700 1 -- 172.21.15.134:0/3694697912 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57000b9c0 con 0x7fb588078cc0 2024-02-16T22:09:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.824+0000 7fb586ffd700 1 -- 172.21.15.134:0/3694697912 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb57000bc90 con 0x7fb588078cc0 2024-02-16T22:09:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.824+0000 7fb58e866700 1 -- 172.21.15.134:0/3694697912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb588078cc0 msgr2=0x7fb5880771d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.824+0000 7fb58e866700 1 --2- 172.21.15.134:0/3694697912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb588078cc0 0x7fb5880771d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb5700098e0 tx=0x7fb570009250 comp rx=0 tx=0).stop 2024-02-16T22:09:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.824+0000 7fb58e866700 1 -- 172.21.15.134:0/3694697912 shutdown_connections 2024-02-16T22:09:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.824+0000 7fb58e866700 1 --2- 172.21.15.134:0/3694697912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb588078cc0 0x7fb5880771d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.824+0000 7fb58e866700 1 -- 172.21.15.134:0/3694697912 >> 172.21.15.134:0/3694697912 conn(0x7fb5880fded0 msgr2=0x7fb588100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:28.523 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.824+0000 7fb58e866700 1 -- 172.21.15.134:0/3694697912 shutdown_connections 2024-02-16T22:09:28.523 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.824+0000 7fb58e866700 1 -- 172.21.15.134:0/3694697912 wait complete. 2024-02-16T22:09:28.523 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.825+0000 7fb58e866700 1 Processor -- start 2024-02-16T22:09:28.523 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.825+0000 7fb58e866700 1 -- start start 2024-02-16T22:09:28.523 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.825+0000 7fb58e866700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb588078cc0 0x7fb588112fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:28.523 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.825+0000 7fb58e866700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb588113500 con 0x7fb588078cc0 2024-02-16T22:09:28.523 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.825+0000 7fb587fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb588078cc0 0x7fb588112fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:28.523 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.825+0000 7fb587fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb588078cc0 0x7fb588112fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54764/0 (socket says 172.21.15.134:54764) 2024-02-16T22:09:28.523 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.825+0000 7fb587fff700 1 -- 172.21.15.134:0/1111711392 learned_addr learned my addr 172.21.15.134:0/1111711392 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:28.523 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.825+0000 7fb587fff700 1 -- 172.21.15.134:0/1111711392 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700094f0 con 0x7fb588078cc0 2024-02-16T22:09:28.523 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.825+0000 7fb587fff700 1 --2- 172.21.15.134:0/1111711392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb588078cc0 0x7fb588112fc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb570009290 tx=0x7fb570016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:28.523 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.826+0000 7fb584ff9700 1 -- 172.21.15.134:0/1111711392 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb57001c5c0 con 0x7fb588078cc0 2024-02-16T22:09:28.523 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.826+0000 7fb584ff9700 1 -- 172.21.15.134:0/1111711392 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57001c740 con 0x7fb588078cc0 2024-02-16T22:09:28.524 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.826+0000 7fb58e866700 1 -- 172.21.15.134:0/1111711392 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb588113700 con 0x7fb588078cc0 2024-02-16T22:09:28.524 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.826+0000 7fb584ff9700 1 -- 172.21.15.134:0/1111711392 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb57001ca50 con 0x7fb588078cc0 2024-02-16T22:09:28.524 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.826+0000 7fb58e866700 1 -- 172.21.15.134:0/1111711392 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5881143a0 con 0x7fb588078cc0 2024-02-16T22:09:28.524 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.826+0000 7fb584ff9700 1 -- 172.21.15.134:0/1111711392 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb57001a450 con 0x7fb588078cc0 2024-02-16T22:09:28.524 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.826+0000 7fb584ff9700 1 -- 172.21.15.134:0/1111711392 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb57002e790 con 0x7fb588078cc0 2024-02-16T22:09:28.524 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.827+0000 7fb58e866700 1 -- 172.21.15.134:0/1111711392 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58805f5c0 con 0x7fb588078cc0 2024-02-16T22:09:28.524 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.829+0000 7fb584ff9700 1 -- 172.21.15.134:0/1111711392 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb57001ce30 con 0x7fb588078cc0 2024-02-16T22:09:28.524 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.894+0000 7fb58e866700 1 -- 172.21.15.134:0/1111711392 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fb58810c860 con 0x7fb588078cc0 2024-02-16T22:09:28.524 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.897+0000 7fb584ff9700 1 -- 172.21.15.134:0/1111711392 <== mon.0 v2:172.21.15.134:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb5700243e0 con 0x7fb588078cc0 2024-02-16T22:09:28.524 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.897+0000 7fb584ff9700 1 -- 172.21.15.134:0/1111711392 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7fb57002e9f0 con 0x7fb588078cc0 2024-02-16T22:09:28.524 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.898+0000 7fb58e866700 1 -- 172.21.15.134:0/1111711392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb588078cc0 msgr2=0x7fb588112fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:28.524 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.898+0000 7fb58e866700 1 --2- 172.21.15.134:0/1111711392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb588078cc0 0x7fb588112fc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb570009290 tx=0x7fb570016000 comp rx=0 tx=0).stop 2024-02-16T22:09:28.525 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.899+0000 7fb58e866700 1 -- 172.21.15.134:0/1111711392 shutdown_connections 2024-02-16T22:09:28.525 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.899+0000 7fb58e866700 1 --2- 172.21.15.134:0/1111711392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb588078cc0 0x7fb588112fc0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:28.525 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.899+0000 7fb58e866700 1 -- 172.21.15.134:0/1111711392 >> 172.21.15.134:0/1111711392 conn(0x7fb5880fded0 msgr2=0x7fb5881074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:28.525 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.899+0000 7fb58e866700 1 -- 172.21.15.134:0/1111711392 shutdown_connections 2024-02-16T22:09:28.525 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:27.899+0000 7fb58e866700 1 -- 172.21.15.134:0/1111711392 wait complete. 2024-02-16T22:09:28.525 INFO:teuthology.orchestra.run.smithi134.stdout:Generating new minimal ceph.conf... 2024-02-16T22:09:29.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:29 smithi134 ceph-mon[28497]: from='client.? 172.21.15.134:0/861315916' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:09:29.574 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.939+0000 7f8daa455700 1 Processor -- start 2024-02-16T22:09:29.574 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.939+0000 7f8daa455700 1 -- start start 2024-02-16T22:09:29.574 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.940+0000 7f8daa455700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8da4101670 0x7f8da4101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:29.575 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.940+0000 7f8daa455700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da4101fc0 con 0x7f8da4101670 2024-02-16T22:09:29.575 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.940+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8da4101670 0x7f8da4101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:29.575 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.940+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8da4101670 0x7f8da4101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54772/0 (socket says 172.21.15.134:54772) 2024-02-16T22:09:29.575 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.940+0000 7f8da3fff700 1 -- 172.21.15.134:0/2872098942 learned_addr learned my addr 172.21.15.134:0/2872098942 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:29.575 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.940+0000 7f8da3fff700 1 -- 172.21.15.134:0/2872098942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da4102100 con 0x7f8da4101670 2024-02-16T22:09:29.575 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.940+0000 7f8da3fff700 1 --2- 172.21.15.134:0/2872098942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8da4101670 0x7f8da4101a80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8d940098e0 tx=0x7f8d94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d38a6d90fe5de4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:29.575 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.940+0000 7f8da2ffd700 1 -- 172.21.15.134:0/2872098942 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d9400b860 con 0x7f8da4101670 2024-02-16T22:09:29.575 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.940+0000 7f8da2ffd700 1 -- 172.21.15.134:0/2872098942 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f8d9400be50 con 0x7f8da4101670 2024-02-16T22:09:29.575 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.940+0000 7f8da2ffd700 1 -- 172.21.15.134:0/2872098942 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d94010380 con 0x7f8da4101670 2024-02-16T22:09:29.575 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.941+0000 7f8daa455700 1 -- 172.21.15.134:0/2872098942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8da4101670 msgr2=0x7f8da4101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:29.575 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.941+0000 7f8daa455700 1 --2- 172.21.15.134:0/2872098942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8da4101670 0x7f8da4101a80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8d940098e0 tx=0x7f8d94009250 comp rx=0 tx=0).stop 2024-02-16T22:09:29.575 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.941+0000 7f8daa455700 1 -- 172.21.15.134:0/2872098942 shutdown_connections 2024-02-16T22:09:29.575 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.941+0000 7f8daa455700 1 --2- 172.21.15.134:0/2872098942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8da4101670 0x7f8da4101a80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:29.576 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.941+0000 7f8daa455700 1 -- 172.21.15.134:0/2872098942 >> 172.21.15.134:0/2872098942 conn(0x7f8da40fcdd0 msgr2=0x7f8da40ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:29.576 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.941+0000 7f8daa455700 1 -- 172.21.15.134:0/2872098942 shutdown_connections 2024-02-16T22:09:29.576 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.941+0000 7f8daa455700 1 -- 172.21.15.134:0/2872098942 wait complete. 2024-02-16T22:09:29.576 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.942+0000 7f8daa455700 1 Processor -- start 2024-02-16T22:09:29.576 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.942+0000 7f8daa455700 1 -- start start 2024-02-16T22:09:29.576 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.942+0000 7f8daa455700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8da4101670 0x7f8da4110470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:29.576 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.942+0000 7f8daa455700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da41109b0 con 0x7f8da4101670 2024-02-16T22:09:29.576 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.942+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8da4101670 0x7f8da4110470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:29.576 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.942+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8da4101670 0x7f8da4110470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54780/0 (socket says 172.21.15.134:54780) 2024-02-16T22:09:29.576 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.942+0000 7f8da3fff700 1 -- 172.21.15.134:0/861315916 learned_addr learned my addr 172.21.15.134:0/861315916 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:29.576 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.942+0000 7f8da3fff700 1 -- 172.21.15.134:0/861315916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d940094f0 con 0x7f8da4101670 2024-02-16T22:09:29.576 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.942+0000 7f8da3fff700 1 --2- 172.21.15.134:0/861315916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8da4101670 0x7f8da4110470 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400b440 tx=0x7f8d94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:29.576 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.943+0000 7f8da0ff9700 1 -- 172.21.15.134:0/861315916 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d94010760 con 0x7f8da4101670 2024-02-16T22:09:29.577 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.943+0000 7f8da0ff9700 1 -- 172.21.15.134:0/861315916 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f8d94010d50 con 0x7f8da4101670 2024-02-16T22:09:29.577 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.943+0000 7f8daa455700 1 -- 172.21.15.134:0/861315916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da4110bb0 con 0x7f8da4101670 2024-02-16T22:09:29.577 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.943+0000 7f8da0ff9700 1 -- 172.21.15.134:0/861315916 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d9401ae20 con 0x7f8da4101670 2024-02-16T22:09:29.577 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.943+0000 7f8daa455700 1 -- 172.21.15.134:0/861315916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da4111850 con 0x7f8da4101670 2024-02-16T22:09:29.577 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.943+0000 7f8da0ff9700 1 -- 172.21.15.134:0/861315916 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8d9402e6c0 con 0x7f8da4101670 2024-02-16T22:09:29.577 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.943+0000 7f8da0ff9700 1 -- 172.21.15.134:0/861315916 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8d94024960 con 0x7f8da4101670 2024-02-16T22:09:29.577 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.944+0000 7f8daa455700 1 -- 172.21.15.134:0/861315916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da405f5c0 con 0x7f8da4101670 2024-02-16T22:09:29.577 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:28.946+0000 7f8da0ff9700 1 -- 172.21.15.134:0/861315916 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8d94029070 con 0x7f8da4101670 2024-02-16T22:09:29.577 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:29.012+0000 7f8daa455700 1 -- 172.21.15.134:0/861315916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f8da41034e0 con 0x7f8da4101670 2024-02-16T22:09:29.577 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:29.012+0000 7f8da0ff9700 1 -- 172.21.15.134:0/861315916 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f8d9401a6a0 con 0x7f8da4101670 2024-02-16T22:09:29.577 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:29.013+0000 7f8daa455700 1 -- 172.21.15.134:0/861315916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8da4101670 msgr2=0x7f8da4110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:29.577 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:29.013+0000 7f8daa455700 1 --2- 172.21.15.134:0/861315916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8da4101670 0x7f8da4110470 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400b440 tx=0x7f8d94009250 comp rx=0 tx=0).stop 2024-02-16T22:09:29.577 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:29.013+0000 7f8daa455700 1 -- 172.21.15.134:0/861315916 shutdown_connections 2024-02-16T22:09:29.577 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:29.013+0000 7f8daa455700 1 --2- 172.21.15.134:0/861315916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8da4101670 0x7f8da4110470 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:29.578 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:29.013+0000 7f8daa455700 1 -- 172.21.15.134:0/861315916 >> 172.21.15.134:0/861315916 conn(0x7f8da40fcdd0 msgr2=0x7f8da40fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:29.578 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:29.013+0000 7f8daa455700 1 -- 172.21.15.134:0/861315916 shutdown_connections 2024-02-16T22:09:29.578 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:29.013+0000 7f8daa455700 1 -- 172.21.15.134:0/861315916 wait complete. 2024-02-16T22:09:29.578 INFO:teuthology.orchestra.run.smithi134.stdout:Restarting the monitor... 2024-02-16T22:09:29.838 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:29 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:09:30.092 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:29 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134[28493]: 2024-02-16T22:09:29.835+0000 7fd612bb8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:09:30.093 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:29 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134[28493]: 2024-02-16T22:09:29.835+0000 7fd612bb8700 -1 mon.smithi134@0(leader) e1 *** Got Signal Terminated *** 2024-02-16T22:09:30.362 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:30 smithi134 podman[28740]: 2024-02-16 22:09:30.09146004 +0000 UTC m=+0.357048082 container died 555d9527f68f1c9798650e2d9de82ba626b071bdef27a1e7370a90376b1ba979 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-b88fae6, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214) 2024-02-16T22:09:30.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:30 smithi134 podman[28740]: 2024-02-16 22:09:30.443935457 +0000 UTC m=+0.709523498 container cleanup 555d9527f68f1c9798650e2d9de82ba626b071bdef27a1e7370a90376b1ba979 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-b88fae6, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-16T22:09:30.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:30 smithi134 bash[28740]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134 2024-02-16T22:09:31.088 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:30 smithi134 podman[28754]: 2024-02-16 22:09:30.745130564 +0000 UTC m=+0.648558529 container remove 555d9527f68f1c9798650e2d9de82ba626b071bdef27a1e7370a90376b1ba979 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240214, RELEASE=quincy-b88fae6) 2024-02-16T22:09:31.088 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:30 smithi134 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi134.service: Deactivated successfully. 2024-02-16T22:09:31.088 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:30 smithi134 systemd[1]: Stopped Ceph mon.smithi134 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:09:31.088 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:30 smithi134 systemd[1]: Starting Ceph mon.smithi134 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:09:31.355 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 podman[28849]: 2024-02-16 22:09:30.99083777 +0000 UTC m=+0.018398847 image pull 870a0944ccb83fae8829e20e516a8aeec00e19c6a392cc9e32528216b9cb93f0 quay.ceph.io/ceph-ci/ceph:quincy 2024-02-16T22:09:31.356 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 podman[28849]: 2024-02-16 22:09:31.087595486 +0000 UTC m=+0.115156555 container create 93a679740d930487bbf01364d2fd8617cdc6851d1b22a04d9c006804a5d2f5e0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=quincy-b88fae6, org.label-schema.build-date=20240214) 2024-02-16T22:09:31.356 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 podman[28849]: 2024-02-16 22:09:31.331964808 +0000 UTC m=+0.359525878 container init 93a679740d930487bbf01364d2fd8617cdc6851d1b22a04d9c006804a5d2f5e0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=quincy-b88fae6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-02-16T22:09:31.356 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 podman[28849]: 2024-02-16 22:09:31.334801327 +0000 UTC m=+0.362362397 container start 93a679740d930487bbf01364d2fd8617cdc6851d1b22a04d9c006804a5d2f5e0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134, CEPH_POINT_RELEASE=, RELEASE=quincy-b88fae6, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:09:31.395 INFO:teuthology.orchestra.run.smithi134.stdout:Setting mon public_network to 172.21.0.0/20 2024-02-16T22:09:31.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: set uid:gid to 167:167 (ceph:ceph) 2024-02-16T22:09:31.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable), process ceph-mon, pid 2 2024-02-16T22:09:31.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: pidfile_write: ignore empty --pid-file 2024-02-16T22:09:31.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: load: jerasure load: lrc 2024-02-16T22:09:31.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: RocksDB version: 6.15.5 2024-02-16T22:09:31.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-16T22:09:31.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Compile date Feb 15 2024 2024-02-16T22:09:31.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: DB SUMMARY 2024-02-16T22:09:31.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: DB Session ID: MQV1DHQO9K475V0KEVU8 2024-02-16T22:09:31.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: CURRENT file: CURRENT 2024-02-16T22:09:31.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: IDENTITY file: IDENTITY 2024-02-16T22:09:31.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-02-16T22:09:31.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi134/store.db dir, Total Num: 1, files: 000008.sst 2024-02-16T22:09:31.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi134/store.db: 000010.log size: 97306 ; 2024-02-16T22:09:31.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.error_if_exists: 0 2024-02-16T22:09:31.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.create_if_missing: 0 2024-02-16T22:09:31.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.paranoid_checks: 1 2024-02-16T22:09:31.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-16T22:09:31.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.env: 0x5577eb204a80 2024-02-16T22:09:31.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.fs: Posix File System 2024-02-16T22:09:31.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.info_log: 0x5577ed5bbcc0 2024-02-16T22:09:31.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_file_opening_threads: 16 2024-02-16T22:09:31.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.statistics: (nil) 2024-02-16T22:09:31.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.use_fsync: 0 2024-02-16T22:09:31.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_log_file_size: 0 2024-02-16T22:09:31.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-16T22:09:31.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-16T22:09:31.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.keep_log_file_num: 1000 2024-02-16T22:09:31.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.recycle_log_file_num: 0 2024-02-16T22:09:31.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.allow_fallocate: 1 2024-02-16T22:09:31.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.allow_mmap_reads: 0 2024-02-16T22:09:31.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.allow_mmap_writes: 0 2024-02-16T22:09:31.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.use_direct_reads: 0 2024-02-16T22:09:31.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-16T22:09:31.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.create_missing_column_families: 0 2024-02-16T22:09:31.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.db_log_dir: 2024-02-16T22:09:31.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi134/store.db 2024-02-16T22:09:31.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-16T22:09:31.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-16T22:09:31.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-16T22:09:31.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-16T22:09:31.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-16T22:09:31.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-16T22:09:31.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.advise_random_on_open: 1 2024-02-16T22:09:31.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.db_write_buffer_size: 0 2024-02-16T22:09:31.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.write_buffer_manager: 0x5577ee330ae0 2024-02-16T22:09:31.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-16T22:09:31.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-16T22:09:31.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-16T22:09:31.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-16T22:09:31.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.rate_limiter: (nil) 2024-02-16T22:09:31.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-16T22:09:31.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.wal_recovery_mode: 2 2024-02-16T22:09:31.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.enable_thread_tracking: 0 2024-02-16T22:09:31.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.enable_pipelined_write: 0 2024-02-16T22:09:31.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.unordered_write: 0 2024-02-16T22:09:31.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-16T22:09:31.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-16T22:09:31.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-16T22:09:31.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-16T22:09:31.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.row_cache: None 2024-02-16T22:09:31.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.wal_filter: None 2024-02-16T22:09:31.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-16T22:09:31.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.allow_ingest_behind: 0 2024-02-16T22:09:31.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.preserve_deletes: 0 2024-02-16T22:09:31.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.two_write_queues: 0 2024-02-16T22:09:31.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.manual_wal_flush: 0 2024-02-16T22:09:31.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.atomic_flush: 0 2024-02-16T22:09:31.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-16T22:09:31.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-16T22:09:31.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-16T22:09:31.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.log_readahead_size: 0 2024-02-16T22:09:31.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-16T22:09:31.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.best_efforts_recovery: 0 2024-02-16T22:09:31.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-16T22:09:31.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-16T22:09:31.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.allow_data_in_errors: 0 2024-02-16T22:09:31.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.db_host_id: __hostname__ 2024-02-16T22:09:31.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_background_jobs: 2 2024-02-16T22:09:31.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_background_compactions: -1 2024-02-16T22:09:31.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_subcompactions: 1 2024-02-16T22:09:31.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-16T22:09:31.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-16T22:09:31.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-16T22:09:31.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_total_wal_size: 0 2024-02-16T22:09:31.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-16T22:09:31.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-16T22:09:31.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-16T22:09:31.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-16T22:09:31.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_open_files: -1 2024-02-16T22:09:31.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.bytes_per_sync: 0 2024-02-16T22:09:31.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-16T22:09:31.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-16T22:09:31.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compaction_readahead_size: 0 2024-02-16T22:09:31.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_background_flushes: -1 2024-02-16T22:09:31.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Compression algorithms supported: 2024-02-16T22:09:31.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-16T22:09:31.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: kZSTD supported: 0 2024-02-16T22:09:31.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: kXpressCompression supported: 0 2024-02-16T22:09:31.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: kLZ4HCCompression supported: 1 2024-02-16T22:09:31.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: kZlibCompression supported: 1 2024-02-16T22:09:31.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: kSnappyCompression supported: 1 2024-02-16T22:09:31.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: kLZ4Compression supported: 1 2024-02-16T22:09:31.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: kBZip2Compression supported: 0 2024-02-16T22:09:31.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-16T22:09:31.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000009 2024-02-16T22:09:31.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-02-16T22:09:31.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-16T22:09:31.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.merge_operator: 2024-02-16T22:09:31.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compaction_filter: None 2024-02-16T22:09:31.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compaction_filter_factory: None 2024-02-16T22:09:31.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.sst_partitioner_factory: None 2024-02-16T22:09:31.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-16T22:09:31.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-16T22:09:31.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5577ed610f58) 2024-02-16T22:09:31.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks: 1 2024-02-16T22:09:31.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-16T22:09:31.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-16T22:09:31.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_top_level_index_and_filter: 1 2024-02-16T22:09:31.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_type: 0 2024-02-16T22:09:31.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_index_type: 0 2024-02-16T22:09:31.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_shortening: 1 2024-02-16T22:09:31.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-16T22:09:31.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: hash_index_allow_collision: 1 2024-02-16T22:09:31.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: checksum: 1 2024-02-16T22:09:31.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: no_block_cache: 0 2024-02-16T22:09:31.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache: 0x5577ed643090 2024-02-16T22:09:31.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_name: BinnedLRUCache 2024-02-16T22:09:31.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_options: 2024-02-16T22:09:31.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: capacity : 536870912 2024-02-16T22:09:31.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_shard_bits : 4 2024-02-16T22:09:31.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: strict_capacity_limit : 0 2024-02-16T22:09:31.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: high_pri_pool_ratio: 0.000 2024-02-16T22:09:31.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_compressed: (nil) 2024-02-16T22:09:31.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: persistent_cache: (nil) 2024-02-16T22:09:31.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size: 4096 2024-02-16T22:09:31.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size_deviation: 10 2024-02-16T22:09:31.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_restart_interval: 16 2024-02-16T22:09:31.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_block_restart_interval: 1 2024-02-16T22:09:31.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_block_size: 4096 2024-02-16T22:09:31.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: partition_filters: 0 2024-02-16T22:09:31.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: use_delta_encoding: 1 2024-02-16T22:09:31.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-16T22:09:31.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: whole_key_filtering: 1 2024-02-16T22:09:31.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: verify_compression: 0 2024-02-16T22:09:31.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: read_amp_bytes_per_bit: 0 2024-02-16T22:09:31.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: format_version: 4 2024-02-16T22:09:31.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_index_compression: 1 2024-02-16T22:09:31.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_align: 0 2024-02-16T22:09:31.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.write_buffer_size: 33554432 2024-02-16T22:09:31.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_write_buffer_number: 2 2024-02-16T22:09:31.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compression: NoCompression 2024-02-16T22:09:31.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.bottommost_compression: Disabled 2024-02-16T22:09:31.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.prefix_extractor: nullptr 2024-02-16T22:09:31.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-16T22:09:31.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.num_levels: 7 2024-02-16T22:09:31.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-16T22:09:31.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-16T22:09:31.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-16T22:09:31.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-16T22:09:31.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-16T22:09:31.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-16T22:09:31.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-16T22:09:31.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-16T22:09:31.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-16T22:09:31.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-16T22:09:31.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-16T22:09:31.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compression_opts.level: 32767 2024-02-16T22:09:31.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compression_opts.strategy: 0 2024-02-16T22:09:31.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-16T22:09:31.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-16T22:09:31.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-16T22:09:31.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compression_opts.enabled: false 2024-02-16T22:09:31.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-16T22:09:31.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-16T22:09:31.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-16T22:09:31.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.target_file_size_base: 67108864 2024-02-16T22:09:31.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-16T22:09:31.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-16T22:09:31.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-16T22:09:31.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-16T22:09:31.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-16T22:09:31.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-16T22:09:31.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-16T22:09:31.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-16T22:09:31.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-16T22:09:31.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-16T22:09:31.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-16T22:09:31.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-16T22:09:31.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-16T22:09:31.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.arena_block_size: 4194304 2024-02-16T22:09:31.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-16T22:09:31.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-16T22:09:31.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-16T22:09:31.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.disable_auto_compactions: 0 2024-02-16T22:09:31.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-16T22:09:31.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-16T22:09:31.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-16T22:09:31.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-16T22:09:31.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-16T22:09:31.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-16T22:09:31.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-16T22:09:31.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-16T22:09:31.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-16T22:09:31.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-16T22:09:31.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.table_properties_collectors: 2024-02-16T22:09:31.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.inplace_update_support: 0 2024-02-16T22:09:31.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-16T22:09:31.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-16T22:09:31.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-16T22:09:31.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-16T22:09:31.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.bloom_locality: 0 2024-02-16T22:09:31.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.max_successive_merges: 0 2024-02-16T22:09:31.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-16T22:09:31.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.paranoid_file_checks: 0 2024-02-16T22:09:31.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.force_consistency_checks: 1 2024-02-16T22:09:31.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.report_bg_io_stats: 0 2024-02-16T22:09:31.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.ttl: 2592000 2024-02-16T22:09:31.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-16T22:09:31.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.enable_blob_files: false 2024-02-16T22:09:31.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.min_blob_size: 0 2024-02-16T22:09:31.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.blob_file_size: 268435456 2024-02-16T22:09:31.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-16T22:09:31.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-16T22:09:31.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-16T22:09:31.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-16T22:09:31.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-02-16T22:09:31.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-02-16T22:09:31.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708121371360772, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-02-16T22:09:31.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-02-16T22:09:31.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-16T22:09:31.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708121371361554, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 92578, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 90673, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13356, "raw_average_key_size": 49, "raw_value_size": 83388, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 269, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708121371, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "3b0a4693-3174-4fb7-b142-7bcc4109bbd7", "db_session_id": "MQV1DHQO9K475V0KEVU8"}} 2024-02-16T22:09:31.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-02-16T22:09:31.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708121371361859, "job": 1, "event": "recovery_finished"} 2024-02-16T22:09:31.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi134/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-16T22:09:31.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x5577ed5d7180 2024-02-16T22:09:31.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: DB pointer 0x5577ed6ac000 2024-02-16T22:09:31.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-02-16T22:09:31.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-02-16T22:09:31.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** DB Stats ** 2024-02-16T22:09:31.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-16T22:09:31.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-16T22:09:31.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-16T22:09:31.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-16T22:09:31.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-16T22:09:31.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-16T22:09:31.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-16T22:09:31.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:09:31.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-02-16T22:09:31.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-16T22:09:31.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-16T22:09:31.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L0 2/0 92.21 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 166.3 0.00 0.00 1 0.001 0 0 2024-02-16T22:09:31.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Sum 2/0 92.21 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 166.3 0.00 0.00 1 0.001 0 0 2024-02-16T22:09:31.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 166.3 0.00 0.00 1 0.001 0 0 2024-02-16T22:09:31.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:09:31.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-02-16T22:09:31.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-16T22:09:31.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-16T22:09:31.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 166.3 0.00 0.00 1 0.001 0 0 2024-02-16T22:09:31.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-16T22:09:31.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-16T22:09:31.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-16T22:09:31.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-16T22:09:31.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-16T22:09:31.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-16T22:09:31.666 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative compaction: 0.00 GB write, 30.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-16T22:09:31.666 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval compaction: 0.00 GB write, 30.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-16T22:09:31.666 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-16T22:09:31.666 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:09:31.666 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-16T22:09:31.666 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:09:31.666 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-02-16T22:09:31.666 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-16T22:09:31.666 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-16T22:09:31.666 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L0 2/0 92.21 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 166.3 0.00 0.00 1 0.001 0 0 2024-02-16T22:09:31.666 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Sum 2/0 92.21 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 166.3 0.00 0.00 1 0.001 0 0 2024-02-16T22:09:31.666 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-16T22:09:31.666 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:09:31.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-02-16T22:09:31.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-16T22:09:31.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-16T22:09:31.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 166.3 0.00 0.00 1 0.001 0 0 2024-02-16T22:09:31.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-16T22:09:31.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-16T22:09:31.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-16T22:09:31.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-16T22:09:31.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-16T22:09:31.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-16T22:09:31.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative compaction: 0.00 GB write, 30.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-16T22:09:31.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-16T22:09:31.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-16T22:09:31.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:09:31.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-16T22:09:31.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: starting mon.smithi134 rank 0 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi134 fsid f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:09:31.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: mon.smithi134@-1(???) e1 preinit fsid f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:09:31.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: mon.smithi134@-1(???).mds e1 new map 2024-02-16T22:09:31.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: mon.smithi134@-1(???).mds e1 print_map 2024-02-16T22:09:31.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: e1 2024-02-16T22:09:31.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:09:31.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:09:31.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: legacy client fscid: -1 2024-02-16T22:09:31.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:09:31.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: No filesystems configured 2024-02-16T22:09:31.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: mon.smithi134@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-16T22:09:31.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: mon.smithi134@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-16T22:09:31.669 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: mon.smithi134@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-16T22:09:31.669 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: mon.smithi134@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-16T22:09:31.669 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: mon.smithi134@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-16T22:09:31.669 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 bash[28849]: 93a679740d930487bbf01364d2fd8617cdc6851d1b22a04d9c006804a5d2f5e0 2024-02-16T22:09:31.669 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 systemd[1]: Started Ceph mon.smithi134 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:09:31.669 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: mon.smithi134 is new leader, mons smithi134 in quorum (ranks 0) 2024-02-16T22:09:31.669 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: monmap e1: 1 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-16T22:09:31.669 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: fsmap 2024-02-16T22:09:31.669 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: osdmap e1: 0 total, 0 up, 0 in 2024-02-16T22:09:31.669 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:31 smithi134 ceph-mon[28869]: mgrmap e1: no daemons active 2024-02-16T22:09:32.439 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.832+0000 7fee4f47b700 1 Processor -- start 2024-02-16T22:09:32.439 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.832+0000 7fee4f47b700 1 -- start start 2024-02-16T22:09:32.439 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.832+0000 7fee4f47b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee48102c40 0x7fee48103050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:32.439 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.832+0000 7fee4f47b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee48103590 con 0x7fee48102c40 2024-02-16T22:09:32.439 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.832+0000 7fee4d217700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee48102c40 0x7fee48103050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:32.440 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.832+0000 7fee4d217700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee48102c40 0x7fee48103050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43094/0 (socket says 172.21.15.134:43094) 2024-02-16T22:09:32.440 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.832+0000 7fee4d217700 1 -- 172.21.15.134:0/2789004277 learned_addr learned my addr 172.21.15.134:0/2789004277 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:32.440 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.833+0000 7fee4d217700 1 -- 172.21.15.134:0/2789004277 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee481036d0 con 0x7fee48102c40 2024-02-16T22:09:32.440 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.833+0000 7fee4d217700 1 --2- 172.21.15.134:0/2789004277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee48102c40 0x7fee48103050 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fee440098e0 tx=0x7fee44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3b3b104e5c060c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:32.440 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.833+0000 7fee3ffff700 1 -- 172.21.15.134:0/2789004277 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee4400b860 con 0x7fee48102c40 2024-02-16T22:09:32.440 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.833+0000 7fee3ffff700 1 -- 172.21.15.134:0/2789004277 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fee4400be50 con 0x7fee48102c40 2024-02-16T22:09:32.440 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.833+0000 7fee3ffff700 1 -- 172.21.15.134:0/2789004277 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee44010380 con 0x7fee48102c40 2024-02-16T22:09:32.440 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.834+0000 7fee4f47b700 1 -- 172.21.15.134:0/2789004277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee48102c40 msgr2=0x7fee48103050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:32.440 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.834+0000 7fee4f47b700 1 --2- 172.21.15.134:0/2789004277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee48102c40 0x7fee48103050 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fee440098e0 tx=0x7fee44009250 comp rx=0 tx=0).stop 2024-02-16T22:09:32.440 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.834+0000 7fee4f47b700 1 -- 172.21.15.134:0/2789004277 shutdown_connections 2024-02-16T22:09:32.440 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.834+0000 7fee4f47b700 1 --2- 172.21.15.134:0/2789004277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee48102c40 0x7fee48103050 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:32.440 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.834+0000 7fee4f47b700 1 -- 172.21.15.134:0/2789004277 >> 172.21.15.134:0/2789004277 conn(0x7fee480fc580 msgr2=0x7fee480fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:32.440 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.834+0000 7fee4f47b700 1 -- 172.21.15.134:0/2789004277 shutdown_connections 2024-02-16T22:09:32.441 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.834+0000 7fee4f47b700 1 -- 172.21.15.134:0/2789004277 wait complete. 2024-02-16T22:09:32.441 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.834+0000 7fee4f47b700 1 Processor -- start 2024-02-16T22:09:32.441 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.834+0000 7fee4f47b700 1 -- start start 2024-02-16T22:09:32.441 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.834+0000 7fee4f47b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee48102c40 0x7fee48111820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:32.441 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.834+0000 7fee4f47b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee48111d60 con 0x7fee48102c40 2024-02-16T22:09:32.441 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.835+0000 7fee4d217700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee48102c40 0x7fee48111820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:32.441 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.835+0000 7fee4d217700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee48102c40 0x7fee48111820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43098/0 (socket says 172.21.15.134:43098) 2024-02-16T22:09:32.441 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.835+0000 7fee4d217700 1 -- 172.21.15.134:0/30606274 learned_addr learned my addr 172.21.15.134:0/30606274 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:32.441 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.835+0000 7fee4d217700 1 -- 172.21.15.134:0/30606274 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee440094f0 con 0x7fee48102c40 2024-02-16T22:09:32.441 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.835+0000 7fee4d217700 1 --2- 172.21.15.134:0/30606274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee48102c40 0x7fee48111820 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fee4400b440 tx=0x7fee44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:32.441 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.835+0000 7fee3dffb700 1 -- 172.21.15.134:0/30606274 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee440107c0 con 0x7fee48102c40 2024-02-16T22:09:32.442 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.835+0000 7fee3dffb700 1 -- 172.21.15.134:0/30606274 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fee44010db0 con 0x7fee48102c40 2024-02-16T22:09:32.442 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.835+0000 7fee4f47b700 1 -- 172.21.15.134:0/30606274 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee48111f60 con 0x7fee48102c40 2024-02-16T22:09:32.442 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.835+0000 7fee3dffb700 1 -- 172.21.15.134:0/30606274 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee4401ada0 con 0x7fee48102c40 2024-02-16T22:09:32.442 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.835+0000 7fee4f47b700 1 -- 172.21.15.134:0/30606274 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee48112c00 con 0x7fee48102c40 2024-02-16T22:09:32.442 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.836+0000 7fee3dffb700 1 -- 172.21.15.134:0/30606274 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fee4402e6c0 con 0x7fee48102c40 2024-02-16T22:09:32.442 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.836+0000 7fee3dffb700 1 -- 172.21.15.134:0/30606274 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fee44024ad0 con 0x7fee48102c40 2024-02-16T22:09:32.442 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.837+0000 7fee4f47b700 1 -- 172.21.15.134:0/30606274 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4805f5c0 con 0x7fee48102c40 2024-02-16T22:09:32.442 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.839+0000 7fee3dffb700 1 -- 172.21.15.134:0/30606274 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fee44010920 con 0x7fee48102c40 2024-02-16T22:09:32.442 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.904+0000 7fee4f47b700 1 -- 172.21.15.134:0/30606274 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fee48064ad0 con 0x7fee48102c40 2024-02-16T22:09:32.442 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.909+0000 7fee3dffb700 1 -- 172.21.15.134:0/30606274 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fee44010ac0 con 0x7fee48102c40 2024-02-16T22:09:32.442 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.910+0000 7fee4f47b700 1 -- 172.21.15.134:0/30606274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee48102c40 msgr2=0x7fee48111820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:32.442 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.910+0000 7fee4f47b700 1 --2- 172.21.15.134:0/30606274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee48102c40 0x7fee48111820 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fee4400b440 tx=0x7fee44009250 comp rx=0 tx=0).stop 2024-02-16T22:09:32.442 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.910+0000 7fee4f47b700 1 -- 172.21.15.134:0/30606274 shutdown_connections 2024-02-16T22:09:32.443 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.910+0000 7fee4f47b700 1 --2- 172.21.15.134:0/30606274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee48102c40 0x7fee48111820 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:32.443 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.910+0000 7fee4f47b700 1 -- 172.21.15.134:0/30606274 >> 172.21.15.134:0/30606274 conn(0x7fee480fc580 msgr2=0x7fee480fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:32.443 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.910+0000 7fee4f47b700 1 -- 172.21.15.134:0/30606274 shutdown_connections 2024-02-16T22:09:32.443 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:31.910+0000 7fee4f47b700 1 -- 172.21.15.134:0/30606274 wait complete. 2024-02-16T22:09:32.443 INFO:teuthology.orchestra.run.smithi134.stdout:Wrote config to /etc/ceph/ceph.conf 2024-02-16T22:09:32.443 INFO:teuthology.orchestra.run.smithi134.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-16T22:09:32.443 INFO:teuthology.orchestra.run.smithi134.stdout:Creating mgr... 2024-02-16T22:09:32.443 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying port 9283 ... 2024-02-16T22:09:32.619 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mgr.smithi134.ordace 2024-02-16T22:09:32.619 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mgr.smithi134.ordace.service: Unit ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mgr.smithi134.ordace.service not loaded. 2024-02-16T22:09:32.771 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f29a5372-cd17-11ee-95ba-87774f69a715.target.wants/ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mgr.smithi134.ordace.service → /etc/systemd/system/ceph-f29a5372-cd17-11ee-95ba-87774f69a715@.service. 2024-02-16T22:09:33.067 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:32 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/30606274' entity='client.admin' 2024-02-16T22:09:33.292 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-16T22:09:33.293 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout disabled 2024-02-16T22:09:33.301 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-16T22:09:33.301 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-02-16T22:09:33.301 INFO:teuthology.orchestra.run.smithi134.stdout:firewalld.service is not enabled 2024-02-16T22:09:33.301 INFO:teuthology.orchestra.run.smithi134.stdout:Not possible to enable service . firewalld.service is not available 2024-02-16T22:09:33.312 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-16T22:09:33.312 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout disabled 2024-02-16T22:09:33.321 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-16T22:09:33.321 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-02-16T22:09:33.321 INFO:teuthology.orchestra.run.smithi134.stdout:firewalld.service is not enabled 2024-02-16T22:09:33.321 INFO:teuthology.orchestra.run.smithi134.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-02-16T22:09:33.321 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mgr to start... 2024-02-16T22:09:33.321 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mgr... 2024-02-16T22:09:33.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:33 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/1337941176' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-16T22:09:34.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-02-16T22:09:34.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-02-16T22:09:34.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsid": "f29a5372-cd17-11ee-95ba-87774f69a715", 2024-02-16T22:09:34.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "health": { 2024-02-16T22:09:34.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-16T22:09:34.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-16T22:09:34.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-16T22:09:34.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:34.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-16T22:09:34.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-16T22:09:34.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 0 2024-02-16T22:09:34.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-02-16T22:09:34.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-16T22:09:34.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "smithi134" 2024-02-16T22:09:34.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-02-16T22:09:34.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-02-16T22:09:34.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-16T22:09:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-16T22:09:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-16T22:09:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-16T22:09:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-16T22:09:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-16T22:09:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-16T22:09:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-16T22:09:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-16T22:09:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-16T22:09:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-16T22:09:34.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-16T22:09:34.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-16T22:09:34.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-16T22:09:34.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-16T22:09:34.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-16T22:09:34.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-16T22:09:34.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-16T22:09:34.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-16T22:09:34.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:34.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-16T22:09:34.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:34.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-16T22:09:34.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-16T22:09:34.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:34.435 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-16T22:09:34.435 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-16T22:09:34.435 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-16T22:09:34.435 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-16T22:09:34.435 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-16T22:09:34.435 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-16T22:09:34.435 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "restful" 2024-02-16T22:09:34.435 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-02-16T22:09:34.435 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-16T22:09:34.435 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:34.435 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-16T22:09:34.435 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:34.435 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modified": "2024-02-16T22:09:26.274490+0000", 2024-02-16T22:09:34.436 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-16T22:09:34.436 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:34.436 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-16T22:09:34.436 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-02-16T22:09:34.436 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.793+0000 7f49fa02d700 1 Processor -- start 2024-02-16T22:09:34.436 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.793+0000 7f49fa02d700 1 -- start start 2024-02-16T22:09:34.436 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.793+0000 7f49fa02d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f4102780 0x7f49f4102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:34.436 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.793+0000 7f49fa02d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f41030d0 con 0x7f49f4102780 2024-02-16T22:09:34.436 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.794+0000 7f49f37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f4102780 0x7f49f4102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:34.436 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.794+0000 7f49f37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f4102780 0x7f49f4102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43128/0 (socket says 172.21.15.134:43128) 2024-02-16T22:09:34.436 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.794+0000 7f49f37fe700 1 -- 172.21.15.134:0/4257141005 learned_addr learned my addr 172.21.15.134:0/4257141005 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:34.436 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.794+0000 7f49f37fe700 1 -- 172.21.15.134:0/4257141005 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f4103210 con 0x7f49f4102780 2024-02-16T22:09:34.436 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.794+0000 7f49f37fe700 1 --2- 172.21.15.134:0/4257141005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f4102780 0x7f49f4102b90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f49e80098e0 tx=0x7f49e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc080f087a4cf9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:34.436 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.794+0000 7f49f27fc700 1 -- 172.21.15.134:0/4257141005 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49e800b860 con 0x7f49f4102780 2024-02-16T22:09:34.437 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.794+0000 7f49f27fc700 1 -- 172.21.15.134:0/4257141005 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f49e800be50 con 0x7f49f4102780 2024-02-16T22:09:34.437 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.794+0000 7f49f27fc700 1 -- 172.21.15.134:0/4257141005 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49e8010380 con 0x7f49f4102780 2024-02-16T22:09:34.437 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.795+0000 7f49fa02d700 1 -- 172.21.15.134:0/4257141005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f4102780 msgr2=0x7f49f4102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:34.437 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.795+0000 7f49fa02d700 1 --2- 172.21.15.134:0/4257141005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f4102780 0x7f49f4102b90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f49e80098e0 tx=0x7f49e8009250 comp rx=0 tx=0).stop 2024-02-16T22:09:34.437 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.795+0000 7f49fa02d700 1 -- 172.21.15.134:0/4257141005 shutdown_connections 2024-02-16T22:09:34.437 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.795+0000 7f49fa02d700 1 --2- 172.21.15.134:0/4257141005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f4102780 0x7f49f4102b90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:34.437 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.795+0000 7f49fa02d700 1 -- 172.21.15.134:0/4257141005 >> 172.21.15.134:0/4257141005 conn(0x7f49f40fdf00 msgr2=0x7f49f4100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:34.437 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.795+0000 7f49fa02d700 1 -- 172.21.15.134:0/4257141005 shutdown_connections 2024-02-16T22:09:34.437 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.795+0000 7f49fa02d700 1 -- 172.21.15.134:0/4257141005 wait complete. 2024-02-16T22:09:34.437 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.795+0000 7f49fa02d700 1 Processor -- start 2024-02-16T22:09:34.437 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.796+0000 7f49fa02d700 1 -- start start 2024-02-16T22:09:34.437 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.796+0000 7f49fa02d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f4102780 0x7f49f4111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:34.437 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.796+0000 7f49fa02d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f4111aa0 con 0x7f49f4102780 2024-02-16T22:09:34.438 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.796+0000 7f49f37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f4102780 0x7f49f4111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:34.438 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.796+0000 7f49f37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f4102780 0x7f49f4111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43132/0 (socket says 172.21.15.134:43132) 2024-02-16T22:09:34.438 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.796+0000 7f49f37fe700 1 -- 172.21.15.134:0/1337941176 learned_addr learned my addr 172.21.15.134:0/1337941176 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:34.438 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.796+0000 7f49f37fe700 1 -- 172.21.15.134:0/1337941176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e80094f0 con 0x7f49f4102780 2024-02-16T22:09:34.438 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.796+0000 7f49f37fe700 1 --2- 172.21.15.134:0/1337941176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f4102780 0x7f49f4111560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f49e800b440 tx=0x7f49e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:34.438 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.797+0000 7f49dbfff700 1 -- 172.21.15.134:0/1337941176 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49e8010760 con 0x7f49f4102780 2024-02-16T22:09:34.438 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.797+0000 7f49dbfff700 1 -- 172.21.15.134:0/1337941176 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f49e8010d50 con 0x7f49f4102780 2024-02-16T22:09:34.438 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.797+0000 7f49fa02d700 1 -- 172.21.15.134:0/1337941176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f4111ca0 con 0x7f49f4102780 2024-02-16T22:09:34.438 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.797+0000 7f49fa02d700 1 -- 172.21.15.134:0/1337941176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f4112940 con 0x7f49f4102780 2024-02-16T22:09:34.438 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.797+0000 7f49dbfff700 1 -- 172.21.15.134:0/1337941176 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49e801ae20 con 0x7f49f4102780 2024-02-16T22:09:34.438 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.797+0000 7f49dbfff700 1 -- 172.21.15.134:0/1337941176 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f49e80246f0 con 0x7f49f4102780 2024-02-16T22:09:34.438 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.797+0000 7f49dbfff700 1 -- 172.21.15.134:0/1337941176 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f49e802eb30 con 0x7f49f4102780 2024-02-16T22:09:34.438 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.798+0000 7f49fa02d700 1 -- 172.21.15.134:0/1337941176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f405f5c0 con 0x7f49f4102780 2024-02-16T22:09:34.438 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.800+0000 7f49dbfff700 1 -- 172.21.15.134:0/1337941176 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f49e8029070 con 0x7f49f4102780 2024-02-16T22:09:34.439 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.872+0000 7f49fa02d700 1 -- 172.21.15.134:0/1337941176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f49f4112b80 con 0x7f49f4102780 2024-02-16T22:09:34.439 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.873+0000 7f49dbfff700 1 -- 172.21.15.134:0/1337941176 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f49e801a6a0 con 0x7f49f4102780 2024-02-16T22:09:34.439 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.873+0000 7f49fa02d700 1 -- 172.21.15.134:0/1337941176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f4102780 msgr2=0x7f49f4111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:34.439 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.873+0000 7f49fa02d700 1 --2- 172.21.15.134:0/1337941176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f4102780 0x7f49f4111560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f49e800b440 tx=0x7f49e8009250 comp rx=0 tx=0).stop 2024-02-16T22:09:34.439 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.873+0000 7f49fa02d700 1 -- 172.21.15.134:0/1337941176 shutdown_connections 2024-02-16T22:09:34.439 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.873+0000 7f49fa02d700 1 --2- 172.21.15.134:0/1337941176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f4102780 0x7f49f4111560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:34.439 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.873+0000 7f49fa02d700 1 -- 172.21.15.134:0/1337941176 >> 172.21.15.134:0/1337941176 conn(0x7f49f40fdf00 msgr2=0x7f49f40fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:34.439 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.874+0000 7f49fa02d700 1 -- 172.21.15.134:0/1337941176 shutdown_connections 2024-02-16T22:09:34.439 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:33.874+0000 7f49fa02d700 1 -- 172.21.15.134:0/1337941176 wait complete. 2024-02-16T22:09:34.439 INFO:teuthology.orchestra.run.smithi134.stdout:mgr not available, waiting (1/15)... 2024-02-16T22:09:37.574 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:37 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/3178385518' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-16T22:09:37.579 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-02-16T22:09:37.580 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-02-16T22:09:37.580 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsid": "f29a5372-cd17-11ee-95ba-87774f69a715", 2024-02-16T22:09:37.580 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "health": { 2024-02-16T22:09:37.580 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-16T22:09:37.580 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-16T22:09:37.580 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-16T22:09:37.580 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:37.580 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-16T22:09:37.580 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-16T22:09:37.580 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 0 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "smithi134" 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-16T22:09:37.581 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-16T22:09:37.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-16T22:09:37.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-16T22:09:37.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-16T22:09:37.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:37.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-16T22:09:37.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-16T22:09:37.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-16T22:09:37.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-16T22:09:37.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-16T22:09:37.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-16T22:09:37.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-16T22:09:37.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-16T22:09:37.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-16T22:09:37.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:37.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "restful" 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:37.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-16T22:09:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modified": "2024-02-16T22:09:26.274490+0000", 2024-02-16T22:09:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-16T22:09:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-16T22:09:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-02-16T22:09:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.898+0000 7fa6317df700 1 Processor -- start 2024-02-16T22:09:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.898+0000 7fa6317df700 1 -- start start 2024-02-16T22:09:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.898+0000 7fa6317df700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa62c0714a0 0x7fa62c105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.898+0000 7fa6317df700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c1058a0 con 0x7fa62c0714a0 2024-02-16T22:09:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.898+0000 7fa62affd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa62c0714a0 0x7fa62c105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.898+0000 7fa62affd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa62c0714a0 0x7fa62c105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43138/0 (socket says 172.21.15.134:43138) 2024-02-16T22:09:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.898+0000 7fa62affd700 1 -- 172.21.15.134:0/3910643624 learned_addr learned my addr 172.21.15.134:0/3910643624 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.898+0000 7fa62affd700 1 -- 172.21.15.134:0/3910643624 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c1059e0 con 0x7fa62c0714a0 2024-02-16T22:09:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.899+0000 7fa62affd700 1 --2- 172.21.15.134:0/3910643624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa62c0714a0 0x7fa62c105360 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0098e0 tx=0x7fa61c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8df6dbce5c0ce2b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.899+0000 7fa629ffb700 1 -- 172.21.15.134:0/3910643624 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa61c00b860 con 0x7fa62c0714a0 2024-02-16T22:09:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.899+0000 7fa629ffb700 1 -- 172.21.15.134:0/3910643624 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa61c00be50 con 0x7fa62c0714a0 2024-02-16T22:09:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.899+0000 7fa629ffb700 1 -- 172.21.15.134:0/3910643624 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa61c010380 con 0x7fa62c0714a0 2024-02-16T22:09:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.899+0000 7fa6317df700 1 -- 172.21.15.134:0/3910643624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa62c0714a0 msgr2=0x7fa62c105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.899+0000 7fa6317df700 1 --2- 172.21.15.134:0/3910643624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa62c0714a0 0x7fa62c105360 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0098e0 tx=0x7fa61c009250 comp rx=0 tx=0).stop 2024-02-16T22:09:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.899+0000 7fa6317df700 1 -- 172.21.15.134:0/3910643624 shutdown_connections 2024-02-16T22:09:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.899+0000 7fa6317df700 1 --2- 172.21.15.134:0/3910643624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa62c0714a0 0x7fa62c105360 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.899+0000 7fa6317df700 1 -- 172.21.15.134:0/3910643624 >> 172.21.15.134:0/3910643624 conn(0x7fa62c0fcdd0 msgr2=0x7fa62c0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.899+0000 7fa6317df700 1 -- 172.21.15.134:0/3910643624 shutdown_connections 2024-02-16T22:09:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.899+0000 7fa6317df700 1 -- 172.21.15.134:0/3910643624 wait complete. 2024-02-16T22:09:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.900+0000 7fa6317df700 1 Processor -- start 2024-02-16T22:09:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.900+0000 7fa6317df700 1 -- start start 2024-02-16T22:09:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.900+0000 7fa6317df700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa62c0714a0 0x7fa62c102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.900+0000 7fa6317df700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c101260 con 0x7fa62c0714a0 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.900+0000 7fa62affd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa62c0714a0 0x7fa62c102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.900+0000 7fa62affd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa62c0714a0 0x7fa62c102de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43154/0 (socket says 172.21.15.134:43154) 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.900+0000 7fa62affd700 1 -- 172.21.15.134:0/3178385518 learned_addr learned my addr 172.21.15.134:0/3178385518 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.901+0000 7fa62affd700 1 -- 172.21.15.134:0/3178385518 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c0094f0 con 0x7fa62c0714a0 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.901+0000 7fa62affd700 1 --2- 172.21.15.134:0/3178385518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa62c0714a0 0x7fa62c102de0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa61c006b00 tx=0x7fa61c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.901+0000 7fa6137fe700 1 -- 172.21.15.134:0/3178385518 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa61c0107c0 con 0x7fa62c0714a0 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.901+0000 7fa6137fe700 1 -- 172.21.15.134:0/3178385518 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa61c010db0 con 0x7fa62c0714a0 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.901+0000 7fa6317df700 1 -- 172.21.15.134:0/3178385518 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c101460 con 0x7fa62c0714a0 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.901+0000 7fa6137fe700 1 -- 172.21.15.134:0/3178385518 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa61c01acf0 con 0x7fa62c0714a0 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.901+0000 7fa6317df700 1 -- 172.21.15.134:0/3178385518 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c1018f0 con 0x7fa62c0714a0 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.901+0000 7fa6137fe700 1 -- 172.21.15.134:0/3178385518 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa61c024440 con 0x7fa62c0714a0 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.901+0000 7fa6137fe700 1 -- 172.21.15.134:0/3178385518 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa61c019710 con 0x7fa62c0714a0 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.902+0000 7fa6317df700 1 -- 172.21.15.134:0/3178385518 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c10b640 con 0x7fa62c0714a0 2024-02-16T22:09:37.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.904+0000 7fa6137fe700 1 -- 172.21.15.134:0/3178385518 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa61c0426d0 con 0x7fa62c0714a0 2024-02-16T22:09:37.595 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.975+0000 7fa6317df700 1 -- 172.21.15.134:0/3178385518 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa62c02b2a0 con 0x7fa62c0714a0 2024-02-16T22:09:37.595 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.975+0000 7fa6137fe700 1 -- 172.21.15.134:0/3178385518 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fa61c031020 con 0x7fa62c0714a0 2024-02-16T22:09:37.595 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.976+0000 7fa6317df700 1 -- 172.21.15.134:0/3178385518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa62c0714a0 msgr2=0x7fa62c102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:37.595 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.976+0000 7fa6317df700 1 --2- 172.21.15.134:0/3178385518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa62c0714a0 0x7fa62c102de0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa61c006b00 tx=0x7fa61c009250 comp rx=0 tx=0).stop 2024-02-16T22:09:37.595 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.977+0000 7fa6317df700 1 -- 172.21.15.134:0/3178385518 shutdown_connections 2024-02-16T22:09:37.595 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.977+0000 7fa6317df700 1 --2- 172.21.15.134:0/3178385518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa62c0714a0 0x7fa62c102de0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:37.595 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.977+0000 7fa6317df700 1 -- 172.21.15.134:0/3178385518 >> 172.21.15.134:0/3178385518 conn(0x7fa62c0fcdd0 msgr2=0x7fa62c0fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:37.595 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.977+0000 7fa6317df700 1 -- 172.21.15.134:0/3178385518 shutdown_connections 2024-02-16T22:09:37.595 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:36.977+0000 7fa6317df700 1 -- 172.21.15.134:0/3178385518 wait complete. 2024-02-16T22:09:37.595 INFO:teuthology.orchestra.run.smithi134.stdout:mgr not available, waiting (2/15)... 2024-02-16T22:09:40.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:39 smithi134 ceph-mon[28869]: Activating manager daemon smithi134.ordace 2024-02-16T22:09:40.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:39 smithi134 ceph-mon[28869]: mgrmap e2: smithi134.ordace(active, starting, since 0.00293311s) 2024-02-16T22:09:40.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:39 smithi134 ceph-mon[28869]: from='mgr.14100 172.21.15.134:0/2261120422' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-16T22:09:40.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:39 smithi134 ceph-mon[28869]: from='mgr.14100 172.21.15.134:0/2261120422' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-16T22:09:40.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:39 smithi134 ceph-mon[28869]: from='mgr.14100 172.21.15.134:0/2261120422' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-16T22:09:40.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:39 smithi134 ceph-mon[28869]: from='mgr.14100 172.21.15.134:0/2261120422' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:09:40.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:39 smithi134 ceph-mon[28869]: from='mgr.14100 172.21.15.134:0/2261120422' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr metadata", "who": "smithi134.ordace", "id": "smithi134.ordace"}]: dispatch 2024-02-16T22:09:40.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:39 smithi134 ceph-mon[28869]: Manager daemon smithi134.ordace is now available 2024-02-16T22:09:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:39 smithi134 ceph-mon[28869]: from='mgr.14100 172.21.15.134:0/2261120422' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/mirror_snapshot_schedule"}]: dispatch 2024-02-16T22:09:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:39 smithi134 ceph-mon[28869]: from='mgr.14100 172.21.15.134:0/2261120422' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/trash_purge_schedule"}]: dispatch 2024-02-16T22:09:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:39 smithi134 ceph-mon[28869]: from='mgr.14100 172.21.15.134:0/2261120422' entity='mgr.smithi134.ordace' 2024-02-16T22:09:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:39 smithi134 ceph-mon[28869]: from='mgr.14100 172.21.15.134:0/2261120422' entity='mgr.smithi134.ordace' 2024-02-16T22:09:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:39 smithi134 ceph-mon[28869]: from='mgr.14100 172.21.15.134:0/2261120422' entity='mgr.smithi134.ordace' 2024-02-16T22:09:40.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-02-16T22:09:40.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-02-16T22:09:40.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsid": "f29a5372-cd17-11ee-95ba-87774f69a715", 2024-02-16T22:09:40.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "health": { 2024-02-16T22:09:40.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-16T22:09:40.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-16T22:09:40.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-16T22:09:40.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:40.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-16T22:09:40.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-16T22:09:40.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 0 2024-02-16T22:09:40.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-02-16T22:09:40.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-16T22:09:40.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "smithi134" 2024-02-16T22:09:40.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-02-16T22:09:40.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-02-16T22:09:40.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-16T22:09:40.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:40.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-16T22:09:40.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-16T22:09:40.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:40.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-16T22:09:40.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:40.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-16T22:09:40.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-16T22:09:40.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-16T22:09:40.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-16T22:09:40.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-16T22:09:40.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-16T22:09:40.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:40.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-16T22:09:40.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-16T22:09:40.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-16T22:09:40.648 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-16T22:09:40.648 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-16T22:09:40.648 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-16T22:09:40.648 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-16T22:09:40.648 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "restful" 2024-02-16T22:09:40.648 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-02-16T22:09:40.648 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-16T22:09:40.648 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:40.648 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-16T22:09:40.648 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:40.648 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modified": "2024-02-16T22:09:26.274490+0000", 2024-02-16T22:09:40.648 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-16T22:09:40.648 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:40.648 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.019+0000 7f22b5df4700 1 Processor -- start 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.019+0000 7f22b5df4700 1 -- start start 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.019+0000 7f22b5df4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b0103e40 0x7f22b0104250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.019+0000 7f22b5df4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b0104790 con 0x7f22b0103e40 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.019+0000 7f22af7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b0103e40 0x7f22b0104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.019+0000 7f22af7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b0103e40 0x7f22b0104250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43240/0 (socket says 172.21.15.134:43240) 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.019+0000 7f22af7fe700 1 -- 172.21.15.134:0/3709510763 learned_addr learned my addr 172.21.15.134:0/3709510763 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.019+0000 7f22af7fe700 1 -- 172.21.15.134:0/3709510763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b01048d0 con 0x7f22b0103e40 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.020+0000 7f22af7fe700 1 --2- 172.21.15.134:0/3709510763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b0103e40 0x7f22b0104250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f22a40098e0 tx=0x7f22a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a736ef237269392 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.020+0000 7f22ae7fc700 1 -- 172.21.15.134:0/3709510763 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22a400b860 con 0x7f22b0103e40 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.020+0000 7f22ae7fc700 1 -- 172.21.15.134:0/3709510763 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f22a400be50 con 0x7f22b0103e40 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.020+0000 7f22ae7fc700 1 -- 172.21.15.134:0/3709510763 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22a4010380 con 0x7f22b0103e40 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.020+0000 7f22b5df4700 1 -- 172.21.15.134:0/3709510763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b0103e40 msgr2=0x7f22b0104250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:40.649 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.020+0000 7f22b5df4700 1 --2- 172.21.15.134:0/3709510763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b0103e40 0x7f22b0104250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f22a40098e0 tx=0x7f22a4009250 comp rx=0 tx=0).stop 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.020+0000 7f22b5df4700 1 -- 172.21.15.134:0/3709510763 shutdown_connections 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.020+0000 7f22b5df4700 1 --2- 172.21.15.134:0/3709510763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b0103e40 0x7f22b0104250 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.020+0000 7f22b5df4700 1 -- 172.21.15.134:0/3709510763 >> 172.21.15.134:0/3709510763 conn(0x7f22b00fc580 msgr2=0x7f22b00fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.020+0000 7f22b5df4700 1 -- 172.21.15.134:0/3709510763 shutdown_connections 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.020+0000 7f22b5df4700 1 -- 172.21.15.134:0/3709510763 wait complete. 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.021+0000 7f22b5df4700 1 Processor -- start 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.021+0000 7f22b5df4700 1 -- start start 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.021+0000 7f22b5df4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b0103e40 0x7f22b0111820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.021+0000 7f22b5df4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b0111d60 con 0x7f22b0103e40 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.021+0000 7f22af7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b0103e40 0x7f22b0111820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.021+0000 7f22af7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b0103e40 0x7f22b0111820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43252/0 (socket says 172.21.15.134:43252) 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.021+0000 7f22af7fe700 1 -- 172.21.15.134:0/2138340911 learned_addr learned my addr 172.21.15.134:0/2138340911 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.022+0000 7f22af7fe700 1 -- 172.21.15.134:0/2138340911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a40094f0 con 0x7f22b0103e40 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.022+0000 7f22af7fe700 1 --2- 172.21.15.134:0/2138340911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b0103e40 0x7f22b0111820 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f22a400b440 tx=0x7f22a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.022+0000 7f2297fff700 1 -- 172.21.15.134:0/2138340911 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22a4010760 con 0x7f22b0103e40 2024-02-16T22:09:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.022+0000 7f22b5df4700 1 -- 172.21.15.134:0/2138340911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b0111f60 con 0x7f22b0103e40 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.022+0000 7f2297fff700 1 -- 172.21.15.134:0/2138340911 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f22a4010d50 con 0x7f22b0103e40 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.022+0000 7f2297fff700 1 -- 172.21.15.134:0/2138340911 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22a4024d80 con 0x7f22b0103e40 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.022+0000 7f22b5df4700 1 -- 172.21.15.134:0/2138340911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b0112c00 con 0x7f22b0103e40 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.023+0000 7f2297fff700 1 -- 172.21.15.134:0/2138340911 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 2) v1 ==== 43124+0+0 (secure 0 0 0) 0x7f22a401a430 con 0x7f22b0103e40 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.023+0000 7f22b5df4700 1 -- 172.21.15.134:0/2138340911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b005f5c0 con 0x7f22b0103e40 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.023+0000 7f2297fff700 1 -- 172.21.15.134:0/2138340911 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f22a404a150 con 0x7f22b0103e40 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.025+0000 7f2297fff700 1 -- 172.21.15.134:0/2138340911 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f22a4018940 con 0x7f22b0103e40 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.093+0000 7f22b5df4700 1 -- 172.21.15.134:0/2138340911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f22b004bed0 con 0x7f22b0103e40 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.094+0000 7f2297fff700 1 -- 172.21.15.134:0/2138340911 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f22a402e020 con 0x7f22b0103e40 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.094+0000 7f22b5df4700 1 -- 172.21.15.134:0/2138340911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b0103e40 msgr2=0x7f22b0111820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.095+0000 7f22b5df4700 1 --2- 172.21.15.134:0/2138340911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b0103e40 0x7f22b0111820 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f22a400b440 tx=0x7f22a4009250 comp rx=0 tx=0).stop 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.095+0000 7f22b5df4700 1 -- 172.21.15.134:0/2138340911 shutdown_connections 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.095+0000 7f22b5df4700 1 --2- 172.21.15.134:0/2138340911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b0103e40 0x7f22b0111820 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.095+0000 7f22b5df4700 1 -- 172.21.15.134:0/2138340911 >> 172.21.15.134:0/2138340911 conn(0x7f22b00fc580 msgr2=0x7f22b00fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.095+0000 7f22b5df4700 1 -- 172.21.15.134:0/2138340911 shutdown_connections 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:40.095+0000 7f22b5df4700 1 -- 172.21.15.134:0/2138340911 wait complete. 2024-02-16T22:09:40.651 INFO:teuthology.orchestra.run.smithi134.stdout:mgr not available, waiting (3/15)... 2024-02-16T22:09:41.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:40 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2138340911' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-16T22:09:41.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:40 smithi134 ceph-mon[28869]: mgrmap e3: smithi134.ordace(active, since 1.00631s) 2024-02-16T22:09:43.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:43 smithi134 ceph-mon[28869]: mgrmap e4: smithi134.ordace(active, since 2s) 2024-02-16T22:09:46.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:46 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/892572883' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-16T22:09:51.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-02-16T22:09:51.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-02-16T22:09:51.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsid": "f29a5372-cd17-11ee-95ba-87774f69a715", 2024-02-16T22:09:51.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "health": { 2024-02-16T22:09:51.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 0 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "smithi134" 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-16T22:09:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-16T22:09:51.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "restful" 2024-02-16T22:09:51.057 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-02-16T22:09:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-16T22:09:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-16T22:09:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-16T22:09:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modified": "2024-02-16T22:09:26.274490+0000", 2024-02-16T22:09:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-16T22:09:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-02-16T22:09:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-16T22:09:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-02-16T22:09:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.858+0000 7fc573758700 1 Processor -- start 2024-02-16T22:09:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.858+0000 7fc573758700 1 -- start start 2024-02-16T22:09:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.859+0000 7fc573758700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56c071480 0x7fc56c105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.859+0000 7fc573758700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c1058c0 con 0x7fc56c071480 2024-02-16T22:09:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.859+0000 7fc5714f4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56c071480 0x7fc56c105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.859+0000 7fc5714f4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56c071480 0x7fc56c105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38054/0 (socket says 172.21.15.134:38054) 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.859+0000 7fc5714f4700 1 -- 172.21.15.134:0/4047167980 learned_addr learned my addr 172.21.15.134:0/4047167980 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.859+0000 7fc5714f4700 1 -- 172.21.15.134:0/4047167980 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c105a00 con 0x7fc56c071480 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.859+0000 7fc5714f4700 1 --2- 172.21.15.134:0/4047167980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56c071480 0x7fc56c105380 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0098e0 tx=0x7fc55c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daca71fed6dde1a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.859+0000 7fc563fff700 1 -- 172.21.15.134:0/4047167980 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc55c00b860 con 0x7fc56c071480 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.859+0000 7fc563fff700 1 -- 172.21.15.134:0/4047167980 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fc55c00be50 con 0x7fc56c071480 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.859+0000 7fc563fff700 1 -- 172.21.15.134:0/4047167980 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc55c010380 con 0x7fc56c071480 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.860+0000 7fc573758700 1 -- 172.21.15.134:0/4047167980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56c071480 msgr2=0x7fc56c105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.860+0000 7fc573758700 1 --2- 172.21.15.134:0/4047167980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56c071480 0x7fc56c105380 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0098e0 tx=0x7fc55c009250 comp rx=0 tx=0).stop 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.860+0000 7fc573758700 1 -- 172.21.15.134:0/4047167980 shutdown_connections 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.860+0000 7fc573758700 1 --2- 172.21.15.134:0/4047167980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56c071480 0x7fc56c105380 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.860+0000 7fc573758700 1 -- 172.21.15.134:0/4047167980 >> 172.21.15.134:0/4047167980 conn(0x7fc56c0fcdd0 msgr2=0x7fc56c0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.860+0000 7fc573758700 1 -- 172.21.15.134:0/4047167980 shutdown_connections 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.860+0000 7fc573758700 1 -- 172.21.15.134:0/4047167980 wait complete. 2024-02-16T22:09:51.059 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.860+0000 7fc573758700 1 Processor -- start 2024-02-16T22:09:51.060 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.861+0000 7fc573758700 1 -- start start 2024-02-16T22:09:51.060 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.861+0000 7fc573758700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56c071480 0x7fc56c111570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:51.060 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.861+0000 7fc573758700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c111ab0 con 0x7fc56c071480 2024-02-16T22:09:51.060 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.861+0000 7fc5714f4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56c071480 0x7fc56c111570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:51.060 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.861+0000 7fc5714f4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56c071480 0x7fc56c111570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38068/0 (socket says 172.21.15.134:38068) 2024-02-16T22:09:51.060 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.861+0000 7fc5714f4700 1 -- 172.21.15.134:0/892572883 learned_addr learned my addr 172.21.15.134:0/892572883 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:51.060 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.861+0000 7fc5714f4700 1 -- 172.21.15.134:0/892572883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c0094f0 con 0x7fc56c071480 2024-02-16T22:09:51.060 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.861+0000 7fc5714f4700 1 --2- 172.21.15.134:0/892572883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56c071480 0x7fc56c111570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc55c006b00 tx=0x7fc55c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:51.060 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.861+0000 7fc561ffb700 1 -- 172.21.15.134:0/892572883 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc55c0107c0 con 0x7fc56c071480 2024-02-16T22:09:51.060 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.861+0000 7fc561ffb700 1 -- 172.21.15.134:0/892572883 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fc55c010db0 con 0x7fc56c071480 2024-02-16T22:09:51.060 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.861+0000 7fc573758700 1 -- 172.21.15.134:0/892572883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c111cb0 con 0x7fc56c071480 2024-02-16T22:09:51.060 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.861+0000 7fc561ffb700 1 -- 172.21.15.134:0/892572883 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc55c01acf0 con 0x7fc56c071480 2024-02-16T22:09:51.060 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.862+0000 7fc573758700 1 -- 172.21.15.134:0/892572883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c112950 con 0x7fc56c071480 2024-02-16T22:09:51.060 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.863+0000 7fc561ffb700 1 -- 172.21.15.134:0/892572883 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7fc55c010920 con 0x7fc56c071480 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.863+0000 7fc573758700 1 -- 172.21.15.134:0/892572883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56c05f5c0 con 0x7fc56c071480 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.863+0000 7fc561ffb700 1 --2- 172.21.15.134:0/892572883 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7fc558036790 0x7fc558038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.863+0000 7fc561ffb700 1 -- 172.21.15.134:0/892572883 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc55c04a530 con 0x7fc56c071480 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.863+0000 7fc570cf3700 1 --2- 172.21.15.134:0/892572883 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7fc558036790 0x7fc558038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.863+0000 7fc570cf3700 1 --2- 172.21.15.134:0/892572883 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7fc558036790 0x7fc558038c40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc568009990 tx=0x7fc568006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:45.868+0000 7fc561ffb700 1 -- 172.21.15.134:0/892572883 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc55c010bd0 con 0x7fc56c071480 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:46.124+0000 7fc573758700 1 -- 172.21.15.134:0/892572883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc56c04bed0 con 0x7fc56c071480 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:46.124+0000 7fc561ffb700 1 -- 172.21.15.134:0/892572883 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fc55c0233a0 con 0x7fc56c071480 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:46.127+0000 7fc573758700 1 -- 172.21.15.134:0/892572883 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7fc558036790 msgr2=0x7fc558038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:46.127+0000 7fc573758700 1 --2- 172.21.15.134:0/892572883 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7fc558036790 0x7fc558038c40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc568009990 tx=0x7fc568006e40 comp rx=0 tx=0).stop 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:46.127+0000 7fc573758700 1 -- 172.21.15.134:0/892572883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56c071480 msgr2=0x7fc56c111570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:46.127+0000 7fc573758700 1 --2- 172.21.15.134:0/892572883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56c071480 0x7fc56c111570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc55c006b00 tx=0x7fc55c009250 comp rx=0 tx=0).stop 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:46.127+0000 7fc573758700 1 -- 172.21.15.134:0/892572883 shutdown_connections 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:46.127+0000 7fc573758700 1 --2- 172.21.15.134:0/892572883 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7fc558036790 0x7fc558038c40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:46.127+0000 7fc573758700 1 --2- 172.21.15.134:0/892572883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc56c071480 0x7fc56c111570 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:51.061 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:46.127+0000 7fc573758700 1 -- 172.21.15.134:0/892572883 >> 172.21.15.134:0/892572883 conn(0x7fc56c0fcdd0 msgr2=0x7fc56c0fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:51.062 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:46.127+0000 7fc573758700 1 -- 172.21.15.134:0/892572883 shutdown_connections 2024-02-16T22:09:51.062 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:46.127+0000 7fc573758700 1 -- 172.21.15.134:0/892572883 wait complete. 2024-02-16T22:09:51.062 INFO:teuthology.orchestra.run.smithi134.stdout:mgr is available 2024-02-16T22:09:52.240 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-02-16T22:09:52.240 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [global] 2024-02-16T22:09:52.240 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout fsid = f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:09:52.240 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-16T22:09:52.240 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-16T22:09:52.240 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-16T22:09:52.240 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-16T22:09:52.240 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-02-16T22:09:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-16T22:09:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-16T22:09:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-02-16T22:09:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [osd] 2024-02-16T22:09:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-16T22:09:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-16T22:09:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-16T22:09:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-16T22:09:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-16T22:09:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.472+0000 7f3ef48fe700 1 Processor -- start 2024-02-16T22:09:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.472+0000 7f3ef48fe700 1 -- start start 2024-02-16T22:09:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.473+0000 7f3ef48fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef0078ce0 0x7f3ef00771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.473+0000 7f3ef48fe700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00790f0 con 0x7f3ef0078ce0 2024-02-16T22:09:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.473+0000 7f3eee59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef0078ce0 0x7f3ef00771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:52.242 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.473+0000 7f3eee59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef0078ce0 0x7f3ef00771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44358/0 (socket says 172.21.15.134:44358) 2024-02-16T22:09:52.242 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.473+0000 7f3eee59c700 1 -- 172.21.15.134:0/3135649516 learned_addr learned my addr 172.21.15.134:0/3135649516 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:52.242 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.473+0000 7f3eee59c700 1 -- 172.21.15.134:0/3135649516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef0077730 con 0x7f3ef0078ce0 2024-02-16T22:09:52.242 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.474+0000 7f3eee59c700 1 --2- 172.21.15.134:0/3135649516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef0078ce0 0x7f3ef00771f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40098e0 tx=0x7f3ee4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08ab0d94099d1c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:52.242 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.474+0000 7f3eed59a700 1 -- 172.21.15.134:0/3135649516 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ee400b860 con 0x7f3ef0078ce0 2024-02-16T22:09:52.242 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.474+0000 7f3eed59a700 1 -- 172.21.15.134:0/3135649516 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3ee400be50 con 0x7f3ef0078ce0 2024-02-16T22:09:52.242 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.474+0000 7f3eed59a700 1 -- 172.21.15.134:0/3135649516 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ee4010380 con 0x7f3ef0078ce0 2024-02-16T22:09:52.242 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.474+0000 7f3ef48fe700 1 -- 172.21.15.134:0/3135649516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef0078ce0 msgr2=0x7f3ef00771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:52.242 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.474+0000 7f3ef48fe700 1 --2- 172.21.15.134:0/3135649516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef0078ce0 0x7f3ef00771f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40098e0 tx=0x7f3ee4009250 comp rx=0 tx=0).stop 2024-02-16T22:09:52.242 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.475+0000 7f3ef48fe700 1 -- 172.21.15.134:0/3135649516 shutdown_connections 2024-02-16T22:09:52.242 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.475+0000 7f3ef48fe700 1 --2- 172.21.15.134:0/3135649516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef0078ce0 0x7f3ef00771f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:52.242 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.475+0000 7f3ef48fe700 1 -- 172.21.15.134:0/3135649516 >> 172.21.15.134:0/3135649516 conn(0x7f3ef00fded0 msgr2=0x7f3ef0100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:52.242 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.475+0000 7f3ef48fe700 1 -- 172.21.15.134:0/3135649516 shutdown_connections 2024-02-16T22:09:52.242 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.475+0000 7f3ef48fe700 1 -- 172.21.15.134:0/3135649516 wait complete. 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.475+0000 7f3ef48fe700 1 Processor -- start 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.475+0000 7f3ef48fe700 1 -- start start 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.475+0000 7f3ef48fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef0078ce0 0x7f3ef01137e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.475+0000 7f3ef48fe700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef0113d20 con 0x7f3ef0078ce0 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.475+0000 7f3eee59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef0078ce0 0x7f3ef01137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.475+0000 7f3eee59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef0078ce0 0x7f3ef01137e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44374/0 (socket says 172.21.15.134:44374) 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.475+0000 7f3eee59c700 1 -- 172.21.15.134:0/1204875834 learned_addr learned my addr 172.21.15.134:0/1204875834 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.476+0000 7f3eee59c700 1 -- 172.21.15.134:0/1204875834 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee40094f0 con 0x7f3ef0078ce0 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.476+0000 7f3eee59c700 1 --2- 172.21.15.134:0/1204875834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef0078ce0 0x7f3ef01137e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3ee400b440 tx=0x7f3ee4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.476+0000 7f3edeffd700 1 -- 172.21.15.134:0/1204875834 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ee4010760 con 0x7f3ef0078ce0 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.476+0000 7f3edeffd700 1 -- 172.21.15.134:0/1204875834 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3ee4010d50 con 0x7f3ef0078ce0 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.476+0000 7f3ef48fe700 1 -- 172.21.15.134:0/1204875834 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef0113f20 con 0x7f3ef0078ce0 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.476+0000 7f3edeffd700 1 -- 172.21.15.134:0/1204875834 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ee401adc0 con 0x7f3ef0078ce0 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.476+0000 7f3ef48fe700 1 -- 172.21.15.134:0/1204875834 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef0114bc0 con 0x7f3ef0078ce0 2024-02-16T22:09:52.243 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.477+0000 7f3edeffd700 1 -- 172.21.15.134:0/1204875834 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7f3ee4019410 con 0x7f3ef0078ce0 2024-02-16T22:09:52.244 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.477+0000 7f3ef48fe700 1 -- 172.21.15.134:0/1204875834 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef005f5c0 con 0x7f3ef0078ce0 2024-02-16T22:09:52.244 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.477+0000 7f3edeffd700 1 --2- 172.21.15.134:0/1204875834 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f3ed8036720 0x7f3ed8038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:52.244 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.477+0000 7f3eedd9b700 1 --2- 172.21.15.134:0/1204875834 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f3ed8036720 0x7f3ed8038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:52.244 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.477+0000 7f3edeffd700 1 -- 172.21.15.134:0/1204875834 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3ee404a140 con 0x7f3ef0078ce0 2024-02-16T22:09:52.244 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.478+0000 7f3eedd9b700 1 --2- 172.21.15.134:0/1204875834 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f3ed8036720 0x7f3ed8038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009990 tx=0x7f3ee0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:52.244 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.482+0000 7f3edeffd700 1 -- 172.21.15.134:0/1204875834 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3ee4023940 con 0x7f3ef0078ce0 2024-02-16T22:09:52.244 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.665+0000 7f3ef48fe700 1 -- 172.21.15.134:0/1204875834 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3ef004bed0 con 0x7f3ef0078ce0 2024-02-16T22:09:52.244 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.666+0000 7f3edeffd700 1 -- 172.21.15.134:0/1204875834 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f3ee4023350 con 0x7f3ef0078ce0 2024-02-16T22:09:52.244 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.668+0000 7f3ef48fe700 1 -- 172.21.15.134:0/1204875834 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f3ed8036720 msgr2=0x7f3ed8038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:52.244 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.668+0000 7f3ef48fe700 1 --2- 172.21.15.134:0/1204875834 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f3ed8036720 0x7f3ed8038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009990 tx=0x7f3ee0006e40 comp rx=0 tx=0).stop 2024-02-16T22:09:52.244 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.668+0000 7f3ef48fe700 1 -- 172.21.15.134:0/1204875834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef0078ce0 msgr2=0x7f3ef01137e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:52.244 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.668+0000 7f3ef48fe700 1 --2- 172.21.15.134:0/1204875834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef0078ce0 0x7f3ef01137e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3ee400b440 tx=0x7f3ee4009250 comp rx=0 tx=0).stop 2024-02-16T22:09:52.244 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.668+0000 7f3ef48fe700 1 -- 172.21.15.134:0/1204875834 shutdown_connections 2024-02-16T22:09:52.244 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.668+0000 7f3ef48fe700 1 --2- 172.21.15.134:0/1204875834 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f3ed8036720 0x7f3ed8038bd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:52.245 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.668+0000 7f3ef48fe700 1 --2- 172.21.15.134:0/1204875834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ef0078ce0 0x7f3ef01137e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:52.245 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.668+0000 7f3ef48fe700 1 -- 172.21.15.134:0/1204875834 >> 172.21.15.134:0/1204875834 conn(0x7f3ef00fded0 msgr2=0x7f3ef00ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:52.245 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.668+0000 7f3ef48fe700 1 -- 172.21.15.134:0/1204875834 shutdown_connections 2024-02-16T22:09:52.245 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:51.668+0000 7f3ef48fe700 1 -- 172.21.15.134:0/1204875834 wait complete. 2024-02-16T22:09:52.245 INFO:teuthology.orchestra.run.smithi134.stdout:Enabling cephadm module... 2024-02-16T22:09:52.469 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:52 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/1204875834' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-16T22:09:53.719 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:53 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/4275583326' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-16T22:09:54.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.688+0000 7f7f2f179700 1 Processor -- start 2024-02-16T22:09:54.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.688+0000 7f7f2f179700 1 -- start start 2024-02-16T22:09:54.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.688+0000 7f7f2f179700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f28102770 0x7f7f28102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:54.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.688+0000 7f7f2f179700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281030c0 con 0x7f7f28102770 2024-02-16T22:09:54.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.688+0000 7f7f2cf15700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f28102770 0x7f7f28102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:54.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.688+0000 7f7f2cf15700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f28102770 0x7f7f28102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44388/0 (socket says 172.21.15.134:44388) 2024-02-16T22:09:54.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.688+0000 7f7f2cf15700 1 -- 172.21.15.134:0/134262545 learned_addr learned my addr 172.21.15.134:0/134262545 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:54.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.689+0000 7f7f2cf15700 1 -- 172.21.15.134:0/134262545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f28103200 con 0x7f7f28102770 2024-02-16T22:09:54.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.689+0000 7f7f2cf15700 1 --2- 172.21.15.134:0/134262545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f28102770 0x7f7f28102b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0098e0 tx=0x7f7f1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848b82fd345da7a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:54.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.689+0000 7f7f277fe700 1 -- 172.21.15.134:0/134262545 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f1c00b860 con 0x7f7f28102770 2024-02-16T22:09:54.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.689+0000 7f7f277fe700 1 -- 172.21.15.134:0/134262545 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7f1c00be50 con 0x7f7f28102770 2024-02-16T22:09:54.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.689+0000 7f7f277fe700 1 -- 172.21.15.134:0/134262545 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f1c010380 con 0x7f7f28102770 2024-02-16T22:09:54.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.689+0000 7f7f2f179700 1 -- 172.21.15.134:0/134262545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f28102770 msgr2=0x7f7f28102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:54.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.689+0000 7f7f2f179700 1 --2- 172.21.15.134:0/134262545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f28102770 0x7f7f28102b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0098e0 tx=0x7f7f1c009250 comp rx=0 tx=0).stop 2024-02-16T22:09:54.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.690+0000 7f7f2f179700 1 -- 172.21.15.134:0/134262545 shutdown_connections 2024-02-16T22:09:54.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.690+0000 7f7f2f179700 1 --2- 172.21.15.134:0/134262545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f28102770 0x7f7f28102b80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:54.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.690+0000 7f7f2f179700 1 -- 172.21.15.134:0/134262545 >> 172.21.15.134:0/134262545 conn(0x7f7f280fded0 msgr2=0x7f7f28100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:54.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.690+0000 7f7f2f179700 1 -- 172.21.15.134:0/134262545 shutdown_connections 2024-02-16T22:09:54.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.690+0000 7f7f2f179700 1 -- 172.21.15.134:0/134262545 wait complete. 2024-02-16T22:09:54.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.690+0000 7f7f2f179700 1 Processor -- start 2024-02-16T22:09:54.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.690+0000 7f7f2f179700 1 -- start start 2024-02-16T22:09:54.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.690+0000 7f7f2f179700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f28102770 0x7f7f28111590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:54.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.690+0000 7f7f2f179700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28111ad0 con 0x7f7f28102770 2024-02-16T22:09:54.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.691+0000 7f7f2cf15700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f28102770 0x7f7f28111590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:54.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.691+0000 7f7f2cf15700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f28102770 0x7f7f28111590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44394/0 (socket says 172.21.15.134:44394) 2024-02-16T22:09:54.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.691+0000 7f7f2cf15700 1 -- 172.21.15.134:0/4275583326 learned_addr learned my addr 172.21.15.134:0/4275583326 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:54.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.691+0000 7f7f2cf15700 1 -- 172.21.15.134:0/4275583326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c0094f0 con 0x7f7f28102770 2024-02-16T22:09:54.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.691+0000 7f7f2cf15700 1 --2- 172.21.15.134:0/4275583326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f28102770 0x7f7f28111590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00b440 tx=0x7f7f1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:54.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.691+0000 7f7f257fa700 1 -- 172.21.15.134:0/4275583326 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f1c010760 con 0x7f7f28102770 2024-02-16T22:09:54.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.691+0000 7f7f257fa700 1 -- 172.21.15.134:0/4275583326 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7f1c010d50 con 0x7f7f28102770 2024-02-16T22:09:54.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.691+0000 7f7f257fa700 1 -- 172.21.15.134:0/4275583326 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f1c01ae20 con 0x7f7f28102770 2024-02-16T22:09:54.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.691+0000 7f7f2f179700 1 -- 172.21.15.134:0/4275583326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f28111cd0 con 0x7f7f28102770 2024-02-16T22:09:54.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.691+0000 7f7f2f179700 1 -- 172.21.15.134:0/4275583326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f28112970 con 0x7f7f28102770 2024-02-16T22:09:54.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.692+0000 7f7f257fa700 1 -- 172.21.15.134:0/4275583326 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7f7f1c02e440 con 0x7f7f28102770 2024-02-16T22:09:54.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.692+0000 7f7f257fa700 1 --2- 172.21.15.134:0/4275583326 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f7f18036790 0x7f7f18038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:54.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.692+0000 7f7f2f179700 1 -- 172.21.15.134:0/4275583326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2805f5c0 con 0x7f7f28102770 2024-02-16T22:09:54.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.692+0000 7f7f257fa700 1 -- 172.21.15.134:0/4275583326 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7f1c04a550 con 0x7f7f28102770 2024-02-16T22:09:54.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.692+0000 7f7f27fff700 1 --2- 172.21.15.134:0/4275583326 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f7f18036790 0x7f7f18038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:54.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.693+0000 7f7f27fff700 1 --2- 172.21.15.134:0/4275583326 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f7f18036790 0x7f7f18038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009990 tx=0x7f7f14006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:54.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.697+0000 7f7f257fa700 1 -- 172.21.15.134:0/4275583326 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f7f1c018920 con 0x7f7f28102770 2024-02-16T22:09:54.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:52.929+0000 7f7f2f179700 1 -- 172.21.15.134:0/4275583326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f7f2804bed0 con 0x7f7f28102770 2024-02-16T22:09:54.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:53.374+0000 7f7f257fa700 1 -- 172.21.15.134:0/4275583326 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f7f1c0243f0 con 0x7f7f28102770 2024-02-16T22:09:54.041 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:53.375+0000 7f7f257fa700 1 -- 172.21.15.134:0/4275583326 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f7f1c018350 con 0x7f7f28102770 2024-02-16T22:09:54.041 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:53.378+0000 7f7f2f179700 1 -- 172.21.15.134:0/4275583326 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f7f18036790 msgr2=0x7f7f18038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:54.041 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:53.378+0000 7f7f2f179700 1 --2- 172.21.15.134:0/4275583326 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f7f18036790 0x7f7f18038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009990 tx=0x7f7f14006e40 comp rx=0 tx=0).stop 2024-02-16T22:09:54.041 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:53.378+0000 7f7f2f179700 1 -- 172.21.15.134:0/4275583326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f28102770 msgr2=0x7f7f28111590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:54.041 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:53.378+0000 7f7f2f179700 1 --2- 172.21.15.134:0/4275583326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f28102770 0x7f7f28111590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00b440 tx=0x7f7f1c009250 comp rx=0 tx=0).stop 2024-02-16T22:09:54.041 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:53.378+0000 7f7f2f179700 1 -- 172.21.15.134:0/4275583326 shutdown_connections 2024-02-16T22:09:54.041 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:53.378+0000 7f7f2f179700 1 --2- 172.21.15.134:0/4275583326 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f7f18036790 0x7f7f18038c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:54.041 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:53.378+0000 7f7f2f179700 1 --2- 172.21.15.134:0/4275583326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f28102770 0x7f7f28111590 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:54.041 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:53.378+0000 7f7f2f179700 1 -- 172.21.15.134:0/4275583326 >> 172.21.15.134:0/4275583326 conn(0x7f7f280fded0 msgr2=0x7f7f280ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:54.041 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:53.378+0000 7f7f2f179700 1 -- 172.21.15.134:0/4275583326 shutdown_connections 2024-02-16T22:09:54.041 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:53.378+0000 7f7f2f179700 1 -- 172.21.15.134:0/4275583326 wait complete. 2024-02-16T22:09:54.637 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:54 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/4275583326' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-16T22:09:54.637 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:54 smithi134 ceph-mon[28869]: mgrmap e5: smithi134.ordace(active, since 13s) 2024-02-16T22:09:55.269 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-02-16T22:09:55.269 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-02-16T22:09:55.269 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-16T22:09:55.269 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "active_name": "smithi134.ordace", 2024-02-16T22:09:55.269 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-16T22:09:55.269 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-02-16T22:09:55.269 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.442+0000 7f9c181a6700 1 Processor -- start 2024-02-16T22:09:55.269 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.442+0000 7f9c181a6700 1 -- start start 2024-02-16T22:09:55.269 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.442+0000 7f9c181a6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c10102780 0x7f9c10102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:55.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.442+0000 7f9c181a6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c101030d0 con 0x7f9c10102780 2024-02-16T22:09:55.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.442+0000 7f9c15f42700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c10102780 0x7f9c10102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:55.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.442+0000 7f9c15f42700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c10102780 0x7f9c10102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44432/0 (socket says 172.21.15.134:44432) 2024-02-16T22:09:55.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.443+0000 7f9c15f42700 1 -- 172.21.15.134:0/2854211068 learned_addr learned my addr 172.21.15.134:0/2854211068 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:55.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.443+0000 7f9c15f42700 1 -- 172.21.15.134:0/2854211068 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c10103210 con 0x7f9c10102780 2024-02-16T22:09:55.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.443+0000 7f9c15f42700 1 --2- 172.21.15.134:0/2854211068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c10102780 0x7f9c10102b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9c000098e0 tx=0x7f9c00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a44ce028d6dd5d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:55.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.443+0000 7f9c14f40700 1 -- 172.21.15.134:0/2854211068 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c0000b860 con 0x7f9c10102780 2024-02-16T22:09:55.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.443+0000 7f9c14f40700 1 -- 172.21.15.134:0/2854211068 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9c0000be50 con 0x7f9c10102780 2024-02-16T22:09:55.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.443+0000 7f9c14f40700 1 -- 172.21.15.134:0/2854211068 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c00010380 con 0x7f9c10102780 2024-02-16T22:09:55.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.444+0000 7f9c181a6700 1 -- 172.21.15.134:0/2854211068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c10102780 msgr2=0x7f9c10102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:55.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.444+0000 7f9c181a6700 1 --2- 172.21.15.134:0/2854211068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c10102780 0x7f9c10102b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9c000098e0 tx=0x7f9c00009250 comp rx=0 tx=0).stop 2024-02-16T22:09:55.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.444+0000 7f9c181a6700 1 -- 172.21.15.134:0/2854211068 shutdown_connections 2024-02-16T22:09:55.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.444+0000 7f9c181a6700 1 --2- 172.21.15.134:0/2854211068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c10102780 0x7f9c10102b90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:55.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.444+0000 7f9c181a6700 1 -- 172.21.15.134:0/2854211068 >> 172.21.15.134:0/2854211068 conn(0x7f9c100fdf00 msgr2=0x7f9c10100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:55.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.444+0000 7f9c181a6700 1 -- 172.21.15.134:0/2854211068 shutdown_connections 2024-02-16T22:09:55.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.444+0000 7f9c181a6700 1 -- 172.21.15.134:0/2854211068 wait complete. 2024-02-16T22:09:55.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.445+0000 7f9c181a6700 1 Processor -- start 2024-02-16T22:09:55.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.445+0000 7f9c181a6700 1 -- start start 2024-02-16T22:09:55.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.445+0000 7f9c181a6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c10102780 0x7f9c10111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:55.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.445+0000 7f9c181a6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c10111aa0 con 0x7f9c10102780 2024-02-16T22:09:55.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.445+0000 7f9c15f42700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c10102780 0x7f9c10111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:09:55.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.445+0000 7f9c15f42700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c10102780 0x7f9c10111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44438/0 (socket says 172.21.15.134:44438) 2024-02-16T22:09:55.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.445+0000 7f9c15f42700 1 -- 172.21.15.134:0/675791768 learned_addr learned my addr 172.21.15.134:0/675791768 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:09:55.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.445+0000 7f9c15f42700 1 -- 172.21.15.134:0/675791768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c000094f0 con 0x7f9c10102780 2024-02-16T22:09:55.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.445+0000 7f9c15f42700 1 --2- 172.21.15.134:0/675791768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c10102780 0x7f9c10111560 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9c00000c00 tx=0x7f9c00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:09:55.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.446+0000 7f9c067fc700 1 -- 172.21.15.134:0/675791768 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c000107c0 con 0x7f9c10102780 2024-02-16T22:09:55.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.446+0000 7f9c181a6700 1 -- 172.21.15.134:0/675791768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c10111ca0 con 0x7f9c10102780 2024-02-16T22:09:55.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.446+0000 7f9c067fc700 1 -- 172.21.15.134:0/675791768 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9c00010db0 con 0x7f9c10102780 2024-02-16T22:09:55.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.446+0000 7f9c067fc700 1 -- 172.21.15.134:0/675791768 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c0001ad00 con 0x7f9c10102780 2024-02-16T22:09:55.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.446+0000 7f9c181a6700 1 -- 172.21.15.134:0/675791768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c10112940 con 0x7f9c10102780 2024-02-16T22:09:55.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.446+0000 7f9c181a6700 1 -- 172.21.15.134:0/675791768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1005f5c0 con 0x7f9c10102780 2024-02-16T22:09:55.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.447+0000 7f9c067fc700 1 -- 172.21.15.134:0/675791768 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f9c0001a530 con 0x7f9c10102780 2024-02-16T22:09:55.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.447+0000 7f9c067fc700 1 --2- 172.21.15.134:0/675791768 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f9bfc036790 0x7f9bfc038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:09:55.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.447+0000 7f9c067fc700 1 -- 172.21.15.134:0/675791768 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9c0004a6d0 con 0x7f9c10102780 2024-02-16T22:09:55.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.447+0000 7f9c15741700 1 -- 172.21.15.134:0/675791768 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f9bfc036790 msgr2=0x7f9bfc038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3459537666 2024-02-16T22:09:55.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.447+0000 7f9c15741700 1 --2- 172.21.15.134:0/675791768 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f9bfc036790 0x7f9bfc038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T22:09:55.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.455+0000 7f9c067fc700 1 -- 172.21.15.134:0/675791768 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9c00010920 con 0x7f9c10102780 2024-02-16T22:09:55.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.648+0000 7f9c15741700 1 -- 172.21.15.134:0/675791768 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f9bfc036790 msgr2=0x7f9bfc038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3459537666 2024-02-16T22:09:55.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.648+0000 7f9c15741700 1 --2- 172.21.15.134:0/675791768 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f9bfc036790 0x7f9bfc038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-16T22:09:55.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.695+0000 7f9c181a6700 1 -- 172.21.15.134:0/675791768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f9c10112c80 con 0x7f9c10102780 2024-02-16T22:09:55.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.696+0000 7f9c067fc700 1 -- 172.21.15.134:0/675791768 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f9c0002bb40 con 0x7f9c10102780 2024-02-16T22:09:55.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.698+0000 7f9c181a6700 1 -- 172.21.15.134:0/675791768 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f9bfc036790 msgr2=0x7f9bfc038c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-16T22:09:55.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.698+0000 7f9c181a6700 1 --2- 172.21.15.134:0/675791768 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f9bfc036790 0x7f9bfc038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:55.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.698+0000 7f9c181a6700 1 -- 172.21.15.134:0/675791768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c10102780 msgr2=0x7f9c10111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:09:55.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.698+0000 7f9c181a6700 1 --2- 172.21.15.134:0/675791768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c10102780 0x7f9c10111560 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9c00000c00 tx=0x7f9c00009250 comp rx=0 tx=0).stop 2024-02-16T22:09:55.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.698+0000 7f9c181a6700 1 -- 172.21.15.134:0/675791768 shutdown_connections 2024-02-16T22:09:55.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.698+0000 7f9c181a6700 1 --2- 172.21.15.134:0/675791768 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f9bfc036790 0x7f9bfc038c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:55.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.698+0000 7f9c181a6700 1 --2- 172.21.15.134:0/675791768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c10102780 0x7f9c10111560 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:09:55.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.698+0000 7f9c181a6700 1 -- 172.21.15.134:0/675791768 >> 172.21.15.134:0/675791768 conn(0x7f9c100fdf00 msgr2=0x7f9c100fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:09:55.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.698+0000 7f9c181a6700 1 -- 172.21.15.134:0/675791768 shutdown_connections 2024-02-16T22:09:55.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:54.698+0000 7f9c181a6700 1 -- 172.21.15.134:0/675791768 wait complete. 2024-02-16T22:09:55.273 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for the mgr to restart... 2024-02-16T22:09:55.273 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mgr epoch 5... 2024-02-16T22:09:55.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:55 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/675791768' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-16T22:10:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: Active manager daemon smithi134.ordace restarted 2024-02-16T22:10:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: Activating manager daemon smithi134.ordace 2024-02-16T22:10:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: osdmap e2: 0 total, 0 up, 0 in 2024-02-16T22:10:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: mgrmap e6: smithi134.ordace(active, starting, since 0.00322427s) 2024-02-16T22:10:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:10:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr metadata", "who": "smithi134.ordace", "id": "smithi134.ordace"}]: dispatch 2024-02-16T22:10:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-16T22:10:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-16T22:10:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-16T22:10:00.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: Manager daemon smithi134.ordace is now available 2024-02-16T22:10:00.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:00.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:00.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:10:00.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:10:00.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:09:59 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:10:01.100 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:00 smithi134 ceph-mon[28869]: Found migration_current of "None". Setting to last migration. 2024-02-16T22:10:01.100 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:00 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/mirror_snapshot_schedule"}]: dispatch 2024-02-16T22:10:01.100 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:00 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/trash_purge_schedule"}]: dispatch 2024-02-16T22:10:01.100 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:00 smithi134 ceph-mon[28869]: mgrmap e7: smithi134.ordace(active, since 1.00546s) 2024-02-16T22:10:01.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-02-16T22:10:01.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-16T22:10:01.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-16T22:10:01.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-02-16T22:10:01.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.709+0000 7f0379b70700 1 Processor -- start 2024-02-16T22:10:01.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.709+0000 7f0379b70700 1 -- start start 2024-02-16T22:10:01.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.709+0000 7f0379b70700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0374077bf0 0x7f0374076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.709+0000 7f0379b70700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0374078000 con 0x7f0374077bf0 2024-02-16T22:10:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.709+0000 7f03737fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0374077bf0 0x7f0374076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.709+0000 7f03737fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0374077bf0 0x7f0374076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44454/0 (socket says 172.21.15.134:44454) 2024-02-16T22:10:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.709+0000 7f03737fe700 1 -- 172.21.15.134:0/1199166605 learned_addr learned my addr 172.21.15.134:0/1199166605 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.709+0000 7f03737fe700 1 -- 172.21.15.134:0/1199166605 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0374076640 con 0x7f0374077bf0 2024-02-16T22:10:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.710+0000 7f03737fe700 1 --2- 172.21.15.134:0/1199166605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0374077bf0 0x7f0374076100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f03640098e0 tx=0x7f0364009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4a7c500b28b40c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.710+0000 7f03727fc700 1 -- 172.21.15.134:0/1199166605 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f036400b860 con 0x7f0374077bf0 2024-02-16T22:10:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.710+0000 7f03727fc700 1 -- 172.21.15.134:0/1199166605 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f036400be50 con 0x7f0374077bf0 2024-02-16T22:10:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.710+0000 7f03727fc700 1 -- 172.21.15.134:0/1199166605 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0364010380 con 0x7f0374077bf0 2024-02-16T22:10:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.710+0000 7f0379b70700 1 -- 172.21.15.134:0/1199166605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0374077bf0 msgr2=0x7f0374076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.710+0000 7f0379b70700 1 --2- 172.21.15.134:0/1199166605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0374077bf0 0x7f0374076100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f03640098e0 tx=0x7f0364009250 comp rx=0 tx=0).stop 2024-02-16T22:10:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.711+0000 7f0379b70700 1 -- 172.21.15.134:0/1199166605 shutdown_connections 2024-02-16T22:10:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.711+0000 7f0379b70700 1 --2- 172.21.15.134:0/1199166605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0374077bf0 0x7f0374076100 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.711+0000 7f0379b70700 1 -- 172.21.15.134:0/1199166605 >> 172.21.15.134:0/1199166605 conn(0x7f03740fded0 msgr2=0x7f0374100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.711+0000 7f0379b70700 1 -- 172.21.15.134:0/1199166605 shutdown_connections 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.711+0000 7f0379b70700 1 -- 172.21.15.134:0/1199166605 wait complete. 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.711+0000 7f0379b70700 1 Processor -- start 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.711+0000 7f0379b70700 1 -- start start 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.711+0000 7f0379b70700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0374077bf0 0x7f0374113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.711+0000 7f0379b70700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0374113f70 con 0x7f0374077bf0 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.712+0000 7f03737fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0374077bf0 0x7f0374113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.712+0000 7f03737fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0374077bf0 0x7f0374113a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44468/0 (socket says 172.21.15.134:44468) 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.712+0000 7f03737fe700 1 -- 172.21.15.134:0/865258133 learned_addr learned my addr 172.21.15.134:0/865258133 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.712+0000 7f03737fe700 1 -- 172.21.15.134:0/865258133 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03640094f0 con 0x7f0374077bf0 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.712+0000 7f03737fe700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0374077bf0 0x7f0374113a30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f036400b440 tx=0x7f0364009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.712+0000 7f035bfff700 1 -- 172.21.15.134:0/865258133 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03640107c0 con 0x7f0374077bf0 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.712+0000 7f035bfff700 1 -- 172.21.15.134:0/865258133 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0364010db0 con 0x7f0374077bf0 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.712+0000 7f035bfff700 1 -- 172.21.15.134:0/865258133 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f036401ad30 con 0x7f0374077bf0 2024-02-16T22:10:01.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.712+0000 7f0379b70700 1 -- 172.21.15.134:0/865258133 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0374114170 con 0x7f0374077bf0 2024-02-16T22:10:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.712+0000 7f0379b70700 1 -- 172.21.15.134:0/865258133 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0374114540 con 0x7f0374077bf0 2024-02-16T22:10:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.713+0000 7f035bfff700 1 -- 172.21.15.134:0/865258133 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f036402e440 con 0x7f0374077bf0 2024-02-16T22:10:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.713+0000 7f035bfff700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f035c036790 0x7f035c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.713+0000 7f035bfff700 1 -- 172.21.15.134:0/865258133 --> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f035c039350 con 0x7f035c036790 2024-02-16T22:10:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.713+0000 7f035bfff700 1 -- 172.21.15.134:0/865258133 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f036404ada0 con 0x7f0374077bf0 2024-02-16T22:10:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.713+0000 7f0372ffd700 1 -- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f035c036790 msgr2=0x7f035c038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3459537666 2024-02-16T22:10:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.713+0000 7f0372ffd700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f035c036790 0x7f035c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T22:10:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.914+0000 7f0372ffd700 1 -- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f035c036790 msgr2=0x7f035c038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3459537666 2024-02-16T22:10:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:55.914+0000 7f0372ffd700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f035c036790 0x7f035c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-16T22:10:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:56.315+0000 7f0372ffd700 1 -- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f035c036790 msgr2=0x7f035c038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3459537666 2024-02-16T22:10:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:56.315+0000 7f0372ffd700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f035c036790 0x7f035c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-16T22:10:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:57.116+0000 7f0372ffd700 1 -- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f035c036790 msgr2=0x7f035c038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3459537666 2024-02-16T22:10:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:57.116+0000 7f0372ffd700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f035c036790 0x7f035c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-16T22:10:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:58.717+0000 7f0372ffd700 1 -- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f035c036790 msgr2=0x7f035c038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3459537666 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:58.717+0000 7f0372ffd700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f035c036790 0x7f035c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:59.841+0000 7f035bfff700 1 -- 172.21.15.134:0/865258133 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mgrmap(e 6) v1 ==== 43135+0+0 (secure 0 0 0) 0x7f036401afa0 con 0x7f0374077bf0 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:59.841+0000 7f035bfff700 1 -- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f035c036790 msgr2=0x7f035c038c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:09:59.841+0000 7f035bfff700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f035c036790 0x7f035c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.841+0000 7f035bfff700 1 -- 172.21.15.134:0/865258133 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 7) v1 ==== 43262+0+0 (secure 0 0 0) 0x7f036404a390 con 0x7f0374077bf0 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.841+0000 7f035bfff700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f035c039fc0 0x7f035c03c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.841+0000 7f035bfff700 1 -- 172.21.15.134:0/865258133 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f035c039350 con 0x7f035c039fc0 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.841+0000 7f0372ffd700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f035c039fc0 0x7f035c03c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.842+0000 7f0372ffd700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f035c039fc0 0x7f035c03c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f03680039d0 tx=0x7f0368009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.842+0000 7f035bfff700 1 -- 172.21.15.134:0/865258133 <== mgr.14120 v2:172.21.15.134:6800/3520115315 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f035c039350 con 0x7f035c039fc0 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.848+0000 7f0379b70700 1 -- 172.21.15.134:0/865258133 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f037404bed0 con 0x7f035c039fc0 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.849+0000 7f035bfff700 1 -- 172.21.15.134:0/865258133 <== mgr.14120 v2:172.21.15.134:6800/3520115315 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f037404bed0 con 0x7f035c039fc0 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.849+0000 7f0379b70700 1 -- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f035c039fc0 msgr2=0x7f035c03c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.849+0000 7f0379b70700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f035c039fc0 0x7f035c03c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f03680039d0 tx=0x7f0368009350 comp rx=0 tx=0).stop 2024-02-16T22:10:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.849+0000 7f0379b70700 1 -- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0374077bf0 msgr2=0x7f0374113a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:01.399 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.849+0000 7f0379b70700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0374077bf0 0x7f0374113a30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f036400b440 tx=0x7f0364009250 comp rx=0 tx=0).stop 2024-02-16T22:10:01.399 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.849+0000 7f0379b70700 1 -- 172.21.15.134:0/865258133 shutdown_connections 2024-02-16T22:10:01.399 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.849+0000 7f0379b70700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f035c039fc0 0x7f035c03c3a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:01.399 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.849+0000 7f0379b70700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0374077bf0 0x7f0374113a30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:01.399 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.849+0000 7f0379b70700 1 --2- 172.21.15.134:0/865258133 >> [v2:172.21.15.134:6800/3459537666,v1:172.21.15.134:6801/3459537666] conn(0x7f035c036790 0x7f035c038c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:01.399 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.849+0000 7f0379b70700 1 -- 172.21.15.134:0/865258133 >> 172.21.15.134:0/865258133 conn(0x7f03740fded0 msgr2=0x7f03741001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:01.399 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.849+0000 7f0379b70700 1 -- 172.21.15.134:0/865258133 shutdown_connections 2024-02-16T22:10:01.399 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:00.849+0000 7f0379b70700 1 -- 172.21.15.134:0/865258133 wait complete. 2024-02-16T22:10:01.399 INFO:teuthology.orchestra.run.smithi134.stdout:mgr epoch 5 is available 2024-02-16T22:10:01.399 INFO:teuthology.orchestra.run.smithi134.stdout:Setting orchestrator backend to cephadm... 2024-02-16T22:10:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:01 smithi134 ceph-mon[28869]: [16/Feb/2024:22:10:00] ENGINE Bus STARTING 2024-02-16T22:10:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:01 smithi134 ceph-mon[28869]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-16T22:10:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:01 smithi134 ceph-mon[28869]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-16T22:10:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:01 smithi134 ceph-mon[28869]: [16/Feb/2024:22:10:00] ENGINE Serving on https://172.21.15.134:7150 2024-02-16T22:10:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:01 smithi134 ceph-mon[28869]: [16/Feb/2024:22:10:00] ENGINE Bus STARTED 2024-02-16T22:10:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:01 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:01 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:10:02.549 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.850+0000 7fe078dde700 1 Processor -- start 2024-02-16T22:10:02.549 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.850+0000 7fe078dde700 1 -- start start 2024-02-16T22:10:02.550 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.850+0000 7fe078dde700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe074102d70 0x7fe074103180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:02.550 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.850+0000 7fe078dde700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0741036c0 con 0x7fe074102d70 2024-02-16T22:10:02.550 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.850+0000 7fe07259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe074102d70 0x7fe074103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:02.550 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.850+0000 7fe07259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe074102d70 0x7fe074103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41852/0 (socket says 172.21.15.134:41852) 2024-02-16T22:10:02.550 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.850+0000 7fe07259c700 1 -- 172.21.15.134:0/488034585 learned_addr learned my addr 172.21.15.134:0/488034585 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:02.550 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.851+0000 7fe07259c700 1 -- 172.21.15.134:0/488034585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe074103800 con 0x7fe074102d70 2024-02-16T22:10:02.550 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.851+0000 7fe07259c700 1 --2- 172.21.15.134:0/488034585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe074102d70 0x7fe074103180 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe0640098e0 tx=0x7fe064009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b929cfadeb61f14 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:02.550 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.851+0000 7fe07159a700 1 -- 172.21.15.134:0/488034585 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe06400b8f0 con 0x7fe074102d70 2024-02-16T22:10:02.550 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.851+0000 7fe07159a700 1 -- 172.21.15.134:0/488034585 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe064011420 con 0x7fe074102d70 2024-02-16T22:10:02.550 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.851+0000 7fe07159a700 1 -- 172.21.15.134:0/488034585 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe064010540 con 0x7fe074102d70 2024-02-16T22:10:02.550 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.852+0000 7fe078dde700 1 -- 172.21.15.134:0/488034585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe074102d70 msgr2=0x7fe074103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:02.550 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.852+0000 7fe078dde700 1 --2- 172.21.15.134:0/488034585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe074102d70 0x7fe074103180 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe0640098e0 tx=0x7fe064009250 comp rx=0 tx=0).stop 2024-02-16T22:10:02.550 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.852+0000 7fe078dde700 1 -- 172.21.15.134:0/488034585 shutdown_connections 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.852+0000 7fe078dde700 1 --2- 172.21.15.134:0/488034585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe074102d70 0x7fe074103180 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.852+0000 7fe078dde700 1 -- 172.21.15.134:0/488034585 >> 172.21.15.134:0/488034585 conn(0x7fe0740fc580 msgr2=0x7fe0740fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.852+0000 7fe078dde700 1 -- 172.21.15.134:0/488034585 shutdown_connections 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.852+0000 7fe078dde700 1 -- 172.21.15.134:0/488034585 wait complete. 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.852+0000 7fe078dde700 1 Processor -- start 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.852+0000 7fe078dde700 1 -- start start 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.852+0000 7fe078dde700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe074102d70 0x7fe074113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.852+0000 7fe078dde700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe074113ff0 con 0x7fe074102d70 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.852+0000 7fe07259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe074102d70 0x7fe074113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.853+0000 7fe07259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe074102d70 0x7fe074113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41860/0 (socket says 172.21.15.134:41860) 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.853+0000 7fe07259c700 1 -- 172.21.15.134:0/3236611126 learned_addr learned my addr 172.21.15.134:0/3236611126 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.853+0000 7fe07259c700 1 -- 172.21.15.134:0/3236611126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640094f0 con 0x7fe074102d70 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.853+0000 7fe07259c700 1 --2- 172.21.15.134:0/3236611126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe074102d70 0x7fe074113ab0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe06400b440 tx=0x7fe064009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.853+0000 7fe062ffd700 1 -- 172.21.15.134:0/3236611126 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe064010800 con 0x7fe074102d70 2024-02-16T22:10:02.551 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.853+0000 7fe062ffd700 1 -- 172.21.15.134:0/3236611126 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe064010df0 con 0x7fe074102d70 2024-02-16T22:10:02.552 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.853+0000 7fe062ffd700 1 -- 172.21.15.134:0/3236611126 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe06401a430 con 0x7fe074102d70 2024-02-16T22:10:02.552 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.853+0000 7fe078dde700 1 -- 172.21.15.134:0/3236611126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0741141f0 con 0x7fe074102d70 2024-02-16T22:10:02.552 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.853+0000 7fe078dde700 1 -- 172.21.15.134:0/3236611126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe074114e90 con 0x7fe074102d70 2024-02-16T22:10:02.552 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.854+0000 7fe062ffd700 1 -- 172.21.15.134:0/3236611126 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) v1 ==== 43262+0+0 (secure 0 0 0) 0x7fe06401a5b0 con 0x7fe074102d70 2024-02-16T22:10:02.552 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.854+0000 7fe078dde700 1 -- 172.21.15.134:0/3236611126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07405f5c0 con 0x7fe074102d70 2024-02-16T22:10:02.552 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.854+0000 7fe062ffd700 1 --2- 172.21.15.134:0/3236611126 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fe05c0366b0 0x7fe05c038b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:02.552 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.854+0000 7fe062ffd700 1 -- 172.21.15.134:0/3236611126 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe06404a6f0 con 0x7fe074102d70 2024-02-16T22:10:02.552 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.854+0000 7fe071d9b700 1 --2- 172.21.15.134:0/3236611126 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fe05c0366b0 0x7fe05c038b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:02.552 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.855+0000 7fe071d9b700 1 --2- 172.21.15.134:0/3236611126 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fe05c0366b0 0x7fe05c038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe068009990 tx=0x7fe068006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:02.552 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:01.859+0000 7fe062ffd700 1 -- 172.21.15.134:0/3236611126 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe06402d3f0 con 0x7fe074102d70 2024-02-16T22:10:02.552 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.056+0000 7fe078dde700 1 -- 172.21.15.134:0/3236611126 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fe074108b20 con 0x7fe05c0366b0 2024-02-16T22:10:02.552 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.063+0000 7fe062ffd700 1 -- 172.21.15.134:0/3236611126 <== mgr.14120 v2:172.21.15.134:6800/3520115315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe074108b20 con 0x7fe05c0366b0 2024-02-16T22:10:02.553 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.065+0000 7fe078dde700 1 -- 172.21.15.134:0/3236611126 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fe05c0366b0 msgr2=0x7fe05c038b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:02.553 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.065+0000 7fe078dde700 1 --2- 172.21.15.134:0/3236611126 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fe05c0366b0 0x7fe05c038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe068009990 tx=0x7fe068006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:02.553 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.065+0000 7fe078dde700 1 -- 172.21.15.134:0/3236611126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe074102d70 msgr2=0x7fe074113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:02.553 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.065+0000 7fe078dde700 1 --2- 172.21.15.134:0/3236611126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe074102d70 0x7fe074113ab0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe06400b440 tx=0x7fe064009250 comp rx=0 tx=0).stop 2024-02-16T22:10:02.553 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.065+0000 7fe078dde700 1 -- 172.21.15.134:0/3236611126 shutdown_connections 2024-02-16T22:10:02.553 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.065+0000 7fe078dde700 1 --2- 172.21.15.134:0/3236611126 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fe05c0366b0 0x7fe05c038b60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:02.553 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.065+0000 7fe078dde700 1 --2- 172.21.15.134:0/3236611126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe074102d70 0x7fe074113ab0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:02.553 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.065+0000 7fe078dde700 1 -- 172.21.15.134:0/3236611126 >> 172.21.15.134:0/3236611126 conn(0x7fe0740fc580 msgr2=0x7fe0740fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:02.553 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.065+0000 7fe078dde700 1 -- 172.21.15.134:0/3236611126 shutdown_connections 2024-02-16T22:10:02.553 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.065+0000 7fe078dde700 1 -- 172.21.15.134:0/3236611126 wait complete. 2024-02-16T22:10:03.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:03 smithi134 ceph-mon[28869]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:03.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:03 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:03.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:03 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:10:03.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:03 smithi134 ceph-mon[28869]: mgrmap e8: smithi134.ordace(active, since 2s) 2024-02-16T22:10:03.815 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout value unchanged 2024-02-16T22:10:03.815 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.954+0000 7f0e1e01a700 1 Processor -- start 2024-02-16T22:10:03.815 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.954+0000 7f0e1e01a700 1 -- start start 2024-02-16T22:10:03.815 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.954+0000 7f0e1e01a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e18103e60 0x7f0e18104270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:03.815 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.954+0000 7f0e1e01a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e181047b0 con 0x7f0e18103e60 2024-02-16T22:10:03.816 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.954+0000 7f0e177fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e18103e60 0x7f0e18104270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:03.816 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.954+0000 7f0e177fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e18103e60 0x7f0e18104270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41864/0 (socket says 172.21.15.134:41864) 2024-02-16T22:10:03.816 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.954+0000 7f0e177fe700 1 -- 172.21.15.134:0/900058951 learned_addr learned my addr 172.21.15.134:0/900058951 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:03.816 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.954+0000 7f0e177fe700 1 -- 172.21.15.134:0/900058951 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e181048f0 con 0x7f0e18103e60 2024-02-16T22:10:03.816 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.955+0000 7f0e177fe700 1 --2- 172.21.15.134:0/900058951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e18103e60 0x7f0e18104270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0e080098e0 tx=0x7f0e08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85ede0c770ff322 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:03.816 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.955+0000 7f0e167fc700 1 -- 172.21.15.134:0/900058951 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e0800b860 con 0x7f0e18103e60 2024-02-16T22:10:03.816 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.955+0000 7f0e167fc700 1 -- 172.21.15.134:0/900058951 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0e0800be50 con 0x7f0e18103e60 2024-02-16T22:10:03.816 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.955+0000 7f0e167fc700 1 -- 172.21.15.134:0/900058951 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e08010380 con 0x7f0e18103e60 2024-02-16T22:10:03.816 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.955+0000 7f0e1e01a700 1 -- 172.21.15.134:0/900058951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e18103e60 msgr2=0x7f0e18104270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:03.816 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.955+0000 7f0e1e01a700 1 --2- 172.21.15.134:0/900058951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e18103e60 0x7f0e18104270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0e080098e0 tx=0x7f0e08009250 comp rx=0 tx=0).stop 2024-02-16T22:10:03.816 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.955+0000 7f0e1e01a700 1 -- 172.21.15.134:0/900058951 shutdown_connections 2024-02-16T22:10:03.816 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.955+0000 7f0e1e01a700 1 --2- 172.21.15.134:0/900058951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e18103e60 0x7f0e18104270 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:03.816 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.955+0000 7f0e1e01a700 1 -- 172.21.15.134:0/900058951 >> 172.21.15.134:0/900058951 conn(0x7f0e180fc580 msgr2=0x7f0e180fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.955+0000 7f0e1e01a700 1 -- 172.21.15.134:0/900058951 shutdown_connections 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.955+0000 7f0e1e01a700 1 -- 172.21.15.134:0/900058951 wait complete. 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.956+0000 7f0e1e01a700 1 Processor -- start 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.956+0000 7f0e1e01a700 1 -- start start 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.956+0000 7f0e1e01a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e18103e60 0x7f0e18111810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.956+0000 7f0e1e01a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18111d50 con 0x7f0e18103e60 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.956+0000 7f0e177fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e18103e60 0x7f0e18111810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.956+0000 7f0e177fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e18103e60 0x7f0e18111810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41872/0 (socket says 172.21.15.134:41872) 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.956+0000 7f0e177fe700 1 -- 172.21.15.134:0/802350701 learned_addr learned my addr 172.21.15.134:0/802350701 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.957+0000 7f0e177fe700 1 -- 172.21.15.134:0/802350701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e080094f0 con 0x7f0e18103e60 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.957+0000 7f0e177fe700 1 --2- 172.21.15.134:0/802350701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e18103e60 0x7f0e18111810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800b440 tx=0x7f0e08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.957+0000 7f0dfffff700 1 -- 172.21.15.134:0/802350701 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e08010760 con 0x7f0e18103e60 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.957+0000 7f0e1e01a700 1 -- 172.21.15.134:0/802350701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e18111f50 con 0x7f0e18103e60 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.957+0000 7f0dfffff700 1 -- 172.21.15.134:0/802350701 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0e08010d50 con 0x7f0e18103e60 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.957+0000 7f0dfffff700 1 -- 172.21.15.134:0/802350701 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e08024d80 con 0x7f0e18103e60 2024-02-16T22:10:03.817 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.957+0000 7f0e1e01a700 1 -- 172.21.15.134:0/802350701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e18112bf0 con 0x7f0e18103e60 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.958+0000 7f0dfffff700 1 -- 172.21.15.134:0/802350701 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f0e0801a450 con 0x7f0e18103e60 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.958+0000 7f0dfffff700 1 --2- 172.21.15.134:0/802350701 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0e00036740 0x7f0e00038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.958+0000 7f0dfffff700 1 -- 172.21.15.134:0/802350701 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0e0804a6b0 con 0x7f0e18103e60 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.958+0000 7f0e1e01a700 1 -- 172.21.15.134:0/802350701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1805f5c0 con 0x7f0e18103e60 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.958+0000 7f0e16ffd700 1 --2- 172.21.15.134:0/802350701 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0e00036740 0x7f0e00038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.958+0000 7f0e16ffd700 1 --2- 172.21.15.134:0/802350701 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0e00036740 0x7f0e00038bf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009990 tx=0x7f0e0c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:02.963+0000 7f0dfffff700 1 -- 172.21.15.134:0/802350701 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f0e0801a700 con 0x7f0e18103e60 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:03.147+0000 7f0e1e01a700 1 -- 172.21.15.134:0/802350701 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e181013e0 con 0x7f0e00036740 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:03.147+0000 7f0dfffff700 1 -- 172.21.15.134:0/802350701 <== mgr.14120 v2:172.21.15.134:6800/3520115315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f0e181013e0 con 0x7f0e00036740 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:03.149+0000 7f0e1e01a700 1 -- 172.21.15.134:0/802350701 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0e00036740 msgr2=0x7f0e00038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:03.149+0000 7f0e1e01a700 1 --2- 172.21.15.134:0/802350701 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0e00036740 0x7f0e00038bf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009990 tx=0x7f0e0c006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:03.149+0000 7f0e1e01a700 1 -- 172.21.15.134:0/802350701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e18103e60 msgr2=0x7f0e18111810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:03.149+0000 7f0e1e01a700 1 --2- 172.21.15.134:0/802350701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e18103e60 0x7f0e18111810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800b440 tx=0x7f0e08009250 comp rx=0 tx=0).stop 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:03.149+0000 7f0e1e01a700 1 -- 172.21.15.134:0/802350701 shutdown_connections 2024-02-16T22:10:03.818 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:03.149+0000 7f0e1e01a700 1 --2- 172.21.15.134:0/802350701 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0e00036740 0x7f0e00038bf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:03.819 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:03.149+0000 7f0e1e01a700 1 --2- 172.21.15.134:0/802350701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e18103e60 0x7f0e18111810 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:03.819 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:03.149+0000 7f0e1e01a700 1 -- 172.21.15.134:0/802350701 >> 172.21.15.134:0/802350701 conn(0x7f0e180fc580 msgr2=0x7f0e180fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:03.819 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:03.150+0000 7f0e1e01a700 1 -- 172.21.15.134:0/802350701 shutdown_connections 2024-02-16T22:10:03.819 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:03.150+0000 7f0e1e01a700 1 -- 172.21.15.134:0/802350701 wait complete. 2024-02-16T22:10:03.819 INFO:teuthology.orchestra.run.smithi134.stdout:Generating ssh key... 2024-02-16T22:10:04.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:04 smithi134 ceph-mon[28869]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:05.354 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.258+0000 7ff98c4e7700 1 Processor -- start 2024-02-16T22:10:05.354 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.258+0000 7ff98c4e7700 1 -- start start 2024-02-16T22:10:05.354 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.258+0000 7ff98c4e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff984101670 0x7ff984101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:05.354 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.258+0000 7ff98c4e7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff984101fc0 con 0x7ff984101670 2024-02-16T22:10:05.354 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.259+0000 7ff98a283700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff984101670 0x7ff984101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:05.354 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.259+0000 7ff98a283700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff984101670 0x7ff984101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41876/0 (socket says 172.21.15.134:41876) 2024-02-16T22:10:05.354 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.259+0000 7ff98a283700 1 -- 172.21.15.134:0/4218145732 learned_addr learned my addr 172.21.15.134:0/4218145732 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:05.354 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.259+0000 7ff98a283700 1 -- 172.21.15.134:0/4218145732 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff984102100 con 0x7ff984101670 2024-02-16T22:10:05.354 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.259+0000 7ff98a283700 1 --2- 172.21.15.134:0/4218145732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff984101670 0x7ff984101a80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff98000bb80 tx=0x7ff98000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912bf87776dd597f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:05.354 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.259+0000 7ff989281700 1 -- 172.21.15.134:0/4218145732 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff98000dd00 con 0x7ff984101670 2024-02-16T22:10:05.354 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.259+0000 7ff989281700 1 -- 172.21.15.134:0/4218145732 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff98000de60 con 0x7ff984101670 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.259+0000 7ff989281700 1 -- 172.21.15.134:0/4218145732 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9800188a0 con 0x7ff984101670 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.260+0000 7ff98c4e7700 1 -- 172.21.15.134:0/4218145732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff984101670 msgr2=0x7ff984101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.260+0000 7ff98c4e7700 1 --2- 172.21.15.134:0/4218145732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff984101670 0x7ff984101a80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff98000bb80 tx=0x7ff98000b4f0 comp rx=0 tx=0).stop 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.260+0000 7ff98c4e7700 1 -- 172.21.15.134:0/4218145732 shutdown_connections 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.260+0000 7ff98c4e7700 1 --2- 172.21.15.134:0/4218145732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff984101670 0x7ff984101a80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.260+0000 7ff98c4e7700 1 -- 172.21.15.134:0/4218145732 >> 172.21.15.134:0/4218145732 conn(0x7ff9840fcdd0 msgr2=0x7ff9840ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.260+0000 7ff98c4e7700 1 -- 172.21.15.134:0/4218145732 shutdown_connections 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.260+0000 7ff98c4e7700 1 -- 172.21.15.134:0/4218145732 wait complete. 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.261+0000 7ff98c4e7700 1 Processor -- start 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.261+0000 7ff98c4e7700 1 -- start start 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.261+0000 7ff98c4e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff984101670 0x7ff98410f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.261+0000 7ff98c4e7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98410faf0 con 0x7ff984101670 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.261+0000 7ff98a283700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff984101670 0x7ff98410f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.261+0000 7ff98a283700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff984101670 0x7ff98410f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41886/0 (socket says 172.21.15.134:41886) 2024-02-16T22:10:05.355 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.261+0000 7ff98a283700 1 -- 172.21.15.134:0/3445051311 learned_addr learned my addr 172.21.15.134:0/3445051311 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:05.356 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.261+0000 7ff98a283700 1 -- 172.21.15.134:0/3445051311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98000b790 con 0x7ff984101670 2024-02-16T22:10:05.356 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.261+0000 7ff98a283700 1 --2- 172.21.15.134:0/3445051311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff984101670 0x7ff98410f5b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff98000d650 tx=0x7ff98000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:05.356 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.261+0000 7ff97affd700 1 -- 172.21.15.134:0/3445051311 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff98000dc70 con 0x7ff984101670 2024-02-16T22:10:05.356 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.261+0000 7ff97affd700 1 -- 172.21.15.134:0/3445051311 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff98001d050 con 0x7ff984101670 2024-02-16T22:10:05.356 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.261+0000 7ff98c4e7700 1 -- 172.21.15.134:0/3445051311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98410fcf0 con 0x7ff984101670 2024-02-16T22:10:05.356 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.261+0000 7ff97affd700 1 -- 172.21.15.134:0/3445051311 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9800223d0 con 0x7ff984101670 2024-02-16T22:10:05.356 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.261+0000 7ff98c4e7700 1 -- 172.21.15.134:0/3445051311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff984110990 con 0x7ff984101670 2024-02-16T22:10:05.356 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.262+0000 7ff97affd700 1 -- 172.21.15.134:0/3445051311 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7ff980022650 con 0x7ff984101670 2024-02-16T22:10:05.356 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.262+0000 7ff98c4e7700 1 -- 172.21.15.134:0/3445051311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98405f5c0 con 0x7ff984101670 2024-02-16T22:10:05.356 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.262+0000 7ff97affd700 1 --2- 172.21.15.134:0/3445051311 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7ff970036790 0x7ff970038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:05.356 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.263+0000 7ff97affd700 1 -- 172.21.15.134:0/3445051311 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff980014070 con 0x7ff984101670 2024-02-16T22:10:05.356 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.263+0000 7ff989a82700 1 --2- 172.21.15.134:0/3445051311 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7ff970036790 0x7ff970038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:05.356 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.263+0000 7ff989a82700 1 --2- 172.21.15.134:0/3445051311 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7ff970036790 0x7ff970038c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff974009990 tx=0x7ff974006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:05.356 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.267+0000 7ff97affd700 1 -- 172.21.15.134:0/3445051311 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff98000e9b0 con 0x7ff984101670 2024-02-16T22:10:05.357 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.450+0000 7ff98c4e7700 1 -- 172.21.15.134:0/3445051311 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7ff984103650 con 0x7ff970036790 2024-02-16T22:10:05.357 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.781+0000 7ff97affd700 1 -- 172.21.15.134:0/3445051311 <== mgr.14120 v2:172.21.15.134:6800/3520115315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff984103650 con 0x7ff970036790 2024-02-16T22:10:05.357 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.783+0000 7ff98c4e7700 1 -- 172.21.15.134:0/3445051311 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7ff970036790 msgr2=0x7ff970038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:05.357 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.783+0000 7ff98c4e7700 1 --2- 172.21.15.134:0/3445051311 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7ff970036790 0x7ff970038c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff974009990 tx=0x7ff974006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:05.357 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.783+0000 7ff98c4e7700 1 -- 172.21.15.134:0/3445051311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff984101670 msgr2=0x7ff98410f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:05.357 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.783+0000 7ff98c4e7700 1 --2- 172.21.15.134:0/3445051311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff984101670 0x7ff98410f5b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff98000d650 tx=0x7ff98000b4f0 comp rx=0 tx=0).stop 2024-02-16T22:10:05.357 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.783+0000 7ff98c4e7700 1 -- 172.21.15.134:0/3445051311 shutdown_connections 2024-02-16T22:10:05.357 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.783+0000 7ff98c4e7700 1 --2- 172.21.15.134:0/3445051311 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7ff970036790 0x7ff970038c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:05.357 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.783+0000 7ff98c4e7700 1 --2- 172.21.15.134:0/3445051311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff984101670 0x7ff98410f5b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:05.357 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.783+0000 7ff98c4e7700 1 -- 172.21.15.134:0/3445051311 >> 172.21.15.134:0/3445051311 conn(0x7ff9840fcdd0 msgr2=0x7ff9841063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:05.357 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.783+0000 7ff98c4e7700 1 -- 172.21.15.134:0/3445051311 shutdown_connections 2024-02-16T22:10:05.357 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:04.783+0000 7ff98c4e7700 1 -- 172.21.15.134:0/3445051311 wait complete. 2024-02-16T22:10:05.930 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:05 smithi134 ceph-mon[28869]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:05.931 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:05 smithi134 ceph-mon[28869]: Generating ssh key... 2024-02-16T22:10:05.931 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:05 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:05.931 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:05 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:06.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL+IkzSsPKonnZvP6741ofat+3KvAixcD7htaarVkWfpACZm9lGdk2x6igleKn5hEKb12Dk6o3RuCYznuABLqGCoGMMBvdDsCddsQvOj/EC1wmYxGjUEbxozJ8kIOiiUQVXXaHk/46F3mId7zysdVTTg2bfY/uVyHfZOGw8PwQLMO/Un42BK9Ar6wvbyCl650NdG+6zSM6wFXH1XzMv6jx6O5Z6IR+aI9r7DCn/ZNdXqjK7tOhPRDnbMipwDM0m9wCJhKg60PFwP26Du7fo0FXl+v73r9iSUh7/P0PZFlzPieAiydqNkx1hVe3XoKoLJwwhHXzrbblD5njHAg8fG7X5sLb6KJA+jJKuCfU8uw/u/7dZzy06PYYd2yCyVYoJAQpm6QEjJAWpW8oD5es6DSkrGU7bjQztX4HQEbyR8yMoqyX6MQJZx4IrJZ00kTH5V4qd+bnI11vuH1HgrVSjSTMLNJ/gS7QIzgOiYH9vL97JGMskUkVkngZyVbyXPliW0c= ceph-f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:10:06.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.735+0000 7f4fc2271700 1 Processor -- start 2024-02-16T22:10:06.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.735+0000 7f4fc2271700 1 -- start start 2024-02-16T22:10:06.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.735+0000 7f4fc2271700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc102770 0x7f4fbc102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:06.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.735+0000 7f4fc2271700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc1030c0 con 0x7f4fbc102770 2024-02-16T22:10:06.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.735+0000 7f4fbbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc102770 0x7f4fbc102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:06.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.735+0000 7f4fbbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc102770 0x7f4fbc102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41898/0 (socket says 172.21.15.134:41898) 2024-02-16T22:10:06.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.735+0000 7f4fbbfff700 1 -- 172.21.15.134:0/4203232601 learned_addr learned my addr 172.21.15.134:0/4203232601 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:06.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.736+0000 7f4fbbfff700 1 -- 172.21.15.134:0/4203232601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc103200 con 0x7f4fbc102770 2024-02-16T22:10:06.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.736+0000 7f4fbbfff700 1 --2- 172.21.15.134:0/4203232601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc102770 0x7f4fbc102b80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0098e0 tx=0x7f4fac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c26f8beb48f19bf server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:06.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.736+0000 7f4fbaffd700 1 -- 172.21.15.134:0/4203232601 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fac00b860 con 0x7f4fbc102770 2024-02-16T22:10:06.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.736+0000 7f4fbaffd700 1 -- 172.21.15.134:0/4203232601 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4fac00be50 con 0x7f4fbc102770 2024-02-16T22:10:06.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.736+0000 7f4fbaffd700 1 -- 172.21.15.134:0/4203232601 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fac010380 con 0x7f4fbc102770 2024-02-16T22:10:06.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.737+0000 7f4fc2271700 1 -- 172.21.15.134:0/4203232601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc102770 msgr2=0x7f4fbc102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:06.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.737+0000 7f4fc2271700 1 --2- 172.21.15.134:0/4203232601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc102770 0x7f4fbc102b80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0098e0 tx=0x7f4fac009250 comp rx=0 tx=0).stop 2024-02-16T22:10:06.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.737+0000 7f4fc2271700 1 -- 172.21.15.134:0/4203232601 shutdown_connections 2024-02-16T22:10:06.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.737+0000 7f4fc2271700 1 --2- 172.21.15.134:0/4203232601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc102770 0x7f4fbc102b80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:06.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.737+0000 7f4fc2271700 1 -- 172.21.15.134:0/4203232601 >> 172.21.15.134:0/4203232601 conn(0x7f4fbc0fded0 msgr2=0x7f4fbc100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:06.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.737+0000 7f4fc2271700 1 -- 172.21.15.134:0/4203232601 shutdown_connections 2024-02-16T22:10:06.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.737+0000 7f4fc2271700 1 -- 172.21.15.134:0/4203232601 wait complete. 2024-02-16T22:10:06.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.737+0000 7f4fc2271700 1 Processor -- start 2024-02-16T22:10:06.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.737+0000 7f4fc2271700 1 -- start start 2024-02-16T22:10:06.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.737+0000 7f4fc2271700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc102770 0x7f4fbc111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:06.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.737+0000 7f4fc2271700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc111aa0 con 0x7f4fbc102770 2024-02-16T22:10:06.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.738+0000 7f4fbbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc102770 0x7f4fbc111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:06.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.738+0000 7f4fbbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc102770 0x7f4fbc111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41908/0 (socket says 172.21.15.134:41908) 2024-02-16T22:10:06.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.738+0000 7f4fbbfff700 1 -- 172.21.15.134:0/3542461943 learned_addr learned my addr 172.21.15.134:0/3542461943 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:06.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.738+0000 7f4fbbfff700 1 -- 172.21.15.134:0/3542461943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac0094f0 con 0x7f4fbc102770 2024-02-16T22:10:06.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.738+0000 7f4fbbfff700 1 --2- 172.21.15.134:0/3542461943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc102770 0x7f4fbc111560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4fac000c00 tx=0x7f4fac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.738+0000 7f4fb8ff9700 1 -- 172.21.15.134:0/3542461943 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fac0107c0 con 0x7f4fbc102770 2024-02-16T22:10:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.738+0000 7f4fb8ff9700 1 -- 172.21.15.134:0/3542461943 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4fac010db0 con 0x7f4fbc102770 2024-02-16T22:10:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.738+0000 7f4fc2271700 1 -- 172.21.15.134:0/3542461943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fbc111ca0 con 0x7f4fbc102770 2024-02-16T22:10:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.738+0000 7f4fb8ff9700 1 -- 172.21.15.134:0/3542461943 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fac01ad00 con 0x7f4fbc102770 2024-02-16T22:10:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.738+0000 7f4fc2271700 1 -- 172.21.15.134:0/3542461943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc112940 con 0x7f4fbc102770 2024-02-16T22:10:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.739+0000 7f4fb8ff9700 1 -- 172.21.15.134:0/3542461943 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f4fac0193c0 con 0x7f4fbc102770 2024-02-16T22:10:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.739+0000 7f4fc2271700 1 -- 172.21.15.134:0/3542461943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fbc05f5c0 con 0x7f4fbc102770 2024-02-16T22:10:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.739+0000 7f4fb8ff9700 1 --2- 172.21.15.134:0/3542461943 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f4fa40367e0 0x7f4fa4038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.739+0000 7f4fb8ff9700 1 -- 172.21.15.134:0/3542461943 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4fac04a7a0 con 0x7f4fbc102770 2024-02-16T22:10:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.739+0000 7f4fbb7fe700 1 --2- 172.21.15.134:0/3542461943 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f4fa40367e0 0x7f4fa4038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.740+0000 7f4fbb7fe700 1 --2- 172.21.15.134:0/3542461943 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f4fa40367e0 0x7f4fa4038c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009990 tx=0x7f4fb0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.744+0000 7f4fb8ff9700 1 -- 172.21.15.134:0/3542461943 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4fac022930 con 0x7f4fbc102770 2024-02-16T22:10:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.929+0000 7f4fc2271700 1 -- 172.21.15.134:0/3542461943 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fbc100190 con 0x7f4fa40367e0 2024-02-16T22:10:06.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.929+0000 7f4fb8ff9700 1 -- 172.21.15.134:0/3542461943 <== mgr.14120 v2:172.21.15.134:6800/3520115315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f4fbc100190 con 0x7f4fa40367e0 2024-02-16T22:10:06.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.932+0000 7f4fc2271700 1 -- 172.21.15.134:0/3542461943 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f4fa40367e0 msgr2=0x7f4fa4038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:06.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.932+0000 7f4fc2271700 1 --2- 172.21.15.134:0/3542461943 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f4fa40367e0 0x7f4fa4038c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009990 tx=0x7f4fb0006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:06.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.932+0000 7f4fc2271700 1 -- 172.21.15.134:0/3542461943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc102770 msgr2=0x7f4fbc111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:06.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.932+0000 7f4fc2271700 1 --2- 172.21.15.134:0/3542461943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc102770 0x7f4fbc111560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4fac000c00 tx=0x7f4fac009250 comp rx=0 tx=0).stop 2024-02-16T22:10:06.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.932+0000 7f4fc2271700 1 -- 172.21.15.134:0/3542461943 shutdown_connections 2024-02-16T22:10:06.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.932+0000 7f4fc2271700 1 --2- 172.21.15.134:0/3542461943 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f4fa40367e0 0x7f4fa4038c90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:06.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.932+0000 7f4fc2271700 1 --2- 172.21.15.134:0/3542461943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc102770 0x7f4fbc111560 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:06.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.932+0000 7f4fc2271700 1 -- 172.21.15.134:0/3542461943 >> 172.21.15.134:0/3542461943 conn(0x7f4fbc0fded0 msgr2=0x7f4fbc0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:06.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.932+0000 7f4fc2271700 1 -- 172.21.15.134:0/3542461943 shutdown_connections 2024-02-16T22:10:06.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:05.932+0000 7f4fc2271700 1 -- 172.21.15.134:0/3542461943 wait complete. 2024-02-16T22:10:06.498 INFO:teuthology.orchestra.run.smithi134.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-16T22:10:06.498 INFO:teuthology.orchestra.run.smithi134.stdout:Adding key to root@localhost authorized_keys... 2024-02-16T22:10:06.498 INFO:teuthology.orchestra.run.smithi134.stdout:Adding host smithi134... 2024-02-16T22:10:07.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:07 smithi134 ceph-mon[28869]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:08.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:08 smithi134 ceph-mon[28869]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "addr": "172.21.15.134", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:09.694 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:09 smithi134 ceph-mon[28869]: Deploying cephadm binary to smithi134 2024-02-16T22:10:09.695 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:09 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:09.695 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:09 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:10:09.702 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Added host 'smithi134' with addr '172.21.15.134' 2024-02-16T22:10:09.702 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.885+0000 7fdf86caa700 1 Processor -- start 2024-02-16T22:10:09.702 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.885+0000 7fdf86caa700 1 -- start start 2024-02-16T22:10:09.703 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.885+0000 7fdf86caa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf80076c20 0x7fdf80105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:09.703 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.885+0000 7fdf86caa700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf801058c0 con 0x7fdf80076c20 2024-02-16T22:10:09.703 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.886+0000 7fdf84a46700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf80076c20 0x7fdf80105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:09.703 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.886+0000 7fdf84a46700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf80076c20 0x7fdf80105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41912/0 (socket says 172.21.15.134:41912) 2024-02-16T22:10:09.703 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.886+0000 7fdf84a46700 1 -- 172.21.15.134:0/3972185934 learned_addr learned my addr 172.21.15.134:0/3972185934 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:09.703 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.886+0000 7fdf84a46700 1 -- 172.21.15.134:0/3972185934 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80105a00 con 0x7fdf80076c20 2024-02-16T22:10:09.703 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.886+0000 7fdf84a46700 1 --2- 172.21.15.134:0/3972185934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf80076c20 0x7fdf80105380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009e50 tx=0x7fdf7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23be97dd5ccea4d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:09.703 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.886+0000 7fdf777fe700 1 -- 172.21.15.134:0/3972185934 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf7c0092e0 con 0x7fdf80076c20 2024-02-16T22:10:09.703 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.886+0000 7fdf777fe700 1 -- 172.21.15.134:0/3972185934 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fdf7c012430 con 0x7fdf80076c20 2024-02-16T22:10:09.703 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.886+0000 7fdf777fe700 1 -- 172.21.15.134:0/3972185934 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf7c0075c0 con 0x7fdf80076c20 2024-02-16T22:10:09.703 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.887+0000 7fdf86caa700 1 -- 172.21.15.134:0/3972185934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf80076c20 msgr2=0x7fdf80105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:09.703 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.887+0000 7fdf86caa700 1 --2- 172.21.15.134:0/3972185934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf80076c20 0x7fdf80105380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009e50 tx=0x7fdf7c009840 comp rx=0 tx=0).stop 2024-02-16T22:10:09.703 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.887+0000 7fdf86caa700 1 -- 172.21.15.134:0/3972185934 shutdown_connections 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.887+0000 7fdf86caa700 1 --2- 172.21.15.134:0/3972185934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf80076c20 0x7fdf80105380 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.887+0000 7fdf86caa700 1 -- 172.21.15.134:0/3972185934 >> 172.21.15.134:0/3972185934 conn(0x7fdf800fcdd0 msgr2=0x7fdf800ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.887+0000 7fdf86caa700 1 -- 172.21.15.134:0/3972185934 shutdown_connections 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.887+0000 7fdf86caa700 1 -- 172.21.15.134:0/3972185934 wait complete. 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.887+0000 7fdf86caa700 1 Processor -- start 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.887+0000 7fdf86caa700 1 -- start start 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.888+0000 7fdf86caa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf80076c20 0x7fdf80111870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.888+0000 7fdf86caa700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf80111db0 con 0x7fdf80076c20 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.888+0000 7fdf84a46700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf80076c20 0x7fdf80111870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.888+0000 7fdf84a46700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf80076c20 0x7fdf80111870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41918/0 (socket says 172.21.15.134:41918) 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.888+0000 7fdf84a46700 1 -- 172.21.15.134:0/2506092901 learned_addr learned my addr 172.21.15.134:0/2506092901 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.888+0000 7fdf84a46700 1 -- 172.21.15.134:0/2506092901 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c009ae0 con 0x7fdf80076c20 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.888+0000 7fdf84a46700 1 --2- 172.21.15.134:0/2506092901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf80076c20 0x7fdf80111870 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009ab0 tx=0x7fdf7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.888+0000 7fdf757fa700 1 -- 172.21.15.134:0/2506092901 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf7c0092e0 con 0x7fdf80076c20 2024-02-16T22:10:09.704 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.888+0000 7fdf757fa700 1 -- 172.21.15.134:0/2506092901 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fdf7c007d10 con 0x7fdf80076c20 2024-02-16T22:10:09.705 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.888+0000 7fdf86caa700 1 -- 172.21.15.134:0/2506092901 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf80111fb0 con 0x7fdf80076c20 2024-02-16T22:10:09.705 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.888+0000 7fdf757fa700 1 -- 172.21.15.134:0/2506092901 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf7c01c9a0 con 0x7fdf80076c20 2024-02-16T22:10:09.705 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.888+0000 7fdf86caa700 1 -- 172.21.15.134:0/2506092901 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf80112c50 con 0x7fdf80076c20 2024-02-16T22:10:09.705 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.889+0000 7fdf757fa700 1 -- 172.21.15.134:0/2506092901 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fdf7c019070 con 0x7fdf80076c20 2024-02-16T22:10:09.705 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.889+0000 7fdf757fa700 1 --2- 172.21.15.134:0/2506092901 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fdf68036790 0x7fdf68038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:09.705 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.889+0000 7fdf757fa700 1 -- 172.21.15.134:0/2506092901 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdf7c049f20 con 0x7fdf80076c20 2024-02-16T22:10:09.705 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.889+0000 7fdf86caa700 1 -- 172.21.15.134:0/2506092901 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8005f5c0 con 0x7fdf80076c20 2024-02-16T22:10:09.705 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.889+0000 7fdf77fff700 1 --2- 172.21.15.134:0/2506092901 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fdf68036790 0x7fdf68038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:09.705 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.890+0000 7fdf77fff700 1 --2- 172.21.15.134:0/2506092901 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fdf68036790 0x7fdf68038c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdf70009990 tx=0x7fdf70006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:09.705 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:06.894+0000 7fdf757fa700 1 -- 172.21.15.134:0/2506092901 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fdf7c017020 con 0x7fdf80076c20 2024-02-16T22:10:09.705 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:07.081+0000 7fdf86caa700 1 -- 172.21.15.134:0/2506092901 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi134", "addr": "172.21.15.134", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf800008d0 con 0x7fdf68036790 2024-02-16T22:10:09.705 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:09.062+0000 7fdf757fa700 1 -- 172.21.15.134:0/2506092901 <== mgr.14120 v2:172.21.15.134:6800/3520115315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fdf800008d0 con 0x7fdf68036790 2024-02-16T22:10:09.705 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:09.064+0000 7fdf86caa700 1 -- 172.21.15.134:0/2506092901 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fdf68036790 msgr2=0x7fdf68038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:09.705 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:09.064+0000 7fdf86caa700 1 --2- 172.21.15.134:0/2506092901 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fdf68036790 0x7fdf68038c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdf70009990 tx=0x7fdf70006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:09.706 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:09.064+0000 7fdf86caa700 1 -- 172.21.15.134:0/2506092901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf80076c20 msgr2=0x7fdf80111870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:09.706 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:09.064+0000 7fdf86caa700 1 --2- 172.21.15.134:0/2506092901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf80076c20 0x7fdf80111870 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009ab0 tx=0x7fdf7c009840 comp rx=0 tx=0).stop 2024-02-16T22:10:09.706 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:09.065+0000 7fdf86caa700 1 -- 172.21.15.134:0/2506092901 shutdown_connections 2024-02-16T22:10:09.706 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:09.065+0000 7fdf86caa700 1 --2- 172.21.15.134:0/2506092901 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fdf68036790 0x7fdf68038c40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:09.706 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:09.065+0000 7fdf86caa700 1 --2- 172.21.15.134:0/2506092901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf80076c20 0x7fdf80111870 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:09.706 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:09.065+0000 7fdf86caa700 1 -- 172.21.15.134:0/2506092901 >> 172.21.15.134:0/2506092901 conn(0x7fdf800fcdd0 msgr2=0x7fdf800ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:09.706 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:09.065+0000 7fdf86caa700 1 -- 172.21.15.134:0/2506092901 shutdown_connections 2024-02-16T22:10:09.706 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:09.065+0000 7fdf86caa700 1 -- 172.21.15.134:0/2506092901 wait complete. 2024-02-16T22:10:09.706 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying mon service with default placement... 2024-02-16T22:10:10.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:10 smithi134 ceph-mon[28869]: Added host smithi134 2024-02-16T22:10:10.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:10 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:11.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-02-16T22:10:11.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.127+0000 7ffb991e7700 1 Processor -- start 2024-02-16T22:10:11.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.127+0000 7ffb991e7700 1 -- start start 2024-02-16T22:10:11.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.127+0000 7ffb991e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb94076c20 0x7ffb94105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:11.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.127+0000 7ffb991e7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb941058c0 con 0x7ffb94076c20 2024-02-16T22:10:11.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.127+0000 7ffb92d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb94076c20 0x7ffb94105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:11.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.127+0000 7ffb92d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb94076c20 0x7ffb94105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41934/0 (socket says 172.21.15.134:41934) 2024-02-16T22:10:11.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.127+0000 7ffb92d9d700 1 -- 172.21.15.134:0/640635151 learned_addr learned my addr 172.21.15.134:0/640635151 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.128+0000 7ffb92d9d700 1 -- 172.21.15.134:0/640635151 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb94105a00 con 0x7ffb94076c20 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.128+0000 7ffb92d9d700 1 --2- 172.21.15.134:0/640635151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb94076c20 0x7ffb94105380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb840098e0 tx=0x7ffb84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6323a533e5d8c952 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.128+0000 7ffb91d9b700 1 -- 172.21.15.134:0/640635151 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb8400b860 con 0x7ffb94076c20 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.128+0000 7ffb91d9b700 1 -- 172.21.15.134:0/640635151 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ffb8400be50 con 0x7ffb94076c20 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.128+0000 7ffb91d9b700 1 -- 172.21.15.134:0/640635151 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb84010380 con 0x7ffb94076c20 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.129+0000 7ffb991e7700 1 -- 172.21.15.134:0/640635151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb94076c20 msgr2=0x7ffb94105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.129+0000 7ffb991e7700 1 --2- 172.21.15.134:0/640635151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb94076c20 0x7ffb94105380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb840098e0 tx=0x7ffb84009250 comp rx=0 tx=0).stop 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.129+0000 7ffb991e7700 1 -- 172.21.15.134:0/640635151 shutdown_connections 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.129+0000 7ffb991e7700 1 --2- 172.21.15.134:0/640635151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb94076c20 0x7ffb94105380 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.129+0000 7ffb991e7700 1 -- 172.21.15.134:0/640635151 >> 172.21.15.134:0/640635151 conn(0x7ffb940fcdd0 msgr2=0x7ffb940ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.129+0000 7ffb991e7700 1 -- 172.21.15.134:0/640635151 shutdown_connections 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.129+0000 7ffb991e7700 1 -- 172.21.15.134:0/640635151 wait complete. 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.129+0000 7ffb991e7700 1 Processor -- start 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.129+0000 7ffb991e7700 1 -- start start 2024-02-16T22:10:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.129+0000 7ffb991e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb94076c20 0x7ffb94111520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:11.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.129+0000 7ffb991e7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb94111a60 con 0x7ffb94076c20 2024-02-16T22:10:11.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.130+0000 7ffb92d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb94076c20 0x7ffb94111520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:11.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.130+0000 7ffb92d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb94076c20 0x7ffb94111520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41938/0 (socket says 172.21.15.134:41938) 2024-02-16T22:10:11.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.130+0000 7ffb92d9d700 1 -- 172.21.15.134:0/4038065691 learned_addr learned my addr 172.21.15.134:0/4038065691 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:11.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.130+0000 7ffb92d9d700 1 -- 172.21.15.134:0/4038065691 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb840094f0 con 0x7ffb94076c20 2024-02-16T22:10:11.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.130+0000 7ffb92d9d700 1 --2- 172.21.15.134:0/4038065691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb94076c20 0x7ffb94111520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400b440 tx=0x7ffb84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:11.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.130+0000 7ffb7b7fe700 1 -- 172.21.15.134:0/4038065691 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb840107c0 con 0x7ffb94076c20 2024-02-16T22:10:11.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.130+0000 7ffb7b7fe700 1 -- 172.21.15.134:0/4038065691 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ffb84010db0 con 0x7ffb94076c20 2024-02-16T22:10:11.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.130+0000 7ffb991e7700 1 -- 172.21.15.134:0/4038065691 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb94111c60 con 0x7ffb94076c20 2024-02-16T22:10:11.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.130+0000 7ffb7b7fe700 1 -- 172.21.15.134:0/4038065691 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb8401ad30 con 0x7ffb94076c20 2024-02-16T22:10:11.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.130+0000 7ffb991e7700 1 -- 172.21.15.134:0/4038065691 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb94112900 con 0x7ffb94076c20 2024-02-16T22:10:11.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.131+0000 7ffb7b7fe700 1 -- 172.21.15.134:0/4038065691 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7ffb8402e440 con 0x7ffb94076c20 2024-02-16T22:10:11.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.131+0000 7ffb991e7700 1 -- 172.21.15.134:0/4038065691 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9405f5c0 con 0x7ffb94076c20 2024-02-16T22:10:11.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.131+0000 7ffb7b7fe700 1 --2- 172.21.15.134:0/4038065691 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7ffb7c0367e0 0x7ffb7c038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:11.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.131+0000 7ffb7b7fe700 1 -- 172.21.15.134:0/4038065691 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ffb8404acb0 con 0x7ffb94076c20 2024-02-16T22:10:11.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.131+0000 7ffb9259c700 1 --2- 172.21.15.134:0/4038065691 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7ffb7c0367e0 0x7ffb7c038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:11.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.132+0000 7ffb9259c700 1 --2- 172.21.15.134:0/4038065691 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7ffb7c0367e0 0x7ffb7c038c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009990 tx=0x7ffb88006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:11.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.136+0000 7ffb7b7fe700 1 -- 172.21.15.134:0/4038065691 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ffb84018350 con 0x7ffb94076c20 2024-02-16T22:10:11.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.340+0000 7ffb991e7700 1 -- 172.21.15.134:0/4038065691 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb940ff0c0 con 0x7ffb7c0367e0 2024-02-16T22:10:11.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.345+0000 7ffb7b7fe700 1 -- 172.21.15.134:0/4038065691 <== mgr.14120 v2:172.21.15.134:6800/3520115315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ffb940ff0c0 con 0x7ffb7c0367e0 2024-02-16T22:10:11.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.347+0000 7ffb991e7700 1 -- 172.21.15.134:0/4038065691 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7ffb7c0367e0 msgr2=0x7ffb7c038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:11.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.347+0000 7ffb991e7700 1 --2- 172.21.15.134:0/4038065691 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7ffb7c0367e0 0x7ffb7c038c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009990 tx=0x7ffb88006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:11.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.347+0000 7ffb991e7700 1 -- 172.21.15.134:0/4038065691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb94076c20 msgr2=0x7ffb94111520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:11.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.347+0000 7ffb991e7700 1 --2- 172.21.15.134:0/4038065691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb94076c20 0x7ffb94111520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400b440 tx=0x7ffb84009250 comp rx=0 tx=0).stop 2024-02-16T22:10:11.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.347+0000 7ffb991e7700 1 -- 172.21.15.134:0/4038065691 shutdown_connections 2024-02-16T22:10:11.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.347+0000 7ffb991e7700 1 --2- 172.21.15.134:0/4038065691 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7ffb7c0367e0 0x7ffb7c038c90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:11.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.347+0000 7ffb991e7700 1 --2- 172.21.15.134:0/4038065691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb94076c20 0x7ffb94111520 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:11.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.347+0000 7ffb991e7700 1 -- 172.21.15.134:0/4038065691 >> 172.21.15.134:0/4038065691 conn(0x7ffb940fcdd0 msgr2=0x7ffb940fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:11.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.347+0000 7ffb991e7700 1 -- 172.21.15.134:0/4038065691 shutdown_connections 2024-02-16T22:10:11.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:10.347+0000 7ffb991e7700 1 -- 172.21.15.134:0/4038065691 wait complete. 2024-02-16T22:10:11.150 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying mgr service with default placement... 2024-02-16T22:10:11.714 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:11 smithi134 ceph-mon[28869]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:11.714 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:11 smithi134 ceph-mon[28869]: Saving service mon spec with placement count:5 2024-02-16T22:10:12.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:12 smithi134 ceph-mon[28869]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:12.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:12 smithi134 ceph-mon[28869]: Saving service mgr spec with placement count:2 2024-02-16T22:10:12.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:12 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:13.109 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-02-16T22:10:13.109 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.559+0000 7f6c6d4d8700 1 Processor -- start 2024-02-16T22:10:13.109 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.559+0000 7f6c6d4d8700 1 -- start start 2024-02-16T22:10:13.109 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.559+0000 7f6c6d4d8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c681015f0 0x7f6c68101a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:13.109 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.559+0000 7f6c6d4d8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c68101f40 con 0x7f6c681015f0 2024-02-16T22:10:13.109 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.559+0000 7f6c66ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c681015f0 0x7f6c68101a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:13.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.559+0000 7f6c66ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c681015f0 0x7f6c68101a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39510/0 (socket says 172.21.15.134:39510) 2024-02-16T22:10:13.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.559+0000 7f6c66ffd700 1 -- 172.21.15.134:0/2630765091 learned_addr learned my addr 172.21.15.134:0/2630765091 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:13.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.559+0000 7f6c66ffd700 1 -- 172.21.15.134:0/2630765091 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c68102080 con 0x7f6c681015f0 2024-02-16T22:10:13.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.560+0000 7f6c66ffd700 1 --2- 172.21.15.134:0/2630765091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c681015f0 0x7f6c68101a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800bb80 tx=0x7f6c5800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1069094e7e4393 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:13.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.560+0000 7f6c65ffb700 1 -- 172.21.15.134:0/2630765091 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c5800dd00 con 0x7f6c681015f0 2024-02-16T22:10:13.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.560+0000 7f6c65ffb700 1 -- 172.21.15.134:0/2630765091 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6c5800de60 con 0x7f6c681015f0 2024-02-16T22:10:13.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.560+0000 7f6c65ffb700 1 -- 172.21.15.134:0/2630765091 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c580188a0 con 0x7f6c681015f0 2024-02-16T22:10:13.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.560+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/2630765091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c681015f0 msgr2=0x7f6c68101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:13.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.560+0000 7f6c6d4d8700 1 --2- 172.21.15.134:0/2630765091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c681015f0 0x7f6c68101a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800bb80 tx=0x7f6c5800b4f0 comp rx=0 tx=0).stop 2024-02-16T22:10:13.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.560+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/2630765091 shutdown_connections 2024-02-16T22:10:13.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.560+0000 7f6c6d4d8700 1 --2- 172.21.15.134:0/2630765091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c681015f0 0x7f6c68101a00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:13.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.560+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/2630765091 >> 172.21.15.134:0/2630765091 conn(0x7f6c680fcd90 msgr2=0x7f6c680ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:13.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.560+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/2630765091 shutdown_connections 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.560+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/2630765091 wait complete. 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.561+0000 7f6c6d4d8700 1 Processor -- start 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.561+0000 7f6c6d4d8700 1 -- start start 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.561+0000 7f6c6d4d8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c681015f0 0x7f6c6810f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.561+0000 7f6c6d4d8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6810f770 con 0x7f6c681015f0 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.561+0000 7f6c66ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c681015f0 0x7f6c6810f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.561+0000 7f6c66ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c681015f0 0x7f6c6810f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39526/0 (socket says 172.21.15.134:39526) 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.561+0000 7f6c66ffd700 1 -- 172.21.15.134:0/3810269447 learned_addr learned my addr 172.21.15.134:0/3810269447 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.562+0000 7f6c66ffd700 1 -- 172.21.15.134:0/3810269447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5800b790 con 0x7f6c681015f0 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.562+0000 7f6c66ffd700 1 --2- 172.21.15.134:0/3810269447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c681015f0 0x7f6c6810f230 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800d650 tx=0x7f6c5800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.562+0000 7f6c4f7fe700 1 -- 172.21.15.134:0/3810269447 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c5800dc70 con 0x7f6c681015f0 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.562+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/3810269447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6810f970 con 0x7f6c681015f0 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.562+0000 7f6c4f7fe700 1 -- 172.21.15.134:0/3810269447 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6c5801d050 con 0x7f6c681015f0 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.562+0000 7f6c4f7fe700 1 -- 172.21.15.134:0/3810269447 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c580223d0 con 0x7f6c681015f0 2024-02-16T22:10:13.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.562+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/3810269447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c68110610 con 0x7f6c681015f0 2024-02-16T22:10:13.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.563+0000 7f6c4f7fe700 1 -- 172.21.15.134:0/3810269447 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f6c58022650 con 0x7f6c681015f0 2024-02-16T22:10:13.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.563+0000 7f6c4f7fe700 1 --2- 172.21.15.134:0/3810269447 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f6c50036790 0x7f6c50038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:13.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.563+0000 7f6c4f7fe700 1 -- 172.21.15.134:0/3810269447 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6c58014070 con 0x7f6c681015f0 2024-02-16T22:10:13.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.563+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/3810269447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6805f5c0 con 0x7f6c681015f0 2024-02-16T22:10:13.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.563+0000 7f6c667fc700 1 --2- 172.21.15.134:0/3810269447 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f6c50036790 0x7f6c50038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:13.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.563+0000 7f6c667fc700 1 --2- 172.21.15.134:0/3810269447 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f6c50036790 0x7f6c50038c40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009990 tx=0x7f6c5c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:13.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.568+0000 7f6c4f7fe700 1 -- 172.21.15.134:0/3810269447 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6c5800eda0 con 0x7f6c681015f0 2024-02-16T22:10:13.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.766+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/3810269447 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c68111130 con 0x7f6c50036790 2024-02-16T22:10:13.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.773+0000 7f6c4f7fe700 1 -- 172.21.15.134:0/3810269447 <== mgr.14120 v2:172.21.15.134:6800/3520115315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6c68111130 con 0x7f6c50036790 2024-02-16T22:10:13.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.776+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/3810269447 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f6c50036790 msgr2=0x7f6c50038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:13.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.776+0000 7f6c6d4d8700 1 --2- 172.21.15.134:0/3810269447 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f6c50036790 0x7f6c50038c40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009990 tx=0x7f6c5c006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:13.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.776+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/3810269447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c681015f0 msgr2=0x7f6c6810f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:13.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.776+0000 7f6c6d4d8700 1 --2- 172.21.15.134:0/3810269447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c681015f0 0x7f6c6810f230 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800d650 tx=0x7f6c5800b4f0 comp rx=0 tx=0).stop 2024-02-16T22:10:13.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.776+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/3810269447 shutdown_connections 2024-02-16T22:10:13.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.776+0000 7f6c6d4d8700 1 --2- 172.21.15.134:0/3810269447 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f6c50036790 0x7f6c50038c40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:13.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.776+0000 7f6c6d4d8700 1 --2- 172.21.15.134:0/3810269447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c681015f0 0x7f6c6810f230 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:13.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.776+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/3810269447 >> 172.21.15.134:0/3810269447 conn(0x7f6c680fcd90 msgr2=0x7f6c680ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:13.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.776+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/3810269447 shutdown_connections 2024-02-16T22:10:13.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:11.776+0000 7f6c6d4d8700 1 -- 172.21.15.134:0/3810269447 wait complete. 2024-02-16T22:10:13.113 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying crash service with default placement... 2024-02-16T22:10:14.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:13 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:14.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:13 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:14.845 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:14 smithi134 ceph-mon[28869]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:14.845 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:14 smithi134 ceph-mon[28869]: Saving service crash spec with placement * 2024-02-16T22:10:14.845 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:14 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:14.845 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:14 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-02-16T22:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.599+0000 7f5f5ec62700 1 Processor -- start 2024-02-16T22:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.599+0000 7f5f5ec62700 1 -- start start 2024-02-16T22:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.599+0000 7f5f5ec62700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f58076ba0 0x7f5f58105400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.599+0000 7f5f5ec62700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f58105940 con 0x7f5f58076ba0 2024-02-16T22:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.599+0000 7f5f5c9fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f58076ba0 0x7f5f58105400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.600+0000 7f5f5c9fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f58076ba0 0x7f5f58105400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39536/0 (socket says 172.21.15.134:39536) 2024-02-16T22:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.600+0000 7f5f5c9fe700 1 -- 172.21.15.134:0/1639862847 learned_addr learned my addr 172.21.15.134:0/1639862847 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.600+0000 7f5f5c9fe700 1 -- 172.21.15.134:0/1639862847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58105a80 con 0x7f5f58076ba0 2024-02-16T22:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.600+0000 7f5f5c9fe700 1 --2- 172.21.15.134:0/1639862847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f58076ba0 0x7f5f58105400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5f480098e0 tx=0x7f5f48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7c1d9c7509092d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.600+0000 7f5f577fe700 1 -- 172.21.15.134:0/1639862847 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f4800b8f0 con 0x7f5f58076ba0 2024-02-16T22:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.600+0000 7f5f577fe700 1 -- 172.21.15.134:0/1639862847 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f48011420 con 0x7f5f58076ba0 2024-02-16T22:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.600+0000 7f5f577fe700 1 -- 172.21.15.134:0/1639862847 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f48010540 con 0x7f5f58076ba0 2024-02-16T22:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.601+0000 7f5f5ec62700 1 -- 172.21.15.134:0/1639862847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f58076ba0 msgr2=0x7f5f58105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.601+0000 7f5f5ec62700 1 --2- 172.21.15.134:0/1639862847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f58076ba0 0x7f5f58105400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5f480098e0 tx=0x7f5f48009250 comp rx=0 tx=0).stop 2024-02-16T22:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.601+0000 7f5f5ec62700 1 -- 172.21.15.134:0/1639862847 shutdown_connections 2024-02-16T22:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.601+0000 7f5f5ec62700 1 --2- 172.21.15.134:0/1639862847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f58076ba0 0x7f5f58105400 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.601+0000 7f5f5ec62700 1 -- 172.21.15.134:0/1639862847 >> 172.21.15.134:0/1639862847 conn(0x7f5f580fcdd0 msgr2=0x7f5f580ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.601+0000 7f5f5ec62700 1 -- 172.21.15.134:0/1639862847 shutdown_connections 2024-02-16T22:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.601+0000 7f5f5ec62700 1 -- 172.21.15.134:0/1639862847 wait complete. 2024-02-16T22:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.601+0000 7f5f5ec62700 1 Processor -- start 2024-02-16T22:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.601+0000 7f5f5ec62700 1 -- start start 2024-02-16T22:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.602+0000 7f5f5ec62700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f58076ba0 0x7f5f58111860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.602+0000 7f5f5ec62700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f58111da0 con 0x7f5f58076ba0 2024-02-16T22:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.602+0000 7f5f5c9fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f58076ba0 0x7f5f58111860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.602+0000 7f5f5c9fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f58076ba0 0x7f5f58111860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39552/0 (socket says 172.21.15.134:39552) 2024-02-16T22:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.602+0000 7f5f5c9fe700 1 -- 172.21.15.134:0/866235554 learned_addr learned my addr 172.21.15.134:0/866235554 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.602+0000 7f5f5c9fe700 1 -- 172.21.15.134:0/866235554 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f480094f0 con 0x7f5f58076ba0 2024-02-16T22:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.602+0000 7f5f5c9fe700 1 --2- 172.21.15.134:0/866235554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f58076ba0 0x7f5f58111860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5f480094c0 tx=0x7f5f48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.602+0000 7f5f557fa700 1 -- 172.21.15.134:0/866235554 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f480107b0 con 0x7f5f58076ba0 2024-02-16T22:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.602+0000 7f5f5ec62700 1 -- 172.21.15.134:0/866235554 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f58111fa0 con 0x7f5f58076ba0 2024-02-16T22:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.602+0000 7f5f5ec62700 1 -- 172.21.15.134:0/866235554 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f58112c40 con 0x7f5f58076ba0 2024-02-16T22:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.602+0000 7f5f557fa700 1 -- 172.21.15.134:0/866235554 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f48010de0 con 0x7f5f58076ba0 2024-02-16T22:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.602+0000 7f5f557fa700 1 -- 172.21.15.134:0/866235554 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f4801ae70 con 0x7f5f58076ba0 2024-02-16T22:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.603+0000 7f5f557fa700 1 -- 172.21.15.134:0/866235554 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f5f4802d3f0 con 0x7f5f58076ba0 2024-02-16T22:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.603+0000 7f5f5ec62700 1 -- 172.21.15.134:0/866235554 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f440052e0 con 0x7f5f58076ba0 2024-02-16T22:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.604+0000 7f5f557fa700 1 --2- 172.21.15.134:0/866235554 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f5f40036870 0x7f5f40038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.604+0000 7f5f557fa700 1 -- 172.21.15.134:0/866235554 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5f4804a370 con 0x7f5f58076ba0 2024-02-16T22:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.604+0000 7f5f57fff700 1 --2- 172.21.15.134:0/866235554 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f5f40036870 0x7f5f40038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.604+0000 7f5f57fff700 1 --2- 172.21.15.134:0/866235554 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f5f40036870 0x7f5f40038d20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009990 tx=0x7f5f4c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.608+0000 7f5f557fa700 1 -- 172.21.15.134:0/866235554 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5f48018710 con 0x7f5f58076ba0 2024-02-16T22:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.823+0000 7f5f5ec62700 1 -- 172.21.15.134:0/866235554 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f44000bf0 con 0x7f5f40036870 2024-02-16T22:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.827+0000 7f5f557fa700 1 -- 172.21.15.134:0/866235554 <== mgr.14120 v2:172.21.15.134:6800/3520115315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f5f44000bf0 con 0x7f5f40036870 2024-02-16T22:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.829+0000 7f5f5ec62700 1 -- 172.21.15.134:0/866235554 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f5f40036870 msgr2=0x7f5f40038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.829+0000 7f5f5ec62700 1 --2- 172.21.15.134:0/866235554 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f5f40036870 0x7f5f40038d20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009990 tx=0x7f5f4c006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.829+0000 7f5f5ec62700 1 -- 172.21.15.134:0/866235554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f58076ba0 msgr2=0x7f5f58111860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.829+0000 7f5f5ec62700 1 --2- 172.21.15.134:0/866235554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f58076ba0 0x7f5f58111860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5f480094c0 tx=0x7f5f48009250 comp rx=0 tx=0).stop 2024-02-16T22:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.829+0000 7f5f5ec62700 1 -- 172.21.15.134:0/866235554 shutdown_connections 2024-02-16T22:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.829+0000 7f5f5ec62700 1 --2- 172.21.15.134:0/866235554 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f5f40036870 0x7f5f40038d20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.829+0000 7f5f5ec62700 1 --2- 172.21.15.134:0/866235554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f58076ba0 0x7f5f58111860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.829+0000 7f5f5ec62700 1 -- 172.21.15.134:0/866235554 >> 172.21.15.134:0/866235554 conn(0x7f5f580fcdd0 msgr2=0x7f5f580ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.829+0000 7f5f5ec62700 1 -- 172.21.15.134:0/866235554 shutdown_connections 2024-02-16T22:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:13.829+0000 7f5f5ec62700 1 -- 172.21.15.134:0/866235554 wait complete. 2024-02-16T22:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying prometheus service with default placement... 2024-02-16T22:10:16.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-02-16T22:10:16.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.305+0000 7fee2e2b4700 1 Processor -- start 2024-02-16T22:10:16.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.305+0000 7fee2e2b4700 1 -- start start 2024-02-16T22:10:16.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.306+0000 7fee2e2b4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee28102770 0x7fee28102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:16.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.306+0000 7fee2e2b4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee281030c0 con 0x7fee28102770 2024-02-16T22:10:16.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.306+0000 7fee27fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee28102770 0x7fee28102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:16.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.306+0000 7fee27fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee28102770 0x7fee28102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39554/0 (socket says 172.21.15.134:39554) 2024-02-16T22:10:16.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.306+0000 7fee27fff700 1 -- 172.21.15.134:0/3266147281 learned_addr learned my addr 172.21.15.134:0/3266147281 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:16.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.306+0000 7fee27fff700 1 -- 172.21.15.134:0/3266147281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee28103200 con 0x7fee28102770 2024-02-16T22:10:16.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.306+0000 7fee27fff700 1 --2- 172.21.15.134:0/3266147281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee28102770 0x7fee28102b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fee180098e0 tx=0x7fee18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30295f3d97b2b4fa server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:16.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.306+0000 7fee26ffd700 1 -- 172.21.15.134:0/3266147281 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee1800b860 con 0x7fee28102770 2024-02-16T22:10:16.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.306+0000 7fee26ffd700 1 -- 172.21.15.134:0/3266147281 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee1800be90 con 0x7fee28102770 2024-02-16T22:10:16.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.306+0000 7fee26ffd700 1 -- 172.21.15.134:0/3266147281 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee180103c0 con 0x7fee28102770 2024-02-16T22:10:16.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.307+0000 7fee2e2b4700 1 -- 172.21.15.134:0/3266147281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee28102770 msgr2=0x7fee28102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:16.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.307+0000 7fee2e2b4700 1 --2- 172.21.15.134:0/3266147281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee28102770 0x7fee28102b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fee180098e0 tx=0x7fee18009250 comp rx=0 tx=0).stop 2024-02-16T22:10:16.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.307+0000 7fee2e2b4700 1 -- 172.21.15.134:0/3266147281 shutdown_connections 2024-02-16T22:10:16.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.307+0000 7fee2e2b4700 1 --2- 172.21.15.134:0/3266147281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee28102770 0x7fee28102b80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:16.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.307+0000 7fee2e2b4700 1 -- 172.21.15.134:0/3266147281 >> 172.21.15.134:0/3266147281 conn(0x7fee280fded0 msgr2=0x7fee28100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:16.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.307+0000 7fee2e2b4700 1 -- 172.21.15.134:0/3266147281 shutdown_connections 2024-02-16T22:10:16.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.307+0000 7fee2e2b4700 1 -- 172.21.15.134:0/3266147281 wait complete. 2024-02-16T22:10:16.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.308+0000 7fee2e2b4700 1 Processor -- start 2024-02-16T22:10:16.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.308+0000 7fee2e2b4700 1 -- start start 2024-02-16T22:10:16.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.308+0000 7fee2e2b4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee28102770 0x7fee28111540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:16.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.308+0000 7fee2e2b4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee28111a80 con 0x7fee28102770 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.308+0000 7fee27fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee28102770 0x7fee28111540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.308+0000 7fee27fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee28102770 0x7fee28111540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39556/0 (socket says 172.21.15.134:39556) 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.308+0000 7fee27fff700 1 -- 172.21.15.134:0/659705847 learned_addr learned my addr 172.21.15.134:0/659705847 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.309+0000 7fee27fff700 1 -- 172.21.15.134:0/659705847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee180094f0 con 0x7fee28102770 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.309+0000 7fee27fff700 1 --2- 172.21.15.134:0/659705847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee28102770 0x7fee28111540 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee18006b00 tx=0x7fee18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.309+0000 7fee24ff9700 1 -- 172.21.15.134:0/659705847 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee180109a0 con 0x7fee28102770 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.309+0000 7fee24ff9700 1 -- 172.21.15.134:0/659705847 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee1801a430 con 0x7fee28102770 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.309+0000 7fee2e2b4700 1 -- 172.21.15.134:0/659705847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee28111c80 con 0x7fee28102770 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.309+0000 7fee24ff9700 1 -- 172.21.15.134:0/659705847 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee180245b0 con 0x7fee28102770 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.309+0000 7fee2e2b4700 1 -- 172.21.15.134:0/659705847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee28112920 con 0x7fee28102770 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.310+0000 7fee24ff9700 1 -- 172.21.15.134:0/659705847 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fee180247e0 con 0x7fee28102770 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.310+0000 7fee24ff9700 1 --2- 172.21.15.134:0/659705847 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fee100367e0 0x7fee10038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.310+0000 7fee2e2b4700 1 -- 172.21.15.134:0/659705847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2805f5c0 con 0x7fee28102770 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.310+0000 7fee24ff9700 1 -- 172.21.15.134:0/659705847 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fee1801aaa0 con 0x7fee28102770 2024-02-16T22:10:16.113 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.310+0000 7fee277fe700 1 --2- 172.21.15.134:0/659705847 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fee100367e0 0x7fee10038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.311+0000 7fee277fe700 1 --2- 172.21.15.134:0/659705847 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fee100367e0 0x7fee10038c90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009990 tx=0x7fee1c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.315+0000 7fee24ff9700 1 -- 172.21.15.134:0/659705847 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fee1802e440 con 0x7fee28102770 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.527+0000 7fee2e2b4700 1 -- 172.21.15.134:0/659705847 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fee280ff3a0 con 0x7fee100367e0 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.531+0000 7fee24ff9700 1 -- 172.21.15.134:0/659705847 <== mgr.14120 v2:172.21.15.134:6800/3520115315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fee280ff3a0 con 0x7fee100367e0 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.534+0000 7fee2e2b4700 1 -- 172.21.15.134:0/659705847 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fee100367e0 msgr2=0x7fee10038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.534+0000 7fee2e2b4700 1 --2- 172.21.15.134:0/659705847 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fee100367e0 0x7fee10038c90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009990 tx=0x7fee1c006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.534+0000 7fee2e2b4700 1 -- 172.21.15.134:0/659705847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee28102770 msgr2=0x7fee28111540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.534+0000 7fee2e2b4700 1 --2- 172.21.15.134:0/659705847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee28102770 0x7fee28111540 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee18006b00 tx=0x7fee18009250 comp rx=0 tx=0).stop 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.534+0000 7fee2e2b4700 1 -- 172.21.15.134:0/659705847 shutdown_connections 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.534+0000 7fee2e2b4700 1 --2- 172.21.15.134:0/659705847 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fee100367e0 0x7fee10038c90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.534+0000 7fee2e2b4700 1 --2- 172.21.15.134:0/659705847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee28102770 0x7fee28111540 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.534+0000 7fee2e2b4700 1 -- 172.21.15.134:0/659705847 >> 172.21.15.134:0/659705847 conn(0x7fee280fded0 msgr2=0x7fee280fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.534+0000 7fee2e2b4700 1 -- 172.21.15.134:0/659705847 shutdown_connections 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:15.534+0000 7fee2e2b4700 1 -- 172.21.15.134:0/659705847 wait complete. 2024-02-16T22:10:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying grafana service with default placement... 2024-02-16T22:10:16.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:16 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:16.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:16 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:17.321 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-02-16T22:10:17.321 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.557+0000 7f60cf3b2700 1 Processor -- start 2024-02-16T22:10:17.321 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.558+0000 7f60cf3b2700 1 -- start start 2024-02-16T22:10:17.321 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.558+0000 7f60cf3b2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c81007e0 0x7f60c8100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:17.321 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.558+0000 7f60cf3b2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c81011c0 con 0x7f60c81007e0 2024-02-16T22:10:17.321 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.558+0000 7f60cd14e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c81007e0 0x7f60c8100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:17.321 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.558+0000 7f60cd14e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c81007e0 0x7f60c8100bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39566/0 (socket says 172.21.15.134:39566) 2024-02-16T22:10:17.321 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.558+0000 7f60cd14e700 1 -- 172.21.15.134:0/1605408728 learned_addr learned my addr 172.21.15.134:0/1605408728 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:17.321 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.558+0000 7f60cd14e700 1 -- 172.21.15.134:0/1605408728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c8101300 con 0x7f60c81007e0 2024-02-16T22:10:17.322 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.558+0000 7f60cd14e700 1 --2- 172.21.15.134:0/1605408728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c81007e0 0x7f60c8100bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60c40098e0 tx=0x7f60c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c90b2618d514b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:17.322 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.559+0000 7f60bffff700 1 -- 172.21.15.134:0/1605408728 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60c400b860 con 0x7f60c81007e0 2024-02-16T22:10:17.322 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.559+0000 7f60bffff700 1 -- 172.21.15.134:0/1605408728 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60c400be90 con 0x7f60c81007e0 2024-02-16T22:10:17.322 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.559+0000 7f60bffff700 1 -- 172.21.15.134:0/1605408728 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60c40103c0 con 0x7f60c81007e0 2024-02-16T22:10:17.322 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.559+0000 7f60cf3b2700 1 -- 172.21.15.134:0/1605408728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c81007e0 msgr2=0x7f60c8100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:17.322 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.559+0000 7f60cf3b2700 1 --2- 172.21.15.134:0/1605408728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c81007e0 0x7f60c8100bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60c40098e0 tx=0x7f60c4009250 comp rx=0 tx=0).stop 2024-02-16T22:10:17.322 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.559+0000 7f60cf3b2700 1 -- 172.21.15.134:0/1605408728 shutdown_connections 2024-02-16T22:10:17.322 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.559+0000 7f60cf3b2700 1 --2- 172.21.15.134:0/1605408728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c81007e0 0x7f60c8100bf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:17.322 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.559+0000 7f60cf3b2700 1 -- 172.21.15.134:0/1605408728 >> 172.21.15.134:0/1605408728 conn(0x7f60c80fc100 msgr2=0x7f60c80fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:17.322 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.559+0000 7f60cf3b2700 1 -- 172.21.15.134:0/1605408728 shutdown_connections 2024-02-16T22:10:17.322 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.559+0000 7f60cf3b2700 1 -- 172.21.15.134:0/1605408728 wait complete. 2024-02-16T22:10:17.322 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.560+0000 7f60cf3b2700 1 Processor -- start 2024-02-16T22:10:17.323 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.560+0000 7f60cf3b2700 1 -- start start 2024-02-16T22:10:17.323 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.560+0000 7f60cf3b2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c81007e0 0x7f60c8113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:17.323 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.560+0000 7f60cf3b2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8113cd0 con 0x7f60c81007e0 2024-02-16T22:10:17.323 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.560+0000 7f60cd14e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c81007e0 0x7f60c8113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:17.323 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.560+0000 7f60cd14e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c81007e0 0x7f60c8113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39572/0 (socket says 172.21.15.134:39572) 2024-02-16T22:10:17.323 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.560+0000 7f60cd14e700 1 -- 172.21.15.134:0/3477002039 learned_addr learned my addr 172.21.15.134:0/3477002039 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:17.323 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.560+0000 7f60cd14e700 1 -- 172.21.15.134:0/3477002039 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c40094f0 con 0x7f60c81007e0 2024-02-16T22:10:17.323 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.560+0000 7f60cd14e700 1 --2- 172.21.15.134:0/3477002039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c81007e0 0x7f60c8113790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60c4006d40 tx=0x7f60c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:17.323 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.561+0000 7f60bdffb700 1 -- 172.21.15.134:0/3477002039 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60c4010840 con 0x7f60c81007e0 2024-02-16T22:10:17.323 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.561+0000 7f60bdffb700 1 -- 172.21.15.134:0/3477002039 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60c4010e70 con 0x7f60c81007e0 2024-02-16T22:10:17.323 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.561+0000 7f60bdffb700 1 -- 172.21.15.134:0/3477002039 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60c4024ea0 con 0x7f60c81007e0 2024-02-16T22:10:17.324 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.561+0000 7f60cf3b2700 1 -- 172.21.15.134:0/3477002039 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c8113f30 con 0x7f60c81007e0 2024-02-16T22:10:17.324 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.561+0000 7f60cf3b2700 1 -- 172.21.15.134:0/3477002039 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c8114b70 con 0x7f60c81007e0 2024-02-16T22:10:17.324 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.561+0000 7f60bdffb700 1 -- 172.21.15.134:0/3477002039 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f60c4024780 con 0x7f60c81007e0 2024-02-16T22:10:17.324 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.562+0000 7f60bdffb700 1 --2- 172.21.15.134:0/3477002039 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f60b4036790 0x7f60b4038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:17.324 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.562+0000 7f60cf3b2700 1 -- 172.21.15.134:0/3477002039 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c805f5c0 con 0x7f60c81007e0 2024-02-16T22:10:17.324 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.562+0000 7f60cc94d700 1 --2- 172.21.15.134:0/3477002039 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f60b4036790 0x7f60b4038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:17.324 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.562+0000 7f60bdffb700 1 -- 172.21.15.134:0/3477002039 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f60c404a640 con 0x7f60c81007e0 2024-02-16T22:10:17.324 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.562+0000 7f60cc94d700 1 --2- 172.21.15.134:0/3477002039 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f60b4036790 0x7f60b4038c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009990 tx=0x7f60b8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:17.324 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.567+0000 7f60bdffb700 1 -- 172.21.15.134:0/3477002039 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f60c402c340 con 0x7f60c81007e0 2024-02-16T22:10:17.324 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.769+0000 7f60cf3b2700 1 -- 172.21.15.134:0/3477002039 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f60c81157d0 con 0x7f60b4036790 2024-02-16T22:10:17.324 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.773+0000 7f60bdffb700 1 -- 172.21.15.134:0/3477002039 <== mgr.14120 v2:172.21.15.134:6800/3520115315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f60c81157d0 con 0x7f60b4036790 2024-02-16T22:10:17.325 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.775+0000 7f60cf3b2700 1 -- 172.21.15.134:0/3477002039 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f60b4036790 msgr2=0x7f60b4038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:17.325 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.775+0000 7f60cf3b2700 1 --2- 172.21.15.134:0/3477002039 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f60b4036790 0x7f60b4038c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009990 tx=0x7f60b8006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:17.325 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.775+0000 7f60cf3b2700 1 -- 172.21.15.134:0/3477002039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c81007e0 msgr2=0x7f60c8113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:17.325 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.775+0000 7f60cf3b2700 1 --2- 172.21.15.134:0/3477002039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c81007e0 0x7f60c8113790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60c4006d40 tx=0x7f60c4009250 comp rx=0 tx=0).stop 2024-02-16T22:10:17.325 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.775+0000 7f60cf3b2700 1 -- 172.21.15.134:0/3477002039 shutdown_connections 2024-02-16T22:10:17.325 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.775+0000 7f60cf3b2700 1 --2- 172.21.15.134:0/3477002039 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f60b4036790 0x7f60b4038c40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:17.325 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.775+0000 7f60cf3b2700 1 --2- 172.21.15.134:0/3477002039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c81007e0 0x7f60c8113790 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:17.325 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.775+0000 7f60cf3b2700 1 -- 172.21.15.134:0/3477002039 >> 172.21.15.134:0/3477002039 conn(0x7f60c80fc100 msgr2=0x7f60c80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:17.325 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.776+0000 7f60cf3b2700 1 -- 172.21.15.134:0/3477002039 shutdown_connections 2024-02-16T22:10:17.325 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:16.776+0000 7f60cf3b2700 1 -- 172.21.15.134:0/3477002039 wait complete. 2024-02-16T22:10:17.325 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying node-exporter service with default placement... 2024-02-16T22:10:17.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:17 smithi134 ceph-mon[28869]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:17.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:17 smithi134 ceph-mon[28869]: Saving service prometheus spec with placement count:1 2024-02-16T22:10:17.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:17 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:18.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:18 smithi134 ceph-mon[28869]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:18.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:18 smithi134 ceph-mon[28869]: Saving service grafana spec with placement count:1 2024-02-16T22:10:18.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:18 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:18.746 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-02-16T22:10:18.746 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.736+0000 7f8b8c702700 1 Processor -- start 2024-02-16T22:10:18.746 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.736+0000 7f8b8c702700 1 -- start start 2024-02-16T22:10:18.746 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.736+0000 7f8b8c702700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b840714a0 0x7f8b84105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:18.746 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.736+0000 7f8b8c702700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b841058a0 con 0x7f8b840714a0 2024-02-16T22:10:18.746 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.736+0000 7f8b8a49e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b840714a0 0x7f8b84105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:18.747 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.737+0000 7f8b8a49e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b840714a0 0x7f8b84105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39580/0 (socket says 172.21.15.134:39580) 2024-02-16T22:10:18.747 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.737+0000 7f8b8a49e700 1 -- 172.21.15.134:0/2348906299 learned_addr learned my addr 172.21.15.134:0/2348906299 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:18.747 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.737+0000 7f8b8a49e700 1 -- 172.21.15.134:0/2348906299 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b841059e0 con 0x7f8b840714a0 2024-02-16T22:10:18.747 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.737+0000 7f8b8a49e700 1 --2- 172.21.15.134:0/2348906299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b840714a0 0x7f8b84105360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8b740098e0 tx=0x7f8b74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cadaf0dcaca3a1f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:18.747 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.737+0000 7f8b8949c700 1 -- 172.21.15.134:0/2348906299 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b7400b860 con 0x7f8b840714a0 2024-02-16T22:10:18.747 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.737+0000 7f8b8949c700 1 -- 172.21.15.134:0/2348906299 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b7400be90 con 0x7f8b840714a0 2024-02-16T22:10:18.747 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.737+0000 7f8b8949c700 1 -- 172.21.15.134:0/2348906299 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b740103c0 con 0x7f8b840714a0 2024-02-16T22:10:18.747 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.738+0000 7f8b8c702700 1 -- 172.21.15.134:0/2348906299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b840714a0 msgr2=0x7f8b84105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:18.747 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.738+0000 7f8b8c702700 1 --2- 172.21.15.134:0/2348906299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b840714a0 0x7f8b84105360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8b740098e0 tx=0x7f8b74009250 comp rx=0 tx=0).stop 2024-02-16T22:10:18.747 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.738+0000 7f8b8c702700 1 -- 172.21.15.134:0/2348906299 shutdown_connections 2024-02-16T22:10:18.747 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.738+0000 7f8b8c702700 1 --2- 172.21.15.134:0/2348906299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b840714a0 0x7f8b84105360 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:18.747 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.738+0000 7f8b8c702700 1 -- 172.21.15.134:0/2348906299 >> 172.21.15.134:0/2348906299 conn(0x7f8b840fcdd0 msgr2=0x7f8b840ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:18.748 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.738+0000 7f8b8c702700 1 -- 172.21.15.134:0/2348906299 shutdown_connections 2024-02-16T22:10:18.748 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.738+0000 7f8b8c702700 1 -- 172.21.15.134:0/2348906299 wait complete. 2024-02-16T22:10:18.748 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.738+0000 7f8b8c702700 1 Processor -- start 2024-02-16T22:10:18.748 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.738+0000 7f8b8c702700 1 -- start start 2024-02-16T22:10:18.748 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.739+0000 7f8b8c702700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b840714a0 0x7f8b841115c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:18.748 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.739+0000 7f8b8c702700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b84111b00 con 0x7f8b840714a0 2024-02-16T22:10:18.748 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.739+0000 7f8b8a49e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b840714a0 0x7f8b841115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:18.748 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.739+0000 7f8b8a49e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b840714a0 0x7f8b841115c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39594/0 (socket says 172.21.15.134:39594) 2024-02-16T22:10:18.748 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.739+0000 7f8b8a49e700 1 -- 172.21.15.134:0/3280835803 learned_addr learned my addr 172.21.15.134:0/3280835803 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:18.748 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.739+0000 7f8b8a49e700 1 -- 172.21.15.134:0/3280835803 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b740094f0 con 0x7f8b840714a0 2024-02-16T22:10:18.748 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.739+0000 7f8b8a49e700 1 --2- 172.21.15.134:0/3280835803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b840714a0 0x7f8b841115c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b740094c0 tx=0x7f8b74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:18.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.739+0000 7f8b7affd700 1 -- 172.21.15.134:0/3280835803 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b74010890 con 0x7f8b840714a0 2024-02-16T22:10:18.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.739+0000 7f8b8c702700 1 -- 172.21.15.134:0/3280835803 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b84111d00 con 0x7f8b840714a0 2024-02-16T22:10:18.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.739+0000 7f8b7affd700 1 -- 172.21.15.134:0/3280835803 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b74010ec0 con 0x7f8b840714a0 2024-02-16T22:10:18.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.739+0000 7f8b7affd700 1 -- 172.21.15.134:0/3280835803 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b740243f0 con 0x7f8b840714a0 2024-02-16T22:10:18.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.739+0000 7f8b8c702700 1 -- 172.21.15.134:0/3280835803 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b841129a0 con 0x7f8b840714a0 2024-02-16T22:10:18.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.740+0000 7f8b8c702700 1 -- 172.21.15.134:0/3280835803 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8405f5c0 con 0x7f8b840714a0 2024-02-16T22:10:18.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.740+0000 7f8b7affd700 1 -- 172.21.15.134:0/3280835803 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f8b740109f0 con 0x7f8b840714a0 2024-02-16T22:10:18.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.741+0000 7f8b7affd700 1 --2- 172.21.15.134:0/3280835803 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f8b70036790 0x7f8b70038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:18.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.741+0000 7f8b7affd700 1 -- 172.21.15.134:0/3280835803 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8b7404a2c0 con 0x7f8b840714a0 2024-02-16T22:10:18.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.741+0000 7f8b89c9d700 1 --2- 172.21.15.134:0/3280835803 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f8b70036790 0x7f8b70038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:18.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.741+0000 7f8b89c9d700 1 --2- 172.21.15.134:0/3280835803 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f8b70036790 0x7f8b70038c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009990 tx=0x7f8b80006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:18.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.749+0000 7f8b7affd700 1 -- 172.21.15.134:0/3280835803 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8b7402b670 con 0x7f8b840714a0 2024-02-16T22:10:18.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.959+0000 7f8b8c702700 1 -- 172.21.15.134:0/3280835803 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b84113580 con 0x7f8b70036790 2024-02-16T22:10:18.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.963+0000 7f8b7affd700 1 -- 172.21.15.134:0/3280835803 <== mgr.14120 v2:172.21.15.134:6800/3520115315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f8b84113580 con 0x7f8b70036790 2024-02-16T22:10:18.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.966+0000 7f8b8c702700 1 -- 172.21.15.134:0/3280835803 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f8b70036790 msgr2=0x7f8b70038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:18.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.966+0000 7f8b8c702700 1 --2- 172.21.15.134:0/3280835803 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f8b70036790 0x7f8b70038c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009990 tx=0x7f8b80006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:18.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.966+0000 7f8b8c702700 1 -- 172.21.15.134:0/3280835803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b840714a0 msgr2=0x7f8b841115c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:18.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.966+0000 7f8b8c702700 1 --2- 172.21.15.134:0/3280835803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b840714a0 0x7f8b841115c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b740094c0 tx=0x7f8b74009250 comp rx=0 tx=0).stop 2024-02-16T22:10:18.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.966+0000 7f8b8c702700 1 -- 172.21.15.134:0/3280835803 shutdown_connections 2024-02-16T22:10:18.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.966+0000 7f8b8c702700 1 --2- 172.21.15.134:0/3280835803 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f8b70036790 0x7f8b70038c40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:18.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.966+0000 7f8b8c702700 1 --2- 172.21.15.134:0/3280835803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b840714a0 0x7f8b841115c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:18.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.966+0000 7f8b8c702700 1 -- 172.21.15.134:0/3280835803 >> 172.21.15.134:0/3280835803 conn(0x7f8b840fcdd0 msgr2=0x7f8b840fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:18.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.966+0000 7f8b8c702700 1 -- 172.21.15.134:0/3280835803 shutdown_connections 2024-02-16T22:10:18.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:17.966+0000 7f8b8c702700 1 -- 172.21.15.134:0/3280835803 wait complete. 2024-02-16T22:10:18.751 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying alertmanager service with default placement... 2024-02-16T22:10:19.618 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:19 smithi134 ceph-mon[28869]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:19.618 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:19 smithi134 ceph-mon[28869]: Saving service node-exporter spec with placement * 2024-02-16T22:10:19.618 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:19 smithi134 ceph-mon[28869]: from='mgr.14120 172.21.15.134:0/2757622451' entity='mgr.smithi134.ordace' 2024-02-16T22:10:20.247 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-02-16T22:10:20.247 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.133+0000 7f645f012700 1 Processor -- start 2024-02-16T22:10:20.247 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.133+0000 7f645f012700 1 -- start start 2024-02-16T22:10:20.247 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.133+0000 7f645f012700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458076c20 0x7f6458105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:20.247 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.133+0000 7f645f012700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64581058c0 con 0x7f6458076c20 2024-02-16T22:10:20.247 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.133+0000 7f645cdae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458076c20 0x7f6458105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:20.247 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.133+0000 7f645cdae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458076c20 0x7f6458105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39600/0 (socket says 172.21.15.134:39600) 2024-02-16T22:10:20.247 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.133+0000 7f645cdae700 1 -- 172.21.15.134:0/622640760 learned_addr learned my addr 172.21.15.134:0/622640760 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:20.247 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.134+0000 7f645cdae700 1 -- 172.21.15.134:0/622640760 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6458105a00 con 0x7f6458076c20 2024-02-16T22:10:20.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.134+0000 7f645cdae700 1 --2- 172.21.15.134:0/622640760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458076c20 0x7f6458105380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f644c0098e0 tx=0x7f644c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e81bb7a94949b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:20.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.134+0000 7f64577fe700 1 -- 172.21.15.134:0/622640760 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f644c00b860 con 0x7f6458076c20 2024-02-16T22:10:20.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.134+0000 7f64577fe700 1 -- 172.21.15.134:0/622640760 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f644c00be90 con 0x7f6458076c20 2024-02-16T22:10:20.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.134+0000 7f64577fe700 1 -- 172.21.15.134:0/622640760 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f644c0103c0 con 0x7f6458076c20 2024-02-16T22:10:20.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.134+0000 7f645f012700 1 -- 172.21.15.134:0/622640760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458076c20 msgr2=0x7f6458105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:20.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.134+0000 7f645f012700 1 --2- 172.21.15.134:0/622640760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458076c20 0x7f6458105380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f644c0098e0 tx=0x7f644c009250 comp rx=0 tx=0).stop 2024-02-16T22:10:20.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.135+0000 7f645f012700 1 -- 172.21.15.134:0/622640760 shutdown_connections 2024-02-16T22:10:20.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.135+0000 7f645f012700 1 --2- 172.21.15.134:0/622640760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458076c20 0x7f6458105380 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:20.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.135+0000 7f645f012700 1 -- 172.21.15.134:0/622640760 >> 172.21.15.134:0/622640760 conn(0x7f64580fcdd0 msgr2=0x7f64580ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:20.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.135+0000 7f645f012700 1 -- 172.21.15.134:0/622640760 shutdown_connections 2024-02-16T22:10:20.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.135+0000 7f645f012700 1 -- 172.21.15.134:0/622640760 wait complete. 2024-02-16T22:10:20.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.135+0000 7f645f012700 1 Processor -- start 2024-02-16T22:10:20.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.135+0000 7f645f012700 1 -- start start 2024-02-16T22:10:20.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.135+0000 7f645f012700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458076c20 0x7f6458111870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:20.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.135+0000 7f645f012700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6458111db0 con 0x7f6458076c20 2024-02-16T22:10:20.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.136+0000 7f645cdae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458076c20 0x7f6458111870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:20.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.136+0000 7f645cdae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458076c20 0x7f6458111870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39604/0 (socket says 172.21.15.134:39604) 2024-02-16T22:10:20.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.136+0000 7f645cdae700 1 -- 172.21.15.134:0/2681543880 learned_addr learned my addr 172.21.15.134:0/2681543880 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:20.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.136+0000 7f645cdae700 1 -- 172.21.15.134:0/2681543880 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c0094f0 con 0x7f6458076c20 2024-02-16T22:10:20.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.136+0000 7f645cdae700 1 --2- 172.21.15.134:0/2681543880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458076c20 0x7f6458111870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f644c003080 tx=0x7f644c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:20.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.136+0000 7f64557fa700 1 -- 172.21.15.134:0/2681543880 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f644c011920 con 0x7f6458076c20 2024-02-16T22:10:20.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.136+0000 7f64557fa700 1 -- 172.21.15.134:0/2681543880 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f644c010d60 con 0x7f6458076c20 2024-02-16T22:10:20.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.136+0000 7f645f012700 1 -- 172.21.15.134:0/2681543880 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6458111fb0 con 0x7f6458076c20 2024-02-16T22:10:20.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.136+0000 7f64557fa700 1 -- 172.21.15.134:0/2681543880 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f644c0243f0 con 0x7f6458076c20 2024-02-16T22:10:20.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.136+0000 7f645f012700 1 -- 172.21.15.134:0/2681543880 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6458112c50 con 0x7f6458076c20 2024-02-16T22:10:20.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.137+0000 7f64557fa700 1 -- 172.21.15.134:0/2681543880 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f644c02d3f0 con 0x7f6458076c20 2024-02-16T22:10:20.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.137+0000 7f645f012700 1 -- 172.21.15.134:0/2681543880 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645805f5c0 con 0x7f6458076c20 2024-02-16T22:10:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.137+0000 7f64557fa700 1 --2- 172.21.15.134:0/2681543880 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f64480367e0 0x7f6448038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.137+0000 7f64557fa700 1 -- 172.21.15.134:0/2681543880 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f644c04a570 con 0x7f6458076c20 2024-02-16T22:10:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.138+0000 7f6457fff700 1 --2- 172.21.15.134:0/2681543880 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f64480367e0 0x7f6448038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.138+0000 7f6457fff700 1 --2- 172.21.15.134:0/2681543880 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f64480367e0 0x7f6448038c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6444009990 tx=0x7f6444006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.142+0000 7f64557fa700 1 -- 172.21.15.134:0/2681543880 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f644c02b8e0 con 0x7f6458076c20 2024-02-16T22:10:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.339+0000 7f645f012700 1 -- 172.21.15.134:0/2681543880 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f6458106950 con 0x7f64480367e0 2024-02-16T22:10:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.343+0000 7f64557fa700 1 -- 172.21.15.134:0/2681543880 <== mgr.14120 v2:172.21.15.134:6800/3520115315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f6458106950 con 0x7f64480367e0 2024-02-16T22:10:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.345+0000 7f645f012700 1 -- 172.21.15.134:0/2681543880 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f64480367e0 msgr2=0x7f6448038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.345+0000 7f645f012700 1 --2- 172.21.15.134:0/2681543880 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f64480367e0 0x7f6448038c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6444009990 tx=0x7f6444006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.345+0000 7f645f012700 1 -- 172.21.15.134:0/2681543880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458076c20 msgr2=0x7f6458111870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.345+0000 7f645f012700 1 --2- 172.21.15.134:0/2681543880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458076c20 0x7f6458111870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f644c003080 tx=0x7f644c009250 comp rx=0 tx=0).stop 2024-02-16T22:10:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.345+0000 7f645f012700 1 -- 172.21.15.134:0/2681543880 shutdown_connections 2024-02-16T22:10:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.345+0000 7f645f012700 1 --2- 172.21.15.134:0/2681543880 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f64480367e0 0x7f6448038c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.345+0000 7f645f012700 1 --2- 172.21.15.134:0/2681543880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458076c20 0x7f6458111870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:20.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.345+0000 7f645f012700 1 -- 172.21.15.134:0/2681543880 >> 172.21.15.134:0/2681543880 conn(0x7f64580fcdd0 msgr2=0x7f64580fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:20.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.345+0000 7f645f012700 1 -- 172.21.15.134:0/2681543880 shutdown_connections 2024-02-16T22:10:20.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:19.345+0000 7f645f012700 1 -- 172.21.15.134:0/2681543880 wait complete. 2024-02-16T22:10:20.634 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:20 smithi134 ceph-mon[28869]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:20.634 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:20 smithi134 ceph-mon[28869]: Saving service alertmanager spec with placement count:1 2024-02-16T22:10:21.563 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.846+0000 7fcc9d487700 1 Processor -- start 2024-02-16T22:10:21.563 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.846+0000 7fcc9d487700 1 -- start start 2024-02-16T22:10:21.563 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.847+0000 7fcc9d487700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc98078d00 0x7fcc98077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.847+0000 7fcc9d487700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98079110 con 0x7fcc98078d00 2024-02-16T22:10:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.847+0000 7fcc96ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc98078d00 0x7fcc98077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.847+0000 7fcc96ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc98078d00 0x7fcc98077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39606/0 (socket says 172.21.15.134:39606) 2024-02-16T22:10:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.847+0000 7fcc96ffd700 1 -- 172.21.15.134:0/3295430259 learned_addr learned my addr 172.21.15.134:0/3295430259 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.847+0000 7fcc96ffd700 1 -- 172.21.15.134:0/3295430259 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98077750 con 0x7fcc98078d00 2024-02-16T22:10:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.847+0000 7fcc96ffd700 1 --2- 172.21.15.134:0/3295430259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc98078d00 0x7fcc98077210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc880098e0 tx=0x7fcc88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7933670c56d0db1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.847+0000 7fcc95ffb700 1 -- 172.21.15.134:0/3295430259 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc8800b860 con 0x7fcc98078d00 2024-02-16T22:10:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.847+0000 7fcc95ffb700 1 -- 172.21.15.134:0/3295430259 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc8800be90 con 0x7fcc98078d00 2024-02-16T22:10:21.567 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.847+0000 7fcc95ffb700 1 -- 172.21.15.134:0/3295430259 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc880103c0 con 0x7fcc98078d00 2024-02-16T22:10:21.567 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.848+0000 7fcc9d487700 1 -- 172.21.15.134:0/3295430259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc98078d00 msgr2=0x7fcc98077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:21.567 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.848+0000 7fcc9d487700 1 --2- 172.21.15.134:0/3295430259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc98078d00 0x7fcc98077210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc880098e0 tx=0x7fcc88009250 comp rx=0 tx=0).stop 2024-02-16T22:10:21.567 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.848+0000 7fcc9d487700 1 -- 172.21.15.134:0/3295430259 shutdown_connections 2024-02-16T22:10:21.567 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.848+0000 7fcc9d487700 1 --2- 172.21.15.134:0/3295430259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc98078d00 0x7fcc98077210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:21.567 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.848+0000 7fcc9d487700 1 -- 172.21.15.134:0/3295430259 >> 172.21.15.134:0/3295430259 conn(0x7fcc980fdf00 msgr2=0x7fcc98100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:21.567 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.848+0000 7fcc9d487700 1 -- 172.21.15.134:0/3295430259 shutdown_connections 2024-02-16T22:10:21.567 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.848+0000 7fcc9d487700 1 -- 172.21.15.134:0/3295430259 wait complete. 2024-02-16T22:10:21.567 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.849+0000 7fcc9d487700 1 Processor -- start 2024-02-16T22:10:21.567 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.849+0000 7fcc9d487700 1 -- start start 2024-02-16T22:10:21.567 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.849+0000 7fcc9d487700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc98078d00 0x7fcc98113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:21.568 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.849+0000 7fcc9d487700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98113d40 con 0x7fcc98078d00 2024-02-16T22:10:21.568 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.849+0000 7fcc96ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc98078d00 0x7fcc98113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:21.568 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.849+0000 7fcc96ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc98078d00 0x7fcc98113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39614/0 (socket says 172.21.15.134:39614) 2024-02-16T22:10:21.568 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.849+0000 7fcc96ffd700 1 -- 172.21.15.134:0/95524990 learned_addr learned my addr 172.21.15.134:0/95524990 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:21.568 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.849+0000 7fcc96ffd700 1 -- 172.21.15.134:0/95524990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc880094f0 con 0x7fcc98078d00 2024-02-16T22:10:21.568 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.849+0000 7fcc96ffd700 1 --2- 172.21.15.134:0/95524990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc98078d00 0x7fcc98113800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcc88006d40 tx=0x7fcc88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:21.568 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.849+0000 7fcc8f7fe700 1 -- 172.21.15.134:0/95524990 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc88010840 con 0x7fcc98078d00 2024-02-16T22:10:21.568 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.849+0000 7fcc8f7fe700 1 -- 172.21.15.134:0/95524990 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc88010e70 con 0x7fcc98078d00 2024-02-16T22:10:21.568 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.850+0000 7fcc9d487700 1 -- 172.21.15.134:0/95524990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc98113f40 con 0x7fcc98078d00 2024-02-16T22:10:21.568 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.850+0000 7fcc8f7fe700 1 -- 172.21.15.134:0/95524990 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc88024ea0 con 0x7fcc98078d00 2024-02-16T22:10:21.568 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.850+0000 7fcc9d487700 1 -- 172.21.15.134:0/95524990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc98114be0 con 0x7fcc98078d00 2024-02-16T22:10:21.568 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.850+0000 7fcc8f7fe700 1 -- 172.21.15.134:0/95524990 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fcc8801a510 con 0x7fcc98078d00 2024-02-16T22:10:21.569 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.850+0000 7fcc8f7fe700 1 --2- 172.21.15.134:0/95524990 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fcc84036740 0x7fcc84038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:21.569 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.851+0000 7fcc8f7fe700 1 -- 172.21.15.134:0/95524990 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fcc8804a7d0 con 0x7fcc98078d00 2024-02-16T22:10:21.569 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.851+0000 7fcc967fc700 1 --2- 172.21.15.134:0/95524990 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fcc84036740 0x7fcc84038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:21.569 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.851+0000 7fcc9d487700 1 -- 172.21.15.134:0/95524990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc981143d0 con 0x7fcc98078d00 2024-02-16T22:10:21.569 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.851+0000 7fcc967fc700 1 --2- 172.21.15.134:0/95524990 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fcc84036740 0x7fcc84038bf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009990 tx=0x7fcc80006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:21.569 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:20.855+0000 7fcc8f7fe700 1 -- 172.21.15.134:0/95524990 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fcc88018940 con 0x7fcc98078d00 2024-02-16T22:10:21.569 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.037+0000 7fcc9d487700 1 -- 172.21.15.134:0/95524990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fcc9805f5c0 con 0x7fcc98078d00 2024-02-16T22:10:21.569 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.040+0000 7fcc8f7fe700 1 -- 172.21.15.134:0/95524990 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fcc88049020 con 0x7fcc98078d00 2024-02-16T22:10:21.569 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.042+0000 7fcc9d487700 1 -- 172.21.15.134:0/95524990 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fcc84036740 msgr2=0x7fcc84038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:21.569 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.042+0000 7fcc9d487700 1 --2- 172.21.15.134:0/95524990 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fcc84036740 0x7fcc84038bf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009990 tx=0x7fcc80006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:21.569 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.042+0000 7fcc9d487700 1 -- 172.21.15.134:0/95524990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc98078d00 msgr2=0x7fcc98113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:21.569 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.042+0000 7fcc9d487700 1 --2- 172.21.15.134:0/95524990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc98078d00 0x7fcc98113800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcc88006d40 tx=0x7fcc88009250 comp rx=0 tx=0).stop 2024-02-16T22:10:21.569 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.042+0000 7fcc9d487700 1 -- 172.21.15.134:0/95524990 shutdown_connections 2024-02-16T22:10:21.570 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.042+0000 7fcc9d487700 1 --2- 172.21.15.134:0/95524990 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fcc84036740 0x7fcc84038bf0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:21.570 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.042+0000 7fcc9d487700 1 --2- 172.21.15.134:0/95524990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc98078d00 0x7fcc98113800 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:21.570 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.042+0000 7fcc9d487700 1 -- 172.21.15.134:0/95524990 >> 172.21.15.134:0/95524990 conn(0x7fcc980fdf00 msgr2=0x7fcc980ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:21.570 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.042+0000 7fcc9d487700 1 -- 172.21.15.134:0/95524990 shutdown_connections 2024-02-16T22:10:21.570 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.042+0000 7fcc9d487700 1 -- 172.21.15.134:0/95524990 wait complete. 2024-02-16T22:10:21.637 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:21 smithi134 ceph-mon[28869]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:10:21.637 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:21 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/95524990' entity='client.admin' 2024-02-16T22:10:22.710 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.965+0000 7f71a52a6700 1 Processor -- start 2024-02-16T22:10:22.710 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.965+0000 7f71a52a6700 1 -- start start 2024-02-16T22:10:22.710 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.965+0000 7f71a52a6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71a0102770 0x7f71a0102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:22.710 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.965+0000 7f71a52a6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a01030c0 con 0x7f71a0102770 2024-02-16T22:10:22.710 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.965+0000 7f719effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71a0102770 0x7f71a0102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:22.710 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.965+0000 7f719effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71a0102770 0x7f71a0102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45308/0 (socket says 172.21.15.134:45308) 2024-02-16T22:10:22.710 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.965+0000 7f719effd700 1 -- 172.21.15.134:0/1630364058 learned_addr learned my addr 172.21.15.134:0/1630364058 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:22.710 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.965+0000 7f719effd700 1 -- 172.21.15.134:0/1630364058 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a0103200 con 0x7f71a0102770 2024-02-16T22:10:22.710 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.965+0000 7f719effd700 1 --2- 172.21.15.134:0/1630364058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71a0102770 0x7f71a0102b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71900098e0 tx=0x7f7190009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4913b8ee377d8af server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:22.711 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.966+0000 7f719dffb700 1 -- 172.21.15.134:0/1630364058 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f719000b860 con 0x7f71a0102770 2024-02-16T22:10:22.711 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.966+0000 7f719dffb700 1 -- 172.21.15.134:0/1630364058 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f719000be90 con 0x7f71a0102770 2024-02-16T22:10:22.711 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.966+0000 7f719dffb700 1 -- 172.21.15.134:0/1630364058 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71900103c0 con 0x7f71a0102770 2024-02-16T22:10:22.711 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.966+0000 7f71a52a6700 1 -- 172.21.15.134:0/1630364058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71a0102770 msgr2=0x7f71a0102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:22.711 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.966+0000 7f71a52a6700 1 --2- 172.21.15.134:0/1630364058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71a0102770 0x7f71a0102b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71900098e0 tx=0x7f7190009250 comp rx=0 tx=0).stop 2024-02-16T22:10:22.711 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.966+0000 7f71a52a6700 1 -- 172.21.15.134:0/1630364058 shutdown_connections 2024-02-16T22:10:22.711 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.966+0000 7f71a52a6700 1 --2- 172.21.15.134:0/1630364058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71a0102770 0x7f71a0102b80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:22.711 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.966+0000 7f71a52a6700 1 -- 172.21.15.134:0/1630364058 >> 172.21.15.134:0/1630364058 conn(0x7f71a00fded0 msgr2=0x7f71a0100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:22.711 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.966+0000 7f71a52a6700 1 -- 172.21.15.134:0/1630364058 shutdown_connections 2024-02-16T22:10:22.711 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.966+0000 7f71a52a6700 1 -- 172.21.15.134:0/1630364058 wait complete. 2024-02-16T22:10:22.711 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.967+0000 7f71a52a6700 1 Processor -- start 2024-02-16T22:10:22.711 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.967+0000 7f71a52a6700 1 -- start start 2024-02-16T22:10:22.711 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.967+0000 7f71a52a6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71a0102770 0x7f71a01115c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:22.712 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.967+0000 7f71a52a6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0111b00 con 0x7f71a0102770 2024-02-16T22:10:22.712 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.967+0000 7f719effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71a0102770 0x7f71a01115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:22.712 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.967+0000 7f719effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71a0102770 0x7f71a01115c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45322/0 (socket says 172.21.15.134:45322) 2024-02-16T22:10:22.712 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.967+0000 7f719effd700 1 -- 172.21.15.134:0/195891656 learned_addr learned my addr 172.21.15.134:0/195891656 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:22.712 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.968+0000 7f719effd700 1 -- 172.21.15.134:0/195891656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71900094f0 con 0x7f71a0102770 2024-02-16T22:10:22.712 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.968+0000 7f719effd700 1 --2- 172.21.15.134:0/195891656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71a0102770 0x7f71a01115c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7190011680 tx=0x7f7190009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:22.712 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.968+0000 7f71877fe700 1 -- 172.21.15.134:0/195891656 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7190010890 con 0x7f71a0102770 2024-02-16T22:10:22.712 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.968+0000 7f71877fe700 1 -- 172.21.15.134:0/195891656 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7190010ec0 con 0x7f71a0102770 2024-02-16T22:10:22.712 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.968+0000 7f71a52a6700 1 -- 172.21.15.134:0/195891656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a0111d00 con 0x7f71a0102770 2024-02-16T22:10:22.712 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.968+0000 7f71877fe700 1 -- 172.21.15.134:0/195891656 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71900243f0 con 0x7f71a0102770 2024-02-16T22:10:22.712 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.968+0000 7f71a52a6700 1 -- 172.21.15.134:0/195891656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a01129a0 con 0x7f71a0102770 2024-02-16T22:10:22.712 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.969+0000 7f71877fe700 1 -- 172.21.15.134:0/195891656 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f719002d3f0 con 0x7f71a0102770 2024-02-16T22:10:22.713 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.969+0000 7f71a52a6700 1 -- 172.21.15.134:0/195891656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a005f5c0 con 0x7f71a0102770 2024-02-16T22:10:22.713 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.969+0000 7f71877fe700 1 --2- 172.21.15.134:0/195891656 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f71880367e0 0x7f7188038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:22.713 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.969+0000 7f71877fe700 1 -- 172.21.15.134:0/195891656 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f719004a1e0 con 0x7f71a0102770 2024-02-16T22:10:22.713 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.969+0000 7f719e7fc700 1 --2- 172.21.15.134:0/195891656 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f71880367e0 0x7f7188038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:22.713 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.969+0000 7f719e7fc700 1 --2- 172.21.15.134:0/195891656 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f71880367e0 0x7f7188038c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7194009990 tx=0x7f7194006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:22.713 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:21.974+0000 7f71877fe700 1 -- 172.21.15.134:0/195891656 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f719002b8e0 con 0x7f71a0102770 2024-02-16T22:10:22.713 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:22.155+0000 7f71a52a6700 1 -- 172.21.15.134:0/195891656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f71a004bed0 con 0x7f71a0102770 2024-02-16T22:10:22.713 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:22.158+0000 7f71877fe700 1 -- 172.21.15.134:0/195891656 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f7190006d70 con 0x7f71a0102770 2024-02-16T22:10:22.713 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:22.161+0000 7f71a52a6700 1 -- 172.21.15.134:0/195891656 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f71880367e0 msgr2=0x7f7188038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:22.713 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:22.161+0000 7f71a52a6700 1 --2- 172.21.15.134:0/195891656 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f71880367e0 0x7f7188038c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7194009990 tx=0x7f7194006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:22.713 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:22.161+0000 7f71a52a6700 1 -- 172.21.15.134:0/195891656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71a0102770 msgr2=0x7f71a01115c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:22.713 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:22.161+0000 7f71a52a6700 1 --2- 172.21.15.134:0/195891656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71a0102770 0x7f71a01115c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7190011680 tx=0x7f7190009250 comp rx=0 tx=0).stop 2024-02-16T22:10:22.714 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:22.161+0000 7f71a52a6700 1 -- 172.21.15.134:0/195891656 shutdown_connections 2024-02-16T22:10:22.714 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:22.161+0000 7f71a52a6700 1 --2- 172.21.15.134:0/195891656 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f71880367e0 0x7f7188038c90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:22.714 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:22.161+0000 7f71a52a6700 1 --2- 172.21.15.134:0/195891656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71a0102770 0x7f71a01115c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:22.714 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:22.161+0000 7f71a52a6700 1 -- 172.21.15.134:0/195891656 >> 172.21.15.134:0/195891656 conn(0x7f71a00fded0 msgr2=0x7f71a00ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:22.714 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:22.161+0000 7f71a52a6700 1 -- 172.21.15.134:0/195891656 shutdown_connections 2024-02-16T22:10:22.714 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:22.161+0000 7f71a52a6700 1 -- 172.21.15.134:0/195891656 wait complete. 2024-02-16T22:10:22.714 INFO:teuthology.orchestra.run.smithi134.stdout:Enabling the dashboard module... 2024-02-16T22:10:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:23 smithi134 ceph-mon[28869]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:10:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:23 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/195891656' entity='client.admin' 2024-02-16T22:10:24.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:24 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/3583051475' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-16T22:10:24.808 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.091+0000 7feff4897700 1 Processor -- start 2024-02-16T22:10:24.808 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.091+0000 7feff4897700 1 -- start start 2024-02-16T22:10:24.808 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.092+0000 7feff4897700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff0102770 0x7feff0102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:24.808 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.092+0000 7feff4897700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff01030c0 con 0x7feff0102770 2024-02-16T22:10:24.808 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.092+0000 7fefee59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff0102770 0x7feff0102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:24.808 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.092+0000 7fefee59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff0102770 0x7feff0102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45328/0 (socket says 172.21.15.134:45328) 2024-02-16T22:10:24.808 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.092+0000 7fefee59c700 1 -- 172.21.15.134:0/4270552054 learned_addr learned my addr 172.21.15.134:0/4270552054 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:24.808 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.092+0000 7fefee59c700 1 -- 172.21.15.134:0/4270552054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff0103200 con 0x7feff0102770 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.092+0000 7fefee59c700 1 --2- 172.21.15.134:0/4270552054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff0102770 0x7feff0102b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fefe40098e0 tx=0x7fefe4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966c8901057d8321 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.093+0000 7fefed59a700 1 -- 172.21.15.134:0/4270552054 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefe400b860 con 0x7feff0102770 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.093+0000 7fefed59a700 1 -- 172.21.15.134:0/4270552054 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fefe400be90 con 0x7feff0102770 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.093+0000 7fefed59a700 1 -- 172.21.15.134:0/4270552054 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefe40103c0 con 0x7feff0102770 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.093+0000 7feff4897700 1 -- 172.21.15.134:0/4270552054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff0102770 msgr2=0x7feff0102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.093+0000 7feff4897700 1 --2- 172.21.15.134:0/4270552054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff0102770 0x7feff0102b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fefe40098e0 tx=0x7fefe4009250 comp rx=0 tx=0).stop 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.093+0000 7feff4897700 1 -- 172.21.15.134:0/4270552054 shutdown_connections 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.093+0000 7feff4897700 1 --2- 172.21.15.134:0/4270552054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff0102770 0x7feff0102b80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.093+0000 7feff4897700 1 -- 172.21.15.134:0/4270552054 >> 172.21.15.134:0/4270552054 conn(0x7feff00fded0 msgr2=0x7feff0100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.093+0000 7feff4897700 1 -- 172.21.15.134:0/4270552054 shutdown_connections 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.093+0000 7feff4897700 1 -- 172.21.15.134:0/4270552054 wait complete. 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.094+0000 7feff4897700 1 Processor -- start 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.094+0000 7feff4897700 1 -- start start 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.094+0000 7feff4897700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff0102770 0x7feff0078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:24.809 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.094+0000 7feff4897700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff0077190 con 0x7feff0102770 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.094+0000 7fefee59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff0102770 0x7feff0078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.094+0000 7fefee59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff0102770 0x7feff0078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45340/0 (socket says 172.21.15.134:45340) 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.094+0000 7fefee59c700 1 -- 172.21.15.134:0/3583051475 learned_addr learned my addr 172.21.15.134:0/3583051475 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.094+0000 7fefee59c700 1 -- 172.21.15.134:0/3583051475 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40094f0 con 0x7feff0102770 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.094+0000 7fefee59c700 1 --2- 172.21.15.134:0/3583051475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff0102770 0x7feff0078d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fefe4011680 tx=0x7fefe4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.094+0000 7fefdeffd700 1 -- 172.21.15.134:0/3583051475 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefe4010890 con 0x7feff0102770 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.094+0000 7fefdeffd700 1 -- 172.21.15.134:0/3583051475 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fefe4010ec0 con 0x7feff0102770 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.094+0000 7fefdeffd700 1 -- 172.21.15.134:0/3583051475 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefe40243f0 con 0x7feff0102770 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.095+0000 7feff4897700 1 -- 172.21.15.134:0/3583051475 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff0077390 con 0x7feff0102770 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.095+0000 7feff4897700 1 -- 172.21.15.134:0/3583051475 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff0077820 con 0x7feff0102770 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.096+0000 7fefdeffd700 1 -- 172.21.15.134:0/3583051475 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fefe40109f0 con 0x7feff0102770 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.096+0000 7fefdeffd700 1 --2- 172.21.15.134:0/3583051475 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fefd80367e0 0x7fefd8038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.096+0000 7fefdeffd700 1 -- 172.21.15.134:0/3583051475 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fefe404a2d0 con 0x7feff0102770 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.096+0000 7feff4897700 1 -- 172.21.15.134:0/3583051475 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff004bed0 con 0x7feff0102770 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.096+0000 7fefedd9b700 1 --2- 172.21.15.134:0/3583051475 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fefd80367e0 0x7fefd8038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:24.810 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.096+0000 7fefedd9b700 1 --2- 172.21.15.134:0/3583051475 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fefd80367e0 0x7fefd8038c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009990 tx=0x7fefe0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.101+0000 7fefdeffd700 1 -- 172.21.15.134:0/3583051475 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fefe402d3f0 con 0x7feff0102770 2024-02-16T22:10:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:23.338+0000 7feff4897700 1 -- 172.21.15.134:0/3583051475 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7feff0077c20 con 0x7feff0102770 2024-02-16T22:10:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:24.163+0000 7fefdeffd700 1 -- 172.21.15.134:0/3583051475 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7fefe401a8c0 con 0x7feff0102770 2024-02-16T22:10:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:24.165+0000 7fefdeffd700 1 -- 172.21.15.134:0/3583051475 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fefe400fb50 con 0x7feff0102770 2024-02-16T22:10:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:24.167+0000 7feff4897700 1 -- 172.21.15.134:0/3583051475 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fefd80367e0 msgr2=0x7fefd8038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:24.167+0000 7feff4897700 1 --2- 172.21.15.134:0/3583051475 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fefd80367e0 0x7fefd8038c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009990 tx=0x7fefe0006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:24.167+0000 7feff4897700 1 -- 172.21.15.134:0/3583051475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff0102770 msgr2=0x7feff0078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:24.167+0000 7feff4897700 1 --2- 172.21.15.134:0/3583051475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff0102770 0x7feff0078d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fefe4011680 tx=0x7fefe4009250 comp rx=0 tx=0).stop 2024-02-16T22:10:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:24.167+0000 7feff4897700 1 -- 172.21.15.134:0/3583051475 shutdown_connections 2024-02-16T22:10:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:24.167+0000 7feff4897700 1 --2- 172.21.15.134:0/3583051475 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7fefd80367e0 0x7fefd8038c90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:24.167+0000 7feff4897700 1 --2- 172.21.15.134:0/3583051475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff0102770 0x7feff0078d10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:24.167+0000 7feff4897700 1 -- 172.21.15.134:0/3583051475 >> 172.21.15.134:0/3583051475 conn(0x7feff00fded0 msgr2=0x7feff00ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:24.167+0000 7feff4897700 1 -- 172.21.15.134:0/3583051475 shutdown_connections 2024-02-16T22:10:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:24.167+0000 7feff4897700 1 -- 172.21.15.134:0/3583051475 wait complete. 2024-02-16T22:10:25.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:25 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/3583051475' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-16T22:10:25.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:25 smithi134 ceph-mon[28869]: mgrmap e9: smithi134.ordace(active, since 24s) 2024-02-16T22:10:26.091 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-02-16T22:10:26.091 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-02-16T22:10:26.091 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-16T22:10:26.091 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "active_name": "smithi134.ordace", 2024-02-16T22:10:26.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-16T22:10:26.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-02-16T22:10:26.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.207+0000 7f538e8ed700 1 Processor -- start 2024-02-16T22:10:26.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.207+0000 7f538e8ed700 1 -- start start 2024-02-16T22:10:26.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.207+0000 7f538e8ed700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5388102770 0x7f5388102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:26.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.207+0000 7f538e8ed700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53881030c0 con 0x7f5388102770 2024-02-16T22:10:26.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.207+0000 7f5387fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5388102770 0x7f5388102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:26.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.207+0000 7f5387fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5388102770 0x7f5388102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45354/0 (socket says 172.21.15.134:45354) 2024-02-16T22:10:26.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.207+0000 7f5387fff700 1 -- 172.21.15.134:0/1663893939 learned_addr learned my addr 172.21.15.134:0/1663893939 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:26.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.207+0000 7f5387fff700 1 -- 172.21.15.134:0/1663893939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5388103200 con 0x7f5388102770 2024-02-16T22:10:26.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.208+0000 7f5387fff700 1 --2- 172.21.15.134:0/1663893939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5388102770 0x7f5388102b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f53780098e0 tx=0x7f5378009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd85b7fad5d002dc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:26.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.208+0000 7f5386ffd700 1 -- 172.21.15.134:0/1663893939 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f537800b860 con 0x7f5388102770 2024-02-16T22:10:26.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.208+0000 7f5386ffd700 1 -- 172.21.15.134:0/1663893939 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f537800be90 con 0x7f5388102770 2024-02-16T22:10:26.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.208+0000 7f5386ffd700 1 -- 172.21.15.134:0/1663893939 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53780103c0 con 0x7f5388102770 2024-02-16T22:10:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.209+0000 7f538e8ed700 1 -- 172.21.15.134:0/1663893939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5388102770 msgr2=0x7f5388102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.209+0000 7f538e8ed700 1 --2- 172.21.15.134:0/1663893939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5388102770 0x7f5388102b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f53780098e0 tx=0x7f5378009250 comp rx=0 tx=0).stop 2024-02-16T22:10:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.209+0000 7f538e8ed700 1 -- 172.21.15.134:0/1663893939 shutdown_connections 2024-02-16T22:10:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.209+0000 7f538e8ed700 1 --2- 172.21.15.134:0/1663893939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5388102770 0x7f5388102b80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.209+0000 7f538e8ed700 1 -- 172.21.15.134:0/1663893939 >> 172.21.15.134:0/1663893939 conn(0x7f53880fded0 msgr2=0x7f5388100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.209+0000 7f538e8ed700 1 -- 172.21.15.134:0/1663893939 shutdown_connections 2024-02-16T22:10:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.209+0000 7f538e8ed700 1 -- 172.21.15.134:0/1663893939 wait complete. 2024-02-16T22:10:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.209+0000 7f538e8ed700 1 Processor -- start 2024-02-16T22:10:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.209+0000 7f538e8ed700 1 -- start start 2024-02-16T22:10:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.210+0000 7f538e8ed700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5388102770 0x7f5388078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.210+0000 7f538e8ed700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5388077190 con 0x7f5388102770 2024-02-16T22:10:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.210+0000 7f5387fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5388102770 0x7f5388078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.210+0000 7f5387fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5388102770 0x7f5388078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45364/0 (socket says 172.21.15.134:45364) 2024-02-16T22:10:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.210+0000 7f5387fff700 1 -- 172.21.15.134:0/3220359808 learned_addr learned my addr 172.21.15.134:0/3220359808 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.210+0000 7f5387fff700 1 -- 172.21.15.134:0/3220359808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53780094f0 con 0x7f5388102770 2024-02-16T22:10:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.210+0000 7f5387fff700 1 --2- 172.21.15.134:0/3220359808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5388102770 0x7f5388078d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5378006b00 tx=0x7f5378009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.210+0000 7f5384ff9700 1 -- 172.21.15.134:0/3220359808 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53780109a0 con 0x7f5388102770 2024-02-16T22:10:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.210+0000 7f5384ff9700 1 -- 172.21.15.134:0/3220359808 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f537801a430 con 0x7f5388102770 2024-02-16T22:10:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.210+0000 7f5384ff9700 1 -- 172.21.15.134:0/3220359808 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53780245b0 con 0x7f5388102770 2024-02-16T22:10:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.210+0000 7f538e8ed700 1 -- 172.21.15.134:0/3220359808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5388077390 con 0x7f5388102770 2024-02-16T22:10:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.210+0000 7f538e8ed700 1 -- 172.21.15.134:0/3220359808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5388077820 con 0x7f5388102770 2024-02-16T22:10:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.211+0000 7f5384ff9700 1 -- 172.21.15.134:0/3220359808 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f53780247e0 con 0x7f5388102770 2024-02-16T22:10:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.211+0000 7f5384ff9700 1 --2- 172.21.15.134:0/3220359808 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f5370036830 0x7f5370038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.211+0000 7f5384ff9700 1 -- 172.21.15.134:0/3220359808 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f537804a6c0 con 0x7f5388102770 2024-02-16T22:10:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.211+0000 7f53877fe700 1 -- 172.21.15.134:0/3220359808 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f5370036830 msgr2=0x7f5370038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3520115315 2024-02-16T22:10:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.211+0000 7f53877fe700 1 --2- 172.21.15.134:0/3220359808 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f5370036830 0x7f5370038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T22:10:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.212+0000 7f538e8ed700 1 -- 172.21.15.134:0/3220359808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538805f5c0 con 0x7f5388102770 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.216+0000 7f5384ff9700 1 -- 172.21.15.134:0/3220359808 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f53780189a0 con 0x7f5388102770 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.412+0000 7f53877fe700 1 -- 172.21.15.134:0/3220359808 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f5370036830 msgr2=0x7f5370038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3520115315 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.412+0000 7f53877fe700 1 --2- 172.21.15.134:0/3220359808 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f5370036830 0x7f5370038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.477+0000 7f538e8ed700 1 -- 172.21.15.134:0/3220359808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f5388077c20 con 0x7f5388102770 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.477+0000 7f5384ff9700 1 -- 172.21.15.134:0/3220359808 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f5378018350 con 0x7f5388102770 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.479+0000 7f538e8ed700 1 -- 172.21.15.134:0/3220359808 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f5370036830 msgr2=0x7f5370038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.479+0000 7f538e8ed700 1 --2- 172.21.15.134:0/3220359808 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f5370036830 0x7f5370038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.479+0000 7f538e8ed700 1 -- 172.21.15.134:0/3220359808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5388102770 msgr2=0x7f5388078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.479+0000 7f538e8ed700 1 --2- 172.21.15.134:0/3220359808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5388102770 0x7f5388078d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5378006b00 tx=0x7f5378009250 comp rx=0 tx=0).stop 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.479+0000 7f538e8ed700 1 -- 172.21.15.134:0/3220359808 shutdown_connections 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.479+0000 7f538e8ed700 1 --2- 172.21.15.134:0/3220359808 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f5370036830 0x7f5370038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.479+0000 7f538e8ed700 1 --2- 172.21.15.134:0/3220359808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5388102770 0x7f5388078d10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.479+0000 7f538e8ed700 1 -- 172.21.15.134:0/3220359808 >> 172.21.15.134:0/3220359808 conn(0x7f53880fded0 msgr2=0x7f53880fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.480+0000 7f538e8ed700 1 -- 172.21.15.134:0/3220359808 shutdown_connections 2024-02-16T22:10:26.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:25.480+0000 7f538e8ed700 1 -- 172.21.15.134:0/3220359808 wait complete. 2024-02-16T22:10:26.096 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for the mgr to restart... 2024-02-16T22:10:26.096 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mgr epoch 9... 2024-02-16T22:10:26.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:26 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/3220359808' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-16T22:10:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:30 smithi134 ceph-mon[28869]: Active manager daemon smithi134.ordace restarted 2024-02-16T22:10:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:30 smithi134 ceph-mon[28869]: Activating manager daemon smithi134.ordace 2024-02-16T22:10:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:30 smithi134 ceph-mon[28869]: osdmap e3: 0 total, 0 up, 0 in 2024-02-16T22:10:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:30 smithi134 ceph-mon[28869]: mgrmap e10: smithi134.ordace(active, starting, since 0.00387991s) 2024-02-16T22:10:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:30 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:10:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:30 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr metadata", "who": "smithi134.ordace", "id": "smithi134.ordace"}]: dispatch 2024-02-16T22:10:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:30 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-16T22:10:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:30 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-16T22:10:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:30 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-16T22:10:31.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:30 smithi134 ceph-mon[28869]: Manager daemon smithi134.ordace is now available 2024-02-16T22:10:31.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:30 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:10:31.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:30 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:10:32.091 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:31 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/mirror_snapshot_schedule"}]: dispatch 2024-02-16T22:10:32.092 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:31 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/trash_purge_schedule"}]: dispatch 2024-02-16T22:10:32.092 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:31 smithi134 ceph-mon[28869]: mgrmap e11: smithi134.ordace(active, since 1.00616s) 2024-02-16T22:10:32.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-02-16T22:10:32.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-16T22:10:32.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-16T22:10:32.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-02-16T22:10:32.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.548+0000 7f07ad43a700 1 Processor -- start 2024-02-16T22:10:32.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.548+0000 7f07ad43a700 1 -- start start 2024-02-16T22:10:32.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.548+0000 7f07ad43a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a8102770 0x7f07a8102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:32.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.548+0000 7f07ad43a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a81030c0 con 0x7f07a8102770 2024-02-16T22:10:32.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.549+0000 7f07a6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a8102770 0x7f07a8102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:32.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.549+0000 7f07a6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a8102770 0x7f07a8102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45374/0 (socket says 172.21.15.134:45374) 2024-02-16T22:10:32.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.549+0000 7f07a6ffd700 1 -- 172.21.15.134:0/922303839 learned_addr learned my addr 172.21.15.134:0/922303839 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.549+0000 7f07a6ffd700 1 -- 172.21.15.134:0/922303839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a8103200 con 0x7f07a8102770 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.549+0000 7f07a6ffd700 1 --2- 172.21.15.134:0/922303839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a8102770 0x7f07a8102b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f07980098e0 tx=0x7f0798009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d019ddfd642facf server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.549+0000 7f07a5ffb700 1 -- 172.21.15.134:0/922303839 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f079800b860 con 0x7f07a8102770 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.549+0000 7f07a5ffb700 1 -- 172.21.15.134:0/922303839 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f079800be90 con 0x7f07a8102770 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.549+0000 7f07a5ffb700 1 -- 172.21.15.134:0/922303839 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07980103c0 con 0x7f07a8102770 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.550+0000 7f07ad43a700 1 -- 172.21.15.134:0/922303839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a8102770 msgr2=0x7f07a8102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.550+0000 7f07ad43a700 1 --2- 172.21.15.134:0/922303839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a8102770 0x7f07a8102b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f07980098e0 tx=0x7f0798009250 comp rx=0 tx=0).stop 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.550+0000 7f07ad43a700 1 -- 172.21.15.134:0/922303839 shutdown_connections 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.550+0000 7f07ad43a700 1 --2- 172.21.15.134:0/922303839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a8102770 0x7f07a8102b80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.550+0000 7f07ad43a700 1 -- 172.21.15.134:0/922303839 >> 172.21.15.134:0/922303839 conn(0x7f07a80fded0 msgr2=0x7f07a8100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.550+0000 7f07ad43a700 1 -- 172.21.15.134:0/922303839 shutdown_connections 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.550+0000 7f07ad43a700 1 -- 172.21.15.134:0/922303839 wait complete. 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.551+0000 7f07ad43a700 1 Processor -- start 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.551+0000 7f07ad43a700 1 -- start start 2024-02-16T22:10:32.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.551+0000 7f07ad43a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a8102770 0x7f07a81115b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:32.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.551+0000 7f07ad43a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a8111af0 con 0x7f07a8102770 2024-02-16T22:10:32.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.551+0000 7f07a6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a8102770 0x7f07a81115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:32.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.551+0000 7f07a6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a8102770 0x7f07a81115b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45386/0 (socket says 172.21.15.134:45386) 2024-02-16T22:10:32.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.551+0000 7f07a6ffd700 1 -- 172.21.15.134:0/3780358033 learned_addr learned my addr 172.21.15.134:0/3780358033 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:32.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.552+0000 7f07a6ffd700 1 -- 172.21.15.134:0/3780358033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07980094f0 con 0x7f07a8102770 2024-02-16T22:10:32.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.552+0000 7f07a6ffd700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a8102770 0x7f07a81115b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0798011680 tx=0x7f0798009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:32.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.552+0000 7f079f7fe700 1 -- 172.21.15.134:0/3780358033 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0798010890 con 0x7f07a8102770 2024-02-16T22:10:32.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.552+0000 7f079f7fe700 1 -- 172.21.15.134:0/3780358033 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0798010ec0 con 0x7f07a8102770 2024-02-16T22:10:32.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.552+0000 7f079f7fe700 1 -- 172.21.15.134:0/3780358033 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07980243f0 con 0x7f07a8102770 2024-02-16T22:10:32.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.552+0000 7f07ad43a700 1 -- 172.21.15.134:0/3780358033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a8111cf0 con 0x7f07a8102770 2024-02-16T22:10:32.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.552+0000 7f07ad43a700 1 -- 172.21.15.134:0/3780358033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a8112990 con 0x7f07a8102770 2024-02-16T22:10:32.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.553+0000 7f079f7fe700 1 -- 172.21.15.134:0/3780358033 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f079802d3f0 con 0x7f07a8102770 2024-02-16T22:10:32.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.553+0000 7f079f7fe700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0794036830 0x7f0794038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:32.395 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.553+0000 7f07ad43a700 1 -- 172.21.15.134:0/3780358033 --> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07a805f5c0 con 0x7f0794036830 2024-02-16T22:10:32.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.553+0000 7f079f7fe700 1 -- 172.21.15.134:0/3780358033 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f079804a2f0 con 0x7f07a8102770 2024-02-16T22:10:32.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.553+0000 7f07a67fc700 1 -- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0794036830 msgr2=0x7f0794038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3520115315 2024-02-16T22:10:32.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.553+0000 7f07a67fc700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0794036830 0x7f0794038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T22:10:32.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.754+0000 7f07a67fc700 1 -- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0794036830 msgr2=0x7f0794038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3520115315 2024-02-16T22:10:32.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:26.754+0000 7f07a67fc700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0794036830 0x7f0794038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-16T22:10:32.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:27.155+0000 7f07a67fc700 1 -- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0794036830 msgr2=0x7f0794038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3520115315 2024-02-16T22:10:32.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:27.155+0000 7f07a67fc700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0794036830 0x7f0794038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-16T22:10:32.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:27.956+0000 7f07a67fc700 1 -- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0794036830 msgr2=0x7f0794038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3520115315 2024-02-16T22:10:32.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:27.956+0000 7f07a67fc700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0794036830 0x7f0794038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-16T22:10:32.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:29.557+0000 7f07a67fc700 1 -- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0794036830 msgr2=0x7f0794038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3520115315 2024-02-16T22:10:32.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:29.557+0000 7f07a67fc700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0794036830 0x7f0794038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-16T22:10:32.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:30.768+0000 7f079f7fe700 1 -- 172.21.15.134:0/3780358033 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mgrmap(e 10) v1 ==== 43148+0+0 (secure 0 0 0) 0x7f079801a8c0 con 0x7f07a8102770 2024-02-16T22:10:32.396 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:30.769+0000 7f079f7fe700 1 -- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0794036830 msgr2=0x7f0794038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:30.769+0000 7f079f7fe700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0794036830 0x7f0794038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.769+0000 7f079f7fe700 1 -- 172.21.15.134:0/3780358033 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 11) v1 ==== 43275+0+0 (secure 0 0 0) 0x7f079802d6a0 con 0x7f07a8102770 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.770+0000 7f079f7fe700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f0794039ff0 0x7f079403c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.770+0000 7f079f7fe700 1 -- 172.21.15.134:0/3780358033 --> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07a805f5c0 con 0x7f0794039ff0 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.770+0000 7f07a67fc700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f0794039ff0 0x7f079403c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.771+0000 7f07a67fc700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f0794039ff0 0x7f079403c3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f07900039d0 tx=0x7f0790009350 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.771+0000 7f079f7fe700 1 -- 172.21.15.134:0/3780358033 <== mgr.14162 v2:172.21.15.134:6800/2987045407 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f07a805f5c0 con 0x7f0794039ff0 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.777+0000 7f07ad43a700 1 -- 172.21.15.134:0/3780358033 --> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f07a8112180 con 0x7f0794039ff0 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.777+0000 7f079f7fe700 1 -- 172.21.15.134:0/3780358033 <== mgr.14162 v2:172.21.15.134:6800/2987045407 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f07a8112180 con 0x7f0794039ff0 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.777+0000 7f07ad43a700 1 -- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f0794039ff0 msgr2=0x7f079403c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.778+0000 7f07ad43a700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f0794039ff0 0x7f079403c3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f07900039d0 tx=0x7f0790009350 comp rx=0 tx=0).stop 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.778+0000 7f07ad43a700 1 -- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a8102770 msgr2=0x7f07a81115b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.778+0000 7f07ad43a700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a8102770 0x7f07a81115b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0798011680 tx=0x7f0798009250 comp rx=0 tx=0).stop 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.778+0000 7f07ad43a700 1 -- 172.21.15.134:0/3780358033 shutdown_connections 2024-02-16T22:10:32.397 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.778+0000 7f07ad43a700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f0794039ff0 0x7f079403c3d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:32.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.778+0000 7f07ad43a700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a8102770 0x7f07a81115b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:32.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.778+0000 7f07ad43a700 1 --2- 172.21.15.134:0/3780358033 >> [v2:172.21.15.134:6800/3520115315,v1:172.21.15.134:6801/3520115315] conn(0x7f0794036830 0x7f0794038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:32.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.778+0000 7f07ad43a700 1 -- 172.21.15.134:0/3780358033 >> 172.21.15.134:0/3780358033 conn(0x7f07a80fded0 msgr2=0x7f07a80ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:32.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.778+0000 7f07ad43a700 1 -- 172.21.15.134:0/3780358033 shutdown_connections 2024-02-16T22:10:32.398 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:31.778+0000 7f07ad43a700 1 -- 172.21.15.134:0/3780358033 wait complete. 2024-02-16T22:10:32.398 INFO:teuthology.orchestra.run.smithi134.stdout:mgr epoch 9 is available 2024-02-16T22:10:32.398 INFO:teuthology.orchestra.run.smithi134.stdout:Generating a dashboard self-signed certificate... 2024-02-16T22:10:33.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:33 smithi134 ceph-mon[28869]: [16/Feb/2024:22:10:32] ENGINE Bus STARTING 2024-02-16T22:10:33.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:33 smithi134 ceph-mon[28869]: [16/Feb/2024:22:10:32] ENGINE Serving on https://172.21.15.134:7150 2024-02-16T22:10:33.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:33 smithi134 ceph-mon[28869]: [16/Feb/2024:22:10:32] ENGINE Bus STARTED 2024-02-16T22:10:33.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:33 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:33.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:33 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:33.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:33 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:33.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:33 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:33.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-16T22:10:33.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.841+0000 7fab46518700 1 Processor -- start 2024-02-16T22:10:33.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.841+0000 7fab46518700 1 -- start start 2024-02-16T22:10:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.841+0000 7fab46518700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab40076c20 0x7fab40105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.841+0000 7fab46518700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab401058c0 con 0x7fab40076c20 2024-02-16T22:10:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.841+0000 7fab3ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab40076c20 0x7fab40105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.841+0000 7fab3ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab40076c20 0x7fab40105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60680/0 (socket says 172.21.15.134:60680) 2024-02-16T22:10:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.841+0000 7fab3ffff700 1 -- 172.21.15.134:0/1906224121 learned_addr learned my addr 172.21.15.134:0/1906224121 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.842+0000 7fab3ffff700 1 -- 172.21.15.134:0/1906224121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40105a00 con 0x7fab40076c20 2024-02-16T22:10:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.842+0000 7fab3ffff700 1 --2- 172.21.15.134:0/1906224121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab40076c20 0x7fab40105380 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fab300098e0 tx=0x7fab30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c52ddcd3775bb9d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.842+0000 7fab3effd700 1 -- 172.21.15.134:0/1906224121 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab3000b860 con 0x7fab40076c20 2024-02-16T22:10:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.842+0000 7fab3effd700 1 -- 172.21.15.134:0/1906224121 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab3000be90 con 0x7fab40076c20 2024-02-16T22:10:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.842+0000 7fab3effd700 1 -- 172.21.15.134:0/1906224121 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab300103c0 con 0x7fab40076c20 2024-02-16T22:10:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.842+0000 7fab46518700 1 -- 172.21.15.134:0/1906224121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab40076c20 msgr2=0x7fab40105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.842+0000 7fab46518700 1 --2- 172.21.15.134:0/1906224121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab40076c20 0x7fab40105380 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fab300098e0 tx=0x7fab30009250 comp rx=0 tx=0).stop 2024-02-16T22:10:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.843+0000 7fab46518700 1 -- 172.21.15.134:0/1906224121 shutdown_connections 2024-02-16T22:10:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.843+0000 7fab46518700 1 --2- 172.21.15.134:0/1906224121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab40076c20 0x7fab40105380 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.843+0000 7fab46518700 1 -- 172.21.15.134:0/1906224121 >> 172.21.15.134:0/1906224121 conn(0x7fab400fcdd0 msgr2=0x7fab400ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.843+0000 7fab46518700 1 -- 172.21.15.134:0/1906224121 shutdown_connections 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.843+0000 7fab46518700 1 -- 172.21.15.134:0/1906224121 wait complete. 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.843+0000 7fab46518700 1 Processor -- start 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.843+0000 7fab46518700 1 -- start start 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.843+0000 7fab46518700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab40076c20 0x7fab40111870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.843+0000 7fab46518700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab40111db0 con 0x7fab40076c20 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.843+0000 7fab3ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab40076c20 0x7fab40111870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.843+0000 7fab3ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab40076c20 0x7fab40111870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60686/0 (socket says 172.21.15.134:60686) 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.843+0000 7fab3ffff700 1 -- 172.21.15.134:0/1316275111 learned_addr learned my addr 172.21.15.134:0/1316275111 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.844+0000 7fab3ffff700 1 -- 172.21.15.134:0/1316275111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab300094f0 con 0x7fab40076c20 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.844+0000 7fab3ffff700 1 --2- 172.21.15.134:0/1316275111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab40076c20 0x7fab40111870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fab30003080 tx=0x7fab30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.844+0000 7fab3cff9700 1 -- 172.21.15.134:0/1316275111 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab30011920 con 0x7fab40076c20 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.844+0000 7fab3cff9700 1 -- 172.21.15.134:0/1316275111 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab30010d60 con 0x7fab40076c20 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.844+0000 7fab46518700 1 -- 172.21.15.134:0/1316275111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab40111fb0 con 0x7fab40076c20 2024-02-16T22:10:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.844+0000 7fab3cff9700 1 -- 172.21.15.134:0/1316275111 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab300243f0 con 0x7fab40076c20 2024-02-16T22:10:33.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.844+0000 7fab46518700 1 -- 172.21.15.134:0/1316275111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab40112c50 con 0x7fab40076c20 2024-02-16T22:10:33.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.845+0000 7fab3cff9700 1 -- 172.21.15.134:0/1316275111 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) v1 ==== 43275+0+0 (secure 0 0 0) 0x7fab3002d3f0 con 0x7fab40076c20 2024-02-16T22:10:33.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.845+0000 7fab3cff9700 1 --2- 172.21.15.134:0/1316275111 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fab280366b0 0x7fab28038b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:33.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.845+0000 7fab3cff9700 1 -- 172.21.15.134:0/1316275111 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fab3004a360 con 0x7fab40076c20 2024-02-16T22:10:33.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.845+0000 7fab3f7fe700 1 --2- 172.21.15.134:0/1316275111 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fab280366b0 0x7fab28038b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:33.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.845+0000 7fab46518700 1 -- 172.21.15.134:0/1316275111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab40112440 con 0x7fab40076c20 2024-02-16T22:10:33.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.845+0000 7fab3f7fe700 1 --2- 172.21.15.134:0/1316275111 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fab280366b0 0x7fab28038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fab34009990 tx=0x7fab34006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:33.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:32.850+0000 7fab3cff9700 1 -- 172.21.15.134:0/1316275111 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fab3002b8e0 con 0x7fab40076c20 2024-02-16T22:10:33.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:33.092+0000 7fab46518700 1 -- 172.21.15.134:0/1316275111 --> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fab40106850 con 0x7fab280366b0 2024-02-16T22:10:33.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:33.171+0000 7fab3cff9700 1 -- 172.21.15.134:0/1316275111 <== mgr.14162 v2:172.21.15.134:6800/2987045407 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fab40106850 con 0x7fab280366b0 2024-02-16T22:10:33.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:33.174+0000 7fab46518700 1 -- 172.21.15.134:0/1316275111 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fab280366b0 msgr2=0x7fab28038b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:33.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:33.174+0000 7fab46518700 1 --2- 172.21.15.134:0/1316275111 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fab280366b0 0x7fab28038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fab34009990 tx=0x7fab34006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:33.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:33.174+0000 7fab46518700 1 -- 172.21.15.134:0/1316275111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab40076c20 msgr2=0x7fab40111870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:33.678 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:33.174+0000 7fab46518700 1 --2- 172.21.15.134:0/1316275111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab40076c20 0x7fab40111870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fab30003080 tx=0x7fab30009250 comp rx=0 tx=0).stop 2024-02-16T22:10:33.678 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:33.174+0000 7fab46518700 1 -- 172.21.15.134:0/1316275111 shutdown_connections 2024-02-16T22:10:33.678 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:33.174+0000 7fab46518700 1 --2- 172.21.15.134:0/1316275111 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fab280366b0 0x7fab28038b60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:33.678 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:33.174+0000 7fab46518700 1 --2- 172.21.15.134:0/1316275111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab40076c20 0x7fab40111870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:33.678 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:33.174+0000 7fab46518700 1 -- 172.21.15.134:0/1316275111 >> 172.21.15.134:0/1316275111 conn(0x7fab400fcdd0 msgr2=0x7fab400fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:33.678 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:33.174+0000 7fab46518700 1 -- 172.21.15.134:0/1316275111 shutdown_connections 2024-02-16T22:10:33.678 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:33.174+0000 7fab46518700 1 -- 172.21.15.134:0/1316275111 wait complete. 2024-02-16T22:10:33.678 INFO:teuthology.orchestra.run.smithi134.stdout:Creating initial admin user... 2024-02-16T22:10:34.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:34 smithi134 ceph-mon[28869]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:34.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:34 smithi134 ceph-mon[28869]: mgrmap e12: smithi134.ordace(active, since 2s) 2024-02-16T22:10:34.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:34 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:35.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$U78UdbznLi9SUm8irRDf3OXz3a3Pw.yIabbk5uxGhD6vZ3FUC9AdK", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1708121434, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-16T22:10:35.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.097+0000 7ff282a9b700 1 Processor -- start 2024-02-16T22:10:35.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.097+0000 7ff282a9b700 1 -- start start 2024-02-16T22:10:35.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.097+0000 7ff282a9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c076c60 0x7ff27c103130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:35.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.097+0000 7ff282a9b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c103670 con 0x7ff27c076c60 2024-02-16T22:10:35.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.097+0000 7ff280837700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c076c60 0x7ff27c103130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:35.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.097+0000 7ff280837700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c076c60 0x7ff27c103130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60688/0 (socket says 172.21.15.134:60688) 2024-02-16T22:10:35.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.097+0000 7ff280837700 1 -- 172.21.15.134:0/3096672926 learned_addr learned my addr 172.21.15.134:0/3096672926 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:35.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.097+0000 7ff280837700 1 -- 172.21.15.134:0/3096672926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c1037b0 con 0x7ff27c076c60 2024-02-16T22:10:35.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.097+0000 7ff280837700 1 --2- 172.21.15.134:0/3096672926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c076c60 0x7ff27c103130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff2700098e0 tx=0x7ff270009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe85e1b81538800c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:35.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.098+0000 7ff27b7fe700 1 -- 172.21.15.134:0/3096672926 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff27000b860 con 0x7ff27c076c60 2024-02-16T22:10:35.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.098+0000 7ff27b7fe700 1 -- 172.21.15.134:0/3096672926 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff27000be90 con 0x7ff27c076c60 2024-02-16T22:10:35.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.098+0000 7ff27b7fe700 1 -- 172.21.15.134:0/3096672926 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2700103c0 con 0x7ff27c076c60 2024-02-16T22:10:35.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.098+0000 7ff282a9b700 1 -- 172.21.15.134:0/3096672926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c076c60 msgr2=0x7ff27c103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:35.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.098+0000 7ff282a9b700 1 --2- 172.21.15.134:0/3096672926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c076c60 0x7ff27c103130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff2700098e0 tx=0x7ff270009250 comp rx=0 tx=0).stop 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.098+0000 7ff282a9b700 1 -- 172.21.15.134:0/3096672926 shutdown_connections 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.098+0000 7ff282a9b700 1 --2- 172.21.15.134:0/3096672926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c076c60 0x7ff27c103130 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.098+0000 7ff282a9b700 1 -- 172.21.15.134:0/3096672926 >> 172.21.15.134:0/3096672926 conn(0x7ff27c0fcdd0 msgr2=0x7ff27c0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.098+0000 7ff282a9b700 1 -- 172.21.15.134:0/3096672926 shutdown_connections 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.098+0000 7ff282a9b700 1 -- 172.21.15.134:0/3096672926 wait complete. 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.099+0000 7ff282a9b700 1 Processor -- start 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.099+0000 7ff282a9b700 1 -- start start 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.099+0000 7ff282a9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c076c60 0x7ff27c117b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.099+0000 7ff282a9b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c1180a0 con 0x7ff27c076c60 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.099+0000 7ff280837700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c076c60 0x7ff27c117b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.099+0000 7ff280837700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c076c60 0x7ff27c117b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60702/0 (socket says 172.21.15.134:60702) 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.099+0000 7ff280837700 1 -- 172.21.15.134:0/3351946840 learned_addr learned my addr 172.21.15.134:0/3351946840 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.100+0000 7ff280837700 1 -- 172.21.15.134:0/3351946840 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2700094f0 con 0x7ff27c076c60 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.100+0000 7ff280837700 1 --2- 172.21.15.134:0/3351946840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c076c60 0x7ff27c117b60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2700090b0 tx=0x7ff270009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:35.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.100+0000 7ff2797fa700 1 -- 172.21.15.134:0/3351946840 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2700118f0 con 0x7ff27c076c60 2024-02-16T22:10:35.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.100+0000 7ff2797fa700 1 -- 172.21.15.134:0/3351946840 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff270010d10 con 0x7ff27c076c60 2024-02-16T22:10:35.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.100+0000 7ff282a9b700 1 -- 172.21.15.134:0/3351946840 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27c1182a0 con 0x7ff27c076c60 2024-02-16T22:10:35.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.100+0000 7ff2797fa700 1 -- 172.21.15.134:0/3351946840 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff270024e70 con 0x7ff27c076c60 2024-02-16T22:10:35.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.100+0000 7ff282a9b700 1 -- 172.21.15.134:0/3351946840 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27c118f40 con 0x7ff27c076c60 2024-02-16T22:10:35.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.101+0000 7ff2797fa700 1 -- 172.21.15.134:0/3351946840 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7ff27001a550 con 0x7ff27c076c60 2024-02-16T22:10:35.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.101+0000 7ff282a9b700 1 -- 172.21.15.134:0/3351946840 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27c05f5c0 con 0x7ff27c076c60 2024-02-16T22:10:35.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.101+0000 7ff2797fa700 1 --2- 172.21.15.134:0/3351946840 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff26c036790 0x7ff26c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:35.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.101+0000 7ff2797fa700 1 -- 172.21.15.134:0/3351946840 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff27004a6b0 con 0x7ff27c076c60 2024-02-16T22:10:35.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.101+0000 7ff27bfff700 1 --2- 172.21.15.134:0/3351946840 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff26c036790 0x7ff26c038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:35.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.102+0000 7ff27bfff700 1 --2- 172.21.15.134:0/3351946840 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff26c036790 0x7ff26c038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff268009990 tx=0x7ff268006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:35.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.106+0000 7ff2797fa700 1 -- 172.21.15.134:0/3351946840 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff270018db0 con 0x7ff27c076c60 2024-02-16T22:10:35.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.318+0000 7ff282a9b700 1 -- 172.21.15.134:0/3351946840 --> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ff27c05f3e0 con 0x7ff26c036790 2024-02-16T22:10:35.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.541+0000 7ff2797fa700 1 -- 172.21.15.134:0/3351946840 <== mgr.14162 v2:172.21.15.134:6800/2987045407 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7ff27c05f3e0 con 0x7ff26c036790 2024-02-16T22:10:35.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.544+0000 7ff282a9b700 1 -- 172.21.15.134:0/3351946840 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff26c036790 msgr2=0x7ff26c038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:35.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.544+0000 7ff282a9b700 1 --2- 172.21.15.134:0/3351946840 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff26c036790 0x7ff26c038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff268009990 tx=0x7ff268006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:35.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.544+0000 7ff282a9b700 1 -- 172.21.15.134:0/3351946840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c076c60 msgr2=0x7ff27c117b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:35.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.544+0000 7ff282a9b700 1 --2- 172.21.15.134:0/3351946840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c076c60 0x7ff27c117b60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2700090b0 tx=0x7ff270009250 comp rx=0 tx=0).stop 2024-02-16T22:10:35.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.544+0000 7ff282a9b700 1 -- 172.21.15.134:0/3351946840 shutdown_connections 2024-02-16T22:10:35.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.544+0000 7ff282a9b700 1 --2- 172.21.15.134:0/3351946840 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff26c036790 0x7ff26c038c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:35.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.544+0000 7ff282a9b700 1 --2- 172.21.15.134:0/3351946840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c076c60 0x7ff27c117b60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:35.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.544+0000 7ff282a9b700 1 -- 172.21.15.134:0/3351946840 >> 172.21.15.134:0/3351946840 conn(0x7ff27c0fcdd0 msgr2=0x7ff27c106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:35.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.544+0000 7ff282a9b700 1 -- 172.21.15.134:0/3351946840 shutdown_connections 2024-02-16T22:10:35.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:34.544+0000 7ff282a9b700 1 -- 172.21.15.134:0/3351946840 wait complete. 2024-02-16T22:10:35.792 INFO:teuthology.orchestra.run.smithi134.stdout:Fetching dashboard port number... 2024-02-16T22:10:35.911 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:35 smithi134 ceph-mon[28869]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:35.911 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:35 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:37.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 8443 2024-02-16T22:10:37.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.294+0000 7fbeab95a700 1 Processor -- start 2024-02-16T22:10:37.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.294+0000 7fbeab95a700 1 -- start start 2024-02-16T22:10:37.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.295+0000 7fbeab95a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4076c40 0x7fbea4105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:37.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.295+0000 7fbeab95a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea41058a0 con 0x7fbea4076c40 2024-02-16T22:10:37.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.295+0000 7fbea96f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4076c40 0x7fbea4105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:37.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.295+0000 7fbea96f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4076c40 0x7fbea4105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60704/0 (socket says 172.21.15.134:60704) 2024-02-16T22:10:37.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.295+0000 7fbea96f6700 1 -- 172.21.15.134:0/2641875723 learned_addr learned my addr 172.21.15.134:0/2641875723 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:37.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.295+0000 7fbea96f6700 1 -- 172.21.15.134:0/2641875723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea41059e0 con 0x7fbea4076c40 2024-02-16T22:10:37.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.295+0000 7fbea96f6700 1 --2- 172.21.15.134:0/2641875723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4076c40 0x7fbea4105360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbe980098e0 tx=0x7fbe98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc06ab4643b00f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:37.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.295+0000 7fbe97fff700 1 -- 172.21.15.134:0/2641875723 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe9800b860 con 0x7fbea4076c40 2024-02-16T22:10:37.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.295+0000 7fbe97fff700 1 -- 172.21.15.134:0/2641875723 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe9800be90 con 0x7fbea4076c40 2024-02-16T22:10:37.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.295+0000 7fbe97fff700 1 -- 172.21.15.134:0/2641875723 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe980103c0 con 0x7fbea4076c40 2024-02-16T22:10:37.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.296+0000 7fbeab95a700 1 -- 172.21.15.134:0/2641875723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4076c40 msgr2=0x7fbea4105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:37.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.296+0000 7fbeab95a700 1 --2- 172.21.15.134:0/2641875723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4076c40 0x7fbea4105360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbe980098e0 tx=0x7fbe98009250 comp rx=0 tx=0).stop 2024-02-16T22:10:37.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.296+0000 7fbeab95a700 1 -- 172.21.15.134:0/2641875723 shutdown_connections 2024-02-16T22:10:37.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.296+0000 7fbeab95a700 1 --2- 172.21.15.134:0/2641875723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4076c40 0x7fbea4105360 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:37.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.296+0000 7fbeab95a700 1 -- 172.21.15.134:0/2641875723 >> 172.21.15.134:0/2641875723 conn(0x7fbea40fcdd0 msgr2=0x7fbea40ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:37.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.296+0000 7fbeab95a700 1 -- 172.21.15.134:0/2641875723 shutdown_connections 2024-02-16T22:10:37.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.296+0000 7fbeab95a700 1 -- 172.21.15.134:0/2641875723 wait complete. 2024-02-16T22:10:37.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.297+0000 7fbeab95a700 1 Processor -- start 2024-02-16T22:10:37.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.297+0000 7fbeab95a700 1 -- start start 2024-02-16T22:10:37.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.297+0000 7fbeab95a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4076c40 0x7fbea4111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:37.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.297+0000 7fbeab95a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea4111aa0 con 0x7fbea4076c40 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.297+0000 7fbea96f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4076c40 0x7fbea4111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.297+0000 7fbea96f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4076c40 0x7fbea4111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60718/0 (socket says 172.21.15.134:60718) 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.297+0000 7fbea96f6700 1 -- 172.21.15.134:0/3837480701 learned_addr learned my addr 172.21.15.134:0/3837480701 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.297+0000 7fbea96f6700 1 -- 172.21.15.134:0/3837480701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe980094f0 con 0x7fbea4076c40 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.297+0000 7fbea96f6700 1 --2- 172.21.15.134:0/3837480701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4076c40 0x7fbea4111560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbe98003080 tx=0x7fbe98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.298+0000 7fbe95ffb700 1 -- 172.21.15.134:0/3837480701 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe98011920 con 0x7fbea4076c40 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.298+0000 7fbe95ffb700 1 -- 172.21.15.134:0/3837480701 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe98010d60 con 0x7fbea4076c40 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.298+0000 7fbeab95a700 1 -- 172.21.15.134:0/3837480701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea4111ca0 con 0x7fbea4076c40 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.298+0000 7fbe95ffb700 1 -- 172.21.15.134:0/3837480701 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe980243f0 con 0x7fbea4076c40 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.298+0000 7fbeab95a700 1 -- 172.21.15.134:0/3837480701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea4112940 con 0x7fbea4076c40 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.298+0000 7fbe95ffb700 1 -- 172.21.15.134:0/3837480701 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7fbe9802d3f0 con 0x7fbea4076c40 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.299+0000 7fbeab95a700 1 -- 172.21.15.134:0/3837480701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea405f5c0 con 0x7fbea4076c40 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.299+0000 7fbe95ffb700 1 --2- 172.21.15.134:0/3837480701 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fbe900367e0 0x7fbe90038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.299+0000 7fbe95ffb700 1 -- 172.21.15.134:0/3837480701 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbe9804a690 con 0x7fbea4076c40 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.299+0000 7fbea8ef5700 1 --2- 172.21.15.134:0/3837480701 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fbe900367e0 0x7fbe90038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:37.055 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.299+0000 7fbea8ef5700 1 --2- 172.21.15.134:0/3837480701 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fbe900367e0 0x7fbe90038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009990 tx=0x7fbea0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:37.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.303+0000 7fbe95ffb700 1 -- 172.21.15.134:0/3837480701 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fbe980193c0 con 0x7fbea4076c40 2024-02-16T22:10:37.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.487+0000 7fbeab95a700 1 -- 172.21.15.134:0/3837480701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fbea404bed0 con 0x7fbea4076c40 2024-02-16T22:10:37.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.487+0000 7fbe95ffb700 1 -- 172.21.15.134:0/3837480701 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fbe98009350 con 0x7fbea4076c40 2024-02-16T22:10:37.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.489+0000 7fbeab95a700 1 -- 172.21.15.134:0/3837480701 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fbe900367e0 msgr2=0x7fbe90038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:37.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.489+0000 7fbeab95a700 1 --2- 172.21.15.134:0/3837480701 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fbe900367e0 0x7fbe90038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009990 tx=0x7fbea0006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:37.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.489+0000 7fbeab95a700 1 -- 172.21.15.134:0/3837480701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4076c40 msgr2=0x7fbea4111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:37.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.489+0000 7fbeab95a700 1 --2- 172.21.15.134:0/3837480701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4076c40 0x7fbea4111560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbe98003080 tx=0x7fbe98009250 comp rx=0 tx=0).stop 2024-02-16T22:10:37.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.489+0000 7fbeab95a700 1 -- 172.21.15.134:0/3837480701 shutdown_connections 2024-02-16T22:10:37.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.489+0000 7fbeab95a700 1 --2- 172.21.15.134:0/3837480701 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fbe900367e0 0x7fbe90038c90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:37.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.489+0000 7fbeab95a700 1 --2- 172.21.15.134:0/3837480701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4076c40 0x7fbea4111560 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:37.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.489+0000 7fbeab95a700 1 -- 172.21.15.134:0/3837480701 >> 172.21.15.134:0/3837480701 conn(0x7fbea40fcdd0 msgr2=0x7fbea40fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:37.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.489+0000 7fbeab95a700 1 -- 172.21.15.134:0/3837480701 shutdown_connections 2024-02-16T22:10:37.056 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:36.490+0000 7fbeab95a700 1 -- 172.21.15.134:0/3837480701 wait complete. 2024-02-16T22:10:37.060 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-16T22:10:37.060 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout disabled 2024-02-16T22:10:37.067 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-16T22:10:37.067 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-02-16T22:10:37.067 INFO:teuthology.orchestra.run.smithi134.stdout:firewalld.service is not enabled 2024-02-16T22:10:37.067 INFO:teuthology.orchestra.run.smithi134.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-16T22:10:37.069 INFO:teuthology.orchestra.run.smithi134.stdout:Ceph Dashboard is now available at: 2024-02-16T22:10:37.069 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:10:37.069 INFO:teuthology.orchestra.run.smithi134.stdout: URL: https://smithi134.front.sepia.ceph.com:8443/ 2024-02-16T22:10:37.069 INFO:teuthology.orchestra.run.smithi134.stdout: User: admin 2024-02-16T22:10:37.069 INFO:teuthology.orchestra.run.smithi134.stdout: Password: 637esolqpa 2024-02-16T22:10:37.069 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:10:37.070 INFO:teuthology.orchestra.run.smithi134.stdout:Saving cluster configuration to /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config directory 2024-02-16T22:10:37.070 INFO:teuthology.orchestra.run.smithi134.stdout:Enabling autotune for osd_memory_target 2024-02-16T22:10:37.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:37 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/3837480701' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-16T22:10:38.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.456+0000 7f159e68a700 1 Processor -- start 2024-02-16T22:10:38.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.456+0000 7f159e68a700 1 -- start start 2024-02-16T22:10:38.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.456+0000 7f159e68a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1598102c60 0x7f1598103070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:38.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.456+0000 7f159e68a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15981035b0 con 0x7f1598102c60 2024-02-16T22:10:38.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.456+0000 7f1597fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1598102c60 0x7f1598103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:38.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.456+0000 7f1597fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1598102c60 0x7f1598103070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60730/0 (socket says 172.21.15.134:60730) 2024-02-16T22:10:38.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.456+0000 7f1597fff700 1 -- 172.21.15.134:0/4178253472 learned_addr learned my addr 172.21.15.134:0/4178253472 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:38.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.456+0000 7f1597fff700 1 -- 172.21.15.134:0/4178253472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15981036f0 con 0x7f1598102c60 2024-02-16T22:10:38.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.457+0000 7f1597fff700 1 --2- 172.21.15.134:0/4178253472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1598102c60 0x7f1598103070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f15880098e0 tx=0x7f1588009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3916e7abb92cb994 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:38.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.457+0000 7f1596ffd700 1 -- 172.21.15.134:0/4178253472 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f158800b860 con 0x7f1598102c60 2024-02-16T22:10:38.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.457+0000 7f1596ffd700 1 -- 172.21.15.134:0/4178253472 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f158800be90 con 0x7f1598102c60 2024-02-16T22:10:38.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.457+0000 7f1596ffd700 1 -- 172.21.15.134:0/4178253472 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15880103c0 con 0x7f1598102c60 2024-02-16T22:10:38.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.457+0000 7f159e68a700 1 -- 172.21.15.134:0/4178253472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1598102c60 msgr2=0x7f1598103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:38.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.457+0000 7f159e68a700 1 --2- 172.21.15.134:0/4178253472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1598102c60 0x7f1598103070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f15880098e0 tx=0x7f1588009250 comp rx=0 tx=0).stop 2024-02-16T22:10:38.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.457+0000 7f159e68a700 1 -- 172.21.15.134:0/4178253472 shutdown_connections 2024-02-16T22:10:38.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.457+0000 7f159e68a700 1 --2- 172.21.15.134:0/4178253472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1598102c60 0x7f1598103070 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:38.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.457+0000 7f159e68a700 1 -- 172.21.15.134:0/4178253472 >> 172.21.15.134:0/4178253472 conn(0x7f15980fc580 msgr2=0x7f15980fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.457+0000 7f159e68a700 1 -- 172.21.15.134:0/4178253472 shutdown_connections 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.457+0000 7f159e68a700 1 -- 172.21.15.134:0/4178253472 wait complete. 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.458+0000 7f159e68a700 1 Processor -- start 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.458+0000 7f159e68a700 1 -- start start 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.458+0000 7f159e68a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1598102c60 0x7f1598114580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.458+0000 7f159e68a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1598101540 con 0x7f1598102c60 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.458+0000 7f1597fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1598102c60 0x7f1598114580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.458+0000 7f1597fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1598102c60 0x7f1598114580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60736/0 (socket says 172.21.15.134:60736) 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.458+0000 7f1597fff700 1 -- 172.21.15.134:0/1789693738 learned_addr learned my addr 172.21.15.134:0/1789693738 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.459+0000 7f1597fff700 1 -- 172.21.15.134:0/1789693738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15880094f0 con 0x7f1598102c60 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.459+0000 7f1597fff700 1 --2- 172.21.15.134:0/1789693738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1598102c60 0x7f1598114580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1588011650 tx=0x7f1588009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.459+0000 7f1594ff9700 1 -- 172.21.15.134:0/1789693738 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1588010890 con 0x7f1598102c60 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.459+0000 7f1594ff9700 1 -- 172.21.15.134:0/1789693738 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1588010ec0 con 0x7f1598102c60 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.459+0000 7f159e68a700 1 -- 172.21.15.134:0/1789693738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1598101740 con 0x7f1598102c60 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.459+0000 7f1594ff9700 1 -- 172.21.15.134:0/1789693738 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f158801a430 con 0x7f1598102c60 2024-02-16T22:10:38.235 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.459+0000 7f159e68a700 1 -- 172.21.15.134:0/1789693738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1598114c80 con 0x7f1598102c60 2024-02-16T22:10:38.236 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.460+0000 7f1594ff9700 1 -- 172.21.15.134:0/1789693738 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f158801a6b0 con 0x7f1598102c60 2024-02-16T22:10:38.236 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.460+0000 7f159e68a700 1 -- 172.21.15.134:0/1789693738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159810a570 con 0x7f1598102c60 2024-02-16T22:10:38.236 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.460+0000 7f1594ff9700 1 --2- 172.21.15.134:0/1789693738 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f1580036880 0x7f1580038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:38.236 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.460+0000 7f1594ff9700 1 -- 172.21.15.134:0/1789693738 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f158804a700 con 0x7f1598102c60 2024-02-16T22:10:38.236 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.460+0000 7f15977fe700 1 --2- 172.21.15.134:0/1789693738 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f1580036880 0x7f1580038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:38.236 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.460+0000 7f15977fe700 1 --2- 172.21.15.134:0/1789693738 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f1580036880 0x7f1580038d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f158c009990 tx=0x7f158c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:38.236 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.465+0000 7f1594ff9700 1 -- 172.21.15.134:0/1789693738 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1588018db0 con 0x7f1598102c60 2024-02-16T22:10:38.236 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.648+0000 7f159e68a700 1 -- 172.21.15.134:0/1789693738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f1598102660 con 0x7f1598102c60 2024-02-16T22:10:38.236 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.648+0000 7f1594ff9700 1 -- 172.21.15.134:0/1789693738 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f1588018350 con 0x7f1598102c60 2024-02-16T22:10:38.236 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.650+0000 7f159e68a700 1 -- 172.21.15.134:0/1789693738 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f1580036880 msgr2=0x7f1580038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:38.236 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.650+0000 7f159e68a700 1 --2- 172.21.15.134:0/1789693738 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f1580036880 0x7f1580038d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f158c009990 tx=0x7f158c006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:38.236 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.650+0000 7f159e68a700 1 -- 172.21.15.134:0/1789693738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1598102c60 msgr2=0x7f1598114580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:38.236 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.650+0000 7f159e68a700 1 --2- 172.21.15.134:0/1789693738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1598102c60 0x7f1598114580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1588011650 tx=0x7f1588009250 comp rx=0 tx=0).stop 2024-02-16T22:10:38.237 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.651+0000 7f159e68a700 1 -- 172.21.15.134:0/1789693738 shutdown_connections 2024-02-16T22:10:38.237 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.651+0000 7f159e68a700 1 --2- 172.21.15.134:0/1789693738 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f1580036880 0x7f1580038d30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:38.237 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.651+0000 7f159e68a700 1 --2- 172.21.15.134:0/1789693738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1598102c60 0x7f1598114580 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:38.237 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.651+0000 7f159e68a700 1 -- 172.21.15.134:0/1789693738 >> 172.21.15.134:0/1789693738 conn(0x7f15980fc580 msgr2=0x7f15980fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:38.237 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.651+0000 7f159e68a700 1 -- 172.21.15.134:0/1789693738 shutdown_connections 2024-02-16T22:10:38.237 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:37.651+0000 7f159e68a700 1 -- 172.21.15.134:0/1789693738 wait complete. 2024-02-16T22:10:38.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:38 smithi134 ceph-mon[28869]: mgrmap e13: smithi134.ordace(active, since 6s) 2024-02-16T22:10:39.557 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.665+0000 7fed52542700 1 Processor -- start 2024-02-16T22:10:39.558 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.665+0000 7fed52542700 1 -- start start 2024-02-16T22:10:39.558 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.665+0000 7fed52542700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed4c078ce0 0x7fed4c0771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:39.558 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.665+0000 7fed52542700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0790f0 con 0x7fed4c078ce0 2024-02-16T22:10:39.558 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.665+0000 7fed4bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed4c078ce0 0x7fed4c0771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:39.558 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.665+0000 7fed4bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed4c078ce0 0x7fed4c0771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60738/0 (socket says 172.21.15.134:60738) 2024-02-16T22:10:39.558 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.665+0000 7fed4bfff700 1 -- 172.21.15.134:0/3853647210 learned_addr learned my addr 172.21.15.134:0/3853647210 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:39.558 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.665+0000 7fed4bfff700 1 -- 172.21.15.134:0/3853647210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c077730 con 0x7fed4c078ce0 2024-02-16T22:10:39.558 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.666+0000 7fed4bfff700 1 --2- 172.21.15.134:0/3853647210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed4c078ce0 0x7fed4c0771f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0098e0 tx=0x7fed3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3b62a040a314f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:39.558 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.666+0000 7fed4affd700 1 -- 172.21.15.134:0/3853647210 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed3c00b860 con 0x7fed4c078ce0 2024-02-16T22:10:39.558 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.666+0000 7fed4affd700 1 -- 172.21.15.134:0/3853647210 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed3c00be90 con 0x7fed4c078ce0 2024-02-16T22:10:39.558 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.666+0000 7fed4affd700 1 -- 172.21.15.134:0/3853647210 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed3c0103c0 con 0x7fed4c078ce0 2024-02-16T22:10:39.558 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.666+0000 7fed52542700 1 -- 172.21.15.134:0/3853647210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed4c078ce0 msgr2=0x7fed4c0771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:39.558 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.666+0000 7fed52542700 1 --2- 172.21.15.134:0/3853647210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed4c078ce0 0x7fed4c0771f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0098e0 tx=0x7fed3c009250 comp rx=0 tx=0).stop 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.666+0000 7fed52542700 1 -- 172.21.15.134:0/3853647210 shutdown_connections 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.666+0000 7fed52542700 1 --2- 172.21.15.134:0/3853647210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed4c078ce0 0x7fed4c0771f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.666+0000 7fed52542700 1 -- 172.21.15.134:0/3853647210 >> 172.21.15.134:0/3853647210 conn(0x7fed4c0fded0 msgr2=0x7fed4c100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.666+0000 7fed52542700 1 -- 172.21.15.134:0/3853647210 shutdown_connections 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.666+0000 7fed52542700 1 -- 172.21.15.134:0/3853647210 wait complete. 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.667+0000 7fed52542700 1 Processor -- start 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.667+0000 7fed52542700 1 -- start start 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.667+0000 7fed52542700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed4c078ce0 0x7fed4c113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.667+0000 7fed52542700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c113d60 con 0x7fed4c078ce0 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.667+0000 7fed4bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed4c078ce0 0x7fed4c113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.667+0000 7fed4bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed4c078ce0 0x7fed4c113820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60746/0 (socket says 172.21.15.134:60746) 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.667+0000 7fed4bfff700 1 -- 172.21.15.134:0/3159431439 learned_addr learned my addr 172.21.15.134:0/3159431439 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.668+0000 7fed4bfff700 1 -- 172.21.15.134:0/3159431439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c0094f0 con 0x7fed4c078ce0 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.668+0000 7fed4bfff700 1 --2- 172.21.15.134:0/3159431439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed4c078ce0 0x7fed4c113820 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0094c0 tx=0x7fed3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.668+0000 7fed48ff9700 1 -- 172.21.15.134:0/3159431439 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed3c010890 con 0x7fed4c078ce0 2024-02-16T22:10:39.560 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.668+0000 7fed52542700 1 -- 172.21.15.134:0/3159431439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c113f60 con 0x7fed4c078ce0 2024-02-16T22:10:39.560 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.668+0000 7fed48ff9700 1 -- 172.21.15.134:0/3159431439 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed3c010ec0 con 0x7fed4c078ce0 2024-02-16T22:10:39.560 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.668+0000 7fed48ff9700 1 -- 172.21.15.134:0/3159431439 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed3c0243f0 con 0x7fed4c078ce0 2024-02-16T22:10:39.560 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.668+0000 7fed52542700 1 -- 172.21.15.134:0/3159431439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c114c00 con 0x7fed4c078ce0 2024-02-16T22:10:39.560 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.669+0000 7fed48ff9700 1 -- 172.21.15.134:0/3159431439 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fed3c02d3f0 con 0x7fed4c078ce0 2024-02-16T22:10:39.560 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.669+0000 7fed48ff9700 1 --2- 172.21.15.134:0/3159431439 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fed34036880 0x7fed34038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:39.560 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.669+0000 7fed48ff9700 1 -- 172.21.15.134:0/3159431439 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fed3c04b4f0 con 0x7fed4c078ce0 2024-02-16T22:10:39.560 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.669+0000 7fed4b7fe700 1 --2- 172.21.15.134:0/3159431439 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fed34036880 0x7fed34038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:39.560 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.669+0000 7fed52542700 1 -- 172.21.15.134:0/3159431439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c1143f0 con 0x7fed4c078ce0 2024-02-16T22:10:39.560 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.669+0000 7fed4b7fe700 1 --2- 172.21.15.134:0/3159431439 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fed34036880 0x7fed34038d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fed40009990 tx=0x7fed40006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:39.560 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.674+0000 7fed48ff9700 1 -- 172.21.15.134:0/3159431439 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fed3c02b8e0 con 0x7fed4c078ce0 2024-02-16T22:10:39.560 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.955+0000 7fed52542700 1 -- 172.21.15.134:0/3159431439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fed4c05f5c0 con 0x7fed4c078ce0 2024-02-16T22:10:39.560 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.958+0000 7fed48ff9700 1 -- 172.21.15.134:0/3159431439 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fed3c02b2f0 con 0x7fed4c078ce0 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.960+0000 7fed52542700 1 -- 172.21.15.134:0/3159431439 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fed34036880 msgr2=0x7fed34038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.960+0000 7fed52542700 1 --2- 172.21.15.134:0/3159431439 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fed34036880 0x7fed34038d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fed40009990 tx=0x7fed40006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.960+0000 7fed52542700 1 -- 172.21.15.134:0/3159431439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed4c078ce0 msgr2=0x7fed4c113820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.960+0000 7fed52542700 1 --2- 172.21.15.134:0/3159431439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed4c078ce0 0x7fed4c113820 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0094c0 tx=0x7fed3c009250 comp rx=0 tx=0).stop 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.960+0000 7fed52542700 1 -- 172.21.15.134:0/3159431439 shutdown_connections 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.960+0000 7fed52542700 1 --2- 172.21.15.134:0/3159431439 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fed34036880 0x7fed34038d30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.960+0000 7fed52542700 1 --2- 172.21.15.134:0/3159431439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed4c078ce0 0x7fed4c113820 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.960+0000 7fed52542700 1 -- 172.21.15.134:0/3159431439 >> 172.21.15.134:0/3159431439 conn(0x7fed4c0fded0 msgr2=0x7fed4c0ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.960+0000 7fed52542700 1 -- 172.21.15.134:0/3159431439 shutdown_connections 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-02-16T22:10:38.960+0000 7fed52542700 1 -- 172.21.15.134:0/3159431439 wait complete. 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-16T22:10:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:10:39.562 INFO:teuthology.orchestra.run.smithi134.stdout:Or, if you are only running a single cluster on this host: 2024-02-16T22:10:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:10:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-16T22:10:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:10:39.562 INFO:teuthology.orchestra.run.smithi134.stdout:Please consider enabling telemetry to help improve Ceph: 2024-02-16T22:10:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:10:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: ceph telemetry on 2024-02-16T22:10:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:10:39.562 INFO:teuthology.orchestra.run.smithi134.stdout:For more information see: 2024-02-16T22:10:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:10:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-02-16T22:10:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:10:39.562 INFO:teuthology.orchestra.run.smithi134.stdout:Bootstrap complete. 2024-02-16T22:10:39.595 INFO:tasks.cephadm:Fetching config... 2024-02-16T22:10:39.595 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:10:39.595 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-16T22:10:39.651 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-16T22:10:39.651 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:10:39.651 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-16T22:10:39.706 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-16T22:10:39.706 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:10:39.706 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/keyring of=/dev/stdout 2024-02-16T22:10:39.774 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-16T22:10:39.774 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:10:39.774 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-16T22:10:39.829 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-16T22:10:39.829 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL+IkzSsPKonnZvP6741ofat+3KvAixcD7htaarVkWfpACZm9lGdk2x6igleKn5hEKb12Dk6o3RuCYznuABLqGCoGMMBvdDsCddsQvOj/EC1wmYxGjUEbxozJ8kIOiiUQVXXaHk/46F3mId7zysdVTTg2bfY/uVyHfZOGw8PwQLMO/Un42BK9Ar6wvbyCl650NdG+6zSM6wFXH1XzMv6jx6O5Z6IR+aI9r7DCn/ZNdXqjK7tOhPRDnbMipwDM0m9wCJhKg60PFwP26Du7fo0FXl+v73r9iSUh7/P0PZFlzPieAiydqNkx1hVe3XoKoLJwwhHXzrbblD5njHAg8fG7X5sLb6KJA+jJKuCfU8uw/u/7dZzy06PYYd2yCyVYoJAQpm6QEjJAWpW8oD5es6DSkrGU7bjQztX4HQEbyR8yMoqyX6MQJZx4IrJZ00kTH5V4qd+bnI11vuH1HgrVSjSTMLNJ/gS7QIzgOiYH9vL97JGMskUkVkngZyVbyXPliW0c= ceph-f29a5372-cd17-11ee-95ba-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-16T22:10:39.909 INFO:teuthology.orchestra.run.smithi134.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL+IkzSsPKonnZvP6741ofat+3KvAixcD7htaarVkWfpACZm9lGdk2x6igleKn5hEKb12Dk6o3RuCYznuABLqGCoGMMBvdDsCddsQvOj/EC1wmYxGjUEbxozJ8kIOiiUQVXXaHk/46F3mId7zysdVTTg2bfY/uVyHfZOGw8PwQLMO/Un42BK9Ar6wvbyCl650NdG+6zSM6wFXH1XzMv6jx6O5Z6IR+aI9r7DCn/ZNdXqjK7tOhPRDnbMipwDM0m9wCJhKg60PFwP26Du7fo0FXl+v73r9iSUh7/P0PZFlzPieAiydqNkx1hVe3XoKoLJwwhHXzrbblD5njHAg8fG7X5sLb6KJA+jJKuCfU8uw/u/7dZzy06PYYd2yCyVYoJAQpm6QEjJAWpW8oD5es6DSkrGU7bjQztX4HQEbyR8yMoqyX6MQJZx4IrJZ00kTH5V4qd+bnI11vuH1HgrVSjSTMLNJ/gS7QIzgOiYH9vL97JGMskUkVkngZyVbyXPliW0c= ceph-f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:10:39.923 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL+IkzSsPKonnZvP6741ofat+3KvAixcD7htaarVkWfpACZm9lGdk2x6igleKn5hEKb12Dk6o3RuCYznuABLqGCoGMMBvdDsCddsQvOj/EC1wmYxGjUEbxozJ8kIOiiUQVXXaHk/46F3mId7zysdVTTg2bfY/uVyHfZOGw8PwQLMO/Un42BK9Ar6wvbyCl650NdG+6zSM6wFXH1XzMv6jx6O5Z6IR+aI9r7DCn/ZNdXqjK7tOhPRDnbMipwDM0m9wCJhKg60PFwP26Du7fo0FXl+v73r9iSUh7/P0PZFlzPieAiydqNkx1hVe3XoKoLJwwhHXzrbblD5njHAg8fG7X5sLb6KJA+jJKuCfU8uw/u/7dZzy06PYYd2yCyVYoJAQpm6QEjJAWpW8oD5es6DSkrGU7bjQztX4HQEbyR8yMoqyX6MQJZx4IrJZ00kTH5V4qd+bnI11vuH1HgrVSjSTMLNJ/gS7QIzgOiYH9vL97JGMskUkVkngZyVbyXPliW0c= ceph-f29a5372-cd17-11ee-95ba-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-16T22:10:39.971 INFO:teuthology.orchestra.run.smithi173.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL+IkzSsPKonnZvP6741ofat+3KvAixcD7htaarVkWfpACZm9lGdk2x6igleKn5hEKb12Dk6o3RuCYznuABLqGCoGMMBvdDsCddsQvOj/EC1wmYxGjUEbxozJ8kIOiiUQVXXaHk/46F3mId7zysdVTTg2bfY/uVyHfZOGw8PwQLMO/Un42BK9Ar6wvbyCl650NdG+6zSM6wFXH1XzMv6jx6O5Z6IR+aI9r7DCn/ZNdXqjK7tOhPRDnbMipwDM0m9wCJhKg60PFwP26Du7fo0FXl+v73r9iSUh7/P0PZFlzPieAiydqNkx1hVe3XoKoLJwwhHXzrbblD5njHAg8fG7X5sLb6KJA+jJKuCfU8uw/u/7dZzy06PYYd2yCyVYoJAQpm6QEjJAWpW8oD5es6DSkrGU7bjQztX4HQEbyR8yMoqyX6MQJZx4IrJZ00kTH5V4qd+bnI11vuH1HgrVSjSTMLNJ/gS7QIzgOiYH9vL97JGMskUkVkngZyVbyXPliW0c= ceph-f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:10:39.987 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-16T22:10:40.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:39 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/3159431439' entity='client.admin' 2024-02-16T22:10:40.241 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:10:42.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.836+0000 7f8510ad0700 1 -- 172.21.15.134:0/1214072628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850c0fbad0 msgr2=0x7f850c0fbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:42.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.836+0000 7f8510ad0700 1 --2- 172.21.15.134:0/1214072628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850c0fbad0 0x7f850c0fbee0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0048c0 tx=0x7f84fc009e30 comp rx=0 tx=0).stop 2024-02-16T22:10:42.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.836+0000 7f8510ad0700 1 -- 172.21.15.134:0/1214072628 shutdown_connections 2024-02-16T22:10:42.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.836+0000 7f8510ad0700 1 --2- 172.21.15.134:0/1214072628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850c0fbad0 0x7f850c0fbee0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:42.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.836+0000 7f8510ad0700 1 -- 172.21.15.134:0/1214072628 >> 172.21.15.134:0/1214072628 conn(0x7f850c0f7190 msgr2=0x7f850c0f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:42.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.836+0000 7f8510ad0700 1 -- 172.21.15.134:0/1214072628 shutdown_connections 2024-02-16T22:10:42.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.836+0000 7f8510ad0700 1 -- 172.21.15.134:0/1214072628 wait complete. 2024-02-16T22:10:42.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.836+0000 7f8510ad0700 1 Processor -- start 2024-02-16T22:10:42.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.836+0000 7f8510ad0700 1 -- start start 2024-02-16T22:10:42.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.837+0000 7f8510ad0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850c0fbad0 0x7f850c10fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:42.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.837+0000 7f8510ad0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c065d60 con 0x7f850c0fbad0 2024-02-16T22:10:42.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.837+0000 7f850a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850c0fbad0 0x7f850c10fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:42.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.837+0000 7f850a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850c0fbad0 0x7f850c10fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40188/0 (socket says 172.21.15.134:40188) 2024-02-16T22:10:42.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.837+0000 7f850a59c700 1 -- 172.21.15.134:0/3585516464 learned_addr learned my addr 172.21.15.134:0/3585516464 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:42.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.837+0000 7f850a59c700 1 -- 172.21.15.134:0/3585516464 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc005040 con 0x7f850c0fbad0 2024-02-16T22:10:42.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.837+0000 7f850a59c700 1 --2- 172.21.15.134:0/3585516464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850c0fbad0 0x7f850c10fbd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009680 tx=0x7f84fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:42.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.837+0000 7f84faffd700 1 -- 172.21.15.134:0/3585516464 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84fc00bed0 con 0x7f850c0fbad0 2024-02-16T22:10:42.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.837+0000 7f84faffd700 1 -- 172.21.15.134:0/3585516464 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84fc00b5c0 con 0x7f850c0fbad0 2024-02-16T22:10:42.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.838+0000 7f8510ad0700 1 -- 172.21.15.134:0/3585516464 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850c065f60 con 0x7f850c0fbad0 2024-02-16T22:10:42.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.838+0000 7f84faffd700 1 -- 172.21.15.134:0/3585516464 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84fc01c5b0 con 0x7f850c0fbad0 2024-02-16T22:10:42.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.838+0000 7f8510ad0700 1 -- 172.21.15.134:0/3585516464 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850c110350 con 0x7f850c0fbad0 2024-02-16T22:10:42.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.838+0000 7f84faffd700 1 -- 172.21.15.134:0/3585516464 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f84fc01c820 con 0x7f850c0fbad0 2024-02-16T22:10:42.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.839+0000 7f84faffd700 1 --2- 172.21.15.134:0/3585516464 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f84f4036820 0x7f84f4038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:42.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.839+0000 7f84faffd700 1 -- 172.21.15.134:0/3585516464 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f84fc04aac0 con 0x7f850c0fbad0 2024-02-16T22:10:42.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.839+0000 7f8510ad0700 1 -- 172.21.15.134:0/3585516464 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850c1058a0 con 0x7f850c0fbad0 2024-02-16T22:10:42.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.839+0000 7f8509d9b700 1 --2- 172.21.15.134:0/3585516464 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f84f4036820 0x7f84f4038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:42.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.839+0000 7f8509d9b700 1 --2- 172.21.15.134:0/3585516464 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f84f4036820 0x7f84f4038cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8500009990 tx=0x7f8500006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:42.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:42.844+0000 7f84faffd700 1 -- 172.21.15.134:0/3585516464 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f84fc023300 con 0x7f850c0fbad0 2024-02-16T22:10:43.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:43.034+0000 7f8510ad0700 1 -- 172.21.15.134:0/3585516464 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f850c101890 con 0x7f850c0fbad0 2024-02-16T22:10:43.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:43.038+0000 7f84faffd700 1 -- 172.21.15.134:0/3585516464 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f84fc011b60 con 0x7f850c0fbad0 2024-02-16T22:10:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:43.041+0000 7f8510ad0700 1 -- 172.21.15.134:0/3585516464 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f84f4036820 msgr2=0x7f84f4038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:43.041+0000 7f8510ad0700 1 --2- 172.21.15.134:0/3585516464 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f84f4036820 0x7f84f4038cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8500009990 tx=0x7f8500006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:43.041+0000 7f8510ad0700 1 -- 172.21.15.134:0/3585516464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850c0fbad0 msgr2=0x7f850c10fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:43.041+0000 7f8510ad0700 1 --2- 172.21.15.134:0/3585516464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850c0fbad0 0x7f850c10fbd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009680 tx=0x7f84fc009e30 comp rx=0 tx=0).stop 2024-02-16T22:10:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:43.041+0000 7f8510ad0700 1 -- 172.21.15.134:0/3585516464 shutdown_connections 2024-02-16T22:10:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:43.041+0000 7f8510ad0700 1 --2- 172.21.15.134:0/3585516464 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f84f4036820 0x7f84f4038cd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:43.041+0000 7f8510ad0700 1 --2- 172.21.15.134:0/3585516464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850c0fbad0 0x7f850c10fbd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:43.041+0000 7f8510ad0700 1 -- 172.21.15.134:0/3585516464 >> 172.21.15.134:0/3585516464 conn(0x7f850c0f7190 msgr2=0x7f850c0f7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:43.041+0000 7f8510ad0700 1 -- 172.21.15.134:0/3585516464 shutdown_connections 2024-02-16T22:10:43.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:43.041+0000 7f8510ad0700 1 -- 172.21.15.134:0/3585516464 wait complete. 2024-02-16T22:10:44.167 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-16T22:10:44.168 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-16T22:10:44.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:44 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/3585516464' entity='client.admin' 2024-02-16T22:10:44.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:44 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:44.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:44 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:44.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:44 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:10:44.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:44 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:44.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:44 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-16T22:10:44.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:44 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-16T22:10:44.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:44 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:10:45.236 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:10:45.368 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:45 smithi134 ceph-mon[28869]: Deploying daemon crash.smithi134 on smithi134 2024-02-16T22:10:47.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.265+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2249221212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3980fe200 msgr2=0x7fd3980fe610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:47.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.265+0000 7fd39ea1a700 1 --2- 172.21.15.134:0/2249221212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3980fe200 0x7fd3980fe610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd3880048c0 tx=0x7fd388009e30 comp rx=0 tx=0).stop 2024-02-16T22:10:47.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.265+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2249221212 shutdown_connections 2024-02-16T22:10:47.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.265+0000 7fd39ea1a700 1 --2- 172.21.15.134:0/2249221212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3980fe200 0x7fd3980fe610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:47.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.265+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2249221212 >> 172.21.15.134:0/2249221212 conn(0x7fd3980f69c0 msgr2=0x7fd3980f8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:47.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.265+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2249221212 shutdown_connections 2024-02-16T22:10:47.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.265+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2249221212 wait complete. 2024-02-16T22:10:47.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.265+0000 7fd39ea1a700 1 Processor -- start 2024-02-16T22:10:47.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.265+0000 7fd39ea1a700 1 -- start start 2024-02-16T22:10:47.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.265+0000 7fd39ea1a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3980fe200 0x7fd39810cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:47.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.265+0000 7fd39ea1a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39810d490 con 0x7fd3980fe200 2024-02-16T22:10:47.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.266+0000 7fd397fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3980fe200 0x7fd39810cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:47.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.266+0000 7fd397fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3980fe200 0x7fd39810cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40220/0 (socket says 172.21.15.134:40220) 2024-02-16T22:10:47.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.266+0000 7fd397fff700 1 -- 172.21.15.134:0/2822539067 learned_addr learned my addr 172.21.15.134:0/2822539067 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:47.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.266+0000 7fd397fff700 1 -- 172.21.15.134:0/2822539067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388005040 con 0x7fd3980fe200 2024-02-16T22:10:47.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.266+0000 7fd397fff700 1 --2- 172.21.15.134:0/2822539067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3980fe200 0x7fd39810cf50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd388009300 tx=0x7fd388009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:47.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.266+0000 7fd394ff9700 1 -- 172.21.15.134:0/2822539067 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd388004e60 con 0x7fd3980fe200 2024-02-16T22:10:47.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.266+0000 7fd394ff9700 1 -- 172.21.15.134:0/2822539067 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd388009680 con 0x7fd3980fe200 2024-02-16T22:10:47.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.266+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2822539067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39810d690 con 0x7fd3980fe200 2024-02-16T22:10:47.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.266+0000 7fd394ff9700 1 -- 172.21.15.134:0/2822539067 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd38801c5b0 con 0x7fd3980fe200 2024-02-16T22:10:47.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.266+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2822539067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39810e330 con 0x7fd3980fe200 2024-02-16T22:10:47.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.267+0000 7fd394ff9700 1 -- 172.21.15.134:0/2822539067 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fd38801c870 con 0x7fd3980fe200 2024-02-16T22:10:47.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.267+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2822539067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39805f5c0 con 0x7fd3980fe200 2024-02-16T22:10:47.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.267+0000 7fd394ff9700 1 --2- 172.21.15.134:0/2822539067 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fd380036870 0x7fd380038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:47.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.267+0000 7fd394ff9700 1 -- 172.21.15.134:0/2822539067 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd388049a80 con 0x7fd3980fe200 2024-02-16T22:10:47.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.267+0000 7fd3977fe700 1 --2- 172.21.15.134:0/2822539067 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fd380036870 0x7fd380038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:47.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.268+0000 7fd3977fe700 1 --2- 172.21.15.134:0/2822539067 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fd380036870 0x7fd380038d20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009990 tx=0x7fd38c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:47.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.272+0000 7fd394ff9700 1 -- 172.21.15.134:0/2822539067 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd388011dd0 con 0x7fd3980fe200 2024-02-16T22:10:47.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.488+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2822539067 --> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fd39810eef0 con 0x7fd380036870 2024-02-16T22:10:47.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.493+0000 7fd394ff9700 1 -- 172.21.15.134:0/2822539067 <== mgr.14162 v2:172.21.15.134:6800/2987045407 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd39810eef0 con 0x7fd380036870 2024-02-16T22:10:47.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.495+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2822539067 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fd380036870 msgr2=0x7fd380038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:47.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.495+0000 7fd39ea1a700 1 --2- 172.21.15.134:0/2822539067 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fd380036870 0x7fd380038d20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009990 tx=0x7fd38c006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:47.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.495+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2822539067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3980fe200 msgr2=0x7fd39810cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:47.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.495+0000 7fd39ea1a700 1 --2- 172.21.15.134:0/2822539067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3980fe200 0x7fd39810cf50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd388009300 tx=0x7fd388009e30 comp rx=0 tx=0).stop 2024-02-16T22:10:47.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.495+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2822539067 shutdown_connections 2024-02-16T22:10:47.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.495+0000 7fd39ea1a700 1 --2- 172.21.15.134:0/2822539067 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fd380036870 0x7fd380038d20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:47.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.495+0000 7fd39ea1a700 1 --2- 172.21.15.134:0/2822539067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3980fe200 0x7fd39810cf50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:47.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.495+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2822539067 >> 172.21.15.134:0/2822539067 conn(0x7fd3980f69c0 msgr2=0x7fd3980f77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:47.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.495+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2822539067 shutdown_connections 2024-02-16T22:10:47.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:47.495+0000 7fd39ea1a700 1 -- 172.21.15.134:0/2822539067 wait complete. 2024-02-16T22:10:48.083 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:47 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:48.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:47 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:48.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:47 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:48.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:47 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:48.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:47 smithi134 ceph-mon[28869]: Deploying daemon node-exporter.smithi134 on smithi134 2024-02-16T22:10:48.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:47 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:48.108 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi173 2024-02-16T22:10:48.108 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:10:48.108 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/etc/ceph/ceph.conf 2024-02-16T22:10:48.127 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:10:48.127 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:10:48.185 INFO:tasks.cephadm:Adding host smithi173 to orchestrator... 2024-02-16T22:10:48.185 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph orch host add smithi173 2024-02-16T22:10:48.444 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:10:49.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:48 smithi134 ceph-mon[28869]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:50.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.012+0000 7ff4d312a700 1 -- 172.21.15.134:0/4087820788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4cc0fbad0 msgr2=0x7ff4cc0fbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:50.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.012+0000 7ff4d312a700 1 --2- 172.21.15.134:0/4087820788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4cc0fbad0 0x7ff4cc0fbee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00048c0 tx=0x7ff4c0009e30 comp rx=0 tx=0).stop 2024-02-16T22:10:50.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.012+0000 7ff4d312a700 1 -- 172.21.15.134:0/4087820788 shutdown_connections 2024-02-16T22:10:50.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.012+0000 7ff4d312a700 1 --2- 172.21.15.134:0/4087820788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4cc0fbad0 0x7ff4cc0fbee0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:50.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.012+0000 7ff4d312a700 1 -- 172.21.15.134:0/4087820788 >> 172.21.15.134:0/4087820788 conn(0x7ff4cc0f7190 msgr2=0x7ff4cc0f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:50.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.012+0000 7ff4d312a700 1 -- 172.21.15.134:0/4087820788 shutdown_connections 2024-02-16T22:10:50.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.012+0000 7ff4d312a700 1 -- 172.21.15.134:0/4087820788 wait complete. 2024-02-16T22:10:50.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.013+0000 7ff4d312a700 1 Processor -- start 2024-02-16T22:10:50.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.013+0000 7ff4d312a700 1 -- start start 2024-02-16T22:10:50.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.013+0000 7ff4d312a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4cc0fbad0 0x7ff4cc111fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:50.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.013+0000 7ff4d312a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc10d9c0 con 0x7ff4cc0fbad0 2024-02-16T22:10:50.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.013+0000 7ff4d0ec6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4cc0fbad0 0x7ff4cc111fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:50.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.013+0000 7ff4d0ec6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4cc0fbad0 0x7ff4cc111fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40230/0 (socket says 172.21.15.134:40230) 2024-02-16T22:10:50.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.013+0000 7ff4d0ec6700 1 -- 172.21.15.134:0/2750145034 learned_addr learned my addr 172.21.15.134:0/2750145034 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:50.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.013+0000 7ff4d0ec6700 1 -- 172.21.15.134:0/2750145034 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c0005040 con 0x7ff4cc0fbad0 2024-02-16T22:10:50.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.014+0000 7ff4d0ec6700 1 --2- 172.21.15.134:0/2750145034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4cc0fbad0 0x7ff4cc111fd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009b80 tx=0x7ff4c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:50.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.014+0000 7ff4c97fa700 1 -- 172.21.15.134:0/2750145034 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4c000b5c0 con 0x7ff4cc0fbad0 2024-02-16T22:10:50.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.014+0000 7ff4c97fa700 1 -- 172.21.15.134:0/2750145034 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4c000be70 con 0x7ff4cc0fbad0 2024-02-16T22:10:50.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.014+0000 7ff4d312a700 1 -- 172.21.15.134:0/2750145034 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4cc065d60 con 0x7ff4cc0fbad0 2024-02-16T22:10:50.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.014+0000 7ff4c97fa700 1 -- 172.21.15.134:0/2750145034 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4c001c660 con 0x7ff4cc0fbad0 2024-02-16T22:10:50.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.014+0000 7ff4d312a700 1 -- 172.21.15.134:0/2750145034 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4cc112510 con 0x7ff4cc0fbad0 2024-02-16T22:10:50.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.015+0000 7ff4c97fa700 1 -- 172.21.15.134:0/2750145034 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7ff4c001c7c0 con 0x7ff4cc0fbad0 2024-02-16T22:10:50.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.015+0000 7ff4c97fa700 1 --2- 172.21.15.134:0/2750145034 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff4bc0368c0 0x7ff4bc038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:50.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.015+0000 7ff4c97fa700 1 -- 172.21.15.134:0/2750145034 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff4c0013910 con 0x7ff4cc0fbad0 2024-02-16T22:10:50.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.015+0000 7ff4cbfff700 1 --2- 172.21.15.134:0/2750145034 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff4bc0368c0 0x7ff4bc038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:50.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.015+0000 7ff4d312a700 1 -- 172.21.15.134:0/2750145034 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4cc1058a0 con 0x7ff4cc0fbad0 2024-02-16T22:10:50.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.015+0000 7ff4cbfff700 1 --2- 172.21.15.134:0/2750145034 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff4bc0368c0 0x7ff4bc038d70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009990 tx=0x7ff4b8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:50.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.020+0000 7ff4c97fa700 1 -- 172.21.15.134:0/2750145034 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff4c0011dd0 con 0x7ff4cc0fbad0 2024-02-16T22:10:50.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:50.226+0000 7ff4d312a700 1 -- 172.21.15.134:0/2750145034 --> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4cc05e3d0 con 0x7ff4bc0368c0 2024-02-16T22:10:52.139 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:51 smithi134 ceph-mon[28869]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:10:52.140 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:51 smithi134 ceph-mon[28869]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:10:52.140 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:51 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:52.140 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:51 smithi134 ceph-mon[28869]: Deploying cephadm binary to smithi173 2024-02-16T22:10:52.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:52.411+0000 7ff4c97fa700 1 -- 172.21.15.134:0/2750145034 <== mgr.14162 v2:172.21.15.134:6800/2987045407 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ff4cc05e3d0 con 0x7ff4bc0368c0 2024-02-16T22:10:52.413 INFO:teuthology.orchestra.run.smithi134.stdout:Added host 'smithi173' with addr '172.21.15.173' 2024-02-16T22:10:52.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:52.413+0000 7ff4d312a700 1 -- 172.21.15.134:0/2750145034 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff4bc0368c0 msgr2=0x7ff4bc038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:52.413+0000 7ff4d312a700 1 --2- 172.21.15.134:0/2750145034 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff4bc0368c0 0x7ff4bc038d70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009990 tx=0x7ff4b8006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:52.413+0000 7ff4d312a700 1 -- 172.21.15.134:0/2750145034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4cc0fbad0 msgr2=0x7ff4cc111fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:52.413+0000 7ff4d312a700 1 --2- 172.21.15.134:0/2750145034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4cc0fbad0 0x7ff4cc111fd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009b80 tx=0x7ff4c0009e30 comp rx=0 tx=0).stop 2024-02-16T22:10:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:52.413+0000 7ff4d312a700 1 -- 172.21.15.134:0/2750145034 shutdown_connections 2024-02-16T22:10:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:52.413+0000 7ff4d312a700 1 --2- 172.21.15.134:0/2750145034 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff4bc0368c0 0x7ff4bc038d70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:52.413+0000 7ff4d312a700 1 --2- 172.21.15.134:0/2750145034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4cc0fbad0 0x7ff4cc111fd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:52.413+0000 7ff4d312a700 1 -- 172.21.15.134:0/2750145034 >> 172.21.15.134:0/2750145034 conn(0x7ff4cc0f7190 msgr2=0x7ff4cc0f7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:52.413+0000 7ff4d312a700 1 -- 172.21.15.134:0/2750145034 shutdown_connections 2024-02-16T22:10:52.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:52.413+0000 7ff4d312a700 1 -- 172.21.15.134:0/2750145034 wait complete. 2024-02-16T22:10:53.054 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph orch host ls --format=json 2024-02-16T22:10:53.562 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:10:53.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:53 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:53 smithi134 ceph-mon[28869]: Added host smithi173 2024-02-16T22:10:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:53 smithi134 ceph-mon[28869]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:10:54.884 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:54 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:54.884 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:54 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:54.884 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:54 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:54.884 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:54 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:54.884 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:54 smithi134 ceph-mon[28869]: Deploying daemon alertmanager.smithi134 on smithi134 2024-02-16T22:10:55.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.101+0000 7f6e59b2a700 1 -- 172.21.15.134:0/968920260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e540faea0 msgr2=0x7f6e540fb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:55.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.101+0000 7f6e59b2a700 1 --2- 172.21.15.134:0/968920260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e540faea0 0x7f6e540fb2b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e440048c0 tx=0x7f6e44009e30 comp rx=0 tx=0).stop 2024-02-16T22:10:55.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.101+0000 7f6e59b2a700 1 -- 172.21.15.134:0/968920260 shutdown_connections 2024-02-16T22:10:55.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.101+0000 7f6e59b2a700 1 --2- 172.21.15.134:0/968920260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e540faea0 0x7f6e540fb2b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:55.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.101+0000 7f6e59b2a700 1 -- 172.21.15.134:0/968920260 >> 172.21.15.134:0/968920260 conn(0x7f6e540f6920 msgr2=0x7f6e540f8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:55.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.101+0000 7f6e59b2a700 1 -- 172.21.15.134:0/968920260 shutdown_connections 2024-02-16T22:10:55.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.101+0000 7f6e59b2a700 1 -- 172.21.15.134:0/968920260 wait complete. 2024-02-16T22:10:55.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.102+0000 7f6e59b2a700 1 Processor -- start 2024-02-16T22:10:55.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.102+0000 7f6e59b2a700 1 -- start start 2024-02-16T22:10:55.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.102+0000 7f6e59b2a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e540faea0 0x7f6e5410cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:55.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.102+0000 7f6e59b2a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5410d450 con 0x7f6e540faea0 2024-02-16T22:10:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.102+0000 7f6e537fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e540faea0 0x7f6e5410cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.102+0000 7f6e537fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e540faea0 0x7f6e5410cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34928/0 (socket says 172.21.15.134:34928) 2024-02-16T22:10:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.102+0000 7f6e537fe700 1 -- 172.21.15.134:0/3184696870 learned_addr learned my addr 172.21.15.134:0/3184696870 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.103+0000 7f6e537fe700 1 -- 172.21.15.134:0/3184696870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e44005040 con 0x7f6e540faea0 2024-02-16T22:10:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.103+0000 7f6e537fe700 1 --2- 172.21.15.134:0/3184696870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e540faea0 0x7f6e5410cf10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009b80 tx=0x7f6e44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.103+0000 7f6e3bfff700 1 -- 172.21.15.134:0/3184696870 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e44009620 con 0x7f6e540faea0 2024-02-16T22:10:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.103+0000 7f6e3bfff700 1 -- 172.21.15.134:0/3184696870 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e44009780 con 0x7f6e540faea0 2024-02-16T22:10:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.103+0000 7f6e59b2a700 1 -- 172.21.15.134:0/3184696870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5410d650 con 0x7f6e540faea0 2024-02-16T22:10:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.103+0000 7f6e3bfff700 1 -- 172.21.15.134:0/3184696870 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e4401c5b0 con 0x7f6e540faea0 2024-02-16T22:10:55.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.103+0000 7f6e59b2a700 1 -- 172.21.15.134:0/3184696870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5410e2f0 con 0x7f6e540faea0 2024-02-16T22:10:55.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.104+0000 7f6e3bfff700 1 -- 172.21.15.134:0/3184696870 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f6e4401c830 con 0x7f6e540faea0 2024-02-16T22:10:55.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.104+0000 7f6e59b2a700 1 -- 172.21.15.134:0/3184696870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5405f5c0 con 0x7f6e540faea0 2024-02-16T22:10:55.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.104+0000 7f6e3bfff700 1 --2- 172.21.15.134:0/3184696870 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f6e3c036870 0x7f6e3c038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:55.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.104+0000 7f6e3bfff700 1 -- 172.21.15.134:0/3184696870 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6e44049a30 con 0x7f6e540faea0 2024-02-16T22:10:55.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.104+0000 7f6e52ffd700 1 --2- 172.21.15.134:0/3184696870 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f6e3c036870 0x7f6e3c038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:55.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.104+0000 7f6e52ffd700 1 --2- 172.21.15.134:0/3184696870 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f6e3c036870 0x7f6e3c038d20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009990 tx=0x7f6e48006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:55.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.109+0000 7f6e3bfff700 1 -- 172.21.15.134:0/3184696870 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6e44011db0 con 0x7f6e540faea0 2024-02-16T22:10:55.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.298+0000 7f6e59b2a700 1 -- 172.21.15.134:0/3184696870 --> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e5410eed0 con 0x7f6e3c036870 2024-02-16T22:10:55.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.299+0000 7f6e3bfff700 1 -- 172.21.15.134:0/3184696870 <== mgr.14162 v2:172.21.15.134:6800/2987045407 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f6e5410eed0 con 0x7f6e3c036870 2024-02-16T22:10:55.301 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:10:55.301 INFO:teuthology.orchestra.run.smithi134.stdout:[{"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}, {"addr": "172.21.15.173", "hostname": "smithi173", "labels": [], "status": ""}] 2024-02-16T22:10:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.301+0000 7f6e59b2a700 1 -- 172.21.15.134:0/3184696870 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f6e3c036870 msgr2=0x7f6e3c038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.301+0000 7f6e59b2a700 1 --2- 172.21.15.134:0/3184696870 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f6e3c036870 0x7f6e3c038d20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009990 tx=0x7f6e48006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.301+0000 7f6e59b2a700 1 -- 172.21.15.134:0/3184696870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e540faea0 msgr2=0x7f6e5410cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.301+0000 7f6e59b2a700 1 --2- 172.21.15.134:0/3184696870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e540faea0 0x7f6e5410cf10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009b80 tx=0x7f6e44009e30 comp rx=0 tx=0).stop 2024-02-16T22:10:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.301+0000 7f6e59b2a700 1 -- 172.21.15.134:0/3184696870 shutdown_connections 2024-02-16T22:10:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.301+0000 7f6e59b2a700 1 --2- 172.21.15.134:0/3184696870 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f6e3c036870 0x7f6e3c038d20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.301+0000 7f6e59b2a700 1 --2- 172.21.15.134:0/3184696870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e540faea0 0x7f6e5410cf10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.301+0000 7f6e59b2a700 1 -- 172.21.15.134:0/3184696870 >> 172.21.15.134:0/3184696870 conn(0x7f6e540f6920 msgr2=0x7f6e540f76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.301+0000 7f6e59b2a700 1 -- 172.21.15.134:0/3184696870 shutdown_connections 2024-02-16T22:10:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:55.301+0000 7f6e59b2a700 1 -- 172.21.15.134:0/3184696870 wait complete. 2024-02-16T22:10:55.913 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:55 smithi134 ceph-mon[28869]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:10:55.936 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-16T22:10:55.936 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph osd crush tunables default 2024-02-16T22:10:56.191 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:10:56.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:56 smithi134 ceph-mon[28869]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-16T22:10:56.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:56 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:10:57.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:57 smithi134 ceph-mon[28869]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:10:58.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.507+0000 7f94753ef700 1 -- 172.21.15.134:0/1436863598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700fcbc0 msgr2=0x7f94700fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:58.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.507+0000 7f94753ef700 1 --2- 172.21.15.134:0/1436863598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700fcbc0 0x7f94700fcfd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f94600048c0 tx=0x7f9460009e30 comp rx=0 tx=0).stop 2024-02-16T22:10:58.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.507+0000 7f94753ef700 1 -- 172.21.15.134:0/1436863598 shutdown_connections 2024-02-16T22:10:58.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.507+0000 7f94753ef700 1 --2- 172.21.15.134:0/1436863598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700fcbc0 0x7f94700fcfd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:58.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.507+0000 7f94753ef700 1 -- 172.21.15.134:0/1436863598 >> 172.21.15.134:0/1436863598 conn(0x7f94700f82a0 msgr2=0x7f94700fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:58.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.507+0000 7f94753ef700 1 -- 172.21.15.134:0/1436863598 shutdown_connections 2024-02-16T22:10:58.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.507+0000 7f94753ef700 1 -- 172.21.15.134:0/1436863598 wait complete. 2024-02-16T22:10:58.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.508+0000 7f94753ef700 1 Processor -- start 2024-02-16T22:10:58.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.508+0000 7f94753ef700 1 -- start start 2024-02-16T22:10:58.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.508+0000 7f94753ef700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700fcbc0 0x7f947010ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:58.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.508+0000 7f94753ef700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947010d3d0 con 0x7f94700fcbc0 2024-02-16T22:10:58.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.508+0000 7f946effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700fcbc0 0x7f947010ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:58.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.508+0000 7f946effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700fcbc0 0x7f947010ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34932/0 (socket says 172.21.15.134:34932) 2024-02-16T22:10:58.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.508+0000 7f946effd700 1 -- 172.21.15.134:0/346817280 learned_addr learned my addr 172.21.15.134:0/346817280 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:10:58.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.508+0000 7f946effd700 1 -- 172.21.15.134:0/346817280 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460005040 con 0x7f94700fcbc0 2024-02-16T22:10:58.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.508+0000 7f946effd700 1 --2- 172.21.15.134:0/346817280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700fcbc0 0x7f947010ce90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9460009b80 tx=0x7f9460009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:58.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.509+0000 7f94577fe700 1 -- 172.21.15.134:0/346817280 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f946000b5c0 con 0x7f94700fcbc0 2024-02-16T22:10:58.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.509+0000 7f94753ef700 1 -- 172.21.15.134:0/346817280 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947010d5d0 con 0x7f94700fcbc0 2024-02-16T22:10:58.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.509+0000 7f94577fe700 1 -- 172.21.15.134:0/346817280 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f946000be70 con 0x7f94700fcbc0 2024-02-16T22:10:58.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.509+0000 7f94577fe700 1 -- 172.21.15.134:0/346817280 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f946001c660 con 0x7f94700fcbc0 2024-02-16T22:10:58.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.509+0000 7f94753ef700 1 -- 172.21.15.134:0/346817280 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947010e270 con 0x7f94700fcbc0 2024-02-16T22:10:58.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.509+0000 7f94577fe700 1 -- 172.21.15.134:0/346817280 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f946001c8d0 con 0x7f94700fcbc0 2024-02-16T22:10:58.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.510+0000 7f94577fe700 1 --2- 172.21.15.134:0/346817280 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f9458036870 0x7f9458038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:10:58.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.510+0000 7f94753ef700 1 -- 172.21.15.134:0/346817280 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947005f5c0 con 0x7f94700fcbc0 2024-02-16T22:10:58.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.510+0000 7f94577fe700 1 -- 172.21.15.134:0/346817280 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f94600499d0 con 0x7f94700fcbc0 2024-02-16T22:10:58.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.510+0000 7f946e7fc700 1 --2- 172.21.15.134:0/346817280 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f9458036870 0x7f9458038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:10:58.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.510+0000 7f946e7fc700 1 --2- 172.21.15.134:0/346817280 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f9458036870 0x7f9458038d20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9464009990 tx=0x7f9464006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:10:58.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.514+0000 7f94577fe700 1 -- 172.21.15.134:0/346817280 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9460011dd0 con 0x7f94700fcbc0 2024-02-16T22:10:58.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.712+0000 7f94753ef700 1 -- 172.21.15.134:0/346817280 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f947010ed90 con 0x7f94700fcbc0 2024-02-16T22:10:58.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.826+0000 7f94577fe700 1 -- 172.21.15.134:0/346817280 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9460011370 con 0x7f94700fcbc0 2024-02-16T22:10:58.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.828+0000 7f94753ef700 1 -- 172.21.15.134:0/346817280 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f9458036870 msgr2=0x7f9458038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:58.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.828+0000 7f94753ef700 1 --2- 172.21.15.134:0/346817280 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f9458036870 0x7f9458038d20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9464009990 tx=0x7f9464006e40 comp rx=0 tx=0).stop 2024-02-16T22:10:58.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.828+0000 7f94753ef700 1 -- 172.21.15.134:0/346817280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700fcbc0 msgr2=0x7f947010ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:10:58.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.828+0000 7f94753ef700 1 --2- 172.21.15.134:0/346817280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700fcbc0 0x7f947010ce90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9460009b80 tx=0x7f9460009e30 comp rx=0 tx=0).stop 2024-02-16T22:10:58.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.828+0000 7f94753ef700 1 -- 172.21.15.134:0/346817280 shutdown_connections 2024-02-16T22:10:58.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.828+0000 7f94753ef700 1 --2- 172.21.15.134:0/346817280 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f9458036870 0x7f9458038d20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:58.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.828+0000 7f94753ef700 1 --2- 172.21.15.134:0/346817280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700fcbc0 0x7f947010ce90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:10:58.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.828+0000 7f94753ef700 1 -- 172.21.15.134:0/346817280 >> 172.21.15.134:0/346817280 conn(0x7f94700f82a0 msgr2=0x7f94700f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:10:58.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.829+0000 7f94753ef700 1 -- 172.21.15.134:0/346817280 shutdown_connections 2024-02-16T22:10:58.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:10:58.829+0000 7f94753ef700 1 -- 172.21.15.134:0/346817280 wait complete. 2024-02-16T22:10:58.832 INFO:teuthology.orchestra.run.smithi134.stderr:adjusted tunables profile to default 2024-02-16T22:10:58.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:58 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/346817280' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-16T22:11:00.178 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:59 smithi134 ceph-mon[28869]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:00.179 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:59 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/346817280' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-16T22:11:00.179 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:10:59 smithi134 ceph-mon[28869]: osdmap e4: 0 total, 0 up, 0 in 2024-02-16T22:11:00.203 INFO:tasks.cephadm:Adding mon.smithi134 on smithi134 2024-02-16T22:11:00.203 INFO:tasks.cephadm:Adding mon.smithi173 on smithi173 2024-02-16T22:11:00.203 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph orch apply mon '2;smithi134:172.21.15.134=smithi134;smithi173:172.21.15.173=smithi173' 2024-02-16T22:11:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:00.498 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:01.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.963+0000 7ff4510a3700 1 -- 172.21.15.173:0/4077943544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c0fae80 msgr2=0x7ff44c0fb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:01.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.963+0000 7ff4510a3700 1 --2- 172.21.15.173:0/4077943544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c0fae80 0x7ff44c0fb290 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0048c0 tx=0x7ff43c009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:01.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.963+0000 7ff4510a3700 1 -- 172.21.15.173:0/4077943544 shutdown_connections 2024-02-16T22:11:01.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.963+0000 7ff4510a3700 1 --2- 172.21.15.173:0/4077943544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c0fae80 0x7ff44c0fb290 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:01.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.963+0000 7ff4510a3700 1 -- 172.21.15.173:0/4077943544 >> 172.21.15.173:0/4077943544 conn(0x7ff44c0f6920 msgr2=0x7ff44c0f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:01.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.963+0000 7ff4510a3700 1 -- 172.21.15.173:0/4077943544 shutdown_connections 2024-02-16T22:11:01.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.963+0000 7ff4510a3700 1 -- 172.21.15.173:0/4077943544 wait complete. 2024-02-16T22:11:01.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.964+0000 7ff4510a3700 1 Processor -- start 2024-02-16T22:11:01.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.964+0000 7ff4510a3700 1 -- start start 2024-02-16T22:11:01.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.964+0000 7ff4510a3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c0fae80 0x7ff44c10cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:01.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.964+0000 7ff4510a3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c10d400 con 0x7ff44c0fae80 2024-02-16T22:11:01.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.964+0000 7ff44ad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c0fae80 0x7ff44c10cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:01.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.964+0000 7ff44ad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c0fae80 0x7ff44c10cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:55864/0 (socket says 172.21.15.173:55864) 2024-02-16T22:11:01.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.964+0000 7ff44ad9d700 1 -- 172.21.15.173:0/885693309 learned_addr learned my addr 172.21.15.173:0/885693309 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:01.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.964+0000 7ff44ad9d700 1 -- 172.21.15.173:0/885693309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c005040 con 0x7ff44c0fae80 2024-02-16T22:11:01.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.964+0000 7ff44ad9d700 1 --2- 172.21.15.173:0/885693309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c0fae80 0x7ff44c10cec0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009040 tx=0x7ff43c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:01.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.965+0000 7ff4337fe700 1 -- 172.21.15.173:0/885693309 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff43c00bed0 con 0x7ff44c0fae80 2024-02-16T22:11:01.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.965+0000 7ff4337fe700 1 -- 172.21.15.173:0/885693309 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff43c00b5c0 con 0x7ff44c0fae80 2024-02-16T22:11:01.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.965+0000 7ff4510a3700 1 -- 172.21.15.173:0/885693309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44c10d600 con 0x7ff44c0fae80 2024-02-16T22:11:01.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.965+0000 7ff4337fe700 1 -- 172.21.15.173:0/885693309 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff43c01c5b0 con 0x7ff44c0fae80 2024-02-16T22:11:01.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.965+0000 7ff4510a3700 1 -- 172.21.15.173:0/885693309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c10e2a0 con 0x7ff44c0fae80 2024-02-16T22:11:01.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.966+0000 7ff4337fe700 1 -- 172.21.15.173:0/885693309 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7ff43c013420 con 0x7ff44c0fae80 2024-02-16T22:11:01.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.966+0000 7ff4510a3700 1 -- 172.21.15.173:0/885693309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44c05f5c0 con 0x7ff44c0fae80 2024-02-16T22:11:01.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.966+0000 7ff4337fe700 1 --2- 172.21.15.173:0/885693309 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff4340368c0 0x7ff434038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:01.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.966+0000 7ff4337fe700 1 -- 172.21.15.173:0/885693309 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff43c049ad0 con 0x7ff44c0fae80 2024-02-16T22:11:01.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.966+0000 7ff44a59c700 1 --2- 172.21.15.173:0/885693309 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff4340368c0 0x7ff434038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:01.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.966+0000 7ff44a59c700 1 --2- 172.21.15.173:0/885693309 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff4340368c0 0x7ff434038d70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff440009990 tx=0x7ff440006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:01.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:01.971+0000 7ff4337fe700 1 -- 172.21.15.173:0/885693309 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff43c013a80 con 0x7ff44c0fae80 2024-02-16T22:11:02.067 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:01 smithi134 ceph-mon[28869]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:02.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:02.161+0000 7ff4510a3700 1 -- 172.21.15.173:0/885693309 --> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi134:172.21.15.134=smithi134;smithi173:172.21.15.173=smithi173", "target": ["mon-mgr", ""]}) v1 -- 0x7ff44c10ef10 con 0x7ff4340368c0 2024-02-16T22:11:02.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:02.167+0000 7ff4337fe700 1 -- 172.21.15.173:0/885693309 <== mgr.14162 v2:172.21.15.134:6800/2987045407 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff44c10ef10 con 0x7ff4340368c0 2024-02-16T22:11:02.169 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mon update... 2024-02-16T22:11:02.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:02.169+0000 7ff4510a3700 1 -- 172.21.15.173:0/885693309 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff4340368c0 msgr2=0x7ff434038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:02.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:02.169+0000 7ff4510a3700 1 --2- 172.21.15.173:0/885693309 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff4340368c0 0x7ff434038d70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff440009990 tx=0x7ff440006e40 comp rx=0 tx=0).stop 2024-02-16T22:11:02.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:02.169+0000 7ff4510a3700 1 -- 172.21.15.173:0/885693309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c0fae80 msgr2=0x7ff44c10cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:02.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:02.169+0000 7ff4510a3700 1 --2- 172.21.15.173:0/885693309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c0fae80 0x7ff44c10cec0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009040 tx=0x7ff43c009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:02.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:02.169+0000 7ff4510a3700 1 -- 172.21.15.173:0/885693309 shutdown_connections 2024-02-16T22:11:02.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:02.169+0000 7ff4510a3700 1 --2- 172.21.15.173:0/885693309 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ff4340368c0 0x7ff434038d70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:02.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:02.169+0000 7ff4510a3700 1 --2- 172.21.15.173:0/885693309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff44c0fae80 0x7ff44c10cec0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:02.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:02.169+0000 7ff4510a3700 1 -- 172.21.15.173:0/885693309 >> 172.21.15.173:0/885693309 conn(0x7ff44c0f6920 msgr2=0x7ff44c0f7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:02.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:02.169+0000 7ff4510a3700 1 -- 172.21.15.173:0/885693309 shutdown_connections 2024-02-16T22:11:02.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:02.169+0000 7ff4510a3700 1 -- 172.21.15.173:0/885693309 wait complete. 2024-02-16T22:11:02.793 DEBUG:teuthology.orchestra.run.smithi173:mon.smithi173> sudo journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi173.service 2024-02-16T22:11:02.796 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:02.796 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:03.067 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:03.115 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:03.172 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:03 smithi134 ceph-mon[28869]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi134:172.21.15.134=smithi134;smithi173:172.21.15.173=smithi173", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:11:03.172 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:03 smithi134 ceph-mon[28869]: Saving service mon spec with placement smithi134:172.21.15.134=smithi134;smithi173:172.21.15.173=smithi173;count:2 2024-02-16T22:11:03.173 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:03 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:04.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:04 smithi134 ceph-mon[28869]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:04.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.581+0000 7fc17d70d700 1 -- 172.21.15.173:0/3538615411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1780fbac0 msgr2=0x7fc1780fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.581+0000 7fc17d70d700 1 --2- 172.21.15.173:0/3538615411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1780fbac0 0x7fc1780fbed0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1700048c0 tx=0x7fc170009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.581+0000 7fc17d70d700 1 -- 172.21.15.173:0/3538615411 shutdown_connections 2024-02-16T22:11:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.581+0000 7fc17d70d700 1 --2- 172.21.15.173:0/3538615411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1780fbac0 0x7fc1780fbed0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.581+0000 7fc17d70d700 1 -- 172.21.15.173:0/3538615411 >> 172.21.15.173:0/3538615411 conn(0x7fc1780f71a0 msgr2=0x7fc1780f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.581+0000 7fc17d70d700 1 -- 172.21.15.173:0/3538615411 shutdown_connections 2024-02-16T22:11:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.581+0000 7fc17d70d700 1 -- 172.21.15.173:0/3538615411 wait complete. 2024-02-16T22:11:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.582+0000 7fc17d70d700 1 Processor -- start 2024-02-16T22:11:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.582+0000 7fc17d70d700 1 -- start start 2024-02-16T22:11:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.582+0000 7fc17d70d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1780fbac0 0x7fc17810be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.582+0000 7fc17d70d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17810c370 con 0x7fc1780fbac0 2024-02-16T22:11:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.582+0000 7fc176ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1780fbac0 0x7fc17810be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.582+0000 7fc176ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1780fbac0 0x7fc17810be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:55882/0 (socket says 172.21.15.173:55882) 2024-02-16T22:11:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.582+0000 7fc176ffd700 1 -- 172.21.15.173:0/395772768 learned_addr learned my addr 172.21.15.173:0/395772768 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:04.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.583+0000 7fc176ffd700 1 -- 172.21.15.173:0/395772768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc170005040 con 0x7fc1780fbac0 2024-02-16T22:11:04.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.583+0000 7fc176ffd700 1 --2- 172.21.15.173:0/395772768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1780fbac0 0x7fc17810be30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc170009680 tx=0x7fc170009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:04.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.583+0000 7fc15f7fe700 1 -- 172.21.15.173:0/395772768 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc17000bed0 con 0x7fc1780fbac0 2024-02-16T22:11:04.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.583+0000 7fc17d70d700 1 -- 172.21.15.173:0/395772768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17810c570 con 0x7fc1780fbac0 2024-02-16T22:11:04.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.583+0000 7fc15f7fe700 1 -- 172.21.15.173:0/395772768 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc17000b5c0 con 0x7fc1780fbac0 2024-02-16T22:11:04.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.583+0000 7fc15f7fe700 1 -- 172.21.15.173:0/395772768 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc17001c5b0 con 0x7fc1780fbac0 2024-02-16T22:11:04.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.583+0000 7fc17d70d700 1 -- 172.21.15.173:0/395772768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17810d130 con 0x7fc1780fbac0 2024-02-16T22:11:04.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.584+0000 7fc15f7fe700 1 -- 172.21.15.173:0/395772768 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fc170013a80 con 0x7fc1780fbac0 2024-02-16T22:11:04.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.584+0000 7fc17d70d700 1 -- 172.21.15.173:0/395772768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17805f5c0 con 0x7fc1780fbac0 2024-02-16T22:11:04.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.584+0000 7fc15f7fe700 1 --2- 172.21.15.173:0/395772768 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fc160036820 0x7fc160038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:04.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.584+0000 7fc15f7fe700 1 -- 172.21.15.173:0/395772768 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc170049af0 con 0x7fc1780fbac0 2024-02-16T22:11:04.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.584+0000 7fc1767fc700 1 --2- 172.21.15.173:0/395772768 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fc160036820 0x7fc160038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:04.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.585+0000 7fc1767fc700 1 --2- 172.21.15.173:0/395772768 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fc160036820 0x7fc160038cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009990 tx=0x7fc16c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:04.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.589+0000 7fc15f7fe700 1 -- 172.21.15.173:0/395772768 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc170011960 con 0x7fc1780fbac0 2024-02-16T22:11:04.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.844+0000 7fc17d70d700 1 -- 172.21.15.173:0/395772768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc17810dd70 con 0x7fc1780fbac0 2024-02-16T22:11:04.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.844+0000 7fc15f7fe700 1 -- 172.21.15.173:0/395772768 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fc170011370 con 0x7fc1780fbac0 2024-02-16T22:11:04.846 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:04.847 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:04.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.847+0000 7fc17d70d700 1 -- 172.21.15.173:0/395772768 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fc160036820 msgr2=0x7fc160038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:04.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.847+0000 7fc17d70d700 1 --2- 172.21.15.173:0/395772768 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fc160036820 0x7fc160038cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009990 tx=0x7fc16c006e40 comp rx=0 tx=0).stop 2024-02-16T22:11:04.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.847+0000 7fc17d70d700 1 -- 172.21.15.173:0/395772768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1780fbac0 msgr2=0x7fc17810be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:04.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.847+0000 7fc17d70d700 1 --2- 172.21.15.173:0/395772768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1780fbac0 0x7fc17810be30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc170009680 tx=0x7fc170009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:04.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.847+0000 7fc17d70d700 1 -- 172.21.15.173:0/395772768 shutdown_connections 2024-02-16T22:11:04.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.847+0000 7fc17d70d700 1 --2- 172.21.15.173:0/395772768 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fc160036820 0x7fc160038cd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:04.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.847+0000 7fc17d70d700 1 --2- 172.21.15.173:0/395772768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1780fbac0 0x7fc17810be30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:04.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.847+0000 7fc17d70d700 1 -- 172.21.15.173:0/395772768 >> 172.21.15.173:0/395772768 conn(0x7fc1780f71a0 msgr2=0x7fc1780f7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:04.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.847+0000 7fc17d70d700 1 -- 172.21.15.173:0/395772768 shutdown_connections 2024-02-16T22:11:04.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:04.847+0000 7fc17d70d700 1 -- 172.21.15.173:0/395772768 wait complete. 2024-02-16T22:11:04.851 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:05 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:05 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:05 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:05 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:05 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:05 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:05 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-16T22:11:05.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:05 smithi134 ceph-mon[28869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-16T22:11:05.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:05 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:05.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:05 smithi134 ceph-mon[28869]: Deploying daemon grafana.smithi134 on smithi134 2024-02-16T22:11:05.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:05 smithi134 ceph-mon[28869]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:05.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:05 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/395772768' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:06.455 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:06.456 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:06.702 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:06.748 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:07.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:06 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:08.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.167+0000 7f0f0fcce700 1 -- 172.21.15.173:0/3486297309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080fe200 msgr2=0x7f0f080fe610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:08.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.167+0000 7f0f0fcce700 1 --2- 172.21.15.173:0/3486297309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080fe200 0x7f0f080fe610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80048c0 tx=0x7f0ef8009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:08.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.167+0000 7f0f0fcce700 1 -- 172.21.15.173:0/3486297309 shutdown_connections 2024-02-16T22:11:08.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.167+0000 7f0f0fcce700 1 --2- 172.21.15.173:0/3486297309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080fe200 0x7f0f080fe610 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:08.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.167+0000 7f0f0fcce700 1 -- 172.21.15.173:0/3486297309 >> 172.21.15.173:0/3486297309 conn(0x7f0f080f69c0 msgr2=0x7f0f080f8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:08.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.168+0000 7f0f0fcce700 1 -- 172.21.15.173:0/3486297309 shutdown_connections 2024-02-16T22:11:08.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.168+0000 7f0f0fcce700 1 -- 172.21.15.173:0/3486297309 wait complete. 2024-02-16T22:11:08.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.168+0000 7f0f0fcce700 1 Processor -- start 2024-02-16T22:11:08.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.168+0000 7f0f0fcce700 1 -- start start 2024-02-16T22:11:08.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.168+0000 7f0f0fcce700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080fe200 0x7f0f080fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:08.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.168+0000 7f0f0fcce700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f080fbec0 con 0x7f0f080fe200 2024-02-16T22:11:08.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.168+0000 7f0f0da6a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080fe200 0x7f0f080fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:08.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.168+0000 7f0f0da6a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080fe200 0x7f0f080fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:55902/0 (socket says 172.21.15.173:55902) 2024-02-16T22:11:08.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.168+0000 7f0f0da6a700 1 -- 172.21.15.173:0/1968826442 learned_addr learned my addr 172.21.15.173:0/1968826442 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:08.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.169+0000 7f0f0da6a700 1 -- 172.21.15.173:0/1968826442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef8005040 con 0x7f0f080fe200 2024-02-16T22:11:08.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.169+0000 7f0f0da6a700 1 --2- 172.21.15.173:0/1968826442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080fe200 0x7f0f080fda40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009300 tx=0x7f0ef8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:08.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.169+0000 7f0efe7fc700 1 -- 172.21.15.173:0/1968826442 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ef8004e60 con 0x7f0f080fe200 2024-02-16T22:11:08.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.169+0000 7f0efe7fc700 1 -- 172.21.15.173:0/1968826442 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ef8009680 con 0x7f0f080fe200 2024-02-16T22:11:08.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.169+0000 7f0f0fcce700 1 -- 172.21.15.173:0/1968826442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f080fc0c0 con 0x7f0f080fe200 2024-02-16T22:11:08.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.169+0000 7f0efe7fc700 1 -- 172.21.15.173:0/1968826442 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ef801c5b0 con 0x7f0f080fe200 2024-02-16T22:11:08.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.169+0000 7f0f0fcce700 1 -- 172.21.15.173:0/1968826442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f080fc5b0 con 0x7f0f080fe200 2024-02-16T22:11:08.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.170+0000 7f0efe7fc700 1 -- 172.21.15.173:0/1968826442 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f0ef801c870 con 0x7f0f080fe200 2024-02-16T22:11:08.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.170+0000 7f0f0fcce700 1 -- 172.21.15.173:0/1968826442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f08106910 con 0x7f0f080fe200 2024-02-16T22:11:08.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.170+0000 7f0efe7fc700 1 --2- 172.21.15.173:0/1968826442 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f0ef4036870 0x7f0ef4038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:08.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.170+0000 7f0efe7fc700 1 -- 172.21.15.173:0/1968826442 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0ef8049b60 con 0x7f0f080fe200 2024-02-16T22:11:08.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.170+0000 7f0f0d269700 1 --2- 172.21.15.173:0/1968826442 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f0ef4036870 0x7f0ef4038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:08.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.170+0000 7f0f0d269700 1 --2- 172.21.15.173:0/1968826442 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f0ef4036870 0x7f0ef4038d20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009990 tx=0x7f0f04006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:08.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.175+0000 7f0efe7fc700 1 -- 172.21.15.173:0/1968826442 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f0ef8025400 con 0x7f0f080fe200 2024-02-16T22:11:08.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:07 smithi134 ceph-mon[28869]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:08.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.430+0000 7f0f0fcce700 1 -- 172.21.15.173:0/1968826442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0f0804bed0 con 0x7f0f080fe200 2024-02-16T22:11:08.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.430+0000 7f0efe7fc700 1 -- 172.21.15.173:0/1968826442 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f0ef8023300 con 0x7f0f080fe200 2024-02-16T22:11:08.432 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:08.432 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:08.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.432+0000 7f0f0fcce700 1 -- 172.21.15.173:0/1968826442 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f0ef4036870 msgr2=0x7f0ef4038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:08.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.432+0000 7f0f0fcce700 1 --2- 172.21.15.173:0/1968826442 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f0ef4036870 0x7f0ef4038d20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009990 tx=0x7f0f04006e40 comp rx=0 tx=0).stop 2024-02-16T22:11:08.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.432+0000 7f0f0fcce700 1 -- 172.21.15.173:0/1968826442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080fe200 msgr2=0x7f0f080fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:08.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.432+0000 7f0f0fcce700 1 --2- 172.21.15.173:0/1968826442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080fe200 0x7f0f080fda40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009300 tx=0x7f0ef8009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:08.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.432+0000 7f0f0fcce700 1 -- 172.21.15.173:0/1968826442 shutdown_connections 2024-02-16T22:11:08.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.432+0000 7f0f0fcce700 1 --2- 172.21.15.173:0/1968826442 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f0ef4036870 0x7f0ef4038d20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:08.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.432+0000 7f0f0fcce700 1 --2- 172.21.15.173:0/1968826442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080fe200 0x7f0f080fda40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:08.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.432+0000 7f0f0fcce700 1 -- 172.21.15.173:0/1968826442 >> 172.21.15.173:0/1968826442 conn(0x7f0f080f69c0 msgr2=0x7f0f080f7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:08.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.432+0000 7f0f0fcce700 1 -- 172.21.15.173:0/1968826442 shutdown_connections 2024-02-16T22:11:08.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:08.432+0000 7f0f0fcce700 1 -- 172.21.15.173:0/1968826442 wait complete. 2024-02-16T22:11:08.435 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:09.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:08 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/1968826442' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:09.942 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:09.942 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:10.186 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:10.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:09 smithi134 ceph-mon[28869]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:10.233 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:11.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.639+0000 7f98d9ce2700 1 -- 172.21.15.173:0/35558938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d40fcbd0 msgr2=0x7f98d40fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:11.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.639+0000 7f98d9ce2700 1 --2- 172.21.15.173:0/35558938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d40fcbd0 0x7f98d40fcfe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f98c40048c0 tx=0x7f98c4009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:11.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.639+0000 7f98d9ce2700 1 -- 172.21.15.173:0/35558938 shutdown_connections 2024-02-16T22:11:11.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.639+0000 7f98d9ce2700 1 --2- 172.21.15.173:0/35558938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d40fcbd0 0x7f98d40fcfe0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:11.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.639+0000 7f98d9ce2700 1 -- 172.21.15.173:0/35558938 >> 172.21.15.173:0/35558938 conn(0x7f98d40f8290 msgr2=0x7f98d40fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:11.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.639+0000 7f98d9ce2700 1 -- 172.21.15.173:0/35558938 shutdown_connections 2024-02-16T22:11:11.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.639+0000 7f98d9ce2700 1 -- 172.21.15.173:0/35558938 wait complete. 2024-02-16T22:11:11.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.639+0000 7f98d9ce2700 1 Processor -- start 2024-02-16T22:11:11.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.640+0000 7f98d9ce2700 1 -- start start 2024-02-16T22:11:11.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.640+0000 7f98d9ce2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d40fcbd0 0x7f98d410cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:11.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.640+0000 7f98d9ce2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d410d400 con 0x7f98d40fcbd0 2024-02-16T22:11:11.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.640+0000 7f98d37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d40fcbd0 0x7f98d410cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:11.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.640+0000 7f98d37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d40fcbd0 0x7f98d410cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:40828/0 (socket says 172.21.15.173:40828) 2024-02-16T22:11:11.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.640+0000 7f98d37fe700 1 -- 172.21.15.173:0/2728960540 learned_addr learned my addr 172.21.15.173:0/2728960540 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:11.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.640+0000 7f98d37fe700 1 -- 172.21.15.173:0/2728960540 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c4005040 con 0x7f98d40fcbd0 2024-02-16T22:11:11.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.640+0000 7f98d37fe700 1 --2- 172.21.15.173:0/2728960540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d40fcbd0 0x7f98d410cec0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009680 tx=0x7f98c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:11.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.640+0000 7f98bbfff700 1 -- 172.21.15.173:0/2728960540 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98c400bed0 con 0x7f98d40fcbd0 2024-02-16T22:11:11.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.641+0000 7f98bbfff700 1 -- 172.21.15.173:0/2728960540 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98c400b5c0 con 0x7f98d40fcbd0 2024-02-16T22:11:11.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.641+0000 7f98d9ce2700 1 -- 172.21.15.173:0/2728960540 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d410d600 con 0x7f98d40fcbd0 2024-02-16T22:11:11.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.641+0000 7f98bbfff700 1 -- 172.21.15.173:0/2728960540 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98c401c5b0 con 0x7f98d40fcbd0 2024-02-16T22:11:11.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.641+0000 7f98d9ce2700 1 -- 172.21.15.173:0/2728960540 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d410e2a0 con 0x7f98d40fcbd0 2024-02-16T22:11:11.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.641+0000 7f98bbfff700 1 -- 172.21.15.173:0/2728960540 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f98c401c820 con 0x7f98d40fcbd0 2024-02-16T22:11:11.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.641+0000 7f98d9ce2700 1 -- 172.21.15.173:0/2728960540 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d405f5c0 con 0x7f98d40fcbd0 2024-02-16T22:11:11.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.642+0000 7f98bbfff700 1 --2- 172.21.15.173:0/2728960540 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f98bc036820 0x7f98bc038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:11.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.642+0000 7f98bbfff700 1 -- 172.21.15.173:0/2728960540 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f98c4049bf0 con 0x7f98d40fcbd0 2024-02-16T22:11:11.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.642+0000 7f98d2ffd700 1 --2- 172.21.15.173:0/2728960540 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f98bc036820 0x7f98bc038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:11.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.642+0000 7f98d2ffd700 1 --2- 172.21.15.173:0/2728960540 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f98bc036820 0x7f98bc038cd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009990 tx=0x7f98c8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:11.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.646+0000 7f98bbfff700 1 -- 172.21.15.173:0/2728960540 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f98c40116f0 con 0x7f98d40fcbd0 2024-02-16T22:11:11.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.904+0000 7f98d9ce2700 1 -- 172.21.15.173:0/2728960540 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f98d410edf0 con 0x7f98d40fcbd0 2024-02-16T22:11:11.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.904+0000 7f98bbfff700 1 -- 172.21.15.173:0/2728960540 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f98c401be90 con 0x7f98d40fcbd0 2024-02-16T22:11:11.906 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:11.906 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.906+0000 7f98d9ce2700 1 -- 172.21.15.173:0/2728960540 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f98bc036820 msgr2=0x7f98bc038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.906+0000 7f98d9ce2700 1 --2- 172.21.15.173:0/2728960540 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f98bc036820 0x7f98bc038cd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009990 tx=0x7f98c8006e40 comp rx=0 tx=0).stop 2024-02-16T22:11:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.906+0000 7f98d9ce2700 1 -- 172.21.15.173:0/2728960540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d40fcbd0 msgr2=0x7f98d410cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.906+0000 7f98d9ce2700 1 --2- 172.21.15.173:0/2728960540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d40fcbd0 0x7f98d410cec0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009680 tx=0x7f98c4009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.906+0000 7f98d9ce2700 1 -- 172.21.15.173:0/2728960540 shutdown_connections 2024-02-16T22:11:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.906+0000 7f98d9ce2700 1 --2- 172.21.15.173:0/2728960540 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f98bc036820 0x7f98bc038cd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.906+0000 7f98d9ce2700 1 --2- 172.21.15.173:0/2728960540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d40fcbd0 0x7f98d410cec0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.906+0000 7f98d9ce2700 1 -- 172.21.15.173:0/2728960540 >> 172.21.15.173:0/2728960540 conn(0x7f98d40f8290 msgr2=0x7f98d40f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:11.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.906+0000 7f98d9ce2700 1 -- 172.21.15.173:0/2728960540 shutdown_connections 2024-02-16T22:11:11.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:11.906+0000 7f98d9ce2700 1 -- 172.21.15.173:0/2728960540 wait complete. 2024-02-16T22:11:11.909 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:12.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:11 smithi134 ceph-mon[28869]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:13.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:12 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/2728960540' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:13.510 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:13.510 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:13.758 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:13.804 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:14.116 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:13 smithi134 ceph-mon[28869]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:15.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.268+0000 7fae3fae5700 1 -- 172.21.15.173:0/3442246536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae380fcbc0 msgr2=0x7fae380fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:15.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.268+0000 7fae3fae5700 1 --2- 172.21.15.173:0/3442246536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae380fcbc0 0x7fae380fcfd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fae34009c60 tx=0x7fae34004d10 comp rx=0 tx=0).stop 2024-02-16T22:11:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.268+0000 7fae3fae5700 1 -- 172.21.15.173:0/3442246536 shutdown_connections 2024-02-16T22:11:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.268+0000 7fae3fae5700 1 --2- 172.21.15.173:0/3442246536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae380fcbc0 0x7fae380fcfd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.268+0000 7fae3fae5700 1 -- 172.21.15.173:0/3442246536 >> 172.21.15.173:0/3442246536 conn(0x7fae380f82a0 msgr2=0x7fae380fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.268+0000 7fae3fae5700 1 -- 172.21.15.173:0/3442246536 shutdown_connections 2024-02-16T22:11:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.268+0000 7fae3fae5700 1 -- 172.21.15.173:0/3442246536 wait complete. 2024-02-16T22:11:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.269+0000 7fae3fae5700 1 Processor -- start 2024-02-16T22:11:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.269+0000 7fae3fae5700 1 -- start start 2024-02-16T22:11:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.269+0000 7fae3fae5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae380fcbc0 0x7fae3810ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.269+0000 7fae3fae5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3810d3d0 con 0x7fae380fcbc0 2024-02-16T22:11:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.269+0000 7fae3d881700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae380fcbc0 0x7fae3810ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.269+0000 7fae3d881700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae380fcbc0 0x7fae3810ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:40836/0 (socket says 172.21.15.173:40836) 2024-02-16T22:11:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.269+0000 7fae3d881700 1 -- 172.21.15.173:0/1282817621 learned_addr learned my addr 172.21.15.173:0/1282817621 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.269+0000 7fae3d881700 1 -- 172.21.15.173:0/1282817621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae34009940 con 0x7fae380fcbc0 2024-02-16T22:11:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.269+0000 7fae3d881700 1 --2- 172.21.15.173:0/1282817621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae380fcbc0 0x7fae3810ce90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fae34015040 tx=0x7fae34004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:15.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.270+0000 7fae2e7fc700 1 -- 172.21.15.173:0/1282817621 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae34007c80 con 0x7fae380fcbc0 2024-02-16T22:11:15.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.270+0000 7fae3fae5700 1 -- 172.21.15.173:0/1282817621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3810d5d0 con 0x7fae380fcbc0 2024-02-16T22:11:15.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.270+0000 7fae2e7fc700 1 -- 172.21.15.173:0/1282817621 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae3401d910 con 0x7fae380fcbc0 2024-02-16T22:11:15.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.270+0000 7fae2e7fc700 1 -- 172.21.15.173:0/1282817621 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae340129f0 con 0x7fae380fcbc0 2024-02-16T22:11:15.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.270+0000 7fae3fae5700 1 -- 172.21.15.173:0/1282817621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3810e270 con 0x7fae380fcbc0 2024-02-16T22:11:15.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.270+0000 7fae2e7fc700 1 -- 172.21.15.173:0/1282817621 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fae34019040 con 0x7fae380fcbc0 2024-02-16T22:11:15.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.271+0000 7fae3fae5700 1 -- 172.21.15.173:0/1282817621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3805f5c0 con 0x7fae380fcbc0 2024-02-16T22:11:15.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.271+0000 7fae2e7fc700 1 --2- 172.21.15.173:0/1282817621 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fae24036870 0x7fae24038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:15.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.271+0000 7fae2e7fc700 1 -- 172.21.15.173:0/1282817621 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fae3404a5b0 con 0x7fae380fcbc0 2024-02-16T22:11:15.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.271+0000 7fae3d080700 1 --2- 172.21.15.173:0/1282817621 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fae24036870 0x7fae24038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:15.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.271+0000 7fae3d080700 1 --2- 172.21.15.173:0/1282817621 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fae24036870 0x7fae24038d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fae28009990 tx=0x7fae28006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:15.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.275+0000 7fae2e7fc700 1 -- 172.21.15.173:0/1282817621 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fae3402e530 con 0x7fae380fcbc0 2024-02-16T22:11:15.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.532+0000 7fae3fae5700 1 -- 172.21.15.173:0/1282817621 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fae3810ed60 con 0x7fae380fcbc0 2024-02-16T22:11:15.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.532+0000 7fae2e7fc700 1 -- 172.21.15.173:0/1282817621 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fae34017030 con 0x7fae380fcbc0 2024-02-16T22:11:15.535 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:15.536 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:15.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.535+0000 7fae3fae5700 1 -- 172.21.15.173:0/1282817621 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fae24036870 msgr2=0x7fae24038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:15.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.535+0000 7fae3fae5700 1 --2- 172.21.15.173:0/1282817621 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fae24036870 0x7fae24038d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fae28009990 tx=0x7fae28006e40 comp rx=0 tx=0).stop 2024-02-16T22:11:15.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.535+0000 7fae3fae5700 1 -- 172.21.15.173:0/1282817621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae380fcbc0 msgr2=0x7fae3810ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:15.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.535+0000 7fae3fae5700 1 --2- 172.21.15.173:0/1282817621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae380fcbc0 0x7fae3810ce90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fae34015040 tx=0x7fae34004d10 comp rx=0 tx=0).stop 2024-02-16T22:11:15.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.535+0000 7fae3fae5700 1 -- 172.21.15.173:0/1282817621 shutdown_connections 2024-02-16T22:11:15.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.535+0000 7fae3fae5700 1 --2- 172.21.15.173:0/1282817621 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fae24036870 0x7fae24038d20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:15.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.535+0000 7fae3fae5700 1 --2- 172.21.15.173:0/1282817621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae380fcbc0 0x7fae3810ce90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:15.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.535+0000 7fae3fae5700 1 -- 172.21.15.173:0/1282817621 >> 172.21.15.173:0/1282817621 conn(0x7fae380f82a0 msgr2=0x7fae380f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:15.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.535+0000 7fae3fae5700 1 -- 172.21.15.173:0/1282817621 shutdown_connections 2024-02-16T22:11:15.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:15.535+0000 7fae3fae5700 1 -- 172.21.15.173:0/1282817621 wait complete. 2024-02-16T22:11:15.538 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:16.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:15 smithi134 ceph-mon[28869]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:16.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:15 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/1282817621' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:17.130 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:17.130 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:17.379 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:17.426 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:17.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:17 smithi134 ceph-mon[28869]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:18.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.924+0000 7ffa80dee700 1 -- 172.21.15.173:0/2685831186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c0fbac0 msgr2=0x7ffa7c0fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:18.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.924+0000 7ffa80dee700 1 --2- 172.21.15.173:0/2685831186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c0fbac0 0x7ffa7c0fbed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0048c0 tx=0x7ffa6c009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:18.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.924+0000 7ffa80dee700 1 -- 172.21.15.173:0/2685831186 shutdown_connections 2024-02-16T22:11:18.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.924+0000 7ffa80dee700 1 --2- 172.21.15.173:0/2685831186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c0fbac0 0x7ffa7c0fbed0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:18.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.924+0000 7ffa80dee700 1 -- 172.21.15.173:0/2685831186 >> 172.21.15.173:0/2685831186 conn(0x7ffa7c0f71a0 msgr2=0x7ffa7c0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:18.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.924+0000 7ffa80dee700 1 -- 172.21.15.173:0/2685831186 shutdown_connections 2024-02-16T22:11:18.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.924+0000 7ffa80dee700 1 -- 172.21.15.173:0/2685831186 wait complete. 2024-02-16T22:11:18.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.925+0000 7ffa80dee700 1 Processor -- start 2024-02-16T22:11:18.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.925+0000 7ffa80dee700 1 -- start start 2024-02-16T22:11:18.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.925+0000 7ffa80dee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c0fbac0 0x7ffa7c10ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:18.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.925+0000 7ffa80dee700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c10d410 con 0x7ffa7c0fbac0 2024-02-16T22:11:18.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.925+0000 7ffa7a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c0fbac0 0x7ffa7c10ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:18.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.925+0000 7ffa7a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c0fbac0 0x7ffa7c10ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:40856/0 (socket says 172.21.15.173:40856) 2024-02-16T22:11:18.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.925+0000 7ffa7a59c700 1 -- 172.21.15.173:0/2320406993 learned_addr learned my addr 172.21.15.173:0/2320406993 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:18.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.925+0000 7ffa7a59c700 1 -- 172.21.15.173:0/2320406993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c005040 con 0x7ffa7c0fbac0 2024-02-16T22:11:18.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.926+0000 7ffa7a59c700 1 --2- 172.21.15.173:0/2320406993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c0fbac0 0x7ffa7c10ced0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009680 tx=0x7ffa6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:18.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.926+0000 7ffa72ffd700 1 -- 172.21.15.173:0/2320406993 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa6c00bed0 con 0x7ffa7c0fbac0 2024-02-16T22:11:18.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.926+0000 7ffa72ffd700 1 -- 172.21.15.173:0/2320406993 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa6c00b5c0 con 0x7ffa7c0fbac0 2024-02-16T22:11:18.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.926+0000 7ffa80dee700 1 -- 172.21.15.173:0/2320406993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c10d610 con 0x7ffa7c0fbac0 2024-02-16T22:11:18.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.926+0000 7ffa72ffd700 1 -- 172.21.15.173:0/2320406993 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa6c01c5b0 con 0x7ffa7c0fbac0 2024-02-16T22:11:18.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.926+0000 7ffa80dee700 1 -- 172.21.15.173:0/2320406993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c10e2b0 con 0x7ffa7c0fbac0 2024-02-16T22:11:18.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.927+0000 7ffa72ffd700 1 -- 172.21.15.173:0/2320406993 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7ffa6c013420 con 0x7ffa7c0fbac0 2024-02-16T22:11:18.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.927+0000 7ffa80dee700 1 -- 172.21.15.173:0/2320406993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7c05f5c0 con 0x7ffa7c0fbac0 2024-02-16T22:11:18.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.927+0000 7ffa72ffd700 1 --2- 172.21.15.173:0/2320406993 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ffa68036820 0x7ffa68038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:18.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.927+0000 7ffa72ffd700 1 -- 172.21.15.173:0/2320406993 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ffa6c049ad0 con 0x7ffa7c0fbac0 2024-02-16T22:11:18.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.927+0000 7ffa79d9b700 1 --2- 172.21.15.173:0/2320406993 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ffa68036820 0x7ffa68038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:18.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.928+0000 7ffa79d9b700 1 --2- 172.21.15.173:0/2320406993 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ffa68036820 0x7ffa68038cd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009990 tx=0x7ffa64006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:18.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:18.932+0000 7ffa72ffd700 1 -- 172.21.15.173:0/2320406993 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ffa6c013a80 con 0x7ffa7c0fbac0 2024-02-16T22:11:19.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:19.186+0000 7ffa80dee700 1 -- 172.21.15.173:0/2320406993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ffa7c05f5c0 con 0x7ffa7c0fbac0 2024-02-16T22:11:19.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:19.187+0000 7ffa72ffd700 1 -- 172.21.15.173:0/2320406993 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ffa6c011370 con 0x7ffa7c0fbac0 2024-02-16T22:11:19.190 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:19.190 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:19.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:19.189+0000 7ffa80dee700 1 -- 172.21.15.173:0/2320406993 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ffa68036820 msgr2=0x7ffa68038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:19.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:19.189+0000 7ffa80dee700 1 --2- 172.21.15.173:0/2320406993 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ffa68036820 0x7ffa68038cd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009990 tx=0x7ffa64006e40 comp rx=0 tx=0).stop 2024-02-16T22:11:19.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:19.189+0000 7ffa80dee700 1 -- 172.21.15.173:0/2320406993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c0fbac0 msgr2=0x7ffa7c10ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:19.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:19.189+0000 7ffa80dee700 1 --2- 172.21.15.173:0/2320406993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c0fbac0 0x7ffa7c10ced0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009680 tx=0x7ffa6c009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:19.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:19.189+0000 7ffa80dee700 1 -- 172.21.15.173:0/2320406993 shutdown_connections 2024-02-16T22:11:19.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:19.189+0000 7ffa80dee700 1 --2- 172.21.15.173:0/2320406993 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7ffa68036820 0x7ffa68038cd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:19.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:19.189+0000 7ffa80dee700 1 --2- 172.21.15.173:0/2320406993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c0fbac0 0x7ffa7c10ced0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:19.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:19.189+0000 7ffa80dee700 1 -- 172.21.15.173:0/2320406993 >> 172.21.15.173:0/2320406993 conn(0x7ffa7c0f71a0 msgr2=0x7ffa7c066410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:19.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:19.189+0000 7ffa80dee700 1 -- 172.21.15.173:0/2320406993 shutdown_connections 2024-02-16T22:11:19.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:19.189+0000 7ffa80dee700 1 -- 172.21.15.173:0/2320406993 wait complete. 2024-02-16T22:11:19.193 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:20.083 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:19 smithi134 ceph-mon[28869]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:20.083 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:19 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/2320406993' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:20.727 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:20.727 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:20.975 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:21.022 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:21.864 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:21 smithi134 ceph-mon[28869]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:22.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.481+0000 7f2867e52700 1 -- 172.21.15.173:0/2329960765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28600fcbd0 msgr2=0x7f28600fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:22.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.481+0000 7f2867e52700 1 --2- 172.21.15.173:0/2329960765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28600fcbd0 0x7f28600fcfe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f285c0048c0 tx=0x7f285c009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:22.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.481+0000 7f2867e52700 1 -- 172.21.15.173:0/2329960765 shutdown_connections 2024-02-16T22:11:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.481+0000 7f2867e52700 1 --2- 172.21.15.173:0/2329960765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28600fcbd0 0x7f28600fcfe0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.481+0000 7f2867e52700 1 -- 172.21.15.173:0/2329960765 >> 172.21.15.173:0/2329960765 conn(0x7f28600f8270 msgr2=0x7f28600fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.481+0000 7f2867e52700 1 -- 172.21.15.173:0/2329960765 shutdown_connections 2024-02-16T22:11:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.481+0000 7f2867e52700 1 -- 172.21.15.173:0/2329960765 wait complete. 2024-02-16T22:11:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.481+0000 7f2867e52700 1 Processor -- start 2024-02-16T22:11:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.482+0000 7f2867e52700 1 -- start start 2024-02-16T22:11:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.482+0000 7f2867e52700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28600fcbd0 0x7f286010ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.482+0000 7f2867e52700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286010d410 con 0x7f28600fcbd0 2024-02-16T22:11:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.482+0000 7f2865bee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28600fcbd0 0x7f286010ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.482+0000 7f2865bee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28600fcbd0 0x7f286010ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:51796/0 (socket says 172.21.15.173:51796) 2024-02-16T22:11:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.482+0000 7f2865bee700 1 -- 172.21.15.173:0/4259658103 learned_addr learned my addr 172.21.15.173:0/4259658103 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.482+0000 7f2865bee700 1 -- 172.21.15.173:0/4259658103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c005040 con 0x7f28600fcbd0 2024-02-16T22:11:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.482+0000 7f2865bee700 1 --2- 172.21.15.173:0/4259658103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28600fcbd0 0x7f286010ced0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f285c009680 tx=0x7f285c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.482+0000 7f28567fc700 1 -- 172.21.15.173:0/4259658103 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f285c00bed0 con 0x7f28600fcbd0 2024-02-16T22:11:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.482+0000 7f28567fc700 1 -- 172.21.15.173:0/4259658103 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f285c00b5c0 con 0x7f28600fcbd0 2024-02-16T22:11:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.482+0000 7f28567fc700 1 -- 172.21.15.173:0/4259658103 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f285c01c5b0 con 0x7f28600fcbd0 2024-02-16T22:11:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.482+0000 7f2867e52700 1 -- 172.21.15.173:0/4259658103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286010d610 con 0x7f28600fcbd0 2024-02-16T22:11:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.483+0000 7f2867e52700 1 -- 172.21.15.173:0/4259658103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286010e2b0 con 0x7f28600fcbd0 2024-02-16T22:11:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.483+0000 7f28567fc700 1 -- 172.21.15.173:0/4259658103 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f285c013420 con 0x7f28600fcbd0 2024-02-16T22:11:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.483+0000 7f28567fc700 1 --2- 172.21.15.173:0/4259658103 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f284c036820 0x7f284c038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.483+0000 7f28567fc700 1 -- 172.21.15.173:0/4259658103 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f285c049b90 con 0x7f28600fcbd0 2024-02-16T22:11:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.483+0000 7f2867e52700 1 -- 172.21.15.173:0/4259658103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286005f5c0 con 0x7f28600fcbd0 2024-02-16T22:11:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.484+0000 7f28653ed700 1 --2- 172.21.15.173:0/4259658103 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f284c036820 0x7f284c038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:22.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.484+0000 7f28653ed700 1 --2- 172.21.15.173:0/4259658103 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f284c036820 0x7f284c038cd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2850009990 tx=0x7f2850006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:22.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.488+0000 7f28567fc700 1 -- 172.21.15.173:0/4259658103 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f285c013a80 con 0x7f28600fcbd0 2024-02-16T22:11:22.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.741+0000 7f2867e52700 1 -- 172.21.15.173:0/4259658103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f286010ecc0 con 0x7f28600fcbd0 2024-02-16T22:11:22.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.742+0000 7f28567fc700 1 -- 172.21.15.173:0/4259658103 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f285c011370 con 0x7f28600fcbd0 2024-02-16T22:11:22.745 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:22.745 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.744+0000 7f2867e52700 1 -- 172.21.15.173:0/4259658103 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f284c036820 msgr2=0x7f284c038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.744+0000 7f2867e52700 1 --2- 172.21.15.173:0/4259658103 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f284c036820 0x7f284c038cd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2850009990 tx=0x7f2850006e40 comp rx=0 tx=0).stop 2024-02-16T22:11:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.744+0000 7f2867e52700 1 -- 172.21.15.173:0/4259658103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28600fcbd0 msgr2=0x7f286010ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.744+0000 7f2867e52700 1 --2- 172.21.15.173:0/4259658103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28600fcbd0 0x7f286010ced0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f285c009680 tx=0x7f285c009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.744+0000 7f2867e52700 1 -- 172.21.15.173:0/4259658103 shutdown_connections 2024-02-16T22:11:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.744+0000 7f2867e52700 1 --2- 172.21.15.173:0/4259658103 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f284c036820 0x7f284c038cd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.744+0000 7f2867e52700 1 --2- 172.21.15.173:0/4259658103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28600fcbd0 0x7f286010ced0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.744+0000 7f2867e52700 1 -- 172.21.15.173:0/4259658103 >> 172.21.15.173:0/4259658103 conn(0x7f28600f8270 msgr2=0x7f28600f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.744+0000 7f2867e52700 1 -- 172.21.15.173:0/4259658103 shutdown_connections 2024-02-16T22:11:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:22.744+0000 7f2867e52700 1 -- 172.21.15.173:0/4259658103 wait complete. 2024-02-16T22:11:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:23.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:22 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:22 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:22 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:22 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:22 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:22 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:22 smithi134 ceph-mon[28869]: Deploying daemon prometheus.smithi134 on smithi134 2024-02-16T22:11:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:22 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/4259658103' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:24.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:23 smithi134 ceph-mon[28869]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:24.375 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:24.375 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:24.626 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:26.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.106+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/707505428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a40fcb60 msgr2=0x7fb2a40fcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:26.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.106+0000 7fb2ac7bb700 1 --2- 172.21.15.173:0/707505428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a40fcb60 0x7fb2a40fcf70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009c60 tx=0x7fb29c004d10 comp rx=0 tx=0).stop 2024-02-16T22:11:26.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.106+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/707505428 shutdown_connections 2024-02-16T22:11:26.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.106+0000 7fb2ac7bb700 1 --2- 172.21.15.173:0/707505428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a40fcb60 0x7fb2a40fcf70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:26.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.106+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/707505428 >> 172.21.15.173:0/707505428 conn(0x7fb2a40f8200 msgr2=0x7fb2a40fa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:26.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.106+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/707505428 shutdown_connections 2024-02-16T22:11:26.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.106+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/707505428 wait complete. 2024-02-16T22:11:26.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.107+0000 7fb2ac7bb700 1 Processor -- start 2024-02-16T22:11:26.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.107+0000 7fb2ac7bb700 1 -- start start 2024-02-16T22:11:26.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.107+0000 7fb2ac7bb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a40fcb60 0x7fb2a410cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:26.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.107+0000 7fb2ac7bb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a410d3e0 con 0x7fb2a40fcb60 2024-02-16T22:11:26.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.107+0000 7fb2aa557700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a40fcb60 0x7fb2a410cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:26.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.107+0000 7fb2aa557700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a40fcb60 0x7fb2a410cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:51806/0 (socket says 172.21.15.173:51806) 2024-02-16T22:11:26.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.107+0000 7fb2aa557700 1 -- 172.21.15.173:0/3365141973 learned_addr learned my addr 172.21.15.173:0/3365141973 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:26.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.108+0000 7fb2aa557700 1 -- 172.21.15.173:0/3365141973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c009940 con 0x7fb2a40fcb60 2024-02-16T22:11:26.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.108+0000 7fb2aa557700 1 --2- 172.21.15.173:0/3365141973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a40fcb60 0x7fb2a410cea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb29c015040 tx=0x7fb29c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:26.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.108+0000 7fb2a2ffd700 1 -- 172.21.15.173:0/3365141973 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb29c007c80 con 0x7fb2a40fcb60 2024-02-16T22:11:26.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.108+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/3365141973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a410d5e0 con 0x7fb2a40fcb60 2024-02-16T22:11:26.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.108+0000 7fb2a2ffd700 1 -- 172.21.15.173:0/3365141973 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb29c01d910 con 0x7fb2a40fcb60 2024-02-16T22:11:26.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.108+0000 7fb2a2ffd700 1 -- 172.21.15.173:0/3365141973 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb29c0129f0 con 0x7fb2a40fcb60 2024-02-16T22:11:26.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.108+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/3365141973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a410e280 con 0x7fb2a40fcb60 2024-02-16T22:11:26.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.109+0000 7fb2a2ffd700 1 -- 172.21.15.173:0/3365141973 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fb29c019040 con 0x7fb2a40fcb60 2024-02-16T22:11:26.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.109+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/3365141973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a405f5c0 con 0x7fb2a40fcb60 2024-02-16T22:11:26.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.109+0000 7fb2a2ffd700 1 --2- 172.21.15.173:0/3365141973 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fb28c0368d0 0x7fb28c038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:26.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.109+0000 7fb2a2ffd700 1 -- 172.21.15.173:0/3365141973 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb29c04a4f0 con 0x7fb2a40fcb60 2024-02-16T22:11:26.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.109+0000 7fb2a9d56700 1 --2- 172.21.15.173:0/3365141973 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fb28c0368d0 0x7fb28c038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:26.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.110+0000 7fb2a9d56700 1 --2- 172.21.15.173:0/3365141973 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fb28c0368d0 0x7fb28c038d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb298009990 tx=0x7fb298006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:26.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.114+0000 7fb2a2ffd700 1 -- 172.21.15.173:0/3365141973 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb29c02eb40 con 0x7fb2a40fcb60 2024-02-16T22:11:26.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:25 smithi134 ceph-mon[28869]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:26.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:25 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:26.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.370+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/3365141973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb2a410ed70 con 0x7fb2a40fcb60 2024-02-16T22:11:26.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.370+0000 7fb2a2ffd700 1 -- 172.21.15.173:0/3365141973 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fb29c017070 con 0x7fb2a40fcb60 2024-02-16T22:11:26.372 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:26.372 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:26.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.372+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/3365141973 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fb28c0368d0 msgr2=0x7fb28c038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:26.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.372+0000 7fb2ac7bb700 1 --2- 172.21.15.173:0/3365141973 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fb28c0368d0 0x7fb28c038d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb298009990 tx=0x7fb298006e40 comp rx=0 tx=0).stop 2024-02-16T22:11:26.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.372+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/3365141973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a40fcb60 msgr2=0x7fb2a410cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:26.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.372+0000 7fb2ac7bb700 1 --2- 172.21.15.173:0/3365141973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a40fcb60 0x7fb2a410cea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb29c015040 tx=0x7fb29c004d10 comp rx=0 tx=0).stop 2024-02-16T22:11:26.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.372+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/3365141973 shutdown_connections 2024-02-16T22:11:26.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.372+0000 7fb2ac7bb700 1 --2- 172.21.15.173:0/3365141973 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fb28c0368d0 0x7fb28c038d80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:26.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.372+0000 7fb2ac7bb700 1 --2- 172.21.15.173:0/3365141973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a40fcb60 0x7fb2a410cea0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:26.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.372+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/3365141973 >> 172.21.15.173:0/3365141973 conn(0x7fb2a40f8200 msgr2=0x7fb2a40f8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:26.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.372+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/3365141973 shutdown_connections 2024-02-16T22:11:26.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:26.372+0000 7fb2ac7bb700 1 -- 172.21.15.173:0/3365141973 wait complete. 2024-02-16T22:11:26.374 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:27.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:26 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/3365141973' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:27.834 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:27.835 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:28.084 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:28.132 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:28.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:27 smithi134 ceph-mon[28869]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:29.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.516+0000 7f4dea33a700 1 -- 172.21.15.173:0/3556180236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de40fd700 msgr2=0x7f4de40ffae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:29.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.516+0000 7f4dea33a700 1 --2- 172.21.15.173:0/3556180236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de40fd700 0x7f4de40ffae0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4dd80048c0 tx=0x7f4dd8009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:29.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.516+0000 7f4dea33a700 1 -- 172.21.15.173:0/3556180236 shutdown_connections 2024-02-16T22:11:29.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.516+0000 7f4dea33a700 1 --2- 172.21.15.173:0/3556180236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de40fd700 0x7f4de40ffae0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:29.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.516+0000 7f4dea33a700 1 -- 172.21.15.173:0/3556180236 >> 172.21.15.173:0/3556180236 conn(0x7f4de40f71a0 msgr2=0x7f4de40f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:29.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.516+0000 7f4dea33a700 1 -- 172.21.15.173:0/3556180236 shutdown_connections 2024-02-16T22:11:29.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.516+0000 7f4dea33a700 1 -- 172.21.15.173:0/3556180236 wait complete. 2024-02-16T22:11:29.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.517+0000 7f4dea33a700 1 Processor -- start 2024-02-16T22:11:29.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.517+0000 7f4dea33a700 1 -- start start 2024-02-16T22:11:29.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.517+0000 7f4dea33a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de40fd700 0x7f4de410ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:29.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.517+0000 7f4dea33a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de410d3b0 con 0x7f4de40fd700 2024-02-16T22:11:29.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.517+0000 7f4de3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de40fd700 0x7f4de410ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:29.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.517+0000 7f4de3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de40fd700 0x7f4de410ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:51818/0 (socket says 172.21.15.173:51818) 2024-02-16T22:11:29.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.517+0000 7f4de3fff700 1 -- 172.21.15.173:0/4164240161 learned_addr learned my addr 172.21.15.173:0/4164240161 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:29.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.518+0000 7f4de3fff700 1 -- 172.21.15.173:0/4164240161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd8005040 con 0x7f4de40fd700 2024-02-16T22:11:29.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.518+0000 7f4de3fff700 1 --2- 172.21.15.173:0/4164240161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de40fd700 0x7f4de410ce70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009680 tx=0x7f4dd8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:29.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.518+0000 7f4de0ff9700 1 -- 172.21.15.173:0/4164240161 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dd800b5c0 con 0x7f4de40fd700 2024-02-16T22:11:29.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.518+0000 7f4dea33a700 1 -- 172.21.15.173:0/4164240161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de410d5b0 con 0x7f4de40fd700 2024-02-16T22:11:29.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.518+0000 7f4de0ff9700 1 -- 172.21.15.173:0/4164240161 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4dd8004e60 con 0x7f4de40fd700 2024-02-16T22:11:29.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.518+0000 7f4dea33a700 1 -- 172.21.15.173:0/4164240161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de410e250 con 0x7f4de40fd700 2024-02-16T22:11:29.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.518+0000 7f4de0ff9700 1 -- 172.21.15.173:0/4164240161 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dd801c590 con 0x7f4de40fd700 2024-02-16T22:11:29.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.519+0000 7f4de0ff9700 1 -- 172.21.15.173:0/4164240161 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f4dd8013420 con 0x7f4de40fd700 2024-02-16T22:11:29.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.519+0000 7f4dea33a700 1 -- 172.21.15.173:0/4164240161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de405f5c0 con 0x7f4de40fd700 2024-02-16T22:11:29.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.519+0000 7f4de0ff9700 1 --2- 172.21.15.173:0/4164240161 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f4dcc036870 0x7f4dcc038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:29.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.519+0000 7f4de0ff9700 1 -- 172.21.15.173:0/4164240161 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4dd8049ba0 con 0x7f4de40fd700 2024-02-16T22:11:29.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.519+0000 7f4de37fe700 1 --2- 172.21.15.173:0/4164240161 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f4dcc036870 0x7f4dcc038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:29.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.519+0000 7f4de37fe700 1 --2- 172.21.15.173:0/4164240161 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f4dcc036870 0x7f4dcc038d20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009990 tx=0x7f4dd4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:29.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.524+0000 7f4de0ff9700 1 -- 172.21.15.173:0/4164240161 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4dd8025400 con 0x7f4de40fd700 2024-02-16T22:11:29.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.778+0000 7f4dea33a700 1 -- 172.21.15.173:0/4164240161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4de410edc0 con 0x7f4de40fd700 2024-02-16T22:11:29.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.779+0000 7f4de0ff9700 1 -- 172.21.15.173:0/4164240161 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f4dd8011370 con 0x7f4de40fd700 2024-02-16T22:11:29.781 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:29.781 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:29.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.781+0000 7f4dea33a700 1 -- 172.21.15.173:0/4164240161 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f4dcc036870 msgr2=0x7f4dcc038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:29.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.781+0000 7f4dea33a700 1 --2- 172.21.15.173:0/4164240161 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f4dcc036870 0x7f4dcc038d20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009990 tx=0x7f4dd4006e40 comp rx=0 tx=0).stop 2024-02-16T22:11:29.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.781+0000 7f4dea33a700 1 -- 172.21.15.173:0/4164240161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de40fd700 msgr2=0x7f4de410ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:29.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.781+0000 7f4dea33a700 1 --2- 172.21.15.173:0/4164240161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de40fd700 0x7f4de410ce70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009680 tx=0x7f4dd8009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:29.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.781+0000 7f4dea33a700 1 -- 172.21.15.173:0/4164240161 shutdown_connections 2024-02-16T22:11:29.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.781+0000 7f4dea33a700 1 --2- 172.21.15.173:0/4164240161 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f4dcc036870 0x7f4dcc038d20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:29.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.781+0000 7f4dea33a700 1 --2- 172.21.15.173:0/4164240161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de40fd700 0x7f4de410ce70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:29.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.781+0000 7f4dea33a700 1 -- 172.21.15.173:0/4164240161 >> 172.21.15.173:0/4164240161 conn(0x7f4de40f71a0 msgr2=0x7f4de40f7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:29.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.781+0000 7f4dea33a700 1 -- 172.21.15.173:0/4164240161 shutdown_connections 2024-02-16T22:11:29.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:29.781+0000 7f4dea33a700 1 -- 172.21.15.173:0/4164240161 wait complete. 2024-02-16T22:11:29.784 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:30.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:29 smithi134 ceph-mon[28869]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:30.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:29 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/4164240161' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:31.273 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:31.273 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:31.522 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:31.569 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:32.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:31 smithi134 ceph-mon[28869]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:32.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.962+0000 7fa830b8e700 1 -- 172.21.15.173:0/4270239035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0fbac0 msgr2=0x7fa82c0fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:32.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.962+0000 7fa830b8e700 1 --2- 172.21.15.173:0/4270239035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0fbac0 0x7fa82c0fbed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0048c0 tx=0x7fa81c009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:32.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.962+0000 7fa830b8e700 1 -- 172.21.15.173:0/4270239035 shutdown_connections 2024-02-16T22:11:32.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.962+0000 7fa830b8e700 1 --2- 172.21.15.173:0/4270239035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0fbac0 0x7fa82c0fbed0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:32.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.962+0000 7fa830b8e700 1 -- 172.21.15.173:0/4270239035 >> 172.21.15.173:0/4270239035 conn(0x7fa82c0f71a0 msgr2=0x7fa82c0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:32.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.962+0000 7fa830b8e700 1 -- 172.21.15.173:0/4270239035 shutdown_connections 2024-02-16T22:11:32.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.962+0000 7fa830b8e700 1 -- 172.21.15.173:0/4270239035 wait complete. 2024-02-16T22:11:32.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.962+0000 7fa830b8e700 1 Processor -- start 2024-02-16T22:11:32.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.963+0000 7fa830b8e700 1 -- start start 2024-02-16T22:11:32.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.963+0000 7fa830b8e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0fbac0 0x7fa82c101ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:32.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.963+0000 7fa830b8e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c100020 con 0x7fa82c0fbac0 2024-02-16T22:11:32.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.963+0000 7fa82a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0fbac0 0x7fa82c101ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:32.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.963+0000 7fa82a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0fbac0 0x7fa82c101ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:38996/0 (socket says 172.21.15.173:38996) 2024-02-16T22:11:32.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.963+0000 7fa82a59c700 1 -- 172.21.15.173:0/1865221583 learned_addr learned my addr 172.21.15.173:0/1865221583 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:32.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.963+0000 7fa82a59c700 1 -- 172.21.15.173:0/1865221583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c005040 con 0x7fa82c0fbac0 2024-02-16T22:11:32.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.963+0000 7fa82a59c700 1 --2- 172.21.15.173:0/1865221583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0fbac0 0x7fa82c101ba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009680 tx=0x7fa81c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:32.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.964+0000 7fa8237fe700 1 -- 172.21.15.173:0/1865221583 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa81c00bed0 con 0x7fa82c0fbac0 2024-02-16T22:11:32.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.964+0000 7fa830b8e700 1 -- 172.21.15.173:0/1865221583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82c100220 con 0x7fa82c0fbac0 2024-02-16T22:11:32.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.964+0000 7fa8237fe700 1 -- 172.21.15.173:0/1865221583 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa81c00b5c0 con 0x7fa82c0fbac0 2024-02-16T22:11:32.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.964+0000 7fa8237fe700 1 -- 172.21.15.173:0/1865221583 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa81c01c5b0 con 0x7fa82c0fbac0 2024-02-16T22:11:32.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.964+0000 7fa830b8e700 1 -- 172.21.15.173:0/1865221583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c100710 con 0x7fa82c0fbac0 2024-02-16T22:11:32.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.965+0000 7fa830b8e700 1 -- 172.21.15.173:0/1865221583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82c106990 con 0x7fa82c0fbac0 2024-02-16T22:11:32.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.965+0000 7fa8237fe700 1 -- 172.21.15.173:0/1865221583 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fa81c013a80 con 0x7fa82c0fbac0 2024-02-16T22:11:32.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.965+0000 7fa8237fe700 1 --2- 172.21.15.173:0/1865221583 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fa818036820 0x7fa818038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:32.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.965+0000 7fa8237fe700 1 -- 172.21.15.173:0/1865221583 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa81c049af0 con 0x7fa82c0fbac0 2024-02-16T22:11:32.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.965+0000 7fa821d9b700 1 --2- 172.21.15.173:0/1865221583 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fa818036820 0x7fa818038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:32.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.966+0000 7fa821d9b700 1 --2- 172.21.15.173:0/1865221583 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fa818036820 0x7fa818038cd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa814009990 tx=0x7fa814006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:32.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:32.970+0000 7fa8237fe700 1 -- 172.21.15.173:0/1865221583 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa81c011960 con 0x7fa82c0fbac0 2024-02-16T22:11:33.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:33.223+0000 7fa830b8e700 1 -- 172.21.15.173:0/1865221583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa82c04bed0 con 0x7fa82c0fbac0 2024-02-16T22:11:33.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:33.224+0000 7fa8237fe700 1 -- 172.21.15.173:0/1865221583 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa81c011370 con 0x7fa82c0fbac0 2024-02-16T22:11:33.226 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:33.226 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:33.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:33.226+0000 7fa830b8e700 1 -- 172.21.15.173:0/1865221583 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fa818036820 msgr2=0x7fa818038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:33.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:33.226+0000 7fa830b8e700 1 --2- 172.21.15.173:0/1865221583 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fa818036820 0x7fa818038cd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa814009990 tx=0x7fa814006e40 comp rx=0 tx=0).stop 2024-02-16T22:11:33.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:33.226+0000 7fa830b8e700 1 -- 172.21.15.173:0/1865221583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0fbac0 msgr2=0x7fa82c101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:33.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:33.226+0000 7fa830b8e700 1 --2- 172.21.15.173:0/1865221583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0fbac0 0x7fa82c101ba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009680 tx=0x7fa81c009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:33.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:33.226+0000 7fa830b8e700 1 -- 172.21.15.173:0/1865221583 shutdown_connections 2024-02-16T22:11:33.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:33.226+0000 7fa830b8e700 1 --2- 172.21.15.173:0/1865221583 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7fa818036820 0x7fa818038cd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:33.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:33.226+0000 7fa830b8e700 1 --2- 172.21.15.173:0/1865221583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0fbac0 0x7fa82c101ba0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:33.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:33.226+0000 7fa830b8e700 1 -- 172.21.15.173:0/1865221583 >> 172.21.15.173:0/1865221583 conn(0x7fa82c0f71a0 msgr2=0x7fa82c0f7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:33.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:33.226+0000 7fa830b8e700 1 -- 172.21.15.173:0/1865221583 shutdown_connections 2024-02-16T22:11:33.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:33.226+0000 7fa830b8e700 1 -- 172.21.15.173:0/1865221583 wait complete. 2024-02-16T22:11:33.229 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:34.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:33 smithi134 ceph-mon[28869]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:34.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:33 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/1865221583' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:34.846 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:34.846 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:35.095 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:35.144 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:36.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:35 smithi134 ceph-mon[28869]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:11:36.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:35 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:36.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:35 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:36.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:35 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:36.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:35 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-16T22:11:36.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:35 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' 2024-02-16T22:11:36.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.611+0000 7f81be5a2700 1 -- 172.21.15.173:0/1656879903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b8066880 msgr2=0x7f81b80fd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:36.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.611+0000 7f81be5a2700 1 --2- 172.21.15.173:0/1656879903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b8066880 0x7f81b80fd590 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f81a80048c0 tx=0x7f81a8009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:36.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.611+0000 7f81be5a2700 1 -- 172.21.15.173:0/1656879903 shutdown_connections 2024-02-16T22:11:36.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.611+0000 7f81be5a2700 1 --2- 172.21.15.173:0/1656879903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b8066880 0x7f81b80fd590 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:36.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.611+0000 7f81be5a2700 1 -- 172.21.15.173:0/1656879903 >> 172.21.15.173:0/1656879903 conn(0x7f81b80f7210 msgr2=0x7f81b80f9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:36.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.611+0000 7f81be5a2700 1 -- 172.21.15.173:0/1656879903 shutdown_connections 2024-02-16T22:11:36.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.611+0000 7f81be5a2700 1 -- 172.21.15.173:0/1656879903 wait complete. 2024-02-16T22:11:36.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.611+0000 7f81be5a2700 1 Processor -- start 2024-02-16T22:11:36.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.611+0000 7f81be5a2700 1 -- start start 2024-02-16T22:11:36.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.612+0000 7f81be5a2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b8066880 0x7f81b8113460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:36.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.612+0000 7f81be5a2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b81139a0 con 0x7f81b8066880 2024-02-16T22:11:36.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.612+0000 7f81b7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b8066880 0x7f81b8113460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:36.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.612+0000 7f81b7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b8066880 0x7f81b8113460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:39012/0 (socket says 172.21.15.173:39012) 2024-02-16T22:11:36.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.612+0000 7f81b7fff700 1 -- 172.21.15.173:0/1358582389 learned_addr learned my addr 172.21.15.173:0/1358582389 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:36.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.612+0000 7f81b7fff700 1 -- 172.21.15.173:0/1358582389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a8005040 con 0x7f81b8066880 2024-02-16T22:11:36.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.612+0000 7f81b7fff700 1 --2- 172.21.15.173:0/1358582389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b8066880 0x7f81b8113460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f81a8009b80 tx=0x7f81a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:36.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.612+0000 7f81b4ff9700 1 -- 172.21.15.173:0/1358582389 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f81a800b5c0 con 0x7f81b8066880 2024-02-16T22:11:36.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.612+0000 7f81be5a2700 1 -- 172.21.15.173:0/1358582389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b8113ba0 con 0x7f81b8066880 2024-02-16T22:11:36.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.612+0000 7f81b4ff9700 1 -- 172.21.15.173:0/1358582389 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f81a800be70 con 0x7f81b8066880 2024-02-16T22:11:36.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.612+0000 7f81b4ff9700 1 -- 172.21.15.173:0/1358582389 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f81a801c660 con 0x7f81b8066880 2024-02-16T22:11:36.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.612+0000 7f81be5a2700 1 -- 172.21.15.173:0/1358582389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b8114840 con 0x7f81b8066880 2024-02-16T22:11:36.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.613+0000 7f81b4ff9700 1 -- 172.21.15.173:0/1358582389 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 14) v1 ==== 43439+0+0 (secure 0 0 0) 0x7f81a801c8d0 con 0x7f81b8066880 2024-02-16T22:11:36.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.613+0000 7f81be5a2700 1 -- 172.21.15.173:0/1358582389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b805f5c0 con 0x7f81b8066880 2024-02-16T22:11:36.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.613+0000 7f81b4ff9700 1 --2- 172.21.15.173:0/1358582389 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f81a00368c0 0x7f81a0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:36.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.613+0000 7f81b4ff9700 1 -- 172.21.15.173:0/1358582389 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f81a8049c00 con 0x7f81b8066880 2024-02-16T22:11:36.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.613+0000 7f81b77fe700 1 -- 172.21.15.173:0/1358582389 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f81a00368c0 msgr2=0x7f81a0038d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/2987045407 2024-02-16T22:11:36.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.613+0000 7f81b77fe700 1 --2- 172.21.15.173:0/1358582389 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f81a00368c0 0x7f81a0038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T22:11:36.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.618+0000 7f81b4ff9700 1 -- 172.21.15.173:0/1358582389 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f81a8011dd0 con 0x7f81b8066880 2024-02-16T22:11:36.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.814+0000 7f81b77fe700 1 -- 172.21.15.173:0/1358582389 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f81a00368c0 msgr2=0x7f81a0038d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/2987045407 2024-02-16T22:11:36.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.814+0000 7f81b77fe700 1 --2- 172.21.15.173:0/1358582389 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f81a00368c0 0x7f81a0038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-16T22:11:36.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.879+0000 7f81be5a2700 1 -- 172.21.15.173:0/1358582389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f81b81153b0 con 0x7f81b8066880 2024-02-16T22:11:36.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.879+0000 7f81b4ff9700 1 -- 172.21.15.173:0/1358582389 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f81a8049e60 con 0x7f81b8066880 2024-02-16T22:11:36.881 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:36.881 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:36.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.881+0000 7f81be5a2700 1 -- 172.21.15.173:0/1358582389 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f81a00368c0 msgr2=0x7f81a0038d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-16T22:11:36.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.881+0000 7f81be5a2700 1 --2- 172.21.15.173:0/1358582389 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f81a00368c0 0x7f81a0038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:36.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.881+0000 7f81be5a2700 1 -- 172.21.15.173:0/1358582389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b8066880 msgr2=0x7f81b8113460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:36.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.881+0000 7f81be5a2700 1 --2- 172.21.15.173:0/1358582389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b8066880 0x7f81b8113460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f81a8009b80 tx=0x7f81a8009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:36.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.881+0000 7f81be5a2700 1 -- 172.21.15.173:0/1358582389 shutdown_connections 2024-02-16T22:11:36.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.881+0000 7f81be5a2700 1 --2- 172.21.15.173:0/1358582389 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f81a00368c0 0x7f81a0038d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:36.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.881+0000 7f81be5a2700 1 --2- 172.21.15.173:0/1358582389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b8066880 0x7f81b8113460 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:36.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.881+0000 7f81be5a2700 1 -- 172.21.15.173:0/1358582389 >> 172.21.15.173:0/1358582389 conn(0x7f81b80f7210 msgr2=0x7f81b80f7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:36.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.881+0000 7f81be5a2700 1 -- 172.21.15.173:0/1358582389 shutdown_connections 2024-02-16T22:11:36.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:36.881+0000 7f81be5a2700 1 -- 172.21.15.173:0/1358582389 wait complete. 2024-02-16T22:11:36.884 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:37.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:37 smithi134 ceph-mon[28869]: from='mgr.14162 172.21.15.134:0/2582387303' entity='mgr.smithi134.ordace' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-16T22:11:37.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:37 smithi134 ceph-mon[28869]: mgrmap e14: smithi134.ordace(active, since 65s) 2024-02-16T22:11:37.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:37 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/1358582389' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:38.443 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:38.443 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:38.694 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:38.741 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:40.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.071+0000 7f667e8a9700 1 -- 172.21.15.173:0/3697191841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66780fcbd0 msgr2=0x7f66780fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:40.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.071+0000 7f667e8a9700 1 --2- 172.21.15.173:0/3697191841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66780fcbd0 0x7f66780fcfe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f66680048c0 tx=0x7f6668009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:40.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.071+0000 7f667e8a9700 1 -- 172.21.15.173:0/3697191841 shutdown_connections 2024-02-16T22:11:40.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.071+0000 7f667e8a9700 1 --2- 172.21.15.173:0/3697191841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66780fcbd0 0x7f66780fcfe0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:40.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.071+0000 7f667e8a9700 1 -- 172.21.15.173:0/3697191841 >> 172.21.15.173:0/3697191841 conn(0x7f66780f8290 msgr2=0x7f66780fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:40.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.071+0000 7f667e8a9700 1 -- 172.21.15.173:0/3697191841 shutdown_connections 2024-02-16T22:11:40.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.071+0000 7f667e8a9700 1 -- 172.21.15.173:0/3697191841 wait complete. 2024-02-16T22:11:40.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.071+0000 7f667e8a9700 1 Processor -- start 2024-02-16T22:11:40.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.071+0000 7f667e8a9700 1 -- start start 2024-02-16T22:11:40.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.072+0000 7f667e8a9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66780fcbd0 0x7f6678071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:40.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.072+0000 7f667e8a9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66780702e0 con 0x7f66780fcbd0 2024-02-16T22:11:40.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.072+0000 7f6677fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66780fcbd0 0x7f6678071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:40.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.072+0000 7f6677fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66780fcbd0 0x7f6678071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:39026/0 (socket says 172.21.15.173:39026) 2024-02-16T22:11:40.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.072+0000 7f6677fff700 1 -- 172.21.15.173:0/1984263115 learned_addr learned my addr 172.21.15.173:0/1984263115 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:40.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.072+0000 7f6677fff700 1 -- 172.21.15.173:0/1984263115 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6668005040 con 0x7f66780fcbd0 2024-02-16T22:11:40.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.072+0000 7f6677fff700 1 --2- 172.21.15.173:0/1984263115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66780fcbd0 0x7f6678071e60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6668009b80 tx=0x7f6668009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:40.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.072+0000 7f6674ff9700 1 -- 172.21.15.173:0/1984263115 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f666800b5c0 con 0x7f66780fcbd0 2024-02-16T22:11:40.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.072+0000 7f6674ff9700 1 -- 172.21.15.173:0/1984263115 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f666800be70 con 0x7f66780fcbd0 2024-02-16T22:11:40.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.072+0000 7f667e8a9700 1 -- 172.21.15.173:0/1984263115 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66780704e0 con 0x7f66780fcbd0 2024-02-16T22:11:40.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.072+0000 7f6674ff9700 1 -- 172.21.15.173:0/1984263115 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f666801c660 con 0x7f66780fcbd0 2024-02-16T22:11:40.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.072+0000 7f667e8a9700 1 -- 172.21.15.173:0/1984263115 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66780709d0 con 0x7f66780fcbd0 2024-02-16T22:11:40.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.073+0000 7f6674ff9700 1 -- 172.21.15.173:0/1984263115 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 14) v1 ==== 43439+0+0 (secure 0 0 0) 0x7f6668013420 con 0x7f66780fcbd0 2024-02-16T22:11:40.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.073+0000 7f667e8a9700 1 -- 172.21.15.173:0/1984263115 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66781069a0 con 0x7f66780fcbd0 2024-02-16T22:11:40.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.073+0000 7f6674ff9700 1 --2- 172.21.15.173:0/1984263115 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f66600368c0 0x7f6660038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:40.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.073+0000 7f6674ff9700 1 -- 172.21.15.173:0/1984263115 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6668049b40 con 0x7f66780fcbd0 2024-02-16T22:11:40.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.073+0000 7f66777fe700 1 -- 172.21.15.173:0/1984263115 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f66600368c0 msgr2=0x7f6660038d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/2987045407 2024-02-16T22:11:40.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.073+0000 7f66777fe700 1 --2- 172.21.15.173:0/1984263115 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f66600368c0 0x7f6660038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T22:11:40.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.078+0000 7f6674ff9700 1 -- 172.21.15.173:0/1984263115 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6668013b10 con 0x7f66780fcbd0 2024-02-16T22:11:40.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.274+0000 7f66777fe700 1 -- 172.21.15.173:0/1984263115 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f66600368c0 msgr2=0x7f6660038d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/2987045407 2024-02-16T22:11:40.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.274+0000 7f66777fe700 1 --2- 172.21.15.173:0/1984263115 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f66600368c0 0x7f6660038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-16T22:11:40.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.334+0000 7f667e8a9700 1 -- 172.21.15.173:0/1984263115 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f667805f5c0 con 0x7f66780fcbd0 2024-02-16T22:11:40.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.334+0000 7f6674ff9700 1 -- 172.21.15.173:0/1984263115 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f6668011370 con 0x7f66780fcbd0 2024-02-16T22:11:40.336 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:40.336 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:40.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.336+0000 7f667e8a9700 1 -- 172.21.15.173:0/1984263115 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f66600368c0 msgr2=0x7f6660038d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-16T22:11:40.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.336+0000 7f667e8a9700 1 --2- 172.21.15.173:0/1984263115 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f66600368c0 0x7f6660038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:40.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.336+0000 7f667e8a9700 1 -- 172.21.15.173:0/1984263115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66780fcbd0 msgr2=0x7f6678071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:40.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.336+0000 7f667e8a9700 1 --2- 172.21.15.173:0/1984263115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66780fcbd0 0x7f6678071e60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6668009b80 tx=0x7f6668009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:40.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.336+0000 7f667e8a9700 1 -- 172.21.15.173:0/1984263115 shutdown_connections 2024-02-16T22:11:40.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.336+0000 7f667e8a9700 1 --2- 172.21.15.173:0/1984263115 >> [v2:172.21.15.134:6800/2987045407,v1:172.21.15.134:6801/2987045407] conn(0x7f66600368c0 0x7f6660038d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:40.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.336+0000 7f667e8a9700 1 --2- 172.21.15.173:0/1984263115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66780fcbd0 0x7f6678071e60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:40.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.336+0000 7f667e8a9700 1 -- 172.21.15.173:0/1984263115 >> 172.21.15.173:0/1984263115 conn(0x7f66780f8290 msgr2=0x7f66780f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:40.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.336+0000 7f667e8a9700 1 -- 172.21.15.173:0/1984263115 shutdown_connections 2024-02-16T22:11:40.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:40.336+0000 7f667e8a9700 1 -- 172.21.15.173:0/1984263115 wait complete. 2024-02-16T22:11:40.339 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:40.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:40 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/1984263115' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:41.905 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:41.905 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:42.155 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:42.201 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:43.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:42 smithi134 ceph-mon[28869]: Active manager daemon smithi134.ordace restarted 2024-02-16T22:11:43.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:42 smithi134 ceph-mon[28869]: Activating manager daemon smithi134.ordace 2024-02-16T22:11:43.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:42 smithi134 ceph-mon[28869]: osdmap e5: 0 total, 0 up, 0 in 2024-02-16T22:11:43.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:42 smithi134 ceph-mon[28869]: mgrmap e15: smithi134.ordace(active, starting, since 0.0036608s) 2024-02-16T22:11:43.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:42 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:11:43.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:42 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr metadata", "who": "smithi134.ordace", "id": "smithi134.ordace"}]: dispatch 2024-02-16T22:11:43.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:42 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-16T22:11:43.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:42 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-16T22:11:43.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:42 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-16T22:11:43.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:42 smithi134 ceph-mon[28869]: Manager daemon smithi134.ordace is now available 2024-02-16T22:11:43.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:42 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:11:43.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:42 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:11:43.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.633+0000 7f3c632ab700 1 -- 172.21.15.173:0/1931455488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5c0fbac0 msgr2=0x7f3c5c0fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:43.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.633+0000 7f3c632ab700 1 --2- 172.21.15.173:0/1931455488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5c0fbac0 0x7f3c5c0fbed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3c580048c0 tx=0x7f3c58009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.633+0000 7f3c632ab700 1 -- 172.21.15.173:0/1931455488 shutdown_connections 2024-02-16T22:11:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.633+0000 7f3c632ab700 1 --2- 172.21.15.173:0/1931455488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5c0fbac0 0x7f3c5c0fbed0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.633+0000 7f3c632ab700 1 -- 172.21.15.173:0/1931455488 >> 172.21.15.173:0/1931455488 conn(0x7f3c5c0f71a0 msgr2=0x7f3c5c0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.633+0000 7f3c632ab700 1 -- 172.21.15.173:0/1931455488 shutdown_connections 2024-02-16T22:11:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.633+0000 7f3c632ab700 1 -- 172.21.15.173:0/1931455488 wait complete. 2024-02-16T22:11:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.633+0000 7f3c632ab700 1 Processor -- start 2024-02-16T22:11:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.633+0000 7f3c632ab700 1 -- start start 2024-02-16T22:11:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.633+0000 7f3c632ab700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5c0fbac0 0x7f3c5c10fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.633+0000 7f3c632ab700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c066610 con 0x7f3c5c0fbac0 2024-02-16T22:11:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.634+0000 7f3c61047700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5c0fbac0 0x7f3c5c10fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.634+0000 7f3c61047700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5c0fbac0 0x7f3c5c10fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:56788/0 (socket says 172.21.15.173:56788) 2024-02-16T22:11:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.634+0000 7f3c61047700 1 -- 172.21.15.173:0/4255293193 learned_addr learned my addr 172.21.15.173:0/4255293193 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.634+0000 7f3c61047700 1 -- 172.21.15.173:0/4255293193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58005040 con 0x7f3c5c0fbac0 2024-02-16T22:11:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.634+0000 7f3c61047700 1 --2- 172.21.15.173:0/4255293193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5c0fbac0 0x7f3c5c10fbc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009680 tx=0x7f3c58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:43.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.634+0000 7f3c51ffb700 1 -- 172.21.15.173:0/4255293193 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c5800bed0 con 0x7f3c5c0fbac0 2024-02-16T22:11:43.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.634+0000 7f3c51ffb700 1 -- 172.21.15.173:0/4255293193 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c5800b5c0 con 0x7f3c5c0fbac0 2024-02-16T22:11:43.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.634+0000 7f3c632ab700 1 -- 172.21.15.173:0/4255293193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c066810 con 0x7f3c5c0fbac0 2024-02-16T22:11:43.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.634+0000 7f3c51ffb700 1 -- 172.21.15.173:0/4255293193 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c5801c5b0 con 0x7f3c5c0fbac0 2024-02-16T22:11:43.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.634+0000 7f3c632ab700 1 -- 172.21.15.173:0/4255293193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c110340 con 0x7f3c5c0fbac0 2024-02-16T22:11:43.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.635+0000 7f3c51ffb700 1 -- 172.21.15.173:0/4255293193 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) v1 ==== 43162+0+0 (secure 0 0 0) 0x7f3c5801c820 con 0x7f3c5c0fbac0 2024-02-16T22:11:43.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.635+0000 7f3c632ab700 1 -- 172.21.15.173:0/4255293193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c105890 con 0x7f3c5c0fbac0 2024-02-16T22:11:43.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.635+0000 7f3c51ffb700 1 -- 172.21.15.173:0/4255293193 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3c58049960 con 0x7f3c5c0fbac0 2024-02-16T22:11:43.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.640+0000 7f3c51ffb700 1 -- 172.21.15.173:0/4255293193 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3c58023300 con 0x7f3c5c0fbac0 2024-02-16T22:11:43.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.857+0000 7f3c51ffb700 1 -- 172.21.15.173:0/4255293193 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 16) v1 ==== 43289+0+0 (secure 0 0 0) 0x7f3c5804bd50 con 0x7f3c5c0fbac0 2024-02-16T22:11:43.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.857+0000 7f3c51ffb700 1 --2- 172.21.15.173:0/4255293193 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3c48037930 0x7f3c48039d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:43.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.857+0000 7f3c60846700 1 --2- 172.21.15.173:0/4255293193 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3c48037930 0x7f3c48039d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:43.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.858+0000 7f3c60846700 1 --2- 172.21.15.173:0/4255293193 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3c48037930 0x7f3c48039d10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009990 tx=0x7f3c4c006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:43.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.924+0000 7f3c632ab700 1 -- 172.21.15.173:0/4255293193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3c5c04bed0 con 0x7f3c5c0fbac0 2024-02-16T22:11:43.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.925+0000 7f3c51ffb700 1 -- 172.21.15.173:0/4255293193 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f3c58004e20 con 0x7f3c5c0fbac0 2024-02-16T22:11:43.927 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:43.927 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.927+0000 7f3c632ab700 1 -- 172.21.15.173:0/4255293193 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3c48037930 msgr2=0x7f3c48039d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.927+0000 7f3c632ab700 1 --2- 172.21.15.173:0/4255293193 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3c48037930 0x7f3c48039d10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009990 tx=0x7f3c4c006e40 comp rx=0 tx=0).stop 2024-02-16T22:11:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.927+0000 7f3c632ab700 1 -- 172.21.15.173:0/4255293193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5c0fbac0 msgr2=0x7f3c5c10fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.927+0000 7f3c632ab700 1 --2- 172.21.15.173:0/4255293193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5c0fbac0 0x7f3c5c10fbc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009680 tx=0x7f3c58009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.927+0000 7f3c632ab700 1 -- 172.21.15.173:0/4255293193 shutdown_connections 2024-02-16T22:11:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.927+0000 7f3c632ab700 1 --2- 172.21.15.173:0/4255293193 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3c48037930 0x7f3c48039d10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.927+0000 7f3c632ab700 1 --2- 172.21.15.173:0/4255293193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5c0fbac0 0x7f3c5c10fbc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.927+0000 7f3c632ab700 1 -- 172.21.15.173:0/4255293193 >> 172.21.15.173:0/4255293193 conn(0x7f3c5c0f71a0 msgr2=0x7f3c5c0f7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.927+0000 7f3c632ab700 1 -- 172.21.15.173:0/4255293193 shutdown_connections 2024-02-16T22:11:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:43.927+0000 7f3c632ab700 1 -- 172.21.15.173:0/4255293193 wait complete. 2024-02-16T22:11:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:44.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:44.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:11:44.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/mirror_snapshot_schedule"}]: dispatch 2024-02-16T22:11:44.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/trash_purge_schedule"}]: dispatch 2024-02-16T22:11:44.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:44.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:44.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:43 smithi134 ceph-mon[28869]: mgrmap e16: smithi134.ordace(active, since 1.00568s) 2024-02-16T22:11:44.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:45.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:44 smithi134 ceph-mon[28869]: [16/Feb/2024:22:11:43] ENGINE Bus STARTING 2024-02-16T22:11:45.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:44 smithi134 ceph-mon[28869]: [16/Feb/2024:22:11:43] ENGINE Serving on https://172.21.15.134:7150 2024-02-16T22:11:45.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:44 smithi134 ceph-mon[28869]: [16/Feb/2024:22:11:43] ENGINE Bus STARTED 2024-02-16T22:11:45.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:44 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/4255293193' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:45.519 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:45.520 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:46.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:45 smithi134 ceph-mon[28869]: mgrmap e17: smithi134.ordace(active, since 2s) 2024-02-16T22:11:46.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:45 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:46.775 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:46.837 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.990+0000 7fbfb2376700 1 -- 172.21.15.173:0/2793956007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfac0fbae0 msgr2=0x7fbfac0fbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.990+0000 7fbfb2376700 1 --2- 172.21.15.173:0/2793956007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfac0fbae0 0x7fbfac0fbef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c0048c0 tx=0x7fbf9c009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.991+0000 7fbfb2376700 1 -- 172.21.15.173:0/2793956007 shutdown_connections 2024-02-16T22:11:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.991+0000 7fbfb2376700 1 --2- 172.21.15.173:0/2793956007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfac0fbae0 0x7fbfac0fbef0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.991+0000 7fbfb2376700 1 -- 172.21.15.173:0/2793956007 >> 172.21.15.173:0/2793956007 conn(0x7fbfac0f71a0 msgr2=0x7fbfac0f95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.991+0000 7fbfb2376700 1 -- 172.21.15.173:0/2793956007 shutdown_connections 2024-02-16T22:11:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.991+0000 7fbfb2376700 1 -- 172.21.15.173:0/2793956007 wait complete. 2024-02-16T22:11:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.991+0000 7fbfb2376700 1 Processor -- start 2024-02-16T22:11:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.991+0000 7fbfb2376700 1 -- start start 2024-02-16T22:11:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.991+0000 7fbfb2376700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfac0fbae0 0x7fbfac10bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.991+0000 7fbfb2376700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac10c410 con 0x7fbfac0fbae0 2024-02-16T22:11:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.992+0000 7fbfabfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfac0fbae0 0x7fbfac10bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.992+0000 7fbfabfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfac0fbae0 0x7fbfac10bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:56798/0 (socket says 172.21.15.173:56798) 2024-02-16T22:11:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.992+0000 7fbfabfff700 1 -- 172.21.15.173:0/1146549424 learned_addr learned my addr 172.21.15.173:0/1146549424 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.992+0000 7fbfabfff700 1 -- 172.21.15.173:0/1146549424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c005040 con 0x7fbfac0fbae0 2024-02-16T22:11:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.992+0000 7fbfabfff700 1 --2- 172.21.15.173:0/1146549424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfac0fbae0 0x7fbfac10bed0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009300 tx=0x7fbf9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.992+0000 7fbfa8ff9700 1 -- 172.21.15.173:0/1146549424 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf9c009890 con 0x7fbfac0fbae0 2024-02-16T22:11:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.992+0000 7fbfb2376700 1 -- 172.21.15.173:0/1146549424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac10c610 con 0x7fbfac0fbae0 2024-02-16T22:11:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.992+0000 7fbfa8ff9700 1 -- 172.21.15.173:0/1146549424 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf9c01e8f0 con 0x7fbfac0fbae0 2024-02-16T22:11:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.992+0000 7fbfa8ff9700 1 -- 172.21.15.173:0/1146549424 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf9c0137a0 con 0x7fbfac0fbae0 2024-02-16T22:11:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.992+0000 7fbfb2376700 1 -- 172.21.15.173:0/1146549424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac10d170 con 0x7fbfac0fbae0 2024-02-16T22:11:48.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.993+0000 7fbfa8ff9700 1 -- 172.21.15.173:0/1146549424 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7fbf9c01e420 con 0x7fbfac0fbae0 2024-02-16T22:11:48.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.993+0000 7fbfb2376700 1 -- 172.21.15.173:0/1146549424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac05f5c0 con 0x7fbfac0fbae0 2024-02-16T22:11:48.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.993+0000 7fbfa8ff9700 1 --2- 172.21.15.173:0/1146549424 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fbf98036960 0x7fbf98038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:48.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.993+0000 7fbfa8ff9700 1 -- 172.21.15.173:0/1146549424 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fbf9c04c900 con 0x7fbfac0fbae0 2024-02-16T22:11:48.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.994+0000 7fbfab7fe700 1 --2- 172.21.15.173:0/1146549424 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fbf98036960 0x7fbf98038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:48.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.994+0000 7fbfab7fe700 1 --2- 172.21.15.173:0/1146549424 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fbf98036960 0x7fbf98038e10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009990 tx=0x7fbf94006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:49.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:48.998+0000 7fbfa8ff9700 1 -- 172.21.15.173:0/1146549424 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fbf9c028460 con 0x7fbfac0fbae0 2024-02-16T22:11:49.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:49.254+0000 7fbfb2376700 1 -- 172.21.15.173:0/1146549424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbfac04bed0 con 0x7fbfac0fbae0 2024-02-16T22:11:49.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:49.254+0000 7fbfa8ff9700 1 -- 172.21.15.173:0/1146549424 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fbf9c02ee60 con 0x7fbfac0fbae0 2024-02-16T22:11:49.256 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:49.256 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:49.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:49.256+0000 7fbfb2376700 1 -- 172.21.15.173:0/1146549424 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fbf98036960 msgr2=0x7fbf98038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:49.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:49.256+0000 7fbfb2376700 1 --2- 172.21.15.173:0/1146549424 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fbf98036960 0x7fbf98038e10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009990 tx=0x7fbf94006e40 comp rx=0 tx=0).stop 2024-02-16T22:11:49.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:49.256+0000 7fbfb2376700 1 -- 172.21.15.173:0/1146549424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfac0fbae0 msgr2=0x7fbfac10bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:49.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:49.256+0000 7fbfb2376700 1 --2- 172.21.15.173:0/1146549424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfac0fbae0 0x7fbfac10bed0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009300 tx=0x7fbf9c009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:49.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:49.256+0000 7fbfb2376700 1 -- 172.21.15.173:0/1146549424 shutdown_connections 2024-02-16T22:11:49.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:49.256+0000 7fbfb2376700 1 --2- 172.21.15.173:0/1146549424 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fbf98036960 0x7fbf98038e10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:49.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:49.256+0000 7fbfb2376700 1 --2- 172.21.15.173:0/1146549424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfac0fbae0 0x7fbfac10bed0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:49.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:49.256+0000 7fbfb2376700 1 -- 172.21.15.173:0/1146549424 >> 172.21.15.173:0/1146549424 conn(0x7fbfac0f71a0 msgr2=0x7fbfac0f7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:49.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:49.257+0000 7fbfb2376700 1 -- 172.21.15.173:0/1146549424 shutdown_connections 2024-02-16T22:11:49.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:49.257+0000 7fbfb2376700 1 -- 172.21.15.173:0/1146549424 wait complete. 2024-02-16T22:11:49.259 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:49.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:49 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:49.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:49 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:49.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:49 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:49.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:49 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:49.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:49 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:11:50.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:50 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/1146549424' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:50.841 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:50.841 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:51.093 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:51.139 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:52.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.664+0000 7f20f3853700 1 -- 172.21.15.173:0/4012166688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec0fae80 msgr2=0x7f20ec0fb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:52.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.664+0000 7f20f3853700 1 --2- 172.21.15.173:0/4012166688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec0fae80 0x7f20ec0fb290 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f20e80048c0 tx=0x7f20e8009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:52.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.664+0000 7f20f3853700 1 -- 172.21.15.173:0/4012166688 shutdown_connections 2024-02-16T22:11:52.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.664+0000 7f20f3853700 1 --2- 172.21.15.173:0/4012166688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec0fae80 0x7f20ec0fb290 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:52.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.664+0000 7f20f3853700 1 -- 172.21.15.173:0/4012166688 >> 172.21.15.173:0/4012166688 conn(0x7f20ec0f6920 msgr2=0x7f20ec0f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:52.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.664+0000 7f20f3853700 1 -- 172.21.15.173:0/4012166688 shutdown_connections 2024-02-16T22:11:52.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.664+0000 7f20f3853700 1 -- 172.21.15.173:0/4012166688 wait complete. 2024-02-16T22:11:52.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.665+0000 7f20f3853700 1 Processor -- start 2024-02-16T22:11:52.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.665+0000 7f20f3853700 1 -- start start 2024-02-16T22:11:52.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.665+0000 7f20f3853700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec0fae80 0x7f20ec0fd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:52.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.665+0000 7f20f3853700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0fbe20 con 0x7f20ec0fae80 2024-02-16T22:11:52.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.665+0000 7f20f15ef700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec0fae80 0x7f20ec0fd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:52.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.665+0000 7f20f15ef700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec0fae80 0x7f20ec0fd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:33660/0 (socket says 172.21.15.173:33660) 2024-02-16T22:11:52.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.665+0000 7f20f15ef700 1 -- 172.21.15.173:0/3692820163 learned_addr learned my addr 172.21.15.173:0/3692820163 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:52.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.665+0000 7f20f15ef700 1 -- 172.21.15.173:0/3692820163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e8005040 con 0x7f20ec0fae80 2024-02-16T22:11:52.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.665+0000 7f20f15ef700 1 --2- 172.21.15.173:0/3692820163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec0fae80 0x7f20ec0fd9a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009040 tx=0x7f20e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:52.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.665+0000 7f20e1ffb700 1 -- 172.21.15.173:0/3692820163 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20e800bed0 con 0x7f20ec0fae80 2024-02-16T22:11:52.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.665+0000 7f20f3853700 1 -- 172.21.15.173:0/3692820163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec0fc020 con 0x7f20ec0fae80 2024-02-16T22:11:52.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.665+0000 7f20e1ffb700 1 -- 172.21.15.173:0/3692820163 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20e800b5c0 con 0x7f20ec0fae80 2024-02-16T22:11:52.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.666+0000 7f20e1ffb700 1 -- 172.21.15.173:0/3692820163 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20e801c5b0 con 0x7f20ec0fae80 2024-02-16T22:11:52.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.666+0000 7f20f3853700 1 -- 172.21.15.173:0/3692820163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec0fc510 con 0x7f20ec0fae80 2024-02-16T22:11:52.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.666+0000 7f20e1ffb700 1 -- 172.21.15.173:0/3692820163 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f20e801c830 con 0x7f20ec0fae80 2024-02-16T22:11:52.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.667+0000 7f20f3853700 1 -- 172.21.15.173:0/3692820163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec106930 con 0x7f20ec0fae80 2024-02-16T22:11:52.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.667+0000 7f20e1ffb700 1 --2- 172.21.15.173:0/3692820163 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f20d8036960 0x7f20d8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:52.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.667+0000 7f20e1ffb700 1 -- 172.21.15.173:0/3692820163 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f20e8049d80 con 0x7f20ec0fae80 2024-02-16T22:11:52.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.667+0000 7f20f0dee700 1 --2- 172.21.15.173:0/3692820163 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f20d8036960 0x7f20d8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:52.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.667+0000 7f20f0dee700 1 --2- 172.21.15.173:0/3692820163 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f20d8036960 0x7f20d8038e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009990 tx=0x7f20dc006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:52.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.672+0000 7f20e1ffb700 1 -- 172.21.15.173:0/3692820163 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f20e8011db0 con 0x7f20ec0fae80 2024-02-16T22:11:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.927+0000 7f20f3853700 1 -- 172.21.15.173:0/3692820163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f20ec106930 con 0x7f20ec0fae80 2024-02-16T22:11:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.928+0000 7f20e1ffb700 1 -- 172.21.15.173:0/3692820163 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f20e8023990 con 0x7f20ec0fae80 2024-02-16T22:11:52.930 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:52.930 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.930+0000 7f20f3853700 1 -- 172.21.15.173:0/3692820163 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f20d8036960 msgr2=0x7f20d8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.930+0000 7f20f3853700 1 --2- 172.21.15.173:0/3692820163 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f20d8036960 0x7f20d8038e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009990 tx=0x7f20dc006e40 comp rx=0 tx=0).stop 2024-02-16T22:11:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.930+0000 7f20f3853700 1 -- 172.21.15.173:0/3692820163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec0fae80 msgr2=0x7f20ec0fd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.930+0000 7f20f3853700 1 --2- 172.21.15.173:0/3692820163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec0fae80 0x7f20ec0fd9a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009040 tx=0x7f20e8009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.930+0000 7f20f3853700 1 -- 172.21.15.173:0/3692820163 shutdown_connections 2024-02-16T22:11:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.930+0000 7f20f3853700 1 --2- 172.21.15.173:0/3692820163 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f20d8036960 0x7f20d8038e10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.930+0000 7f20f3853700 1 --2- 172.21.15.173:0/3692820163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ec0fae80 0x7f20ec0fd9a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.930+0000 7f20f3853700 1 -- 172.21.15.173:0/3692820163 >> 172.21.15.173:0/3692820163 conn(0x7f20ec0f6920 msgr2=0x7f20ec0f76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.930+0000 7f20f3853700 1 -- 172.21.15.173:0/3692820163 shutdown_connections 2024-02-16T22:11:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:52.930+0000 7f20f3853700 1 -- 172.21.15.173:0/3692820163 wait complete. 2024-02-16T22:11:52.933 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:53.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:52 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/3692820163' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:54.547 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:54.547 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:54.792 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:54.840 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-16T22:11:55.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:55.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:55.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:55.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:55.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:11:55.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:11:55.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:11:55.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:54 smithi134 ceph-mon[28869]: Updating smithi134:/etc/ceph/ceph.conf 2024-02-16T22:11:55.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:54 smithi134 ceph-mon[28869]: Updating smithi173:/etc/ceph/ceph.conf 2024-02-16T22:11:56.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:11:56.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:11:56.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:11:56.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:11:56.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-16T22:11:56.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-16T22:11:56.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:56.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:56.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:56.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:56.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:11:56.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi173", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-16T22:11:56.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi173", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-16T22:11:56.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:11:56.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:56 smithi134 ceph-mon[28869]: Deploying daemon crash.smithi173 on smithi173 2024-02-16T22:11:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.260+0000 7fe74a74b700 1 -- 172.21.15.173:0/3571905073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe744102bd0 msgr2=0x7fe744102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.260+0000 7fe74a74b700 1 --2- 172.21.15.173:0/3571905073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe744102bd0 0x7fe744102fa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe7340048c0 tx=0x7fe734009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.260+0000 7fe74a74b700 1 -- 172.21.15.173:0/3571905073 shutdown_connections 2024-02-16T22:11:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.260+0000 7fe74a74b700 1 --2- 172.21.15.173:0/3571905073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe744102bd0 0x7fe744102fa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.260+0000 7fe74a74b700 1 -- 172.21.15.173:0/3571905073 >> 172.21.15.173:0/3571905073 conn(0x7fe7440f8760 msgr2=0x7fe7440fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.260+0000 7fe74a74b700 1 -- 172.21.15.173:0/3571905073 shutdown_connections 2024-02-16T22:11:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.260+0000 7fe74a74b700 1 -- 172.21.15.173:0/3571905073 wait complete. 2024-02-16T22:11:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.260+0000 7fe74a74b700 1 Processor -- start 2024-02-16T22:11:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.260+0000 7fe74a74b700 1 -- start start 2024-02-16T22:11:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.261+0000 7fe74a74b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe744102bd0 0x7fe744070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.261+0000 7fe74a74b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440707d0 con 0x7fe744102bd0 2024-02-16T22:11:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.261+0000 7fe743fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe744102bd0 0x7fe744070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.261+0000 7fe743fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe744102bd0 0x7fe744070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:33674/0 (socket says 172.21.15.173:33674) 2024-02-16T22:11:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.261+0000 7fe743fff700 1 -- 172.21.15.173:0/1953466415 learned_addr learned my addr 172.21.15.173:0/1953466415 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:11:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.261+0000 7fe743fff700 1 -- 172.21.15.173:0/1953466415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe734005040 con 0x7fe744102bd0 2024-02-16T22:11:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.261+0000 7fe743fff700 1 --2- 172.21.15.173:0/1953466415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe744102bd0 0x7fe744070290 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe734009300 tx=0x7fe734009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.261+0000 7fe740ff9700 1 -- 172.21.15.173:0/1953466415 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe734004e60 con 0x7fe744102bd0 2024-02-16T22:11:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.261+0000 7fe74a74b700 1 -- 172.21.15.173:0/1953466415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7440709d0 con 0x7fe744102bd0 2024-02-16T22:11:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.261+0000 7fe740ff9700 1 -- 172.21.15.173:0/1953466415 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe734013420 con 0x7fe744102bd0 2024-02-16T22:11:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.261+0000 7fe740ff9700 1 -- 172.21.15.173:0/1953466415 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe73401c5b0 con 0x7fe744102bd0 2024-02-16T22:11:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.262+0000 7fe74a74b700 1 -- 172.21.15.173:0/1953466415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe744070e40 con 0x7fe744102bd0 2024-02-16T22:11:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.262+0000 7fe740ff9700 1 -- 172.21.15.173:0/1953466415 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7fe73401c7f0 con 0x7fe744102bd0 2024-02-16T22:11:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.262+0000 7fe74a74b700 1 -- 172.21.15.173:0/1953466415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe744101ef0 con 0x7fe744102bd0 2024-02-16T22:11:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.263+0000 7fe740ff9700 1 --2- 172.21.15.173:0/1953466415 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe72c036960 0x7fe72c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:11:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.263+0000 7fe740ff9700 1 -- 172.21.15.173:0/1953466415 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe734049bb0 con 0x7fe744102bd0 2024-02-16T22:11:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.263+0000 7fe7437fe700 1 --2- 172.21.15.173:0/1953466415 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe72c036960 0x7fe72c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:11:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.263+0000 7fe7437fe700 1 --2- 172.21.15.173:0/1953466415 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe72c036960 0x7fe72c038e10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe738009990 tx=0x7fe738006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:11:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.268+0000 7fe740ff9700 1 -- 172.21.15.173:0/1953466415 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe734011370 con 0x7fe744102bd0 2024-02-16T22:11:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.545+0000 7fe74a74b700 1 -- 172.21.15.173:0/1953466415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe74404bed0 con 0x7fe744102bd0 2024-02-16T22:11:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.545+0000 7fe740ff9700 1 -- 172.21.15.173:0/1953466415 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fe734024b50 con 0x7fe744102bd0 2024-02-16T22:11:57.547 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:11:57.547 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:11:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.547+0000 7fe74a74b700 1 -- 172.21.15.173:0/1953466415 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe72c036960 msgr2=0x7fe72c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.547+0000 7fe74a74b700 1 --2- 172.21.15.173:0/1953466415 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe72c036960 0x7fe72c038e10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe738009990 tx=0x7fe738006e40 comp rx=0 tx=0).stop 2024-02-16T22:11:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.547+0000 7fe74a74b700 1 -- 172.21.15.173:0/1953466415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe744102bd0 msgr2=0x7fe744070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:11:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.547+0000 7fe74a74b700 1 --2- 172.21.15.173:0/1953466415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe744102bd0 0x7fe744070290 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe734009300 tx=0x7fe734009e30 comp rx=0 tx=0).stop 2024-02-16T22:11:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.548+0000 7fe74a74b700 1 -- 172.21.15.173:0/1953466415 shutdown_connections 2024-02-16T22:11:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.548+0000 7fe74a74b700 1 --2- 172.21.15.173:0/1953466415 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe72c036960 0x7fe72c038e10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.548+0000 7fe74a74b700 1 --2- 172.21.15.173:0/1953466415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe744102bd0 0x7fe744070290 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:11:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.548+0000 7fe74a74b700 1 -- 172.21.15.173:0/1953466415 >> 172.21.15.173:0/1953466415 conn(0x7fe7440f8760 msgr2=0x7fe7440f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:11:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.548+0000 7fe74a74b700 1 -- 172.21.15.173:0/1953466415 shutdown_connections 2024-02-16T22:11:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:11:57.548+0000 7fe74a74b700 1 -- 172.21.15.173:0/1953466415 wait complete. 2024-02-16T22:11:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:11:57.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:57 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/1953466415' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:11:58.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:58 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:11:59.235 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:11:59.235 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:11:59.503 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:12:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:59 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:59 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:59 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:59 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:11:59 smithi134 ceph-mon[28869]: Deploying daemon node-exporter.smithi173 on smithi173 2024-02-16T22:12:01.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.154+0000 7fa963570700 1 -- 172.21.15.173:0/3196161749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c101bd0 msgr2=0x7fa95c101fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:12:01.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.154+0000 7fa963570700 1 --2- 172.21.15.173:0/3196161749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c101bd0 0x7fa95c101fa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa9580048c0 tx=0x7fa958009e30 comp rx=0 tx=0).stop 2024-02-16T22:12:01.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.154+0000 7fa963570700 1 -- 172.21.15.173:0/3196161749 shutdown_connections 2024-02-16T22:12:01.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.154+0000 7fa963570700 1 --2- 172.21.15.173:0/3196161749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c101bd0 0x7fa95c101fa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:01.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.154+0000 7fa963570700 1 -- 172.21.15.173:0/3196161749 >> 172.21.15.173:0/3196161749 conn(0x7fa95c0720e0 msgr2=0x7fa95c0724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:12:01.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.154+0000 7fa963570700 1 -- 172.21.15.173:0/3196161749 shutdown_connections 2024-02-16T22:12:01.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.155+0000 7fa963570700 1 -- 172.21.15.173:0/3196161749 wait complete. 2024-02-16T22:12:01.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.155+0000 7fa963570700 1 Processor -- start 2024-02-16T22:12:01.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.155+0000 7fa963570700 1 -- start start 2024-02-16T22:12:01.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.155+0000 7fa963570700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c101bd0 0x7fa95c111f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:12:01.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.155+0000 7fa963570700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c1124c0 con 0x7fa95c101bd0 2024-02-16T22:12:01.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.156+0000 7fa96130c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c101bd0 0x7fa95c111f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:12:01.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.156+0000 7fa96130c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c101bd0 0x7fa95c111f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:59962/0 (socket says 172.21.15.173:59962) 2024-02-16T22:12:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.156+0000 7fa96130c700 1 -- 172.21.15.173:0/3450907408 learned_addr learned my addr 172.21.15.173:0/3450907408 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:12:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.156+0000 7fa96130c700 1 -- 172.21.15.173:0/3450907408 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa958005040 con 0x7fa95c101bd0 2024-02-16T22:12:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.156+0000 7fa96130c700 1 --2- 172.21.15.173:0/3450907408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c101bd0 0x7fa95c111f80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa958009c90 tx=0x7fa958009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:12:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.156+0000 7fa951ffb700 1 -- 172.21.15.173:0/3450907408 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa958004e60 con 0x7fa95c101bd0 2024-02-16T22:12:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.156+0000 7fa963570700 1 -- 172.21.15.173:0/3450907408 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa95c1126c0 con 0x7fa95c101bd0 2024-02-16T22:12:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.156+0000 7fa951ffb700 1 -- 172.21.15.173:0/3450907408 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa958009860 con 0x7fa95c101bd0 2024-02-16T22:12:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.157+0000 7fa951ffb700 1 -- 172.21.15.173:0/3450907408 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa958013790 con 0x7fa95c101bd0 2024-02-16T22:12:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.157+0000 7fa963570700 1 -- 172.21.15.173:0/3450907408 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa95c112b30 con 0x7fa95c101bd0 2024-02-16T22:12:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.158+0000 7fa951ffb700 1 -- 172.21.15.173:0/3450907408 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7fa95801e420 con 0x7fa95c101bd0 2024-02-16T22:12:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.158+0000 7fa963570700 1 -- 172.21.15.173:0/3450907408 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa95c05f5c0 con 0x7fa95c101bd0 2024-02-16T22:12:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.158+0000 7fa951ffb700 1 --2- 172.21.15.173:0/3450907408 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa948036960 0x7fa948038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:12:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.158+0000 7fa951ffb700 1 -- 172.21.15.173:0/3450907408 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fa95804c840 con 0x7fa95c101bd0 2024-02-16T22:12:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.158+0000 7fa960b0b700 1 --2- 172.21.15.173:0/3450907408 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa948036960 0x7fa948038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:12:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.159+0000 7fa960b0b700 1 --2- 172.21.15.173:0/3450907408 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa948036960 0x7fa948038e10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009990 tx=0x7fa94c006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:12:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.163+0000 7fa951ffb700 1 -- 172.21.15.173:0/3450907408 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa958011550 con 0x7fa95c101bd0 2024-02-16T22:12:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.457+0000 7fa963570700 1 -- 172.21.15.173:0/3450907408 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa95c10d590 con 0x7fa95c101bd0 2024-02-16T22:12:01.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.457+0000 7fa951ffb700 1 -- 172.21.15.173:0/3450907408 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa958011370 con 0x7fa95c101bd0 2024-02-16T22:12:01.460 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:12:01.460 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:12:01.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.460+0000 7fa963570700 1 -- 172.21.15.173:0/3450907408 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa948036960 msgr2=0x7fa948038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:12:01.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.460+0000 7fa963570700 1 --2- 172.21.15.173:0/3450907408 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa948036960 0x7fa948038e10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009990 tx=0x7fa94c006e40 comp rx=0 tx=0).stop 2024-02-16T22:12:01.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.460+0000 7fa963570700 1 -- 172.21.15.173:0/3450907408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c101bd0 msgr2=0x7fa95c111f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:12:01.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.460+0000 7fa963570700 1 --2- 172.21.15.173:0/3450907408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c101bd0 0x7fa95c111f80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa958009c90 tx=0x7fa958009e30 comp rx=0 tx=0).stop 2024-02-16T22:12:01.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.460+0000 7fa963570700 1 -- 172.21.15.173:0/3450907408 shutdown_connections 2024-02-16T22:12:01.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.460+0000 7fa963570700 1 --2- 172.21.15.173:0/3450907408 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa948036960 0x7fa948038e10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:01.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.460+0000 7fa963570700 1 --2- 172.21.15.173:0/3450907408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c101bd0 0x7fa95c111f80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:01.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.460+0000 7fa963570700 1 -- 172.21.15.173:0/3450907408 >> 172.21.15.173:0/3450907408 conn(0x7fa95c0720e0 msgr2=0x7fa95c0f99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:12:01.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.460+0000 7fa963570700 1 -- 172.21.15.173:0/3450907408 shutdown_connections 2024-02-16T22:12:01.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:01.460+0000 7fa963570700 1 -- 172.21.15.173:0/3450907408 wait complete. 2024-02-16T22:12:01.463 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:12:02.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:02 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/3450907408' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:12:03.866 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:12:03.866 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:12:04.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:03 smithi134 ceph-mon[28869]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:04.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:04.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:04.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:04.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:04.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:04.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi173.kbofaa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:12:04.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi173.kbofaa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-16T22:12:04.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:12:04.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:04.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:03 smithi134 ceph-mon[28869]: Deploying daemon mgr.smithi173.kbofaa on smithi173 2024-02-16T22:12:04.301 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:12:06.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:05 smithi134 ceph-mon[28869]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.441+0000 7f3b196bb700 1 -- 172.21.15.173:0/1063853038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b14101b40 msgr2=0x7f3b14101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:12:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.441+0000 7f3b196bb700 1 --2- 172.21.15.173:0/1063853038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b14101b40 0x7f3b14101f10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b040048c0 tx=0x7f3b04009e30 comp rx=0 tx=0).stop 2024-02-16T22:12:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.441+0000 7f3b196bb700 1 -- 172.21.15.173:0/1063853038 shutdown_connections 2024-02-16T22:12:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.441+0000 7f3b196bb700 1 --2- 172.21.15.173:0/1063853038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b14101b40 0x7f3b14101f10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.441+0000 7f3b196bb700 1 -- 172.21.15.173:0/1063853038 >> 172.21.15.173:0/1063853038 conn(0x7f3b140f7640 msgr2=0x7f3b140f9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:12:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.441+0000 7f3b196bb700 1 -- 172.21.15.173:0/1063853038 shutdown_connections 2024-02-16T22:12:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.441+0000 7f3b196bb700 1 -- 172.21.15.173:0/1063853038 wait complete. 2024-02-16T22:12:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.442+0000 7f3b196bb700 1 Processor -- start 2024-02-16T22:12:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.442+0000 7f3b196bb700 1 -- start start 2024-02-16T22:12:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.442+0000 7f3b196bb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b14101b40 0x7f3b14111ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:12:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.442+0000 7f3b196bb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14112420 con 0x7f3b14101b40 2024-02-16T22:12:06.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.442+0000 7f3b12ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b14101b40 0x7f3b14111ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:12:06.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.442+0000 7f3b12ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b14101b40 0x7f3b14111ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:59988/0 (socket says 172.21.15.173:59988) 2024-02-16T22:12:06.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.442+0000 7f3b12ffd700 1 -- 172.21.15.173:0/3700727950 learned_addr learned my addr 172.21.15.173:0/3700727950 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:12:06.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.443+0000 7f3b12ffd700 1 -- 172.21.15.173:0/3700727950 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b04005040 con 0x7f3b14101b40 2024-02-16T22:12:06.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.443+0000 7f3b12ffd700 1 --2- 172.21.15.173:0/3700727950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b14101b40 0x7f3b14111ee0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009300 tx=0x7f3b04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:12:06.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.443+0000 7f3afb7fe700 1 -- 172.21.15.173:0/3700727950 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b04004e60 con 0x7f3b14101b40 2024-02-16T22:12:06.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.443+0000 7f3afb7fe700 1 -- 172.21.15.173:0/3700727950 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b04013420 con 0x7f3b14101b40 2024-02-16T22:12:06.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.443+0000 7f3b196bb700 1 -- 172.21.15.173:0/3700727950 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b14112620 con 0x7f3b14101b40 2024-02-16T22:12:06.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.443+0000 7f3afb7fe700 1 -- 172.21.15.173:0/3700727950 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b0401c590 con 0x7f3b14101b40 2024-02-16T22:12:06.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.443+0000 7f3b196bb700 1 -- 172.21.15.173:0/3700727950 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b14112a90 con 0x7f3b14101b40 2024-02-16T22:12:06.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.444+0000 7f3afb7fe700 1 -- 172.21.15.173:0/3700727950 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f3b04009600 con 0x7f3b14101b40 2024-02-16T22:12:06.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.444+0000 7f3b196bb700 1 -- 172.21.15.173:0/3700727950 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1405f5c0 con 0x7f3b14101b40 2024-02-16T22:12:06.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.444+0000 7f3afb7fe700 1 --2- 172.21.15.173:0/3700727950 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3afc036960 0x7f3afc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:12:06.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.444+0000 7f3afb7fe700 1 -- 172.21.15.173:0/3700727950 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3b04049d40 con 0x7f3b14101b40 2024-02-16T22:12:06.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.444+0000 7f3b127fc700 1 --2- 172.21.15.173:0/3700727950 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3afc036960 0x7f3afc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:12:06.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.445+0000 7f3b127fc700 1 --2- 172.21.15.173:0/3700727950 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3afc036960 0x7f3afc038e10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009990 tx=0x7f3b08006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:12:06.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.449+0000 7f3afb7fe700 1 -- 172.21.15.173:0/3700727950 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3b04025400 con 0x7f3b14101b40 2024-02-16T22:12:06.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.714+0000 7f3b196bb700 1 -- 172.21.15.173:0/3700727950 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3b1410d590 con 0x7f3b14101b40 2024-02-16T22:12:06.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.715+0000 7f3afb7fe700 1 -- 172.21.15.173:0/3700727950 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f3b04011370 con 0x7f3b14101b40 2024-02-16T22:12:06.718 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:12:06.718 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:09:23.177444Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-16T22:12:06.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.717+0000 7f3b196bb700 1 -- 172.21.15.173:0/3700727950 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3afc036960 msgr2=0x7f3afc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:12:06.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.717+0000 7f3b196bb700 1 --2- 172.21.15.173:0/3700727950 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3afc036960 0x7f3afc038e10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009990 tx=0x7f3b08006e40 comp rx=0 tx=0).stop 2024-02-16T22:12:06.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.717+0000 7f3b196bb700 1 -- 172.21.15.173:0/3700727950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b14101b40 msgr2=0x7f3b14111ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:12:06.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.717+0000 7f3b196bb700 1 --2- 172.21.15.173:0/3700727950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b14101b40 0x7f3b14111ee0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009300 tx=0x7f3b04009e30 comp rx=0 tx=0).stop 2024-02-16T22:12:06.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.717+0000 7f3b196bb700 1 -- 172.21.15.173:0/3700727950 shutdown_connections 2024-02-16T22:12:06.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.717+0000 7f3b196bb700 1 --2- 172.21.15.173:0/3700727950 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3afc036960 0x7f3afc038e10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:06.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.717+0000 7f3b196bb700 1 --2- 172.21.15.173:0/3700727950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b14101b40 0x7f3b14111ee0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:06.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.717+0000 7f3b196bb700 1 -- 172.21.15.173:0/3700727950 >> 172.21.15.173:0/3700727950 conn(0x7f3b140f7640 msgr2=0x7f3b14103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:12:06.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.717+0000 7f3b196bb700 1 -- 172.21.15.173:0/3700727950 shutdown_connections 2024-02-16T22:12:06.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:06.717+0000 7f3b196bb700 1 -- 172.21.15.173:0/3700727950 wait complete. 2024-02-16T22:12:06.721 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-02-16T22:12:07.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:07 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/3700727950' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:12:07.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:07 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:07.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:07 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:07.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:07 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:07.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:07 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:07.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:07 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-16T22:12:07.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:07 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:08.329 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-16T22:12:08.330 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-16T22:12:08.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:08 smithi134 ceph-mon[28869]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:08.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:08 smithi134 ceph-mon[28869]: Deploying daemon mon.smithi173 on smithi173 2024-02-16T22:12:08.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:08 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:09.054 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:12:10.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:10 smithi134 ceph-mon[28869]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:11.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.372+0000 7f74bbd6e700 1 -- 172.21.15.173:0/4194125852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b40fdc10 msgr2=0x7f74b40fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:12:11.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.372+0000 7f74bbd6e700 1 --2- 172.21.15.173:0/4194125852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b40fdc10 0x7f74b40fdfe0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f74b00048c0 tx=0x7f74b0009e30 comp rx=0 tx=0).stop 2024-02-16T22:12:11.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.372+0000 7f74bbd6e700 1 -- 172.21.15.173:0/4194125852 shutdown_connections 2024-02-16T22:12:11.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.372+0000 7f74bbd6e700 1 --2- 172.21.15.173:0/4194125852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b40fdc10 0x7f74b40fdfe0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:11.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.372+0000 7f74bbd6e700 1 -- 172.21.15.173:0/4194125852 >> 172.21.15.173:0/4194125852 conn(0x7f74b40f7640 msgr2=0x7f74b40f9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:12:11.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.372+0000 7f74bbd6e700 1 -- 172.21.15.173:0/4194125852 shutdown_connections 2024-02-16T22:12:11.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.372+0000 7f74bbd6e700 1 -- 172.21.15.173:0/4194125852 wait complete. 2024-02-16T22:12:11.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.373+0000 7f74bbd6e700 1 Processor -- start 2024-02-16T22:12:11.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.373+0000 7f74bbd6e700 1 -- start start 2024-02-16T22:12:11.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.373+0000 7f74bbd6e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b40fdc10 0x7f74b4112fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:12:11.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.373+0000 7f74bbd6e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b41134e0 con 0x7f74b40fdc10 2024-02-16T22:12:11.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.373+0000 7f74b9b0a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b40fdc10 0x7f74b4112fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:12:11.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.373+0000 7f74b9b0a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b40fdc10 0x7f74b4112fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.173:54292/0 (socket says 172.21.15.173:54292) 2024-02-16T22:12:11.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.373+0000 7f74b9b0a700 1 -- 172.21.15.173:0/3564209496 learned_addr learned my addr 172.21.15.173:0/3564209496 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:12:11.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.374+0000 7f74b9b0a700 1 -- 172.21.15.173:0/3564209496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b0005040 con 0x7f74b40fdc10 2024-02-16T22:12:11.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.374+0000 7f74b9b0a700 1 --2- 172.21.15.173:0/3564209496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b40fdc10 0x7f74b4112fa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009300 tx=0x7f74b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:12:11.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.374+0000 7f74aa7fc700 1 -- 172.21.15.173:0/3564209496 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74b0004e60 con 0x7f74b40fdc10 2024-02-16T22:12:11.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.374+0000 7f74bbd6e700 1 -- 172.21.15.173:0/3564209496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b41136e0 con 0x7f74b40fdc10 2024-02-16T22:12:11.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.374+0000 7f74bbd6e700 1 -- 172.21.15.173:0/3564209496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b4113b50 con 0x7f74b40fdc10 2024-02-16T22:12:11.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.374+0000 7f74aa7fc700 1 -- 172.21.15.173:0/3564209496 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74b0013420 con 0x7f74b40fdc10 2024-02-16T22:12:11.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.374+0000 7f74aa7fc700 1 -- 172.21.15.173:0/3564209496 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74b001c5b0 con 0x7f74b40fdc10 2024-02-16T22:12:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.375+0000 7f74aa7fc700 1 -- 172.21.15.173:0/3564209496 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f74b0009600 con 0x7f74b40fdc10 2024-02-16T22:12:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.375+0000 7f74aa7fc700 1 --2- 172.21.15.173:0/3564209496 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f74a00369b0 0x7f74a0038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:12:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.375+0000 7f74aa7fc700 1 -- 172.21.15.173:0/3564209496 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f74b0049b00 con 0x7f74b40fdc10 2024-02-16T22:12:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.375+0000 7f74bbd6e700 1 -- 172.21.15.173:0/3564209496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b405f5c0 con 0x7f74b40fdc10 2024-02-16T22:12:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.375+0000 7f74b9309700 1 --2- 172.21.15.173:0/3564209496 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f74a00369b0 0x7f74a0038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:12:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.376+0000 7f74b9309700 1 --2- 172.21.15.173:0/3564209496 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f74a00369b0 0x7f74a0038e60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009990 tx=0x7f74a4006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:12:11.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.380+0000 7f74aa7fc700 1 -- 172.21.15.173:0/3564209496 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f74b0025400 con 0x7f74b40fdc10 2024-02-16T22:12:11.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.512+0000 7f74aa7fc700 1 -- 172.21.15.173:0/3564209496 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74b001bec0 con 0x7f74b40fdc10 2024-02-16T22:12:11.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:11.662+0000 7f74bbd6e700 1 -- 172.21.15.173:0/3564209496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f74b410e580 con 0x7f74b40fdc10 2024-02-16T22:12:16.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:16.558+0000 7f74aa7fc700 1 -- 172.21.15.173:0/3564209496 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7f74b0011370 con 0x7f74b40fdc10 2024-02-16T22:12:16.560 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-02-16T22:12:16.560 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":2,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","modified":"2024-02-16T22:12:11.512301Z","created":"2024-02-16T22:09:23.177444Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi173","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-16T22:12:16.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:16.561+0000 7f74bbd6e700 1 -- 172.21.15.173:0/3564209496 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f74a00369b0 msgr2=0x7f74a0038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:12:16.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:16.561+0000 7f74bbd6e700 1 --2- 172.21.15.173:0/3564209496 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f74a00369b0 0x7f74a0038e60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009990 tx=0x7f74a4006e40 comp rx=0 tx=0).stop 2024-02-16T22:12:16.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:16.561+0000 7f74bbd6e700 1 -- 172.21.15.173:0/3564209496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b40fdc10 msgr2=0x7f74b4112fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:12:16.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:16.561+0000 7f74bbd6e700 1 --2- 172.21.15.173:0/3564209496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b40fdc10 0x7f74b4112fa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009300 tx=0x7f74b0009e30 comp rx=0 tx=0).stop 2024-02-16T22:12:16.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:16.561+0000 7f74bbd6e700 1 -- 172.21.15.173:0/3564209496 shutdown_connections 2024-02-16T22:12:16.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:16.561+0000 7f74bbd6e700 1 --2- 172.21.15.173:0/3564209496 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f74a00369b0 0x7f74a0038e60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:16.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:16.561+0000 7f74bbd6e700 1 --2- 172.21.15.173:0/3564209496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b40fdc10 0x7f74b4112fa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:16.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:16.561+0000 7f74bbd6e700 1 -- 172.21.15.173:0/3564209496 >> 172.21.15.173:0/3564209496 conn(0x7f74b40f7640 msgr2=0x7f74b4101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:12:16.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:16.561+0000 7f74bbd6e700 1 -- 172.21.15.173:0/3564209496 shutdown_connections 2024-02-16T22:12:16.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:12:16.561+0000 7f74bbd6e700 1 -- 172.21.15.173:0/3564209496 wait complete. 2024-02-16T22:12:16.564 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 2 2024-02-16T22:12:16.919 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:16 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:12:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: mon.smithi134 calling monitor election 2024-02-16T22:12:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:12:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/3564209496' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-16T22:12:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:12:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/687806346' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/crt"}]: dispatch 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: mon.smithi173 calling monitor election 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: mon.smithi134 is new leader, mons smithi134,smithi173 in quorum (ranks 0,1) 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: monmap e2: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi173=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: fsmap 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: osdmap e5: 0 total, 0 up, 0 in 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: mgrmap e17: smithi134.ordace(active, since 33s) 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: Standby manager daemon smithi173.kbofaa started 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/687806346' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-16T22:12:16.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: overall HEALTH_OK 2024-02-16T22:12:16.979 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/687806346' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/key"}]: dispatch 2024-02-16T22:12:16.979 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/687806346' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-16T22:12:16.979 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:16.979 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:17.191 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-16T22:12:17.192 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph config generate-minimal-conf 2024-02-16T22:12:17.466 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:12:17.902 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:17.902 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:17 smithi134 ceph-mon[28869]: mgrmap e18: smithi134.ordace(active, since 33s), standbys: smithi173.kbofaa 2024-02-16T22:12:17.902 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:17.902 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr metadata", "who": "smithi173.kbofaa", "id": "smithi173.kbofaa"}]: dispatch 2024-02-16T22:12:17.902 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:17.902 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:12:17.902 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:17 smithi134 ceph-mon[28869]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:17.903 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:12:17.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:17.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:17 smithi173 ceph-mon[37280]: mgrmap e18: smithi134.ordace(active, since 33s), standbys: smithi173.kbofaa 2024-02-16T22:12:17.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:17.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr metadata", "who": "smithi173.kbofaa", "id": "smithi173.kbofaa"}]: dispatch 2024-02-16T22:12:17.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:17.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:12:17.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:17 smithi173 ceph-mon[37280]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:17.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:12:19.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.109+0000 7f6a27bd9700 1 -- 172.21.15.134:0/662391489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a200fdbd0 msgr2=0x7f6a200fdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:12:19.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.109+0000 7f6a27bd9700 1 --2- 172.21.15.134:0/662391489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a200fdbd0 0x7f6a200fdfa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0048c0 tx=0x7f6a1c009e30 comp rx=0 tx=0).stop 2024-02-16T22:12:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.109+0000 7f6a27bd9700 1 -- 172.21.15.134:0/662391489 shutdown_connections 2024-02-16T22:12:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.109+0000 7f6a27bd9700 1 --2- 172.21.15.134:0/662391489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a200fdbd0 0x7f6a200fdfa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.109+0000 7f6a27bd9700 1 -- 172.21.15.134:0/662391489 >> 172.21.15.134:0/662391489 conn(0x7f6a200f7660 msgr2=0x7f6a200f9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:12:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.109+0000 7f6a27bd9700 1 -- 172.21.15.134:0/662391489 shutdown_connections 2024-02-16T22:12:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.109+0000 7f6a27bd9700 1 -- 172.21.15.134:0/662391489 wait complete. 2024-02-16T22:12:19.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a27bd9700 1 Processor -- start 2024-02-16T22:12:19.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a27bd9700 1 -- start start 2024-02-16T22:12:19.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a27bd9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a200fdbd0 0x7f6a20113140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:12:19.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a27bd9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a20113680 0x7f6a2010cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:12:19.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a27bd9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a20113c90 con 0x7f6a20113680 2024-02-16T22:12:19.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a27bd9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2010d520 con 0x7f6a200fdbd0 2024-02-16T22:12:19.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a25174700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a20113680 0x7f6a2010cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:12:19.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a25174700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a20113680 0x7f6a2010cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36600/0 (socket says 172.21.15.134:36600) 2024-02-16T22:12:19.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a25174700 1 -- 172.21.15.134:0/4099631295 learned_addr learned my addr 172.21.15.134:0/4099631295 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:12:19.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a25975700 1 --2- 172.21.15.134:0/4099631295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a200fdbd0 0x7f6a20113140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:12:19.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a25975700 1 -- 172.21.15.134:0/4099631295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a200fdbd0 msgr2=0x7f6a20113140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-16T22:12:19.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a25975700 1 -- 172.21.15.134:0/4099631295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a200fdbd0 msgr2=0x7f6a20113140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-16T22:12:19.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a25975700 1 --2- 172.21.15.134:0/4099631295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a200fdbd0 0x7f6a20113140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-16T22:12:19.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a25975700 1 --2- 172.21.15.134:0/4099631295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a200fdbd0 0x7f6a20113140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T22:12:19.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a25174700 1 -- 172.21.15.134:0/4099631295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a200fdbd0 msgr2=0x7f6a20113140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-16T22:12:19.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.110+0000 7f6a25174700 1 --2- 172.21.15.134:0/4099631295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a200fdbd0 0x7f6a20113140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:19.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.111+0000 7f6a25174700 1 -- 172.21.15.134:0/4099631295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c005040 con 0x7f6a20113680 2024-02-16T22:12:19.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.111+0000 7f6a25174700 1 --2- 172.21.15.134:0/4099631295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a20113680 0x7f6a2010cfe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000b790 tx=0x7f6a10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:12:19.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.111+0000 7f6a167fc700 1 -- 172.21.15.134:0/4099631295 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a10010870 con 0x7f6a20113680 2024-02-16T22:12:19.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.111+0000 7f6a27bd9700 1 -- 172.21.15.134:0/4099631295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2010d800 con 0x7f6a20113680 2024-02-16T22:12:19.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.111+0000 7f6a167fc700 1 -- 172.21.15.134:0/4099631295 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a1000f3e0 con 0x7f6a20113680 2024-02-16T22:12:19.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.111+0000 7f6a167fc700 1 -- 172.21.15.134:0/4099631295 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a10010ea0 con 0x7f6a20113680 2024-02-16T22:12:19.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.111+0000 7f6a27bd9700 1 -- 172.21.15.134:0/4099631295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2010dd40 con 0x7f6a20113680 2024-02-16T22:12:19.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.112+0000 7f6a27bd9700 1 -- 172.21.15.134:0/4099631295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a20104310 con 0x7f6a20113680 2024-02-16T22:12:19.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.113+0000 7f6a167fc700 1 -- 172.21.15.134:0/4099631295 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f6a1000f550 con 0x7f6a20113680 2024-02-16T22:12:19.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.113+0000 7f6a167fc700 1 --2- 172.21.15.134:0/4099631295 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6a0c069370 0x7f6a0c06b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:12:19.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.113+0000 7f6a167fc700 1 -- 172.21.15.134:0/4099631295 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6a100865c0 con 0x7f6a20113680 2024-02-16T22:12:19.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.113+0000 7f6a25975700 1 --2- 172.21.15.134:0/4099631295 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6a0c069370 0x7f6a0c06b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:12:19.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.113+0000 7f6a25975700 1 --2- 172.21.15.134:0/4099631295 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6a0c069370 0x7f6a0c06b820 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0045a0 tx=0x7f6a1c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:12:19.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.117+0000 7f6a167fc700 1 -- 172.21.15.134:0/4099631295 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6a10057460 con 0x7f6a20113680 2024-02-16T22:12:19.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:18 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:19.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:18 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:19.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:18 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:19.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:18 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:19.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:18 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:12:19.230 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:18 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:19.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:18 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:19.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:18 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:19.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:18 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:19.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:18 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:12:19.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.316+0000 7f6a27bd9700 1 -- 172.21.15.134:0/4099631295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f6a2005f5c0 con 0x7f6a20113680 2024-02-16T22:12:19.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.317+0000 7f6a167fc700 1 -- 172.21.15.134:0/4099631295 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7f6a10014100 con 0x7f6a20113680 2024-02-16T22:12:19.319 INFO:teuthology.orchestra.run.smithi134.stdout:# minimal ceph.conf for f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:12:19.319 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-02-16T22:12:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:12:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: mon_host = [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-02-16T22:12:19.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.320+0000 7f6a27bd9700 1 -- 172.21.15.134:0/4099631295 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6a0c069370 msgr2=0x7f6a0c06b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:12:19.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.320+0000 7f6a27bd9700 1 --2- 172.21.15.134:0/4099631295 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6a0c069370 0x7f6a0c06b820 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0045a0 tx=0x7f6a1c009e30 comp rx=0 tx=0).stop 2024-02-16T22:12:19.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.320+0000 7f6a27bd9700 1 -- 172.21.15.134:0/4099631295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a20113680 msgr2=0x7f6a2010cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:12:19.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.320+0000 7f6a27bd9700 1 --2- 172.21.15.134:0/4099631295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a20113680 0x7f6a2010cfe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000b790 tx=0x7f6a10009250 comp rx=0 tx=0).stop 2024-02-16T22:12:19.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.320+0000 7f6a27bd9700 1 -- 172.21.15.134:0/4099631295 shutdown_connections 2024-02-16T22:12:19.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.320+0000 7f6a27bd9700 1 --2- 172.21.15.134:0/4099631295 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6a0c069370 0x7f6a0c06b820 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:19.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.320+0000 7f6a27bd9700 1 --2- 172.21.15.134:0/4099631295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a200fdbd0 0x7f6a20113140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:19.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.320+0000 7f6a27bd9700 1 --2- 172.21.15.134:0/4099631295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a20113680 0x7f6a2010cfe0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:19.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.320+0000 7f6a27bd9700 1 -- 172.21.15.134:0/4099631295 >> 172.21.15.134:0/4099631295 conn(0x7f6a200f7660 msgr2=0x7f6a20101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:12:19.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.320+0000 7f6a27bd9700 1 -- 172.21.15.134:0/4099631295 shutdown_connections 2024-02-16T22:12:19.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:19.320+0000 7f6a27bd9700 1 -- 172.21.15.134:0/4099631295 wait complete. 2024-02-16T22:12:19.948 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-16T22:12:19.948 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:12:19.948 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.conf 2024-02-16T22:12:19.979 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:12:19.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:12:20.047 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:12:20.047 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.conf 2024-02-16T22:12:20.082 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:12:20.082 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:12:20.153 INFO:tasks.cephadm:Deploying OSDs... 2024-02-16T22:12:20.153 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:12:20.153 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-02-16T22:12:20.168 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-16T22:12:20.169 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-02-16T22:12:20.223 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-16T22:12:20.224 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T22:12:20.224 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-02-16T22:12:20.224 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T22:12:20.224 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T22:12:20.224 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-02-16 22:11:34.649720805 +0000 2024-02-16T22:12:20.224 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-02-16 22:05:56.060511630 +0000 2024-02-16T22:12:20.224 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-02-16 22:05:56.060511630 +0000 2024-02-16T22:12:20.224 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-02-16 22:05:56.060511630 +0000 2024-02-16T22:12:20.224 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-16T22:12:20.289 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-02-16T22:12:20.289 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-02-16T22:12:20.289 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000188291 s, 2.7 MB/s 2024-02-16T22:12:20.290 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-16T22:12:20.346 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-02-16T22:12:20.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: Updating smithi134:/etc/ceph/ceph.conf 2024-02-16T22:12:20.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: Updating smithi173:/etc/ceph/ceph.conf 2024-02-16T22:12:20.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:20.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:12:20.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:12:20.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:20.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:20.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:20.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:20.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:20.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/4099631295' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:20.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: Reconfiguring mon.smithi134 (unknown last config time)... 2024-02-16T22:12:20.360 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-16T22:12:20.360 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-16T22:12:20.360 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:20.360 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:20 smithi134 ceph-mon[28869]: Reconfiguring daemon mon.smithi134 on smithi134 2024-02-16T22:12:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-16T22:12:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T22:12:20.374 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-02-16T22:12:20.374 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T22:12:20.374 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T22:12:20.375 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-02-16 22:11:34.649720805 +0000 2024-02-16T22:12:20.375 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-02-16 22:05:56.402503193 +0000 2024-02-16T22:12:20.375 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-02-16 22:05:56.402503193 +0000 2024-02-16T22:12:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-02-16 22:05:56.402503193 +0000 2024-02-16T22:12:20.375 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-16T22:12:20.394 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: Updating smithi134:/etc/ceph/ceph.conf 2024-02-16T22:12:20.394 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: Updating smithi173:/etc/ceph/ceph.conf 2024-02-16T22:12:20.394 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:20.394 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:12:20.394 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:12:20.394 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:20.394 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:20.394 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:20.394 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:20.394 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:20.394 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/4099631295' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:20.394 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: Reconfiguring mon.smithi134 (unknown last config time)... 2024-02-16T22:12:20.395 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-16T22:12:20.395 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-16T22:12:20.395 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:20.395 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:20 smithi173 ceph-mon[37280]: Reconfiguring daemon mon.smithi134 on smithi134 2024-02-16T22:12:20.441 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-02-16T22:12:20.441 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-02-16T22:12:20.441 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000170222 s, 3.0 MB/s 2024-02-16T22:12:20.443 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-16T22:12:20.498 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-02-16T22:12:20.553 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-16T22:12:20.553 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T22:12:20.553 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-02-16T22:12:20.553 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T22:12:20.553 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T22:12:20.553 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-02-16 22:11:34.649720805 +0000 2024-02-16T22:12:20.553 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-02-16 22:05:56.733495029 +0000 2024-02-16T22:12:20.553 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-02-16 22:05:56.733495029 +0000 2024-02-16T22:12:20.554 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-02-16 22:05:56.733495029 +0000 2024-02-16T22:12:20.554 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-16T22:12:20.619 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-02-16T22:12:20.619 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-02-16T22:12:20.619 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000175629 s, 2.9 MB/s 2024-02-16T22:12:20.620 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-16T22:12:20.676 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-02-16T22:12:20.730 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-16T22:12:20.730 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T22:12:20.730 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-02-16T22:12:20.730 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T22:12:20.730 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T22:12:20.731 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-02-16 22:11:34.650720780 +0000 2024-02-16T22:12:20.731 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-02-16 22:05:57.063486888 +0000 2024-02-16T22:12:20.731 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-02-16 22:05:57.063486888 +0000 2024-02-16T22:12:20.731 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-02-16 22:05:57.063486888 +0000 2024-02-16T22:12:20.731 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-16T22:12:20.795 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-02-16T22:12:20.795 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-02-16T22:12:20.795 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000176538 s, 2.9 MB/s 2024-02-16T22:12:20.797 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-16T22:12:20.852 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:12:20.852 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2024-02-16T22:12:20.867 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-16T22:12:20.867 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2024-02-16T22:12:20.922 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-16T22:12:20.923 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T22:12:20.923 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-02-16T22:12:20.923 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T22:12:20.923 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T22:12:20.923 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-02-16 22:12:10.373761888 +0000 2024-02-16T22:12:20.923 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-02-16 22:05:56.083586289 +0000 2024-02-16T22:12:20.923 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-02-16 22:05:56.083586289 +0000 2024-02-16T22:12:20.923 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-02-16 22:05:56.083586289 +0000 2024-02-16T22:12:20.923 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-16T22:12:20.989 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-02-16T22:12:21.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-02-16T22:12:21.021 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000217779 s, 2.4 MB/s 2024-02-16T22:12:21.022 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-16T22:12:21.078 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2024-02-16T22:12:21.133 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-16T22:12:21.133 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T22:12:21.133 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-02-16T22:12:21.133 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T22:12:21.133 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T22:12:21.133 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-02-16 22:12:10.373761888 +0000 2024-02-16T22:12:21.133 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-02-16 22:05:56.431578552 +0000 2024-02-16T22:12:21.133 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-02-16 22:05:56.431578552 +0000 2024-02-16T22:12:21.133 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-02-16 22:05:56.431578552 +0000 2024-02-16T22:12:21.134 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-16T22:12:21.198 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-02-16T22:12:21.199 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-02-16T22:12:21.199 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000232426 s, 2.2 MB/s 2024-02-16T22:12:21.200 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-16T22:12:21.255 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2024-02-16T22:12:21.310 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-16T22:12:21.310 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T22:12:21.310 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-02-16T22:12:21.310 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T22:12:21.310 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T22:12:21.310 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-02-16 22:12:10.373761888 +0000 2024-02-16T22:12:21.310 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-02-16 22:05:56.795570459 +0000 2024-02-16T22:12:21.311 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-02-16 22:05:56.795570459 +0000 2024-02-16T22:12:21.311 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-02-16 22:05:56.795570459 +0000 2024-02-16T22:12:21.311 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-16T22:12:21.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-02-16T22:12:21.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-02-16T22:12:21.377 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.0002442 s, 2.1 MB/s 2024-02-16T22:12:21.379 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-16T22:12:21.434 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2024-02-16T22:12:21.488 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-16T22:12:21.489 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T22:12:21.489 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-02-16T22:12:21.489 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T22:12:21.489 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T22:12:21.489 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-02-16 22:12:10.374761866 +0000 2024-02-16T22:12:21.489 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-02-16 22:05:57.124563144 +0000 2024-02-16T22:12:21.489 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-02-16 22:05:57.124563144 +0000 2024-02-16T22:12:21.489 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-02-16 22:05:57.124563144 +0000 2024-02-16T22:12:21.489 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-16T22:12:21.554 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-02-16T22:12:21.555 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-02-16T22:12:21.555 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000196226 s, 2.6 MB/s 2024-02-16T22:12:21.556 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-16T22:12:21.612 INFO:tasks.cephadm:Deploying osd.0 on smithi134 with /dev/vg_nvme/lv_4... 2024-02-16T22:12:21.612 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-16T22:12:22.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:22 smithi134 ceph-mon[28869]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:22.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:22.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:22.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:22 smithi134 ceph-mon[28869]: Reconfiguring mgr.smithi134.ordace (unknown last config time)... 2024-02-16T22:12:22.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.ordace", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:12:22.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:12:22.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:22.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:22 smithi134 ceph-mon[28869]: Reconfiguring daemon mgr.smithi134.ordace on smithi134 2024-02-16T22:12:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:22 smithi173 ceph-mon[37280]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:22.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:22 smithi173 ceph-mon[37280]: Reconfiguring mgr.smithi134.ordace (unknown last config time)... 2024-02-16T22:12:22.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.ordace", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:12:22.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:12:22.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:22.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:22 smithi173 ceph-mon[37280]: Reconfiguring daemon mgr.smithi134.ordace on smithi134 2024-02-16T22:12:22.602 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:12:23.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:23 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:23.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:23 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:23.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:23 smithi134 ceph-mon[28869]: Reconfiguring crash.smithi134 (monmap changed)... 2024-02-16T22:12:23.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:23 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-16T22:12:23.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:23 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:23.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:23 smithi134 ceph-mon[28869]: Reconfiguring daemon crash.smithi134 on smithi134 2024-02-16T22:12:23.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:23 smithi134 ceph-mon[28869]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:23.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:23 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:23.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:23 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:23.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:23 smithi173 ceph-mon[37280]: Reconfiguring crash.smithi134 (monmap changed)... 2024-02-16T22:12:23.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:23 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-16T22:12:23.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:23 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:23.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:23 smithi173 ceph-mon[37280]: Reconfiguring daemon crash.smithi134 on smithi134 2024-02-16T22:12:23.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:23 smithi173 ceph-mon[37280]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:25.594 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-16T22:12:25.594 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-16T22:12:25.594 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-02-16T22:12:25.594 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-02-16T22:12:25.594 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0139706 s, 751 MB/s 2024-02-16T22:12:25.594 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-02-16T22:12:25.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:25 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:25.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:25 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:25.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:25 smithi134 ceph-mon[28869]: Reconfiguring alertmanager.smithi134 (dependencies changed)... 2024-02-16T22:12:25.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:25 smithi134 ceph-mon[28869]: Reconfiguring daemon alertmanager.smithi134 on smithi134 2024-02-16T22:12:25.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:25 smithi134 ceph-mon[28869]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:26.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:25 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:26.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:25 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:26.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:25 smithi173 ceph-mon[37280]: Reconfiguring alertmanager.smithi134 (dependencies changed)... 2024-02-16T22:12:26.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:25 smithi173 ceph-mon[37280]: Reconfiguring daemon alertmanager.smithi134 on smithi134 2024-02-16T22:12:26.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:25 smithi173 ceph-mon[37280]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:27.845 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi134:vg_nvme/lv_4 2024-02-16T22:12:28.442 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:12:28.568 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:28 smithi134 ceph-mon[28869]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:28.568 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:28 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:12:28.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:28 smithi173 ceph-mon[37280]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:28.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:28 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:12:30.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:30 smithi134 ceph-mon[28869]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.721+0000 7f6350c1a700 1 -- 172.21.15.134:0/3962830263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f634c0fbe40 msgr2=0x7f634c0fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:12:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.721+0000 7f6350c1a700 1 --2- 172.21.15.134:0/3962830263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f634c0fbe40 0x7f634c0fc250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6340004940 tx=0x7f6340009e30 comp rx=0 tx=0).stop 2024-02-16T22:12:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.721+0000 7f6350c1a700 1 -- 172.21.15.134:0/3962830263 shutdown_connections 2024-02-16T22:12:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.721+0000 7f6350c1a700 1 --2- 172.21.15.134:0/3962830263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f634c0fcfb0 0x7f634c0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.721+0000 7f6350c1a700 1 --2- 172.21.15.134:0/3962830263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f634c0fbe40 0x7f634c0fc250 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.721+0000 7f6350c1a700 1 -- 172.21.15.134:0/3962830263 >> 172.21.15.134:0/3962830263 conn(0x7f634c0f7520 msgr2=0x7f634c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:12:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.721+0000 7f6350c1a700 1 -- 172.21.15.134:0/3962830263 shutdown_connections 2024-02-16T22:12:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.721+0000 7f6350c1a700 1 -- 172.21.15.134:0/3962830263 wait complete. 2024-02-16T22:12:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f6350c1a700 1 Processor -- start 2024-02-16T22:12:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f6350c1a700 1 -- start start 2024-02-16T22:12:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f6350c1a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f634c0fbe40 0x7f634c110670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:12:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f6350c1a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f634c0fcfb0 0x7f634c112bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:12:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f6350c1a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c066d80 con 0x7f634c0fbe40 2024-02-16T22:12:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f6350c1a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c066ec0 con 0x7f634c0fcfb0 2024-02-16T22:12:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f634a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f634c0fbe40 0x7f634c110670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:12:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f634a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f634c0fbe40 0x7f634c110670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53054/0 (socket says 172.21.15.134:53054) 2024-02-16T22:12:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f634a59c700 1 -- 172.21.15.134:0/3556065358 learned_addr learned my addr 172.21.15.134:0/3556065358 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:12:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f6349d9b700 1 --2- 172.21.15.134:0/3556065358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f634c0fcfb0 0x7f634c112bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:12:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f634a59c700 1 -- 172.21.15.134:0/3556065358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f634c0fcfb0 msgr2=0x7f634c112bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:12:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f634a59c700 1 --2- 172.21.15.134:0/3556065358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f634c0fcfb0 0x7f634c112bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:12:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f634a59c700 1 -- 172.21.15.134:0/3556065358 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6340005040 con 0x7f634c0fbe40 2024-02-16T22:12:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f634a59c700 1 --2- 172.21.15.134:0/3556065358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f634c0fbe40 0x7f634c110670 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6340009fd0 tx=0x7f6340009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:12:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.722+0000 7f633affd700 1 -- 172.21.15.134:0/3556065358 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f634000e040 con 0x7f634c0fbe40 2024-02-16T22:12:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.723+0000 7f633affd700 1 -- 172.21.15.134:0/3556065358 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f634000bcc0 con 0x7f634c0fbe40 2024-02-16T22:12:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.723+0000 7f6350c1a700 1 -- 172.21.15.134:0/3556065358 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c1131f0 con 0x7f634c0fbe40 2024-02-16T22:12:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.723+0000 7f633affd700 1 -- 172.21.15.134:0/3556065358 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f634001c630 con 0x7f634c0fbe40 2024-02-16T22:12:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.723+0000 7f6350c1a700 1 -- 172.21.15.134:0/3556065358 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c1136d0 con 0x7f634c0fbe40 2024-02-16T22:12:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.724+0000 7f6350c1a700 1 -- 172.21.15.134:0/3556065358 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c04bed0 con 0x7f634c0fbe40 2024-02-16T22:12:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.724+0000 7f633affd700 1 -- 172.21.15.134:0/3556065358 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f6340013420 con 0x7f634c0fbe40 2024-02-16T22:12:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.724+0000 7f633affd700 1 --2- 172.21.15.134:0/3556065358 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6334069210 0x7f633406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:12:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.724+0000 7f6349d9b700 1 --2- 172.21.15.134:0/3556065358 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6334069210 0x7f633406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:12:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.724+0000 7f633affd700 1 -- 172.21.15.134:0/3556065358 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6340087620 con 0x7f634c0fbe40 2024-02-16T22:12:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.725+0000 7f6349d9b700 1 --2- 172.21.15.134:0/3556065358 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6334069210 0x7f633406b6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f633c006fd0 tx=0x7f633c008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:12:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.728+0000 7f633affd700 1 -- 172.21.15.134:0/3556065358 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6340054a30 con 0x7f634c0fbe40 2024-02-16T22:12:30.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:30 smithi173 ceph-mon[37280]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:30.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:12:30.960+0000 7f6350c1a700 1 -- 172.21.15.134:0/3556065358 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f634c101990 con 0x7f6334069210 2024-02-16T22:12:31.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:31 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-16T22:12:31.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:31 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-16T22:12:31.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:31 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:31.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:31 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-16T22:12:31.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:31 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-16T22:12:31.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:31 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:32.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:32 smithi134 ceph-mon[28869]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:32.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:32 smithi134 ceph-mon[28869]: from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:12:32.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:32.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:32 smithi173 ceph-mon[37280]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:32 smithi173 ceph-mon[37280]: from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:12:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:33.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:33 smithi134 ceph-mon[28869]: Reconfiguring grafana.smithi134 (dependencies changed)... 2024-02-16T22:12:33.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:33 smithi134 ceph-mon[28869]: Reconfiguring daemon grafana.smithi134 on smithi134 2024-02-16T22:12:33.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:33 smithi173 ceph-mon[37280]: Reconfiguring grafana.smithi134 (dependencies changed)... 2024-02-16T22:12:33.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:33 smithi173 ceph-mon[37280]: Reconfiguring daemon grafana.smithi134 on smithi134 2024-02-16T22:12:34.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:34 smithi134 ceph-mon[28869]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:34.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:34 smithi173 ceph-mon[37280]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:35.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:35 smithi134 ceph-mon[28869]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:35.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:35 smithi173 ceph-mon[37280]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:37.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:37 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:37.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:37 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:37.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:37 smithi134 ceph-mon[28869]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-02-16T22:12:37.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:37 smithi134 ceph-mon[28869]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-02-16T22:12:37.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:37 smithi134 ceph-mon[28869]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:38.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:37 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:38.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:37 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:38.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:37 smithi173 ceph-mon[37280]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-02-16T22:12:38.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:37 smithi173 ceph-mon[37280]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-02-16T22:12:38.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:37 smithi173 ceph-mon[37280]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:38 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2763003240' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8e715f3-43f6-439a-be3d-a3bbd70b412a"}]: dispatch 2024-02-16T22:12:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:38 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2763003240' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8e715f3-43f6-439a-be3d-a3bbd70b412a"}]': finished 2024-02-16T22:12:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:38 smithi134 ceph-mon[28869]: osdmap e6: 1 total, 0 up, 1 in 2024-02-16T22:12:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:38 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:12:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:38 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2023934339' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-16T22:12:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:38 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2763003240' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8e715f3-43f6-439a-be3d-a3bbd70b412a"}]: dispatch 2024-02-16T22:12:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:38 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2763003240' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8e715f3-43f6-439a-be3d-a3bbd70b412a"}]': finished 2024-02-16T22:12:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:38 smithi173 ceph-mon[37280]: osdmap e6: 1 total, 0 up, 1 in 2024-02-16T22:12:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:38 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:12:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:38 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2023934339' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-16T22:12:40.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:39 smithi134 ceph-mon[28869]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:40.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:39 smithi173 ceph-mon[37280]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:42.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:42 smithi134 ceph-mon[28869]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:42.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:42 smithi173 ceph-mon[37280]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:43.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:12:43.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:43 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:12:44.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:44 smithi134 ceph-mon[28869]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:44 smithi173 ceph-mon[37280]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:46 smithi134 ceph-mon[28869]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:46.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:46 smithi173 ceph-mon[37280]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:47.632 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:47 smithi134 ceph-mon[28869]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:47.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:47 smithi173 ceph-mon[37280]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:49.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:49 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:49.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:49 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:49.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:49 smithi134 ceph-mon[28869]: Reconfiguring crash.smithi173 (monmap changed)... 2024-02-16T22:12:49.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:49 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi173", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-16T22:12:49.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:49 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:49.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:49 smithi134 ceph-mon[28869]: Reconfiguring daemon crash.smithi173 on smithi173 2024-02-16T22:12:49.451 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:49 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:49.452 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:49 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:49.452 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:49 smithi173 ceph-mon[37280]: Reconfiguring crash.smithi173 (monmap changed)... 2024-02-16T22:12:49.452 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:49 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi173", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-16T22:12:49.452 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:49 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:49.452 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:49 smithi173 ceph-mon[37280]: Reconfiguring daemon crash.smithi173 on smithi173 2024-02-16T22:12:50.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:50 smithi134 ceph-mon[28869]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:50.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:50 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:50.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:50 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:50.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:50 smithi134 ceph-mon[28869]: Reconfiguring mgr.smithi173.kbofaa (monmap changed)... 2024-02-16T22:12:50.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:50 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi173.kbofaa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:12:50.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:50 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:12:50.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:50 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:50.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:50 smithi134 ceph-mon[28869]: Reconfiguring daemon mgr.smithi173.kbofaa on smithi173 2024-02-16T22:12:50.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:50 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-16T22:12:50.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:50 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:50.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:50 smithi134 ceph-mon[28869]: Deploying daemon osd.0 on smithi134 2024-02-16T22:12:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:50 smithi173 ceph-mon[37280]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:50 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:50 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:50 smithi173 ceph-mon[37280]: Reconfiguring mgr.smithi173.kbofaa (monmap changed)... 2024-02-16T22:12:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:50 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi173.kbofaa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:12:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:50 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:12:50.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:50 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:50.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:50 smithi173 ceph-mon[37280]: Reconfiguring daemon mgr.smithi173.kbofaa on smithi173 2024-02-16T22:12:50.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:50 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-16T22:12:50.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:50 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:50.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:50 smithi173 ceph-mon[37280]: Deploying daemon osd.0 on smithi134 2024-02-16T22:12:51.700 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:51 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:51.700 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:51 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:51.700 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:51 smithi173 ceph-mon[37280]: Reconfiguring mon.smithi173 (monmap changed)... 2024-02-16T22:12:51.700 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:51 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-16T22:12:51.700 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:51 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-16T22:12:51.701 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:51 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:51.701 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:51 smithi173 ceph-mon[37280]: Reconfiguring daemon mon.smithi173 on smithi173 2024-02-16T22:12:51.701 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:51 smithi173 ceph-mon[37280]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:51.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:51 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:51.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:51 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:51.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:51 smithi134 ceph-mon[28869]: Reconfiguring mon.smithi173 (monmap changed)... 2024-02-16T22:12:51.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:51 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-16T22:12:51.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:51 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-16T22:12:51.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:51 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:51.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:51 smithi134 ceph-mon[28869]: Reconfiguring daemon mon.smithi173 on smithi173 2024-02-16T22:12:51.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:51 smithi134 ceph-mon[28869]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:52.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:52.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:52.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-16T22:12:52.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-16T22:12:52.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi134.front.sepia.ceph.com:9093"}]: dispatch 2024-02-16T22:12:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi134.front.sepia.ceph.com:9093"}]: dispatch 2024-02-16T22:12:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-16T22:12:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-16T22:12:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134.front.sepia.ceph.com:3000"}]: dispatch 2024-02-16T22:12:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134.front.sepia.ceph.com:3000"}]: dispatch 2024-02-16T22:12:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:12:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:12:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-02-16T22:12:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-02-16T22:12:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:12:53.119 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:53.119 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:53.119 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-16T22:12:53.120 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-16T22:12:53.120 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi134.front.sepia.ceph.com:9093"}]: dispatch 2024-02-16T22:12:53.120 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi134.front.sepia.ceph.com:9093"}]: dispatch 2024-02-16T22:12:53.120 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:53.120 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-16T22:12:53.120 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-16T22:12:53.120 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134.front.sepia.ceph.com:3000"}]: dispatch 2024-02-16T22:12:53.120 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134.front.sepia.ceph.com:3000"}]: dispatch 2024-02-16T22:12:53.120 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:53.120 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:12:53.120 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:12:53.120 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-02-16T22:12:53.120 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-02-16T22:12:53.120 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:53.121 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:12:54.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:53 smithi134 ceph-mon[28869]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:54.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:53 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:54.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:53 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:54.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:53 smithi173 ceph-mon[37280]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:54.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:53 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:54.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:53 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:55.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:55 smithi134 ceph-mon[28869]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:56.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:55 smithi173 ceph-mon[37280]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:57.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:57 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:57.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:57 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:57 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:57 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:58.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:58 smithi134 ceph-mon[28869]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:58.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:58 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:12:58.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:58 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:58.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:58 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:58.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:58 smithi173 ceph-mon[37280]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:12:58.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:58 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:12:58.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:58 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:58.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:58 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:59.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:59 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:59.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:59 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:12:59.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:59 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:59.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:12:59 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:12:59.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:59 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:12:59.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:59 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:12:59.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:59 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:12:59.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:12:59 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:13:00.210 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 0 on host 'smithi134' 2024-02-16T22:13:00.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:00.208+0000 7f633affd700 1 -- 172.21.15.134:0/3556065358 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f634c101990 con 0x7f6334069210 2024-02-16T22:13:00.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:00.210+0000 7f6350c1a700 1 -- 172.21.15.134:0/3556065358 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6334069210 msgr2=0x7f633406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:13:00.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:00.210+0000 7f6350c1a700 1 --2- 172.21.15.134:0/3556065358 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6334069210 0x7f633406b6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f633c006fd0 tx=0x7f633c008040 comp rx=0 tx=0).stop 2024-02-16T22:13:00.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:00.210+0000 7f6350c1a700 1 -- 172.21.15.134:0/3556065358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f634c0fbe40 msgr2=0x7f634c110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:13:00.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:00.210+0000 7f6350c1a700 1 --2- 172.21.15.134:0/3556065358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f634c0fbe40 0x7f634c110670 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6340009fd0 tx=0x7f6340009e30 comp rx=0 tx=0).stop 2024-02-16T22:13:00.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:00.210+0000 7f6350c1a700 1 -- 172.21.15.134:0/3556065358 shutdown_connections 2024-02-16T22:13:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:00.210+0000 7f6350c1a700 1 --2- 172.21.15.134:0/3556065358 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6334069210 0x7f633406b6c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:00.210+0000 7f6350c1a700 1 --2- 172.21.15.134:0/3556065358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f634c0fbe40 0x7f634c110670 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:00.210+0000 7f6350c1a700 1 --2- 172.21.15.134:0/3556065358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f634c0fcfb0 0x7f634c112bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:00.210+0000 7f6350c1a700 1 -- 172.21.15.134:0/3556065358 >> 172.21.15.134:0/3556065358 conn(0x7f634c0f7520 msgr2=0x7f634c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:13:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:00.210+0000 7f6350c1a700 1 -- 172.21.15.134:0/3556065358 shutdown_connections 2024-02-16T22:13:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:00.210+0000 7f6350c1a700 1 -- 172.21.15.134:0/3556065358 wait complete. 2024-02-16T22:13:00.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:00 smithi134 ceph-mon[28869]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:13:00.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:00 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:00.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:00 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:00.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:00 smithi134 ceph-mon[28869]: from='osd.0 [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-16T22:13:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:00 smithi173 ceph-mon[37280]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:13:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:00 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:00 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:00 smithi173 ceph-mon[37280]: from='osd.0 [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-16T22:13:01.164 DEBUG:teuthology.orchestra.run.smithi134:osd.0> sudo journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.0.service 2024-02-16T22:13:01.167 INFO:tasks.cephadm:Deploying osd.1 on smithi134 with /dev/vg_nvme/lv_3... 2024-02-16T22:13:01.167 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-16T22:13:01.813 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:01 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:01.813 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:01 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:01.813 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:01 smithi173 ceph-mon[37280]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:13:01.813 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:01 smithi173 ceph-mon[37280]: from='osd.0 [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-16T22:13:01.814 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:01 smithi173 ceph-mon[37280]: osdmap e7: 1 total, 0 up, 1 in 2024-02-16T22:13:01.814 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:01 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:13:01.814 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:01 smithi173 ceph-mon[37280]: from='osd.0 [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-02-16T22:13:01.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:01 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:01.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:01 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:01.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:01 smithi134 ceph-mon[28869]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:13:01.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:01 smithi134 ceph-mon[28869]: from='osd.0 [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-16T22:13:01.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:01 smithi134 ceph-mon[28869]: osdmap e7: 1 total, 0 up, 1 in 2024-02-16T22:13:01.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:01 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:13:01.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:01 smithi134 ceph-mon[28869]: from='osd.0 [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-02-16T22:13:02.040 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:13:02.436 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:13:02 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0[47993]: 2024-02-16T22:13:02.183+0000 7f450ee04700 -1 osd.0 0 waiting for initial osdmap 2024-02-16T22:13:02.436 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:13:02 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0[47993]: 2024-02-16T22:13:02.186+0000 7f45083fc700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T22:13:03.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:03 smithi134 ceph-mon[28869]: from='osd.0 [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-02-16T22:13:03.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:03 smithi134 ceph-mon[28869]: osdmap e8: 1 total, 0 up, 1 in 2024-02-16T22:13:03.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:13:03.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:13:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:03 smithi173 ceph-mon[37280]: from='osd.0 [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-02-16T22:13:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:03 smithi173 ceph-mon[37280]: osdmap e8: 1 total, 0 up, 1 in 2024-02-16T22:13:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:03 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:13:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:03 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:13:04.370 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:04 smithi134 ceph-mon[28869]: purged_snaps scrub starts 2024-02-16T22:13:04.370 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:04 smithi134 ceph-mon[28869]: purged_snaps scrub ok 2024-02-16T22:13:04.370 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:04 smithi134 ceph-mon[28869]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:13:04.370 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:04 smithi134 ceph-mon[28869]: osd.0 [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494] boot 2024-02-16T22:13:04.370 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:04 smithi134 ceph-mon[28869]: osdmap e9: 1 total, 1 up, 1 in 2024-02-16T22:13:04.370 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:04 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:13:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:04 smithi173 ceph-mon[37280]: purged_snaps scrub starts 2024-02-16T22:13:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:04 smithi173 ceph-mon[37280]: purged_snaps scrub ok 2024-02-16T22:13:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:04 smithi173 ceph-mon[37280]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-16T22:13:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:04 smithi173 ceph-mon[37280]: osd.0 [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494] boot 2024-02-16T22:13:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:04 smithi173 ceph-mon[37280]: osdmap e9: 1 total, 1 up, 1 in 2024-02-16T22:13:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:04 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:13:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-16T22:13:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-16T22:13:05.364 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-02-16T22:13:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-02-16T22:13:05.364 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0170271 s, 616 MB/s 2024-02-16T22:13:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-02-16T22:13:05.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:05 smithi134 ceph-mon[28869]: osdmap e10: 1 total, 1 up, 1 in 2024-02-16T22:13:05.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:05 smithi173 ceph-mon[37280]: osdmap e10: 1 total, 1 up, 1 in 2024-02-16T22:13:06.030 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi134:vg_nvme/lv_3 2024-02-16T22:13:06.354 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:13:06.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:06 smithi134 ceph-mon[28869]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:06 smithi173 ceph-mon[37280]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:07.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:07 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:07.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:07 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:07.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:07 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:07.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:07 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:08.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.224+0000 7fcabb7c3700 1 -- 172.21.15.134:0/3172446769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab40fcfb0 msgr2=0x7fcab40fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:13:08.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.224+0000 7fcabb7c3700 1 --2- 172.21.15.134:0/3172446769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab40fcfb0 0x7fcab40fd420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8004940 tx=0x7fcaa8009e30 comp rx=0 tx=0).stop 2024-02-16T22:13:08.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.224+0000 7fcabb7c3700 1 -- 172.21.15.134:0/3172446769 shutdown_connections 2024-02-16T22:13:08.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.224+0000 7fcabb7c3700 1 --2- 172.21.15.134:0/3172446769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab40fcfb0 0x7fcab40fd420 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:08.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.224+0000 7fcabb7c3700 1 --2- 172.21.15.134:0/3172446769 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcab40fbe40 0x7fcab40fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:08.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.224+0000 7fcabb7c3700 1 -- 172.21.15.134:0/3172446769 >> 172.21.15.134:0/3172446769 conn(0x7fcab40f74e0 msgr2=0x7fcab40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:13:08.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.224+0000 7fcabb7c3700 1 -- 172.21.15.134:0/3172446769 shutdown_connections 2024-02-16T22:13:08.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.224+0000 7fcabb7c3700 1 -- 172.21.15.134:0/3172446769 wait complete. 2024-02-16T22:13:08.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.224+0000 7fcabb7c3700 1 Processor -- start 2024-02-16T22:13:08.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.224+0000 7fcabb7c3700 1 -- start start 2024-02-16T22:13:08.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcabb7c3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcab40fbe40 0x7fcab40fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:13:08.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcabb7c3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab40fcfb0 0x7fcab40fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:13:08.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcabb7c3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab40fe980 con 0x7fcab40fcfb0 2024-02-16T22:13:08.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcabb7c3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab40feaf0 con 0x7fcab40fbe40 2024-02-16T22:13:08.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcab8d5e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab40fcfb0 0x7fcab40fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:13:08.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcab8d5e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab40fcfb0 0x7fcab40fe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42318/0 (socket says 172.21.15.134:42318) 2024-02-16T22:13:08.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcab8d5e700 1 -- 172.21.15.134:0/1605458549 learned_addr learned my addr 172.21.15.134:0/1605458549 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:13:08.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcab955f700 1 --2- 172.21.15.134:0/1605458549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcab40fbe40 0x7fcab40fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:13:08.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcab8d5e700 1 -- 172.21.15.134:0/1605458549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcab40fbe40 msgr2=0x7fcab40fff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:13:08.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcab8d5e700 1 --2- 172.21.15.134:0/1605458549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcab40fbe40 0x7fcab40fff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:08.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcab8d5e700 1 -- 172.21.15.134:0/1605458549 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa8005040 con 0x7fcab40fcfb0 2024-02-16T22:13:08.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcab955f700 1 --2- 172.21.15.134:0/1605458549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcab40fbe40 0x7fcab40fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:13:08.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcab8d5e700 1 --2- 172.21.15.134:0/1605458549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab40fcfb0 0x7fcab40fe380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80093b0 tx=0x7fcaa8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:13:08.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcab1ffb700 1 -- 172.21.15.134:0/1605458549 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaa800e040 con 0x7fcab40fcfb0 2024-02-16T22:13:08.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcab1ffb700 1 -- 172.21.15.134:0/1605458549 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcaa800bcc0 con 0x7fcab40fcfb0 2024-02-16T22:13:08.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcabb7c3700 1 -- 172.21.15.134:0/1605458549 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab40fed70 con 0x7fcab40fcfb0 2024-02-16T22:13:08.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcab1ffb700 1 -- 172.21.15.134:0/1605458549 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaa801c630 con 0x7fcab40fcfb0 2024-02-16T22:13:08.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.225+0000 7fcabb7c3700 1 -- 172.21.15.134:0/1605458549 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab4115990 con 0x7fcab40fcfb0 2024-02-16T22:13:08.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.226+0000 7fcabb7c3700 1 -- 172.21.15.134:0/1605458549 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab404bed0 con 0x7fcab40fcfb0 2024-02-16T22:13:08.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.227+0000 7fcab1ffb700 1 -- 172.21.15.134:0/1605458549 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fcaa80139f0 con 0x7fcab40fcfb0 2024-02-16T22:13:08.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.227+0000 7fcab1ffb700 1 --2- 172.21.15.134:0/1605458549 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fca9c069210 0x7fca9c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:13:08.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.227+0000 7fcab1ffb700 1 -- 172.21.15.134:0/1605458549 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7fcaa8087610 con 0x7fcab40fcfb0 2024-02-16T22:13:08.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.227+0000 7fcab955f700 1 --2- 172.21.15.134:0/1605458549 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fca9c069210 0x7fca9c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:13:08.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.228+0000 7fcab955f700 1 --2- 172.21.15.134:0/1605458549 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fca9c069210 0x7fca9c06b6c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcab40ffc90 tx=0x7fcaa400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:13:08.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.232+0000 7fcab1ffb700 1 -- 172.21.15.134:0/1605458549 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fcaa80582f0 con 0x7fcab40fcfb0 2024-02-16T22:13:08.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:08.431+0000 7fcabb7c3700 1 -- 172.21.15.134:0/1605458549 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fcab4065dd0 con 0x7fca9c069210 2024-02-16T22:13:08.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:08 smithi134 ceph-mon[28869]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:08.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:08 smithi173 ceph-mon[37280]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:09.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:09 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-16T22:13:09.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:09 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-16T22:13:09.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:09 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:09.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:09 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-16T22:13:09.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:09 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-16T22:13:09.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:09 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:10 smithi134 ceph-mon[28869]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:13:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:10 smithi134 ceph-mon[28869]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:10.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:10 smithi173 ceph-mon[37280]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:13:10.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:10 smithi173 ceph-mon[37280]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:12 smithi173 ceph-mon[37280]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:12 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:12 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:12 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:13:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:12 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:12 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:12 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:13:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:12 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:12.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:12 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:13:12.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:12 smithi134 ceph-mon[28869]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:12.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:12 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:12.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:12 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:12.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:12 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:13:12.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:12 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:12.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:12 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:12.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:12 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:13:12.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:12 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:12.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:12 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:13:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:13 smithi134 ceph-mon[28869]: Detected new or changed devices on smithi134 2024-02-16T22:13:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:13 smithi134 ceph-mon[28869]: Adjusting osd_memory_target on smithi134 to 12864M 2024-02-16T22:13:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:13 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/329822649' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1fe573e-cb80-4ac7-9d3c-b7e296e86a81"}]: dispatch 2024-02-16T22:13:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:13 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/329822649' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1fe573e-cb80-4ac7-9d3c-b7e296e86a81"}]': finished 2024-02-16T22:13:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:13 smithi134 ceph-mon[28869]: osdmap e11: 2 total, 1 up, 2 in 2024-02-16T22:13:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:13 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:13:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:13 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:13:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:13 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2138490841' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-16T22:13:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:13 smithi173 ceph-mon[37280]: Detected new or changed devices on smithi134 2024-02-16T22:13:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:13 smithi173 ceph-mon[37280]: Adjusting osd_memory_target on smithi134 to 12864M 2024-02-16T22:13:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:13 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/329822649' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1fe573e-cb80-4ac7-9d3c-b7e296e86a81"}]: dispatch 2024-02-16T22:13:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:13 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/329822649' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1fe573e-cb80-4ac7-9d3c-b7e296e86a81"}]': finished 2024-02-16T22:13:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:13 smithi173 ceph-mon[37280]: osdmap e11: 2 total, 1 up, 2 in 2024-02-16T22:13:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:13 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:13:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:13 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:13:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:13 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2138490841' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-16T22:13:14.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:14 smithi134 ceph-mon[28869]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:14.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:14 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:14.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:14 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:14.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:14 smithi173 ceph-mon[37280]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:14.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:14 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:14.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:14 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:15.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:15 smithi134 ceph-mon[28869]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:15.812 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:15 smithi173 ceph-mon[37280]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:17.193 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:17.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:17.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:17.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:13:17.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:17.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:16 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:17.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:16 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:17.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:16 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:17.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:16 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:13:17.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:16 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:18.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:18 smithi134 ceph-mon[28869]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:18.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:18 smithi173 ceph-mon[37280]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:20.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:20 smithi134 ceph-mon[28869]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:20.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:20 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-16T22:13:20.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:20 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:20.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:20 smithi173 ceph-mon[37280]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:20.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:20 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-16T22:13:20.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:20 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:21.609 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:21 smithi134 ceph-mon[28869]: Deploying daemon osd.1 on smithi134 2024-02-16T22:13:21.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:21 smithi173 ceph-mon[37280]: Deploying daemon osd.1 on smithi134 2024-02-16T22:13:22.597 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:22 smithi134 ceph-mon[28869]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:22.713 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:22 smithi173 ceph-mon[37280]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:23.634 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:23 smithi134 ceph-mon[28869]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:23.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:23 smithi173 ceph-mon[37280]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:26.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:26 smithi134 ceph-mon[28869]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:26.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:26 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:26.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:26 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:26.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:26 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:13:26.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:26 smithi173 ceph-mon[37280]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:26.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:26 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:26.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:26 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:26.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:26 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:13:28.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:28 smithi134 ceph-mon[28869]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:28.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:28 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:13:28.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:28 smithi173 ceph-mon[37280]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:28.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:28 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:29.085+0000 7fcab1ffb700 1 -- 172.21.15.134:0/1605458549 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcab4065dd0 con 0x7fca9c069210 2024-02-16T22:13:29.088 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 1 on host 'smithi134' 2024-02-16T22:13:29.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:29.087+0000 7fcabb7c3700 1 -- 172.21.15.134:0/1605458549 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fca9c069210 msgr2=0x7fca9c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:13:29.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:29.087+0000 7fcabb7c3700 1 --2- 172.21.15.134:0/1605458549 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fca9c069210 0x7fca9c06b6c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcab40ffc90 tx=0x7fcaa400b040 comp rx=0 tx=0).stop 2024-02-16T22:13:29.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:29.087+0000 7fcabb7c3700 1 -- 172.21.15.134:0/1605458549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab40fcfb0 msgr2=0x7fcab40fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:13:29.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:29.087+0000 7fcabb7c3700 1 --2- 172.21.15.134:0/1605458549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab40fcfb0 0x7fcab40fe380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80093b0 tx=0x7fcaa8009e30 comp rx=0 tx=0).stop 2024-02-16T22:13:29.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:29.087+0000 7fcabb7c3700 1 -- 172.21.15.134:0/1605458549 shutdown_connections 2024-02-16T22:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:29.087+0000 7fcabb7c3700 1 --2- 172.21.15.134:0/1605458549 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fca9c069210 0x7fca9c06b6c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:29.087+0000 7fcabb7c3700 1 --2- 172.21.15.134:0/1605458549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcab40fbe40 0x7fcab40fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:29.087+0000 7fcabb7c3700 1 --2- 172.21.15.134:0/1605458549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab40fcfb0 0x7fcab40fe380 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:29.087+0000 7fcabb7c3700 1 -- 172.21.15.134:0/1605458549 >> 172.21.15.134:0/1605458549 conn(0x7fcab40f74e0 msgr2=0x7fcab40656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:29.087+0000 7fcabb7c3700 1 -- 172.21.15.134:0/1605458549 shutdown_connections 2024-02-16T22:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:29.087+0000 7fcabb7c3700 1 -- 172.21.15.134:0/1605458549 wait complete. 2024-02-16T22:13:29.906 DEBUG:teuthology.orchestra.run.smithi134:osd.1> sudo journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.1.service 2024-02-16T22:13:29.908 INFO:tasks.cephadm:Deploying osd.2 on smithi134 with /dev/vg_nvme/lv_2... 2024-02-16T22:13:29.909 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-16T22:13:30.167 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:30 smithi134 ceph-mon[28869]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:30.167 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:30 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:30.167 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:30 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:30.167 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:30 smithi134 ceph-mon[28869]: from='osd.1 [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-16T22:13:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:30 smithi173 ceph-mon[37280]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:30 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:30 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:30 smithi173 ceph-mon[37280]: from='osd.1 [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-16T22:13:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:31 smithi134 ceph-mon[28869]: from='osd.1 [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-16T22:13:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:31 smithi134 ceph-mon[28869]: osdmap e12: 2 total, 1 up, 2 in 2024-02-16T22:13:31.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:31 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:13:31.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:31 smithi134 ceph-mon[28869]: from='osd.1 [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-02-16T22:13:31.228 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:13:31 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1[55671]: 2024-02-16T22:13:31.082+0000 7fcfe9101700 -1 osd.1 0 waiting for initial osdmap 2024-02-16T22:13:31.228 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:13:31 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1[55671]: 2024-02-16T22:13:31.086+0000 7fcfe26f9700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T22:13:31.371 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:13:31.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:31 smithi173 ceph-mon[37280]: from='osd.1 [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-16T22:13:31.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:31 smithi173 ceph-mon[37280]: osdmap e12: 2 total, 1 up, 2 in 2024-02-16T22:13:31.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:31 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:13:31.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:31 smithi173 ceph-mon[37280]: from='osd.1 [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-02-16T22:13:32.352 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:32 smithi134 ceph-mon[28869]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:32.352 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:32 smithi134 ceph-mon[28869]: from='osd.1 [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-02-16T22:13:32.352 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:32 smithi134 ceph-mon[28869]: osdmap e13: 2 total, 1 up, 2 in 2024-02-16T22:13:32.352 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:13:32.352 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:13:32.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:32 smithi173 ceph-mon[37280]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:32.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:32 smithi173 ceph-mon[37280]: from='osd.1 [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-02-16T22:13:32.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:32 smithi173 ceph-mon[37280]: osdmap e13: 2 total, 1 up, 2 in 2024-02-16T22:13:32.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:13:32.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:13:33.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:33 smithi134 ceph-mon[28869]: purged_snaps scrub starts 2024-02-16T22:13:33.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:33 smithi134 ceph-mon[28869]: purged_snaps scrub ok 2024-02-16T22:13:33.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:33 smithi134 ceph-mon[28869]: osd.1 [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869] boot 2024-02-16T22:13:33.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:33 smithi134 ceph-mon[28869]: osdmap e14: 2 total, 2 up, 2 in 2024-02-16T22:13:33.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:33 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:13:33.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:33 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:33.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:33 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:33.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:33 smithi173 ceph-mon[37280]: purged_snaps scrub starts 2024-02-16T22:13:33.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:33 smithi173 ceph-mon[37280]: purged_snaps scrub ok 2024-02-16T22:13:33.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:33 smithi173 ceph-mon[37280]: osd.1 [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869] boot 2024-02-16T22:13:33.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:33 smithi173 ceph-mon[37280]: osdmap e14: 2 total, 2 up, 2 in 2024-02-16T22:13:33.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:33 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:13:33.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:33 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:33.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:33 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:33.985 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-16T22:13:33.985 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-16T22:13:33.986 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-02-16T22:13:33.986 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-02-16T22:13:33.986 INFO:teuthology.orchestra.run.smithi134.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122227 s, 858 MB/s 2024-02-16T22:13:33.986 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 2024-02-16T22:13:33.986 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-02-16T22:13:34.343 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:34 smithi134 ceph-mon[28869]: pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:34.343 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:34 smithi134 ceph-mon[28869]: osdmap e15: 2 total, 2 up, 2 in 2024-02-16T22:13:34.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:34 smithi173 ceph-mon[37280]: pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-16T22:13:34.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:34 smithi173 ceph-mon[37280]: osdmap e15: 2 total, 2 up, 2 in 2024-02-16T22:13:34.937 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi134:vg_nvme/lv_2 2024-02-16T22:13:36.053 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:13:36.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:36 smithi134 ceph-mon[28869]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:36.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:36 smithi173 ceph-mon[37280]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:37.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.747+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/4129024900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e141000c0 msgr2=0x7f6e14102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:13:37.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.747+0000 7f6e1c1dd700 1 --2- 172.21.15.134:0/4129024900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e141000c0 0x7f6e14102520 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6e04004940 tx=0x7f6e04009e30 comp rx=0 tx=0).stop 2024-02-16T22:13:37.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.747+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/4129024900 shutdown_connections 2024-02-16T22:13:37.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.747+0000 7f6e1c1dd700 1 --2- 172.21.15.134:0/4129024900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e141000c0 0x7f6e14102520 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:37.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.747+0000 7f6e1c1dd700 1 --2- 172.21.15.134:0/4129024900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e14066c70 0x7f6e140ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:37.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.747+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/4129024900 >> 172.21.15.134:0/4129024900 conn(0x7f6e140f7520 msgr2=0x7f6e140f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:13:37.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.748+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/4129024900 shutdown_connections 2024-02-16T22:13:37.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.748+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/4129024900 wait complete. 2024-02-16T22:13:37.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.748+0000 7f6e1c1dd700 1 Processor -- start 2024-02-16T22:13:37.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.748+0000 7f6e1c1dd700 1 -- start start 2024-02-16T22:13:37.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.748+0000 7f6e1c1dd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e14066c70 0x7f6e140fd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:13:37.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.748+0000 7f6e1c1dd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e141000c0 0x7f6e140fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:13:37.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.748+0000 7f6e1c1dd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140fc080 con 0x7f6e14066c70 2024-02-16T22:13:37.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.748+0000 7f6e1c1dd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140fc1f0 con 0x7f6e141000c0 2024-02-16T22:13:37.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.748+0000 7f6e19f79700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e14066c70 0x7f6e140fd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:13:37.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.748+0000 7f6e19f79700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e14066c70 0x7f6e140fd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44486/0 (socket says 172.21.15.134:44486) 2024-02-16T22:13:37.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.748+0000 7f6e19f79700 1 -- 172.21.15.134:0/1870398725 learned_addr learned my addr 172.21.15.134:0/1870398725 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:13:37.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.749+0000 7f6e19778700 1 --2- 172.21.15.134:0/1870398725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e141000c0 0x7f6e140fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:13:37.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.749+0000 7f6e19f79700 1 -- 172.21.15.134:0/1870398725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e141000c0 msgr2=0x7f6e140fb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:13:37.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.749+0000 7f6e19f79700 1 --2- 172.21.15.134:0/1870398725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e141000c0 0x7f6e140fb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:37.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.749+0000 7f6e19f79700 1 -- 172.21.15.134:0/1870398725 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e04005040 con 0x7f6e14066c70 2024-02-16T22:13:37.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.749+0000 7f6e19f79700 1 --2- 172.21.15.134:0/1870398725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e14066c70 0x7f6e140fd570 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000b790 tx=0x7f6e10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:13:37.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.749+0000 7f6e0a7fc700 1 -- 172.21.15.134:0/1870398725 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e1000f6f0 con 0x7f6e14066c70 2024-02-16T22:13:37.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.749+0000 7f6e0a7fc700 1 -- 172.21.15.134:0/1870398725 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e1000fd20 con 0x7f6e14066c70 2024-02-16T22:13:37.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.749+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/1870398725 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e140fc4d0 con 0x7f6e14066c70 2024-02-16T22:13:37.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.749+0000 7f6e0a7fc700 1 -- 172.21.15.134:0/1870398725 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e100103a0 con 0x7f6e14066c70 2024-02-16T22:13:37.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.749+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/1870398725 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e140fc850 con 0x7f6e14066c70 2024-02-16T22:13:37.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.750+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/1870398725 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1404bed0 con 0x7f6e14066c70 2024-02-16T22:13:37.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.751+0000 7f6e0a7fc700 1 -- 172.21.15.134:0/1870398725 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f6e10011400 con 0x7f6e14066c70 2024-02-16T22:13:37.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.751+0000 7f6e0a7fc700 1 --2- 172.21.15.134:0/1870398725 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6e00069210 0x7f6e0006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:13:37.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.751+0000 7f6e0a7fc700 1 -- 172.21.15.134:0/1870398725 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f6e10086260 con 0x7f6e14066c70 2024-02-16T22:13:37.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.751+0000 7f6e19778700 1 --2- 172.21.15.134:0/1870398725 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6e00069210 0x7f6e0006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:13:37.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.751+0000 7f6e19778700 1 --2- 172.21.15.134:0/1870398725 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6e00069210 0x7f6e0006b6c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e04004890 tx=0x7f6e04009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:13:37.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.755+0000 7f6e0a7fc700 1 -- 172.21.15.134:0/1870398725 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6e10056cf0 con 0x7f6e14066c70 2024-02-16T22:13:37.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:37.950+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/1870398725 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e14100d60 con 0x7f6e00069210 2024-02-16T22:13:38.602 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:38 smithi134 ceph-mon[28869]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:38.602 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:38 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-16T22:13:38.602 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:38 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-16T22:13:38.602 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:38 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:38.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:38 smithi173 ceph-mon[37280]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:38.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:38 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-16T22:13:38.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:38 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-16T22:13:38.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:38 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:39.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:39 smithi134 ceph-mon[28869]: from='client.14284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:13:39.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:39 smithi134 ceph-mon[28869]: Detected new or changed devices on smithi134 2024-02-16T22:13:39.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:39.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:39.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:13:39.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:13:39.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:39.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:39.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:13:39.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:39.668 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:13:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:39 smithi173 ceph-mon[37280]: from='client.14284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:13:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:39 smithi173 ceph-mon[37280]: Detected new or changed devices on smithi134 2024-02-16T22:13:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:13:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:13:39.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:39.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:39.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:13:39.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:39.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:13:40.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:40 smithi134 ceph-mon[28869]: Adjusting osd_memory_target on smithi134 to 6432M 2024-02-16T22:13:40.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:40 smithi134 ceph-mon[28869]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:40.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:40 smithi173 ceph-mon[37280]: Adjusting osd_memory_target on smithi134 to 6432M 2024-02-16T22:13:40.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:40 smithi173 ceph-mon[37280]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:41.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:41 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2725325441' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "036c6cf2-7373-46ff-85db-9e0898ad0677"}]: dispatch 2024-02-16T22:13:41.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:41 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2725325441' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "036c6cf2-7373-46ff-85db-9e0898ad0677"}]': finished 2024-02-16T22:13:41.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:41 smithi134 ceph-mon[28869]: osdmap e16: 3 total, 2 up, 3 in 2024-02-16T22:13:41.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:41 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:13:41.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:41 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2725325441' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "036c6cf2-7373-46ff-85db-9e0898ad0677"}]: dispatch 2024-02-16T22:13:41.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:41 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2725325441' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "036c6cf2-7373-46ff-85db-9e0898ad0677"}]': finished 2024-02-16T22:13:41.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:41 smithi173 ceph-mon[37280]: osdmap e16: 3 total, 2 up, 3 in 2024-02-16T22:13:41.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:41 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:13:42.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:42 smithi134 ceph-mon[28869]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:42.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:42 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2756853986' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-16T22:13:42.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:42 smithi173 ceph-mon[37280]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:42.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:42 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2756853986' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-16T22:13:43.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:13:43.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:43 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:13:44.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:44 smithi134 ceph-mon[28869]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:44.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:44 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:44.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:44 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:44.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:44 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:44.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:44 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:13:44.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:44 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:44 smithi173 ceph-mon[37280]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:44 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:44 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:44 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:44 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:13:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:44 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:45.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:45 smithi134 ceph-mon[28869]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:45.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:45 smithi173 ceph-mon[37280]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:48.671 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:48 smithi134 ceph-mon[28869]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:48.671 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:48 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-16T22:13:48.671 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:48 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:48.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:48 smithi173 ceph-mon[37280]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:48.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:48 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-16T22:13:48.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:48 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:13:49.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:49 smithi134 ceph-mon[28869]: Deploying daemon osd.2 on smithi134 2024-02-16T22:13:49.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:49 smithi173 ceph-mon[37280]: Deploying daemon osd.2 on smithi134 2024-02-16T22:13:50.667 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:50 smithi134 ceph-mon[28869]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:50 smithi173 ceph-mon[37280]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:52.688 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:52 smithi134 ceph-mon[28869]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:52.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:52 smithi173 ceph-mon[37280]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:54 smithi134 ceph-mon[28869]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:13:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:54 smithi173 ceph-mon[37280]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:13:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:56.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:56 smithi134 ceph-mon[28869]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:56.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:56 smithi173 ceph-mon[37280]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:57.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:57.455+0000 7f6e0a7fc700 1 -- 172.21.15.134:0/1870398725 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6e14100d60 con 0x7f6e00069210 2024-02-16T22:13:57.457 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 2 on host 'smithi134' 2024-02-16T22:13:57.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:57.458+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/1870398725 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6e00069210 msgr2=0x7f6e0006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:13:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:57.458+0000 7f6e1c1dd700 1 --2- 172.21.15.134:0/1870398725 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6e00069210 0x7f6e0006b6c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e04004890 tx=0x7f6e04009e30 comp rx=0 tx=0).stop 2024-02-16T22:13:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:57.458+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/1870398725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e14066c70 msgr2=0x7f6e140fd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:13:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:57.458+0000 7f6e1c1dd700 1 --2- 172.21.15.134:0/1870398725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e14066c70 0x7f6e140fd570 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000b790 tx=0x7f6e10009250 comp rx=0 tx=0).stop 2024-02-16T22:13:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:57.458+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/1870398725 shutdown_connections 2024-02-16T22:13:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:57.458+0000 7f6e1c1dd700 1 --2- 172.21.15.134:0/1870398725 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6e00069210 0x7f6e0006b6c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:57.458+0000 7f6e1c1dd700 1 --2- 172.21.15.134:0/1870398725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e14066c70 0x7f6e140fd570 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:57.458+0000 7f6e1c1dd700 1 --2- 172.21.15.134:0/1870398725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e141000c0 0x7f6e140fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:13:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:57.458+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/1870398725 >> 172.21.15.134:0/1870398725 conn(0x7f6e140f7520 msgr2=0x7f6e140f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:13:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:57.458+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/1870398725 shutdown_connections 2024-02-16T22:13:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:13:57.458+0000 7f6e1c1dd700 1 -- 172.21.15.134:0/1870398725 wait complete. 2024-02-16T22:13:58.342 DEBUG:teuthology.orchestra.run.smithi134:osd.2> sudo journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.2.service 2024-02-16T22:13:58.345 INFO:tasks.cephadm:Deploying osd.3 on smithi173 with /dev/vg_nvme/lv_4... 2024-02-16T22:13:58.345 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-16T22:13:58.602 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi173/config 2024-02-16T22:13:58.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:58 smithi134 ceph-mon[28869]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:58.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:58 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:58.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:58 smithi134 ceph-mon[28869]: from='osd.2 [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-16T22:13:58.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:58 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:58.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:58 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:13:58.721 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:58 smithi173 ceph-mon[37280]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:13:58.721 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:58 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:58.721 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:58 smithi173 ceph-mon[37280]: from='osd.2 [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-16T22:13:58.721 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:58 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:13:58.721 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:58 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:13:59.724 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:59 smithi173 ceph-mon[37280]: from='osd.2 [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-16T22:13:59.724 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:59 smithi173 ceph-mon[37280]: osdmap e17: 3 total, 2 up, 3 in 2024-02-16T22:13:59.724 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:59 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:13:59.725 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:13:59 smithi173 ceph-mon[37280]: from='osd.2 [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-02-16T22:13:59.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:59 smithi134 ceph-mon[28869]: from='osd.2 [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-16T22:13:59.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:59 smithi134 ceph-mon[28869]: osdmap e17: 3 total, 2 up, 3 in 2024-02-16T22:13:59.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:59 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:13:59.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:13:59 smithi134 ceph-mon[28869]: from='osd.2 [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-02-16T22:13:59.727 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:13:59 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2[63186]: 2024-02-16T22:13:59.413+0000 7fb8271d1700 -1 osd.2 0 waiting for initial osdmap 2024-02-16T22:13:59.727 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:13:59 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2[63186]: 2024-02-16T22:13:59.418+0000 7fb820fca700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T22:14:00.414 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-16T22:14:00.414 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-16T22:14:00.414 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2024-02-16T22:14:00.414 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2024-02-16T22:14:00.414 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0122389 s, 857 MB/s 2024-02-16T22:14:00.414 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2024-02-16T22:14:00.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:00 smithi134 ceph-mon[28869]: purged_snaps scrub starts 2024-02-16T22:14:00.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:00 smithi134 ceph-mon[28869]: purged_snaps scrub ok 2024-02-16T22:14:00.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:00 smithi134 ceph-mon[28869]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:14:00.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:00 smithi134 ceph-mon[28869]: from='osd.2 [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-02-16T22:14:00.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:00 smithi134 ceph-mon[28869]: osdmap e18: 3 total, 2 up, 3 in 2024-02-16T22:14:00.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:00 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:14:00.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:00 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:14:00.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:00 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:14:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:00 smithi173 ceph-mon[37280]: purged_snaps scrub starts 2024-02-16T22:14:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:00 smithi173 ceph-mon[37280]: purged_snaps scrub ok 2024-02-16T22:14:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:00 smithi173 ceph-mon[37280]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:14:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:00 smithi173 ceph-mon[37280]: from='osd.2 [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-02-16T22:14:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:00 smithi173 ceph-mon[37280]: osdmap e18: 3 total, 2 up, 3 in 2024-02-16T22:14:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:00 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:14:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:00 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:14:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:00 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:14:01.033 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi173:vg_nvme/lv_4 2024-02-16T22:14:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi173/config 2024-02-16T22:14:01.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:01 smithi134 ceph-mon[28869]: osd.2 [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515] boot 2024-02-16T22:14:01.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:01 smithi134 ceph-mon[28869]: osdmap e19: 3 total, 3 up, 3 in 2024-02-16T22:14:01.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:01 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:14:01.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:01 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:01.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:01 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:01.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:01 smithi134 ceph-mon[28869]: pgmap v76: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:14:01.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:01 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-16T22:14:01.661 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:01 smithi173 ceph-mon[37280]: osd.2 [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515] boot 2024-02-16T22:14:01.661 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:01 smithi173 ceph-mon[37280]: osdmap e19: 3 total, 3 up, 3 in 2024-02-16T22:14:01.661 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:01 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:14:01.661 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:01 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:01.661 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:01 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:01.661 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:01 smithi173 ceph-mon[37280]: pgmap v76: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-16T22:14:01.661 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:01 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-16T22:14:02.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:02 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-16T22:14:02.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:02 smithi134 ceph-mon[28869]: osdmap e20: 3 total, 3 up, 3 in 2024-02-16T22:14:02.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:02 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-16T22:14:02.710 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:02 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-16T22:14:02.710 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:02 smithi173 ceph-mon[37280]: osdmap e20: 3 total, 3 up, 3 in 2024-02-16T22:14:02.710 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:02 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-16T22:14:02.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.807+0000 7f43cd7c8700 1 -- 172.21.15.173:0/4012135378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43c80fcef0 msgr2=0x7f43c80fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:14:02.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.807+0000 7f43cd7c8700 1 --2- 172.21.15.173:0/4012135378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43c80fcef0 0x7f43c80fd320 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009d10 tx=0x7f43c0004d10 comp rx=0 tx=0).stop 2024-02-16T22:14:02.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.807+0000 7f43cd7c8700 1 -- 172.21.15.173:0/4012135378 shutdown_connections 2024-02-16T22:14:02.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.807+0000 7f43cd7c8700 1 --2- 172.21.15.173:0/4012135378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c80fe0e0 0x7f43c80fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:02.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.807+0000 7f43cd7c8700 1 --2- 172.21.15.173:0/4012135378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43c80fcef0 0x7f43c80fd320 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.807+0000 7f43cd7c8700 1 -- 172.21.15.173:0/4012135378 >> 172.21.15.173:0/4012135378 conn(0x7f43c80f8620 msgr2=0x7f43c80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:14:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.807+0000 7f43cd7c8700 1 -- 172.21.15.173:0/4012135378 shutdown_connections 2024-02-16T22:14:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.807+0000 7f43cd7c8700 1 -- 172.21.15.173:0/4012135378 wait complete. 2024-02-16T22:14:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.808+0000 7f43cd7c8700 1 Processor -- start 2024-02-16T22:14:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.808+0000 7f43cd7c8700 1 -- start start 2024-02-16T22:14:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.808+0000 7f43cd7c8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c80fcef0 0x7f43c8071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:14:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.808+0000 7f43cd7c8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43c80fe0e0 0x7f43c80702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:14:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.808+0000 7f43cd7c8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c80708e0 con 0x7f43c80fcef0 2024-02-16T22:14:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.808+0000 7f43cd7c8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8070a50 con 0x7f43c80fe0e0 2024-02-16T22:14:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.808+0000 7f43c67fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43c80fe0e0 0x7f43c80702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:14:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.808+0000 7f43c67fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43c80fe0e0 0x7f43c80702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54174/0 (socket says 172.21.15.173:54174) 2024-02-16T22:14:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.808+0000 7f43c67fc700 1 -- 172.21.15.173:0/3114172330 learned_addr learned my addr 172.21.15.173:0/3114172330 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:14:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.808+0000 7f43c6ffd700 1 --2- 172.21.15.173:0/3114172330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c80fcef0 0x7f43c8071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:14:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.808+0000 7f43c67fc700 1 -- 172.21.15.173:0/3114172330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c80fcef0 msgr2=0x7f43c8071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.808+0000 7f43c67fc700 1 --2- 172.21.15.173:0/3114172330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c80fcef0 0x7f43c8071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.808+0000 7f43c67fc700 1 -- 172.21.15.173:0/3114172330 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0009940 con 0x7f43c80fe0e0 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.809+0000 7f43c67fc700 1 --2- 172.21.15.173:0/3114172330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43c80fe0e0 0x7f43c80702e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f43b000eb40 tx=0x7f43b000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.809+0000 7f43bf7fe700 1 -- 172.21.15.173:0/3114172330 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43b0007cc0 con 0x7f43c80fe0e0 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.809+0000 7f43bf7fe700 1 -- 172.21.15.173:0/3114172330 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f43b000f040 con 0x7f43c80fe0e0 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.809+0000 7f43cd7c8700 1 -- 172.21.15.173:0/3114172330 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c8070cd0 con 0x7f43c80fe0e0 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.809+0000 7f43bf7fe700 1 -- 172.21.15.173:0/3114172330 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43b000ca10 con 0x7f43c80fe0e0 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.809+0000 7f43cd7c8700 1 -- 172.21.15.173:0/3114172330 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c81159a0 con 0x7f43c80fe0e0 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.810+0000 7f43cd7c8700 1 -- 172.21.15.173:0/3114172330 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c804bed0 con 0x7f43c80fe0e0 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.810+0000 7f43bf7fe700 1 -- 172.21.15.173:0/3114172330 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f43b000cb70 con 0x7f43c80fe0e0 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.811+0000 7f43bf7fe700 1 --2- 172.21.15.173:0/3114172330 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f43b4069210 0x7f43b406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.811+0000 7f43bf7fe700 1 -- 172.21.15.173:0/3114172330 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3228+0+0 (secure 0 0 0) 0x7f43b00862d0 con 0x7f43c80fe0e0 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.811+0000 7f43c6ffd700 1 --2- 172.21.15.173:0/3114172330 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f43b4069210 0x7f43b406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.811+0000 7f43c6ffd700 1 --2- 172.21.15.173:0/3114172330 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f43b4069210 0x7f43b406b6c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f43c00094a0 tx=0x7f43c0004d10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:14:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:02.815+0000 7f43bf7fe700 1 -- 172.21.15.173:0/3114172330 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f43b004dbd0 con 0x7f43c80fe0e0 2024-02-16T22:14:03.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:03.003+0000 7f43cd7c8700 1 -- 172.21.15.173:0/3114172330 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f43c8102ac0 con 0x7f43b4069210 2024-02-16T22:14:03.599 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:14:03 smithi134 sudo[66683]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-16T22:14:03.599 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:14:03 smithi134 sudo[66683]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-16T22:14:03.599 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:14:03 smithi134 sudo[66683]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-16T22:14:03.599 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:14:03 smithi134 sudo[66683]: pam_unix(sudo:session): session closed for user root 2024-02-16T22:14:03.599 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-16T22:14:03.599 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:03 smithi134 ceph-mon[28869]: osdmap e21: 3 total, 3 up, 3 in 2024-02-16T22:14:03.599 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:03 smithi134 ceph-mon[28869]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-16T22:14:03.599 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:03 smithi134 ceph-mon[28869]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:14:03.599 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-16T22:14:03.599 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-16T22:14:03.600 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:03 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:03 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-16T22:14:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:03 smithi173 ceph-mon[37280]: osdmap e21: 3 total, 3 up, 3 in 2024-02-16T22:14:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:03 smithi173 ceph-mon[37280]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-16T22:14:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:03 smithi173 ceph-mon[37280]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:14:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:03 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-16T22:14:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:03 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-16T22:14:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:03 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:03.871 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:14:03 smithi134 sudo[67553]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-16T22:14:03.871 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:14:03 smithi134 sudo[67553]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-16T22:14:03.872 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:14:03 smithi134 sudo[67553]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-16T22:14:03.872 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:14:03 smithi134 sudo[67553]: pam_unix(sudo:session): session closed for user root 2024-02-16T22:14:04.136 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:14:03 smithi134 sudo[67559]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-16T22:14:04.136 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:14:03 smithi134 sudo[67559]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-16T22:14:04.136 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:14:03 smithi134 sudo[67559]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-16T22:14:04.136 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:14:03 smithi134 sudo[67559]: pam_unix(sudo:session): session closed for user root 2024-02-16T22:14:04.392 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67562]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-16T22:14:04.392 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67562]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-16T22:14:04.393 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67562]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-16T22:14:04.393 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67562]: pam_unix(sudo:session): session closed for user root 2024-02-16T22:14:04.506 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:04 smithi173 ceph-mon[37280]: osdmap e22: 3 total, 3 up, 3 in 2024-02-16T22:14:04.506 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:04 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:04.506 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:04 smithi173 ceph-mon[37280]: Detected new or changed devices on smithi134 2024-02-16T22:14:04.506 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:04 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:04.506 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:04 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:04.506 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:04 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:14:04.506 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:04 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:14:04.506 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:04 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:14:04.506 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:04 smithi173 ceph-mon[37280]: Adjusting osd_memory_target on smithi134 to 4288M 2024-02-16T22:14:04.506 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:04 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:04.506 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:04 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:04.507 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:04 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:14:04.507 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:04 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:04.507 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:04 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:14:04.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:04.627+0000 7f43bf7fe700 1 -- 172.21.15.173:0/3114172330 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f43b0053420 con 0x7f43c80fe0e0 2024-02-16T22:14:04.652 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67597]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-16T22:14:04.652 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67597]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-16T22:14:04.653 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67597]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-16T22:14:04.653 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67597]: pam_unix(sudo:session): session closed for user root 2024-02-16T22:14:04.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 ceph-mon[28869]: osdmap e22: 3 total, 3 up, 3 in 2024-02-16T22:14:04.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:04.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 ceph-mon[28869]: Detected new or changed devices on smithi134 2024-02-16T22:14:04.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:04.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:04.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:14:04.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:14:04.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:14:04.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 ceph-mon[28869]: Adjusting osd_memory_target on smithi134 to 4288M 2024-02-16T22:14:04.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:04.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:04.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:14:04.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:04.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:14:04.911 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67600]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-16T22:14:04.911 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67600]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-16T22:14:04.911 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67600]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-16T22:14:04.911 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67600]: pam_unix(sudo:session): session closed for user root 2024-02-16T22:14:04.911 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67603]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-16T22:14:04.911 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67603]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-16T22:14:04.911 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67603]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-16T22:14:04.912 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:04 smithi134 sudo[67603]: pam_unix(sudo:session): session closed for user root 2024-02-16T22:14:05.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:05 smithi134 sudo[67606]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-16T22:14:05.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:05 smithi134 sudo[67606]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-16T22:14:05.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:05 smithi134 sudo[67606]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-16T22:14:05.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:05 smithi134 sudo[67606]: pam_unix(sudo:session): session closed for user root 2024-02-16T22:14:05.654 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 sudo[40649]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-16T22:14:05.655 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 sudo[40649]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-16T22:14:05.655 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 sudo[40649]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-16T22:14:05.655 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 sudo[40649]: pam_unix(sudo:session): session closed for user root 2024-02-16T22:14:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:05 smithi134 ceph-mon[28869]: mgrmap e19: smithi134.ordace(active, since 2m), standbys: smithi173.kbofaa 2024-02-16T22:14:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:05 smithi134 ceph-mon[28869]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-16T22:14:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:05 smithi134 ceph-mon[28869]: pgmap v81: 1 pgs: 1 active+clean; 449 KiB data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-16T22:14:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:05 smithi134 ceph-mon[28869]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-16T22:14:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:05 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:14:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:05 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:14:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:05 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:05 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:14:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:05 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:14:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:05 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:14:05.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 sudo[40652]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-16T22:14:05.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 sudo[40652]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-16T22:14:05.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 sudo[40652]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-16T22:14:05.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 sudo[40652]: pam_unix(sudo:session): session closed for user root 2024-02-16T22:14:05.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 ceph-mon[37280]: mgrmap e19: smithi134.ordace(active, since 2m), standbys: smithi173.kbofaa 2024-02-16T22:14:05.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 ceph-mon[37280]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-16T22:14:05.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 ceph-mon[37280]: pgmap v81: 1 pgs: 1 active+clean; 449 KiB data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-16T22:14:05.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 ceph-mon[37280]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-16T22:14:05.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:14:05.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:14:05.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:05.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:14:05.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:14:05.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:05 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:14:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:06 smithi134 ceph-mon[28869]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-16T22:14:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:06 smithi134 ceph-mon[28869]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-16T22:14:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:06 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/2786234370' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a00fd47-f787-4e21-9619-9e9341420b4b"}]: dispatch 2024-02-16T22:14:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:06 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:06 smithi134 ceph-mon[28869]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a00fd47-f787-4e21-9619-9e9341420b4b"}]: dispatch 2024-02-16T22:14:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:06 smithi134 ceph-mon[28869]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a00fd47-f787-4e21-9619-9e9341420b4b"}]': finished 2024-02-16T22:14:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:06 smithi134 ceph-mon[28869]: osdmap e23: 4 total, 3 up, 4 in 2024-02-16T22:14:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:06 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:14:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:06 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:06 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/2315947965' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-16T22:14:06.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:06 smithi173 ceph-mon[37280]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-16T22:14:06.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:06 smithi173 ceph-mon[37280]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-16T22:14:06.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:06 smithi173 ceph-mon[37280]: from='client.? 172.21.15.173:0/2786234370' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a00fd47-f787-4e21-9619-9e9341420b4b"}]: dispatch 2024-02-16T22:14:06.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:06 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:06.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:06 smithi173 ceph-mon[37280]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a00fd47-f787-4e21-9619-9e9341420b4b"}]: dispatch 2024-02-16T22:14:06.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:06 smithi173 ceph-mon[37280]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a00fd47-f787-4e21-9619-9e9341420b4b"}]': finished 2024-02-16T22:14:06.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:06 smithi173 ceph-mon[37280]: osdmap e23: 4 total, 3 up, 4 in 2024-02-16T22:14:06.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:06 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:14:06.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:06 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:06.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:06 smithi173 ceph-mon[37280]: from='client.? 172.21.15.173:0/2315947965' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-16T22:14:07.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:07 smithi134 ceph-mon[28869]: pgmap v83: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-02-16T22:14:07.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:07 smithi173 ceph-mon[37280]: pgmap v83: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-02-16T22:14:10.190 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:09 smithi173 ceph-mon[37280]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 5.0 KiB/s rd, 240 KiB/s wr, 16 op/s 2024-02-16T22:14:10.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:09 smithi134 ceph-mon[28869]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 5.0 KiB/s rd, 240 KiB/s wr, 16 op/s 2024-02-16T22:14:12.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:12 smithi134 ceph-mon[28869]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.6 KiB/s rd, 176 KiB/s wr, 12 op/s 2024-02-16T22:14:12.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:12 smithi173 ceph-mon[37280]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.6 KiB/s rd, 176 KiB/s wr, 12 op/s 2024-02-16T22:14:13.656 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:13 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:14:13.656 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:13 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-16T22:14:13.656 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:13 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:13 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:14:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:13 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-16T22:14:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:13 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:14.555 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:14 smithi173 ceph-mon[37280]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.9 KiB/s rd, 138 KiB/s wr, 9 op/s 2024-02-16T22:14:14.556 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:14 smithi173 ceph-mon[37280]: Deploying daemon osd.3 on smithi173 2024-02-16T22:14:14.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:14 smithi134 ceph-mon[28869]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.9 KiB/s rd, 138 KiB/s wr, 9 op/s 2024-02-16T22:14:14.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:14 smithi134 ceph-mon[28869]: Deploying daemon osd.3 on smithi173 2024-02-16T22:14:15.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:15 smithi134 ceph-mon[28869]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-02-16T22:14:15.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:15 smithi173 ceph-mon[37280]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-02-16T22:14:18.567 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:18 smithi173 ceph-mon[37280]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.4 KiB/s rd, 116 KiB/s wr, 8 op/s 2024-02-16T22:14:18.567 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:18 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:18.567 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:18 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:18.567 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:18 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:14:18.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:18 smithi134 ceph-mon[28869]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.4 KiB/s rd, 116 KiB/s wr, 8 op/s 2024-02-16T22:14:18.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:18 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:18.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:18 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:18.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:18 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:14:20.664 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:20 smithi173 ceph-mon[37280]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-02-16T22:14:20.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:20 smithi134 ceph-mon[28869]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-02-16T22:14:21.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:21.520+0000 7f43bf7fe700 1 -- 172.21.15.173:0/3114172330 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f43c8102ac0 con 0x7f43b4069210 2024-02-16T22:14:21.523 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 3 on host 'smithi173' 2024-02-16T22:14:21.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:21.523+0000 7f43cd7c8700 1 -- 172.21.15.173:0/3114172330 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f43b4069210 msgr2=0x7f43b406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:14:21.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:21.523+0000 7f43cd7c8700 1 --2- 172.21.15.173:0/3114172330 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f43b4069210 0x7f43b406b6c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f43c00094a0 tx=0x7f43c0004d10 comp rx=0 tx=0).stop 2024-02-16T22:14:21.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:21.523+0000 7f43cd7c8700 1 -- 172.21.15.173:0/3114172330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43c80fe0e0 msgr2=0x7f43c80702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:14:21.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:21.523+0000 7f43cd7c8700 1 --2- 172.21.15.173:0/3114172330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43c80fe0e0 0x7f43c80702e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f43b000eb40 tx=0x7f43b000b040 comp rx=0 tx=0).stop 2024-02-16T22:14:21.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:21.523+0000 7f43cd7c8700 1 -- 172.21.15.173:0/3114172330 shutdown_connections 2024-02-16T22:14:21.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:21.523+0000 7f43cd7c8700 1 --2- 172.21.15.173:0/3114172330 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f43b4069210 0x7f43b406b6c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:21.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:21.523+0000 7f43cd7c8700 1 --2- 172.21.15.173:0/3114172330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c80fcef0 0x7f43c8071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:21.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:21.523+0000 7f43cd7c8700 1 --2- 172.21.15.173:0/3114172330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43c80fe0e0 0x7f43c80702e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:21.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:21.523+0000 7f43cd7c8700 1 -- 172.21.15.173:0/3114172330 >> 172.21.15.173:0/3114172330 conn(0x7f43c80f8620 msgr2=0x7f43c81013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:14:21.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:21.524+0000 7f43cd7c8700 1 -- 172.21.15.173:0/3114172330 shutdown_connections 2024-02-16T22:14:21.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:21.524+0000 7f43cd7c8700 1 -- 172.21.15.173:0/3114172330 wait complete. 2024-02-16T22:14:22.448 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:22 smithi173 ceph-mon[37280]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-16T22:14:22.448 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:22.448 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:22.448 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:22 smithi173 ceph-mon[37280]: from='osd.3 [v2:172.21.15.173:6800/1747350493,v1:172.21.15.173:6801/1747350493]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-16T22:14:22.448 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:22 smithi173 ceph-mon[37280]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-16T22:14:22.478 DEBUG:teuthology.orchestra.run.smithi173:osd.3> sudo journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.3.service 2024-02-16T22:14:22.480 INFO:tasks.cephadm:Deploying osd.4 on smithi173 with /dev/vg_nvme/lv_3... 2024-02-16T22:14:22.480 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-16T22:14:22.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:22 smithi134 ceph-mon[28869]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-16T22:14:22.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:22.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:22.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:22 smithi134 ceph-mon[28869]: from='osd.3 [v2:172.21.15.173:6800/1747350493,v1:172.21.15.173:6801/1747350493]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-16T22:14:22.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:22 smithi134 ceph-mon[28869]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-16T22:14:22.775 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi173/config 2024-02-16T22:14:23.838 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:23 smithi173 ceph-mon[37280]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-16T22:14:23.838 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:23 smithi173 ceph-mon[37280]: osdmap e24: 4 total, 3 up, 4 in 2024-02-16T22:14:23.838 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:23 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:14:23.838 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:23 smithi173 ceph-mon[37280]: from='osd.3 [v2:172.21.15.173:6800/1747350493,v1:172.21.15.173:6801/1747350493]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:14:23.838 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:23 smithi173 ceph-mon[37280]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:14:23.838 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:23 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:23.838 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:23 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:23.838 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:23 smithi173 ceph-mon[37280]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-16T22:14:23.838 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:14:23 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3[42728]: 2024-02-16T22:14:23.527+0000 7ff1f0e19700 -1 osd.3 0 waiting for initial osdmap 2024-02-16T22:14:23.838 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:14:23 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3[42728]: 2024-02-16T22:14:23.533+0000 7ff1ea411700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T22:14:23.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:23 smithi134 ceph-mon[28869]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-16T22:14:23.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:23 smithi134 ceph-mon[28869]: osdmap e24: 4 total, 3 up, 4 in 2024-02-16T22:14:23.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:23 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:14:23.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:23 smithi134 ceph-mon[28869]: from='osd.3 [v2:172.21.15.173:6800/1747350493,v1:172.21.15.173:6801/1747350493]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:14:23.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:23 smithi134 ceph-mon[28869]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:14:23.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:23 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:23.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:23 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:23.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:23 smithi134 ceph-mon[28869]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-16T22:14:24.919 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:24 smithi173 ceph-mon[37280]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-02-16T22:14:24.919 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:24 smithi173 ceph-mon[37280]: osdmap e25: 4 total, 3 up, 4 in 2024-02-16T22:14:24.919 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:24 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:14:24.919 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:24 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:14:24.919 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:24 smithi173 ceph-mon[37280]: osd.3 [v2:172.21.15.173:6800/1747350493,v1:172.21.15.173:6801/1747350493] boot 2024-02-16T22:14:24.919 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:24 smithi173 ceph-mon[37280]: osdmap e26: 4 total, 4 up, 4 in 2024-02-16T22:14:24.919 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:24 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:14:24.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:24 smithi134 ceph-mon[28869]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-02-16T22:14:24.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:24 smithi134 ceph-mon[28869]: osdmap e25: 4 total, 3 up, 4 in 2024-02-16T22:14:24.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:24 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:14:24.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:24 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:14:24.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:24 smithi134 ceph-mon[28869]: osd.3 [v2:172.21.15.173:6800/1747350493,v1:172.21.15.173:6801/1747350493] boot 2024-02-16T22:14:24.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:24 smithi134 ceph-mon[28869]: osdmap e26: 4 total, 4 up, 4 in 2024-02-16T22:14:24.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:24 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:14:25.728 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-16T22:14:25.728 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-16T22:14:25.729 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2024-02-16T22:14:25.729 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2024-02-16T22:14:25.729 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0142929 s, 734 MB/s 2024-02-16T22:14:25.729 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2024-02-16T22:14:25.753 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:25 smithi173 ceph-mon[37280]: purged_snaps scrub starts 2024-02-16T22:14:25.753 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:25 smithi173 ceph-mon[37280]: purged_snaps scrub ok 2024-02-16T22:14:25.753 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:25 smithi173 ceph-mon[37280]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:25.753 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:25 smithi173 ceph-mon[37280]: osdmap e27: 4 total, 4 up, 4 in 2024-02-16T22:14:25.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:25 smithi134 ceph-mon[28869]: purged_snaps scrub starts 2024-02-16T22:14:25.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:25 smithi134 ceph-mon[28869]: purged_snaps scrub ok 2024-02-16T22:14:25.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:25 smithi134 ceph-mon[28869]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:25.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:25 smithi134 ceph-mon[28869]: osdmap e27: 4 total, 4 up, 4 in 2024-02-16T22:14:26.780 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi173:vg_nvme/lv_3 2024-02-16T22:14:27.216 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi173/config 2024-02-16T22:14:27.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: osdmap e28: 4 total, 4 up, 4 in 2024-02-16T22:14:27.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:27.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: Detected new or changed devices on smithi173 2024-02-16T22:14:27.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:27.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:27.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:14:27.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: Adjusting osd_memory_target on smithi173 to 15936M 2024-02-16T22:14:27.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:27.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:27.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:14:27.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:27.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:14:27.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:27.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:14:27.979 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:27 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:27.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: osdmap e28: 4 total, 4 up, 4 in 2024-02-16T22:14:27.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:27.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: Detected new or changed devices on smithi173 2024-02-16T22:14:27.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:27.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:27.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:14:27.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: Adjusting osd_memory_target on smithi173 to 15936M 2024-02-16T22:14:27.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:27.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:27.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:14:27.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:27.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:14:27.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:27.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:14:27.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:27 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:28.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.634+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/1876783124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8b40fe0e0 msgr2=0x7fb8b40fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:14:28.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.634+0000 7fb8b9eeb700 1 --2- 172.21.15.173:0/1876783124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8b40fe0e0 0x7fb8b40fe550 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8004970 tx=0x7fb8a8009e30 comp rx=0 tx=0).stop 2024-02-16T22:14:28.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.634+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/1876783124 shutdown_connections 2024-02-16T22:14:28.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.634+0000 7fb8b9eeb700 1 --2- 172.21.15.173:0/1876783124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8b40fe0e0 0x7fb8b40fe550 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:28.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.634+0000 7fb8b9eeb700 1 --2- 172.21.15.173:0/1876783124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8b40fcef0 0x7fb8b40fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:28.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.634+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/1876783124 >> 172.21.15.173:0/1876783124 conn(0x7fb8b40f8620 msgr2=0x7fb8b40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:14:28.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.634+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/1876783124 shutdown_connections 2024-02-16T22:14:28.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.634+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/1876783124 wait complete. 2024-02-16T22:14:28.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.635+0000 7fb8b9eeb700 1 Processor -- start 2024-02-16T22:14:28.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.635+0000 7fb8b9eeb700 1 -- start start 2024-02-16T22:14:28.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.635+0000 7fb8b9eeb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8b40fcef0 0x7fb8b410d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:14:28.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.635+0000 7fb8b9eeb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8b40fe0e0 0x7fb8b410de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:14:28.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.635+0000 7fb8b9eeb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b410e430 con 0x7fb8b40fcef0 2024-02-16T22:14:28.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.635+0000 7fb8b9eeb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b410ecd0 con 0x7fb8b40fe0e0 2024-02-16T22:14:28.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.636+0000 7fb8b2ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8b40fe0e0 0x7fb8b410de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:14:28.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.636+0000 7fb8b2ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8b40fe0e0 0x7fb8b410de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57298/0 (socket says 172.21.15.173:57298) 2024-02-16T22:14:28.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.636+0000 7fb8b2ffd700 1 -- 172.21.15.173:0/3316075052 learned_addr learned my addr 172.21.15.173:0/3316075052 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:14:28.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.636+0000 7fb8b37fe700 1 --2- 172.21.15.173:0/3316075052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8b40fcef0 0x7fb8b410d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:14:28.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.636+0000 7fb8b2ffd700 1 -- 172.21.15.173:0/3316075052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8b40fcef0 msgr2=0x7fb8b410d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:14:28.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.636+0000 7fb8b2ffd700 1 --2- 172.21.15.173:0/3316075052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8b40fcef0 0x7fb8b410d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:28.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.636+0000 7fb8b2ffd700 1 -- 172.21.15.173:0/3316075052 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a8005040 con 0x7fb8b40fe0e0 2024-02-16T22:14:28.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.636+0000 7fb8b2ffd700 1 --2- 172.21.15.173:0/3316075052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8b40fe0e0 0x7fb8b410de30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800b370 tx=0x7fb8a8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:14:28.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.636+0000 7fb89bfff700 1 -- 172.21.15.173:0/3316075052 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8a800e040 con 0x7fb8b40fe0e0 2024-02-16T22:14:28.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.636+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/3316075052 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b410ef50 con 0x7fb8b40fe0e0 2024-02-16T22:14:28.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.636+0000 7fb89bfff700 1 -- 172.21.15.173:0/3316075052 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8a8004290 con 0x7fb8b40fe0e0 2024-02-16T22:14:28.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.636+0000 7fb89bfff700 1 -- 172.21.15.173:0/3316075052 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8a801c630 con 0x7fb8b40fe0e0 2024-02-16T22:14:28.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.636+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/3316075052 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b410f490 con 0x7fb8b40fe0e0 2024-02-16T22:14:28.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.637+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/3316075052 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b404bed0 con 0x7fb8b40fe0e0 2024-02-16T22:14:28.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.638+0000 7fb89bfff700 1 -- 172.21.15.173:0/3316075052 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb8a8013420 con 0x7fb8b40fe0e0 2024-02-16T22:14:28.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.638+0000 7fb89bfff700 1 --2- 172.21.15.173:0/3316075052 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb89c0692a0 0x7fb89c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:14:28.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.638+0000 7fb89bfff700 1 -- 172.21.15.173:0/3316075052 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3770+0+0 (secure 0 0 0) 0x7fb8a8087ed0 con 0x7fb8b40fe0e0 2024-02-16T22:14:28.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.638+0000 7fb8b37fe700 1 --2- 172.21.15.173:0/3316075052 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb89c0692a0 0x7fb89c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:14:28.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.639+0000 7fb8b37fe700 1 --2- 172.21.15.173:0/3316075052 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb89c0692a0 0x7fb89c06b750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40fcc30 tx=0x7fb8a400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:14:28.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.642+0000 7fb89bfff700 1 -- 172.21.15.173:0/3316075052 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb8a8058330 con 0x7fb8b40fe0e0 2024-02-16T22:14:28.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:28 smithi173 ceph-mon[37280]: osdmap e29: 4 total, 4 up, 4 in 2024-02-16T22:14:28.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:28 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:14:28.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:28.833+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/3316075052 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8b410f8e0 con 0x7fb89c0692a0 2024-02-16T22:14:28.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:28 smithi134 ceph-mon[28869]: osdmap e29: 4 total, 4 up, 4 in 2024-02-16T22:14:28.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:28 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:14:29.915 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:29 smithi173 ceph-mon[37280]: osdmap e30: 4 total, 4 up, 4 in 2024-02-16T22:14:29.915 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:29 smithi173 ceph-mon[37280]: from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:14:29.915 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:29 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-16T22:14:29.915 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:29 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-16T22:14:29.915 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:29 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:29.915 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:29 smithi173 ceph-mon[37280]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-16T22:14:29.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:29 smithi134 ceph-mon[28869]: osdmap e30: 4 total, 4 up, 4 in 2024-02-16T22:14:29.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:29 smithi134 ceph-mon[28869]: from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:14:29.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:29 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-16T22:14:29.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:29 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-16T22:14:29.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:29 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:29.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:29 smithi134 ceph-mon[28869]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-16T22:14:32.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:31 smithi134 ceph-mon[28869]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-02-16T22:14:32.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:31 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/2264600297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a314e0e-0951-4462-bb9a-f3614ded4c18"}]: dispatch 2024-02-16T22:14:32.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:31 smithi134 ceph-mon[28869]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a314e0e-0951-4462-bb9a-f3614ded4c18"}]: dispatch 2024-02-16T22:14:32.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:31 smithi134 ceph-mon[28869]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a314e0e-0951-4462-bb9a-f3614ded4c18"}]': finished 2024-02-16T22:14:32.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:31 smithi134 ceph-mon[28869]: osdmap e31: 5 total, 4 up, 5 in 2024-02-16T22:14:32.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:31 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:14:32.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:31 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/3368331993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-16T22:14:32.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:31 smithi173 ceph-mon[37280]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-02-16T22:14:32.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:31 smithi173 ceph-mon[37280]: from='client.? 172.21.15.173:0/2264600297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a314e0e-0951-4462-bb9a-f3614ded4c18"}]: dispatch 2024-02-16T22:14:32.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:31 smithi173 ceph-mon[37280]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a314e0e-0951-4462-bb9a-f3614ded4c18"}]: dispatch 2024-02-16T22:14:32.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:31 smithi173 ceph-mon[37280]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a314e0e-0951-4462-bb9a-f3614ded4c18"}]': finished 2024-02-16T22:14:32.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:31 smithi173 ceph-mon[37280]: osdmap e31: 5 total, 4 up, 5 in 2024-02-16T22:14:32.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:31 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:14:32.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:31 smithi173 ceph-mon[37280]: from='client.? 172.21.15.173:0/3368331993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-16T22:14:34.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:33 smithi134 ceph-mon[28869]: pgmap v104: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-16T22:14:34.230 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:33 smithi173 ceph-mon[37280]: pgmap v104: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-16T22:14:36.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:35 smithi173 ceph-mon[37280]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-02-16T22:14:36.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:35 smithi134 ceph-mon[28869]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-02-16T22:14:38.543 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:38 smithi173 ceph-mon[37280]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:38.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:38 smithi134 ceph-mon[28869]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:39.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-16T22:14:39.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-16T22:14:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:40.599 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:40 smithi173 ceph-mon[37280]: Deploying daemon osd.4 on smithi173 2024-02-16T22:14:40.599 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:40 smithi173 ceph-mon[37280]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:40.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:40 smithi134 ceph-mon[28869]: Deploying daemon osd.4 on smithi173 2024-02-16T22:14:40.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:40 smithi134 ceph-mon[28869]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:42.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:42 smithi134 ceph-mon[28869]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:42.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:42 smithi173 ceph-mon[37280]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:43.692 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:43 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:14:43.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:14:44.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:44 smithi134 ceph-mon[28869]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:44.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:44 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:44.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:44 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:44.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:44 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:14:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:44 smithi173 ceph-mon[37280]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:44 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:44 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:44 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:14:45.703 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:45 smithi173 ceph-mon[37280]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:45.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:45 smithi134 ceph-mon[28869]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:46.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:46.846+0000 7fb89bfff700 1 -- 172.21.15.173:0/3316075052 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb8b410f8e0 con 0x7fb89c0692a0 2024-02-16T22:14:46.849 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 4 on host 'smithi173' 2024-02-16T22:14:46.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:46.848+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/3316075052 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb89c0692a0 msgr2=0x7fb89c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:14:46.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:46.848+0000 7fb8b9eeb700 1 --2- 172.21.15.173:0/3316075052 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb89c0692a0 0x7fb89c06b750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40fcc30 tx=0x7fb8a400b040 comp rx=0 tx=0).stop 2024-02-16T22:14:46.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:46.849+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/3316075052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8b40fe0e0 msgr2=0x7fb8b410de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:14:46.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:46.849+0000 7fb8b9eeb700 1 --2- 172.21.15.173:0/3316075052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8b40fe0e0 0x7fb8b410de30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800b370 tx=0x7fb8a8009e30 comp rx=0 tx=0).stop 2024-02-16T22:14:46.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:46.849+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/3316075052 shutdown_connections 2024-02-16T22:14:46.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:46.849+0000 7fb8b9eeb700 1 --2- 172.21.15.173:0/3316075052 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb89c0692a0 0x7fb89c06b750 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:46.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:46.849+0000 7fb8b9eeb700 1 --2- 172.21.15.173:0/3316075052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8b40fcef0 0x7fb8b410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:46.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:46.849+0000 7fb8b9eeb700 1 --2- 172.21.15.173:0/3316075052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8b40fe0e0 0x7fb8b410de30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:46.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:46.849+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/3316075052 >> 172.21.15.173:0/3316075052 conn(0x7fb8b40f8620 msgr2=0x7fb8b41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:14:46.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:46.849+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/3316075052 shutdown_connections 2024-02-16T22:14:46.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:46.849+0000 7fb8b9eeb700 1 -- 172.21.15.173:0/3316075052 wait complete. 2024-02-16T22:14:48.106 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:47 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:48.106 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:47 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:48.107 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:47 smithi173 ceph-mon[37280]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:48.107 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:47 smithi173 ceph-mon[37280]: from='osd.4 [v2:172.21.15.173:6808/1479174093,v1:172.21.15.173:6809/1479174093]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-16T22:14:48.107 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:47 smithi173 ceph-mon[37280]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-16T22:14:48.132 DEBUG:teuthology.orchestra.run.smithi173:osd.4> sudo journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.4.service 2024-02-16T22:14:48.134 INFO:tasks.cephadm:Deploying osd.5 on smithi173 with /dev/vg_nvme/lv_2... 2024-02-16T22:14:48.134 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-16T22:14:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:47 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:47 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:47 smithi134 ceph-mon[28869]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:47 smithi134 ceph-mon[28869]: from='osd.4 [v2:172.21.15.173:6808/1479174093,v1:172.21.15.173:6809/1479174093]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-16T22:14:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:47 smithi134 ceph-mon[28869]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-16T22:14:48.441 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi173/config 2024-02-16T22:14:48.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:48 smithi134 ceph-mon[28869]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-16T22:14:48.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:48 smithi134 ceph-mon[28869]: osdmap e32: 5 total, 4 up, 5 in 2024-02-16T22:14:48.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:48 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:14:48.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:48 smithi134 ceph-mon[28869]: from='osd.4 [v2:172.21.15.173:6808/1479174093,v1:172.21.15.173:6809/1479174093]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:14:48.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:48 smithi134 ceph-mon[28869]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:14:48.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:48 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:48.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:48 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:49.130 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:48 smithi173 ceph-mon[37280]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-16T22:14:49.131 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:48 smithi173 ceph-mon[37280]: osdmap e32: 5 total, 4 up, 5 in 2024-02-16T22:14:49.131 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:48 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:14:49.131 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:48 smithi173 ceph-mon[37280]: from='osd.4 [v2:172.21.15.173:6808/1479174093,v1:172.21.15.173:6809/1479174093]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:14:49.131 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:48 smithi173 ceph-mon[37280]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:14:49.131 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:48 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:49.131 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:48 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:49.131 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:14:48 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[49320]: 2024-02-16T22:14:48.845+0000 7fd0e5872700 -1 osd.4 0 waiting for initial osdmap 2024-02-16T22:14:49.131 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:14:48 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[49320]: 2024-02-16T22:14:48.851+0000 7fd0e0e6e700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T22:14:49.959 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:49 smithi173 ceph-mon[37280]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-02-16T22:14:49.960 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:49 smithi173 ceph-mon[37280]: osdmap e33: 5 total, 4 up, 5 in 2024-02-16T22:14:49.960 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:49 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:14:49.960 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:49 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:14:49.960 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:49 smithi173 ceph-mon[37280]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:50.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:49 smithi134 ceph-mon[28869]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-02-16T22:14:50.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:49 smithi134 ceph-mon[28869]: osdmap e33: 5 total, 4 up, 5 in 2024-02-16T22:14:50.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:49 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:14:50.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:49 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:14:50.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:49 smithi134 ceph-mon[28869]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-16T22:14:50.760 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-16T22:14:50.760 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-16T22:14:50.760 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2024-02-16T22:14:50.761 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2024-02-16T22:14:50.761 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0136621 s, 768 MB/s 2024-02-16T22:14:50.761 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2024-02-16T22:14:50.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:50 smithi173 ceph-mon[37280]: purged_snaps scrub starts 2024-02-16T22:14:50.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:50 smithi173 ceph-mon[37280]: purged_snaps scrub ok 2024-02-16T22:14:50.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:50 smithi173 ceph-mon[37280]: osd.4 [v2:172.21.15.173:6808/1479174093,v1:172.21.15.173:6809/1479174093] boot 2024-02-16T22:14:50.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:50 smithi173 ceph-mon[37280]: osdmap e34: 5 total, 5 up, 5 in 2024-02-16T22:14:50.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:50 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:14:51.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:50 smithi134 ceph-mon[28869]: purged_snaps scrub starts 2024-02-16T22:14:51.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:50 smithi134 ceph-mon[28869]: purged_snaps scrub ok 2024-02-16T22:14:51.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:50 smithi134 ceph-mon[28869]: osd.4 [v2:172.21.15.173:6808/1479174093,v1:172.21.15.173:6809/1479174093] boot 2024-02-16T22:14:51.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:50 smithi134 ceph-mon[28869]: osdmap e34: 5 total, 5 up, 5 in 2024-02-16T22:14:51.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:50 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:14:51.411 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi173:vg_nvme/lv_2 2024-02-16T22:14:51.937 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:51 smithi173 ceph-mon[37280]: osdmap e35: 5 total, 5 up, 5 in 2024-02-16T22:14:51.937 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:51 smithi173 ceph-mon[37280]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:14:52.077 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi173/config 2024-02-16T22:14:52.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:51 smithi134 ceph-mon[28869]: osdmap e35: 5 total, 5 up, 5 in 2024-02-16T22:14:52.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:51 smithi134 ceph-mon[28869]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:14:54.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.259+0000 7f169e5cd700 1 -- 172.21.15.173:0/2005015802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16981003a0 msgr2=0x7f1698102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:14:54.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.259+0000 7f169e5cd700 1 --2- 172.21.15.173:0/2005015802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16981003a0 0x7f1698102780 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f168c004940 tx=0x7f168c009e30 comp rx=0 tx=0).stop 2024-02-16T22:14:54.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.259+0000 7f169e5cd700 1 -- 172.21.15.173:0/2005015802 shutdown_connections 2024-02-16T22:14:54.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.259+0000 7f169e5cd700 1 --2- 172.21.15.173:0/2005015802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16981003a0 0x7f1698102780 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:54.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.259+0000 7f169e5cd700 1 --2- 172.21.15.173:0/2005015802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16980fda80 0x7f16980ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:54.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.259+0000 7f169e5cd700 1 -- 172.21.15.173:0/2005015802 >> 172.21.15.173:0/2005015802 conn(0x7f16980f7520 msgr2=0x7f16980f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:14:54.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.259+0000 7f169e5cd700 1 -- 172.21.15.173:0/2005015802 shutdown_connections 2024-02-16T22:14:54.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.259+0000 7f169e5cd700 1 -- 172.21.15.173:0/2005015802 wait complete. 2024-02-16T22:14:54.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.259+0000 7f169e5cd700 1 Processor -- start 2024-02-16T22:14:54.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.259+0000 7f169e5cd700 1 -- start start 2024-02-16T22:14:54.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f169e5cd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16980fda80 0x7f169810d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:14:54.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f169e5cd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16981003a0 0x7f169810de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:14:54.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f169e5cd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169810e460 con 0x7f16981003a0 2024-02-16T22:14:54.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f169e5cd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169810ed00 con 0x7f16980fda80 2024-02-16T22:14:54.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f1697fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16980fda80 0x7f169810d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:14:54.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f1697fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16980fda80 0x7f169810d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:37402/0 (socket says 172.21.15.173:37402) 2024-02-16T22:14:54.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f1697fff700 1 -- 172.21.15.173:0/3741481549 learned_addr learned my addr 172.21.15.173:0/3741481549 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:14:54.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f1697fff700 1 -- 172.21.15.173:0/3741481549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16981003a0 msgr2=0x7f169810de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:14:54.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f16977fe700 1 --2- 172.21.15.173:0/3741481549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16981003a0 0x7f169810de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:14:54.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f1697fff700 1 --2- 172.21.15.173:0/3741481549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16981003a0 0x7f169810de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:14:54.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f1697fff700 1 -- 172.21.15.173:0/3741481549 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c005040 con 0x7f16980fda80 2024-02-16T22:14:54.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f1697fff700 1 --2- 172.21.15.173:0/3741481549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16980fda80 0x7f169810d920 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f168800c830 tx=0x7f1688004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:14:54.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f1694ff9700 1 -- 172.21.15.173:0/3741481549 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f168800a760 con 0x7f16980fda80 2024-02-16T22:14:54.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f169e5cd700 1 -- 172.21.15.173:0/3741481549 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169810efe0 con 0x7f16980fda80 2024-02-16T22:14:54.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f1694ff9700 1 -- 172.21.15.173:0/3741481549 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f168800ad90 con 0x7f16980fda80 2024-02-16T22:14:54.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f1694ff9700 1 -- 172.21.15.173:0/3741481549 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16880113a0 con 0x7f16980fda80 2024-02-16T22:14:54.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.260+0000 7f169e5cd700 1 -- 172.21.15.173:0/3741481549 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169810f520 con 0x7f16980fda80 2024-02-16T22:14:54.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.261+0000 7f169e5cd700 1 -- 172.21.15.173:0/3741481549 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169804bed0 con 0x7f16980fda80 2024-02-16T22:14:54.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.262+0000 7f1694ff9700 1 -- 172.21.15.173:0/3741481549 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f168800a8c0 con 0x7f16980fda80 2024-02-16T22:14:54.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.262+0000 7f1694ff9700 1 --2- 172.21.15.173:0/3741481549 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f16800692a0 0x7f168006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:14:54.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.262+0000 7f1694ff9700 1 -- 172.21.15.173:0/3741481549 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f1688086d00 con 0x7f16980fda80 2024-02-16T22:14:54.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.262+0000 7f16977fe700 1 --2- 172.21.15.173:0/3741481549 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f16800692a0 0x7f168006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:14:54.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.263+0000 7f16977fe700 1 --2- 172.21.15.173:0/3741481549 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f16800692a0 0x7f168006b750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f168c004f90 tx=0x7f168c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:14:54.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.266+0000 7f1694ff9700 1 -- 172.21.15.173:0/3741481549 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f168808a030 con 0x7f16980fda80 2024-02-16T22:14:54.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:14:54.456+0000 7f169e5cd700 1 -- 172.21.15.173:0/3741481549 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1698101000 con 0x7f16800692a0 2024-02-16T22:14:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:54 smithi134 ceph-mon[28869]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:14:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:54 smithi134 ceph-mon[28869]: Detected new or changed devices on smithi173 2024-02-16T22:14:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:14:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:14:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:54.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:14:54.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:54.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:14:54.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:54.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:14:54.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:54 smithi173 ceph-mon[37280]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:14:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:54 smithi173 ceph-mon[37280]: Detected new or changed devices on smithi173 2024-02-16T22:14:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:14:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:14:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:14:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:54.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:14:54.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:54.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:14:54.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:14:55.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:55 smithi134 ceph-mon[28869]: Adjusting osd_memory_target on smithi173 to 7968M 2024-02-16T22:14:55.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:55 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-16T22:14:55.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:55 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-16T22:14:55.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:55 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:55.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:55 smithi173 ceph-mon[37280]: Adjusting osd_memory_target on smithi173 to 7968M 2024-02-16T22:14:55.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:55 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-16T22:14:55.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:55 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-16T22:14:55.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:55 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:14:56.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:56 smithi134 ceph-mon[28869]: from='client.24177 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:14:56.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:56 smithi134 ceph-mon[28869]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:14:56.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:56 smithi173 ceph-mon[37280]: from='client.24177 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:14:56.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:56 smithi173 ceph-mon[37280]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:14:57.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:57 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/2783948758' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d9ce9a3-e735-4265-890c-af2aada1122d"}]: dispatch 2024-02-16T22:14:57.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:57 smithi134 ceph-mon[28869]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d9ce9a3-e735-4265-890c-af2aada1122d"}]: dispatch 2024-02-16T22:14:57.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:57 smithi134 ceph-mon[28869]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d9ce9a3-e735-4265-890c-af2aada1122d"}]': finished 2024-02-16T22:14:57.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:57 smithi134 ceph-mon[28869]: osdmap e36: 6 total, 5 up, 6 in 2024-02-16T22:14:57.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:57 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:14:57.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:57 smithi134 ceph-mon[28869]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:14:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:57 smithi173 ceph-mon[37280]: from='client.? 172.21.15.173:0/2783948758' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d9ce9a3-e735-4265-890c-af2aada1122d"}]: dispatch 2024-02-16T22:14:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:57 smithi173 ceph-mon[37280]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d9ce9a3-e735-4265-890c-af2aada1122d"}]: dispatch 2024-02-16T22:14:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:57 smithi173 ceph-mon[37280]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d9ce9a3-e735-4265-890c-af2aada1122d"}]': finished 2024-02-16T22:14:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:57 smithi173 ceph-mon[37280]: osdmap e36: 6 total, 5 up, 6 in 2024-02-16T22:14:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:57 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:14:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:57 smithi173 ceph-mon[37280]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:14:58.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:58 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/2385151978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-16T22:14:58.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:58 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:14:58.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:58 smithi173 ceph-mon[37280]: from='client.? 172.21.15.173:0/2385151978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-16T22:14:58.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:58 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:14:59.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:14:59 smithi134 ceph-mon[28869]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:14:59.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:14:59 smithi173 ceph-mon[37280]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:02.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:02 smithi134 ceph-mon[28869]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:02.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:02 smithi173 ceph-mon[37280]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:04.667 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:04 smithi173 ceph-mon[37280]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:04.667 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:04 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-16T22:15:04.667 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:04 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:15:04.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:04 smithi134 ceph-mon[28869]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:04.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:04 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-16T22:15:04.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:04 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:15:05.679 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:05 smithi173 ceph-mon[37280]: Deploying daemon osd.5 on smithi173 2024-02-16T22:15:05.679 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:05 smithi173 ceph-mon[37280]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:05 smithi134 ceph-mon[28869]: Deploying daemon osd.5 on smithi173 2024-02-16T22:15:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:05 smithi134 ceph-mon[28869]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:08.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:08 smithi134 ceph-mon[28869]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:08.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:08 smithi173 ceph-mon[37280]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:10.131 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:10 smithi173 ceph-mon[37280]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:10.131 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:10 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:10.131 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:10 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:10.131 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:10 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:15:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:10 smithi134 ceph-mon[28869]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:10 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:10 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:10 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:15:12.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:12.173+0000 7f1694ff9700 1 -- 172.21.15.173:0/3741481549 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1698101000 con 0x7f16800692a0 2024-02-16T22:15:12.176 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 5 on host 'smithi173' 2024-02-16T22:15:12.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:12.177+0000 7f169e5cd700 1 -- 172.21.15.173:0/3741481549 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f16800692a0 msgr2=0x7f168006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:12.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:12.177+0000 7f169e5cd700 1 --2- 172.21.15.173:0/3741481549 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f16800692a0 0x7f168006b750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f168c004f90 tx=0x7f168c009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:12.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:12.177+0000 7f169e5cd700 1 -- 172.21.15.173:0/3741481549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16980fda80 msgr2=0x7f169810d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:12.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:12.177+0000 7f169e5cd700 1 --2- 172.21.15.173:0/3741481549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16980fda80 0x7f169810d920 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f168800c830 tx=0x7f1688004470 comp rx=0 tx=0).stop 2024-02-16T22:15:12.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:12.177+0000 7f169e5cd700 1 -- 172.21.15.173:0/3741481549 shutdown_connections 2024-02-16T22:15:12.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:12.177+0000 7f169e5cd700 1 --2- 172.21.15.173:0/3741481549 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f16800692a0 0x7f168006b750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:12.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:12.177+0000 7f169e5cd700 1 --2- 172.21.15.173:0/3741481549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16980fda80 0x7f169810d920 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:12.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:12.177+0000 7f169e5cd700 1 --2- 172.21.15.173:0/3741481549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16981003a0 0x7f169810de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:12.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:12.177+0000 7f169e5cd700 1 -- 172.21.15.173:0/3741481549 >> 172.21.15.173:0/3741481549 conn(0x7f16980f7520 msgr2=0x7f16980f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:12.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:12.178+0000 7f169e5cd700 1 -- 172.21.15.173:0/3741481549 shutdown_connections 2024-02-16T22:15:12.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:12.178+0000 7f169e5cd700 1 -- 172.21.15.173:0/3741481549 wait complete. 2024-02-16T22:15:12.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:12 smithi134 ceph-mon[28869]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:12.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:12 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:12.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:12 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:12.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:12 smithi173 ceph-mon[37280]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:12.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:12 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:12.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:12 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:13.450 DEBUG:teuthology.orchestra.run.smithi173:osd.5> sudo journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.5.service 2024-02-16T22:15:13.453 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-02-16T22:15:13.453 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph osd stat -f json 2024-02-16T22:15:13.719 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:13.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:13 smithi134 ceph-mon[28869]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:13.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:13 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:15:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:13 smithi134 ceph-mon[28869]: from='osd.5 [v2:172.21.15.173:6816/2727105831,v1:172.21.15.173:6817/2727105831]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-16T22:15:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:13 smithi134 ceph-mon[28869]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-16T22:15:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:13 smithi173 ceph-mon[37280]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:13 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:15:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:13 smithi173 ceph-mon[37280]: from='osd.5 [v2:172.21.15.173:6816/2727105831,v1:172.21.15.173:6817/2727105831]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-16T22:15:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:13 smithi173 ceph-mon[37280]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-16T22:15:14.718 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:14 smithi173 ceph-mon[37280]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-16T22:15:14.718 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:14 smithi173 ceph-mon[37280]: osdmap e37: 6 total, 5 up, 6 in 2024-02-16T22:15:14.718 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:14 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:15:14.719 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:14 smithi173 ceph-mon[37280]: from='osd.5 [v2:172.21.15.173:6816/2727105831,v1:172.21.15.173:6817/2727105831]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:15:14.719 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:14 smithi173 ceph-mon[37280]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:15:14.719 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:14 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:14.719 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:14 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:14.719 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:15:14 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[56132]: 2024-02-16T22:15:14.445+0000 7f6a196bc700 -1 osd.5 0 waiting for initial osdmap 2024-02-16T22:15:14.719 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:15:14 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[56132]: 2024-02-16T22:15:14.452+0000 7f6a12cb4700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T22:15:14.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:14 smithi134 ceph-mon[28869]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-16T22:15:14.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:14 smithi134 ceph-mon[28869]: osdmap e37: 6 total, 5 up, 6 in 2024-02-16T22:15:14.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:14 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:15:14.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:14 smithi134 ceph-mon[28869]: from='osd.5 [v2:172.21.15.173:6816/2727105831,v1:172.21.15.173:6817/2727105831]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:15:14.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:14 smithi134 ceph-mon[28869]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:15:14.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:14 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:14.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:14 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:15.450 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:15 smithi134 ceph-mon[28869]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-02-16T22:15:15.450 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:15 smithi134 ceph-mon[28869]: osdmap e38: 6 total, 5 up, 6 in 2024-02-16T22:15:15.450 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:15 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:15:15.450 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:15 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:15:15.450 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:15 smithi134 ceph-mon[28869]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:15.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.485+0000 7efce29c8700 1 -- 172.21.15.134:0/3809015565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcdc0fbe40 msgr2=0x7efcdc0fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:15.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.485+0000 7efce29c8700 1 --2- 172.21.15.134:0/3809015565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcdc0fbe40 0x7efcdc0fc250 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efccc004940 tx=0x7efccc009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:15.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.485+0000 7efce29c8700 1 -- 172.21.15.134:0/3809015565 shutdown_connections 2024-02-16T22:15:15.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.485+0000 7efce29c8700 1 --2- 172.21.15.134:0/3809015565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcdc0fcfb0 0x7efcdc0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:15.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.485+0000 7efce29c8700 1 --2- 172.21.15.134:0/3809015565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcdc0fbe40 0x7efcdc0fc250 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:15.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.485+0000 7efce29c8700 1 -- 172.21.15.134:0/3809015565 >> 172.21.15.134:0/3809015565 conn(0x7efcdc0f7520 msgr2=0x7efcdc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:15.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.485+0000 7efce29c8700 1 -- 172.21.15.134:0/3809015565 shutdown_connections 2024-02-16T22:15:15.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.485+0000 7efce29c8700 1 -- 172.21.15.134:0/3809015565 wait complete. 2024-02-16T22:15:15.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.485+0000 7efce29c8700 1 Processor -- start 2024-02-16T22:15:15.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.485+0000 7efce29c8700 1 -- start start 2024-02-16T22:15:15.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efce29c8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcdc0fbe40 0x7efcdc10c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:15.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efce29c8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcdc0fcfb0 0x7efcdc10ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:15.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efce29c8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc10d2d0 con 0x7efcdc0fbe40 2024-02-16T22:15:15.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efce29c8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc10db70 con 0x7efcdc0fcfb0 2024-02-16T22:15:15.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efcdbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcdc0fbe40 0x7efcdc10c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:15.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efcdbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcdc0fbe40 0x7efcdc10c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39674/0 (socket says 172.21.15.134:39674) 2024-02-16T22:15:15.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efcdbfff700 1 -- 172.21.15.134:0/2085003818 learned_addr learned my addr 172.21.15.134:0/2085003818 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:15.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efcdb7fe700 1 --2- 172.21.15.134:0/2085003818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcdc0fcfb0 0x7efcdc10ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:15.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efcdbfff700 1 -- 172.21.15.134:0/2085003818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcdc0fcfb0 msgr2=0x7efcdc10ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:15.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efcdbfff700 1 --2- 172.21.15.134:0/2085003818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcdc0fcfb0 0x7efcdc10ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:15.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efcdbfff700 1 -- 172.21.15.134:0/2085003818 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc005040 con 0x7efcdc0fbe40 2024-02-16T22:15:15.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efcdbfff700 1 --2- 172.21.15.134:0/2085003818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcdc0fbe40 0x7efcdc10c790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efccc000c00 tx=0x7efccc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:15.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efcd8ff9700 1 -- 172.21.15.134:0/2085003818 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efccc021070 con 0x7efcdc0fbe40 2024-02-16T22:15:15.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efcd8ff9700 1 -- 172.21.15.134:0/2085003818 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efccc01c400 con 0x7efcdc0fbe40 2024-02-16T22:15:15.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efce29c8700 1 -- 172.21.15.134:0/2085003818 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc10ddf0 con 0x7efcdc0fbe40 2024-02-16T22:15:15.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efcd8ff9700 1 -- 172.21.15.134:0/2085003818 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efccc00e070 con 0x7efcdc0fbe40 2024-02-16T22:15:15.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.486+0000 7efce29c8700 1 -- 172.21.15.134:0/2085003818 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc10e2d0 con 0x7efcdc0fbe40 2024-02-16T22:15:15.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.487+0000 7efce29c8700 1 -- 172.21.15.134:0/2085003818 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc04bed0 con 0x7efcdc0fbe40 2024-02-16T22:15:15.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.488+0000 7efcd8ff9700 1 -- 172.21.15.134:0/2085003818 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7efccc01ca50 con 0x7efcdc0fbe40 2024-02-16T22:15:15.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.488+0000 7efcd8ff9700 1 --2- 172.21.15.134:0/2085003818 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7efcc40692a0 0x7efcc406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:15.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.488+0000 7efcdb7fe700 1 --2- 172.21.15.134:0/2085003818 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7efcc40692a0 0x7efcc406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:15.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.488+0000 7efcd8ff9700 1 -- 172.21.15.134:0/2085003818 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efccc088050 con 0x7efcdc0fbe40 2024-02-16T22:15:15.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.489+0000 7efcdb7fe700 1 --2- 172.21.15.134:0/2085003818 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7efcc40692a0 0x7efcc406b750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009b80 tx=0x7efcd000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:15.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.493+0000 7efcd8ff9700 1 -- 172.21.15.134:0/2085003818 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7efccc058150 con 0x7efcdc0fbe40 2024-02-16T22:15:15.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.676+0000 7efce29c8700 1 -- 172.21.15.134:0/2085003818 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7efcdc104930 con 0x7efcdc0fbe40 2024-02-16T22:15:15.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.677+0000 7efcd8ff9700 1 -- 172.21.15.134:0/2085003818 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7efccc057ce0 con 0x7efcdc0fbe40 2024-02-16T22:15:15.679 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:15:15.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.679+0000 7efce29c8700 1 -- 172.21.15.134:0/2085003818 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7efcc40692a0 msgr2=0x7efcc406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:15.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.679+0000 7efce29c8700 1 --2- 172.21.15.134:0/2085003818 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7efcc40692a0 0x7efcc406b750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009b80 tx=0x7efcd000b040 comp rx=0 tx=0).stop 2024-02-16T22:15:15.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.679+0000 7efce29c8700 1 -- 172.21.15.134:0/2085003818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcdc0fbe40 msgr2=0x7efcdc10c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:15.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.679+0000 7efce29c8700 1 --2- 172.21.15.134:0/2085003818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcdc0fbe40 0x7efcdc10c790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efccc000c00 tx=0x7efccc009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:15.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.679+0000 7efce29c8700 1 -- 172.21.15.134:0/2085003818 shutdown_connections 2024-02-16T22:15:15.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.679+0000 7efce29c8700 1 --2- 172.21.15.134:0/2085003818 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7efcc40692a0 0x7efcc406b750 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:15.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.679+0000 7efce29c8700 1 --2- 172.21.15.134:0/2085003818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcdc0fbe40 0x7efcdc10c790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:15.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.679+0000 7efce29c8700 1 --2- 172.21.15.134:0/2085003818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcdc0fcfb0 0x7efcdc10ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:15.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.679+0000 7efce29c8700 1 -- 172.21.15.134:0/2085003818 >> 172.21.15.134:0/2085003818 conn(0x7efcdc0f7520 msgr2=0x7efcdc100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:15.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.679+0000 7efce29c8700 1 -- 172.21.15.134:0/2085003818 shutdown_connections 2024-02-16T22:15:15.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:15.679+0000 7efce29c8700 1 -- 172.21.15.134:0/2085003818 wait complete. 2024-02-16T22:15:15.716 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:15 smithi173 ceph-mon[37280]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-02-16T22:15:15.716 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:15 smithi173 ceph-mon[37280]: osdmap e38: 6 total, 5 up, 6 in 2024-02-16T22:15:15.716 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:15 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:15:15.716 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:15 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:15:15.716 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:15 smithi173 ceph-mon[37280]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-16T22:15:16.428 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":39,"num_osds":6,"num_up_osds":6,"osd_up_since":1708121715,"num_in_osds":6,"osd_in_since":1708121696,"num_remapped_pgs":0} 2024-02-16T22:15:16.430 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-16T22:15:16.695 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:16.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:16 smithi134 ceph-mon[28869]: purged_snaps scrub starts 2024-02-16T22:15:16.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:16 smithi134 ceph-mon[28869]: purged_snaps scrub ok 2024-02-16T22:15:16.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:15:16.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:16 smithi134 ceph-mon[28869]: osd.5 [v2:172.21.15.173:6816/2727105831,v1:172.21.15.173:6817/2727105831] boot 2024-02-16T22:15:16.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:16 smithi134 ceph-mon[28869]: osdmap e39: 6 total, 6 up, 6 in 2024-02-16T22:15:16.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:16 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:15:16.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:16 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2085003818' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-16T22:15:16.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:16 smithi173 ceph-mon[37280]: purged_snaps scrub starts 2024-02-16T22:15:16.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:16 smithi173 ceph-mon[37280]: purged_snaps scrub ok 2024-02-16T22:15:16.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:16 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:15:16.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:16 smithi173 ceph-mon[37280]: osd.5 [v2:172.21.15.173:6816/2727105831,v1:172.21.15.173:6817/2727105831] boot 2024-02-16T22:15:16.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:16 smithi173 ceph-mon[37280]: osdmap e39: 6 total, 6 up, 6 in 2024-02-16T22:15:16.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:16 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:15:16.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:16 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2085003818' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-16T22:15:17.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: osdmap e40: 6 total, 6 up, 6 in 2024-02-16T22:15:17.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:17.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: Detected new or changed devices on smithi173 2024-02-16T22:15:17.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:17.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:17.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:15:17.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:15:17.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:15:17.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: Adjusting osd_memory_target on smithi173 to 5312M 2024-02-16T22:15:17.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:17.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:15:17.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:15:17.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:17.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:15:17.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:15:17.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:15:17.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:17 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:17.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: osdmap e40: 6 total, 6 up, 6 in 2024-02-16T22:15:17.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:17.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: Detected new or changed devices on smithi173 2024-02-16T22:15:17.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:17.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:17.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:15:17.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:15:17.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:15:17.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: Adjusting osd_memory_target on smithi173 to 5312M 2024-02-16T22:15:17.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:17.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:15:17.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:15:17.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:17.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:15:17.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:15:17.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:15:17.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:17 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:15:18.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.439+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2319301326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e940fdfe0 msgr2=0x7f9e940fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:18.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.439+0000 7f9e9c4cd700 1 --2- 172.21.15.134:0/2319301326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e940fdfe0 0x7f9e940fe3b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009d10 tx=0x7f9e8c004d10 comp rx=0 tx=0).stop 2024-02-16T22:15:18.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.439+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2319301326 shutdown_connections 2024-02-16T22:15:18.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.439+0000 7f9e9c4cd700 1 --2- 172.21.15.134:0/2319301326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e940fe8f0 0x7f9e94107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:18.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.439+0000 7f9e9c4cd700 1 --2- 172.21.15.134:0/2319301326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e940fdfe0 0x7f9e940fe3b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:18.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.439+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2319301326 >> 172.21.15.134:0/2319301326 conn(0x7f9e94071d90 msgr2=0x7f9e94072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:18.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.440+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2319301326 shutdown_connections 2024-02-16T22:15:18.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.440+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2319301326 wait complete. 2024-02-16T22:15:18.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.440+0000 7f9e9c4cd700 1 Processor -- start 2024-02-16T22:15:18.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.440+0000 7f9e9c4cd700 1 -- start start 2024-02-16T22:15:18.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.440+0000 7f9e9c4cd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e940fdfe0 0x7f9e940fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:18.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.440+0000 7f9e9c4cd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e940fe8f0 0x7f9e940fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:18.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.440+0000 7f9e9c4cd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e940fc9e0 con 0x7f9e940fe8f0 2024-02-16T22:15:18.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.440+0000 7f9e9c4cd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e940fcb50 con 0x7f9e940fdfe0 2024-02-16T22:15:18.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.440+0000 7f9e99a68700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e940fe8f0 0x7f9e940fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:18.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.440+0000 7f9e99a68700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e940fe8f0 0x7f9e940fc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39686/0 (socket says 172.21.15.134:39686) 2024-02-16T22:15:18.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.440+0000 7f9e99a68700 1 -- 172.21.15.134:0/2932427498 learned_addr learned my addr 172.21.15.134:0/2932427498 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:18.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.441+0000 7f9e9a269700 1 --2- 172.21.15.134:0/2932427498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e940fdfe0 0x7f9e940fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:18.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.441+0000 7f9e99a68700 1 -- 172.21.15.134:0/2932427498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e940fdfe0 msgr2=0x7f9e940fbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:18.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.441+0000 7f9e99a68700 1 --2- 172.21.15.134:0/2932427498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e940fdfe0 0x7f9e940fbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:18.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.441+0000 7f9e99a68700 1 -- 172.21.15.134:0/2932427498 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c009940 con 0x7f9e940fe8f0 2024-02-16T22:15:18.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.441+0000 7f9e99a68700 1 --2- 172.21.15.134:0/2932427498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e940fe8f0 0x7f9e940fc3e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400eb40 tx=0x7f9e8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:18.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.441+0000 7f9e8affd700 1 -- 172.21.15.134:0/2932427498 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e84007cc0 con 0x7f9e940fe8f0 2024-02-16T22:15:18.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.441+0000 7f9e8affd700 1 -- 172.21.15.134:0/2932427498 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e8400f040 con 0x7f9e940fe8f0 2024-02-16T22:15:18.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.441+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2932427498 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e94119d10 con 0x7f9e940fe8f0 2024-02-16T22:15:18.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.441+0000 7f9e8affd700 1 -- 172.21.15.134:0/2932427498 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e8400ca10 con 0x7f9e940fe8f0 2024-02-16T22:15:18.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.441+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2932427498 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9411a170 con 0x7f9e940fe8f0 2024-02-16T22:15:18.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.442+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2932427498 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e941046c0 con 0x7f9e940fe8f0 2024-02-16T22:15:18.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.442+0000 7f9e8affd700 1 -- 172.21.15.134:0/2932427498 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f9e8400cc80 con 0x7f9e940fe8f0 2024-02-16T22:15:18.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.443+0000 7f9e8affd700 1 --2- 172.21.15.134:0/2932427498 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f9e800692a0 0x7f9e8006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:18.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.443+0000 7f9e8affd700 1 -- 172.21.15.134:0/2932427498 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9e84086a10 con 0x7f9e940fe8f0 2024-02-16T22:15:18.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.443+0000 7f9e9a269700 1 --2- 172.21.15.134:0/2932427498 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f9e800692a0 0x7f9e8006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:18.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.443+0000 7f9e9a269700 1 --2- 172.21.15.134:0/2932427498 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f9e800692a0 0x7f9e8006b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c004a60 tx=0x7f9e8c004d10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:18.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.447+0000 7f9e8affd700 1 -- 172.21.15.134:0/2932427498 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9e8404dbd0 con 0x7f9e940fe8f0 2024-02-16T22:15:18.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.631+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2932427498 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e940738b0 con 0x7f9e940fe8f0 2024-02-16T22:15:18.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.631+0000 7f9e8affd700 1 -- 172.21.15.134:0/2932427498 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11122 (secure 0 0 0) 0x7f9e840530b0 con 0x7f9e940fe8f0 2024-02-16T22:15:18.634 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:15:18.634 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":40,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","created":"2024-02-16T22:09:26.274039+0000","modified":"2024-02-16T22:15:16.447263+0000","last_up_change":"2024-02-16T22:15:15.443236+0000","last_in_change":"2024-02-16T22:14:56.818141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T22:14:01.182574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d8e715f3-43f6-439a-be3d-a3bbd70b412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6803","nonce":200373494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6805","nonce":200373494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6809","nonce":200373494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6807","nonce":200373494}]},"public_addr":"172.21.15.134:6803/200373494","cluster_addr":"172.21.15.134:6805/200373494","heartbeat_back_addr":"172.21.15.134:6809/200373494","heartbeat_front_addr":"172.21.15.134:6807/200373494","state":["exists","up"]},{"osd":1,"uuid":"c1fe573e-cb80-4ac7-9d3c-b7e296e86a81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6811","nonce":3091662869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6813","nonce":3091662869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6817","nonce":3091662869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6815","nonce":3091662869}]},"public_addr":"172.21.15.134:6811/3091662869","cluster_addr":"172.21.15.134:6813/3091662869","heartbeat_back_addr":"172.21.15.134:6817/3091662869","heartbeat_front_addr":"172.21.15.134:6815/3091662869","state":["exists","up"]},{"osd":2,"uuid":"036c6cf2-7373-46ff-85db-9e0898ad0677","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6819","nonce":203470515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6821","nonce":203470515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6825","nonce":203470515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6823","nonce":203470515}]},"public_addr":"172.21.15.134:6819/203470515","cluster_addr":"172.21.15.134:6821/203470515","heartbeat_back_addr":"172.21.15.134:6825/203470515","heartbeat_front_addr":"172.21.15.134:6823/203470515","state":["exists","up"]},{"osd":3,"uuid":"6a00fd47-f787-4e21-9619-9e9341420b4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6801","nonce":1747350493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6803","nonce":1747350493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6807","nonce":1747350493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6805","nonce":1747350493}]},"public_addr":"172.21.15.173:6801/1747350493","cluster_addr":"172.21.15.173:6803/1747350493","heartbeat_back_addr":"172.21.15.173:6807/1747350493","heartbeat_front_addr":"172.21.15.173:6805/1747350493","state":["exists","up"]},{"osd":4,"uuid":"5a314e0e-0951-4462-bb9a-f3614ded4c18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6809","nonce":1479174093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6811","nonce":1479174093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6815","nonce":1479174093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6813","nonce":1479174093}]},"public_addr":"172.21.15.173:6809/1479174093","cluster_addr":"172.21.15.173:6811/1479174093","heartbeat_back_addr":"172.21.15.173:6815/1479174093","heartbeat_front_addr":"172.21.15.173:6813/1479174093","state":["exists","up"]},{"osd":5,"uuid":"9d9ce9a3-e735-4265-890c-af2aada1122d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6817","nonce":2727105831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6819","nonce":2727105831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6823","nonce":2727105831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6821","nonce":2727105831}]},"public_addr":"172.21.15.173:6817/2727105831","cluster_addr":"172.21.15.173:6819/2727105831","heartbeat_back_addr":"172.21.15.173:6823/2727105831","heartbeat_front_addr":"172.21.15.173:6821/2727105831","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:01.314144+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:30.212232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:58.392610+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:14:22.854647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:14:48.600782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:15:13.932090+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6801/2987045407":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/3010290966":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/994312604":"2024-02-17T22:10:30.766785+0000","172.21.15.134:6801/3459537666":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/1667200782":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6800/3459537666":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/3172564602":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/920183098":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/3516783507":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6800/2987045407":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6800/3520115315":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/3313361224":"2024-02-17T22:09:59.839885+0000","172.21.15.134:6801/3520115315":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/2419255497":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/3099284737":"2024-02-17T22:10:30.766785+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T22:15:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.633+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2932427498 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f9e800692a0 msgr2=0x7f9e8006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.633+0000 7f9e9c4cd700 1 --2- 172.21.15.134:0/2932427498 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f9e800692a0 0x7f9e8006b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c004a60 tx=0x7f9e8c004d10 comp rx=0 tx=0).stop 2024-02-16T22:15:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.633+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2932427498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e940fe8f0 msgr2=0x7f9e940fc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.633+0000 7f9e9c4cd700 1 --2- 172.21.15.134:0/2932427498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e940fe8f0 0x7f9e940fc3e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400eb40 tx=0x7f9e8400b040 comp rx=0 tx=0).stop 2024-02-16T22:15:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.633+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2932427498 shutdown_connections 2024-02-16T22:15:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.633+0000 7f9e9c4cd700 1 --2- 172.21.15.134:0/2932427498 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f9e800692a0 0x7f9e8006b750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.633+0000 7f9e9c4cd700 1 --2- 172.21.15.134:0/2932427498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e940fdfe0 0x7f9e940fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:18.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.633+0000 7f9e9c4cd700 1 --2- 172.21.15.134:0/2932427498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e940fe8f0 0x7f9e940fc3e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:18.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.633+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2932427498 >> 172.21.15.134:0/2932427498 conn(0x7f9e94071d90 msgr2=0x7f9e94101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:18.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.634+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2932427498 shutdown_connections 2024-02-16T22:15:18.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:18.634+0000 7f9e9c4cd700 1 -- 172.21.15.134:0/2932427498 wait complete. 2024-02-16T22:15:18.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:18 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2932427498' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-16T22:15:18.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:18 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2932427498' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-16T22:15:19.386 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-16T22:14:01.182574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-02-16T22:15:19.387 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-02-16T22:15:19.642 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:19.973 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:19 smithi134 ceph-mon[28869]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:19.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:19 smithi173 ceph-mon[37280]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:21.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.178+0000 7fb8470e0700 1 -- 172.21.15.134:0/899321673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8400fdfe0 msgr2=0x7fb8400fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:21.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.178+0000 7fb8470e0700 1 --2- 172.21.15.134:0/899321673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8400fdfe0 0x7fb8400fe3b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb834004970 tx=0x7fb834009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:21.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.178+0000 7fb8470e0700 1 -- 172.21.15.134:0/899321673 shutdown_connections 2024-02-16T22:15:21.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.178+0000 7fb8470e0700 1 --2- 172.21.15.134:0/899321673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8400fe8f0 0x7fb840107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:21.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.178+0000 7fb8470e0700 1 --2- 172.21.15.134:0/899321673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8400fdfe0 0x7fb8400fe3b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:21.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.178+0000 7fb8470e0700 1 -- 172.21.15.134:0/899321673 >> 172.21.15.134:0/899321673 conn(0x7fb840071d90 msgr2=0x7fb840072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:21.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.178+0000 7fb8470e0700 1 -- 172.21.15.134:0/899321673 shutdown_connections 2024-02-16T22:15:21.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.178+0000 7fb8470e0700 1 -- 172.21.15.134:0/899321673 wait complete. 2024-02-16T22:15:21.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.178+0000 7fb8470e0700 1 Processor -- start 2024-02-16T22:15:21.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.178+0000 7fb8470e0700 1 -- start start 2024-02-16T22:15:21.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.179+0000 7fb8470e0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8400fdfe0 0x7fb840113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:21.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.179+0000 7fb8470e0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8400fe8f0 0x7fb840114010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:21.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.179+0000 7fb8470e0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8401146f0 con 0x7fb8400fdfe0 2024-02-16T22:15:21.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.179+0000 7fb8470e0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84010d990 con 0x7fb8400fe8f0 2024-02-16T22:15:21.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.179+0000 7fb844e7c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8400fdfe0 0x7fb840113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:21.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.179+0000 7fb844e7c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8400fdfe0 0x7fb840113ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39706/0 (socket says 172.21.15.134:39706) 2024-02-16T22:15:21.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.179+0000 7fb844e7c700 1 -- 172.21.15.134:0/4188687011 learned_addr learned my addr 172.21.15.134:0/4188687011 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:21.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.179+0000 7fb83ffff700 1 --2- 172.21.15.134:0/4188687011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8400fe8f0 0x7fb840114010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:21.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.179+0000 7fb844e7c700 1 -- 172.21.15.134:0/4188687011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8400fe8f0 msgr2=0x7fb840114010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:21.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.179+0000 7fb844e7c700 1 --2- 172.21.15.134:0/4188687011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8400fe8f0 0x7fb840114010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:21.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.179+0000 7fb844e7c700 1 -- 172.21.15.134:0/4188687011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb834005040 con 0x7fb8400fdfe0 2024-02-16T22:15:21.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.179+0000 7fb83ffff700 1 --2- 172.21.15.134:0/4188687011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8400fe8f0 0x7fb840114010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:15:21.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.179+0000 7fb844e7c700 1 --2- 172.21.15.134:0/4188687011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8400fdfe0 0x7fb840113ad0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb834009150 tx=0x7fb834009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:21.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.179+0000 7fb83d7fa700 1 -- 172.21.15.134:0/4188687011 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb83400e040 con 0x7fb8400fdfe0 2024-02-16T22:15:21.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.180+0000 7fb8470e0700 1 -- 172.21.15.134:0/4188687011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84010dc10 con 0x7fb8400fdfe0 2024-02-16T22:15:21.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.180+0000 7fb83d7fa700 1 -- 172.21.15.134:0/4188687011 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb834004290 con 0x7fb8400fdfe0 2024-02-16T22:15:21.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.180+0000 7fb83d7fa700 1 -- 172.21.15.134:0/4188687011 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb83401c630 con 0x7fb8400fdfe0 2024-02-16T22:15:21.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.180+0000 7fb8470e0700 1 -- 172.21.15.134:0/4188687011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84010e150 con 0x7fb8400fdfe0 2024-02-16T22:15:21.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.181+0000 7fb8470e0700 1 -- 172.21.15.134:0/4188687011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8401046c0 con 0x7fb8400fdfe0 2024-02-16T22:15:21.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.181+0000 7fb83d7fa700 1 -- 172.21.15.134:0/4188687011 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb834013980 con 0x7fb8400fdfe0 2024-02-16T22:15:21.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.181+0000 7fb83d7fa700 1 --2- 172.21.15.134:0/4188687011 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb8300692b0 0x7fb83006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:21.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.181+0000 7fb83d7fa700 1 -- 172.21.15.134:0/4188687011 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb834088110 con 0x7fb8400fdfe0 2024-02-16T22:15:21.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.181+0000 7fb83ffff700 1 --2- 172.21.15.134:0/4188687011 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb8300692b0 0x7fb83006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:21.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.182+0000 7fb83ffff700 1 --2- 172.21.15.134:0/4188687011 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb8300692b0 0x7fb83006b760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb82c006fd0 tx=0x7fb82c008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:21.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.186+0000 7fb83d7fa700 1 -- 172.21.15.134:0/4188687011 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb834058210 con 0x7fb8400fdfe0 2024-02-16T22:15:21.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.368+0000 7fb8470e0700 1 -- 172.21.15.134:0/4188687011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8400738b0 con 0x7fb8400fdfe0 2024-02-16T22:15:21.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.368+0000 7fb83d7fa700 1 -- 172.21.15.134:0/4188687011 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb834057da0 con 0x7fb8400fdfe0 2024-02-16T22:15:21.370 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-02-16T22:15:21.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.370+0000 7fb8470e0700 1 -- 172.21.15.134:0/4188687011 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb8300692b0 msgr2=0x7fb83006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:21.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.370+0000 7fb8470e0700 1 --2- 172.21.15.134:0/4188687011 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb8300692b0 0x7fb83006b760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb82c006fd0 tx=0x7fb82c008040 comp rx=0 tx=0).stop 2024-02-16T22:15:21.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.370+0000 7fb8470e0700 1 -- 172.21.15.134:0/4188687011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8400fdfe0 msgr2=0x7fb840113ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:21.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.370+0000 7fb8470e0700 1 --2- 172.21.15.134:0/4188687011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8400fdfe0 0x7fb840113ad0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb834009150 tx=0x7fb834009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:21.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.370+0000 7fb8470e0700 1 -- 172.21.15.134:0/4188687011 shutdown_connections 2024-02-16T22:15:21.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.370+0000 7fb8470e0700 1 --2- 172.21.15.134:0/4188687011 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb8300692b0 0x7fb83006b760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:21.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.370+0000 7fb8470e0700 1 --2- 172.21.15.134:0/4188687011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8400fdfe0 0x7fb840113ad0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:21.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.370+0000 7fb8470e0700 1 --2- 172.21.15.134:0/4188687011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8400fe8f0 0x7fb840114010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:21.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.370+0000 7fb8470e0700 1 -- 172.21.15.134:0/4188687011 >> 172.21.15.134:0/4188687011 conn(0x7fb840071d90 msgr2=0x7fb840101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:21.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.370+0000 7fb8470e0700 1 -- 172.21.15.134:0/4188687011 shutdown_connections 2024-02-16T22:15:21.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:21.370+0000 7fb8470e0700 1 -- 172.21.15.134:0/4188687011 wait complete. 2024-02-16T22:15:21.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:21 smithi134 ceph-mon[28869]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:21.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:21 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/4188687011' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-16T22:15:22.129 INFO:tasks.cephadm:Setting up client nodes... 2024-02-16T22:15:22.129 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-16T22:15:22.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:21 smithi173 ceph-mon[37280]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:22.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:21 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/4188687011' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-16T22:15:22.388 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.073+0000 7f284f2b2700 1 -- 172.21.15.134:0/3122312091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fdd90 msgr2=0x7f28480fc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.073+0000 7f284f2b2700 1 --2- 172.21.15.134:0/3122312091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fdd90 0x7f28480fc1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2844004940 tx=0x7f2844009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.073+0000 7f284f2b2700 1 -- 172.21.15.134:0/3122312091 shutdown_connections 2024-02-16T22:15:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.073+0000 7f284f2b2700 1 --2- 172.21.15.134:0/3122312091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fdd90 0x7f28480fc1a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.073+0000 7f284f2b2700 1 --2- 172.21.15.134:0/3122312091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28480fd440 0x7f28480fd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.073+0000 7f284f2b2700 1 -- 172.21.15.134:0/3122312091 >> 172.21.15.134:0/3122312091 conn(0x7f28480f6d20 msgr2=0x7f28480f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.073+0000 7f284f2b2700 1 -- 172.21.15.134:0/3122312091 shutdown_connections 2024-02-16T22:15:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.073+0000 7f284f2b2700 1 -- 172.21.15.134:0/3122312091 wait complete. 2024-02-16T22:15:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.074+0000 7f284f2b2700 1 Processor -- start 2024-02-16T22:15:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.074+0000 7f284f2b2700 1 -- start start 2024-02-16T22:15:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.074+0000 7f284f2b2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fd440 0x7f284810cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.074+0000 7f284f2b2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28480fdd90 0x7f284810d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.074+0000 7f284f2b2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284810d6d0 con 0x7f28480fd440 2024-02-16T22:15:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.074+0000 7f284f2b2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284810df70 con 0x7f28480fdd90 2024-02-16T22:15:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.074+0000 7f284d04e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fd440 0x7f284810cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.074+0000 7f284d04e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fd440 0x7f284810cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44582/0 (socket says 172.21.15.134:44582) 2024-02-16T22:15:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.074+0000 7f284d04e700 1 -- 172.21.15.134:0/2532791763 learned_addr learned my addr 172.21.15.134:0/2532791763 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.074+0000 7f284c84d700 1 --2- 172.21.15.134:0/2532791763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28480fdd90 0x7f284810d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.075+0000 7f284d04e700 1 -- 172.21.15.134:0/2532791763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28480fdd90 msgr2=0x7f284810d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.075+0000 7f284d04e700 1 --2- 172.21.15.134:0/2532791763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28480fdd90 0x7f284810d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.075+0000 7f284d04e700 1 -- 172.21.15.134:0/2532791763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844005040 con 0x7f28480fd440 2024-02-16T22:15:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.075+0000 7f284d04e700 1 --2- 172.21.15.134:0/2532791763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fd440 0x7f284810cb90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f283c00c8c0 tx=0x7f283c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.075+0000 7f2839ffb700 1 -- 172.21.15.134:0/2532791763 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f283c00a980 con 0x7f28480fd440 2024-02-16T22:15:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.075+0000 7f2839ffb700 1 -- 172.21.15.134:0/2532791763 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f283c00ce60 con 0x7f28480fd440 2024-02-16T22:15:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.075+0000 7f284f2b2700 1 -- 172.21.15.134:0/2532791763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284810e250 con 0x7f28480fd440 2024-02-16T22:15:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.075+0000 7f2839ffb700 1 -- 172.21.15.134:0/2532791763 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f283c0115e0 con 0x7f28480fd440 2024-02-16T22:15:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.075+0000 7f284f2b2700 1 -- 172.21.15.134:0/2532791763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284810e790 con 0x7f28480fd440 2024-02-16T22:15:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.076+0000 7f284f2b2700 1 -- 172.21.15.134:0/2532791763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2848106980 con 0x7f28480fd440 2024-02-16T22:15:24.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.076+0000 7f2839ffb700 1 -- 172.21.15.134:0/2532791763 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f283c012400 con 0x7f28480fd440 2024-02-16T22:15:24.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.077+0000 7f2839ffb700 1 --2- 172.21.15.134:0/2532791763 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f28340692a0 0x7f283406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:24.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.077+0000 7f2839ffb700 1 -- 172.21.15.134:0/2532791763 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f283c086e50 con 0x7f28480fd440 2024-02-16T22:15:24.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.077+0000 7f284c84d700 1 --2- 172.21.15.134:0/2532791763 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f28340692a0 0x7f283406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:24.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.077+0000 7f284c84d700 1 --2- 172.21.15.134:0/2532791763 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f28340692a0 0x7f283406b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f284400b3b0 tx=0x7f2844009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:24.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.081+0000 7f2839ffb700 1 -- 172.21.15.134:0/2532791763 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f283c056ff0 con 0x7f28480fd440 2024-02-16T22:15:24.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:23 smithi134 ceph-mon[28869]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:24.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:23 smithi173 ceph-mon[37280]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:24.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.338+0000 7f284f2b2700 1 -- 172.21.15.134:0/2532791763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f284804bed0 con 0x7f28480fd440 2024-02-16T22:15:24.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.342+0000 7f2839ffb700 1 -- 172.21.15.134:0/2532791763 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f283c0126b0 con 0x7f28480fd440 2024-02-16T22:15:24.344 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-02-16T22:15:24.344 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB83s9l91A/FBAAQFniMmAj/6DQA+gkr71pHg== 2024-02-16T22:15:24.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.345+0000 7f284f2b2700 1 -- 172.21.15.134:0/2532791763 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f28340692a0 msgr2=0x7f283406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:24.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.345+0000 7f284f2b2700 1 --2- 172.21.15.134:0/2532791763 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f28340692a0 0x7f283406b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f284400b3b0 tx=0x7f2844009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:24.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.345+0000 7f284f2b2700 1 -- 172.21.15.134:0/2532791763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fd440 msgr2=0x7f284810cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:24.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.345+0000 7f284f2b2700 1 --2- 172.21.15.134:0/2532791763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fd440 0x7f284810cb90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f283c00c8c0 tx=0x7f283c0044c0 comp rx=0 tx=0).stop 2024-02-16T22:15:24.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.345+0000 7f284f2b2700 1 -- 172.21.15.134:0/2532791763 shutdown_connections 2024-02-16T22:15:24.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.345+0000 7f284f2b2700 1 --2- 172.21.15.134:0/2532791763 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f28340692a0 0x7f283406b750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:24.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.345+0000 7f284f2b2700 1 --2- 172.21.15.134:0/2532791763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fd440 0x7f284810cb90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:24.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.345+0000 7f284f2b2700 1 --2- 172.21.15.134:0/2532791763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28480fdd90 0x7f284810d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:24.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.345+0000 7f284f2b2700 1 -- 172.21.15.134:0/2532791763 >> 172.21.15.134:0/2532791763 conn(0x7f28480f6d20 msgr2=0x7f28481005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:24.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.345+0000 7f284f2b2700 1 -- 172.21.15.134:0/2532791763 shutdown_connections 2024-02-16T22:15:24.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:24.345+0000 7f284f2b2700 1 -- 172.21.15.134:0/2532791763 wait complete. 2024-02-16T22:15:25.033 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:15:25.033 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-16T22:15:25.033 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-16T22:15:25.078 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-16T22:15:25.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:24 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2532791763' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-16T22:15:25.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:24 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2532791763' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-16T22:15:25.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:24 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2532791763' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-16T22:15:25.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:24 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2532791763' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-16T22:15:25.342 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi173/config 2024-02-16T22:15:26.615 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:26 smithi173 ceph-mon[37280]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:26.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:26 smithi134 ceph-mon[28869]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:26.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.824+0000 7fd51ccee700 1 -- 172.21.15.173:0/255331840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd518070840 msgr2=0x7fd518070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:26.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.824+0000 7fd51ccee700 1 --2- 172.21.15.173:0/255331840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd518070840 0x7fd518070cb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd50c004940 tx=0x7fd50c009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:26.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51ccee700 1 -- 172.21.15.173:0/255331840 shutdown_connections 2024-02-16T22:15:26.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51ccee700 1 --2- 172.21.15.173:0/255331840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd518070840 0x7fd518070cb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:26.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51ccee700 1 --2- 172.21.15.173:0/255331840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd518071e90 0x7fd518070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:26.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51ccee700 1 -- 172.21.15.173:0/255331840 >> 172.21.15.173:0/255331840 conn(0x7fd5180f8620 msgr2=0x7fd5180faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:26.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51ccee700 1 -- 172.21.15.173:0/255331840 shutdown_connections 2024-02-16T22:15:26.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51ccee700 1 -- 172.21.15.173:0/255331840 wait complete. 2024-02-16T22:15:26.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51ccee700 1 Processor -- start 2024-02-16T22:15:26.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51ccee700 1 -- start start 2024-02-16T22:15:26.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51ccee700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd518070840 0x7fd51810fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:26.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51ccee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd518071e90 0x7fd518110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:26.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51ccee700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd518110680 con 0x7fd518071e90 2024-02-16T22:15:26.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51ccee700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd518110f20 con 0x7fd518070840 2024-02-16T22:15:26.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd518070840 0x7fd51810fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:26.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd518070840 0x7fd51810fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60466/0 (socket says 172.21.15.173:60466) 2024-02-16T22:15:26.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.825+0000 7fd51659c700 1 -- 172.21.15.173:0/3642602009 learned_addr learned my addr 172.21.15.173:0/3642602009 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-02-16T22:15:26.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.826+0000 7fd515d9b700 1 --2- 172.21.15.173:0/3642602009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd518071e90 0x7fd518110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:26.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.826+0000 7fd51659c700 1 -- 172.21.15.173:0/3642602009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd518071e90 msgr2=0x7fd518110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:26.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.826+0000 7fd51659c700 1 --2- 172.21.15.173:0/3642602009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd518071e90 0x7fd518110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:26.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.826+0000 7fd51659c700 1 -- 172.21.15.173:0/3642602009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c005040 con 0x7fd518070840 2024-02-16T22:15:26.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.826+0000 7fd515d9b700 1 --2- 172.21.15.173:0/3642602009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd518071e90 0x7fd518110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:15:26.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.826+0000 7fd51659c700 1 --2- 172.21.15.173:0/3642602009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd518070840 0x7fd51810fb40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd50800c8c0 tx=0x7fd5080044c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:26.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.826+0000 7fd506ffd700 1 -- 172.21.15.173:0/3642602009 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd50800a980 con 0x7fd518070840 2024-02-16T22:15:26.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.826+0000 7fd506ffd700 1 -- 172.21.15.173:0/3642602009 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd50800ce60 con 0x7fd518070840 2024-02-16T22:15:26.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.826+0000 7fd506ffd700 1 -- 172.21.15.173:0/3642602009 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5080115e0 con 0x7fd518070840 2024-02-16T22:15:26.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.826+0000 7fd51ccee700 1 -- 172.21.15.173:0/3642602009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd518111200 con 0x7fd518070840 2024-02-16T22:15:26.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.826+0000 7fd51ccee700 1 -- 172.21.15.173:0/3642602009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd518111740 con 0x7fd518070840 2024-02-16T22:15:26.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.827+0000 7fd51ccee700 1 -- 172.21.15.173:0/3642602009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51804bed0 con 0x7fd518070840 2024-02-16T22:15:26.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.827+0000 7fd506ffd700 1 -- 172.21.15.173:0/3642602009 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd508012400 con 0x7fd518070840 2024-02-16T22:15:26.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.828+0000 7fd506ffd700 1 --2- 172.21.15.173:0/3642602009 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd5000692a0 0x7fd50006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:26.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.828+0000 7fd506ffd700 1 -- 172.21.15.173:0/3642602009 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd508086e50 con 0x7fd518070840 2024-02-16T22:15:26.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.828+0000 7fd515d9b700 1 --2- 172.21.15.173:0/3642602009 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd5000692a0 0x7fd50006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:26.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.829+0000 7fd515d9b700 1 --2- 172.21.15.173:0/3642602009 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd5000692a0 0x7fd50006b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009fd0 tx=0x7fd50c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:26.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:26.832+0000 7fd506ffd700 1 -- 172.21.15.173:0/3642602009 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd508056ff0 con 0x7fd518070840 2024-02-16T22:15:27.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:27.083+0000 7fd51ccee700 1 -- 172.21.15.173:0/3642602009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fd518111c50 con 0x7fd518070840 2024-02-16T22:15:27.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:27.088+0000 7fd506ffd700 1 -- 172.21.15.173:0/3642602009 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fd5080126b0 con 0x7fd518070840 2024-02-16T22:15:27.090 INFO:teuthology.orchestra.run.smithi173.stdout:[client.1] 2024-02-16T22:15:27.090 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQB/3s9lmDYXBRAAlo23k5iUgmsb/KP5KiBwqw== 2024-02-16T22:15:27.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:27.090+0000 7fd51ccee700 1 -- 172.21.15.173:0/3642602009 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd5000692a0 msgr2=0x7fd50006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:27.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:27.090+0000 7fd51ccee700 1 --2- 172.21.15.173:0/3642602009 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd5000692a0 0x7fd50006b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009fd0 tx=0x7fd50c009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:27.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:27.090+0000 7fd51ccee700 1 -- 172.21.15.173:0/3642602009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd518070840 msgr2=0x7fd51810fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:27.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:27.090+0000 7fd51ccee700 1 --2- 172.21.15.173:0/3642602009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd518070840 0x7fd51810fb40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd50800c8c0 tx=0x7fd5080044c0 comp rx=0 tx=0).stop 2024-02-16T22:15:27.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:27.090+0000 7fd51ccee700 1 -- 172.21.15.173:0/3642602009 shutdown_connections 2024-02-16T22:15:27.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:27.090+0000 7fd51ccee700 1 --2- 172.21.15.173:0/3642602009 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd5000692a0 0x7fd50006b750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:27.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:27.090+0000 7fd51ccee700 1 --2- 172.21.15.173:0/3642602009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd518070840 0x7fd51810fb40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:27.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:27.090+0000 7fd51ccee700 1 --2- 172.21.15.173:0/3642602009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd518071e90 0x7fd518110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:27.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:27.090+0000 7fd51ccee700 1 -- 172.21.15.173:0/3642602009 >> 172.21.15.173:0/3642602009 conn(0x7fd5180f8620 msgr2=0x7fd518102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:27.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:27.090+0000 7fd51ccee700 1 -- 172.21.15.173:0/3642602009 shutdown_connections 2024-02-16T22:15:27.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-02-16T22:15:27.090+0000 7fd51ccee700 1 -- 172.21.15.173:0/3642602009 wait complete. 2024-02-16T22:15:27.614 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:15:27.614 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-16T22:15:27.614 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-16T22:15:27.656 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-16T22:15:27.656 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-16T22:15:27.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph mgr dump --format=json 2024-02-16T22:15:27.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:27 smithi134 ceph-mon[28869]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:27.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:27 smithi134 ceph-mon[28869]: from='client.? 172.21.15.173:0/3642602009' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-16T22:15:27.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:27 smithi134 ceph-mon[28869]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-16T22:15:27.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:27 smithi134 ceph-mon[28869]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-16T22:15:27.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:27 smithi173 ceph-mon[37280]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:27.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:27 smithi173 ceph-mon[37280]: from='client.? 172.21.15.173:0/3642602009' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-16T22:15:27.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:27 smithi173 ceph-mon[37280]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-16T22:15:27.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:27 smithi173 ceph-mon[37280]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-16T22:15:27.919 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:28.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:28 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:15:28.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:28 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:15:29.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.604+0000 7ffa8a30f700 1 -- 172.21.15.134:0/4276328203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa84101e40 msgr2=0x7ffa84102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:29.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.604+0000 7ffa8a30f700 1 --2- 172.21.15.134:0/4276328203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa84101e40 0x7ffa84102210 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffa78004940 tx=0x7ffa78009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:29.607 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:29 smithi134 ceph-mon[28869]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:29.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.604+0000 7ffa8a30f700 1 -- 172.21.15.134:0/4276328203 shutdown_connections 2024-02-16T22:15:29.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.604+0000 7ffa8a30f700 1 --2- 172.21.15.134:0/4276328203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa841027e0 0x7ffa840fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:29.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.604+0000 7ffa8a30f700 1 --2- 172.21.15.134:0/4276328203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa84101e40 0x7ffa84102210 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:29.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.604+0000 7ffa8a30f700 1 -- 172.21.15.134:0/4276328203 >> 172.21.15.134:0/4276328203 conn(0x7ffa84071d90 msgr2=0x7ffa84072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:29.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.604+0000 7ffa8a30f700 1 -- 172.21.15.134:0/4276328203 shutdown_connections 2024-02-16T22:15:29.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.604+0000 7ffa8a30f700 1 -- 172.21.15.134:0/4276328203 wait complete. 2024-02-16T22:15:29.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.605+0000 7ffa8a30f700 1 Processor -- start 2024-02-16T22:15:29.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.605+0000 7ffa8a30f700 1 -- start start 2024-02-16T22:15:29.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.605+0000 7ffa8a30f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa84101e40 0x7ffa84102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:29.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.605+0000 7ffa8a30f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa841027e0 0x7ffa841031e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:29.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.605+0000 7ffa8a30f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa841037e0 con 0x7ffa841027e0 2024-02-16T22:15:29.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.605+0000 7ffa8a30f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84103950 con 0x7ffa84101e40 2024-02-16T22:15:29.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.605+0000 7ffa837fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa841027e0 0x7ffa841031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:29.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.605+0000 7ffa837fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa841027e0 0x7ffa841031e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44606/0 (socket says 172.21.15.134:44606) 2024-02-16T22:15:29.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.605+0000 7ffa837fe700 1 -- 172.21.15.134:0/2947864745 learned_addr learned my addr 172.21.15.134:0/2947864745 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:29.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.605+0000 7ffa83fff700 1 --2- 172.21.15.134:0/2947864745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa84101e40 0x7ffa84102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:29.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.605+0000 7ffa837fe700 1 -- 172.21.15.134:0/2947864745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa84101e40 msgr2=0x7ffa84102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:29.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.605+0000 7ffa837fe700 1 --2- 172.21.15.134:0/2947864745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa84101e40 0x7ffa84102ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:29.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.606+0000 7ffa837fe700 1 -- 172.21.15.134:0/2947864745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa78005040 con 0x7ffa841027e0 2024-02-16T22:15:29.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.606+0000 7ffa83fff700 1 --2- 172.21.15.134:0/2947864745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa84101e40 0x7ffa84102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:15:29.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.606+0000 7ffa837fe700 1 --2- 172.21.15.134:0/2947864745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa841027e0 0x7ffa841031e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400c890 tx=0x7ffa740044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:29.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.606+0000 7ffa80ff9700 1 -- 172.21.15.134:0/2947864745 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa7400a7d0 con 0x7ffa841027e0 2024-02-16T22:15:29.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.606+0000 7ffa8a30f700 1 -- 172.21.15.134:0/2947864745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa84119cc0 con 0x7ffa841027e0 2024-02-16T22:15:29.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.606+0000 7ffa80ff9700 1 -- 172.21.15.134:0/2947864745 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa7400ae00 con 0x7ffa841027e0 2024-02-16T22:15:29.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.606+0000 7ffa80ff9700 1 -- 172.21.15.134:0/2947864745 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa740113a0 con 0x7ffa841027e0 2024-02-16T22:15:29.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.606+0000 7ffa8a30f700 1 -- 172.21.15.134:0/2947864745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8411a1a0 con 0x7ffa841027e0 2024-02-16T22:15:29.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.607+0000 7ffa8a30f700 1 -- 172.21.15.134:0/2947864745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa840738b0 con 0x7ffa841027e0 2024-02-16T22:15:29.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.607+0000 7ffa80ff9700 1 -- 172.21.15.134:0/2947864745 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ffa74011630 con 0x7ffa841027e0 2024-02-16T22:15:29.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.608+0000 7ffa80ff9700 1 --2- 172.21.15.134:0/2947864745 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ffa6c0692a0 0x7ffa6c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:29.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.608+0000 7ffa80ff9700 1 -- 172.21.15.134:0/2947864745 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ffa74086f40 con 0x7ffa841027e0 2024-02-16T22:15:29.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.608+0000 7ffa83fff700 1 --2- 172.21.15.134:0/2947864745 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ffa6c0692a0 0x7ffa6c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:29.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.608+0000 7ffa83fff700 1 --2- 172.21.15.134:0/2947864745 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ffa6c0692a0 0x7ffa6c06b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa78004560 tx=0x7ffa78009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:29.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.612+0000 7ffa80ff9700 1 -- 172.21.15.134:0/2947864745 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ffa74053620 con 0x7ffa841027e0 2024-02-16T22:15:29.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:29 smithi173 ceph-mon[37280]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:29.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.846+0000 7ffa8a30f700 1 -- 172.21.15.134:0/2947864745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ffa84108f40 con 0x7ffa841027e0 2024-02-16T22:15:29.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.849+0000 7ffa80ff9700 1 -- 172.21.15.134:0/2947864745 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167180 (secure 0 0 0) 0x7ffa74056c40 con 0x7ffa841027e0 2024-02-16T22:15:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:15:29.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.852+0000 7ffa8a30f700 1 -- 172.21.15.134:0/2947864745 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ffa6c0692a0 msgr2=0x7ffa6c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:29.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.852+0000 7ffa8a30f700 1 --2- 172.21.15.134:0/2947864745 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ffa6c0692a0 0x7ffa6c06b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa78004560 tx=0x7ffa78009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:29.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.852+0000 7ffa8a30f700 1 -- 172.21.15.134:0/2947864745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa841027e0 msgr2=0x7ffa841031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:29.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.852+0000 7ffa8a30f700 1 --2- 172.21.15.134:0/2947864745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa841027e0 0x7ffa841031e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400c890 tx=0x7ffa740044c0 comp rx=0 tx=0).stop 2024-02-16T22:15:29.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.852+0000 7ffa8a30f700 1 -- 172.21.15.134:0/2947864745 shutdown_connections 2024-02-16T22:15:29.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.852+0000 7ffa8a30f700 1 --2- 172.21.15.134:0/2947864745 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ffa6c0692a0 0x7ffa6c06b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:29.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.852+0000 7ffa8a30f700 1 --2- 172.21.15.134:0/2947864745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa84101e40 0x7ffa84102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:29.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.852+0000 7ffa8a30f700 1 --2- 172.21.15.134:0/2947864745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa841027e0 0x7ffa841031e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:29.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.852+0000 7ffa8a30f700 1 -- 172.21.15.134:0/2947864745 >> 172.21.15.134:0/2947864745 conn(0x7ffa84071d90 msgr2=0x7ffa840656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:29.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.852+0000 7ffa8a30f700 1 -- 172.21.15.134:0/2947864745 shutdown_connections 2024-02-16T22:15:29.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:29.852+0000 7ffa8a30f700 1 -- 172.21.15.134:0/2947864745 wait complete. 2024-02-16T22:15:30.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:30 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2947864745' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-16T22:15:30.477 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":19,"active_gid":14214,"active_name":"smithi134.ordace","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2578294352},{"type":"v1","addr":"172.21.15.134:6801","nonce":2578294352}]},"active_addr":"172.21.15.134:6801/2578294352","active_change":"2024-02-16T22:11:42.853923+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14238,"name":"smithi173.kbofaa","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.134:8443/","prometheus":"http://172.21.15.134:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1660938940}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":2189745948}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1938438068}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":3934807828}]}]} 2024-02-16T22:15:30.481 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-16T22:15:30.481 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-16T22:15:30.481 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-16T22:15:30.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:30 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2947864745' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-16T22:15:30.739 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:32.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.331+0000 7f6bc6551700 1 -- 172.21.15.134:0/1311506317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc01038f0 msgr2=0x7f6bc00fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:32.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.331+0000 7f6bc6551700 1 --2- 172.21.15.134:0/1311506317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc01038f0 0x7f6bc00fcf60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4004940 tx=0x7f6bb4009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:32.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.332+0000 7f6bc6551700 1 -- 172.21.15.134:0/1311506317 shutdown_connections 2024-02-16T22:15:32.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.332+0000 7f6bc6551700 1 --2- 172.21.15.134:0/1311506317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc01038f0 0x7f6bc00fcf60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:32.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.332+0000 7f6bc6551700 1 --2- 172.21.15.134:0/1311506317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc0102f50 0x7f6bc0103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:32.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.332+0000 7f6bc6551700 1 -- 172.21.15.134:0/1311506317 >> 172.21.15.134:0/1311506317 conn(0x7f6bc00f8ae0 msgr2=0x7f6bc00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:32.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.332+0000 7f6bc6551700 1 -- 172.21.15.134:0/1311506317 shutdown_connections 2024-02-16T22:15:32.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.332+0000 7f6bc6551700 1 -- 172.21.15.134:0/1311506317 wait complete. 2024-02-16T22:15:32.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.332+0000 7f6bc6551700 1 Processor -- start 2024-02-16T22:15:32.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.332+0000 7f6bc6551700 1 -- start start 2024-02-16T22:15:32.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.332+0000 7f6bc6551700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc0102f50 0x7f6bc0113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:32.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.332+0000 7f6bc6551700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc01038f0 0x7f6bc0113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:32.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.332+0000 7f6bc6551700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0114620 con 0x7f6bc0102f50 2024-02-16T22:15:32.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.332+0000 7f6bc6551700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc010d950 con 0x7f6bc01038f0 2024-02-16T22:15:32.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.332+0000 7f6bbffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc0102f50 0x7f6bc0113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:32.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.333+0000 7f6bbffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc0102f50 0x7f6bc0113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49008/0 (socket says 172.21.15.134:49008) 2024-02-16T22:15:32.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.333+0000 7f6bbffff700 1 -- 172.21.15.134:0/4092991821 learned_addr learned my addr 172.21.15.134:0/4092991821 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:32.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.333+0000 7f6bbf7fe700 1 --2- 172.21.15.134:0/4092991821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc01038f0 0x7f6bc0113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:32.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.333+0000 7f6bbffff700 1 -- 172.21.15.134:0/4092991821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc01038f0 msgr2=0x7f6bc0113fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:32.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.333+0000 7f6bbffff700 1 --2- 172.21.15.134:0/4092991821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc01038f0 0x7f6bc0113fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:32.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.333+0000 7f6bbffff700 1 -- 172.21.15.134:0/4092991821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4005040 con 0x7f6bc0102f50 2024-02-16T22:15:32.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.333+0000 7f6bbf7fe700 1 --2- 172.21.15.134:0/4092991821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc01038f0 0x7f6bc0113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:15:32.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.333+0000 7f6bbffff700 1 --2- 172.21.15.134:0/4092991821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc0102f50 0x7f6bc0113a90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000c8c0 tx=0x7f6bb00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:32.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.333+0000 7f6bbcff9700 1 -- 172.21.15.134:0/4092991821 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb000a980 con 0x7f6bc0102f50 2024-02-16T22:15:32.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.333+0000 7f6bc6551700 1 -- 172.21.15.134:0/4092991821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc010dc30 con 0x7f6bc0102f50 2024-02-16T22:15:32.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.333+0000 7f6bbcff9700 1 -- 172.21.15.134:0/4092991821 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bb000ce60 con 0x7f6bc0102f50 2024-02-16T22:15:32.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.333+0000 7f6bbcff9700 1 -- 172.21.15.134:0/4092991821 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb00115e0 con 0x7f6bc0102f50 2024-02-16T22:15:32.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.333+0000 7f6bc6551700 1 -- 172.21.15.134:0/4092991821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc010e170 con 0x7f6bc0102f50 2024-02-16T22:15:32.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.334+0000 7f6bc6551700 1 -- 172.21.15.134:0/4092991821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc0105420 con 0x7f6bc0102f50 2024-02-16T22:15:32.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.335+0000 7f6bbcff9700 1 -- 172.21.15.134:0/4092991821 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f6bb000aae0 con 0x7f6bc0102f50 2024-02-16T22:15:32.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.335+0000 7f6bbcff9700 1 --2- 172.21.15.134:0/4092991821 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6ba80692a0 0x7f6ba806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:32.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.335+0000 7f6bbcff9700 1 -- 172.21.15.134:0/4092991821 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6bb0086f90 con 0x7f6bc0102f50 2024-02-16T22:15:32.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.335+0000 7f6bbf7fe700 1 --2- 172.21.15.134:0/4092991821 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6ba80692a0 0x7f6ba806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:32.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.335+0000 7f6bbf7fe700 1 --2- 172.21.15.134:0/4092991821 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6ba80692a0 0x7f6ba806b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6bc010f2c0 tx=0x7f6bb4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:32.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.339+0000 7f6bbcff9700 1 -- 172.21.15.134:0/4092991821 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6bb0057090 con 0x7f6bc0102f50 2024-02-16T22:15:32.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.526+0000 7f6bc6551700 1 -- 172.21.15.134:0/4092991821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bc004bed0 con 0x7f6bc0102f50 2024-02-16T22:15:32.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.527+0000 7f6bbcff9700 1 -- 172.21.15.134:0/4092991821 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11122 (secure 0 0 0) 0x7f6bb0056c20 con 0x7f6bc0102f50 2024-02-16T22:15:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:15:32.530 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":40,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","created":"2024-02-16T22:09:26.274039+0000","modified":"2024-02-16T22:15:16.447263+0000","last_up_change":"2024-02-16T22:15:15.443236+0000","last_in_change":"2024-02-16T22:14:56.818141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T22:14:01.182574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d8e715f3-43f6-439a-be3d-a3bbd70b412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6803","nonce":200373494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6805","nonce":200373494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6809","nonce":200373494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6807","nonce":200373494}]},"public_addr":"172.21.15.134:6803/200373494","cluster_addr":"172.21.15.134:6805/200373494","heartbeat_back_addr":"172.21.15.134:6809/200373494","heartbeat_front_addr":"172.21.15.134:6807/200373494","state":["exists","up"]},{"osd":1,"uuid":"c1fe573e-cb80-4ac7-9d3c-b7e296e86a81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6811","nonce":3091662869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6813","nonce":3091662869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6817","nonce":3091662869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6815","nonce":3091662869}]},"public_addr":"172.21.15.134:6811/3091662869","cluster_addr":"172.21.15.134:6813/3091662869","heartbeat_back_addr":"172.21.15.134:6817/3091662869","heartbeat_front_addr":"172.21.15.134:6815/3091662869","state":["exists","up"]},{"osd":2,"uuid":"036c6cf2-7373-46ff-85db-9e0898ad0677","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6819","nonce":203470515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6821","nonce":203470515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6825","nonce":203470515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6823","nonce":203470515}]},"public_addr":"172.21.15.134:6819/203470515","cluster_addr":"172.21.15.134:6821/203470515","heartbeat_back_addr":"172.21.15.134:6825/203470515","heartbeat_front_addr":"172.21.15.134:6823/203470515","state":["exists","up"]},{"osd":3,"uuid":"6a00fd47-f787-4e21-9619-9e9341420b4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6801","nonce":1747350493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6803","nonce":1747350493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6807","nonce":1747350493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6805","nonce":1747350493}]},"public_addr":"172.21.15.173:6801/1747350493","cluster_addr":"172.21.15.173:6803/1747350493","heartbeat_back_addr":"172.21.15.173:6807/1747350493","heartbeat_front_addr":"172.21.15.173:6805/1747350493","state":["exists","up"]},{"osd":4,"uuid":"5a314e0e-0951-4462-bb9a-f3614ded4c18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6809","nonce":1479174093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6811","nonce":1479174093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6815","nonce":1479174093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6813","nonce":1479174093}]},"public_addr":"172.21.15.173:6809/1479174093","cluster_addr":"172.21.15.173:6811/1479174093","heartbeat_back_addr":"172.21.15.173:6815/1479174093","heartbeat_front_addr":"172.21.15.173:6813/1479174093","state":["exists","up"]},{"osd":5,"uuid":"9d9ce9a3-e735-4265-890c-af2aada1122d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6817","nonce":2727105831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6819","nonce":2727105831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6823","nonce":2727105831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6821","nonce":2727105831}]},"public_addr":"172.21.15.173:6817/2727105831","cluster_addr":"172.21.15.173:6819/2727105831","heartbeat_back_addr":"172.21.15.173:6823/2727105831","heartbeat_front_addr":"172.21.15.173:6821/2727105831","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:01.314144+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:30.212232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:58.392610+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:14:22.854647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:14:48.600782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:15:13.932090+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6801/2987045407":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/3010290966":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/994312604":"2024-02-17T22:10:30.766785+0000","172.21.15.134:6801/3459537666":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/1667200782":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6800/3459537666":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/3172564602":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/920183098":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/3516783507":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6800/2987045407":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6800/3520115315":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/3313361224":"2024-02-17T22:09:59.839885+0000","172.21.15.134:6801/3520115315":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/2419255497":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/3099284737":"2024-02-17T22:10:30.766785+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T22:15:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.529+0000 7f6bc6551700 1 -- 172.21.15.134:0/4092991821 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6ba80692a0 msgr2=0x7f6ba806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.529+0000 7f6bc6551700 1 --2- 172.21.15.134:0/4092991821 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6ba80692a0 0x7f6ba806b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6bc010f2c0 tx=0x7f6bb4009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.529+0000 7f6bc6551700 1 -- 172.21.15.134:0/4092991821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc0102f50 msgr2=0x7f6bc0113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.529+0000 7f6bc6551700 1 --2- 172.21.15.134:0/4092991821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc0102f50 0x7f6bc0113a90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000c8c0 tx=0x7f6bb00044c0 comp rx=0 tx=0).stop 2024-02-16T22:15:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.529+0000 7f6bc6551700 1 -- 172.21.15.134:0/4092991821 shutdown_connections 2024-02-16T22:15:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.529+0000 7f6bc6551700 1 --2- 172.21.15.134:0/4092991821 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6ba80692a0 0x7f6ba806b750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.529+0000 7f6bc6551700 1 --2- 172.21.15.134:0/4092991821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc0102f50 0x7f6bc0113a90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.529+0000 7f6bc6551700 1 --2- 172.21.15.134:0/4092991821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc01038f0 0x7f6bc0113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.529+0000 7f6bc6551700 1 -- 172.21.15.134:0/4092991821 >> 172.21.15.134:0/4092991821 conn(0x7f6bc00f8ae0 msgr2=0x7f6bc00fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.529+0000 7f6bc6551700 1 -- 172.21.15.134:0/4092991821 shutdown_connections 2024-02-16T22:15:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:32.529+0000 7f6bc6551700 1 -- 172.21.15.134:0/4092991821 wait complete. 2024-02-16T22:15:32.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:32 smithi134 ceph-mon[28869]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:32 smithi173 ceph-mon[37280]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:33.156 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-16T22:15:33.156 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-16T22:15:33.409 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:33.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:33 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/4092991821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-16T22:15:33.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:33 smithi134 ceph-mon[28869]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:33.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:33 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/4092991821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-16T22:15:33.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:33 smithi173 ceph-mon[37280]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.144+0000 7f1197c8e700 1 -- 172.21.15.134:0/2576928785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11900fb7c0 msgr2=0x7f11900fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.144+0000 7f1197c8e700 1 --2- 172.21.15.134:0/2576928785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11900fb7c0 0x7f11900fbb90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f118c004940 tx=0x7f118c009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.144+0000 7f1197c8e700 1 -- 172.21.15.134:0/2576928785 shutdown_connections 2024-02-16T22:15:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.144+0000 7f1197c8e700 1 --2- 172.21.15.134:0/2576928785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11900fc0d0 0x7f119010d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.144+0000 7f1197c8e700 1 --2- 172.21.15.134:0/2576928785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11900fb7c0 0x7f11900fbb90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.145+0000 7f1197c8e700 1 -- 172.21.15.134:0/2576928785 >> 172.21.15.134:0/2576928785 conn(0x7f1190071560 msgr2=0x7f1190071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.145+0000 7f1197c8e700 1 -- 172.21.15.134:0/2576928785 shutdown_connections 2024-02-16T22:15:35.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.145+0000 7f1197c8e700 1 -- 172.21.15.134:0/2576928785 wait complete. 2024-02-16T22:15:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.145+0000 7f1197c8e700 1 Processor -- start 2024-02-16T22:15:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.145+0000 7f1197c8e700 1 -- start start 2024-02-16T22:15:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.145+0000 7f1197c8e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11900fb7c0 0x7f119011a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f1197c8e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11900fc0d0 0x7f119011a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f1197c8e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119011ac50 con 0x7f11900fb7c0 2024-02-16T22:15:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f1197c8e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1190113f60 con 0x7f11900fc0d0 2024-02-16T22:15:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f1195a2a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11900fb7c0 0x7f119011a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f1195a2a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11900fb7c0 0x7f119011a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49034/0 (socket says 172.21.15.134:49034) 2024-02-16T22:15:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f1195a2a700 1 -- 172.21.15.134:0/660409825 learned_addr learned my addr 172.21.15.134:0/660409825 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f1195229700 1 --2- 172.21.15.134:0/660409825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11900fc0d0 0x7f119011a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:35.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f1195a2a700 1 -- 172.21.15.134:0/660409825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11900fc0d0 msgr2=0x7f119011a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:35.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f1195a2a700 1 --2- 172.21.15.134:0/660409825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11900fc0d0 0x7f119011a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:35.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f1195a2a700 1 -- 172.21.15.134:0/660409825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c005040 con 0x7f11900fb7c0 2024-02-16T22:15:35.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f1195a2a700 1 --2- 172.21.15.134:0/660409825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11900fb7c0 0x7f119011a0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f118c00b3b0 tx=0x7f118c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:35.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f11867fc700 1 -- 172.21.15.134:0/660409825 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f118c00e040 con 0x7f11900fb7c0 2024-02-16T22:15:35.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f11867fc700 1 -- 172.21.15.134:0/660409825 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f118c00bcc0 con 0x7f11900fb7c0 2024-02-16T22:15:35.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f1197c8e700 1 -- 172.21.15.134:0/660409825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11901141e0 con 0x7f11900fb7c0 2024-02-16T22:15:35.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f11867fc700 1 -- 172.21.15.134:0/660409825 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f118c013660 con 0x7f11900fb7c0 2024-02-16T22:15:35.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.146+0000 7f1197c8e700 1 -- 172.21.15.134:0/660409825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1190114720 con 0x7f11900fb7c0 2024-02-16T22:15:35.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.147+0000 7f1197c8e700 1 -- 172.21.15.134:0/660409825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11900fe0e0 con 0x7f11900fb7c0 2024-02-16T22:15:35.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.148+0000 7f11867fc700 1 -- 172.21.15.134:0/660409825 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f118c01c430 con 0x7f11900fb7c0 2024-02-16T22:15:35.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.148+0000 7f11867fc700 1 --2- 172.21.15.134:0/660409825 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f117c0692a0 0x7f117c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:35.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.148+0000 7f11867fc700 1 -- 172.21.15.134:0/660409825 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f118c087a80 con 0x7f11900fb7c0 2024-02-16T22:15:35.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.148+0000 7f1195229700 1 --2- 172.21.15.134:0/660409825 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f117c0692a0 0x7f117c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:35.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.148+0000 7f1195229700 1 --2- 172.21.15.134:0/660409825 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f117c0692a0 0x7f117c06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1180007fd0 tx=0x7f1180009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:35.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.152+0000 7f11867fc700 1 -- 172.21.15.134:0/660409825 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f118c057cd0 con 0x7f11900fb7c0 2024-02-16T22:15:35.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.335+0000 7f1197c8e700 1 -- 172.21.15.134:0/660409825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f119004bed0 con 0x7f11900fb7c0 2024-02-16T22:15:35.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.336+0000 7f11867fc700 1 -- 172.21.15.134:0/660409825 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11122 (secure 0 0 0) 0x7f118c057860 con 0x7f11900fb7c0 2024-02-16T22:15:35.338 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:15:35.338 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":40,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","created":"2024-02-16T22:09:26.274039+0000","modified":"2024-02-16T22:15:16.447263+0000","last_up_change":"2024-02-16T22:15:15.443236+0000","last_in_change":"2024-02-16T22:14:56.818141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T22:14:01.182574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d8e715f3-43f6-439a-be3d-a3bbd70b412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6803","nonce":200373494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6805","nonce":200373494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6809","nonce":200373494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6807","nonce":200373494}]},"public_addr":"172.21.15.134:6803/200373494","cluster_addr":"172.21.15.134:6805/200373494","heartbeat_back_addr":"172.21.15.134:6809/200373494","heartbeat_front_addr":"172.21.15.134:6807/200373494","state":["exists","up"]},{"osd":1,"uuid":"c1fe573e-cb80-4ac7-9d3c-b7e296e86a81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6811","nonce":3091662869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6813","nonce":3091662869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6817","nonce":3091662869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6815","nonce":3091662869}]},"public_addr":"172.21.15.134:6811/3091662869","cluster_addr":"172.21.15.134:6813/3091662869","heartbeat_back_addr":"172.21.15.134:6817/3091662869","heartbeat_front_addr":"172.21.15.134:6815/3091662869","state":["exists","up"]},{"osd":2,"uuid":"036c6cf2-7373-46ff-85db-9e0898ad0677","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6819","nonce":203470515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6821","nonce":203470515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6825","nonce":203470515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6823","nonce":203470515}]},"public_addr":"172.21.15.134:6819/203470515","cluster_addr":"172.21.15.134:6821/203470515","heartbeat_back_addr":"172.21.15.134:6825/203470515","heartbeat_front_addr":"172.21.15.134:6823/203470515","state":["exists","up"]},{"osd":3,"uuid":"6a00fd47-f787-4e21-9619-9e9341420b4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6801","nonce":1747350493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6803","nonce":1747350493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6807","nonce":1747350493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6805","nonce":1747350493}]},"public_addr":"172.21.15.173:6801/1747350493","cluster_addr":"172.21.15.173:6803/1747350493","heartbeat_back_addr":"172.21.15.173:6807/1747350493","heartbeat_front_addr":"172.21.15.173:6805/1747350493","state":["exists","up"]},{"osd":4,"uuid":"5a314e0e-0951-4462-bb9a-f3614ded4c18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6809","nonce":1479174093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6811","nonce":1479174093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6815","nonce":1479174093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6813","nonce":1479174093}]},"public_addr":"172.21.15.173:6809/1479174093","cluster_addr":"172.21.15.173:6811/1479174093","heartbeat_back_addr":"172.21.15.173:6815/1479174093","heartbeat_front_addr":"172.21.15.173:6813/1479174093","state":["exists","up"]},{"osd":5,"uuid":"9d9ce9a3-e735-4265-890c-af2aada1122d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6817","nonce":2727105831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6819","nonce":2727105831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6823","nonce":2727105831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6821","nonce":2727105831}]},"public_addr":"172.21.15.173:6817/2727105831","cluster_addr":"172.21.15.173:6819/2727105831","heartbeat_back_addr":"172.21.15.173:6823/2727105831","heartbeat_front_addr":"172.21.15.173:6821/2727105831","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:01.314144+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:30.212232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:58.392610+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:14:22.854647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:14:48.600782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:15:13.932090+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6801/2987045407":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/3010290966":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/994312604":"2024-02-17T22:10:30.766785+0000","172.21.15.134:6801/3459537666":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/1667200782":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6800/3459537666":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/3172564602":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/920183098":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/3516783507":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6800/2987045407":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6800/3520115315":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/3313361224":"2024-02-17T22:09:59.839885+0000","172.21.15.134:6801/3520115315":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/2419255497":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/3099284737":"2024-02-17T22:10:30.766785+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T22:15:35.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.338+0000 7f1197c8e700 1 -- 172.21.15.134:0/660409825 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f117c0692a0 msgr2=0x7f117c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:35.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.338+0000 7f1197c8e700 1 --2- 172.21.15.134:0/660409825 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f117c0692a0 0x7f117c06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1180007fd0 tx=0x7f1180009040 comp rx=0 tx=0).stop 2024-02-16T22:15:35.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.338+0000 7f1197c8e700 1 -- 172.21.15.134:0/660409825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11900fb7c0 msgr2=0x7f119011a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:35.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.338+0000 7f1197c8e700 1 --2- 172.21.15.134:0/660409825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11900fb7c0 0x7f119011a0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f118c00b3b0 tx=0x7f118c009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:35.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.338+0000 7f1197c8e700 1 -- 172.21.15.134:0/660409825 shutdown_connections 2024-02-16T22:15:35.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.338+0000 7f1197c8e700 1 --2- 172.21.15.134:0/660409825 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f117c0692a0 0x7f117c06b750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:35.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.338+0000 7f1197c8e700 1 --2- 172.21.15.134:0/660409825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11900fb7c0 0x7f119011a0c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:35.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.338+0000 7f1197c8e700 1 --2- 172.21.15.134:0/660409825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11900fc0d0 0x7f119011a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:35.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.338+0000 7f1197c8e700 1 -- 172.21.15.134:0/660409825 >> 172.21.15.134:0/660409825 conn(0x7f1190071560 msgr2=0x7f11901014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:35.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.338+0000 7f1197c8e700 1 -- 172.21.15.134:0/660409825 shutdown_connections 2024-02-16T22:15:35.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:35.338+0000 7f1197c8e700 1 -- 172.21.15.134:0/660409825 wait complete. 2024-02-16T22:15:35.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-16T22:15:35.955 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-16T22:15:35.955 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-16T22:15:35.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-16T22:15:35.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-16T22:15:35.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-16T22:15:36.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:35 smithi134 ceph-mon[28869]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:36.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:35 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/660409825' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-16T22:15:36.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:35 smithi173 ceph-mon[37280]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:36.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:35 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/660409825' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-16T22:15:36.269 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:36.270 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:37.828 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:37 smithi134 ceph-mon[28869]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:37.980 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:37 smithi173 ceph-mon[37280]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:38.128 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:38.128 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:38.129 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:38.181 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:40.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:39 smithi134 ceph-mon[28869]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:40.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:39 smithi173 ceph-mon[37280]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:42.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.887+0000 7f50987cf700 1 -- 172.21.15.134:0/3747808680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5090102f50 msgr2=0x7f5090103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.887+0000 7f50987cf700 1 --2- 172.21.15.134:0/3747808680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5090102f50 0x7f5090103320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f508c004940 tx=0x7f508c009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.887+0000 7f50987cf700 1 -- 172.21.15.134:0/3747808680 shutdown_connections 2024-02-16T22:15:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.887+0000 7f50987cf700 1 --2- 172.21.15.134:0/3747808680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50901038f0 0x7f50900fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.887+0000 7f50987cf700 1 --2- 172.21.15.134:0/3747808680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5090102f50 0x7f5090103320 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.887+0000 7f50987cf700 1 -- 172.21.15.134:0/3747808680 >> 172.21.15.134:0/3747808680 conn(0x7f50900f8ae0 msgr2=0x7f50900faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.887+0000 7f50987cf700 1 -- 172.21.15.134:0/3747808680 shutdown_connections 2024-02-16T22:15:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.887+0000 7f50987cf700 1 -- 172.21.15.134:0/3747808680 wait complete. 2024-02-16T22:15:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.888+0000 7f50987cf700 1 Processor -- start 2024-02-16T22:15:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.888+0000 7f50987cf700 1 -- start start 2024-02-16T22:15:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.888+0000 7f50987cf700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5090102f50 0x7f5090113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.888+0000 7f50987cf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50901038f0 0x7f5090113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:42.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.888+0000 7f50987cf700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50901145f0 con 0x7f50901038f0 2024-02-16T22:15:42.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.888+0000 7f50987cf700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509010d920 con 0x7f5090102f50 2024-02-16T22:15:42.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.888+0000 7f5095d6a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50901038f0 0x7f5090113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:42.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.888+0000 7f5095d6a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50901038f0 0x7f5090113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49054/0 (socket says 172.21.15.134:49054) 2024-02-16T22:15:42.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.888+0000 7f5095d6a700 1 -- 172.21.15.134:0/522280886 learned_addr learned my addr 172.21.15.134:0/522280886 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:42.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.888+0000 7f509656b700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5090102f50 0x7f5090113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:42.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.889+0000 7f5095d6a700 1 -- 172.21.15.134:0/522280886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5090102f50 msgr2=0x7f5090113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:42.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.889+0000 7f5095d6a700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5090102f50 0x7f5090113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.889+0000 7f5095d6a700 1 -- 172.21.15.134:0/522280886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c005040 con 0x7f50901038f0 2024-02-16T22:15:42.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.889+0000 7f5095d6a700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50901038f0 0x7f5090113fa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f508000c890 tx=0x7f50800044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:42.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.889+0000 7f5086ffd700 1 -- 172.21.15.134:0/522280886 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f508000a700 con 0x7f50901038f0 2024-02-16T22:15:42.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.889+0000 7f50987cf700 1 -- 172.21.15.134:0/522280886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509010dc00 con 0x7f50901038f0 2024-02-16T22:15:42.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.889+0000 7f5086ffd700 1 -- 172.21.15.134:0/522280886 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f508000ad30 con 0x7f50901038f0 2024-02-16T22:15:42.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.889+0000 7f5086ffd700 1 -- 172.21.15.134:0/522280886 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50800113a0 con 0x7f50901038f0 2024-02-16T22:15:42.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.889+0000 7f50987cf700 1 -- 172.21.15.134:0/522280886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509010e140 con 0x7f50901038f0 2024-02-16T22:15:42.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.890+0000 7f50987cf700 1 -- 172.21.15.134:0/522280886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f509010e6d0 con 0x7f50901038f0 2024-02-16T22:15:42.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.890+0000 7f5086ffd700 1 -- 172.21.15.134:0/522280886 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f5080012400 con 0x7f50901038f0 2024-02-16T22:15:42.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.891+0000 7f5086ffd700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f507c0692a0 0x7f507c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:42.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.891+0000 7f509656b700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f507c0692a0 0x7f507c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:42.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.891+0000 7f5086ffd700 1 -- 172.21.15.134:0/522280886 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5080086e00 con 0x7f50901038f0 2024-02-16T22:15:42.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.891+0000 7f5086ffd700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515] conn(0x7f507c06ef70 0x7f507c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:42.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.891+0000 7f5086ffd700 1 -- 172.21.15.134:0/522280886 --> [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f507c071a30 con 0x7f507c06ef70 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.891+0000 7f5086ffd700 1 -- 172.21.15.134:0/522280886 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5080089410 con 0x7f50901038f0 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.891+0000 7f5096d6c700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515] conn(0x7f507c06ef70 0x7f507c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.891+0000 7f509656b700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f507c0692a0 0x7f507c06b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f508c004f90 tx=0x7f508c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.891+0000 7f5096d6c700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515] conn(0x7f507c06ef70 0x7f507c071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.892+0000 7f5086ffd700 1 -- 172.21.15.134:0/522280886 <== osd.2 v2:172.21.15.134:6818/203470515 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f507c071a30 con 0x7f507c06ef70 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.907+0000 7f50987cf700 1 -- 172.21.15.134:0/522280886 --> [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f509005e610 con 0x7f507c06ef70 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.907+0000 7f5086ffd700 1 -- 172.21.15.134:0/522280886 <== osd.2 v2:172.21.15.134:6818/203470515 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f509005e610 con 0x7f507c06ef70 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.908+0000 7f50987cf700 1 -- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515] conn(0x7f507c06ef70 msgr2=0x7f507c071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.908+0000 7f50987cf700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515] conn(0x7f507c06ef70 0x7f507c071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.908+0000 7f50987cf700 1 -- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f507c0692a0 msgr2=0x7f507c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.908+0000 7f50987cf700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f507c0692a0 0x7f507c06b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f508c004f90 tx=0x7f508c009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.908+0000 7f50987cf700 1 -- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50901038f0 msgr2=0x7f5090113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.908+0000 7f50987cf700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50901038f0 0x7f5090113fa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f508000c890 tx=0x7f50800044c0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.908+0000 7f50987cf700 1 -- 172.21.15.134:0/522280886 shutdown_connections 2024-02-16T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.908+0000 7f50987cf700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:6818/203470515,v1:172.21.15.134:6819/203470515] conn(0x7f507c06ef70 0x7f507c071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.908+0000 7f50987cf700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f507c0692a0 0x7f507c06b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.908+0000 7f50987cf700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5090102f50 0x7f5090113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.908+0000 7f50987cf700 1 --2- 172.21.15.134:0/522280886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50901038f0 0x7f5090113fa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.908+0000 7f50987cf700 1 -- 172.21.15.134:0/522280886 >> 172.21.15.134:0/522280886 conn(0x7f50900f8ae0 msgr2=0x7f50900fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:42.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.908+0000 7f50987cf700 1 -- 172.21.15.134:0/522280886 shutdown_connections 2024-02-16T22:15:42.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:40.908+0000 7f50987cf700 1 -- 172.21.15.134:0/522280886 wait complete. 2024-02-16T22:15:42.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:41 smithi134 ceph-mon[28869]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:42.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:41 smithi173 ceph-mon[37280]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:42.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.505+0000 7fcdc22bb700 1 -- 172.21.15.134:0/731509229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdbc1027e0 msgr2=0x7fcdbc0fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:42.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.505+0000 7fcdc22bb700 1 --2- 172.21.15.134:0/731509229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdbc1027e0 0x7fcdbc0fbea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcdac004940 tx=0x7fcdac009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:42.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.505+0000 7fcdc22bb700 1 -- 172.21.15.134:0/731509229 shutdown_connections 2024-02-16T22:15:42.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.505+0000 7fcdc22bb700 1 --2- 172.21.15.134:0/731509229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdbc1027e0 0x7fcdbc0fbea0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.505+0000 7fcdc22bb700 1 --2- 172.21.15.134:0/731509229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdbc101e40 0x7fcdbc102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.505+0000 7fcdc22bb700 1 -- 172.21.15.134:0/731509229 >> 172.21.15.134:0/731509229 conn(0x7fcdbc071d90 msgr2=0x7fcdbc072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:42.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.505+0000 7fcdc22bb700 1 -- 172.21.15.134:0/731509229 shutdown_connections 2024-02-16T22:15:42.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.505+0000 7fcdc22bb700 1 -- 172.21.15.134:0/731509229 wait complete. 2024-02-16T22:15:42.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.506+0000 7fcdc22bb700 1 Processor -- start 2024-02-16T22:15:42.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.506+0000 7fcdc22bb700 1 -- start start 2024-02-16T22:15:42.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.506+0000 7fcdc22bb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdbc101e40 0x7fcdbc113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:42.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.506+0000 7fcdc22bb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdbc1027e0 0x7fcdbc113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:42.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.506+0000 7fcdc22bb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc1146d0 con 0x7fcdbc101e40 2024-02-16T22:15:42.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.506+0000 7fcdc22bb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc10d970 con 0x7fcdbc1027e0 2024-02-16T22:15:42.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.506+0000 7fcdbbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdbc101e40 0x7fcdbc113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:42.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.506+0000 7fcdbbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdbc101e40 0x7fcdbc113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50396/0 (socket says 172.21.15.134:50396) 2024-02-16T22:15:42.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.506+0000 7fcdbbfff700 1 -- 172.21.15.134:0/2386138067 learned_addr learned my addr 172.21.15.134:0/2386138067 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:42.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.506+0000 7fcdbb7fe700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdbc1027e0 0x7fcdbc113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:42.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.506+0000 7fcdbbfff700 1 -- 172.21.15.134:0/2386138067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdbc1027e0 msgr2=0x7fcdbc113ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:42.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.506+0000 7fcdbbfff700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdbc1027e0 0x7fcdbc113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.506+0000 7fcdbbfff700 1 -- 172.21.15.134:0/2386138067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac005040 con 0x7fcdbc101e40 2024-02-16T22:15:42.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.507+0000 7fcdbbfff700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdbc101e40 0x7fcdbc113ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000b790 tx=0x7fcdb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:42.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.507+0000 7fcdb8ff9700 1 -- 172.21.15.134:0/2386138067 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdb000f770 con 0x7fcdbc101e40 2024-02-16T22:15:42.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.507+0000 7fcdb8ff9700 1 -- 172.21.15.134:0/2386138067 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcdb000fda0 con 0x7fcdbc101e40 2024-02-16T22:15:42.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.507+0000 7fcdc22bb700 1 -- 172.21.15.134:0/2386138067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdbc10dc50 con 0x7fcdbc101e40 2024-02-16T22:15:42.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.507+0000 7fcdb8ff9700 1 -- 172.21.15.134:0/2386138067 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdb000d310 con 0x7fcdbc101e40 2024-02-16T22:15:42.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.507+0000 7fcdc22bb700 1 -- 172.21.15.134:0/2386138067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdbc10e190 con 0x7fcdbc101e40 2024-02-16T22:15:42.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.508+0000 7fcdc22bb700 1 -- 172.21.15.134:0/2386138067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcdbc10e720 con 0x7fcdbc101e40 2024-02-16T22:15:42.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.508+0000 7fcdb8ff9700 1 -- 172.21.15.134:0/2386138067 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fcdb0010420 con 0x7fcdbc101e40 2024-02-16T22:15:42.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.509+0000 7fcdb8ff9700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fcda40692a0 0x7fcda406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:42.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.509+0000 7fcdbb7fe700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fcda40692a0 0x7fcda406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:42.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.509+0000 7fcdb8ff9700 1 -- 172.21.15.134:0/2386138067 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcdb0086e60 con 0x7fcdbc101e40 2024-02-16T22:15:42.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.509+0000 7fcdb8ff9700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.173:6800/1747350493,v1:172.21.15.173:6801/1747350493] conn(0x7fcda406ef70 0x7fcda4071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:42.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.509+0000 7fcdb8ff9700 1 -- 172.21.15.134:0/2386138067 --> [v2:172.21.15.173:6800/1747350493,v1:172.21.15.173:6801/1747350493] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcda4071a30 con 0x7fcda406ef70 2024-02-16T22:15:42.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.509+0000 7fcdb8ff9700 1 -- 172.21.15.134:0/2386138067 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdb008c460 con 0x7fcdbc101e40 2024-02-16T22:15:42.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.509+0000 7fcdbb7fe700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fcda40692a0 0x7fcda406b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00b3b0 tx=0x7fcdac009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:42.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.509+0000 7fcdc0858700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.173:6800/1747350493,v1:172.21.15.173:6801/1747350493] conn(0x7fcda406ef70 0x7fcda4071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:42.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.509+0000 7fcdc0858700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.173:6800/1747350493,v1:172.21.15.173:6801/1747350493] conn(0x7fcda406ef70 0x7fcda4071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:42.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.510+0000 7fcdb8ff9700 1 -- 172.21.15.134:0/2386138067 <== osd.3 v2:172.21.15.173:6800/1747350493 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcda4071a30 con 0x7fcda406ef70 2024-02-16T22:15:42.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.525+0000 7fcdc22bb700 1 -- 172.21.15.134:0/2386138067 --> [v2:172.21.15.173:6800/1747350493,v1:172.21.15.173:6801/1747350493] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcdbc0738b0 con 0x7fcda406ef70 2024-02-16T22:15:42.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.525+0000 7fcdb8ff9700 1 -- 172.21.15.134:0/2386138067 <== osd.3 v2:172.21.15.173:6800/1747350493 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fcdbc0738b0 con 0x7fcda406ef70 2024-02-16T22:15:42.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.526+0000 7fcdc22bb700 1 -- 172.21.15.134:0/2386138067 >> [v2:172.21.15.173:6800/1747350493,v1:172.21.15.173:6801/1747350493] conn(0x7fcda406ef70 msgr2=0x7fcda4071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:42.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.526+0000 7fcdc22bb700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.173:6800/1747350493,v1:172.21.15.173:6801/1747350493] conn(0x7fcda406ef70 0x7fcda4071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.526+0000 7fcdc22bb700 1 -- 172.21.15.134:0/2386138067 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fcda40692a0 msgr2=0x7fcda406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:42.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.526+0000 7fcdc22bb700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fcda40692a0 0x7fcda406b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00b3b0 tx=0x7fcdac009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:42.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.526+0000 7fcdc22bb700 1 -- 172.21.15.134:0/2386138067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdbc101e40 msgr2=0x7fcdbc113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:42.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.526+0000 7fcdc22bb700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdbc101e40 0x7fcdbc113ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000b790 tx=0x7fcdb0009250 comp rx=0 tx=0).stop 2024-02-16T22:15:42.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.526+0000 7fcdc22bb700 1 -- 172.21.15.134:0/2386138067 shutdown_connections 2024-02-16T22:15:42.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.526+0000 7fcdc22bb700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.173:6800/1747350493,v1:172.21.15.173:6801/1747350493] conn(0x7fcda406ef70 0x7fcda4071380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.526+0000 7fcdc22bb700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fcda40692a0 0x7fcda406b750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.526+0000 7fcdc22bb700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdbc101e40 0x7fcdbc113ab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.526+0000 7fcdc22bb700 1 --2- 172.21.15.134:0/2386138067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdbc1027e0 0x7fcdbc113ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:42.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.526+0000 7fcdc22bb700 1 -- 172.21.15.134:0/2386138067 >> 172.21.15.134:0/2386138067 conn(0x7fcdbc071d90 msgr2=0x7fcdbc0656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:42.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.526+0000 7fcdc22bb700 1 -- 172.21.15.134:0/2386138067 shutdown_connections 2024-02-16T22:15:42.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:42.526+0000 7fcdc22bb700 1 -- 172.21.15.134:0/2386138067 wait complete. 2024-02-16T22:15:43.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:42 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:15:43.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:42 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:15:44.176 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:43 smithi134 ceph-mon[28869]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:44.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:43 smithi173 ceph-mon[37280]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:44.887 INFO:teuthology.orchestra.run.smithi134.stdout:111669149713 2024-02-16T22:15:44.887 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-16T22:15:45.446 INFO:teuthology.orchestra.run.smithi134.stdout:81604378647 2024-02-16T22:15:45.446 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-16T22:15:45.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.635+0000 7fb91671c700 1 -- 172.21.15.134:0/1123563151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb910103140 msgr2=0x7fb910103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:45.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.635+0000 7fb91671c700 1 --2- 172.21.15.134:0/1123563151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb910103140 0x7fb910103510 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb900004940 tx=0x7fb900009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:45.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.635+0000 7fb91671c700 1 -- 172.21.15.134:0/1123563151 shutdown_connections 2024-02-16T22:15:45.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.635+0000 7fb91671c700 1 --2- 172.21.15.134:0/1123563151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9100fb570 0x7fb9100fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:45.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.635+0000 7fb91671c700 1 --2- 172.21.15.134:0/1123563151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb910103140 0x7fb910103510 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:45.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.635+0000 7fb91671c700 1 -- 172.21.15.134:0/1123563151 >> 172.21.15.134:0/1123563151 conn(0x7fb910071560 msgr2=0x7fb910071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:45.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.635+0000 7fb91671c700 1 -- 172.21.15.134:0/1123563151 shutdown_connections 2024-02-16T22:15:45.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.635+0000 7fb91671c700 1 -- 172.21.15.134:0/1123563151 wait complete. 2024-02-16T22:15:45.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.636+0000 7fb91671c700 1 Processor -- start 2024-02-16T22:15:45.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.636+0000 7fb91671c700 1 -- start start 2024-02-16T22:15:45.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.636+0000 7fb91671c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9100fb570 0x7fb910115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:45.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.636+0000 7fb91671c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb910103140 0x7fb9101162e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:45.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.636+0000 7fb91671c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9101169c0 con 0x7fb910103140 2024-02-16T22:15:45.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.636+0000 7fb91671c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91010fc40 con 0x7fb9100fb570 2024-02-16T22:15:45.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.636+0000 7fb90f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb910103140 0x7fb9101162e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:45.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.636+0000 7fb90f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb910103140 0x7fb9101162e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50422/0 (socket says 172.21.15.134:50422) 2024-02-16T22:15:45.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.636+0000 7fb90f7fe700 1 -- 172.21.15.134:0/872228886 learned_addr learned my addr 172.21.15.134:0/872228886 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:45.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.636+0000 7fb90ffff700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9100fb570 0x7fb910115da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:45.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.637+0000 7fb90f7fe700 1 -- 172.21.15.134:0/872228886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9100fb570 msgr2=0x7fb910115da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:45.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.637+0000 7fb90f7fe700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9100fb570 0x7fb910115da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:45.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.637+0000 7fb90f7fe700 1 -- 172.21.15.134:0/872228886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb900005040 con 0x7fb910103140 2024-02-16T22:15:45.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.637+0000 7fb90f7fe700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb910103140 0x7fb9101162e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb90400b790 tx=0x7fb904009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:45.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.637+0000 7fb90cff9700 1 -- 172.21.15.134:0/872228886 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb90400f770 con 0x7fb910103140 2024-02-16T22:15:45.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.637+0000 7fb90cff9700 1 -- 172.21.15.134:0/872228886 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb90400fda0 con 0x7fb910103140 2024-02-16T22:15:45.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.638+0000 7fb90cff9700 1 -- 172.21.15.134:0/872228886 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb90400d310 con 0x7fb910103140 2024-02-16T22:15:45.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.638+0000 7fb91671c700 1 -- 172.21.15.134:0/872228886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91010fec0 con 0x7fb910103140 2024-02-16T22:15:45.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.638+0000 7fb91671c700 1 -- 172.21.15.134:0/872228886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb910110380 con 0x7fb910103140 2024-02-16T22:15:45.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.639+0000 7fb91671c700 1 -- 172.21.15.134:0/872228886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb910110890 con 0x7fb910103140 2024-02-16T22:15:45.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.640+0000 7fb90cff9700 1 -- 172.21.15.134:0/872228886 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb90400f8d0 con 0x7fb910103140 2024-02-16T22:15:45.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.640+0000 7fb90cff9700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb8f80690d0 0x7fb8f806b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:45.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.640+0000 7fb90cff9700 1 -- 172.21.15.134:0/872228886 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb904086ed0 con 0x7fb910103140 2024-02-16T22:15:45.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.640+0000 7fb90ffff700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb8f80690d0 0x7fb8f806b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:45.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.640+0000 7fb90cff9700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494] conn(0x7fb8f806ec30 0x7fb8f8071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:45.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.640+0000 7fb90cff9700 1 -- 172.21.15.134:0/872228886 --> [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8f80716f0 con 0x7fb8f806ec30 2024-02-16T22:15:45.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.640+0000 7fb90cff9700 1 -- 172.21.15.134:0/872228886 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9040871c0 con 0x7fb910103140 2024-02-16T22:15:45.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.640+0000 7fb914cb9700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494] conn(0x7fb8f806ec30 0x7fb8f8071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:45.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.641+0000 7fb90ffff700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb8f80690d0 0x7fb8f806b580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb90000b020 tx=0x7fb900009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:45.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.641+0000 7fb914cb9700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494] conn(0x7fb8f806ec30 0x7fb8f8071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:45.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.641+0000 7fb90cff9700 1 -- 172.21.15.134:0/872228886 <== osd.0 v2:172.21.15.134:6802/200373494 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb8f80716f0 con 0x7fb8f806ec30 2024-02-16T22:15:45.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.660+0000 7fb91671c700 1 -- 172.21.15.134:0/872228886 --> [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb910110890 con 0x7fb8f806ec30 2024-02-16T22:15:45.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.660+0000 7fb90cff9700 1 -- 172.21.15.134:0/872228886 <== osd.0 v2:172.21.15.134:6802/200373494 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb910110890 con 0x7fb8f806ec30 2024-02-16T22:15:45.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.661+0000 7fb91671c700 1 -- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494] conn(0x7fb8f806ec30 msgr2=0x7fb8f8071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:45.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.661+0000 7fb91671c700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494] conn(0x7fb8f806ec30 0x7fb8f8071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:45.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.661+0000 7fb91671c700 1 -- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb8f80690d0 msgr2=0x7fb8f806b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:45.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.661+0000 7fb91671c700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb8f80690d0 0x7fb8f806b580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb90000b020 tx=0x7fb900009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:45.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.661+0000 7fb91671c700 1 -- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb910103140 msgr2=0x7fb9101162e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:45.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.661+0000 7fb91671c700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb910103140 0x7fb9101162e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb90400b790 tx=0x7fb904009250 comp rx=0 tx=0).stop 2024-02-16T22:15:45.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.661+0000 7fb91671c700 1 -- 172.21.15.134:0/872228886 shutdown_connections 2024-02-16T22:15:45.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.661+0000 7fb91671c700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:6802/200373494,v1:172.21.15.134:6803/200373494] conn(0x7fb8f806ec30 0x7fb8f8071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:45.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.661+0000 7fb91671c700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb8f80690d0 0x7fb8f806b580 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:45.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.661+0000 7fb91671c700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9100fb570 0x7fb910115da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:45.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.661+0000 7fb91671c700 1 --2- 172.21.15.134:0/872228886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb910103140 0x7fb9101162e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:45.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.661+0000 7fb91671c700 1 -- 172.21.15.134:0/872228886 >> 172.21.15.134:0/872228886 conn(0x7fb910071560 msgr2=0x7fb9100f9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:45.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.661+0000 7fb91671c700 1 -- 172.21.15.134:0/872228886 shutdown_connections 2024-02-16T22:15:45.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:45.661+0000 7fb91671c700 1 -- 172.21.15.134:0/872228886 wait complete. 2024-02-16T22:15:46.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:45 smithi134 ceph-mon[28869]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:46.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:45 smithi173 ceph-mon[37280]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:46.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.742+0000 7fc76e735700 1 -- 172.21.15.134:0/3379490244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7680fdfe0 msgr2=0x7fc7680fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.742+0000 7fc76e735700 1 --2- 172.21.15.134:0/3379490244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7680fdfe0 0x7fc7680fe3b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc758004970 tx=0x7fc758009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.742+0000 7fc76e735700 1 -- 172.21.15.134:0/3379490244 shutdown_connections 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.742+0000 7fc76e735700 1 --2- 172.21.15.134:0/3379490244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7680fe8f0 0x7fc768107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.742+0000 7fc76e735700 1 --2- 172.21.15.134:0/3379490244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7680fdfe0 0x7fc7680fe3b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.742+0000 7fc76e735700 1 -- 172.21.15.134:0/3379490244 >> 172.21.15.134:0/3379490244 conn(0x7fc768071d90 msgr2=0x7fc768072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.742+0000 7fc76e735700 1 -- 172.21.15.134:0/3379490244 shutdown_connections 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.742+0000 7fc76e735700 1 -- 172.21.15.134:0/3379490244 wait complete. 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.743+0000 7fc76e735700 1 Processor -- start 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.743+0000 7fc76e735700 1 -- start start 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.743+0000 7fc76e735700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7680fdfe0 0x7fc768113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.743+0000 7fc76e735700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7680fe8f0 0x7fc768114010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.743+0000 7fc76e735700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7681146f0 con 0x7fc7680fdfe0 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.743+0000 7fc76e735700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76810d990 con 0x7fc7680fe8f0 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.743+0000 7fc767fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7680fdfe0 0x7fc768113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:46.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.743+0000 7fc767fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7680fdfe0 0x7fc768113ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50448/0 (socket says 172.21.15.134:50448) 2024-02-16T22:15:46.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.743+0000 7fc767fff700 1 -- 172.21.15.134:0/871396238 learned_addr learned my addr 172.21.15.134:0/871396238 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:46.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.743+0000 7fc7677fe700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7680fe8f0 0x7fc768114010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:46.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.743+0000 7fc767fff700 1 -- 172.21.15.134:0/871396238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7680fe8f0 msgr2=0x7fc768114010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:46.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.744+0000 7fc767fff700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7680fe8f0 0x7fc768114010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.744+0000 7fc767fff700 1 -- 172.21.15.134:0/871396238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc758005040 con 0x7fc7680fdfe0 2024-02-16T22:15:46.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.744+0000 7fc767fff700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7680fdfe0 0x7fc768113ad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc758009150 tx=0x7fc758009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:46.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.744+0000 7fc764ff9700 1 -- 172.21.15.134:0/871396238 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc75800e040 con 0x7fc7680fdfe0 2024-02-16T22:15:46.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.744+0000 7fc764ff9700 1 -- 172.21.15.134:0/871396238 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc758004290 con 0x7fc7680fdfe0 2024-02-16T22:15:46.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.744+0000 7fc76e735700 1 -- 172.21.15.134:0/871396238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76810dc10 con 0x7fc7680fdfe0 2024-02-16T22:15:46.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.744+0000 7fc764ff9700 1 -- 172.21.15.134:0/871396238 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc75801c630 con 0x7fc7680fdfe0 2024-02-16T22:15:46.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.744+0000 7fc76e735700 1 -- 172.21.15.134:0/871396238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76810e150 con 0x7fc7680fdfe0 2024-02-16T22:15:46.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.745+0000 7fc76e735700 1 -- 172.21.15.134:0/871396238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc76810e640 con 0x7fc7680fdfe0 2024-02-16T22:15:46.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.745+0000 7fc764ff9700 1 -- 172.21.15.134:0/871396238 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc758013980 con 0x7fc7680fdfe0 2024-02-16T22:15:46.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.746+0000 7fc764ff9700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc7500692b0 0x7fc75006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:46.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.746+0000 7fc764ff9700 1 -- 172.21.15.134:0/871396238 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc758088070 con 0x7fc7680fdfe0 2024-02-16T22:15:46.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.746+0000 7fc7677fe700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc7500692b0 0x7fc75006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:46.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.746+0000 7fc764ff9700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869] conn(0x7fc75006ef80 0x7fc750071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:46.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.746+0000 7fc764ff9700 1 -- 172.21.15.134:0/871396238 --> [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc750071a40 con 0x7fc75006ef80 2024-02-16T22:15:46.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.746+0000 7fc764ff9700 1 -- 172.21.15.134:0/871396238 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc75808a680 con 0x7fc7680fdfe0 2024-02-16T22:15:46.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.746+0000 7fc76ccd2700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869] conn(0x7fc75006ef80 0x7fc750071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:46.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.746+0000 7fc7677fe700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc7500692b0 0x7fc75006b760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc75c006fd0 tx=0x7fc75c008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:46.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.746+0000 7fc76ccd2700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869] conn(0x7fc75006ef80 0x7fc750071390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:46.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.747+0000 7fc764ff9700 1 -- 172.21.15.134:0/871396238 <== osd.1 v2:172.21.15.134:6810/3091662869 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc750071a40 con 0x7fc75006ef80 2024-02-16T22:15:46.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.761+0000 7fc76e735700 1 -- 172.21.15.134:0/871396238 --> [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc76810e800 con 0x7fc75006ef80 2024-02-16T22:15:46.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc764ff9700 1 -- 172.21.15.134:0/871396238 <== osd.1 v2:172.21.15.134:6810/3091662869 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc76810e800 con 0x7fc75006ef80 2024-02-16T22:15:46.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc76e735700 1 -- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869] conn(0x7fc75006ef80 msgr2=0x7fc750071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:46.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc76e735700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869] conn(0x7fc75006ef80 0x7fc750071390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc76e735700 1 -- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc7500692b0 msgr2=0x7fc75006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:46.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc76e735700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc7500692b0 0x7fc75006b760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc75c006fd0 tx=0x7fc75c008040 comp rx=0 tx=0).stop 2024-02-16T22:15:46.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc76e735700 1 -- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7680fdfe0 msgr2=0x7fc768113ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:46.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc76e735700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7680fdfe0 0x7fc768113ad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc758009150 tx=0x7fc758009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:46.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc76e735700 1 -- 172.21.15.134:0/871396238 shutdown_connections 2024-02-16T22:15:46.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc76e735700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:6810/3091662869,v1:172.21.15.134:6811/3091662869] conn(0x7fc75006ef80 0x7fc750071390 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc76e735700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc7500692b0 0x7fc75006b760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc76e735700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7680fdfe0 0x7fc768113ad0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc76e735700 1 --2- 172.21.15.134:0/871396238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7680fe8f0 0x7fc768114010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc76e735700 1 -- 172.21.15.134:0/871396238 >> 172.21.15.134:0/871396238 conn(0x7fc768071d90 msgr2=0x7fc768101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:46.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc76e735700 1 -- 172.21.15.134:0/871396238 shutdown_connections 2024-02-16T22:15:46.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.762+0000 7fc76e735700 1 -- 172.21.15.134:0/871396238 wait complete. 2024-02-16T22:15:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.936+0000 7fd13024b700 1 -- 172.21.15.134:0/2273988802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128103140 msgr2=0x7fd128103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.936+0000 7fd13024b700 1 --2- 172.21.15.134:0/2273988802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128103140 0x7fd128103510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd124004940 tx=0x7fd124009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.936+0000 7fd13024b700 1 -- 172.21.15.134:0/2273988802 shutdown_connections 2024-02-16T22:15:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.936+0000 7fd13024b700 1 --2- 172.21.15.134:0/2273988802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1280fb570 0x7fd1280fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.937+0000 7fd13024b700 1 --2- 172.21.15.134:0/2273988802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128103140 0x7fd128103510 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.937+0000 7fd13024b700 1 -- 172.21.15.134:0/2273988802 >> 172.21.15.134:0/2273988802 conn(0x7fd128071560 msgr2=0x7fd128071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.937+0000 7fd13024b700 1 -- 172.21.15.134:0/2273988802 shutdown_connections 2024-02-16T22:15:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.937+0000 7fd13024b700 1 -- 172.21.15.134:0/2273988802 wait complete. 2024-02-16T22:15:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.937+0000 7fd13024b700 1 Processor -- start 2024-02-16T22:15:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.937+0000 7fd13024b700 1 -- start start 2024-02-16T22:15:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.937+0000 7fd13024b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1280fb570 0x7fd128113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.937+0000 7fd13024b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128103140 0x7fd128113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.937+0000 7fd13024b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd128114630 con 0x7fd128103140 2024-02-16T22:15:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.937+0000 7fd13024b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12810d9d0 con 0x7fd1280fb570 2024-02-16T22:15:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.937+0000 7fd12d7e6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128103140 0x7fd128113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.937+0000 7fd12d7e6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128103140 0x7fd128113fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50466/0 (socket says 172.21.15.134:50466) 2024-02-16T22:15:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.937+0000 7fd12d7e6700 1 -- 172.21.15.134:0/750430775 learned_addr learned my addr 172.21.15.134:0/750430775 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.938+0000 7fd12dfe7700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1280fb570 0x7fd128113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.938+0000 7fd12d7e6700 1 -- 172.21.15.134:0/750430775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1280fb570 msgr2=0x7fd128113aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.938+0000 7fd12d7e6700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1280fb570 0x7fd128113aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.938+0000 7fd12d7e6700 1 -- 172.21.15.134:0/750430775 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd124005040 con 0x7fd128103140 2024-02-16T22:15:46.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.938+0000 7fd12d7e6700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128103140 0x7fd128113fe0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd11800c8c0 tx=0x7fd1180044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:46.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.938+0000 7fd11e7fc700 1 -- 172.21.15.134:0/750430775 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd11800a760 con 0x7fd128103140 2024-02-16T22:15:46.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.938+0000 7fd13024b700 1 -- 172.21.15.134:0/750430775 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12810dcb0 con 0x7fd128103140 2024-02-16T22:15:46.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.938+0000 7fd11e7fc700 1 -- 172.21.15.134:0/750430775 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd11800ad90 con 0x7fd128103140 2024-02-16T22:15:46.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.938+0000 7fd11e7fc700 1 -- 172.21.15.134:0/750430775 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1180113a0 con 0x7fd128103140 2024-02-16T22:15:46.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.938+0000 7fd13024b700 1 -- 172.21.15.134:0/750430775 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12810e1f0 con 0x7fd128103140 2024-02-16T22:15:46.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.939+0000 7fd13024b700 1 -- 172.21.15.134:0/750430775 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd12810e710 con 0x7fd128103140 2024-02-16T22:15:46.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.939+0000 7fd11e7fc700 1 -- 172.21.15.134:0/750430775 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd118012400 con 0x7fd128103140 2024-02-16T22:15:46.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.940+0000 7fd11e7fc700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd1140692a0 0x7fd11406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:46.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.940+0000 7fd11e7fc700 1 -- 172.21.15.134:0/750430775 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd118086e70 con 0x7fd128103140 2024-02-16T22:15:46.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.940+0000 7fd12dfe7700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd1140692a0 0x7fd11406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:46.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.940+0000 7fd11e7fc700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.173:6808/1479174093,v1:172.21.15.173:6809/1479174093] conn(0x7fd11406ef70 0x7fd114071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:46.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.940+0000 7fd11e7fc700 1 -- 172.21.15.134:0/750430775 --> [v2:172.21.15.173:6808/1479174093,v1:172.21.15.173:6809/1479174093] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd114071a30 con 0x7fd11406ef70 2024-02-16T22:15:46.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.940+0000 7fd11e7fc700 1 -- 172.21.15.134:0/750430775 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd11808c470 con 0x7fd128103140 2024-02-16T22:15:46.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.940+0000 7fd12dfe7700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd1140692a0 0x7fd11406b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd124004f90 tx=0x7fd124009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:46.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.940+0000 7fd12e7e8700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.173:6808/1479174093,v1:172.21.15.173:6809/1479174093] conn(0x7fd11406ef70 0x7fd114071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:46.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.941+0000 7fd12e7e8700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.173:6808/1479174093,v1:172.21.15.173:6809/1479174093] conn(0x7fd11406ef70 0x7fd114071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:46.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.942+0000 7fd11e7fc700 1 -- 172.21.15.134:0/750430775 <== osd.4 v2:172.21.15.173:6808/1479174093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd114071a30 con 0x7fd11406ef70 2024-02-16T22:15:46.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.956+0000 7fd13024b700 1 -- 172.21.15.134:0/750430775 --> [v2:172.21.15.173:6808/1479174093,v1:172.21.15.173:6809/1479174093] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd12805e610 con 0x7fd11406ef70 2024-02-16T22:15:46.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.957+0000 7fd11e7fc700 1 -- 172.21.15.134:0/750430775 <== osd.4 v2:172.21.15.173:6808/1479174093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd12805e610 con 0x7fd11406ef70 2024-02-16T22:15:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.957+0000 7fd13024b700 1 -- 172.21.15.134:0/750430775 >> [v2:172.21.15.173:6808/1479174093,v1:172.21.15.173:6809/1479174093] conn(0x7fd11406ef70 msgr2=0x7fd114071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.957+0000 7fd13024b700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.173:6808/1479174093,v1:172.21.15.173:6809/1479174093] conn(0x7fd11406ef70 0x7fd114071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.957+0000 7fd13024b700 1 -- 172.21.15.134:0/750430775 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd1140692a0 msgr2=0x7fd11406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.957+0000 7fd13024b700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd1140692a0 0x7fd11406b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd124004f90 tx=0x7fd124009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.957+0000 7fd13024b700 1 -- 172.21.15.134:0/750430775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128103140 msgr2=0x7fd128113fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.957+0000 7fd13024b700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128103140 0x7fd128113fe0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd11800c8c0 tx=0x7fd1180044c0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.958+0000 7fd13024b700 1 -- 172.21.15.134:0/750430775 shutdown_connections 2024-02-16T22:15:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.958+0000 7fd13024b700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.173:6808/1479174093,v1:172.21.15.173:6809/1479174093] conn(0x7fd11406ef70 0x7fd114071380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.958+0000 7fd13024b700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd1140692a0 0x7fd11406b750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.958+0000 7fd13024b700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1280fb570 0x7fd128113aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.958+0000 7fd13024b700 1 --2- 172.21.15.134:0/750430775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128103140 0x7fd128113fe0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.958+0000 7fd13024b700 1 -- 172.21.15.134:0/750430775 >> 172.21.15.134:0/750430775 conn(0x7fd128071560 msgr2=0x7fd1280fa5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.958+0000 7fd13024b700 1 -- 172.21.15.134:0/750430775 shutdown_connections 2024-02-16T22:15:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:46.958+0000 7fd13024b700 1 -- 172.21.15.134:0/750430775 wait complete. 2024-02-16T22:15:47.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:47 smithi134 ceph-mon[28869]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:47.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:47 smithi173 ceph-mon[37280]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:47.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.793+0000 7f7d3d363700 1 -- 172.21.15.134:0/3564803298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d380fb570 msgr2=0x7f7d380fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:47.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.793+0000 7f7d3d363700 1 --2- 172.21.15.134:0/3564803298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d380fb570 0x7f7d380fb9c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c004940 tx=0x7f7d2c009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:47.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.793+0000 7f7d3d363700 1 -- 172.21.15.134:0/3564803298 shutdown_connections 2024-02-16T22:15:47.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.793+0000 7f7d3d363700 1 --2- 172.21.15.134:0/3564803298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d380fb570 0x7f7d380fb9c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:47.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.793+0000 7f7d3d363700 1 --2- 172.21.15.134:0/3564803298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d38103140 0x7f7d38103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:47.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.793+0000 7f7d3d363700 1 -- 172.21.15.134:0/3564803298 >> 172.21.15.134:0/3564803298 conn(0x7f7d38071560 msgr2=0x7f7d38071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:47.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.793+0000 7f7d3d363700 1 -- 172.21.15.134:0/3564803298 shutdown_connections 2024-02-16T22:15:47.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.793+0000 7f7d3d363700 1 -- 172.21.15.134:0/3564803298 wait complete. 2024-02-16T22:15:47.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.793+0000 7f7d3d363700 1 Processor -- start 2024-02-16T22:15:47.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.793+0000 7f7d3d363700 1 -- start start 2024-02-16T22:15:47.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d3d363700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d380fb570 0x7f7d38113c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:47.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d3d363700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d38103140 0x7f7d38114160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:47.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d3d363700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d38114840 con 0x7f7d38103140 2024-02-16T22:15:47.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d3d363700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3810dae0 con 0x7f7d380fb570 2024-02-16T22:15:47.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d367fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d38103140 0x7f7d38114160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:47.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d367fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d38103140 0x7f7d38114160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50474/0 (socket says 172.21.15.134:50474) 2024-02-16T22:15:47.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d367fc700 1 -- 172.21.15.134:0/2749618911 learned_addr learned my addr 172.21.15.134:0/2749618911 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:47.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d36ffd700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d380fb570 0x7f7d38113c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:47.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d367fc700 1 -- 172.21.15.134:0/2749618911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d380fb570 msgr2=0x7f7d38113c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:47.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d367fc700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d380fb570 0x7f7d38113c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:47.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d367fc700 1 -- 172.21.15.134:0/2749618911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c005040 con 0x7f7d38103140 2024-02-16T22:15:47.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d367fc700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d38103140 0x7f7d38114160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c00b3b0 tx=0x7f7d2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:47.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d1f7fe700 1 -- 172.21.15.134:0/2749618911 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d2c00e040 con 0x7f7d38103140 2024-02-16T22:15:47.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d3d363700 1 -- 172.21.15.134:0/2749618911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3810dd60 con 0x7f7d38103140 2024-02-16T22:15:47.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d1f7fe700 1 -- 172.21.15.134:0/2749618911 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d2c00bbf0 con 0x7f7d38103140 2024-02-16T22:15:47.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.794+0000 7f7d1f7fe700 1 -- 172.21.15.134:0/2749618911 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d2c01c630 con 0x7f7d38103140 2024-02-16T22:15:47.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.795+0000 7f7d3d363700 1 -- 172.21.15.134:0/2749618911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3810e2a0 con 0x7f7d38103140 2024-02-16T22:15:47.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.795+0000 7f7d3d363700 1 -- 172.21.15.134:0/2749618911 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7d3810e740 con 0x7f7d38103140 2024-02-16T22:15:47.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.796+0000 7f7d1f7fe700 1 -- 172.21.15.134:0/2749618911 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f7d2c00bd60 con 0x7f7d38103140 2024-02-16T22:15:47.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.797+0000 7f7d1f7fe700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f7d200692a0 0x7f7d2006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:47.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.797+0000 7f7d1f7fe700 1 -- 172.21.15.134:0/2749618911 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7d2c088250 con 0x7f7d38103140 2024-02-16T22:15:47.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.797+0000 7f7d36ffd700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f7d200692a0 0x7f7d2006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:47.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.797+0000 7f7d1f7fe700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.173:6816/2727105831,v1:172.21.15.173:6817/2727105831] conn(0x7f7d2006ef70 0x7f7d20071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:47.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.797+0000 7f7d1f7fe700 1 -- 172.21.15.134:0/2749618911 --> [v2:172.21.15.173:6816/2727105831,v1:172.21.15.173:6817/2727105831] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d20071a30 con 0x7f7d2006ef70 2024-02-16T22:15:47.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.797+0000 7f7d1f7fe700 1 -- 172.21.15.134:0/2749618911 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d2c08a840 con 0x7f7d38103140 2024-02-16T22:15:47.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.797+0000 7f7d36ffd700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f7d200692a0 0x7f7d2006b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d28006fd0 tx=0x7f7d28008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:47.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.797+0000 7f7d377fe700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.173:6816/2727105831,v1:172.21.15.173:6817/2727105831] conn(0x7f7d2006ef70 0x7f7d20071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:47.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.798+0000 7f7d377fe700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.173:6816/2727105831,v1:172.21.15.173:6817/2727105831] conn(0x7f7d2006ef70 0x7f7d20071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:47.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.798+0000 7f7d1f7fe700 1 -- 172.21.15.134:0/2749618911 <== osd.5 v2:172.21.15.173:6816/2727105831 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7d20071a30 con 0x7f7d2006ef70 2024-02-16T22:15:47.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.813+0000 7f7d3d363700 1 -- 172.21.15.134:0/2749618911 --> [v2:172.21.15.173:6816/2727105831,v1:172.21.15.173:6817/2727105831] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7d3805e610 con 0x7f7d2006ef70 2024-02-16T22:15:47.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d1f7fe700 1 -- 172.21.15.134:0/2749618911 <== osd.5 v2:172.21.15.173:6816/2727105831 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7d3805e610 con 0x7f7d2006ef70 2024-02-16T22:15:47.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d3d363700 1 -- 172.21.15.134:0/2749618911 >> [v2:172.21.15.173:6816/2727105831,v1:172.21.15.173:6817/2727105831] conn(0x7f7d2006ef70 msgr2=0x7f7d20071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:47.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d3d363700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.173:6816/2727105831,v1:172.21.15.173:6817/2727105831] conn(0x7f7d2006ef70 0x7f7d20071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:47.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d3d363700 1 -- 172.21.15.134:0/2749618911 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f7d200692a0 msgr2=0x7f7d2006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:47.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d3d363700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f7d200692a0 0x7f7d2006b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d28006fd0 tx=0x7f7d28008040 comp rx=0 tx=0).stop 2024-02-16T22:15:47.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d3d363700 1 -- 172.21.15.134:0/2749618911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d38103140 msgr2=0x7f7d38114160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:47.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d3d363700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d38103140 0x7f7d38114160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c00b3b0 tx=0x7f7d2c009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:47.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d3d363700 1 -- 172.21.15.134:0/2749618911 shutdown_connections 2024-02-16T22:15:47.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d3d363700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.173:6816/2727105831,v1:172.21.15.173:6817/2727105831] conn(0x7f7d2006ef70 0x7f7d20071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:47.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d3d363700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f7d200692a0 0x7f7d2006b750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:47.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d3d363700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d380fb570 0x7f7d38113c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:47.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d3d363700 1 --2- 172.21.15.134:0/2749618911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d38103140 0x7f7d38114160 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:47.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d3d363700 1 -- 172.21.15.134:0/2749618911 >> 172.21.15.134:0/2749618911 conn(0x7f7d38071560 msgr2=0x7f7d380f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:47.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d3d363700 1 -- 172.21.15.134:0/2749618911 shutdown_connections 2024-02-16T22:15:47.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:47.814+0000 7f7d3d363700 1 -- 172.21.15.134:0/2749618911 wait complete. 2024-02-16T22:15:48.525 INFO:teuthology.orchestra.run.smithi134.stdout:38654705699 2024-02-16T22:15:48.525 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-16T22:15:49.135 INFO:teuthology.orchestra.run.smithi134.stdout:146028888078 2024-02-16T22:15:49.135 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-16T22:15:49.563 INFO:teuthology.orchestra.run.smithi134.stdout:167503724554 2024-02-16T22:15:49.563 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-16T22:15:50.036 INFO:teuthology.orchestra.run.smithi134.stdout:60129542172 2024-02-16T22:15:50.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-16T22:15:50.044 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:50.050 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:50.070 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:50.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:49 smithi134 ceph-mon[28869]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:50.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:49 smithi173 ceph-mon[37280]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:52.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:51 smithi134 ceph-mon[28869]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:52.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:51 smithi173 ceph-mon[37280]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:52.360 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:52.630 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:53.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.768+0000 7fd8a957a700 1 -- 172.21.15.134:0/1097465109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8a4101e60 msgr2=0x7fd8a4102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:53.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.768+0000 7fd8a957a700 1 --2- 172.21.15.134:0/1097465109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8a4101e60 0x7fd8a4102230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd894004940 tx=0x7fd894009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:53.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.768+0000 7fd8a957a700 1 -- 172.21.15.134:0/1097465109 shutdown_connections 2024-02-16T22:15:53.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.768+0000 7fd8a957a700 1 --2- 172.21.15.134:0/1097465109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8a4102800 0x7fd8a40fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:53.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.768+0000 7fd8a957a700 1 --2- 172.21.15.134:0/1097465109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8a4101e60 0x7fd8a4102230 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:53.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.768+0000 7fd8a957a700 1 -- 172.21.15.134:0/1097465109 >> 172.21.15.134:0/1097465109 conn(0x7fd8a40f7a10 msgr2=0x7fd8a40f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:53.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.768+0000 7fd8a957a700 1 -- 172.21.15.134:0/1097465109 shutdown_connections 2024-02-16T22:15:53.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.768+0000 7fd8a957a700 1 -- 172.21.15.134:0/1097465109 wait complete. 2024-02-16T22:15:53.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.769+0000 7fd8a957a700 1 Processor -- start 2024-02-16T22:15:53.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.769+0000 7fd8a957a700 1 -- start start 2024-02-16T22:15:53.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.769+0000 7fd8a957a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8a4101e60 0x7fd8a4112900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:53.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.769+0000 7fd8a957a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8a4102800 0x7fd8a4112e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:53.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.769+0000 7fd8a957a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a4113490 con 0x7fd8a4102800 2024-02-16T22:15:53.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.769+0000 7fd8a957a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a410c7c0 con 0x7fd8a4101e60 2024-02-16T22:15:53.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.769+0000 7fd8a2ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8a4101e60 0x7fd8a4112900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:53.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.769+0000 7fd89a7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8a4102800 0x7fd8a4112e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:53.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.769+0000 7fd8a2ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8a4101e60 0x7fd8a4112900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.134:54434/0 (socket says 172.21.15.134:54434) 2024-02-16T22:15:53.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.769+0000 7fd8a2ffd700 1 -- 172.21.15.134:0/3758354785 learned_addr learned my addr 172.21.15.134:0/3758354785 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:53.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.770+0000 7fd8a2ffd700 1 -- 172.21.15.134:0/3758354785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8a4102800 msgr2=0x7fd8a4112e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:53.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.770+0000 7fd8a2ffd700 1 --2- 172.21.15.134:0/3758354785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8a4102800 0x7fd8a4112e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:53.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.770+0000 7fd8a2ffd700 1 -- 172.21.15.134:0/3758354785 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894005040 con 0x7fd8a4101e60 2024-02-16T22:15:53.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.770+0000 7fd89a7fc700 1 --2- 172.21.15.134:0/3758354785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8a4102800 0x7fd8a4112e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:15:53.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.770+0000 7fd8a2ffd700 1 --2- 172.21.15.134:0/3758354785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8a4101e60 0x7fd8a4112900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd894009b30 tx=0x7fd894009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:53.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.770+0000 7fd89bfff700 1 -- 172.21.15.134:0/3758354785 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd894021070 con 0x7fd8a4101e60 2024-02-16T22:15:53.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.770+0000 7fd8a957a700 1 -- 172.21.15.134:0/3758354785 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a410ca40 con 0x7fd8a4101e60 2024-02-16T22:15:53.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.770+0000 7fd89bfff700 1 -- 172.21.15.134:0/3758354785 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd894013dd0 con 0x7fd8a4101e60 2024-02-16T22:15:53.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.770+0000 7fd89bfff700 1 -- 172.21.15.134:0/3758354785 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd89400e070 con 0x7fd8a4101e60 2024-02-16T22:15:53.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.770+0000 7fd8a957a700 1 -- 172.21.15.134:0/3758354785 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a410cf20 con 0x7fd8a4101e60 2024-02-16T22:15:53.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.771+0000 7fd8a957a700 1 -- 172.21.15.134:0/3758354785 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a40fb610 con 0x7fd8a4101e60 2024-02-16T22:15:53.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.771+0000 7fd89bfff700 1 -- 172.21.15.134:0/3758354785 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd89400b910 con 0x7fd8a4101e60 2024-02-16T22:15:53.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.772+0000 7fd89bfff700 1 --2- 172.21.15.134:0/3758354785 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd8900692a0 0x7fd89006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:53.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.772+0000 7fd89bfff700 1 -- 172.21.15.134:0/3758354785 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd8940882c0 con 0x7fd8a4101e60 2024-02-16T22:15:53.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.772+0000 7fd89a7fc700 1 --2- 172.21.15.134:0/3758354785 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd8900692a0 0x7fd89006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:53.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.772+0000 7fd89a7fc700 1 --2- 172.21.15.134:0/3758354785 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd8900692a0 0x7fd89006b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8a410e130 tx=0x7fd88c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:53.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.776+0000 7fd89bfff700 1 -- 172.21.15.134:0/3758354785 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd8940583c0 con 0x7fd8a4101e60 2024-02-16T22:15:53.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.965+0000 7fd8a957a700 1 -- 172.21.15.134:0/3758354785 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd8a410dee0 con 0x7fd8a4101e60 2024-02-16T22:15:53.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.966+0000 7fd89bfff700 1 -- 172.21.15.134:0/3758354785 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd894004490 con 0x7fd8a4101e60 2024-02-16T22:15:53.968 INFO:teuthology.orchestra.run.smithi134.stdout:81604378650 2024-02-16T22:15:53.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.968+0000 7fd8a957a700 1 -- 172.21.15.134:0/3758354785 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd8900692a0 msgr2=0x7fd89006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.968+0000 7fd8a957a700 1 --2- 172.21.15.134:0/3758354785 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd8900692a0 0x7fd89006b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8a410e130 tx=0x7fd88c00b040 comp rx=0 tx=0).stop 2024-02-16T22:15:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.968+0000 7fd8a957a700 1 -- 172.21.15.134:0/3758354785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8a4101e60 msgr2=0x7fd8a4112900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.968+0000 7fd8a957a700 1 --2- 172.21.15.134:0/3758354785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8a4101e60 0x7fd8a4112900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd894009b30 tx=0x7fd894009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.968+0000 7fd8a957a700 1 -- 172.21.15.134:0/3758354785 shutdown_connections 2024-02-16T22:15:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.968+0000 7fd8a957a700 1 --2- 172.21.15.134:0/3758354785 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd8900692a0 0x7fd89006b750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.968+0000 7fd8a957a700 1 --2- 172.21.15.134:0/3758354785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8a4101e60 0x7fd8a4112900 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.968+0000 7fd8a957a700 1 --2- 172.21.15.134:0/3758354785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8a4102800 0x7fd8a4112e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.968+0000 7fd8a957a700 1 -- 172.21.15.134:0/3758354785 >> 172.21.15.134:0/3758354785 conn(0x7fd8a40f7a10 msgr2=0x7fd8a40f93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.968+0000 7fd8a957a700 1 -- 172.21.15.134:0/3758354785 shutdown_connections 2024-02-16T22:15:53.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:53.968+0000 7fd8a957a700 1 -- 172.21.15.134:0/3758354785 wait complete. 2024-02-16T22:15:54.221 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:53 smithi173 ceph-mon[37280]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:54.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:53 smithi134 ceph-mon[28869]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:54.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.565+0000 7f228234a700 1 -- 172.21.15.134:0/1147579077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f227c102f50 msgr2=0x7f227c103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:54.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.565+0000 7f228234a700 1 --2- 172.21.15.134:0/1147579077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f227c102f50 0x7f227c103320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f226c004940 tx=0x7f226c009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:54.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.565+0000 7f228234a700 1 -- 172.21.15.134:0/1147579077 shutdown_connections 2024-02-16T22:15:54.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.565+0000 7f228234a700 1 --2- 172.21.15.134:0/1147579077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f227c1038f0 0x7f227c0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:54.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.565+0000 7f228234a700 1 --2- 172.21.15.134:0/1147579077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f227c102f50 0x7f227c103320 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:54.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.565+0000 7f228234a700 1 -- 172.21.15.134:0/1147579077 >> 172.21.15.134:0/1147579077 conn(0x7f227c0f8ae0 msgr2=0x7f227c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:54.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.565+0000 7f228234a700 1 -- 172.21.15.134:0/1147579077 shutdown_connections 2024-02-16T22:15:54.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.565+0000 7f228234a700 1 -- 172.21.15.134:0/1147579077 wait complete. 2024-02-16T22:15:54.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.566+0000 7f228234a700 1 Processor -- start 2024-02-16T22:15:54.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.566+0000 7f228234a700 1 -- start start 2024-02-16T22:15:54.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.566+0000 7f228234a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f227c102f50 0x7f227c113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:54.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.566+0000 7f228234a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f227c1038f0 0x7f227c114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:54.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f228234a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c114700 con 0x7f227c102f50 2024-02-16T22:15:54.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f228234a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c10d9a0 con 0x7f227c1038f0 2024-02-16T22:15:54.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f227bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f227c102f50 0x7f227c113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:54.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f227bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f227c102f50 0x7f227c113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53462/0 (socket says 172.21.15.134:53462) 2024-02-16T22:15:54.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f227bfff700 1 -- 172.21.15.134:0/4099987177 learned_addr learned my addr 172.21.15.134:0/4099987177 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:54.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f227b7fe700 1 --2- 172.21.15.134:0/4099987177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f227c1038f0 0x7f227c114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:54.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f227bfff700 1 -- 172.21.15.134:0/4099987177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f227c1038f0 msgr2=0x7f227c114020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:54.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f227bfff700 1 --2- 172.21.15.134:0/4099987177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f227c1038f0 0x7f227c114020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:54.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f227bfff700 1 -- 172.21.15.134:0/4099987177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c005040 con 0x7f227c102f50 2024-02-16T22:15:54.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f227bfff700 1 --2- 172.21.15.134:0/4099987177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f227c102f50 0x7f227c113ae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f226c00b3b0 tx=0x7f226c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:54.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f2278ff9700 1 -- 172.21.15.134:0/4099987177 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f226c00e040 con 0x7f227c102f50 2024-02-16T22:15:54.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f228234a700 1 -- 172.21.15.134:0/4099987177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c10dc20 con 0x7f227c102f50 2024-02-16T22:15:54.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f2278ff9700 1 -- 172.21.15.134:0/4099987177 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f226c00bbf0 con 0x7f227c102f50 2024-02-16T22:15:54.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f2278ff9700 1 -- 172.21.15.134:0/4099987177 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f226c01c3f0 con 0x7f227c102f50 2024-02-16T22:15:54.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.567+0000 7f228234a700 1 -- 172.21.15.134:0/4099987177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c10e160 con 0x7f227c102f50 2024-02-16T22:15:54.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.568+0000 7f228234a700 1 -- 172.21.15.134:0/4099987177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c0fc6e0 con 0x7f227c102f50 2024-02-16T22:15:54.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.569+0000 7f2278ff9700 1 -- 172.21.15.134:0/4099987177 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f226c01c670 con 0x7f227c102f50 2024-02-16T22:15:54.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.569+0000 7f2278ff9700 1 --2- 172.21.15.134:0/4099987177 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f22640692a0 0x7f226406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:54.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.569+0000 7f2278ff9700 1 -- 172.21.15.134:0/4099987177 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f226c0881b0 con 0x7f227c102f50 2024-02-16T22:15:54.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.569+0000 7f227b7fe700 1 --2- 172.21.15.134:0/4099987177 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f22640692a0 0x7f226406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:54.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.569+0000 7f227b7fe700 1 --2- 172.21.15.134:0/4099987177 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f22640692a0 0x7f226406b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f227c10f310 tx=0x7f22700091a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:54.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.573+0000 7f2278ff9700 1 -- 172.21.15.134:0/4099987177 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f226c058320 con 0x7f227c102f50 2024-02-16T22:15:54.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.762+0000 7f228234a700 1 -- 172.21.15.134:0/4099987177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f227c10f0c0 con 0x7f227c102f50 2024-02-16T22:15:54.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.762+0000 7f2278ff9700 1 -- 172.21.15.134:0/4099987177 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f226c057eb0 con 0x7f227c102f50 2024-02-16T22:15:54.765 INFO:teuthology.orchestra.run.smithi134.stdout:146028888079 2024-02-16T22:15:54.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.764+0000 7f228234a700 1 -- 172.21.15.134:0/4099987177 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f22640692a0 msgr2=0x7f226406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:54.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.764+0000 7f228234a700 1 --2- 172.21.15.134:0/4099987177 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f22640692a0 0x7f226406b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f227c10f310 tx=0x7f22700091a0 comp rx=0 tx=0).stop 2024-02-16T22:15:54.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.764+0000 7f228234a700 1 -- 172.21.15.134:0/4099987177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f227c102f50 msgr2=0x7f227c113ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:54.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.764+0000 7f228234a700 1 --2- 172.21.15.134:0/4099987177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f227c102f50 0x7f227c113ae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f226c00b3b0 tx=0x7f226c009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:54.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.764+0000 7f228234a700 1 -- 172.21.15.134:0/4099987177 shutdown_connections 2024-02-16T22:15:54.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.764+0000 7f228234a700 1 --2- 172.21.15.134:0/4099987177 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f22640692a0 0x7f226406b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:54.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.764+0000 7f228234a700 1 --2- 172.21.15.134:0/4099987177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f227c102f50 0x7f227c113ae0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:54.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.764+0000 7f228234a700 1 --2- 172.21.15.134:0/4099987177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f227c1038f0 0x7f227c114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:54.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.764+0000 7f228234a700 1 -- 172.21.15.134:0/4099987177 >> 172.21.15.134:0/4099987177 conn(0x7f227c0f8ae0 msgr2=0x7f227c0fa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:54.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.765+0000 7f228234a700 1 -- 172.21.15.134:0/4099987177 shutdown_connections 2024-02-16T22:15:54.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:54.765+0000 7f228234a700 1 -- 172.21.15.134:0/4099987177 wait complete. 2024-02-16T22:15:55.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:54 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/3758354785' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-16T22:15:55.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:54 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/4099987177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-16T22:15:55.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:54 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/3758354785' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-16T22:15:55.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:54 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/4099987177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-16T22:15:56.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:55 smithi134 ceph-mon[28869]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:56.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:55 smithi173 ceph-mon[37280]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:56.577 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888078 got 146028888079 for osd.4 2024-02-16T22:15:56.577 DEBUG:teuthology.parallel:result is None 2024-02-16T22:15:57.004 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378650 for osd.2 2024-02-16T22:15:57.004 DEBUG:teuthology.parallel:result is None 2024-02-16T22:15:57.706 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:57 smithi134 ceph-mon[28869]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:57 smithi173 ceph-mon[37280]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:57.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.734+0000 7fc233aa9700 1 -- 172.21.15.134:0/1671191509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc22c0fb7c0 msgr2=0x7fc22c0fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:57.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.734+0000 7fc233aa9700 1 --2- 172.21.15.134:0/1671191509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc22c0fb7c0 0x7fc22c0fbb90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc228004940 tx=0x7fc228009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:57.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.735+0000 7fc233aa9700 1 -- 172.21.15.134:0/1671191509 shutdown_connections 2024-02-16T22:15:57.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.735+0000 7fc233aa9700 1 --2- 172.21.15.134:0/1671191509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc22c0fc0d0 0x7fc22c10d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:57.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.735+0000 7fc233aa9700 1 --2- 172.21.15.134:0/1671191509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc22c0fb7c0 0x7fc22c0fbb90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.735+0000 7fc233aa9700 1 -- 172.21.15.134:0/1671191509 >> 172.21.15.134:0/1671191509 conn(0x7fc22c071560 msgr2=0x7fc22c071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.735+0000 7fc233aa9700 1 -- 172.21.15.134:0/1671191509 shutdown_connections 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.735+0000 7fc233aa9700 1 -- 172.21.15.134:0/1671191509 wait complete. 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.735+0000 7fc233aa9700 1 Processor -- start 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.735+0000 7fc233aa9700 1 -- start start 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.735+0000 7fc233aa9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc22c0fb7c0 0x7fc22c11a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.735+0000 7fc233aa9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc22c0fc0d0 0x7fc22c11a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.735+0000 7fc233aa9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c11ac80 con 0x7fc22c0fb7c0 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.735+0000 7fc233aa9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c114000 con 0x7fc22c0fc0d0 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.736+0000 7fc231845700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc22c0fb7c0 0x7fc22c11a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.736+0000 7fc231845700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc22c0fb7c0 0x7fc22c11a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53488/0 (socket says 172.21.15.134:53488) 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.736+0000 7fc231845700 1 -- 172.21.15.134:0/3947724827 learned_addr learned my addr 172.21.15.134:0/3947724827 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.736+0000 7fc231044700 1 --2- 172.21.15.134:0/3947724827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc22c0fc0d0 0x7fc22c11a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.736+0000 7fc231845700 1 -- 172.21.15.134:0/3947724827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc22c0fc0d0 msgr2=0x7fc22c11a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.736+0000 7fc231845700 1 --2- 172.21.15.134:0/3947724827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc22c0fc0d0 0x7fc22c11a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:57.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.736+0000 7fc231845700 1 -- 172.21.15.134:0/3947724827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc228005040 con 0x7fc22c0fb7c0 2024-02-16T22:15:57.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.736+0000 7fc231845700 1 --2- 172.21.15.134:0/3947724827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc22c0fb7c0 0x7fc22c11a0f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc22800b3b0 tx=0x7fc228009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:57.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.736+0000 7fc2227fc700 1 -- 172.21.15.134:0/3947724827 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc22800e040 con 0x7fc22c0fb7c0 2024-02-16T22:15:57.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.736+0000 7fc2227fc700 1 -- 172.21.15.134:0/3947724827 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc22800bbf0 con 0x7fc22c0fb7c0 2024-02-16T22:15:57.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.736+0000 7fc2227fc700 1 -- 172.21.15.134:0/3947724827 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc22801cea0 con 0x7fc22c0fb7c0 2024-02-16T22:15:57.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.736+0000 7fc233aa9700 1 -- 172.21.15.134:0/3947724827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22c114280 con 0x7fc22c0fb7c0 2024-02-16T22:15:57.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.736+0000 7fc233aa9700 1 -- 172.21.15.134:0/3947724827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22c1147c0 con 0x7fc22c0fb7c0 2024-02-16T22:15:57.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.737+0000 7fc233aa9700 1 -- 172.21.15.134:0/3947724827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22c0fe0e0 con 0x7fc22c0fb7c0 2024-02-16T22:15:57.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.738+0000 7fc2227fc700 1 -- 172.21.15.134:0/3947724827 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc22800bd60 con 0x7fc22c0fb7c0 2024-02-16T22:15:57.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.738+0000 7fc2227fc700 1 --2- 172.21.15.134:0/3947724827 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc2180692a0 0x7fc21806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:57.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.738+0000 7fc231044700 1 --2- 172.21.15.134:0/3947724827 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc2180692a0 0x7fc21806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:57.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.738+0000 7fc2227fc700 1 -- 172.21.15.134:0/3947724827 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc228087a70 con 0x7fc22c0fb7c0 2024-02-16T22:15:57.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.739+0000 7fc231044700 1 --2- 172.21.15.134:0/3947724827 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc2180692a0 0x7fc21806b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc22c115990 tx=0x7fc21c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:57.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.743+0000 7fc2227fc700 1 -- 172.21.15.134:0/3947724827 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc228057cc0 con 0x7fc22c0fb7c0 2024-02-16T22:15:57.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.931+0000 7fc233aa9700 1 -- 172.21.15.134:0/3947724827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc22c073080 con 0x7fc22c0fb7c0 2024-02-16T22:15:57.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.931+0000 7fc2227fc700 1 -- 172.21.15.134:0/3947724827 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc228057850 con 0x7fc22c0fb7c0 2024-02-16T22:15:57.933 INFO:teuthology.orchestra.run.smithi134.stdout:111669149716 2024-02-16T22:15:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.933+0000 7fc233aa9700 1 -- 172.21.15.134:0/3947724827 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc2180692a0 msgr2=0x7fc21806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.933+0000 7fc233aa9700 1 --2- 172.21.15.134:0/3947724827 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc2180692a0 0x7fc21806b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc22c115990 tx=0x7fc21c00b040 comp rx=0 tx=0).stop 2024-02-16T22:15:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.933+0000 7fc233aa9700 1 -- 172.21.15.134:0/3947724827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc22c0fb7c0 msgr2=0x7fc22c11a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.933+0000 7fc233aa9700 1 --2- 172.21.15.134:0/3947724827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc22c0fb7c0 0x7fc22c11a0f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc22800b3b0 tx=0x7fc228009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.933+0000 7fc233aa9700 1 -- 172.21.15.134:0/3947724827 shutdown_connections 2024-02-16T22:15:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.933+0000 7fc233aa9700 1 --2- 172.21.15.134:0/3947724827 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc2180692a0 0x7fc21806b750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.933+0000 7fc233aa9700 1 --2- 172.21.15.134:0/3947724827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc22c0fb7c0 0x7fc22c11a0f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.933+0000 7fc233aa9700 1 --2- 172.21.15.134:0/3947724827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc22c0fc0d0 0x7fc22c11a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.933+0000 7fc233aa9700 1 -- 172.21.15.134:0/3947724827 >> 172.21.15.134:0/3947724827 conn(0x7fc22c071560 msgr2=0x7fc22c10bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.933+0000 7fc233aa9700 1 -- 172.21.15.134:0/3947724827 shutdown_connections 2024-02-16T22:15:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:57.933+0000 7fc233aa9700 1 -- 172.21.15.134:0/3947724827 wait complete. 2024-02-16T22:15:58.635 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:58 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:15:58.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:58 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/3947724827' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-16T22:15:58.683 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149713 got 111669149716 for osd.3 2024-02-16T22:15:58.683 DEBUG:teuthology.parallel:result is None 2024-02-16T22:15:58.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:58 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:15:58.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:58 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/3947724827' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-16T22:15:58.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.949+0000 7fa836d49700 1 -- 172.21.15.134:0/1422947900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8301038e0 msgr2=0x7fa8300fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:58.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.949+0000 7fa836d49700 1 --2- 172.21.15.134:0/1422947900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8301038e0 0x7fa8300fcf50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa81c004ba0 tx=0x7fa81c009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:58.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.949+0000 7fa836d49700 1 -- 172.21.15.134:0/1422947900 shutdown_connections 2024-02-16T22:15:58.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.949+0000 7fa836d49700 1 --2- 172.21.15.134:0/1422947900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8301038e0 0x7fa8300fcf50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:58.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.949+0000 7fa836d49700 1 --2- 172.21.15.134:0/1422947900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa830102f40 0x7fa830103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:58.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.949+0000 7fa836d49700 1 -- 172.21.15.134:0/1422947900 >> 172.21.15.134:0/1422947900 conn(0x7fa8300f8af0 msgr2=0x7fa8300faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:58.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.949+0000 7fa836d49700 1 -- 172.21.15.134:0/1422947900 shutdown_connections 2024-02-16T22:15:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.949+0000 7fa836d49700 1 -- 172.21.15.134:0/1422947900 wait complete. 2024-02-16T22:15:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.950+0000 7fa836d49700 1 Processor -- start 2024-02-16T22:15:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.950+0000 7fa836d49700 1 -- start start 2024-02-16T22:15:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.950+0000 7fa836d49700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa830102f40 0x7fa8301139c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.950+0000 7fa836d49700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa830113f00 0x7fa83010da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.950+0000 7fa836d49700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8301144c0 con 0x7fa830102f40 2024-02-16T22:15:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.950+0000 7fa836d49700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83010dfd0 con 0x7fa830113f00 2024-02-16T22:15:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.950+0000 7fa834ae5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa830102f40 0x7fa8301139c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.950+0000 7fa834ae5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa830102f40 0x7fa8301139c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53514/0 (socket says 172.21.15.134:53514) 2024-02-16T22:15:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.950+0000 7fa834ae5700 1 -- 172.21.15.134:0/289024202 learned_addr learned my addr 172.21.15.134:0/289024202 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:15:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.951+0000 7fa82ffff700 1 --2- 172.21.15.134:0/289024202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa830113f00 0x7fa83010da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:58.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.951+0000 7fa82ffff700 1 -- 172.21.15.134:0/289024202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa830102f40 msgr2=0x7fa8301139c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:58.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.951+0000 7fa82ffff700 1 --2- 172.21.15.134:0/289024202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa830102f40 0x7fa8301139c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:58.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.951+0000 7fa82ffff700 1 -- 172.21.15.134:0/289024202 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c005040 con 0x7fa830113f00 2024-02-16T22:15:58.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.951+0000 7fa82ffff700 1 --2- 172.21.15.134:0/289024202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa830113f00 0x7fa83010da90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa8300fe0c0 tx=0x7fa81c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:58.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.951+0000 7fa82d7fa700 1 -- 172.21.15.134:0/289024202 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa81c00e070 con 0x7fa830113f00 2024-02-16T22:15:58.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.951+0000 7fa82d7fa700 1 -- 172.21.15.134:0/289024202 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa81c007e00 con 0x7fa830113f00 2024-02-16T22:15:58.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.951+0000 7fa836d49700 1 -- 172.21.15.134:0/289024202 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83010e250 con 0x7fa830113f00 2024-02-16T22:15:58.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.952+0000 7fa82d7fa700 1 -- 172.21.15.134:0/289024202 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa81c013660 con 0x7fa830113f00 2024-02-16T22:15:58.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.952+0000 7fa836d49700 1 -- 172.21.15.134:0/289024202 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83010e760 con 0x7fa830113f00 2024-02-16T22:15:58.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.953+0000 7fa836d49700 1 -- 172.21.15.134:0/289024202 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa830100250 con 0x7fa830113f00 2024-02-16T22:15:58.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.953+0000 7fa82d7fa700 1 -- 172.21.15.134:0/289024202 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa81c0137c0 con 0x7fa830113f00 2024-02-16T22:15:58.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.953+0000 7fa82d7fa700 1 --2- 172.21.15.134:0/289024202 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa8200692a0 0x7fa82006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:15:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.953+0000 7fa82d7fa700 1 -- 172.21.15.134:0/289024202 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa81c087f70 con 0x7fa830113f00 2024-02-16T22:15:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.953+0000 7fa834ae5700 1 --2- 172.21.15.134:0/289024202 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa8200692a0 0x7fa82006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:15:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.954+0000 7fa834ae5700 1 --2- 172.21.15.134:0/289024202 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa8200692a0 0x7fa82006b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa824009c10 tx=0x7fa824000f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:15:58.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:58.958+0000 7fa82d7fa700 1 -- 172.21.15.134:0/289024202 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa81c0b9bd0 con 0x7fa830113f00 2024-02-16T22:15:59.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:59.144+0000 7fa836d49700 1 -- 172.21.15.134:0/289024202 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa83010a0b0 con 0x7fa830113f00 2024-02-16T22:15:59.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:59.145+0000 7fa82d7fa700 1 -- 172.21.15.134:0/289024202 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa81c0580c0 con 0x7fa830113f00 2024-02-16T22:15:59.147 INFO:teuthology.orchestra.run.smithi134.stdout:38654705701 2024-02-16T22:15:59.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:59.147+0000 7fa836d49700 1 -- 172.21.15.134:0/289024202 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa8200692a0 msgr2=0x7fa82006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:59.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:59.147+0000 7fa836d49700 1 --2- 172.21.15.134:0/289024202 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa8200692a0 0x7fa82006b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa824009c10 tx=0x7fa824000f90 comp rx=0 tx=0).stop 2024-02-16T22:15:59.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:59.147+0000 7fa836d49700 1 -- 172.21.15.134:0/289024202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa830113f00 msgr2=0x7fa83010da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:15:59.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:59.147+0000 7fa836d49700 1 --2- 172.21.15.134:0/289024202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa830113f00 0x7fa83010da90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa8300fe0c0 tx=0x7fa81c009e30 comp rx=0 tx=0).stop 2024-02-16T22:15:59.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:59.147+0000 7fa836d49700 1 -- 172.21.15.134:0/289024202 shutdown_connections 2024-02-16T22:15:59.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:59.147+0000 7fa836d49700 1 --2- 172.21.15.134:0/289024202 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa8200692a0 0x7fa82006b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:59.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:59.147+0000 7fa836d49700 1 --2- 172.21.15.134:0/289024202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa830102f40 0x7fa8301139c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:59.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:59.147+0000 7fa836d49700 1 --2- 172.21.15.134:0/289024202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa830113f00 0x7fa83010da90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:15:59.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:59.147+0000 7fa836d49700 1 -- 172.21.15.134:0/289024202 >> 172.21.15.134:0/289024202 conn(0x7fa8300f8af0 msgr2=0x7fa8300fa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:15:59.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:59.147+0000 7fa836d49700 1 -- 172.21.15.134:0/289024202 shutdown_connections 2024-02-16T22:15:59.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:15:59.147+0000 7fa836d49700 1 -- 172.21.15.134:0/289024202 wait complete. 2024-02-16T22:15:59.588 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:15:59.712 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:59 smithi134 ceph-mon[28869]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:59.712 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:15:59 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/289024202' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-16T22:15:59.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:59 smithi173 ceph-mon[37280]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:15:59.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:15:59 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/289024202' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-16T22:16:00.703 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705701 for osd.0 2024-02-16T22:16:00.704 DEBUG:teuthology.parallel:result is None 2024-02-16T22:16:01.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.151+0000 7fa820eea700 1 -- 172.21.15.134:0/3616573891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c0fe8f0 msgr2=0x7fa81c107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:01.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.151+0000 7fa820eea700 1 --2- 172.21.15.134:0/3616573891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c0fe8f0 0x7fa81c107050 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa80c004970 tx=0x7fa80c009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:01.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.151+0000 7fa820eea700 1 -- 172.21.15.134:0/3616573891 shutdown_connections 2024-02-16T22:16:01.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.151+0000 7fa820eea700 1 --2- 172.21.15.134:0/3616573891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c0fe8f0 0x7fa81c107050 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:01.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.151+0000 7fa820eea700 1 --2- 172.21.15.134:0/3616573891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81c0fdfe0 0x7fa81c0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:01.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.151+0000 7fa820eea700 1 -- 172.21.15.134:0/3616573891 >> 172.21.15.134:0/3616573891 conn(0x7fa81c071d90 msgr2=0x7fa81c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:01.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.151+0000 7fa820eea700 1 -- 172.21.15.134:0/3616573891 shutdown_connections 2024-02-16T22:16:01.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.151+0000 7fa820eea700 1 -- 172.21.15.134:0/3616573891 wait complete. 2024-02-16T22:16:01.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.152+0000 7fa820eea700 1 Processor -- start 2024-02-16T22:16:01.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.152+0000 7fa820eea700 1 -- start start 2024-02-16T22:16:01.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.152+0000 7fa820eea700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81c0fdfe0 0x7fa81c1139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:01.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.152+0000 7fa820eea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c0fe8f0 0x7fa81c113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:01.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.152+0000 7fa820eea700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c114580 con 0x7fa81c0fe8f0 2024-02-16T22:16:01.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.152+0000 7fa820eea700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c10d8b0 con 0x7fa81c0fdfe0 2024-02-16T22:16:01.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.152+0000 7fa819d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c0fe8f0 0x7fa81c113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:01.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.152+0000 7fa819d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c0fe8f0 0x7fa81c113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53528/0 (socket says 172.21.15.134:53528) 2024-02-16T22:16:01.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.152+0000 7fa819d9b700 1 -- 172.21.15.134:0/132102093 learned_addr learned my addr 172.21.15.134:0/132102093 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:01.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.152+0000 7fa81a59c700 1 --2- 172.21.15.134:0/132102093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81c0fdfe0 0x7fa81c1139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:01.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.153+0000 7fa819d9b700 1 -- 172.21.15.134:0/132102093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81c0fdfe0 msgr2=0x7fa81c1139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:01.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.153+0000 7fa819d9b700 1 --2- 172.21.15.134:0/132102093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81c0fdfe0 0x7fa81c1139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:01.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.153+0000 7fa819d9b700 1 -- 172.21.15.134:0/132102093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c005040 con 0x7fa81c0fe8f0 2024-02-16T22:16:01.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.153+0000 7fa819d9b700 1 --2- 172.21.15.134:0/132102093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c0fe8f0 0x7fa81c113f30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa80c000c00 tx=0x7fa80c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:01.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.153+0000 7fa80affd700 1 -- 172.21.15.134:0/132102093 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa80c00e040 con 0x7fa81c0fe8f0 2024-02-16T22:16:01.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.153+0000 7fa80affd700 1 -- 172.21.15.134:0/132102093 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa80c009af0 con 0x7fa81c0fe8f0 2024-02-16T22:16:01.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.153+0000 7fa80affd700 1 -- 172.21.15.134:0/132102093 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa80c01c3f0 con 0x7fa81c0fe8f0 2024-02-16T22:16:01.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.153+0000 7fa820eea700 1 -- 172.21.15.134:0/132102093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c10db30 con 0x7fa81c0fe8f0 2024-02-16T22:16:01.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.153+0000 7fa820eea700 1 -- 172.21.15.134:0/132102093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c10e070 con 0x7fa81c0fe8f0 2024-02-16T22:16:01.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.154+0000 7fa820eea700 1 -- 172.21.15.134:0/132102093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c1046c0 con 0x7fa81c0fe8f0 2024-02-16T22:16:01.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.155+0000 7fa80affd700 1 -- 172.21.15.134:0/132102093 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa80c00bc10 con 0x7fa81c0fe8f0 2024-02-16T22:16:01.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.155+0000 7fa80affd700 1 --2- 172.21.15.134:0/132102093 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa8040692a0 0x7fa80406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:01.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.155+0000 7fa80affd700 1 -- 172.21.15.134:0/132102093 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa80c088050 con 0x7fa81c0fe8f0 2024-02-16T22:16:01.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.155+0000 7fa81a59c700 1 --2- 172.21.15.134:0/132102093 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa8040692a0 0x7fa80406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:01.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.155+0000 7fa81a59c700 1 --2- 172.21.15.134:0/132102093 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa8040692a0 0x7fa80406b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa810004f40 tx=0x7fa81000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:01.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.159+0000 7fa80affd700 1 -- 172.21.15.134:0/132102093 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa80c058150 con 0x7fa81c0fe8f0 2024-02-16T22:16:01.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.347+0000 7fa820eea700 1 -- 172.21.15.134:0/132102093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa81c10a030 con 0x7fa81c0fe8f0 2024-02-16T22:16:01.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.347+0000 7fa80affd700 1 -- 172.21.15.134:0/132102093 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa80c004de0 con 0x7fa81c0fe8f0 2024-02-16T22:16:01.349 INFO:teuthology.orchestra.run.smithi134.stdout:167503724556 2024-02-16T22:16:01.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.349+0000 7fa820eea700 1 -- 172.21.15.134:0/132102093 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa8040692a0 msgr2=0x7fa80406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:01.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.349+0000 7fa820eea700 1 --2- 172.21.15.134:0/132102093 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa8040692a0 0x7fa80406b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa810004f40 tx=0x7fa81000b040 comp rx=0 tx=0).stop 2024-02-16T22:16:01.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.349+0000 7fa820eea700 1 -- 172.21.15.134:0/132102093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c0fe8f0 msgr2=0x7fa81c113f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:01.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.349+0000 7fa820eea700 1 --2- 172.21.15.134:0/132102093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c0fe8f0 0x7fa81c113f30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa80c000c00 tx=0x7fa80c009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:01.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.349+0000 7fa820eea700 1 -- 172.21.15.134:0/132102093 shutdown_connections 2024-02-16T22:16:01.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.349+0000 7fa820eea700 1 --2- 172.21.15.134:0/132102093 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa8040692a0 0x7fa80406b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:01.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.349+0000 7fa820eea700 1 --2- 172.21.15.134:0/132102093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81c0fdfe0 0x7fa81c1139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:01.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.349+0000 7fa820eea700 1 --2- 172.21.15.134:0/132102093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c0fe8f0 0x7fa81c113f30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:01.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.349+0000 7fa820eea700 1 -- 172.21.15.134:0/132102093 >> 172.21.15.134:0/132102093 conn(0x7fa81c071d90 msgr2=0x7fa81c101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:01.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.349+0000 7fa820eea700 1 -- 172.21.15.134:0/132102093 shutdown_connections 2024-02-16T22:16:01.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:01.349+0000 7fa820eea700 1 -- 172.21.15.134:0/132102093 wait complete. 2024-02-16T22:16:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:01 smithi134 ceph-mon[28869]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:01 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/132102093' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-16T22:16:02.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:01 smithi173 ceph-mon[37280]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:02.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:01 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/132102093' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-16T22:16:02.638 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724554 got 167503724556 for osd.5 2024-02-16T22:16:02.639 DEBUG:teuthology.parallel:result is None 2024-02-16T22:16:02.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.923+0000 7f67bee96700 1 -- 172.21.15.134:0/2881419976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b8102f50 msgr2=0x7f67b8103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:02.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.923+0000 7f67bee96700 1 --2- 172.21.15.134:0/2881419976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b8102f50 0x7f67b8103320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f67b4004940 tx=0x7f67b4009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:02.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.923+0000 7f67bee96700 1 -- 172.21.15.134:0/2881419976 shutdown_connections 2024-02-16T22:16:02.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.923+0000 7f67bee96700 1 --2- 172.21.15.134:0/2881419976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67b81038f0 0x7f67b80fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:02.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.923+0000 7f67bee96700 1 --2- 172.21.15.134:0/2881419976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b8102f50 0x7f67b8103320 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:02.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.923+0000 7f67bee96700 1 -- 172.21.15.134:0/2881419976 >> 172.21.15.134:0/2881419976 conn(0x7f67b80f8ae0 msgr2=0x7f67b80faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:02.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.923+0000 7f67bee96700 1 -- 172.21.15.134:0/2881419976 shutdown_connections 2024-02-16T22:16:02.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.923+0000 7f67bee96700 1 -- 172.21.15.134:0/2881419976 wait complete. 2024-02-16T22:16:02.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.923+0000 7f67bee96700 1 Processor -- start 2024-02-16T22:16:02.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.924+0000 7f67bee96700 1 -- start start 2024-02-16T22:16:02.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.924+0000 7f67bee96700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67b8102f50 0x7f67b8113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:02.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.924+0000 7f67bee96700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b81038f0 0x7f67b8113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:02.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.924+0000 7f67bee96700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b8114600 con 0x7f67b81038f0 2024-02-16T22:16:02.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.924+0000 7f67bee96700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b810d930 con 0x7f67b8102f50 2024-02-16T22:16:02.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.924+0000 7f67affff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b81038f0 0x7f67b8113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:02.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.924+0000 7f67affff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b81038f0 0x7f67b8113fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41314/0 (socket says 172.21.15.134:41314) 2024-02-16T22:16:02.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.924+0000 7f67affff700 1 -- 172.21.15.134:0/1645424305 learned_addr learned my addr 172.21.15.134:0/1645424305 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:02.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.924+0000 7f67bcc32700 1 --2- 172.21.15.134:0/1645424305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67b8102f50 0x7f67b8113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:02.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.924+0000 7f67affff700 1 -- 172.21.15.134:0/1645424305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67b8102f50 msgr2=0x7f67b8113a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:02.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.924+0000 7f67affff700 1 --2- 172.21.15.134:0/1645424305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67b8102f50 0x7f67b8113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:02.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.924+0000 7f67affff700 1 -- 172.21.15.134:0/1645424305 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b4005040 con 0x7f67b81038f0 2024-02-16T22:16:02.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.924+0000 7f67affff700 1 --2- 172.21.15.134:0/1645424305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b81038f0 0x7f67b8113fb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f67a800c7e0 tx=0x7f67a8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:02.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.925+0000 7f67ad7fa700 1 -- 172.21.15.134:0/1645424305 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67a8012810 con 0x7f67b81038f0 2024-02-16T22:16:02.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.925+0000 7f67ad7fa700 1 -- 172.21.15.134:0/1645424305 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f67a8012e40 con 0x7f67b81038f0 2024-02-16T22:16:02.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.925+0000 7f67bee96700 1 -- 172.21.15.134:0/1645424305 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b810dc10 con 0x7f67b81038f0 2024-02-16T22:16:02.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.925+0000 7f67ad7fa700 1 -- 172.21.15.134:0/1645424305 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67a800a550 con 0x7f67b81038f0 2024-02-16T22:16:02.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.925+0000 7f67bee96700 1 -- 172.21.15.134:0/1645424305 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b810e150 con 0x7f67b81038f0 2024-02-16T22:16:02.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.926+0000 7f67bee96700 1 -- 172.21.15.134:0/1645424305 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b80fc6e0 con 0x7f67b81038f0 2024-02-16T22:16:02.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.926+0000 7f67ad7fa700 1 -- 172.21.15.134:0/1645424305 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f67a8011380 con 0x7f67b81038f0 2024-02-16T22:16:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.926+0000 7f67ad7fa700 1 --2- 172.21.15.134:0/1645424305 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f67a00692a0 0x7f67a006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.927+0000 7f67bcc32700 1 --2- 172.21.15.134:0/1645424305 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f67a00692a0 0x7f67a006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.927+0000 7f67ad7fa700 1 -- 172.21.15.134:0/1645424305 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f67a8087240 con 0x7f67b81038f0 2024-02-16T22:16:02.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.927+0000 7f67bcc32700 1 --2- 172.21.15.134:0/1645424305 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f67a00692a0 0x7f67a006b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f67b4004560 tx=0x7f67b4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:02.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:02.931+0000 7f67ad7fa700 1 -- 172.21.15.134:0/1645424305 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f67a80572c0 con 0x7f67b81038f0 2024-02-16T22:16:03.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:03.114+0000 7f67bee96700 1 -- 172.21.15.134:0/1645424305 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f67b804bed0 con 0x7f67b81038f0 2024-02-16T22:16:03.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:03.115+0000 7f67ad7fa700 1 -- 172.21.15.134:0/1645424305 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67a8011630 con 0x7f67b81038f0 2024-02-16T22:16:03.117 INFO:teuthology.orchestra.run.smithi134.stdout:60129542175 2024-02-16T22:16:03.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:03.117+0000 7f67bee96700 1 -- 172.21.15.134:0/1645424305 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f67a00692a0 msgr2=0x7f67a006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:03.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:03.117+0000 7f67bee96700 1 --2- 172.21.15.134:0/1645424305 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f67a00692a0 0x7f67a006b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f67b4004560 tx=0x7f67b4009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:03.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:03.117+0000 7f67bee96700 1 -- 172.21.15.134:0/1645424305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b81038f0 msgr2=0x7f67b8113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:03.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:03.117+0000 7f67bee96700 1 --2- 172.21.15.134:0/1645424305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b81038f0 0x7f67b8113fb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f67a800c7e0 tx=0x7f67a8007f90 comp rx=0 tx=0).stop 2024-02-16T22:16:03.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:03.117+0000 7f67bee96700 1 -- 172.21.15.134:0/1645424305 shutdown_connections 2024-02-16T22:16:03.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:03.117+0000 7f67bee96700 1 --2- 172.21.15.134:0/1645424305 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f67a00692a0 0x7f67a006b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:03.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:03.117+0000 7f67bee96700 1 --2- 172.21.15.134:0/1645424305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67b8102f50 0x7f67b8113a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:03.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:03.117+0000 7f67bee96700 1 --2- 172.21.15.134:0/1645424305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67b81038f0 0x7f67b8113fb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:03.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:03.117+0000 7f67bee96700 1 -- 172.21.15.134:0/1645424305 >> 172.21.15.134:0/1645424305 conn(0x7f67b80f8ae0 msgr2=0x7f67b80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:03.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:03.117+0000 7f67bee96700 1 -- 172.21.15.134:0/1645424305 shutdown_connections 2024-02-16T22:16:03.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:03.117+0000 7f67bee96700 1 -- 172.21.15.134:0/1645424305 wait complete. 2024-02-16T22:16:03.760 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542172 got 60129542175 for osd.1 2024-02-16T22:16:03.760 DEBUG:teuthology.parallel:result is None 2024-02-16T22:16:03.761 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-16T22:16:03.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph pg dump --format=json 2024-02-16T22:16:03.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:03 smithi173 ceph-mon[37280]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:03.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:03 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/1645424305' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-16T22:16:04.017 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:04.139 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:03 smithi134 ceph-mon[28869]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:04.139 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:03 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/1645424305' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-16T22:16:05.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.450+0000 7f02870ae700 1 -- 172.21.15.134:0/2078044972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0280101e40 msgr2=0x7f0280102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:05.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.450+0000 7f02870ae700 1 --2- 172.21.15.134:0/2078044972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0280101e40 0x7f0280102210 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0270004940 tx=0x7f0270009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:05.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.450+0000 7f02870ae700 1 -- 172.21.15.134:0/2078044972 shutdown_connections 2024-02-16T22:16:05.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.450+0000 7f02870ae700 1 --2- 172.21.15.134:0/2078044972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02801027e0 0x7f02800fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:05.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.450+0000 7f02870ae700 1 --2- 172.21.15.134:0/2078044972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0280101e40 0x7f0280102210 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:05.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.450+0000 7f02870ae700 1 -- 172.21.15.134:0/2078044972 >> 172.21.15.134:0/2078044972 conn(0x7f0280071d90 msgr2=0x7f0280072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:05.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.450+0000 7f02870ae700 1 -- 172.21.15.134:0/2078044972 shutdown_connections 2024-02-16T22:16:05.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.450+0000 7f02870ae700 1 -- 172.21.15.134:0/2078044972 wait complete. 2024-02-16T22:16:05.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.450+0000 7f02870ae700 1 Processor -- start 2024-02-16T22:16:05.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.450+0000 7f02870ae700 1 -- start start 2024-02-16T22:16:05.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.451+0000 7f02870ae700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0280101e40 0x7f0280112970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:05.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.451+0000 7f02870ae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02801027e0 0x7f0280112eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:05.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.451+0000 7f02870ae700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0280113590 con 0x7f02801027e0 2024-02-16T22:16:05.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.451+0000 7f02870ae700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028010c830 con 0x7f0280101e40 2024-02-16T22:16:05.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.451+0000 7f027ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02801027e0 0x7f0280112eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:05.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.451+0000 7f027ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02801027e0 0x7f0280112eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41330/0 (socket says 172.21.15.134:41330) 2024-02-16T22:16:05.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.451+0000 7f027ffff700 1 -- 172.21.15.134:0/198895991 learned_addr learned my addr 172.21.15.134:0/198895991 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:05.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.451+0000 7f0284e4a700 1 --2- 172.21.15.134:0/198895991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0280101e40 0x7f0280112970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:05.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.451+0000 7f027ffff700 1 -- 172.21.15.134:0/198895991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0280101e40 msgr2=0x7f0280112970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:05.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.451+0000 7f027ffff700 1 --2- 172.21.15.134:0/198895991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0280101e40 0x7f0280112970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:05.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.451+0000 7f027ffff700 1 -- 172.21.15.134:0/198895991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0270005040 con 0x7f02801027e0 2024-02-16T22:16:05.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.451+0000 7f027ffff700 1 --2- 172.21.15.134:0/198895991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02801027e0 0x7f0280112eb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f027400b790 tx=0x7f0274009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:05.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.452+0000 7f027d7fa700 1 -- 172.21.15.134:0/198895991 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f027400f6f0 con 0x7f02801027e0 2024-02-16T22:16:05.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.452+0000 7f027d7fa700 1 -- 172.21.15.134:0/198895991 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f027400fd20 con 0x7f02801027e0 2024-02-16T22:16:05.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.452+0000 7f02870ae700 1 -- 172.21.15.134:0/198895991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028010cb10 con 0x7f02801027e0 2024-02-16T22:16:05.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.452+0000 7f027d7fa700 1 -- 172.21.15.134:0/198895991 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02740103a0 con 0x7f02801027e0 2024-02-16T22:16:05.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.452+0000 7f02870ae700 1 -- 172.21.15.134:0/198895991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028010d050 con 0x7f02801027e0 2024-02-16T22:16:05.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.453+0000 7f02870ae700 1 -- 172.21.15.134:0/198895991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02800738b0 con 0x7f02801027e0 2024-02-16T22:16:05.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.453+0000 7f027d7fa700 1 -- 172.21.15.134:0/198895991 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f0274011400 con 0x7f02801027e0 2024-02-16T22:16:05.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.453+0000 7f027d7fa700 1 --2- 172.21.15.134:0/198895991 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f02680692a0 0x7f026806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:05.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.453+0000 7f0284e4a700 1 --2- 172.21.15.134:0/198895991 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f02680692a0 0x7f026806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:05.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.453+0000 7f027d7fa700 1 -- 172.21.15.134:0/198895991 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0274086b20 con 0x7f02801027e0 2024-02-16T22:16:05.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.454+0000 7f0284e4a700 1 --2- 172.21.15.134:0/198895991 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f02680692a0 0x7f026806b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0270004f90 tx=0x7f0270009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:05.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.458+0000 7f027d7fa700 1 -- 172.21.15.134:0/198895991 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f0274056cc0 con 0x7f02801027e0 2024-02-16T22:16:05.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.636+0000 7f02870ae700 1 -- 172.21.15.134:0/198895991 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f028004bed0 con 0x7f02680692a0 2024-02-16T22:16:05.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.638+0000 7f027d7fa700 1 -- 172.21.15.134:0/198895991 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28220 (secure 0 0 0) 0x7f028004bed0 con 0x7f02680692a0 2024-02-16T22:16:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:16:05.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.640+0000 7f02870ae700 1 -- 172.21.15.134:0/198895991 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f02680692a0 msgr2=0x7f026806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:05.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.640+0000 7f02870ae700 1 --2- 172.21.15.134:0/198895991 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f02680692a0 0x7f026806b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0270004f90 tx=0x7f0270009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:05.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.640+0000 7f02870ae700 1 -- 172.21.15.134:0/198895991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02801027e0 msgr2=0x7f0280112eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:05.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.640+0000 7f02870ae700 1 --2- 172.21.15.134:0/198895991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02801027e0 0x7f0280112eb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f027400b790 tx=0x7f0274009220 comp rx=0 tx=0).stop 2024-02-16T22:16:05.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.641+0000 7f02870ae700 1 -- 172.21.15.134:0/198895991 shutdown_connections 2024-02-16T22:16:05.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.641+0000 7f02870ae700 1 --2- 172.21.15.134:0/198895991 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f02680692a0 0x7f026806b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:05.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.641+0000 7f02870ae700 1 --2- 172.21.15.134:0/198895991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0280101e40 0x7f0280112970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:05.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.641+0000 7f02870ae700 1 --2- 172.21.15.134:0/198895991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02801027e0 0x7f0280112eb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:05.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.641+0000 7f02870ae700 1 -- 172.21.15.134:0/198895991 >> 172.21.15.134:0/198895991 conn(0x7f0280071d90 msgr2=0x7f02800fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:05.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.641+0000 7f02870ae700 1 -- 172.21.15.134:0/198895991 shutdown_connections 2024-02-16T22:16:05.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:05.641+0000 7f02870ae700 1 -- 172.21.15.134:0/198895991 wait complete. 2024-02-16T22:16:05.644 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-02-16T22:16:06.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:05 smithi134 ceph-mon[28869]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:06.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:05 smithi173 ceph-mon[37280]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:06.241 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-02-16T22:16:04.901431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787604,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683308,"statfs":{"total":575970213888,"available":574139707392,"internally_reserved":0,"allocated":3969024,"data_stored":2606262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001840"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":189,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-16T22:15:15.451494+0000","last_change":"2024-02-16T22:14:49.846333+0000","last_active":"2024-02-16T22:15:15.451494+0000","last_peered":"2024-02-16T22:15:15.451494+0000","last_clean":"2024-02-16T22:15:15.451494+0000","last_became_active":"2024-02-16T22:14:49.845984+0000","last_became_peered":"2024-02-16T22:14:49.845984+0000","last_unstale":"2024-02-16T22:15:15.451494+0000","last_undegraded":"2024-02-16T22:15:15.451494+0000","last_fullsized":"2024-02-16T22:15:15.451494+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T22:14:01.430283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T22:14:01.430283+0000","last_clean_scrub_stamp":"2024-02-16T22:14:01.430283+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:26:31.679924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 22:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Feb 16 22:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Feb 16 22:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.499}]},{"osd":3,"last update":"Fri Feb 16 22:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.432},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149718,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 22:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.503},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Feb 16 22:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Feb 16 22:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Feb 16 22:15:50 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 22:15:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.30499999999999999}]},{"osd":1,"last update":"Fri Feb 16 22:15:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Feb 16 22:15:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Feb 16 22:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 22:15:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33400000000000002},"min":{"1min":0.25900000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.34699999999999998},"min":{"1min":0.28199999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Feb 16 22:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.252},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.29299999999999998}]},{"osd":3,"last update":"Fri Feb 16 22:15:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.497},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Feb 16 22:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 22:15:37 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34000000000000002},"min":{"1min":0.24299999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47299999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.189},{"interface":"front","average":{"1min":0.37,"5min":0.34499999999999997,"15min":0.34100000000000003},"min":{"1min":0.26900000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.23400000000000001}]},{"osd":2,"last update":"Fri Feb 16 22:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.253}]},{"osd":3,"last update":"Fri Feb 16 22:15:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.49299999999999999}]},{"osd":4,"last update":"Fri Feb 16 22:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T22:16:06.243 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph pg dump --format=json 2024-02-16T22:16:06.501 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:07.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:06 smithi134 ceph-mon[28869]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-16T22:16:07.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:06 smithi173 ceph-mon[37280]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-16T22:16:08.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.057+0000 7fb9531a6700 1 -- 172.21.15.134:0/527930311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb94c0fb560 msgr2=0x7fb94c0fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:08.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.057+0000 7fb9531a6700 1 --2- 172.21.15.134:0/527930311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb94c0fb560 0x7fb94c0fb9d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb938004940 tx=0x7fb938009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:08.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.058+0000 7fb9531a6700 1 -- 172.21.15.134:0/527930311 shutdown_connections 2024-02-16T22:16:08.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.058+0000 7fb9531a6700 1 --2- 172.21.15.134:0/527930311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb94c0fb560 0x7fb94c0fb9d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:08.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.058+0000 7fb9531a6700 1 --2- 172.21.15.134:0/527930311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb94c102fe0 0x7fb94c1033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:08.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.058+0000 7fb9531a6700 1 -- 172.21.15.134:0/527930311 >> 172.21.15.134:0/527930311 conn(0x7fb94c071500 msgr2=0x7fb94c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:08.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.058+0000 7fb9531a6700 1 -- 172.21.15.134:0/527930311 shutdown_connections 2024-02-16T22:16:08.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.058+0000 7fb9531a6700 1 -- 172.21.15.134:0/527930311 wait complete. 2024-02-16T22:16:08.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.058+0000 7fb9531a6700 1 Processor -- start 2024-02-16T22:16:08.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.058+0000 7fb9531a6700 1 -- start start 2024-02-16T22:16:08.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.058+0000 7fb9531a6700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb94c0fb560 0x7fb94c0fc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:08.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.058+0000 7fb9531a6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb94c102fe0 0x7fb94c0fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:08.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.058+0000 7fb9531a6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c0fd380 con 0x7fb94c102fe0 2024-02-16T22:16:08.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.058+0000 7fb9531a6700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c0fd4f0 con 0x7fb94c0fb560 2024-02-16T22:16:08.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.059+0000 7fb94bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb94c102fe0 0x7fb94c0fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:08.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.059+0000 7fb94bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb94c102fe0 0x7fb94c0fcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41338/0 (socket says 172.21.15.134:41338) 2024-02-16T22:16:08.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.059+0000 7fb94bfff700 1 -- 172.21.15.134:0/346184212 learned_addr learned my addr 172.21.15.134:0/346184212 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:08.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.059+0000 7fb950f42700 1 --2- 172.21.15.134:0/346184212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb94c0fb560 0x7fb94c0fc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:08.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.059+0000 7fb94bfff700 1 -- 172.21.15.134:0/346184212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb94c0fb560 msgr2=0x7fb94c0fc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:08.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.059+0000 7fb94bfff700 1 --2- 172.21.15.134:0/346184212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb94c0fb560 0x7fb94c0fc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:08.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.059+0000 7fb94bfff700 1 -- 172.21.15.134:0/346184212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb938005040 con 0x7fb94c102fe0 2024-02-16T22:16:08.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.059+0000 7fb950f42700 1 --2- 172.21.15.134:0/346184212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb94c0fb560 0x7fb94c0fc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:16:08.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.059+0000 7fb94bfff700 1 --2- 172.21.15.134:0/346184212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb94c102fe0 0x7fb94c0fcca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb93800b3b0 tx=0x7fb938009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:08.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.059+0000 7fb9497fa700 1 -- 172.21.15.134:0/346184212 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93800e040 con 0x7fb94c102fe0 2024-02-16T22:16:08.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.059+0000 7fb9497fa700 1 -- 172.21.15.134:0/346184212 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb93800bbf0 con 0x7fb94c102fe0 2024-02-16T22:16:08.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.059+0000 7fb9497fa700 1 -- 172.21.15.134:0/346184212 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93801c630 con 0x7fb94c102fe0 2024-02-16T22:16:08.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.059+0000 7fb9531a6700 1 -- 172.21.15.134:0/346184212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94c119da0 con 0x7fb94c102fe0 2024-02-16T22:16:08.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.059+0000 7fb9531a6700 1 -- 172.21.15.134:0/346184212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c11a260 con 0x7fb94c102fe0 2024-02-16T22:16:08.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.060+0000 7fb9531a6700 1 -- 172.21.15.134:0/346184212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c100290 con 0x7fb94c102fe0 2024-02-16T22:16:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.061+0000 7fb9497fa700 1 -- 172.21.15.134:0/346184212 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb93800bd60 con 0x7fb94c102fe0 2024-02-16T22:16:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.061+0000 7fb9497fa700 1 --2- 172.21.15.134:0/346184212 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb93c0692a0 0x7fb93c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.061+0000 7fb9497fa700 1 -- 172.21.15.134:0/346184212 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb938088240 con 0x7fb94c102fe0 2024-02-16T22:16:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.061+0000 7fb950f42700 1 --2- 172.21.15.134:0/346184212 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb93c0692a0 0x7fb93c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:08.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.062+0000 7fb950f42700 1 --2- 172.21.15.134:0/346184212 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb93c0692a0 0x7fb93c06b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0658f0 tx=0x7fb940008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:08.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.066+0000 7fb9497fa700 1 -- 172.21.15.134:0/346184212 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb9380548b0 con 0x7fb94c102fe0 2024-02-16T22:16:08.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:07 smithi134 ceph-mon[28869]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:08.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:07 smithi173 ceph-mon[37280]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:08.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.243+0000 7fb9531a6700 1 -- 172.21.15.134:0/346184212 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb94c04bed0 con 0x7fb93c0692a0 2024-02-16T22:16:08.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.244+0000 7fb9497fa700 1 -- 172.21.15.134:0/346184212 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28206 (secure 0 0 0) 0x7fb94c04bed0 con 0x7fb93c0692a0 2024-02-16T22:16:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:16:08.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.246+0000 7fb9531a6700 1 -- 172.21.15.134:0/346184212 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb93c0692a0 msgr2=0x7fb93c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:08.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.246+0000 7fb9531a6700 1 --2- 172.21.15.134:0/346184212 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb93c0692a0 0x7fb93c06b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0658f0 tx=0x7fb940008040 comp rx=0 tx=0).stop 2024-02-16T22:16:08.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.246+0000 7fb9531a6700 1 -- 172.21.15.134:0/346184212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb94c102fe0 msgr2=0x7fb94c0fcca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:08.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.246+0000 7fb9531a6700 1 --2- 172.21.15.134:0/346184212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb94c102fe0 0x7fb94c0fcca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb93800b3b0 tx=0x7fb938009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:08.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.246+0000 7fb9531a6700 1 -- 172.21.15.134:0/346184212 shutdown_connections 2024-02-16T22:16:08.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.246+0000 7fb9531a6700 1 --2- 172.21.15.134:0/346184212 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fb93c0692a0 0x7fb93c06b750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:08.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.246+0000 7fb9531a6700 1 --2- 172.21.15.134:0/346184212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb94c0fb560 0x7fb94c0fc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:08.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.246+0000 7fb9531a6700 1 --2- 172.21.15.134:0/346184212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb94c102fe0 0x7fb94c0fcca0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:08.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.246+0000 7fb9531a6700 1 -- 172.21.15.134:0/346184212 >> 172.21.15.134:0/346184212 conn(0x7fb94c071500 msgr2=0x7fb94c0fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:08.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.246+0000 7fb9531a6700 1 -- 172.21.15.134:0/346184212 shutdown_connections 2024-02-16T22:16:08.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:08.246+0000 7fb9531a6700 1 -- 172.21.15.134:0/346184212 wait complete. 2024-02-16T22:16:08.250 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-02-16T22:16:08.939 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-02-16T22:16:06.901676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787604,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683308,"statfs":{"total":575970213888,"available":574139707392,"internally_reserved":0,"allocated":3969024,"data_stored":2606262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001817"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":189,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-16T22:15:15.451494+0000","last_change":"2024-02-16T22:14:49.846333+0000","last_active":"2024-02-16T22:15:15.451494+0000","last_peered":"2024-02-16T22:15:15.451494+0000","last_clean":"2024-02-16T22:15:15.451494+0000","last_became_active":"2024-02-16T22:14:49.845984+0000","last_became_peered":"2024-02-16T22:14:49.845984+0000","last_unstale":"2024-02-16T22:15:15.451494+0000","last_undegraded":"2024-02-16T22:15:15.451494+0000","last_fullsized":"2024-02-16T22:15:15.451494+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T22:14:01.430283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T22:14:01.430283+0000","last_clean_scrub_stamp":"2024-02-16T22:14:01.430283+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T05:26:31.679924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 22:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Feb 16 22:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Feb 16 22:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.499}]},{"osd":3,"last update":"Fri Feb 16 22:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.432},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149718,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 22:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.503},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Feb 16 22:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Feb 16 22:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Feb 16 22:15:50 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 22:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.35299999999999998,"15min":0.35699999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46999999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.373,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.52600000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Feb 16 22:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.46800000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.40200000000000002,"15min":0.40999999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.32200000000000001}]},{"osd":3,"last update":"Fri Feb 16 22:15:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.501},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Feb 16 22:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 22:15:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33400000000000002},"min":{"1min":0.25900000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.34699999999999998},"min":{"1min":0.28199999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Feb 16 22:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.252},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.29299999999999998}]},{"osd":3,"last update":"Fri Feb 16 22:15:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.497},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Feb 16 22:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 22:15:37 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34000000000000002},"min":{"1min":0.24299999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47299999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.189},{"interface":"front","average":{"1min":0.37,"5min":0.34499999999999997,"15min":0.34100000000000003},"min":{"1min":0.26900000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.23400000000000001}]},{"osd":2,"last update":"Fri Feb 16 22:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.253}]},{"osd":3,"last update":"Fri Feb 16 22:15:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.49299999999999999}]},{"osd":4,"last update":"Fri Feb 16 22:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T22:16:08.940 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-16T22:16:08.940 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-16T22:16:08.940 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-16T22:16:08.940 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph health --format=json 2024-02-16T22:16:09.194 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:09.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:08 smithi134 ceph-mon[28869]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-16T22:16:09.230 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:08 smithi173 ceph-mon[37280]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-16T22:16:10.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:09 smithi134 ceph-mon[28869]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:10.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:09 smithi173 ceph-mon[37280]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:10.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.778+0000 7fa157609700 1 -- 172.21.15.134:0/772466221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa150101e60 msgr2=0x7fa150102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:10.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.778+0000 7fa157609700 1 --2- 172.21.15.134:0/772466221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa150101e60 0x7fa150102230 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa140004940 tx=0x7fa140009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:10.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.778+0000 7fa157609700 1 -- 172.21.15.134:0/772466221 shutdown_connections 2024-02-16T22:16:10.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.778+0000 7fa157609700 1 --2- 172.21.15.134:0/772466221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa150102800 0x7fa1500fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:10.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.778+0000 7fa157609700 1 --2- 172.21.15.134:0/772466221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa150101e60 0x7fa150102230 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:10.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.778+0000 7fa157609700 1 -- 172.21.15.134:0/772466221 >> 172.21.15.134:0/772466221 conn(0x7fa1500f7a10 msgr2=0x7fa1500f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:10.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.778+0000 7fa157609700 1 -- 172.21.15.134:0/772466221 shutdown_connections 2024-02-16T22:16:10.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.778+0000 7fa157609700 1 -- 172.21.15.134:0/772466221 wait complete. 2024-02-16T22:16:10.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.779+0000 7fa157609700 1 Processor -- start 2024-02-16T22:16:10.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.779+0000 7fa157609700 1 -- start start 2024-02-16T22:16:10.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.779+0000 7fa157609700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa150101e60 0x7fa150112a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:10.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.779+0000 7fa157609700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa150102800 0x7fa150112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:10.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.779+0000 7fa157609700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501135a0 con 0x7fa150102800 2024-02-16T22:16:10.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.779+0000 7fa157609700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15010c8d0 con 0x7fa150101e60 2024-02-16T22:16:10.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.779+0000 7fa154ba4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa150102800 0x7fa150112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:10.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.779+0000 7fa154ba4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa150102800 0x7fa150112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41362/0 (socket says 172.21.15.134:41362) 2024-02-16T22:16:10.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.779+0000 7fa154ba4700 1 -- 172.21.15.134:0/3784995975 learned_addr learned my addr 172.21.15.134:0/3784995975 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:10.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.780+0000 7fa1553a5700 1 --2- 172.21.15.134:0/3784995975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa150101e60 0x7fa150112a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:10.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.780+0000 7fa154ba4700 1 -- 172.21.15.134:0/3784995975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa150101e60 msgr2=0x7fa150112a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:10.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.780+0000 7fa154ba4700 1 --2- 172.21.15.134:0/3784995975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa150101e60 0x7fa150112a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:10.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.780+0000 7fa154ba4700 1 -- 172.21.15.134:0/3784995975 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140005040 con 0x7fa150102800 2024-02-16T22:16:10.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.780+0000 7fa154ba4700 1 --2- 172.21.15.134:0/3784995975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa150102800 0x7fa150112f50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa14c002a50 tx=0x7fa14c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:10.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.780+0000 7fa145ffb700 1 -- 172.21.15.134:0/3784995975 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa14c007cc0 con 0x7fa150102800 2024-02-16T22:16:10.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.780+0000 7fa157609700 1 -- 172.21.15.134:0/3784995975 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15010cbb0 con 0x7fa150102800 2024-02-16T22:16:10.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.780+0000 7fa145ffb700 1 -- 172.21.15.134:0/3784995975 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa14c00f040 con 0x7fa150102800 2024-02-16T22:16:10.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.780+0000 7fa145ffb700 1 -- 172.21.15.134:0/3784995975 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa14c00d9c0 con 0x7fa150102800 2024-02-16T22:16:10.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.780+0000 7fa157609700 1 -- 172.21.15.134:0/3784995975 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15010d0f0 con 0x7fa150102800 2024-02-16T22:16:10.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.781+0000 7fa157609700 1 -- 172.21.15.134:0/3784995975 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1500ff170 con 0x7fa150102800 2024-02-16T22:16:10.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.782+0000 7fa145ffb700 1 -- 172.21.15.134:0/3784995975 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa14c009730 con 0x7fa150102800 2024-02-16T22:16:10.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.782+0000 7fa145ffb700 1 --2- 172.21.15.134:0/3784995975 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa13c0692a0 0x7fa13c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:10.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.782+0000 7fa1553a5700 1 --2- 172.21.15.134:0/3784995975 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa13c0692a0 0x7fa13c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:10.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.782+0000 7fa145ffb700 1 -- 172.21.15.134:0/3784995975 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa14c086bf0 con 0x7fa150102800 2024-02-16T22:16:10.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.782+0000 7fa1553a5700 1 --2- 172.21.15.134:0/3784995975 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa13c0692a0 0x7fa13c06b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa140004f90 tx=0x7fa140009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:10.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:10.786+0000 7fa145ffb700 1 -- 172.21.15.134:0/3784995975 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa14c056c70 con 0x7fa150102800 2024-02-16T22:16:11.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:11.013+0000 7fa157609700 1 -- 172.21.15.134:0/3784995975 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa150108f60 con 0x7fa150102800 2024-02-16T22:16:11.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:11.013+0000 7fa145ffb700 1 -- 172.21.15.134:0/3784995975 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa14c056800 con 0x7fa150102800 2024-02-16T22:16:11.015 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:16:11.015 INFO:teuthology.orchestra.run.smithi134.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-16T22:16:11.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:11.015+0000 7fa157609700 1 -- 172.21.15.134:0/3784995975 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa13c0692a0 msgr2=0x7fa13c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:11.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:11.015+0000 7fa157609700 1 --2- 172.21.15.134:0/3784995975 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa13c0692a0 0x7fa13c06b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa140004f90 tx=0x7fa140009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:11.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:11.015+0000 7fa157609700 1 -- 172.21.15.134:0/3784995975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa150102800 msgr2=0x7fa150112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:11.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:11.015+0000 7fa157609700 1 --2- 172.21.15.134:0/3784995975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa150102800 0x7fa150112f50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa14c002a50 tx=0x7fa14c004600 comp rx=0 tx=0).stop 2024-02-16T22:16:11.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:11.015+0000 7fa157609700 1 -- 172.21.15.134:0/3784995975 shutdown_connections 2024-02-16T22:16:11.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:11.015+0000 7fa157609700 1 --2- 172.21.15.134:0/3784995975 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fa13c0692a0 0x7fa13c06b750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:11.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:11.015+0000 7fa157609700 1 --2- 172.21.15.134:0/3784995975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa150101e60 0x7fa150112a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:11.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:11.015+0000 7fa157609700 1 --2- 172.21.15.134:0/3784995975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa150102800 0x7fa150112f50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:11.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:11.015+0000 7fa157609700 1 -- 172.21.15.134:0/3784995975 >> 172.21.15.134:0/3784995975 conn(0x7fa1500f7a10 msgr2=0x7fa1500f9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:11.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:11.015+0000 7fa157609700 1 -- 172.21.15.134:0/3784995975 shutdown_connections 2024-02-16T22:16:11.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:11.015+0000 7fa157609700 1 -- 172.21.15.134:0/3784995975 wait complete. 2024-02-16T22:16:11.627 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-16T22:16:11.627 INFO:tasks.cephadm:Setup complete, yielding 2024-02-16T22:16:11.628 INFO:teuthology.run_tasks:Running task print... 2024-02-16T22:16:11.637 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-02-16T22:16:11.637 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-16T22:16:11.674 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T22:16:11.674 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-02-16T22:16:11.928 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:12.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:11 smithi134 ceph-mon[28869]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:12.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:11 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/3784995975' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-16T22:16:12.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:11 smithi173 ceph-mon[37280]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:12.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:11 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/3784995975' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-16T22:16:13.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:12 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:16:13.308 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:12 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:16:13.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.523+0000 7f56091bb700 1 -- 172.21.15.134:0/4058534341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56040fe2b0 msgr2=0x7f56040fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:13.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.523+0000 7f56091bb700 1 --2- 172.21.15.134:0/4058534341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56040fe2b0 0x7f56040fe700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f55ec004940 tx=0x7f55ec009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:13.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.523+0000 7f56091bb700 1 -- 172.21.15.134:0/4058534341 shutdown_connections 2024-02-16T22:16:13.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.523+0000 7f56091bb700 1 --2- 172.21.15.134:0/4058534341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56040fe2b0 0x7f56040fe700 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:13.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.523+0000 7f56091bb700 1 --2- 172.21.15.134:0/4058534341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56040fb220 0x7f56040fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:13.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.523+0000 7f56091bb700 1 -- 172.21.15.134:0/4058534341 >> 172.21.15.134:0/4058534341 conn(0x7f56040f6ca0 msgr2=0x7f56040f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:13.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.523+0000 7f56091bb700 1 -- 172.21.15.134:0/4058534341 shutdown_connections 2024-02-16T22:16:13.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.523+0000 7f56091bb700 1 -- 172.21.15.134:0/4058534341 wait complete. 2024-02-16T22:16:13.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.523+0000 7f56091bb700 1 Processor -- start 2024-02-16T22:16:13.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.523+0000 7f56091bb700 1 -- start start 2024-02-16T22:16:13.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.523+0000 7f56091bb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56040fb220 0x7f560410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:13.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f56091bb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56040fe2b0 0x7f560410df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:13.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f56091bb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560410e5e0 con 0x7f56040fe2b0 2024-02-16T22:16:13.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f56091bb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560410ee20 con 0x7f56040fb220 2024-02-16T22:16:13.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f55fa59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56040fe2b0 0x7f560410df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:13.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f55fa59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56040fe2b0 0x7f560410df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52870/0 (socket says 172.21.15.134:52870) 2024-02-16T22:16:13.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f55fa59c700 1 -- 172.21.15.134:0/2895861440 learned_addr learned my addr 172.21.15.134:0/2895861440 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:13.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f5602d9d700 1 --2- 172.21.15.134:0/2895861440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56040fb220 0x7f560410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:13.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f55fa59c700 1 -- 172.21.15.134:0/2895861440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56040fb220 msgr2=0x7f560410da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:13.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f55fa59c700 1 --2- 172.21.15.134:0/2895861440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56040fb220 0x7f560410da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:13.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f55fa59c700 1 -- 172.21.15.134:0/2895861440 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec005040 con 0x7f56040fe2b0 2024-02-16T22:16:13.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f5602d9d700 1 --2- 172.21.15.134:0/2895861440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56040fb220 0x7f560410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:16:13.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f55fa59c700 1 --2- 172.21.15.134:0/2895861440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56040fe2b0 0x7f560410df50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009180 tx=0x7f55ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:13.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f55fbfff700 1 -- 172.21.15.134:0/2895861440 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55ec00e040 con 0x7f56040fe2b0 2024-02-16T22:16:13.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f56091bb700 1 -- 172.21.15.134:0/2895861440 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560410f0a0 con 0x7f56040fe2b0 2024-02-16T22:16:13.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f55fbfff700 1 -- 172.21.15.134:0/2895861440 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55ec004290 con 0x7f56040fe2b0 2024-02-16T22:16:13.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f55fbfff700 1 -- 172.21.15.134:0/2895861440 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55ec013ea0 con 0x7f56040fe2b0 2024-02-16T22:16:13.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.524+0000 7f56091bb700 1 -- 172.21.15.134:0/2895861440 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560410f5e0 con 0x7f56040fe2b0 2024-02-16T22:16:13.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.525+0000 7f56091bb700 1 -- 172.21.15.134:0/2895861440 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560404bed0 con 0x7f56040fe2b0 2024-02-16T22:16:13.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.526+0000 7f55fbfff700 1 -- 172.21.15.134:0/2895861440 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f55ec00bbf0 con 0x7f56040fe2b0 2024-02-16T22:16:13.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.526+0000 7f55fbfff700 1 --2- 172.21.15.134:0/2895861440 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f55f00692a0 0x7f55f006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:13.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.526+0000 7f55fbfff700 1 -- 172.21.15.134:0/2895861440 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f55ec088280 con 0x7f56040fe2b0 2024-02-16T22:16:13.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.526+0000 7f5602d9d700 1 --2- 172.21.15.134:0/2895861440 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f55f00692a0 0x7f55f006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:13.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.527+0000 7f5602d9d700 1 --2- 172.21.15.134:0/2895861440 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f55f00692a0 0x7f55f006b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5604065420 tx=0x7f55f4008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:13.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.531+0000 7f55fbfff700 1 -- 172.21.15.134:0/2895861440 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f55ec058380 con 0x7f56040fe2b0 2024-02-16T22:16:13.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.716+0000 7f56091bb700 1 -- 172.21.15.134:0/2895861440 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f5604105ae0 con 0x7f56040fe2b0 2024-02-16T22:16:13.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.720+0000 7f55fbfff700 1 -- 172.21.15.134:0/2895861440 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f55ec057f10 con 0x7f56040fe2b0 2024-02-16T22:16:13.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.722+0000 7f56091bb700 1 -- 172.21.15.134:0/2895861440 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f55f00692a0 msgr2=0x7f55f006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:13.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.722+0000 7f56091bb700 1 --2- 172.21.15.134:0/2895861440 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f55f00692a0 0x7f55f006b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5604065420 tx=0x7f55f4008040 comp rx=0 tx=0).stop 2024-02-16T22:16:13.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.722+0000 7f56091bb700 1 -- 172.21.15.134:0/2895861440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56040fe2b0 msgr2=0x7f560410df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:13.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.722+0000 7f56091bb700 1 --2- 172.21.15.134:0/2895861440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56040fe2b0 0x7f560410df50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009180 tx=0x7f55ec009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:13.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.722+0000 7f56091bb700 1 -- 172.21.15.134:0/2895861440 shutdown_connections 2024-02-16T22:16:13.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.722+0000 7f56091bb700 1 --2- 172.21.15.134:0/2895861440 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f55f00692a0 0x7f55f006b750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:13.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.722+0000 7f56091bb700 1 --2- 172.21.15.134:0/2895861440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56040fb220 0x7f560410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:13.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.723+0000 7f56091bb700 1 --2- 172.21.15.134:0/2895861440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56040fe2b0 0x7f560410df50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:13.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.723+0000 7f56091bb700 1 -- 172.21.15.134:0/2895861440 >> 172.21.15.134:0/2895861440 conn(0x7f56040f6ca0 msgr2=0x7f56041014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:13.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.723+0000 7f56091bb700 1 -- 172.21.15.134:0/2895861440 shutdown_connections 2024-02-16T22:16:13.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:13.723+0000 7f56091bb700 1 -- 172.21.15.134:0/2895861440 wait complete. 2024-02-16T22:16:14.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:13 smithi134 ceph-mon[28869]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:14.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:13 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2895861440' entity='client.admin' 2024-02-16T22:16:14.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:13 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:16:14.400 INFO:teuthology.run_tasks:Running task print... 2024-02-16T22:16:14.409 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-02-16T22:16:14.409 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-16T22:16:14.423 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T22:16:14.423 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'ceph orch status' 2024-02-16T22:16:14.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:13 smithi173 ceph-mon[37280]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:14.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:13 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2895861440' entity='client.admin' 2024-02-16T22:16:14.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:13 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:16:14.674 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:15.097 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:14 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:16:15.097 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:14 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:16:15.097 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:14 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:15.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:14 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:16:15.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:14 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:16:15.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:14 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.391+0000 7f13e7b0c700 1 -- 172.21.15.134:0/2681588980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13e00fe0e0 msgr2=0x7f13e00fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.391+0000 7f13e7b0c700 1 --2- 172.21.15.134:0/2681588980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13e00fe0e0 0x7f13e00fe550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f13d0004940 tx=0x7f13d0009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.391+0000 7f13e7b0c700 1 -- 172.21.15.134:0/2681588980 shutdown_connections 2024-02-16T22:16:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.391+0000 7f13e7b0c700 1 --2- 172.21.15.134:0/2681588980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13e00fe0e0 0x7f13e00fe550 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.391+0000 7f13e7b0c700 1 --2- 172.21.15.134:0/2681588980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13e00fcef0 0x7f13e00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.391+0000 7f13e7b0c700 1 -- 172.21.15.134:0/2681588980 >> 172.21.15.134:0/2681588980 conn(0x7f13e00f8620 msgr2=0x7f13e00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.391+0000 7f13e7b0c700 1 -- 172.21.15.134:0/2681588980 shutdown_connections 2024-02-16T22:16:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.391+0000 7f13e7b0c700 1 -- 172.21.15.134:0/2681588980 wait complete. 2024-02-16T22:16:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.391+0000 7f13e7b0c700 1 Processor -- start 2024-02-16T22:16:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.391+0000 7f13e7b0c700 1 -- start start 2024-02-16T22:16:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13e7b0c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13e00fcef0 0x7f13e010d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13e7b0c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13e00fe0e0 0x7f13e010deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13e7b0c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e010e540 con 0x7f13e00fcef0 2024-02-16T22:16:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13e7b0c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e010ed80 con 0x7f13e00fe0e0 2024-02-16T22:16:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13e58a8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13e00fcef0 0x7f13e010d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13e58a8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13e00fcef0 0x7f13e010d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52898/0 (socket says 172.21.15.134:52898) 2024-02-16T22:16:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13e58a8700 1 -- 172.21.15.134:0/1538328167 learned_addr learned my addr 172.21.15.134:0/1538328167 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13e58a8700 1 -- 172.21.15.134:0/1538328167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13e00fe0e0 msgr2=0x7f13e010deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13e58a8700 1 --2- 172.21.15.134:0/1538328167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13e00fe0e0 0x7f13e010deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13e58a8700 1 -- 172.21.15.134:0/1538328167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d0005040 con 0x7f13e00fcef0 2024-02-16T22:16:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13e58a8700 1 --2- 172.21.15.134:0/1538328167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13e00fcef0 0x7f13e010d970 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00bae0 tx=0x7f13dc009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13d67fc700 1 -- 172.21.15.134:0/1538328167 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13dc00c8c0 con 0x7f13e00fcef0 2024-02-16T22:16:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13d67fc700 1 -- 172.21.15.134:0/1538328167 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13dc014410 con 0x7f13e00fcef0 2024-02-16T22:16:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13e7b0c700 1 -- 172.21.15.134:0/1538328167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e010f060 con 0x7f13e00fcef0 2024-02-16T22:16:16.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13d67fc700 1 -- 172.21.15.134:0/1538328167 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13dc007610 con 0x7f13e00fcef0 2024-02-16T22:16:16.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.392+0000 7f13e7b0c700 1 -- 172.21.15.134:0/1538328167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e010f5a0 con 0x7f13e00fcef0 2024-02-16T22:16:16.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.393+0000 7f13e7b0c700 1 -- 172.21.15.134:0/1538328167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e004bed0 con 0x7f13e00fcef0 2024-02-16T22:16:16.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.394+0000 7f13d67fc700 1 -- 172.21.15.134:0/1538328167 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f13dc014580 con 0x7f13e00fcef0 2024-02-16T22:16:16.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.394+0000 7f13d67fc700 1 --2- 172.21.15.134:0/1538328167 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f13cc0692a0 0x7f13cc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:16.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.394+0000 7f13d67fc700 1 -- 172.21.15.134:0/1538328167 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f13dc086f50 con 0x7f13e00fcef0 2024-02-16T22:16:16.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.394+0000 7f13e50a7700 1 --2- 172.21.15.134:0/1538328167 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f13cc0692a0 0x7f13cc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:16.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.395+0000 7f13e50a7700 1 --2- 172.21.15.134:0/1538328167 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f13cc0692a0 0x7f13cc06b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f13d0004f90 tx=0x7f13d0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:16.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.398+0000 7f13d67fc700 1 -- 172.21.15.134:0/1538328167 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f13dc04cbd0 con 0x7f13e00fcef0 2024-02-16T22:16:16.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:16 smithi134 ceph-mon[28869]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:16.517 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:16 smithi173 ceph-mon[37280]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:16.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.597+0000 7f13e7b0c700 1 -- 172.21.15.134:0/1538328167 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f13e0102ac0 con 0x7f13cc0692a0 2024-02-16T22:16:16.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.598+0000 7f13d67fc700 1 -- 172.21.15.134:0/1538328167 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f13e0102ac0 con 0x7f13cc0692a0 2024-02-16T22:16:16.600 INFO:teuthology.orchestra.run.smithi134.stdout:Backend: cephadm 2024-02-16T22:16:16.600 INFO:teuthology.orchestra.run.smithi134.stdout:Available: Yes 2024-02-16T22:16:16.600 INFO:teuthology.orchestra.run.smithi134.stdout:Paused: No 2024-02-16T22:16:16.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.600+0000 7f13e7b0c700 1 -- 172.21.15.134:0/1538328167 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f13cc0692a0 msgr2=0x7f13cc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:16.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.600+0000 7f13e7b0c700 1 --2- 172.21.15.134:0/1538328167 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f13cc0692a0 0x7f13cc06b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f13d0004f90 tx=0x7f13d0009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:16.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.600+0000 7f13e7b0c700 1 -- 172.21.15.134:0/1538328167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13e00fcef0 msgr2=0x7f13e010d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:16.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.600+0000 7f13e7b0c700 1 --2- 172.21.15.134:0/1538328167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13e00fcef0 0x7f13e010d970 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00bae0 tx=0x7f13dc009810 comp rx=0 tx=0).stop 2024-02-16T22:16:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.600+0000 7f13e7b0c700 1 -- 172.21.15.134:0/1538328167 shutdown_connections 2024-02-16T22:16:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.600+0000 7f13e7b0c700 1 --2- 172.21.15.134:0/1538328167 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f13cc0692a0 0x7f13cc06b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.600+0000 7f13e7b0c700 1 --2- 172.21.15.134:0/1538328167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13e00fcef0 0x7f13e010d970 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.600+0000 7f13e7b0c700 1 --2- 172.21.15.134:0/1538328167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13e00fe0e0 0x7f13e010deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.600+0000 7f13e7b0c700 1 -- 172.21.15.134:0/1538328167 >> 172.21.15.134:0/1538328167 conn(0x7f13e00f8620 msgr2=0x7f13e01013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.600+0000 7f13e7b0c700 1 -- 172.21.15.134:0/1538328167 shutdown_connections 2024-02-16T22:16:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:16.600+0000 7f13e7b0c700 1 -- 172.21.15.134:0/1538328167 wait complete. 2024-02-16T22:16:17.198 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-16T22:16:17.460 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:17.706 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:17 smithi134 ceph-mon[28869]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:16:17.706 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:17 smithi134 ceph-mon[28869]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:17.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:17 smithi173 ceph-mon[37280]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:16:17.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:17 smithi173 ceph-mon[37280]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:18.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.914+0000 7f8a471b6700 1 -- 172.21.15.134:0/1996400075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a400fe2b0 msgr2=0x7f8a400fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.914+0000 7f8a471b6700 1 --2- 172.21.15.134:0/1996400075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a400fe2b0 0x7f8a400fe700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8a30004940 tx=0x7f8a30009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.914+0000 7f8a471b6700 1 -- 172.21.15.134:0/1996400075 shutdown_connections 2024-02-16T22:16:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.914+0000 7f8a471b6700 1 --2- 172.21.15.134:0/1996400075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a400fe2b0 0x7f8a400fe700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.914+0000 7f8a471b6700 1 --2- 172.21.15.134:0/1996400075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a400fb220 0x7f8a400fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.914+0000 7f8a471b6700 1 -- 172.21.15.134:0/1996400075 >> 172.21.15.134:0/1996400075 conn(0x7f8a400f6ca0 msgr2=0x7f8a400f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.914+0000 7f8a471b6700 1 -- 172.21.15.134:0/1996400075 shutdown_connections 2024-02-16T22:16:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.914+0000 7f8a471b6700 1 -- 172.21.15.134:0/1996400075 wait complete. 2024-02-16T22:16:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.915+0000 7f8a471b6700 1 Processor -- start 2024-02-16T22:16:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.915+0000 7f8a471b6700 1 -- start start 2024-02-16T22:16:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.915+0000 7f8a471b6700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a400fb220 0x7f8a4010d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.915+0000 7f8a471b6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a400fe2b0 0x7f8a4010df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.915+0000 7f8a471b6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4010e5c0 con 0x7f8a400fe2b0 2024-02-16T22:16:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.915+0000 7f8a471b6700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4010ee00 con 0x7f8a400fb220 2024-02-16T22:16:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.915+0000 7f8a3ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a400fe2b0 0x7f8a4010df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:18.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.915+0000 7f8a3ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a400fe2b0 0x7f8a4010df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52914/0 (socket says 172.21.15.134:52914) 2024-02-16T22:16:18.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.915+0000 7f8a3ffff700 1 -- 172.21.15.134:0/836128890 learned_addr learned my addr 172.21.15.134:0/836128890 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:18.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.915+0000 7f8a44f52700 1 --2- 172.21.15.134:0/836128890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a400fb220 0x7f8a4010d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:18.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.915+0000 7f8a3ffff700 1 -- 172.21.15.134:0/836128890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a400fb220 msgr2=0x7f8a4010d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:18.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.915+0000 7f8a3ffff700 1 --2- 172.21.15.134:0/836128890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a400fb220 0x7f8a4010d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:18.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.915+0000 7f8a3ffff700 1 -- 172.21.15.134:0/836128890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a30005040 con 0x7f8a400fe2b0 2024-02-16T22:16:18.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.916+0000 7f8a3ffff700 1 --2- 172.21.15.134:0/836128890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a400fe2b0 0x7f8a4010df30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000b3b0 tx=0x7f8a30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:18.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.916+0000 7f8a3d7fa700 1 -- 172.21.15.134:0/836128890 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3000e040 con 0x7f8a400fe2b0 2024-02-16T22:16:18.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.916+0000 7f8a3d7fa700 1 -- 172.21.15.134:0/836128890 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a3000bbf0 con 0x7f8a400fe2b0 2024-02-16T22:16:18.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.916+0000 7f8a471b6700 1 -- 172.21.15.134:0/836128890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4010f080 con 0x7f8a400fe2b0 2024-02-16T22:16:18.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.916+0000 7f8a3d7fa700 1 -- 172.21.15.134:0/836128890 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3001c410 con 0x7f8a400fe2b0 2024-02-16T22:16:18.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.916+0000 7f8a471b6700 1 -- 172.21.15.134:0/836128890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4010f5c0 con 0x7f8a400fe2b0 2024-02-16T22:16:18.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.917+0000 7f8a471b6700 1 -- 172.21.15.134:0/836128890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4004bed0 con 0x7f8a400fe2b0 2024-02-16T22:16:18.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.917+0000 7f8a3d7fa700 1 -- 172.21.15.134:0/836128890 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f8a3000bd60 con 0x7f8a400fe2b0 2024-02-16T22:16:18.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.918+0000 7f8a3d7fa700 1 --2- 172.21.15.134:0/836128890 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8a2c0692a0 0x7f8a2c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:18.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.918+0000 7f8a3d7fa700 1 -- 172.21.15.134:0/836128890 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8a300882d0 con 0x7f8a400fe2b0 2024-02-16T22:16:18.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.918+0000 7f8a44f52700 1 --2- 172.21.15.134:0/836128890 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8a2c0692a0 0x7f8a2c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:18.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.918+0000 7f8a44f52700 1 --2- 172.21.15.134:0/836128890 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8a2c0692a0 0x7f8a2c06b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a40065cb0 tx=0x7f8a38009620 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:18.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:18.922+0000 7f8a3d7fa700 1 -- 172.21.15.134:0/836128890 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8a30058400 con 0x7f8a400fe2b0 2024-02-16T22:16:19.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:19.115+0000 7f8a471b6700 1 -- 172.21.15.134:0/836128890 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a4010f9e0 con 0x7f8a2c0692a0 2024-02-16T22:16:19.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:19.124+0000 7f8a3d7fa700 1 -- 172.21.15.134:0/836128890 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7f8a4010f9e0 con 0x7f8a2c0692a0 2024-02-16T22:16:19.126 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:16:19.126 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (3m) 2m ago 5m 25.8M - 0.25.0 c8568f914cd2 62f86e3efbe2 2024-02-16T22:16:19.126 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (5m) 2m ago 5m 6660k - 17.2.7-513-gb88fae66 870a0944ccb8 a0d53bc0a925 2024-02-16T22:16:19.126 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (4m) 65s ago 4m 6669k - 17.2.7-513-gb88fae66 870a0944ccb8 a8d69537e08a 2024-02-16T22:16:19.126 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (3m) 2m ago 4m 82.4M - 9.4.7 954c08fa6188 67572f26488e 2024-02-16T22:16:19.126 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:9283 running (6m) 2m ago 6m 470M - 17.2.7-513-gb88fae66 870a0944ccb8 52095085178d 2024-02-16T22:16:19.126 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283 running (4m) 65s ago 4m 434M - 17.2.7-513-gb88fae66 870a0944ccb8 f405e50edb6b 2024-02-16T22:16:19.126 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (6m) 2m ago 6m 40.7M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 93a679740d93 2024-02-16T22:16:19.126 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (4m) 65s ago 4m 38.2M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 cfbef35950ef 2024-02-16T22:16:19.126 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 2m ago 5m 15.8M - 1.5.0 0da6a335fe13 7e7604241558 2024-02-16T22:16:19.126 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (4m) 65s ago 4m 15.9M - 1.5.0 0da6a335fe13 cddf6bc3c421 2024-02-16T22:16:19.126 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (3m) 2m ago 3m 35.7M 4288M 17.2.7-513-gb88fae66 870a0944ccb8 099f0b29d202 2024-02-16T22:16:19.126 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (2m) 2m ago 2m 36.5M 4288M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:16:19.127 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (2m) 2m ago 2m 11.0M 4288M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:16:19.127 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (2m) 65s ago 2m 38.5M 5312M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:16:19.127 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (95s) 65s ago 95s 38.9M 5312M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:16:19.127 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (70s) 65s ago 70s 10.7M 5312M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:16:19.127 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (3m) 2m ago 4m 35.0M - 2.43.0 a07b618ecd1d 37e529bd9229 2024-02-16T22:16:19.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:19.125+0000 7f8a471b6700 1 -- 172.21.15.134:0/836128890 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8a2c0692a0 msgr2=0x7f8a2c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:19.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:19.125+0000 7f8a471b6700 1 --2- 172.21.15.134:0/836128890 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8a2c0692a0 0x7f8a2c06b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a40065cb0 tx=0x7f8a38009620 comp rx=0 tx=0).stop 2024-02-16T22:16:19.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:19.125+0000 7f8a471b6700 1 -- 172.21.15.134:0/836128890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a400fe2b0 msgr2=0x7f8a4010df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:19.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:19.125+0000 7f8a471b6700 1 --2- 172.21.15.134:0/836128890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a400fe2b0 0x7f8a4010df30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000b3b0 tx=0x7f8a30009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:19.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:19.126+0000 7f8a471b6700 1 -- 172.21.15.134:0/836128890 shutdown_connections 2024-02-16T22:16:19.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:19.126+0000 7f8a471b6700 1 --2- 172.21.15.134:0/836128890 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8a2c0692a0 0x7f8a2c06b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:19.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:19.126+0000 7f8a471b6700 1 --2- 172.21.15.134:0/836128890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a400fb220 0x7f8a4010d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:19.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:19.126+0000 7f8a471b6700 1 --2- 172.21.15.134:0/836128890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a400fe2b0 0x7f8a4010df30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:19.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:19.126+0000 7f8a471b6700 1 -- 172.21.15.134:0/836128890 >> 172.21.15.134:0/836128890 conn(0x7f8a400f6ca0 msgr2=0x7f8a401014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:19.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:19.126+0000 7f8a471b6700 1 -- 172.21.15.134:0/836128890 shutdown_connections 2024-02-16T22:16:19.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:19.126+0000 7f8a471b6700 1 -- 172.21.15.134:0/836128890 wait complete. 2024-02-16T22:16:19.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-16T22:16:20.024 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:20.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:19 smithi134 ceph-mon[28869]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:20.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:19 smithi134 ceph-mon[28869]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:16:20.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:19 smithi173 ceph-mon[37280]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:20.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:19 smithi173 ceph-mon[37280]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:16:21.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.570+0000 7f2c7341f700 1 -- 172.21.15.134:0/63731430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c6c0fe0e0 msgr2=0x7f2c6c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:21.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.570+0000 7f2c7341f700 1 --2- 172.21.15.134:0/63731430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c6c0fe0e0 0x7f2c6c0fe550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c004940 tx=0x7f2c5c009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:21.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.570+0000 7f2c7341f700 1 -- 172.21.15.134:0/63731430 shutdown_connections 2024-02-16T22:16:21.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.570+0000 7f2c7341f700 1 --2- 172.21.15.134:0/63731430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c6c0fe0e0 0x7f2c6c0fe550 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:21.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.570+0000 7f2c7341f700 1 --2- 172.21.15.134:0/63731430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c6c0fcef0 0x7f2c6c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:21.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.570+0000 7f2c7341f700 1 -- 172.21.15.134:0/63731430 >> 172.21.15.134:0/63731430 conn(0x7f2c6c0f8620 msgr2=0x7f2c6c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:21.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.570+0000 7f2c7341f700 1 -- 172.21.15.134:0/63731430 shutdown_connections 2024-02-16T22:16:21.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.570+0000 7f2c7341f700 1 -- 172.21.15.134:0/63731430 wait complete. 2024-02-16T22:16:21.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.570+0000 7f2c7341f700 1 Processor -- start 2024-02-16T22:16:21.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.570+0000 7f2c7341f700 1 -- start start 2024-02-16T22:16:21.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c7341f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c6c0fcef0 0x7f2c6c10d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:21.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c7341f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c6c0fe0e0 0x7f2c6c10ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:21.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c7341f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c10e560 con 0x7f2c6c0fcef0 2024-02-16T22:16:21.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c7341f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c10eda0 con 0x7f2c6c0fe0e0 2024-02-16T22:16:21.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c711bb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c6c0fcef0 0x7f2c6c10d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:21.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c711bb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c6c0fcef0 0x7f2c6c10d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46414/0 (socket says 172.21.15.134:46414) 2024-02-16T22:16:21.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c711bb700 1 -- 172.21.15.134:0/2550973423 learned_addr learned my addr 172.21.15.134:0/2550973423 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:21.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c709ba700 1 --2- 172.21.15.134:0/2550973423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c6c0fe0e0 0x7f2c6c10ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:21.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c711bb700 1 -- 172.21.15.134:0/2550973423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c6c0fe0e0 msgr2=0x7f2c6c10ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:21.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c711bb700 1 --2- 172.21.15.134:0/2550973423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c6c0fe0e0 0x7f2c6c10ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:21.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c711bb700 1 -- 172.21.15.134:0/2550973423 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c005040 con 0x7f2c6c0fcef0 2024-02-16T22:16:21.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c711bb700 1 --2- 172.21.15.134:0/2550973423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c6c0fcef0 0x7f2c6c10d990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400bae0 tx=0x7f2c64009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c61ffb700 1 -- 172.21.15.134:0/2550973423 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c6400c840 con 0x7f2c6c0fcef0 2024-02-16T22:16:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c7341f700 1 -- 172.21.15.134:0/2550973423 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c10f080 con 0x7f2c6c0fcef0 2024-02-16T22:16:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c61ffb700 1 -- 172.21.15.134:0/2550973423 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c6400ce70 con 0x7f2c6c0fcef0 2024-02-16T22:16:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.571+0000 7f2c61ffb700 1 -- 172.21.15.134:0/2550973423 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c64007610 con 0x7f2c6c0fcef0 2024-02-16T22:16:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.572+0000 7f2c7341f700 1 -- 172.21.15.134:0/2550973423 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c10f5c0 con 0x7f2c6c0fcef0 2024-02-16T22:16:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.573+0000 7f2c7341f700 1 -- 172.21.15.134:0/2550973423 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c04bed0 con 0x7f2c6c0fcef0 2024-02-16T22:16:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.573+0000 7f2c61ffb700 1 -- 172.21.15.134:0/2550973423 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f2c64014410 con 0x7f2c6c0fcef0 2024-02-16T22:16:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.573+0000 7f2c61ffb700 1 --2- 172.21.15.134:0/2550973423 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2c580692b0 0x7f2c5806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.573+0000 7f2c61ffb700 1 -- 172.21.15.134:0/2550973423 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2c64086d90 con 0x7f2c6c0fcef0 2024-02-16T22:16:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.573+0000 7f2c709ba700 1 --2- 172.21.15.134:0/2550973423 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2c580692b0 0x7f2c5806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.574+0000 7f2c709ba700 1 --2- 172.21.15.134:0/2550973423 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2c580692b0 0x7f2c5806b760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00b7a0 tx=0x7f2c5c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:21.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.577+0000 7f2c61ffb700 1 -- 172.21.15.134:0/2550973423 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f2c6404cbd0 con 0x7f2c6c0fcef0 2024-02-16T22:16:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.768+0000 7f2c7341f700 1 -- 172.21.15.134:0/2550973423 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c6c10fa60 con 0x7f2c580692b0 2024-02-16T22:16:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.772+0000 7f2c61ffb700 1 -- 172.21.15.134:0/2550973423 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7f2c6c10fa60 con 0x7f2c580692b0 2024-02-16T22:16:21.774 INFO:teuthology.orchestra.run.smithi134.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-16T22:16:21.774 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-02-16T22:16:21.775 INFO:teuthology.orchestra.run.smithi134.stdout:crash 2/2 2m ago 6m * 2024-02-16T22:16:21.775 INFO:teuthology.orchestra.run.smithi134.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-02-16T22:16:21.775 INFO:teuthology.orchestra.run.smithi134.stdout:mgr 2/2 2m ago 6m count:2 2024-02-16T22:16:21.775 INFO:teuthology.orchestra.run.smithi134.stdout:mon 2/2 2m ago 5m smithi134:172.21.15.134=smithi134;smithi173:172.21.15.173=smithi173;count:2 2024-02-16T22:16:21.775 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-02-16T22:16:21.775 INFO:teuthology.orchestra.run.smithi134.stdout:osd 6 2m ago - 2024-02-16T22:16:21.775 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-02-16T22:16:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.775+0000 7f2c7341f700 1 -- 172.21.15.134:0/2550973423 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2c580692b0 msgr2=0x7f2c5806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.775+0000 7f2c7341f700 1 --2- 172.21.15.134:0/2550973423 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2c580692b0 0x7f2c5806b760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00b7a0 tx=0x7f2c5c009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.775+0000 7f2c7341f700 1 -- 172.21.15.134:0/2550973423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c6c0fcef0 msgr2=0x7f2c6c10d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.775+0000 7f2c7341f700 1 --2- 172.21.15.134:0/2550973423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c6c0fcef0 0x7f2c6c10d990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400bae0 tx=0x7f2c64009810 comp rx=0 tx=0).stop 2024-02-16T22:16:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.775+0000 7f2c7341f700 1 -- 172.21.15.134:0/2550973423 shutdown_connections 2024-02-16T22:16:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.775+0000 7f2c7341f700 1 --2- 172.21.15.134:0/2550973423 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2c580692b0 0x7f2c5806b760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.775+0000 7f2c7341f700 1 --2- 172.21.15.134:0/2550973423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c6c0fcef0 0x7f2c6c10d990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.775+0000 7f2c7341f700 1 --2- 172.21.15.134:0/2550973423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c6c0fe0e0 0x7f2c6c10ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.775+0000 7f2c7341f700 1 -- 172.21.15.134:0/2550973423 >> 172.21.15.134:0/2550973423 conn(0x7f2c6c0f8620 msgr2=0x7f2c6c1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.775+0000 7f2c7341f700 1 -- 172.21.15.134:0/2550973423 shutdown_connections 2024-02-16T22:16:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:21.775+0000 7f2c7341f700 1 -- 172.21.15.134:0/2550973423 wait complete. 2024-02-16T22:16:22.150 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:21 smithi134 ceph-mon[28869]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:22.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:21 smithi173 ceph-mon[37280]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:22.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-16T22:16:22.653 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:23.098 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:22 smithi134 ceph-mon[28869]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:16:23.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:22 smithi173 ceph-mon[37280]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:16:24.026 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:23 smithi134 ceph-mon[28869]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:24.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.218+0000 7fd23f55d700 1 -- 172.21.15.134:0/3544888424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2380fe1e0 msgr2=0x7fd2380fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:24.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.218+0000 7fd23f55d700 1 --2- 172.21.15.134:0/3544888424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2380fe1e0 0x7fd2380fe650 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd228004940 tx=0x7fd228009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:24.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.218+0000 7fd23f55d700 1 -- 172.21.15.134:0/3544888424 shutdown_connections 2024-02-16T22:16:24.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.218+0000 7fd23f55d700 1 --2- 172.21.15.134:0/3544888424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2380fe1e0 0x7fd2380fe650 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:24.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.218+0000 7fd23f55d700 1 --2- 172.21.15.134:0/3544888424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2380fcf30 0x7fd2380fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:24.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.218+0000 7fd23f55d700 1 -- 172.21.15.134:0/3544888424 >> 172.21.15.134:0/3544888424 conn(0x7fd2380f86b0 msgr2=0x7fd2380faac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:24.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.218+0000 7fd23f55d700 1 -- 172.21.15.134:0/3544888424 shutdown_connections 2024-02-16T22:16:24.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.218+0000 7fd23f55d700 1 -- 172.21.15.134:0/3544888424 wait complete. 2024-02-16T22:16:24.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.218+0000 7fd23f55d700 1 Processor -- start 2024-02-16T22:16:24.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd23f55d700 1 -- start start 2024-02-16T22:16:24.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd23f55d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2380fcf30 0x7fd238071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:24.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd23f55d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2380fe1e0 0x7fd2380702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:24.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd23f55d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2380708e0 con 0x7fd2380fcf30 2024-02-16T22:16:24.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd23f55d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd238070a50 con 0x7fd2380fe1e0 2024-02-16T22:16:24.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd23d2f9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2380fcf30 0x7fd238071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:24.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd23d2f9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2380fcf30 0x7fd238071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46424/0 (socket says 172.21.15.134:46424) 2024-02-16T22:16:24.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd23d2f9700 1 -- 172.21.15.134:0/2589672728 learned_addr learned my addr 172.21.15.134:0/2589672728 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:24.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd23caf8700 1 --2- 172.21.15.134:0/2589672728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2380fe1e0 0x7fd2380702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:24.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd23d2f9700 1 -- 172.21.15.134:0/2589672728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2380fe1e0 msgr2=0x7fd2380702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:24.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd23d2f9700 1 --2- 172.21.15.134:0/2589672728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2380fe1e0 0x7fd2380702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:24.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd23d2f9700 1 -- 172.21.15.134:0/2589672728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd228005040 con 0x7fd2380fcf30 2024-02-16T22:16:24.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd23d2f9700 1 --2- 172.21.15.134:0/2589672728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2380fcf30 0x7fd238071e60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd234002a80 tx=0x7fd2340046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:24.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd22dffb700 1 -- 172.21.15.134:0/2589672728 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd234007cc0 con 0x7fd2380fcf30 2024-02-16T22:16:24.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd23f55d700 1 -- 172.21.15.134:0/2589672728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd238070d30 con 0x7fd2380fcf30 2024-02-16T22:16:24.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.219+0000 7fd22dffb700 1 -- 172.21.15.134:0/2589672728 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd23400f040 con 0x7fd2380fcf30 2024-02-16T22:16:24.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.220+0000 7fd22dffb700 1 -- 172.21.15.134:0/2589672728 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd23400dac0 con 0x7fd2380fcf30 2024-02-16T22:16:24.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.220+0000 7fd23f55d700 1 -- 172.21.15.134:0/2589672728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2381158a0 con 0x7fd2380fcf30 2024-02-16T22:16:24.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.220+0000 7fd23f55d700 1 -- 172.21.15.134:0/2589672728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23804bed0 con 0x7fd2380fcf30 2024-02-16T22:16:24.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.221+0000 7fd22dffb700 1 -- 172.21.15.134:0/2589672728 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd23400dcc0 con 0x7fd2380fcf30 2024-02-16T22:16:24.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.221+0000 7fd22dffb700 1 --2- 172.21.15.134:0/2589672728 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd2240692a0 0x7fd22406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:24.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.222+0000 7fd22dffb700 1 -- 172.21.15.134:0/2589672728 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd234086a00 con 0x7fd2380fcf30 2024-02-16T22:16:24.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.222+0000 7fd23caf8700 1 --2- 172.21.15.134:0/2589672728 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd2240692a0 0x7fd22406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:24.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.222+0000 7fd23caf8700 1 --2- 172.21.15.134:0/2589672728 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd2240692a0 0x7fd22406b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd228004f90 tx=0x7fd228009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:24.227 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:23 smithi173 ceph-mon[37280]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:24.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.226+0000 7fd22dffb700 1 -- 172.21.15.134:0/2589672728 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd234056b00 con 0x7fd2380fcf30 2024-02-16T22:16:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.413+0000 7fd23f55d700 1 -- 172.21.15.134:0/2589672728 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd238102b30 con 0x7fd2240692a0 2024-02-16T22:16:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.414+0000 7fd22dffb700 1 -- 172.21.15.134:0/2589672728 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fd238102b30 con 0x7fd2240692a0 2024-02-16T22:16:24.416 INFO:teuthology.orchestra.run.smithi134.stdout:HOST ADDR LABELS STATUS 2024-02-16T22:16:24.416 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134 172.21.15.134 2024-02-16T22:16:24.416 INFO:teuthology.orchestra.run.smithi134.stdout:smithi173 172.21.15.173 2024-02-16T22:16:24.417 INFO:teuthology.orchestra.run.smithi134.stdout:2 hosts in cluster 2024-02-16T22:16:24.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.417+0000 7fd23f55d700 1 -- 172.21.15.134:0/2589672728 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd2240692a0 msgr2=0x7fd22406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:24.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.417+0000 7fd23f55d700 1 --2- 172.21.15.134:0/2589672728 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd2240692a0 0x7fd22406b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd228004f90 tx=0x7fd228009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:24.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.417+0000 7fd23f55d700 1 -- 172.21.15.134:0/2589672728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2380fcf30 msgr2=0x7fd238071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:24.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.417+0000 7fd23f55d700 1 --2- 172.21.15.134:0/2589672728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2380fcf30 0x7fd238071e60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd234002a80 tx=0x7fd2340046b0 comp rx=0 tx=0).stop 2024-02-16T22:16:24.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.417+0000 7fd23f55d700 1 -- 172.21.15.134:0/2589672728 shutdown_connections 2024-02-16T22:16:24.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.417+0000 7fd23f55d700 1 --2- 172.21.15.134:0/2589672728 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd2240692a0 0x7fd22406b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:24.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.417+0000 7fd23f55d700 1 --2- 172.21.15.134:0/2589672728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2380fcf30 0x7fd238071e60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:24.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.417+0000 7fd23f55d700 1 --2- 172.21.15.134:0/2589672728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2380fe1e0 0x7fd2380702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:24.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.417+0000 7fd23f55d700 1 -- 172.21.15.134:0/2589672728 >> 172.21.15.134:0/2589672728 conn(0x7fd2380f86b0 msgr2=0x7fd238101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:24.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.417+0000 7fd23f55d700 1 -- 172.21.15.134:0/2589672728 shutdown_connections 2024-02-16T22:16:24.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:24.417+0000 7fd23f55d700 1 -- 172.21.15.134:0/2589672728 wait complete. 2024-02-16T22:16:25.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:24 smithi134 ceph-mon[28869]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:16:25.109 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-16T22:16:25.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:24 smithi173 ceph-mon[37280]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:16:25.363 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:26.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:25 smithi134 ceph-mon[28869]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:26.230 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:25 smithi173 ceph-mon[37280]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:26.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.882+0000 7f52ea010700 1 -- 172.21.15.134:0/2709214532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e40fcf30 msgr2=0x7f52e40fd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:26.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.882+0000 7f52ea010700 1 --2- 172.21.15.134:0/2709214532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e40fcf30 0x7f52e40fd340 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f52d4004940 tx=0x7f52d4009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:26.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52ea010700 1 -- 172.21.15.134:0/2709214532 shutdown_connections 2024-02-16T22:16:26.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52ea010700 1 --2- 172.21.15.134:0/2709214532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52e40fe1e0 0x7f52e40fe650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:26.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52ea010700 1 --2- 172.21.15.134:0/2709214532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e40fcf30 0x7f52e40fd340 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52ea010700 1 -- 172.21.15.134:0/2709214532 >> 172.21.15.134:0/2709214532 conn(0x7f52e40f86b0 msgr2=0x7f52e40faac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52ea010700 1 -- 172.21.15.134:0/2709214532 shutdown_connections 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52ea010700 1 -- 172.21.15.134:0/2709214532 wait complete. 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52ea010700 1 Processor -- start 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52ea010700 1 -- start start 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52ea010700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e40fcf30 0x7f52e410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52ea010700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52e40fe1e0 0x7f52e410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52ea010700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e410e470 con 0x7f52e40fcf30 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52ea010700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e410ed10 con 0x7f52e40fe1e0 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52e37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e40fcf30 0x7f52e410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52e37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e40fcf30 0x7f52e410d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46438/0 (socket says 172.21.15.134:46438) 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.883+0000 7f52e37fe700 1 -- 172.21.15.134:0/2272228617 learned_addr learned my addr 172.21.15.134:0/2272228617 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.884+0000 7f52daffd700 1 --2- 172.21.15.134:0/2272228617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52e40fe1e0 0x7f52e410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.884+0000 7f52e37fe700 1 -- 172.21.15.134:0/2272228617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52e40fe1e0 msgr2=0x7f52e410de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.884+0000 7f52e37fe700 1 --2- 172.21.15.134:0/2272228617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52e40fe1e0 0x7f52e410de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:26.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.884+0000 7f52e37fe700 1 -- 172.21.15.134:0/2272228617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d4005040 con 0x7f52e40fcf30 2024-02-16T22:16:26.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.884+0000 7f52e37fe700 1 --2- 172.21.15.134:0/2272228617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e40fcf30 0x7f52e410d930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f52d400b3b0 tx=0x7f52d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:26.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.884+0000 7f52e0ff9700 1 -- 172.21.15.134:0/2272228617 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52d400e040 con 0x7f52e40fcf30 2024-02-16T22:16:26.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.884+0000 7f52e0ff9700 1 -- 172.21.15.134:0/2272228617 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f52d4009b10 con 0x7f52e40fcf30 2024-02-16T22:16:26.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.884+0000 7f52ea010700 1 -- 172.21.15.134:0/2272228617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e410ef90 con 0x7f52e40fcf30 2024-02-16T22:16:26.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.884+0000 7f52e0ff9700 1 -- 172.21.15.134:0/2272228617 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52d4013ea0 con 0x7f52e40fcf30 2024-02-16T22:16:26.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.884+0000 7f52ea010700 1 -- 172.21.15.134:0/2272228617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e410f4d0 con 0x7f52e40fcf30 2024-02-16T22:16:26.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.885+0000 7f52ea010700 1 -- 172.21.15.134:0/2272228617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e404bed0 con 0x7f52e40fcf30 2024-02-16T22:16:26.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.885+0000 7f52e0ff9700 1 -- 172.21.15.134:0/2272228617 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f52d4013420 con 0x7f52e40fcf30 2024-02-16T22:16:26.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.886+0000 7f52e0ff9700 1 --2- 172.21.15.134:0/2272228617 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f52d00692a0 0x7f52d006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:26.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.886+0000 7f52e0ff9700 1 -- 172.21.15.134:0/2272228617 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f52d4088180 con 0x7f52e40fcf30 2024-02-16T22:16:26.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.886+0000 7f52daffd700 1 --2- 172.21.15.134:0/2272228617 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f52d00692a0 0x7f52d006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:26.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.886+0000 7f52daffd700 1 --2- 172.21.15.134:0/2272228617 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f52d00692a0 0x7f52d006b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f52cc004f40 tx=0x7f52cc00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:26.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:26.890+0000 7f52e0ff9700 1 -- 172.21.15.134:0/2272228617 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f52d4058320 con 0x7f52e40fcf30 2024-02-16T22:16:27.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:27.083+0000 7f52ea010700 1 -- 172.21.15.134:0/2272228617 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f52e410fb90 con 0x7f52d00692a0 2024-02-16T22:16:27.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:27.084+0000 7f52e0ff9700 1 -- 172.21.15.134:0/2272228617 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f52e410fb90 con 0x7f52d00692a0 2024-02-16T22:16:27.086 INFO:teuthology.orchestra.run.smithi134.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-02-16T22:16:27.086 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62420002400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-02-16T22:16:27.087 INFO:teuthology.orchestra.run.smithi134.stdout:smithi173 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204019S400BGN 372G No 69s ago Has a FileSystem, LVM detected 2024-02-16T22:16:27.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:27.086+0000 7f52ea010700 1 -- 172.21.15.134:0/2272228617 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f52d00692a0 msgr2=0x7f52d006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:27.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:27.086+0000 7f52ea010700 1 --2- 172.21.15.134:0/2272228617 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f52d00692a0 0x7f52d006b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f52cc004f40 tx=0x7f52cc00b040 comp rx=0 tx=0).stop 2024-02-16T22:16:27.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:27.086+0000 7f52ea010700 1 -- 172.21.15.134:0/2272228617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e40fcf30 msgr2=0x7f52e410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:27.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:27.086+0000 7f52ea010700 1 --2- 172.21.15.134:0/2272228617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e40fcf30 0x7f52e410d930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f52d400b3b0 tx=0x7f52d4009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:27.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:27.086+0000 7f52ea010700 1 -- 172.21.15.134:0/2272228617 shutdown_connections 2024-02-16T22:16:27.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:27.086+0000 7f52ea010700 1 --2- 172.21.15.134:0/2272228617 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f52d00692a0 0x7f52d006b750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:27.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:27.086+0000 7f52ea010700 1 --2- 172.21.15.134:0/2272228617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52e40fcf30 0x7f52e410d930 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:27.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:27.086+0000 7f52ea010700 1 --2- 172.21.15.134:0/2272228617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52e40fe1e0 0x7f52e410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:27.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:27.086+0000 7f52ea010700 1 -- 172.21.15.134:0/2272228617 >> 172.21.15.134:0/2272228617 conn(0x7f52e40f86b0 msgr2=0x7f52e4101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:27.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:27.087+0000 7f52ea010700 1 -- 172.21.15.134:0/2272228617 shutdown_connections 2024-02-16T22:16:27.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:27.087+0000 7f52ea010700 1 -- 172.21.15.134:0/2272228617 wait complete. 2024-02-16T22:16:27.715 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:27 smithi134 ceph-mon[28869]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:27.715 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:27 smithi134 ceph-mon[28869]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:16:27.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:27 smithi173 ceph-mon[37280]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:27.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:27 smithi173 ceph-mon[37280]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:16:27.738 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-02-16T22:16:27.748 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-16T22:16:27.757 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T22:16:27.758 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-02-16T22:16:28.013 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:28.699 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:28 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:16:28.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:28 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:16:29.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.583+0000 7f8c853a4700 1 -- 172.21.15.134:0/2031709924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c800fcfc0 msgr2=0x7f8c800fd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:29.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.583+0000 7f8c853a4700 1 --2- 172.21.15.134:0/2031709924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c800fcfc0 0x7f8c800fd430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8c74004940 tx=0x7f8c74009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:29.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.583+0000 7f8c853a4700 1 -- 172.21.15.134:0/2031709924 shutdown_connections 2024-02-16T22:16:29.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.583+0000 7f8c853a4700 1 --2- 172.21.15.134:0/2031709924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c800fcfc0 0x7f8c800fd430 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:29.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.583+0000 7f8c853a4700 1 --2- 172.21.15.134:0/2031709924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c800fbe50 0x7f8c800fc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:29.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.583+0000 7f8c853a4700 1 -- 172.21.15.134:0/2031709924 >> 172.21.15.134:0/2031709924 conn(0x7f8c800f7510 msgr2=0x7f8c800f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:29.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.583+0000 7f8c853a4700 1 -- 172.21.15.134:0/2031709924 shutdown_connections 2024-02-16T22:16:29.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.583+0000 7f8c853a4700 1 -- 172.21.15.134:0/2031709924 wait complete. 2024-02-16T22:16:29.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.584+0000 7f8c853a4700 1 Processor -- start 2024-02-16T22:16:29.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.584+0000 7f8c853a4700 1 -- start start 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.584+0000 7f8c853a4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c800fbe50 0x7f8c8010c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.584+0000 7f8c853a4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c800fcfc0 0x7f8c8010cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.584+0000 7f8c853a4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8010d430 con 0x7f8c800fcfc0 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.584+0000 7f8c853a4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8010dc70 con 0x7f8c800fbe50 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.585+0000 7f8c7e7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c800fcfc0 0x7f8c8010cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.585+0000 7f8c7e7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c800fcfc0 0x7f8c8010cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46450/0 (socket says 172.21.15.134:46450) 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.585+0000 7f8c7e7fc700 1 -- 172.21.15.134:0/787769612 learned_addr learned my addr 172.21.15.134:0/787769612 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.585+0000 7f8c7effd700 1 --2- 172.21.15.134:0/787769612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c800fbe50 0x7f8c8010c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.585+0000 7f8c7e7fc700 1 -- 172.21.15.134:0/787769612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c800fbe50 msgr2=0x7f8c8010c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.585+0000 7f8c7e7fc700 1 --2- 172.21.15.134:0/787769612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c800fbe50 0x7f8c8010c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.585+0000 7f8c7e7fc700 1 -- 172.21.15.134:0/787769612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c74005040 con 0x7f8c800fcfc0 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.585+0000 7f8c7effd700 1 --2- 172.21.15.134:0/787769612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c800fbe50 0x7f8c8010c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.585+0000 7f8c7e7fc700 1 --2- 172.21.15.134:0/787769612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c800fcfc0 0x7f8c8010cda0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c740093b0 tx=0x7f8c74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.585+0000 7f8c677fe700 1 -- 172.21.15.134:0/787769612 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c7400e040 con 0x7f8c800fcfc0 2024-02-16T22:16:29.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.585+0000 7f8c677fe700 1 -- 172.21.15.134:0/787769612 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c7400bcc0 con 0x7f8c800fcfc0 2024-02-16T22:16:29.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.585+0000 7f8c853a4700 1 -- 172.21.15.134:0/787769612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8010def0 con 0x7f8c800fcfc0 2024-02-16T22:16:29.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.585+0000 7f8c677fe700 1 -- 172.21.15.134:0/787769612 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c7401c630 con 0x7f8c800fcfc0 2024-02-16T22:16:29.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.585+0000 7f8c853a4700 1 -- 172.21.15.134:0/787769612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8010e430 con 0x7f8c800fcfc0 2024-02-16T22:16:29.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.586+0000 7f8c853a4700 1 -- 172.21.15.134:0/787769612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8004bed0 con 0x7f8c800fcfc0 2024-02-16T22:16:29.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.586+0000 7f8c677fe700 1 -- 172.21.15.134:0/787769612 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f8c740139f0 con 0x7f8c800fcfc0 2024-02-16T22:16:29.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.587+0000 7f8c677fe700 1 --2- 172.21.15.134:0/787769612 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8c680692a0 0x7f8c6806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:29.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.587+0000 7f8c677fe700 1 -- 172.21.15.134:0/787769612 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8c74088180 con 0x7f8c800fcfc0 2024-02-16T22:16:29.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.587+0000 7f8c7effd700 1 --2- 172.21.15.134:0/787769612 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8c680692a0 0x7f8c6806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:29.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.587+0000 7f8c7effd700 1 --2- 172.21.15.134:0/787769612 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8c680692a0 0x7f8c6806b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c70006fd0 tx=0x7f8c70008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:29.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.591+0000 7f8c677fe700 1 -- 172.21.15.134:0/787769612 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8c74058320 con 0x7f8c800fcfc0 2024-02-16T22:16:29.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:29 smithi134 ceph-mon[28869]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:29.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:29 smithi173 ceph-mon[37280]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:29.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:29.802+0000 7f8c853a4700 1 -- 172.21.15.134:0/787769612 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c8010e960 con 0x7f8c680692a0 2024-02-16T22:16:30.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:30 smithi134 ceph-mon[28869]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:16:30.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:30 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-16T22:16:30.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:30 smithi173 ceph-mon[37280]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:16:30.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:30 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-16T22:16:31.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:31.495+0000 7f8c677fe700 1 -- 172.21.15.134:0/787769612 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8c8010e960 con 0x7f8c680692a0 2024-02-16T22:16:31.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:31.499+0000 7f8c853a4700 1 -- 172.21.15.134:0/787769612 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8c680692a0 msgr2=0x7f8c6806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:31.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:31.499+0000 7f8c853a4700 1 --2- 172.21.15.134:0/787769612 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8c680692a0 0x7f8c6806b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c70006fd0 tx=0x7f8c70008040 comp rx=0 tx=0).stop 2024-02-16T22:16:31.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:31.499+0000 7f8c853a4700 1 -- 172.21.15.134:0/787769612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c800fcfc0 msgr2=0x7f8c8010cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:31.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:31.499+0000 7f8c853a4700 1 --2- 172.21.15.134:0/787769612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c800fcfc0 0x7f8c8010cda0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c740093b0 tx=0x7f8c74009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:31.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:31.499+0000 7f8c853a4700 1 -- 172.21.15.134:0/787769612 shutdown_connections 2024-02-16T22:16:31.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:31.499+0000 7f8c853a4700 1 --2- 172.21.15.134:0/787769612 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8c680692a0 0x7f8c6806b750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:31.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:31.499+0000 7f8c853a4700 1 --2- 172.21.15.134:0/787769612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c800fbe50 0x7f8c8010c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:31.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:31.499+0000 7f8c853a4700 1 --2- 172.21.15.134:0/787769612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c800fcfc0 0x7f8c8010cda0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:31.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:31.499+0000 7f8c853a4700 1 -- 172.21.15.134:0/787769612 >> 172.21.15.134:0/787769612 conn(0x7f8c800f7510 msgr2=0x7f8c80100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:31.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:31.499+0000 7f8c853a4700 1 -- 172.21.15.134:0/787769612 shutdown_connections 2024-02-16T22:16:31.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:31.499+0000 7f8c853a4700 1 -- 172.21.15.134:0/787769612 wait complete. 2024-02-16T22:16:31.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:31 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-16T22:16:31.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:31 smithi134 ceph-mon[28869]: osdmap e41: 6 total, 6 up, 6 in 2024-02-16T22:16:31.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:31 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-16T22:16:31.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:31 smithi134 ceph-mon[28869]: pgmap v173: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:31.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:31 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134[28865]: 2024-02-16T22:16:31.471+0000 7f7389e93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-16T22:16:31.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:31 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-16T22:16:31.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:31 smithi173 ceph-mon[37280]: osdmap e41: 6 total, 6 up, 6 in 2024-02-16T22:16:31.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:31 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-16T22:16:31.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:31 smithi173 ceph-mon[37280]: pgmap v173: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:32.213 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-16T22:16:32.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-16T22:16:32.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-16T22:16:32.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: osdmap e42: 6 total, 6 up, 6 in 2024-02-16T22:16:32.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-16T22:16:32.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-16T22:16:32.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-16T22:16:32.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: osdmap e43: 6 total, 6 up, 6 in 2024-02-16T22:16:32.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-16T22:16:32.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: fsmap cephfs:0 2024-02-16T22:16:32.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: Saving service mds.cephfs spec with placement count:4 2024-02-16T22:16:32.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:32.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:16:32.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:16:32.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:16:32.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:32.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.cygfxr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:16:32.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.cygfxr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-16T22:16:32.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:16:32.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:32 smithi134 ceph-mon[28869]: Deploying daemon mds.cephfs.smithi134.cygfxr on smithi134 2024-02-16T22:16:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-16T22:16:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-16T22:16:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: osdmap e42: 6 total, 6 up, 6 in 2024-02-16T22:16:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-16T22:16:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-16T22:16:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-16T22:16:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: osdmap e43: 6 total, 6 up, 6 in 2024-02-16T22:16:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-16T22:16:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: fsmap cephfs:0 2024-02-16T22:16:32.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: Saving service mds.cephfs spec with placement count:4 2024-02-16T22:16:32.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:32.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:16:32.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:16:32.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:16:32.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:32.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.cygfxr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:16:32.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.cygfxr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-16T22:16:32.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:16:32.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:32 smithi173 ceph-mon[37280]: Deploying daemon mds.cephfs.smithi134.cygfxr on smithi134 2024-02-16T22:16:33.564 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:33.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:33 smithi134 ceph-mon[28869]: osdmap e44: 6 total, 6 up, 6 in 2024-02-16T22:16:33.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:33 smithi134 ceph-mon[28869]: pgmap v177: 65 pgs: 10 creating+peering, 1 active+clean, 54 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:33.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:33 smithi173 ceph-mon[37280]: osdmap e44: 6 total, 6 up, 6 in 2024-02-16T22:16:33.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:33 smithi173 ceph-mon[37280]: pgmap v177: 65 pgs: 10 creating+peering, 1 active+clean, 54 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:34.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:34 smithi173 ceph-mon[37280]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-16T22:16:34.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:34 smithi173 ceph-mon[37280]: osdmap e45: 6 total, 6 up, 6 in 2024-02-16T22:16:34.828 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:34 smithi134 ceph-mon[28869]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-16T22:16:34.828 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:34 smithi134 ceph-mon[28869]: osdmap e45: 6 total, 6 up, 6 in 2024-02-16T22:16:35.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.161+0000 7f117b32b700 1 -- 172.21.15.134:0/773310250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11740fbe40 msgr2=0x7f11740fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:35.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.161+0000 7f117b32b700 1 --2- 172.21.15.134:0/773310250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11740fbe40 0x7f11740fc250 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1170004940 tx=0x7f1170009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:35.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.161+0000 7f117b32b700 1 -- 172.21.15.134:0/773310250 shutdown_connections 2024-02-16T22:16:35.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.161+0000 7f117b32b700 1 --2- 172.21.15.134:0/773310250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11740fcfb0 0x7f11740fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:35.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.161+0000 7f117b32b700 1 --2- 172.21.15.134:0/773310250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11740fbe40 0x7f11740fc250 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:35.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.161+0000 7f117b32b700 1 -- 172.21.15.134:0/773310250 >> 172.21.15.134:0/773310250 conn(0x7f11740f7520 msgr2=0x7f11740f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:35.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.161+0000 7f117b32b700 1 -- 172.21.15.134:0/773310250 shutdown_connections 2024-02-16T22:16:35.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.161+0000 7f117b32b700 1 -- 172.21.15.134:0/773310250 wait complete. 2024-02-16T22:16:35.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.161+0000 7f117b32b700 1 Processor -- start 2024-02-16T22:16:35.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.161+0000 7f117b32b700 1 -- start start 2024-02-16T22:16:35.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f117b32b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11740fbe40 0x7f11741105b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:35.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f117b32b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11740fcfb0 0x7f1174112b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:35.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f117b32b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1174066cf0 con 0x7f11740fcfb0 2024-02-16T22:16:35.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f117b32b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1174066e30 con 0x7f11740fbe40 2024-02-16T22:16:35.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f11788c6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11740fcfb0 0x7f1174112b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:35.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f11788c6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11740fcfb0 0x7f1174112b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51408/0 (socket says 172.21.15.134:51408) 2024-02-16T22:16:35.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f11788c6700 1 -- 172.21.15.134:0/159643421 learned_addr learned my addr 172.21.15.134:0/159643421 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:35.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f11790c7700 1 --2- 172.21.15.134:0/159643421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11740fbe40 0x7f11741105b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:35.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f11788c6700 1 -- 172.21.15.134:0/159643421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11740fbe40 msgr2=0x7f11741105b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:35.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f11788c6700 1 --2- 172.21.15.134:0/159643421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11740fbe40 0x7f11741105b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:35.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f11788c6700 1 -- 172.21.15.134:0/159643421 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1170005040 con 0x7f11740fcfb0 2024-02-16T22:16:35.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f11788c6700 1 --2- 172.21.15.134:0/159643421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11740fcfb0 0x7f1174112b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1164002a80 tx=0x7f11640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:35.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f1169ffb700 1 -- 172.21.15.134:0/159643421 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1164007cc0 con 0x7f11740fcfb0 2024-02-16T22:16:35.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f1169ffb700 1 -- 172.21.15.134:0/159643421 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f116400f040 con 0x7f11740fcfb0 2024-02-16T22:16:35.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f117b32b700 1 -- 172.21.15.134:0/159643421 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1174113100 con 0x7f11740fcfb0 2024-02-16T22:16:35.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.162+0000 7f1169ffb700 1 -- 172.21.15.134:0/159643421 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11640096f0 con 0x7f11740fcfb0 2024-02-16T22:16:35.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.163+0000 7f117b32b700 1 -- 172.21.15.134:0/159643421 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1174113640 con 0x7f11740fcfb0 2024-02-16T22:16:35.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.163+0000 7f117b32b700 1 -- 172.21.15.134:0/159643421 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117404bed0 con 0x7f11740fcfb0 2024-02-16T22:16:35.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.164+0000 7f1169ffb700 1 -- 172.21.15.134:0/159643421 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f116400d690 con 0x7f11740fcfb0 2024-02-16T22:16:35.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.164+0000 7f1169ffb700 1 --2- 172.21.15.134:0/159643421 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f11600692a0 0x7f116006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:35.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.164+0000 7f1169ffb700 1 -- 172.21.15.134:0/159643421 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1164086860 con 0x7f11740fcfb0 2024-02-16T22:16:35.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.164+0000 7f11790c7700 1 --2- 172.21.15.134:0/159643421 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f11600692a0 0x7f116006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:35.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.165+0000 7f11790c7700 1 --2- 172.21.15.134:0/159643421 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f11600692a0 0x7f116006b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1170000c00 tx=0x7f1170009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:35.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.169+0000 7f1169ffb700 1 -- 172.21.15.134:0/159643421 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f116404cbd0 con 0x7f11740fcfb0 2024-02-16T22:16:35.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.398+0000 7f117b32b700 1 -- 172.21.15.134:0/159643421 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1174104930 con 0x7f11740fcfb0 2024-02-16T22:16:35.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.398+0000 7f1169ffb700 1 -- 172.21.15.134:0/159643421 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f1164052b90 con 0x7f11740fcfb0 2024-02-16T22:16:35.401 INFO:teuthology.orchestra.run.smithi134.stdout:e2 2024-02-16T22:16:35.401 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:16:35.401 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:16:35.401 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-02-16T22:16:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:16:35.401 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-02-16T22:16:35.401 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-02-16T22:16:35.401 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 2 2024-02-16T22:16:35.401 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-16T22:16:35.401 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:16:35.401 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-02-16T22:16:31.472200+0000 2024-02-16T22:16:35.401 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-02-16T22:16:35.401 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-02-16T22:16:35.402 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-02-16T22:16:35.402 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-02-16T22:16:35.402 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-02-16T22:16:35.402 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-02-16T22:16:35.402 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-02-16T22:16:35.402 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 0 2024-02-16T22:16:35.402 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:16:35.402 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-02-16T22:16:35.402 INFO:teuthology.orchestra.run.smithi134.stdout:in 2024-02-16T22:16:35.402 INFO:teuthology.orchestra.run.smithi134.stdout:up {} 2024-02-16T22:16:35.402 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-02-16T22:16:35.402 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-02-16T22:16:35.402 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-02-16T22:16:35.403 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-02-16T22:16:35.403 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-02-16T22:16:35.403 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-02-16T22:16:35.403 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-02-16T22:16:35.403 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 0 2024-02-16T22:16:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:16:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:16:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.401+0000 7f117b32b700 1 -- 172.21.15.134:0/159643421 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f11600692a0 msgr2=0x7f116006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.401+0000 7f117b32b700 1 --2- 172.21.15.134:0/159643421 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f11600692a0 0x7f116006b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1170000c00 tx=0x7f1170009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.401+0000 7f117b32b700 1 -- 172.21.15.134:0/159643421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11740fcfb0 msgr2=0x7f1174112b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.401+0000 7f117b32b700 1 --2- 172.21.15.134:0/159643421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11740fcfb0 0x7f1174112b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1164002a80 tx=0x7f11640046b0 comp rx=0 tx=0).stop 2024-02-16T22:16:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.401+0000 7f117b32b700 1 -- 172.21.15.134:0/159643421 shutdown_connections 2024-02-16T22:16:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.401+0000 7f117b32b700 1 --2- 172.21.15.134:0/159643421 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f11600692a0 0x7f116006b750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.401+0000 7f117b32b700 1 --2- 172.21.15.134:0/159643421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11740fbe40 0x7f11741105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.401+0000 7f117b32b700 1 --2- 172.21.15.134:0/159643421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11740fcfb0 0x7f1174112b00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.401+0000 7f117b32b700 1 -- 172.21.15.134:0/159643421 >> 172.21.15.134:0/159643421 conn(0x7f11740f7520 msgr2=0x7f1174100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.401+0000 7f117b32b700 1 -- 172.21.15.134:0/159643421 shutdown_connections 2024-02-16T22:16:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:35.401+0000 7f117b32b700 1 -- 172.21.15.134:0/159643421 wait complete. 2024-02-16T22:16:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 2 2024-02-16T22:16:35.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:35 smithi134 ceph-mon[28869]: pgmap v179: 65 pgs: 10 creating+peering, 43 active+clean, 12 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:35.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:35 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/159643421' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:16:35.812 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:35 smithi173 ceph-mon[37280]: pgmap v179: 65 pgs: 10 creating+peering, 43 active+clean, 12 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:35.812 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:35 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/159643421' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:16:36.069 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-16T22:16:36.078 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T22:16:36.078 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-02-16T22:16:36.384 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:37.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:37.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:37.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:37.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.qljqef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:16:37.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.qljqef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-16T22:16:37.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:16:37.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: Deploying daemon mds.cephfs.smithi173.qljqef on smithi173 2024-02-16T22:16:37.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: daemon mds.cephfs.smithi134.cygfxr assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-16T22:16:37.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-16T22:16:37.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-16T22:16:37.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: Cluster is now healthy 2024-02-16T22:16:37.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: mds.? [v2:172.21.15.134:6826/49557312,v1:172.21.15.134:6827/49557312] up:boot 2024-02-16T22:16:37.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: fsmap cephfs:1 {0=cephfs.smithi134.cygfxr=up:creating} 2024-02-16T22:16:37.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:16:37.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:37 smithi134 ceph-mon[28869]: daemon mds.cephfs.smithi134.cygfxr is now active in filesystem cephfs as rank 0 2024-02-16T22:16:37.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:37.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:37.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:37.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.qljqef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:16:37.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.qljqef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-16T22:16:37.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:16:37.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: Deploying daemon mds.cephfs.smithi173.qljqef on smithi173 2024-02-16T22:16:37.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: daemon mds.cephfs.smithi134.cygfxr assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-16T22:16:37.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-16T22:16:37.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-16T22:16:37.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: Cluster is now healthy 2024-02-16T22:16:37.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: mds.? [v2:172.21.15.134:6826/49557312,v1:172.21.15.134:6827/49557312] up:boot 2024-02-16T22:16:37.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: fsmap cephfs:1 {0=cephfs.smithi134.cygfxr=up:creating} 2024-02-16T22:16:37.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:16:37.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:37 smithi173 ceph-mon[37280]: daemon mds.cephfs.smithi134.cygfxr is now active in filesystem cephfs as rank 0 2024-02-16T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.915+0000 7fe1dd68b700 1 -- 172.21.15.134:0/220395880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d8066c30 msgr2=0x7fe1d80ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.915+0000 7fe1dd68b700 1 --2- 172.21.15.134:0/220395880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d8066c30 0x7fe1d80ffb30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009ce0 tx=0x7fe1d0004d10 comp rx=0 tx=0).stop 2024-02-16T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.915+0000 7fe1dd68b700 1 -- 172.21.15.134:0/220395880 shutdown_connections 2024-02-16T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.915+0000 7fe1dd68b700 1 --2- 172.21.15.134:0/220395880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1d8100100 0x7fe1d8102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.915+0000 7fe1dd68b700 1 --2- 172.21.15.134:0/220395880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d8066c30 0x7fe1d80ffb30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.915+0000 7fe1dd68b700 1 -- 172.21.15.134:0/220395880 >> 172.21.15.134:0/220395880 conn(0x7fe1d80f7500 msgr2=0x7fe1d80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.915+0000 7fe1dd68b700 1 -- 172.21.15.134:0/220395880 shutdown_connections 2024-02-16T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.915+0000 7fe1dd68b700 1 -- 172.21.15.134:0/220395880 wait complete. 2024-02-16T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.916+0000 7fe1dd68b700 1 Processor -- start 2024-02-16T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.916+0000 7fe1dd68b700 1 -- start start 2024-02-16T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.916+0000 7fe1dd68b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1d8066c30 0x7fe1d810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.916+0000 7fe1dd68b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d8100100 0x7fe1d810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.916+0000 7fe1dd68b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d810e4b0 con 0x7fe1d8100100 2024-02-16T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.916+0000 7fe1dd68b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d810ed50 con 0x7fe1d8066c30 2024-02-16T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.916+0000 7fe1d67fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d8100100 0x7fe1d810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.916+0000 7fe1d67fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d8100100 0x7fe1d810deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51456/0 (socket says 172.21.15.134:51456) 2024-02-16T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.916+0000 7fe1d67fc700 1 -- 172.21.15.134:0/776969593 learned_addr learned my addr 172.21.15.134:0/776969593 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.916+0000 7fe1d6ffd700 1 --2- 172.21.15.134:0/776969593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1d8066c30 0x7fe1d810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.917+0000 7fe1d67fc700 1 -- 172.21.15.134:0/776969593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1d8066c30 msgr2=0x7fe1d810d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.917+0000 7fe1d67fc700 1 --2- 172.21.15.134:0/776969593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1d8066c30 0x7fe1d810d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.917+0000 7fe1d67fc700 1 -- 172.21.15.134:0/776969593 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0009940 con 0x7fe1d8100100 2024-02-16T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.917+0000 7fe1d67fc700 1 --2- 172.21.15.134:0/776969593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d8100100 0x7fe1d810deb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00eb40 tx=0x7fe1cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.917+0000 7fe1bf7fe700 1 -- 172.21.15.134:0/776969593 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1cc007cc0 con 0x7fe1d8100100 2024-02-16T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.917+0000 7fe1dd68b700 1 -- 172.21.15.134:0/776969593 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d810efd0 con 0x7fe1d8100100 2024-02-16T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.917+0000 7fe1dd68b700 1 -- 172.21.15.134:0/776969593 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d810f510 con 0x7fe1d8100100 2024-02-16T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.917+0000 7fe1bf7fe700 1 -- 172.21.15.134:0/776969593 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe1cc00f040 con 0x7fe1d8100100 2024-02-16T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.917+0000 7fe1bf7fe700 1 -- 172.21.15.134:0/776969593 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1cc00c9d0 con 0x7fe1d8100100 2024-02-16T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.918+0000 7fe1dd68b700 1 -- 172.21.15.134:0/776969593 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d804bed0 con 0x7fe1d8100100 2024-02-16T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.918+0000 7fe1bf7fe700 1 -- 172.21.15.134:0/776969593 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe1cc00cb30 con 0x7fe1d8100100 2024-02-16T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.919+0000 7fe1bf7fe700 1 --2- 172.21.15.134:0/776969593 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe1c00692a0 0x7fe1c006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.919+0000 7fe1bf7fe700 1 -- 172.21.15.134:0/776969593 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe1cc086ab0 con 0x7fe1d8100100 2024-02-16T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.919+0000 7fe1d6ffd700 1 --2- 172.21.15.134:0/776969593 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe1c00692a0 0x7fe1c006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.919+0000 7fe1d6ffd700 1 --2- 172.21.15.134:0/776969593 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe1c00692a0 0x7fe1c006b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0015040 tx=0x7fe1d0004d10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:37.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:37.923+0000 7fe1bf7fe700 1 -- 172.21.15.134:0/776969593 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe1cc04dbd0 con 0x7fe1d8100100 2024-02-16T22:16:38.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:38.152+0000 7fe1dd68b700 1 -- 172.21.15.134:0/776969593 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fe1d810f940 con 0x7fe1d8100100 2024-02-16T22:16:38.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:38.459+0000 7fe1bf7fe700 1 -- 172.21.15.134:0/776969593 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v5) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe1cc056920 con 0x7fe1d8100100 2024-02-16T22:16:38.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:38 smithi134 ceph-mon[28869]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:38.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:38 smithi134 ceph-mon[28869]: mds.? [v2:172.21.15.134:6826/49557312,v1:172.21.15.134:6827/49557312] up:active 2024-02-16T22:16:38.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:38 smithi134 ceph-mon[28869]: fsmap cephfs:1 {0=cephfs.smithi134.cygfxr=up:active} 2024-02-16T22:16:38.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:38 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/776969593' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-16T22:16:38.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:38.461+0000 7fe1dd68b700 1 -- 172.21.15.134:0/776969593 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe1c00692a0 msgr2=0x7fe1c006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:38.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:38.461+0000 7fe1dd68b700 1 --2- 172.21.15.134:0/776969593 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe1c00692a0 0x7fe1c006b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0015040 tx=0x7fe1d0004d10 comp rx=0 tx=0).stop 2024-02-16T22:16:38.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:38.461+0000 7fe1dd68b700 1 -- 172.21.15.134:0/776969593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d8100100 msgr2=0x7fe1d810deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:38.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:38.461+0000 7fe1dd68b700 1 --2- 172.21.15.134:0/776969593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d8100100 0x7fe1d810deb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00eb40 tx=0x7fe1cc00b040 comp rx=0 tx=0).stop 2024-02-16T22:16:38.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:38.461+0000 7fe1dd68b700 1 -- 172.21.15.134:0/776969593 shutdown_connections 2024-02-16T22:16:38.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:38.461+0000 7fe1dd68b700 1 --2- 172.21.15.134:0/776969593 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe1c00692a0 0x7fe1c006b750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:38.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:38.461+0000 7fe1dd68b700 1 --2- 172.21.15.134:0/776969593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1d8066c30 0x7fe1d810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:38.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:38.461+0000 7fe1dd68b700 1 --2- 172.21.15.134:0/776969593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d8100100 0x7fe1d810deb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:38.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:38.461+0000 7fe1dd68b700 1 -- 172.21.15.134:0/776969593 >> 172.21.15.134:0/776969593 conn(0x7fe1d80f7500 msgr2=0x7fe1d80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:38.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:38.461+0000 7fe1dd68b700 1 -- 172.21.15.134:0/776969593 shutdown_connections 2024-02-16T22:16:38.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:38.461+0000 7fe1dd68b700 1 -- 172.21.15.134:0/776969593 wait complete. 2024-02-16T22:16:38.596 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:38 smithi173 ceph-mon[37280]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:16:38.596 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:38 smithi173 ceph-mon[37280]: mds.? [v2:172.21.15.134:6826/49557312,v1:172.21.15.134:6827/49557312] up:active 2024-02-16T22:16:38.596 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:38 smithi173 ceph-mon[37280]: fsmap cephfs:1 {0=cephfs.smithi134.cygfxr=up:active} 2024-02-16T22:16:38.596 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:38 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/776969593' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-16T22:16:39.138 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-16T22:16:39.147 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T22:16:39.148 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-02-16T22:16:39.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:39 smithi134 ceph-mon[28869]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-16T22:16:39.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:39 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/776969593' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-16T22:16:39.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:39 smithi134 ceph-mon[28869]: fsmap cephfs:1 {0=cephfs.smithi134.cygfxr=up:active} 2024-02-16T22:16:39.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:39.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:39.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:39.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jyajef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:16:39.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jyajef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-16T22:16:39.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:39 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:16:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:39 smithi173 ceph-mon[37280]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-16T22:16:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:39 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/776969593' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-16T22:16:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:39 smithi173 ceph-mon[37280]: fsmap cephfs:1 {0=cephfs.smithi134.cygfxr=up:active} 2024-02-16T22:16:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:39.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jyajef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:16:39.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jyajef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-16T22:16:39.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:39 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:16:40.236 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:40.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:40 smithi134 ceph-mon[28869]: Deploying daemon mds.cephfs.smithi134.jyajef on smithi134 2024-02-16T22:16:40.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:40 smithi134 ceph-mon[28869]: pgmap v181: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-02-16T22:16:40.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:40 smithi134 ceph-mon[28869]: mds.? [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] up:boot 2024-02-16T22:16:40.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:40 smithi134 ceph-mon[28869]: daemon mds.cephfs.smithi173.qljqef assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-16T22:16:40.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:40 smithi134 ceph-mon[28869]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-16T22:16:40.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:40 smithi134 ceph-mon[28869]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-16T22:16:40.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:40 smithi134 ceph-mon[28869]: fsmap cephfs:1 {0=cephfs.smithi134.cygfxr=up:active} 1 up:standby 2024-02-16T22:16:40.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:40 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.qljqef"}]: dispatch 2024-02-16T22:16:40.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:40 smithi134 ceph-mon[28869]: fsmap cephfs:2 {0=cephfs.smithi134.cygfxr=up:active,1=cephfs.smithi173.qljqef=up:creating} 2024-02-16T22:16:40.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:40 smithi134 ceph-mon[28869]: daemon mds.cephfs.smithi173.qljqef is now active in filesystem cephfs as rank 1 2024-02-16T22:16:40.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:40 smithi173 ceph-mon[37280]: Deploying daemon mds.cephfs.smithi134.jyajef on smithi134 2024-02-16T22:16:40.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:40 smithi173 ceph-mon[37280]: pgmap v181: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-02-16T22:16:40.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:40 smithi173 ceph-mon[37280]: mds.? [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] up:boot 2024-02-16T22:16:40.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:40 smithi173 ceph-mon[37280]: daemon mds.cephfs.smithi173.qljqef assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-16T22:16:40.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:40 smithi173 ceph-mon[37280]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-16T22:16:40.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:40 smithi173 ceph-mon[37280]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-16T22:16:40.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:40 smithi173 ceph-mon[37280]: fsmap cephfs:1 {0=cephfs.smithi134.cygfxr=up:active} 1 up:standby 2024-02-16T22:16:40.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:40 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.qljqef"}]: dispatch 2024-02-16T22:16:40.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:40 smithi173 ceph-mon[37280]: fsmap cephfs:2 {0=cephfs.smithi134.cygfxr=up:active,1=cephfs.smithi173.qljqef=up:creating} 2024-02-16T22:16:40.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:40 smithi173 ceph-mon[37280]: daemon mds.cephfs.smithi173.qljqef is now active in filesystem cephfs as rank 1 2024-02-16T22:16:41.678 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:41 smithi134 ceph-mon[28869]: mds.? [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] up:active 2024-02-16T22:16:41.678 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:41 smithi134 ceph-mon[28869]: fsmap cephfs:2 {0=cephfs.smithi134.cygfxr=up:active,1=cephfs.smithi173.qljqef=up:active} 2024-02-16T22:16:41.678 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:41 smithi134 ceph-mon[28869]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-02-16T22:16:41.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:41 smithi173 ceph-mon[37280]: mds.? [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] up:active 2024-02-16T22:16:41.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:41 smithi173 ceph-mon[37280]: fsmap cephfs:2 {0=cephfs.smithi134.cygfxr=up:active,1=cephfs.smithi173.qljqef=up:active} 2024-02-16T22:16:41.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:41 smithi173 ceph-mon[37280]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-02-16T22:16:41.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.915+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/3178119889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ee40fe0e0 msgr2=0x7f0ee40fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:41.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.915+0000 7f0ee9d8b700 1 --2- 172.21.15.134:0/3178119889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ee40fe0e0 0x7f0ee40fe550 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc004940 tx=0x7f0ecc009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:41.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.915+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/3178119889 shutdown_connections 2024-02-16T22:16:41.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.915+0000 7f0ee9d8b700 1 --2- 172.21.15.134:0/3178119889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ee40fe0e0 0x7f0ee40fe550 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:41.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.915+0000 7f0ee9d8b700 1 --2- 172.21.15.134:0/3178119889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ee40fcef0 0x7f0ee40fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:41.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.915+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/3178119889 >> 172.21.15.134:0/3178119889 conn(0x7f0ee40f8620 msgr2=0x7f0ee40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:41.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.915+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/3178119889 shutdown_connections 2024-02-16T22:16:41.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.915+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/3178119889 wait complete. 2024-02-16T22:16:41.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.915+0000 7f0ee9d8b700 1 Processor -- start 2024-02-16T22:16:41.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0ee9d8b700 1 -- start start 2024-02-16T22:16:41.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0ee9d8b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ee40fcef0 0x7f0ee410d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:41.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0ee9d8b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ee40fe0e0 0x7f0ee410de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:41.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0ee9d8b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee410e430 con 0x7f0ee40fe0e0 2024-02-16T22:16:41.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0ee9d8b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee410ecd0 con 0x7f0ee40fcef0 2024-02-16T22:16:41.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0edaffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ee40fe0e0 0x7f0ee410de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:41.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0edaffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ee40fe0e0 0x7f0ee410de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54534/0 (socket says 172.21.15.134:54534) 2024-02-16T22:16:41.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0edaffd700 1 -- 172.21.15.134:0/1217108441 learned_addr learned my addr 172.21.15.134:0/1217108441 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:41.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0ee37fe700 1 --2- 172.21.15.134:0/1217108441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ee40fcef0 0x7f0ee410d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:41.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0edaffd700 1 -- 172.21.15.134:0/1217108441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ee40fcef0 msgr2=0x7f0ee410d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:41.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0edaffd700 1 --2- 172.21.15.134:0/1217108441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ee40fcef0 0x7f0ee410d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:41.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0edaffd700 1 -- 172.21.15.134:0/1217108441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc005040 con 0x7f0ee40fe0e0 2024-02-16T22:16:41.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0edaffd700 1 --2- 172.21.15.134:0/1217108441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ee40fe0e0 0x7f0ee410de30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc000c00 tx=0x7f0ecc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:41.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0ee0ff9700 1 -- 172.21.15.134:0/1217108441 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ecc00e070 con 0x7f0ee40fe0e0 2024-02-16T22:16:41.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0ee0ff9700 1 -- 172.21.15.134:0/1217108441 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ecc01c400 con 0x7f0ee40fe0e0 2024-02-16T22:16:41.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/1217108441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee410ef50 con 0x7f0ee40fe0e0 2024-02-16T22:16:41.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0ee0ff9700 1 -- 172.21.15.134:0/1217108441 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ecc00b650 con 0x7f0ee40fe0e0 2024-02-16T22:16:41.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.916+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/1217108441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee410f430 con 0x7f0ee40fe0e0 2024-02-16T22:16:41.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.917+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/1217108441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee404bed0 con 0x7f0ee40fe0e0 2024-02-16T22:16:41.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.918+0000 7f0ee0ff9700 1 -- 172.21.15.134:0/1217108441 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f0ecc01ca50 con 0x7f0ee40fe0e0 2024-02-16T22:16:41.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.918+0000 7f0ee0ff9700 1 --2- 172.21.15.134:0/1217108441 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f0ed00692a0 0x7f0ed006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:41.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.918+0000 7f0ee37fe700 1 --2- 172.21.15.134:0/1217108441 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f0ed00692a0 0x7f0ed006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:41.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.918+0000 7f0ee0ff9700 1 -- 172.21.15.134:0/1217108441 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0ecc0886d0 con 0x7f0ee40fe0e0 2024-02-16T22:16:41.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.919+0000 7f0ee37fe700 1 --2- 172.21.15.134:0/1217108441 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f0ed00692a0 0x7f0ed006b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009b80 tx=0x7f0ed400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:41.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:41.923+0000 7f0ee0ff9700 1 -- 172.21.15.134:0/1217108441 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f0ecc058530 con 0x7f0ee40fe0e0 2024-02-16T22:16:42.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:42.153+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/1217108441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0ee4105a30 con 0x7f0ee40fe0e0 2024-02-16T22:16:42.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:42.482+0000 7f0ee0ff9700 1 -- 172.21.15.134:0/1217108441 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0ecc0580c0 con 0x7f0ee40fe0e0 2024-02-16T22:16:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:42.484+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/1217108441 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f0ed00692a0 msgr2=0x7f0ed006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:42.484+0000 7f0ee9d8b700 1 --2- 172.21.15.134:0/1217108441 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f0ed00692a0 0x7f0ed006b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009b80 tx=0x7f0ed400b040 comp rx=0 tx=0).stop 2024-02-16T22:16:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:42.484+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/1217108441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ee40fe0e0 msgr2=0x7f0ee410de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:42.484+0000 7f0ee9d8b700 1 --2- 172.21.15.134:0/1217108441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ee40fe0e0 0x7f0ee410de30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc000c00 tx=0x7f0ecc009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:42.484+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/1217108441 shutdown_connections 2024-02-16T22:16:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:42.484+0000 7f0ee9d8b700 1 --2- 172.21.15.134:0/1217108441 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f0ed00692a0 0x7f0ed006b750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:42.484+0000 7f0ee9d8b700 1 --2- 172.21.15.134:0/1217108441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ee40fcef0 0x7f0ee410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:42.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:42.484+0000 7f0ee9d8b700 1 --2- 172.21.15.134:0/1217108441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ee40fe0e0 0x7f0ee410de30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:42.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:42.484+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/1217108441 >> 172.21.15.134:0/1217108441 conn(0x7f0ee40f8620 msgr2=0x7f0ee41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:42.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:42.484+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/1217108441 shutdown_connections 2024-02-16T22:16:42.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:42.484+0000 7f0ee9d8b700 1 -- 172.21.15.134:0/1217108441 wait complete. 2024-02-16T22:16:42.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:42 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/1217108441' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-16T22:16:42.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:42 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:42.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:42 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:42.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:42 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:42.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:42 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.phstvm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:16:42.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:42 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.phstvm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-16T22:16:42.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:42 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:16:42.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:42 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/1217108441' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-16T22:16:42.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:42 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:42.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:42 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:42.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:42 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:42.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:42 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.phstvm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:16:42.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:42 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.phstvm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-16T22:16:42.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:42 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:16:43.152 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-16T22:16:43.164 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T22:16:43.164 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2024-02-16T22:16:43.422 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:43.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:43 smithi173 ceph-mon[37280]: Deploying daemon mds.cephfs.smithi173.phstvm on smithi173 2024-02-16T22:16:43.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:43 smithi173 ceph-mon[37280]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-16T22:16:43.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:43 smithi173 ceph-mon[37280]: Cluster is now healthy 2024-02-16T22:16:43.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:43 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/1217108441' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-16T22:16:43.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:43 smithi173 ceph-mon[37280]: mds.? [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] up:boot 2024-02-16T22:16:43.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:43 smithi173 ceph-mon[37280]: fsmap cephfs:2 {0=cephfs.smithi134.cygfxr=up:active,1=cephfs.smithi173.qljqef=up:active} 1 up:standby 2024-02-16T22:16:43.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:43 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jyajef"}]: dispatch 2024-02-16T22:16:43.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:43 smithi173 ceph-mon[37280]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-02-16T22:16:43.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:43 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:16:43.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:43 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:43.782 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:43 smithi134 ceph-mon[28869]: Deploying daemon mds.cephfs.smithi173.phstvm on smithi173 2024-02-16T22:16:43.782 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:43 smithi134 ceph-mon[28869]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-16T22:16:43.782 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:43 smithi134 ceph-mon[28869]: Cluster is now healthy 2024-02-16T22:16:43.782 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:43 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/1217108441' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-16T22:16:43.782 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:43 smithi134 ceph-mon[28869]: mds.? [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] up:boot 2024-02-16T22:16:43.782 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:43 smithi134 ceph-mon[28869]: fsmap cephfs:2 {0=cephfs.smithi134.cygfxr=up:active,1=cephfs.smithi173.qljqef=up:active} 1 up:standby 2024-02-16T22:16:43.782 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jyajef"}]: dispatch 2024-02-16T22:16:43.782 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:43 smithi134 ceph-mon[28869]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-02-16T22:16:43.783 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:16:43.783 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:45.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.026+0000 7ff58abf5700 1 -- 172.21.15.134:0/1852525834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5840fcef0 msgr2=0x7ff5840fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:45.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.026+0000 7ff58abf5700 1 --2- 172.21.15.134:0/1852525834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5840fcef0 0x7ff5840fd320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff578004940 tx=0x7ff578009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:45.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.026+0000 7ff58abf5700 1 -- 172.21.15.134:0/1852525834 shutdown_connections 2024-02-16T22:16:45.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.026+0000 7ff58abf5700 1 --2- 172.21.15.134:0/1852525834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5840fe0e0 0x7ff5840fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:45.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.026+0000 7ff58abf5700 1 --2- 172.21.15.134:0/1852525834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5840fcef0 0x7ff5840fd320 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:45.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.026+0000 7ff58abf5700 1 -- 172.21.15.134:0/1852525834 >> 172.21.15.134:0/1852525834 conn(0x7ff5840f8620 msgr2=0x7ff5840faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:45.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.026+0000 7ff58abf5700 1 -- 172.21.15.134:0/1852525834 shutdown_connections 2024-02-16T22:16:45.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.026+0000 7ff58abf5700 1 -- 172.21.15.134:0/1852525834 wait complete. 2024-02-16T22:16:45.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.026+0000 7ff58abf5700 1 Processor -- start 2024-02-16T22:16:45.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.026+0000 7ff58abf5700 1 -- start start 2024-02-16T22:16:45.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff58abf5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5840fcef0 0x7ff58410d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:45.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff58abf5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5840fe0e0 0x7ff58410de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:45.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff58abf5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58410e420 con 0x7ff5840fcef0 2024-02-16T22:16:45.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff58abf5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58410ecc0 con 0x7ff5840fe0e0 2024-02-16T22:16:45.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff588991700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5840fcef0 0x7ff58410d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:45.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff588991700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5840fcef0 0x7ff58410d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54572/0 (socket says 172.21.15.134:54572) 2024-02-16T22:16:45.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff588991700 1 -- 172.21.15.134:0/2926019700 learned_addr learned my addr 172.21.15.134:0/2926019700 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:45.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff583fff700 1 --2- 172.21.15.134:0/2926019700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5840fe0e0 0x7ff58410de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:45.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff588991700 1 -- 172.21.15.134:0/2926019700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5840fe0e0 msgr2=0x7ff58410de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:45.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff588991700 1 --2- 172.21.15.134:0/2926019700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5840fe0e0 0x7ff58410de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:45.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff588991700 1 -- 172.21.15.134:0/2926019700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff570005040 con 0x7ff5840fcef0 2024-02-16T22:16:45.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff588991700 1 --2- 172.21.15.134:0/2926019700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5840fcef0 0x7ff58410d8e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff578000c00 tx=0x7ff578009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:45.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff5817fa700 1 -- 172.21.15.134:0/2926019700 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff57800e070 con 0x7ff5840fcef0 2024-02-16T22:16:45.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff5817fa700 1 -- 172.21.15.134:0/2926019700 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff57801c400 con 0x7ff5840fcef0 2024-02-16T22:16:45.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff58abf5700 1 -- 172.21.15.134:0/2926019700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff578005040 con 0x7ff5840fcef0 2024-02-16T22:16:45.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.027+0000 7ff5817fa700 1 -- 172.21.15.134:0/2926019700 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff57800b670 con 0x7ff5840fcef0 2024-02-16T22:16:45.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.028+0000 7ff58abf5700 1 -- 172.21.15.134:0/2926019700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58410f290 con 0x7ff5840fcef0 2024-02-16T22:16:45.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.029+0000 7ff58abf5700 1 -- 172.21.15.134:0/2926019700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58404bed0 con 0x7ff5840fcef0 2024-02-16T22:16:45.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.029+0000 7ff5817fa700 1 -- 172.21.15.134:0/2926019700 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff578013af0 con 0x7ff5840fcef0 2024-02-16T22:16:45.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.029+0000 7ff5817fa700 1 --2- 172.21.15.134:0/2926019700 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff5740692a0 0x7ff57406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:45.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.029+0000 7ff5817fa700 1 -- 172.21.15.134:0/2926019700 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff5780887a0 con 0x7ff5840fcef0 2024-02-16T22:16:45.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.030+0000 7ff583fff700 1 --2- 172.21.15.134:0/2926019700 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff5740692a0 0x7ff57406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:45.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.030+0000 7ff583fff700 1 --2- 172.21.15.134:0/2926019700 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff5740692a0 0x7ff57406b750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff570009fd0 tx=0x7ff57000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:45.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.034+0000 7ff5817fa700 1 -- 172.21.15.134:0/2926019700 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff578058560 con 0x7ff5840fcef0 2024-02-16T22:16:45.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.290+0000 7ff58abf5700 1 -- 172.21.15.134:0/2926019700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7ff58410f6f0 con 0x7ff5840fcef0 2024-02-16T22:16:45.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.900+0000 7ff5817fa700 1 -- 172.21.15.134:0/2926019700 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v11) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff5780580f0 con 0x7ff5840fcef0 2024-02-16T22:16:45.902 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:45 smithi134 ceph-mon[28869]: mds.? [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] up:boot 2024-02-16T22:16:45.902 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:45 smithi134 ceph-mon[28869]: fsmap cephfs:2 {0=cephfs.smithi134.cygfxr=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:16:45.903 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:45 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.phstvm"}]: dispatch 2024-02-16T22:16:45.903 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:45 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:45.903 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:45 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:45.903 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:45 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:45.903 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:45 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:45.903 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:45 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:45.903 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:45 smithi134 ceph-mon[28869]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-02-16T22:16:45.903 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:45 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:16:45.903 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:45 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2926019700' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-16T22:16:45.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.902+0000 7ff58abf5700 1 -- 172.21.15.134:0/2926019700 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff5740692a0 msgr2=0x7ff57406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:45.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.902+0000 7ff58abf5700 1 --2- 172.21.15.134:0/2926019700 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff5740692a0 0x7ff57406b750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff570009fd0 tx=0x7ff57000b040 comp rx=0 tx=0).stop 2024-02-16T22:16:45.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.902+0000 7ff58abf5700 1 -- 172.21.15.134:0/2926019700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5840fcef0 msgr2=0x7ff58410d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:45.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.902+0000 7ff58abf5700 1 --2- 172.21.15.134:0/2926019700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5840fcef0 0x7ff58410d8e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff578000c00 tx=0x7ff578009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:45.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.902+0000 7ff58abf5700 1 -- 172.21.15.134:0/2926019700 shutdown_connections 2024-02-16T22:16:45.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.902+0000 7ff58abf5700 1 --2- 172.21.15.134:0/2926019700 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff5740692a0 0x7ff57406b750 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:45.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.902+0000 7ff58abf5700 1 --2- 172.21.15.134:0/2926019700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5840fcef0 0x7ff58410d8e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:45.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.902+0000 7ff58abf5700 1 --2- 172.21.15.134:0/2926019700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5840fe0e0 0x7ff58410de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:45.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.902+0000 7ff58abf5700 1 -- 172.21.15.134:0/2926019700 >> 172.21.15.134:0/2926019700 conn(0x7ff5840f8620 msgr2=0x7ff5841013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:45.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.902+0000 7ff58abf5700 1 -- 172.21.15.134:0/2926019700 shutdown_connections 2024-02-16T22:16:45.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:45.902+0000 7ff58abf5700 1 -- 172.21.15.134:0/2926019700 wait complete. 2024-02-16T22:16:45.905 INFO:teuthology.orchestra.run.smithi134.stderr:inline data disabled 2024-02-16T22:16:45.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:45 smithi173 ceph-mon[37280]: mds.? [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] up:boot 2024-02-16T22:16:45.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:45 smithi173 ceph-mon[37280]: fsmap cephfs:2 {0=cephfs.smithi134.cygfxr=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:16:45.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:45 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.phstvm"}]: dispatch 2024-02-16T22:16:45.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:45 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:45.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:45 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:45.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:45 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:45.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:45 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:45.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:45 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:45.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:45 smithi173 ceph-mon[37280]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-02-16T22:16:45.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:45 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:16:45.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:45 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2926019700' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-16T22:16:46.823 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-16T22:16:46.833 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T22:16:46.833 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-16T22:16:47.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:46 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2926019700' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-16T22:16:47.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:46 smithi134 ceph-mon[28869]: fsmap cephfs:2 {0=cephfs.smithi134.cygfxr=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:16:47.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:46 smithi134 ceph-mon[28869]: Dropping low affinity active daemon mds.cephfs.smithi134.cygfxr in favor of higher affinity standby. 2024-02-16T22:16:47.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:46 smithi134 ceph-mon[28869]: Replacing daemon mds.cephfs.smithi134.cygfxr as rank 0 with standby daemon mds.cephfs.smithi134.jyajef 2024-02-16T22:16:47.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:46 smithi134 ceph-mon[28869]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-16T22:16:47.085 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:46 smithi134 ceph-mon[28869]: osdmap e46: 6 total, 6 up, 6 in 2024-02-16T22:16:47.085 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:46 smithi134 ceph-mon[28869]: mds.? [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] up:standby 2024-02-16T22:16:47.085 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:46 smithi134 ceph-mon[28869]: fsmap cephfs:2/2 {0=cephfs.smithi134.jyajef=up:replay,1=cephfs.smithi173.qljqef=up:active} 1 up:standby 2024-02-16T22:16:47.085 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:46 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:16:47.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:46 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2926019700' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-16T22:16:47.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:46 smithi173 ceph-mon[37280]: fsmap cephfs:2 {0=cephfs.smithi134.cygfxr=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:16:47.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:46 smithi173 ceph-mon[37280]: Dropping low affinity active daemon mds.cephfs.smithi134.cygfxr in favor of higher affinity standby. 2024-02-16T22:16:47.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:46 smithi173 ceph-mon[37280]: Replacing daemon mds.cephfs.smithi134.cygfxr as rank 0 with standby daemon mds.cephfs.smithi134.jyajef 2024-02-16T22:16:47.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:46 smithi173 ceph-mon[37280]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-16T22:16:47.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:46 smithi173 ceph-mon[37280]: osdmap e46: 6 total, 6 up, 6 in 2024-02-16T22:16:47.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:46 smithi173 ceph-mon[37280]: mds.? [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] up:standby 2024-02-16T22:16:47.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:46 smithi173 ceph-mon[37280]: fsmap cephfs:2/2 {0=cephfs.smithi134.jyajef=up:replay,1=cephfs.smithi173.qljqef=up:active} 1 up:standby 2024-02-16T22:16:47.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:46 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:16:47.514 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:47 smithi134 ceph-mon[28869]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2024-02-16T22:16:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:47 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:47 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:47 smithi134 ceph-mon[28869]: mds.? [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] up:resolve 2024-02-16T22:16:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:47 smithi134 ceph-mon[28869]: mds.? [v2:172.21.15.134:6826/2804816044,v1:172.21.15.134:6827/2804816044] up:boot 2024-02-16T22:16:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:47 smithi134 ceph-mon[28869]: fsmap cephfs:2/2 {0=cephfs.smithi134.jyajef=up:resolve,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:16:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:47 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:16:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:47 smithi173 ceph-mon[37280]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2024-02-16T22:16:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:47 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:47 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:47 smithi173 ceph-mon[37280]: mds.? [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] up:resolve 2024-02-16T22:16:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:47 smithi173 ceph-mon[37280]: mds.? [v2:172.21.15.134:6826/2804816044,v1:172.21.15.134:6827/2804816044] up:boot 2024-02-16T22:16:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:47 smithi173 ceph-mon[37280]: fsmap cephfs:2/2 {0=cephfs.smithi134.jyajef=up:resolve,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:16:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:47 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:16:49.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:48 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:49.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:48 smithi134 ceph-mon[28869]: mds.? [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] up:reconnect 2024-02-16T22:16:49.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:48 smithi134 ceph-mon[28869]: mds.? [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] up:active 2024-02-16T22:16:49.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:48 smithi134 ceph-mon[28869]: fsmap cephfs:2/2 {0=cephfs.smithi134.jyajef=up:reconnect,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:16:49.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:48 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:49.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:48 smithi173 ceph-mon[37280]: mds.? [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] up:reconnect 2024-02-16T22:16:49.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:48 smithi173 ceph-mon[37280]: mds.? [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] up:active 2024-02-16T22:16:49.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:48 smithi173 ceph-mon[37280]: fsmap cephfs:2/2 {0=cephfs.smithi134.jyajef=up:reconnect,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:16:50.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:49 smithi134 ceph-mon[28869]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 614 B/s rd, 1.5 KiB/s wr, 7 op/s 2024-02-16T22:16:50.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:49 smithi134 ceph-mon[28869]: mds.? [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] up:rejoin 2024-02-16T22:16:50.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:49 smithi134 ceph-mon[28869]: mds.? [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] up:standby 2024-02-16T22:16:50.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:49 smithi134 ceph-mon[28869]: fsmap cephfs:2/2 {0=cephfs.smithi134.jyajef=up:rejoin,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:16:50.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:49 smithi134 ceph-mon[28869]: daemon mds.cephfs.smithi134.jyajef is now active in filesystem cephfs as rank 0 2024-02-16T22:16:50.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:49 smithi173 ceph-mon[37280]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 614 B/s rd, 1.5 KiB/s wr, 7 op/s 2024-02-16T22:16:50.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:49 smithi173 ceph-mon[37280]: mds.? [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] up:rejoin 2024-02-16T22:16:50.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:49 smithi173 ceph-mon[37280]: mds.? [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] up:standby 2024-02-16T22:16:50.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:49 smithi173 ceph-mon[37280]: fsmap cephfs:2/2 {0=cephfs.smithi134.jyajef=up:rejoin,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:16:50.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:49 smithi173 ceph-mon[37280]: daemon mds.cephfs.smithi134.jyajef is now active in filesystem cephfs as rank 0 2024-02-16T22:16:50.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.943+0000 7fdaedf40700 1 -- 172.21.15.134:0/1959533478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae80fe0e0 msgr2=0x7fdae80fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.943+0000 7fdaedf40700 1 --2- 172.21.15.134:0/1959533478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae80fe0e0 0x7fdae80fe550 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdadc004940 tx=0x7fdadc009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.943+0000 7fdaedf40700 1 -- 172.21.15.134:0/1959533478 shutdown_connections 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.943+0000 7fdaedf40700 1 --2- 172.21.15.134:0/1959533478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae80fe0e0 0x7fdae80fe550 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.943+0000 7fdaedf40700 1 --2- 172.21.15.134:0/1959533478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdae80fcef0 0x7fdae80fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.943+0000 7fdaedf40700 1 -- 172.21.15.134:0/1959533478 >> 172.21.15.134:0/1959533478 conn(0x7fdae80f8620 msgr2=0x7fdae80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.943+0000 7fdaedf40700 1 -- 172.21.15.134:0/1959533478 shutdown_connections 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.943+0000 7fdaedf40700 1 -- 172.21.15.134:0/1959533478 wait complete. 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.943+0000 7fdaedf40700 1 Processor -- start 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.943+0000 7fdaedf40700 1 -- start start 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.943+0000 7fdaedf40700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae80fcef0 0x7fdae810d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.943+0000 7fdaedf40700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdae80fe0e0 0x7fdae810dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.943+0000 7fdaedf40700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae810e4a0 con 0x7fdae80fcef0 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.943+0000 7fdaedf40700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae810ed40 con 0x7fdae80fe0e0 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.944+0000 7fdae77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae80fcef0 0x7fdae810d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:50.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.944+0000 7fdae77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae80fcef0 0x7fdae810d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54612/0 (socket says 172.21.15.134:54612) 2024-02-16T22:16:50.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.944+0000 7fdae77fe700 1 -- 172.21.15.134:0/3713703803 learned_addr learned my addr 172.21.15.134:0/3713703803 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:50.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.944+0000 7fdae6ffd700 1 --2- 172.21.15.134:0/3713703803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdae80fe0e0 0x7fdae810dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:50.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.944+0000 7fdae77fe700 1 -- 172.21.15.134:0/3713703803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdae80fe0e0 msgr2=0x7fdae810dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:50.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.944+0000 7fdae77fe700 1 --2- 172.21.15.134:0/3713703803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdae80fe0e0 0x7fdae810dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:50.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.944+0000 7fdae77fe700 1 -- 172.21.15.134:0/3713703803 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc005040 con 0x7fdae80fcef0 2024-02-16T22:16:50.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.944+0000 7fdae6ffd700 1 --2- 172.21.15.134:0/3713703803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdae80fe0e0 0x7fdae810dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:16:50.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.944+0000 7fdae77fe700 1 --2- 172.21.15.134:0/3713703803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae80fcef0 0x7fdae810d960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdad800cb10 tx=0x7fdad800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.944+0000 7fdacffff700 1 -- 172.21.15.134:0/3713703803 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdad800a980 con 0x7fdae80fcef0 2024-02-16T22:16:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.944+0000 7fdacffff700 1 -- 172.21.15.134:0/3713703803 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdad8012420 con 0x7fdae80fcef0 2024-02-16T22:16:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.944+0000 7fdacffff700 1 -- 172.21.15.134:0/3713703803 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdad80115c0 con 0x7fdae80fcef0 2024-02-16T22:16:50.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.944+0000 7fdaedf40700 1 -- 172.21.15.134:0/3713703803 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae810f020 con 0x7fdae80fcef0 2024-02-16T22:16:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.944+0000 7fdaedf40700 1 -- 172.21.15.134:0/3713703803 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae810f560 con 0x7fdae80fcef0 2024-02-16T22:16:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.945+0000 7fdaedf40700 1 -- 172.21.15.134:0/3713703803 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae804bed0 con 0x7fdae80fcef0 2024-02-16T22:16:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.946+0000 7fdacffff700 1 -- 172.21.15.134:0/3713703803 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fdad8003020 con 0x7fdae80fcef0 2024-02-16T22:16:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.946+0000 7fdacffff700 1 --2- 172.21.15.134:0/3713703803 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fdad00692a0 0x7fdad006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.946+0000 7fdacffff700 1 -- 172.21.15.134:0/3713703803 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdad8087620 con 0x7fdae80fcef0 2024-02-16T22:16:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.946+0000 7fdae6ffd700 1 --2- 172.21.15.134:0/3713703803 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fdad00692a0 0x7fdad006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:50.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.946+0000 7fdae6ffd700 1 --2- 172.21.15.134:0/3713703803 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fdad00692a0 0x7fdad006b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdadc004560 tx=0x7fdadc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:50.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:50.950+0000 7fdacffff700 1 -- 172.21.15.134:0/3713703803 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fdad8057310 con 0x7fdae80fcef0 2024-02-16T22:16:51.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:51.204+0000 7fdaedf40700 1 -- 172.21.15.134:0/3713703803 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdae810f9a0 con 0x7fdae80fcef0 2024-02-16T22:16:51.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:50 smithi134 ceph-mon[28869]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-16T22:16:51.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:50 smithi134 ceph-mon[28869]: Cluster is now healthy 2024-02-16T22:16:51.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:50 smithi134 ceph-mon[28869]: mds.? [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] up:active 2024-02-16T22:16:51.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:50 smithi134 ceph-mon[28869]: fsmap cephfs:2 {0=cephfs.smithi134.jyajef=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:16:51.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:51.205+0000 7fdacffff700 1 -- 172.21.15.134:0/3713703803 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1822 (secure 0 0 0) 0x7fdad8016730 con 0x7fdae80fcef0 2024-02-16T22:16:51.207 INFO:teuthology.orchestra.run.smithi134.stdout:e16 2024-02-16T22:16:51.207 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:16:51.207 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:16:51.207 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-02-16T22:16:51.207 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:16:51.207 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-02-16T22:16:51.207 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-02-16T22:16:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 16 2024-02-16T22:16:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-16T22:16:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:16:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-02-16T22:16:50.465942+0000 2024-02-16T22:16:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-02-16T22:16:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-02-16T22:16:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-02-16T22:16:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-02-16T22:16:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-02-16T22:16:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-02-16T22:16:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-02-16T22:16:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-02-16T22:16:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:16:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 2 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:in 0,1 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14478,1=24269} 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.jyajef{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.qljqef{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-02-16T22:16:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:16:51.210 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.cygfxr{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2804816044,v1:172.21.15.134:6827/2804816044] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:16:51.210 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.phstvm{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:16:51.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:51.208+0000 7fdaedf40700 1 -- 172.21.15.134:0/3713703803 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fdad00692a0 msgr2=0x7fdad006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:51.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:51.208+0000 7fdaedf40700 1 --2- 172.21.15.134:0/3713703803 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fdad00692a0 0x7fdad006b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdadc004560 tx=0x7fdadc009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:51.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:51.208+0000 7fdaedf40700 1 -- 172.21.15.134:0/3713703803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae80fcef0 msgr2=0x7fdae810d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:51.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:51.208+0000 7fdaedf40700 1 --2- 172.21.15.134:0/3713703803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae80fcef0 0x7fdae810d960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdad800cb10 tx=0x7fdad800ced0 comp rx=0 tx=0).stop 2024-02-16T22:16:51.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:51.209+0000 7fdaedf40700 1 -- 172.21.15.134:0/3713703803 shutdown_connections 2024-02-16T22:16:51.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:51.209+0000 7fdaedf40700 1 --2- 172.21.15.134:0/3713703803 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fdad00692a0 0x7fdad006b750 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:51.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:51.209+0000 7fdaedf40700 1 --2- 172.21.15.134:0/3713703803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdae80fcef0 0x7fdae810d960 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:51.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:51.209+0000 7fdaedf40700 1 --2- 172.21.15.134:0/3713703803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdae80fe0e0 0x7fdae810dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:51.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:51.209+0000 7fdaedf40700 1 -- 172.21.15.134:0/3713703803 >> 172.21.15.134:0/3713703803 conn(0x7fdae80f8620 msgr2=0x7fdae81013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:51.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:51.209+0000 7fdaedf40700 1 -- 172.21.15.134:0/3713703803 shutdown_connections 2024-02-16T22:16:51.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:51.209+0000 7fdaedf40700 1 -- 172.21.15.134:0/3713703803 wait complete. 2024-02-16T22:16:51.211 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 16 2024-02-16T22:16:51.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:50 smithi173 ceph-mon[37280]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-16T22:16:51.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:50 smithi173 ceph-mon[37280]: Cluster is now healthy 2024-02-16T22:16:51.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:50 smithi173 ceph-mon[37280]: mds.? [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] up:active 2024-02-16T22:16:51.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:50 smithi173 ceph-mon[37280]: fsmap cephfs:2 {0=cephfs.smithi134.jyajef=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:16:51.856 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-02-16T22:16:52.454 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:52 smithi173 ceph-mon[37280]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-02-16T22:16:52.455 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:52.455 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:52.455 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:16:52.455 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:16:52.455 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:52.455 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:52 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/3713703803' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:16:52.455 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:52 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:16:52.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:52 smithi134 ceph-mon[28869]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-02-16T22:16:52.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:52.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:52.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:16:52.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:16:52.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:52.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:52 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/3713703803' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:16:52.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:52 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:16:52.779 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:54.538 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:54 smithi134 ceph-mon[28869]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 409 B/s wr, 3 op/s 2024-02-16T22:16:54.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:54.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:54 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:54 smithi173 ceph-mon[37280]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 409 B/s wr, 3 op/s 2024-02-16T22:16:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:54 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:16:55.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.631+0000 7ff760dda700 1 -- 172.21.15.134:0/3455560139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff75c0fcfb0 msgr2=0x7ff75c0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:55.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.631+0000 7ff760dda700 1 --2- 172.21.15.134:0/3455560139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff75c0fcfb0 0x7ff75c0fd420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff750004940 tx=0x7ff750009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:55.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.631+0000 7ff760dda700 1 -- 172.21.15.134:0/3455560139 shutdown_connections 2024-02-16T22:16:55.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.631+0000 7ff760dda700 1 --2- 172.21.15.134:0/3455560139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff75c0fcfb0 0x7ff75c0fd420 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.631+0000 7ff760dda700 1 --2- 172.21.15.134:0/3455560139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff75c0fbe40 0x7ff75c0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.631+0000 7ff760dda700 1 -- 172.21.15.134:0/3455560139 >> 172.21.15.134:0/3455560139 conn(0x7ff75c0f7520 msgr2=0x7ff75c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.631+0000 7ff760dda700 1 -- 172.21.15.134:0/3455560139 shutdown_connections 2024-02-16T22:16:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.631+0000 7ff760dda700 1 -- 172.21.15.134:0/3455560139 wait complete. 2024-02-16T22:16:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.631+0000 7ff760dda700 1 Processor -- start 2024-02-16T22:16:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.631+0000 7ff760dda700 1 -- start start 2024-02-16T22:16:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.631+0000 7ff760dda700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff75c0fbe40 0x7ff75c067d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.631+0000 7ff760dda700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff75c0fcfb0 0x7ff75c0682a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.631+0000 7ff760dda700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c0688f0 con 0x7ff75c0fcfb0 2024-02-16T22:16:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.631+0000 7ff760dda700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c069190 con 0x7ff75c0fbe40 2024-02-16T22:16:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.632+0000 7ff759d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff75c0fcfb0 0x7ff75c0682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.632+0000 7ff759d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff75c0fcfb0 0x7ff75c0682a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41562/0 (socket says 172.21.15.134:41562) 2024-02-16T22:16:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.632+0000 7ff759d9b700 1 -- 172.21.15.134:0/228066764 learned_addr learned my addr 172.21.15.134:0/228066764 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:55.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.632+0000 7ff75a59c700 1 --2- 172.21.15.134:0/228066764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff75c0fbe40 0x7ff75c067d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.632+0000 7ff759d9b700 1 -- 172.21.15.134:0/228066764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff75c0fbe40 msgr2=0x7ff75c067d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.632+0000 7ff759d9b700 1 --2- 172.21.15.134:0/228066764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff75c0fbe40 0x7ff75c067d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.632+0000 7ff759d9b700 1 -- 172.21.15.134:0/228066764 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff750005040 con 0x7ff75c0fcfb0 2024-02-16T22:16:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.632+0000 7ff759d9b700 1 --2- 172.21.15.134:0/228066764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff75c0fcfb0 0x7ff75c0682a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff7500093b0 tx=0x7ff750009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.632+0000 7ff74affd700 1 -- 172.21.15.134:0/228066764 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff75000e040 con 0x7ff75c0fcfb0 2024-02-16T22:16:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.632+0000 7ff760dda700 1 -- 172.21.15.134:0/228066764 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75c069410 con 0x7ff75c0fcfb0 2024-02-16T22:16:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.632+0000 7ff74affd700 1 -- 172.21.15.134:0/228066764 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff75000bcc0 con 0x7ff75c0fcfb0 2024-02-16T22:16:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.632+0000 7ff74affd700 1 -- 172.21.15.134:0/228066764 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff75001c630 con 0x7ff75c0fcfb0 2024-02-16T22:16:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.632+0000 7ff760dda700 1 -- 172.21.15.134:0/228066764 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75c069950 con 0x7ff75c0fcfb0 2024-02-16T22:16:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.633+0000 7ff760dda700 1 -- 172.21.15.134:0/228066764 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff75c04bed0 con 0x7ff75c0fcfb0 2024-02-16T22:16:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.634+0000 7ff74affd700 1 -- 172.21.15.134:0/228066764 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff750013980 con 0x7ff75c0fcfb0 2024-02-16T22:16:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.634+0000 7ff74affd700 1 --2- 172.21.15.134:0/228066764 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff7440692a0 0x7ff74406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.634+0000 7ff74affd700 1 -- 172.21.15.134:0/228066764 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff750088550 con 0x7ff75c0fcfb0 2024-02-16T22:16:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.634+0000 7ff75a59c700 1 --2- 172.21.15.134:0/228066764 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff7440692a0 0x7ff74406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.635+0000 7ff75a59c700 1 --2- 172.21.15.134:0/228066764 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff7440692a0 0x7ff74406b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff75c067af0 tx=0x7ff74c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:55.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.639+0000 7ff74affd700 1 -- 172.21.15.134:0/228066764 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff750054830 con 0x7ff75c0fcfb0 2024-02-16T22:16:55.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.873+0000 7ff760dda700 1 -- 172.21.15.134:0/228066764 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff75c104930 con 0x7ff75c0fcfb0 2024-02-16T22:16:55.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.874+0000 7ff74affd700 1 -- 172.21.15.134:0/228066764 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4712 (secure 0 0 0) 0x7ff750057e50 con 0x7ff75c0fcfb0 2024-02-16T22:16:55.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.876+0000 7ff760dda700 1 -- 172.21.15.134:0/228066764 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff7440692a0 msgr2=0x7ff74406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:55.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.876+0000 7ff760dda700 1 --2- 172.21.15.134:0/228066764 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff7440692a0 0x7ff74406b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff75c067af0 tx=0x7ff74c00b040 comp rx=0 tx=0).stop 2024-02-16T22:16:55.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.876+0000 7ff760dda700 1 -- 172.21.15.134:0/228066764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff75c0fcfb0 msgr2=0x7ff75c0682a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:55.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.876+0000 7ff760dda700 1 --2- 172.21.15.134:0/228066764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff75c0fcfb0 0x7ff75c0682a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff7500093b0 tx=0x7ff750009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:55.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.876+0000 7ff760dda700 1 -- 172.21.15.134:0/228066764 shutdown_connections 2024-02-16T22:16:55.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.876+0000 7ff760dda700 1 --2- 172.21.15.134:0/228066764 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff7440692a0 0x7ff74406b750 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:55.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.876+0000 7ff760dda700 1 --2- 172.21.15.134:0/228066764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff75c0fbe40 0x7ff75c067d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:55.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.876+0000 7ff760dda700 1 --2- 172.21.15.134:0/228066764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff75c0fcfb0 0x7ff75c0682a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:55.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.876+0000 7ff760dda700 1 -- 172.21.15.134:0/228066764 >> 172.21.15.134:0/228066764 conn(0x7ff75c0f7520 msgr2=0x7ff75c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:55.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.876+0000 7ff760dda700 1 -- 172.21.15.134:0/228066764 shutdown_connections 2024-02-16T22:16:55.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:55.877+0000 7ff760dda700 1 -- 172.21.15.134:0/228066764 wait complete. 2024-02-16T22:16:55.880 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 16 2024-02-16T22:16:55.890 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:16:56.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:56 smithi134 ceph-mon[28869]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-02-16T22:16:56.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:56 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/228066764' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-16T22:16:56.584 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-02-16T22:16:56.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:56 smithi173 ceph-mon[37280]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-02-16T22:16:56.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:56 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/228066764' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-16T22:16:56.986 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:16:58.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:58 smithi134 ceph-mon[28869]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-16T22:16:58.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:16:58 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:16:58.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:58 smithi173 ceph-mon[37280]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-16T22:16:58.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:16:58 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:16:59.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.202+0000 7f973bd17700 1 -- 172.21.15.134:0/753490750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340fbe80 msgr2=0x7f97340fc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:59.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.202+0000 7f973bd17700 1 --2- 172.21.15.134:0/753490750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340fbe80 0x7f97340fc290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9730004940 tx=0x7f9730009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.202+0000 7f973bd17700 1 -- 172.21.15.134:0/753490750 shutdown_connections 2024-02-16T22:16:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.202+0000 7f973bd17700 1 --2- 172.21.15.134:0/753490750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97340fd080 0x7f97340fd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.202+0000 7f973bd17700 1 --2- 172.21.15.134:0/753490750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340fbe80 0x7f97340fc290 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.202+0000 7f973bd17700 1 -- 172.21.15.134:0/753490750 >> 172.21.15.134:0/753490750 conn(0x7f97340f7590 msgr2=0x7f97340f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.202+0000 7f973bd17700 1 -- 172.21.15.134:0/753490750 shutdown_connections 2024-02-16T22:16:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.202+0000 7f973bd17700 1 -- 172.21.15.134:0/753490750 wait complete. 2024-02-16T22:16:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.203+0000 7f973bd17700 1 Processor -- start 2024-02-16T22:16:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.203+0000 7f973bd17700 1 -- start start 2024-02-16T22:16:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.203+0000 7f973bd17700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340fbe80 0x7f973410c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.203+0000 7f973bd17700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97340fd080 0x7f973410cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.203+0000 7f973bd17700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973410d470 con 0x7f97340fbe80 2024-02-16T22:16:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.203+0000 7f973bd17700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973410dcb0 con 0x7f97340fd080 2024-02-16T22:16:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.203+0000 7f9739ab3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340fbe80 0x7f973410c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.203+0000 7f9739ab3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340fbe80 0x7f973410c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41582/0 (socket says 172.21.15.134:41582) 2024-02-16T22:16:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.203+0000 7f9739ab3700 1 -- 172.21.15.134:0/743572059 learned_addr learned my addr 172.21.15.134:0/743572059 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:16:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.203+0000 7f97392b2700 1 --2- 172.21.15.134:0/743572059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97340fd080 0x7f973410cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.203+0000 7f9739ab3700 1 -- 172.21.15.134:0/743572059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97340fd080 msgr2=0x7f973410cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.203+0000 7f9739ab3700 1 --2- 172.21.15.134:0/743572059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97340fd080 0x7f973410cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.203+0000 7f9739ab3700 1 -- 172.21.15.134:0/743572059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9730005040 con 0x7f97340fbe80 2024-02-16T22:16:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.204+0000 7f9739ab3700 1 --2- 172.21.15.134:0/743572059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340fbe80 0x7f973410c8a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f973000b3b0 tx=0x7f9730009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.204+0000 7f972a7fc700 1 -- 172.21.15.134:0/743572059 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f973000e040 con 0x7f97340fbe80 2024-02-16T22:16:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.204+0000 7f972a7fc700 1 -- 172.21.15.134:0/743572059 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f973000bcc0 con 0x7f97340fbe80 2024-02-16T22:16:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.204+0000 7f973bd17700 1 -- 172.21.15.134:0/743572059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973410df30 con 0x7f97340fbe80 2024-02-16T22:16:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.204+0000 7f972a7fc700 1 -- 172.21.15.134:0/743572059 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f973001c630 con 0x7f97340fbe80 2024-02-16T22:16:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.204+0000 7f973bd17700 1 -- 172.21.15.134:0/743572059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973410e470 con 0x7f97340fbe80 2024-02-16T22:16:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.205+0000 7f973bd17700 1 -- 172.21.15.134:0/743572059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973404bed0 con 0x7f97340fbe80 2024-02-16T22:16:59.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.205+0000 7f972a7fc700 1 -- 172.21.15.134:0/743572059 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f9730013980 con 0x7f97340fbe80 2024-02-16T22:16:59.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.206+0000 7f972a7fc700 1 --2- 172.21.15.134:0/743572059 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f97200692a0 0x7f972006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:16:59.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.206+0000 7f972a7fc700 1 -- 172.21.15.134:0/743572059 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f97300886b0 con 0x7f97340fbe80 2024-02-16T22:16:59.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.206+0000 7f97392b2700 1 --2- 172.21.15.134:0/743572059 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f97200692a0 0x7f972006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:16:59.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.206+0000 7f97392b2700 1 --2- 172.21.15.134:0/743572059 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f97200692a0 0x7f972006b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9724009bf0 tx=0x7f97240091a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:16:59.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.210+0000 7f972a7fc700 1 -- 172.21.15.134:0/743572059 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f97300584d0 con 0x7f97340fbe80 2024-02-16T22:16:59.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.482+0000 7f973bd17700 1 -- 172.21.15.134:0/743572059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f9734104990 con 0x7f97340fbe80 2024-02-16T22:16:59.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.483+0000 7f972a7fc700 1 -- 172.21.15.134:0/743572059 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) v1 ==== 78+0+99 (secure 0 0 0) 0x7f9730058060 con 0x7f97340fbe80 2024-02-16T22:16:59.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.484+0000 7f973bd17700 1 -- 172.21.15.134:0/743572059 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f97200692a0 msgr2=0x7f972006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.484+0000 7f973bd17700 1 --2- 172.21.15.134:0/743572059 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f97200692a0 0x7f972006b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9724009bf0 tx=0x7f97240091a0 comp rx=0 tx=0).stop 2024-02-16T22:16:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.485+0000 7f973bd17700 1 -- 172.21.15.134:0/743572059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340fbe80 msgr2=0x7f973410c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:16:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.485+0000 7f973bd17700 1 --2- 172.21.15.134:0/743572059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340fbe80 0x7f973410c8a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f973000b3b0 tx=0x7f9730009e30 comp rx=0 tx=0).stop 2024-02-16T22:16:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.485+0000 7f973bd17700 1 -- 172.21.15.134:0/743572059 shutdown_connections 2024-02-16T22:16:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.485+0000 7f973bd17700 1 --2- 172.21.15.134:0/743572059 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f97200692a0 0x7f972006b750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.485+0000 7f973bd17700 1 --2- 172.21.15.134:0/743572059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340fbe80 0x7f973410c8a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.485+0000 7f973bd17700 1 --2- 172.21.15.134:0/743572059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97340fd080 0x7f973410cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:16:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.485+0000 7f973bd17700 1 -- 172.21.15.134:0/743572059 >> 172.21.15.134:0/743572059 conn(0x7f97340f7590 msgr2=0x7f97341002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:16:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.485+0000 7f973bd17700 1 -- 172.21.15.134:0/743572059 shutdown_connections 2024-02-16T22:16:59.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:16:59.485+0000 7f973bd17700 1 -- 172.21.15.134:0/743572059 wait complete. 2024-02-16T22:16:59.497 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:17:00.102 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-02-16T22:17:00.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T22:17:00.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.221+0000 7f1eff8ae640 1 -- 172.21.15.134:0/1844850019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ef8066350 msgr2=0x7f1ef80fef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:00.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.221+0000 7f1eff8ae640 1 --2- 172.21.15.134:0/1844850019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ef8066350 0x7f1ef80fef00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80048d0 tx=0x7f1ee8009da0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.221+0000 7f1eff8ae640 1 -- 172.21.15.134:0/1844850019 shutdown_connections 2024-02-16T22:17:00.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.221+0000 7f1eff8ae640 1 --2- 172.21.15.134:0/1844850019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ef80ff440 0x7f1ef8101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.221+0000 7f1eff8ae640 1 --2- 172.21.15.134:0/1844850019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ef8066350 0x7f1ef80fef00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.221+0000 7f1eff8ae640 1 -- 172.21.15.134:0/1844850019 >> 172.21.15.134:0/1844850019 conn(0x7f1ef80f6910 msgr2=0x7f1ef80f8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:00.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.221+0000 7f1eff8ae640 1 -- 172.21.15.134:0/1844850019 shutdown_connections 2024-02-16T22:17:00.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.221+0000 7f1eff8ae640 1 -- 172.21.15.134:0/1844850019 wait complete. 2024-02-16T22:17:00.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1eff8ae640 1 Processor -- start 2024-02-16T22:17:00.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1eff8ae640 1 -- start start 2024-02-16T22:17:00.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1eff8ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ef8066350 0x7f1ef810cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:00.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1eff8ae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ef80ff440 0x7f1ef810d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1eff8ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef810d730 con 0x7f1ef8066350 2024-02-16T22:17:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1eff8ae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8112180 con 0x7f1ef80ff440 2024-02-16T22:17:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1efd64a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ef8066350 0x7f1ef810cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1efd64a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ef8066350 0x7f1ef810cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41596/0 (socket says 172.21.15.134:41596) 2024-02-16T22:17:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1efd64a640 1 -- 172.21.15.134:0/433745076 learned_addr learned my addr 172.21.15.134:0/433745076 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:17:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1efd64a640 1 -- 172.21.15.134:0/433745076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ef80ff440 msgr2=0x7f1ef810d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1efd64a640 1 --2- 172.21.15.134:0/433745076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ef80ff440 0x7f1ef810d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1efd64a640 1 -- 172.21.15.134:0/433745076 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee8005040 con 0x7f1ef8066350 2024-02-16T22:17:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1efd64a640 1 --2- 172.21.15.134:0/433745076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ef8066350 0x7f1ef810cba0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8034040 tx=0x7f1ee8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1eedffb640 1 -- 172.21.15.134:0/433745076 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ee80094c0 con 0x7f1ef8066350 2024-02-16T22:17:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1eedffb640 1 -- 172.21.15.134:0/433745076 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ee8009620 con 0x7f1ef8066350 2024-02-16T22:17:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1eff8ae640 1 -- 172.21.15.134:0/433745076 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef81122c0 con 0x7f1ef8066350 2024-02-16T22:17:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.222+0000 7f1eedffb640 1 -- 172.21.15.134:0/433745076 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ee803b640 con 0x7f1ef8066350 2024-02-16T22:17:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.223+0000 7f1eff8ae640 1 -- 172.21.15.134:0/433745076 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef81127b0 con 0x7f1ef8066350 2024-02-16T22:17:00.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.224+0000 7f1eff8ae640 1 -- 172.21.15.134:0/433745076 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef8104e10 con 0x7f1ef8066350 2024-02-16T22:17:00.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.224+0000 7f1eedffb640 1 -- 172.21.15.134:0/433745076 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f1ee802f070 con 0x7f1ef8066350 2024-02-16T22:17:00.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.224+0000 7f1eedffb640 1 --2- 172.21.15.134:0/433745076 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f1ee4069210 0x7f1ee406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:00.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.224+0000 7f1eedffb640 1 -- 172.21.15.134:0/433745076 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1ee80a9800 con 0x7f1ef8066350 2024-02-16T22:17:00.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.224+0000 7f1efce49640 1 --2- 172.21.15.134:0/433745076 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f1ee4069210 0x7f1ee406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:00.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.225+0000 7f1efce49640 1 --2- 172.21.15.134:0/433745076 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f1ee4069210 0x7f1ee406b6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1ef810e0f0 tx=0x7f1ef4009c50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:00.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.229+0000 7f1eedffb640 1 -- 172.21.15.134:0/433745076 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1ee8075a60 con 0x7f1ef8066350 2024-02-16T22:17:00.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.394+0000 7f1eff8ae640 1 -- 172.21.15.134:0/433745076 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ef8112a30 con 0x7f1ef8066350 2024-02-16T22:17:00.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.395+0000 7f1eedffb640 1 -- 172.21.15.134:0/433745076 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14435 (secure 0 0 0) 0x7f1ee8079080 con 0x7f1ef8066350 2024-02-16T22:17:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:17:00.397 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":46,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","created":"2024-02-16T22:09:26.274039+0000","modified":"2024-02-16T22:16:46.449548+0000","last_up_change":"2024-02-16T22:15:15.443236+0000","last_in_change":"2024-02-16T22:14:56.818141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T22:14:01.182574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-16T22:16:30.037904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-16T22:16:30.699564+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d8e715f3-43f6-439a-be3d-a3bbd70b412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6803","nonce":200373494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6805","nonce":200373494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6809","nonce":200373494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":200373494},{"type":"v1","addr":"172.21.15.134:6807","nonce":200373494}]},"public_addr":"172.21.15.134:6803/200373494","cluster_addr":"172.21.15.134:6805/200373494","heartbeat_back_addr":"172.21.15.134:6809/200373494","heartbeat_front_addr":"172.21.15.134:6807/200373494","state":["exists","up"]},{"osd":1,"uuid":"c1fe573e-cb80-4ac7-9d3c-b7e296e86a81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6811","nonce":3091662869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6813","nonce":3091662869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6817","nonce":3091662869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3091662869},{"type":"v1","addr":"172.21.15.134:6815","nonce":3091662869}]},"public_addr":"172.21.15.134:6811/3091662869","cluster_addr":"172.21.15.134:6813/3091662869","heartbeat_back_addr":"172.21.15.134:6817/3091662869","heartbeat_front_addr":"172.21.15.134:6815/3091662869","state":["exists","up"]},{"osd":2,"uuid":"036c6cf2-7373-46ff-85db-9e0898ad0677","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6819","nonce":203470515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6821","nonce":203470515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6825","nonce":203470515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":203470515},{"type":"v1","addr":"172.21.15.134:6823","nonce":203470515}]},"public_addr":"172.21.15.134:6819/203470515","cluster_addr":"172.21.15.134:6821/203470515","heartbeat_back_addr":"172.21.15.134:6825/203470515","heartbeat_front_addr":"172.21.15.134:6823/203470515","state":["exists","up"]},{"osd":3,"uuid":"6a00fd47-f787-4e21-9619-9e9341420b4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6801","nonce":1747350493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6803","nonce":1747350493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6807","nonce":1747350493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1747350493},{"type":"v1","addr":"172.21.15.173:6805","nonce":1747350493}]},"public_addr":"172.21.15.173:6801/1747350493","cluster_addr":"172.21.15.173:6803/1747350493","heartbeat_back_addr":"172.21.15.173:6807/1747350493","heartbeat_front_addr":"172.21.15.173:6805/1747350493","state":["exists","up"]},{"osd":4,"uuid":"5a314e0e-0951-4462-bb9a-f3614ded4c18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6809","nonce":1479174093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6811","nonce":1479174093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6815","nonce":1479174093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1479174093},{"type":"v1","addr":"172.21.15.173:6813","nonce":1479174093}]},"public_addr":"172.21.15.173:6809/1479174093","cluster_addr":"172.21.15.173:6811/1479174093","heartbeat_back_addr":"172.21.15.173:6815/1479174093","heartbeat_front_addr":"172.21.15.173:6813/1479174093","state":["exists","up"]},{"osd":5,"uuid":"9d9ce9a3-e735-4265-890c-af2aada1122d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6817","nonce":2727105831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6819","nonce":2727105831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6823","nonce":2727105831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":2727105831},{"type":"v1","addr":"172.21.15.173:6821","nonce":2727105831}]},"public_addr":"172.21.15.173:6817/2727105831","cluster_addr":"172.21.15.173:6819/2727105831","heartbeat_back_addr":"172.21.15.173:6823/2727105831","heartbeat_front_addr":"172.21.15.173:6821/2727105831","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:01.314144+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:30.212232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:58.392610+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:14:22.854647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:14:48.600782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:15:13.932090+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6827/49557312":"2024-02-17T22:16:46.449488+0000","172.21.15.134:0/3099284737":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/2419255497":"2024-02-17T22:09:59.839885+0000","172.21.15.134:6801/3520115315":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/3313361224":"2024-02-17T22:09:59.839885+0000","172.21.15.134:6800/3520115315":"2024-02-17T22:10:30.766785+0000","172.21.15.134:6800/2987045407":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6826/49557312":"2024-02-17T22:16:46.449488+0000","172.21.15.134:0/920183098":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/3172564602":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6800/3459537666":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/3516783507":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/1667200782":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6801/3459537666":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/994312604":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/3010290966":"2024-02-17T22:10:30.766785+0000","172.21.15.134:6801/2987045407":"2024-02-17T22:11:42.853761+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T22:17:00.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.397+0000 7f1eff8ae640 1 -- 172.21.15.134:0/433745076 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f1ee4069210 msgr2=0x7f1ee406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:00.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.397+0000 7f1eff8ae640 1 --2- 172.21.15.134:0/433745076 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f1ee4069210 0x7f1ee406b6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1ef810e0f0 tx=0x7f1ef4009c50 comp rx=0 tx=0).stop 2024-02-16T22:17:00.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.397+0000 7f1eff8ae640 1 -- 172.21.15.134:0/433745076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ef8066350 msgr2=0x7f1ef810cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:00.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.397+0000 7f1eff8ae640 1 --2- 172.21.15.134:0/433745076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ef8066350 0x7f1ef810cba0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8034040 tx=0x7f1ee8009da0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.397+0000 7f1eff8ae640 1 -- 172.21.15.134:0/433745076 shutdown_connections 2024-02-16T22:17:00.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.397+0000 7f1eff8ae640 1 --2- 172.21.15.134:0/433745076 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f1ee4069210 0x7f1ee406b6c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.397+0000 7f1eff8ae640 1 --2- 172.21.15.134:0/433745076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ef80ff440 0x7f1ef810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.397+0000 7f1eff8ae640 1 --2- 172.21.15.134:0/433745076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ef8066350 0x7f1ef810cba0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.397+0000 7f1eff8ae640 1 -- 172.21.15.134:0/433745076 >> 172.21.15.134:0/433745076 conn(0x7f1ef80f6910 msgr2=0x7f1ef80f8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:00.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.397+0000 7f1eff8ae640 1 -- 172.21.15.134:0/433745076 shutdown_connections 2024-02-16T22:17:00.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.397+0000 7f1eff8ae640 1 -- 172.21.15.134:0/433745076 wait complete. 2024-02-16T22:17:00.410 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-16T22:14:01.182574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-16T22:16:30.037904+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-16T22:16:30.699564+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-16T22:17:00.410 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-16T22:17:00.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.508+0000 7f257c31d640 1 -- 172.21.15.134:0/4040542698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25740fce40 msgr2=0x7f25740ff220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:00.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.508+0000 7f257c31d640 1 --2- 172.21.15.134:0/4040542698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25740fce40 0x7f25740ff220 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f25700048d0 tx=0x7f2570009da0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.508+0000 7f257c31d640 1 -- 172.21.15.134:0/4040542698 shutdown_connections 2024-02-16T22:17:00.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.508+0000 7f257c31d640 1 --2- 172.21.15.134:0/4040542698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25740ff760 0x7f2574101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.508+0000 7f257c31d640 1 --2- 172.21.15.134:0/4040542698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25740fce40 0x7f25740ff220 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.508+0000 7f257c31d640 1 -- 172.21.15.134:0/4040542698 >> 172.21.15.134:0/4040542698 conn(0x7f25740f6900 msgr2=0x7f25740f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:00.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.508+0000 7f257c31d640 1 -- 172.21.15.134:0/4040542698 shutdown_connections 2024-02-16T22:17:00.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.508+0000 7f257c31d640 1 -- 172.21.15.134:0/4040542698 wait complete. 2024-02-16T22:17:00.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.509+0000 7f257c31d640 1 Processor -- start 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.509+0000 7f257c31d640 1 -- start start 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.509+0000 7f257c31d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25740fce40 0x7f257410cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.509+0000 7f257c31d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25740ff760 0x7f257410d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.509+0000 7f257c31d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257410d720 con 0x7f25740fce40 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.509+0000 7f257c31d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2574112170 con 0x7f25740ff760 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.509+0000 7f257a0b9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25740fce40 0x7f257410cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.509+0000 7f257a0b9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25740fce40 0x7f257410cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41612/0 (socket says 172.21.15.134:41612) 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.509+0000 7f257a0b9640 1 -- 172.21.15.134:0/258205412 learned_addr learned my addr 172.21.15.134:0/258205412 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.509+0000 7f257a0b9640 1 -- 172.21.15.134:0/258205412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25740ff760 msgr2=0x7f257410d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.509+0000 7f257a0b9640 1 --2- 172.21.15.134:0/258205412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25740ff760 0x7f257410d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.509+0000 7f257a0b9640 1 -- 172.21.15.134:0/258205412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570005040 con 0x7f25740fce40 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.509+0000 7f257a0b9640 1 --2- 172.21.15.134:0/258205412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25740fce40 0x7f257410cb90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2570007d20 tx=0x7f2570009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.510+0000 7f256affd640 1 -- 172.21.15.134:0/258205412 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2570009590 con 0x7f25740fce40 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.510+0000 7f256affd640 1 -- 172.21.15.134:0/258205412 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25700096f0 con 0x7f25740fce40 2024-02-16T22:17:00.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.510+0000 7f257c31d640 1 -- 172.21.15.134:0/258205412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25741122b0 con 0x7f25740fce40 2024-02-16T22:17:00.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.510+0000 7f256affd640 1 -- 172.21.15.134:0/258205412 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f257003b6d0 con 0x7f25740fce40 2024-02-16T22:17:00.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.510+0000 7f257c31d640 1 -- 172.21.15.134:0/258205412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25741127a0 con 0x7f25740fce40 2024-02-16T22:17:00.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.511+0000 7f257c31d640 1 -- 172.21.15.134:0/258205412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2574106e10 con 0x7f25740fce40 2024-02-16T22:17:00.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.511+0000 7f256affd640 1 -- 172.21.15.134:0/258205412 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f257002f070 con 0x7f25740fce40 2024-02-16T22:17:00.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.512+0000 7f256affd640 1 --2- 172.21.15.134:0/258205412 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2560069210 0x7f256006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:00.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.512+0000 7f25798b8640 1 --2- 172.21.15.134:0/258205412 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2560069210 0x7f256006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:00.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.512+0000 7f256affd640 1 -- 172.21.15.134:0/258205412 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f25700a98b0 con 0x7f25740fce40 2024-02-16T22:17:00.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.512+0000 7f25798b8640 1 --2- 172.21.15.134:0/258205412 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2560069210 0x7f256006b6c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f257410e0e0 tx=0x7f2564007cb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.516+0000 7f256affd640 1 -- 172.21.15.134:0/258205412 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f2570075b90 con 0x7f25740fce40 2024-02-16T22:17:00.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.679+0000 7f257c31d640 1 -- 172.21.15.134:0/258205412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f257402a8e0 con 0x7f25740fce40 2024-02-16T22:17:00.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.680+0000 7f256affd640 1 -- 172.21.15.134:0/258205412 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25700791b0 con 0x7f25740fce40 2024-02-16T22:17:00.682 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-02-16T22:17:00.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.682+0000 7f257c31d640 1 -- 172.21.15.134:0/258205412 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2560069210 msgr2=0x7f256006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:00.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.682+0000 7f257c31d640 1 --2- 172.21.15.134:0/258205412 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2560069210 0x7f256006b6c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f257410e0e0 tx=0x7f2564007cb0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.682+0000 7f257c31d640 1 -- 172.21.15.134:0/258205412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25740fce40 msgr2=0x7f257410cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:00.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.682+0000 7f257c31d640 1 --2- 172.21.15.134:0/258205412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25740fce40 0x7f257410cb90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2570007d20 tx=0x7f2570009da0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.682+0000 7f257c31d640 1 -- 172.21.15.134:0/258205412 shutdown_connections 2024-02-16T22:17:00.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.682+0000 7f257c31d640 1 --2- 172.21.15.134:0/258205412 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2560069210 0x7f256006b6c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.682+0000 7f257c31d640 1 --2- 172.21.15.134:0/258205412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25740ff760 0x7f257410d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.682+0000 7f257c31d640 1 --2- 172.21.15.134:0/258205412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25740fce40 0x7f257410cb90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.682+0000 7f257c31d640 1 -- 172.21.15.134:0/258205412 >> 172.21.15.134:0/258205412 conn(0x7f25740f6900 msgr2=0x7f25740f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:00.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.682+0000 7f257c31d640 1 -- 172.21.15.134:0/258205412 shutdown_connections 2024-02-16T22:17:00.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.682+0000 7f257c31d640 1 -- 172.21.15.134:0/258205412 wait complete. 2024-02-16T22:17:00.693 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:00 smithi134 ceph-mon[28869]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-16T22:17:00.693 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:00 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:17:00.693 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:00 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:17:00.694 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:00 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:17:00.694 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:00 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:17:00.694 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:00 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:17:00.694 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:00 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/743572059' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-16T22:17:00.694 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-16T22:17:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:00 smithi173 ceph-mon[37280]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-16T22:17:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:00 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:17:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:00 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:17:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:00 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:17:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:00 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:17:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:00 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:17:00.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:00 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/743572059' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-16T22:17:00.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f700b55d640 1 -- 172.21.15.134:0/387938161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70040fb1d0 msgr2=0x7f70040fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:00.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f700b55d640 1 --2- 172.21.15.134:0/387938161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70040fb1d0 0x7f70040fb5e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f70000048d0 tx=0x7f7000009da0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f700b55d640 1 -- 172.21.15.134:0/387938161 shutdown_connections 2024-02-16T22:17:00.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f700b55d640 1 --2- 172.21.15.134:0/387938161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040fc400 0x7f70040fc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f700b55d640 1 --2- 172.21.15.134:0/387938161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70040fb1d0 0x7f70040fb5e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f700b55d640 1 -- 172.21.15.134:0/387938161 >> 172.21.15.134:0/387938161 conn(0x7f70040f68d0 msgr2=0x7f70040f8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f700b55d640 1 -- 172.21.15.134:0/387938161 shutdown_connections 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f700b55d640 1 -- 172.21.15.134:0/387938161 wait complete. 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f700b55d640 1 Processor -- start 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f700b55d640 1 -- start start 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f700b55d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70040fb1d0 0x7f70040ff070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f700b55d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040fc400 0x7f70040fd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f700b55d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70040ff6c0 con 0x7f70040fb1d0 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f700b55d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70040fdc80 con 0x7f70040fc400 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f70092f9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70040fb1d0 0x7f70040ff070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f70092f9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70040fb1d0 0x7f70040ff070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41630/0 (socket says 172.21.15.134:41630) 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.793+0000 7f70092f9640 1 -- 172.21.15.134:0/2912260704 learned_addr learned my addr 172.21.15.134:0/2912260704 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.794+0000 7f7008af8640 1 --2- 172.21.15.134:0/2912260704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040fc400 0x7f70040fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.794+0000 7f70092f9640 1 -- 172.21.15.134:0/2912260704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040fc400 msgr2=0x7f70040fd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:00.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.794+0000 7f70092f9640 1 --2- 172.21.15.134:0/2912260704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040fc400 0x7f70040fd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.794+0000 7f70092f9640 1 -- 172.21.15.134:0/2912260704 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7000005040 con 0x7f70040fb1d0 2024-02-16T22:17:00.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.794+0000 7f7008af8640 1 --2- 172.21.15.134:0/2912260704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040fc400 0x7f70040fd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:17:00.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.794+0000 7f70092f9640 1 --2- 172.21.15.134:0/2912260704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70040fb1d0 0x7f70040ff070 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7000034040 tx=0x7f7000009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:00.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.794+0000 7f6ff9ffb640 1 -- 172.21.15.134:0/2912260704 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70000094c0 con 0x7f70040fb1d0 2024-02-16T22:17:00.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.794+0000 7f6ff9ffb640 1 -- 172.21.15.134:0/2912260704 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7000009620 con 0x7f70040fb1d0 2024-02-16T22:17:00.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.794+0000 7f700b55d640 1 -- 172.21.15.134:0/2912260704 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70040fdf00 con 0x7f70040fb1d0 2024-02-16T22:17:00.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.794+0000 7f6ff9ffb640 1 -- 172.21.15.134:0/2912260704 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f700003b640 con 0x7f70040fb1d0 2024-02-16T22:17:00.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.794+0000 7f700b55d640 1 -- 172.21.15.134:0/2912260704 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70040fe420 con 0x7f70040fb1d0 2024-02-16T22:17:00.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.795+0000 7f700b55d640 1 -- 172.21.15.134:0/2912260704 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7004103d20 con 0x7f70040fb1d0 2024-02-16T22:17:00.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.796+0000 7f6ff9ffb640 1 -- 172.21.15.134:0/2912260704 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f700002f070 con 0x7f70040fb1d0 2024-02-16T22:17:00.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.796+0000 7f6ff9ffb640 1 --2- 172.21.15.134:0/2912260704 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6ff0069210 0x7f6ff006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:00.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.796+0000 7f7008af8640 1 --2- 172.21.15.134:0/2912260704 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6ff0069210 0x7f6ff006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:00.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.796+0000 7f6ff9ffb640 1 -- 172.21.15.134:0/2912260704 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f70000a97d0 con 0x7f70040fb1d0 2024-02-16T22:17:00.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.796+0000 7f7008af8640 1 --2- 172.21.15.134:0/2912260704 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6ff0069210 0x7f6ff006b6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70040fee20 tx=0x7f6ff4009ed0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:00.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.800+0000 7f6ff9ffb640 1 -- 172.21.15.134:0/2912260704 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f7000075a30 con 0x7f70040fb1d0 2024-02-16T22:17:00.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.963+0000 7f700b55d640 1 -- 172.21.15.134:0/2912260704 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f7004114d10 con 0x7f70040fb1d0 2024-02-16T22:17:00.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.963+0000 7f6ff9ffb640 1 -- 172.21.15.134:0/2912260704 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f7000079050 con 0x7f70040fb1d0 2024-02-16T22:17:00.965 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-16T22:17:00.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.965+0000 7f700b55d640 1 -- 172.21.15.134:0/2912260704 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6ff0069210 msgr2=0x7f6ff006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:00.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.965+0000 7f700b55d640 1 --2- 172.21.15.134:0/2912260704 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6ff0069210 0x7f6ff006b6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70040fee20 tx=0x7f6ff4009ed0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.965+0000 7f700b55d640 1 -- 172.21.15.134:0/2912260704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70040fb1d0 msgr2=0x7f70040ff070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:00.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.965+0000 7f700b55d640 1 --2- 172.21.15.134:0/2912260704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70040fb1d0 0x7f70040ff070 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7000034040 tx=0x7f7000009da0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.965+0000 7f700b55d640 1 -- 172.21.15.134:0/2912260704 shutdown_connections 2024-02-16T22:17:00.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.965+0000 7f700b55d640 1 --2- 172.21.15.134:0/2912260704 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6ff0069210 0x7f6ff006b6c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.965+0000 7f700b55d640 1 --2- 172.21.15.134:0/2912260704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040fc400 0x7f70040fd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.965+0000 7f700b55d640 1 --2- 172.21.15.134:0/2912260704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70040fb1d0 0x7f70040ff070 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:00.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.965+0000 7f700b55d640 1 -- 172.21.15.134:0/2912260704 >> 172.21.15.134:0/2912260704 conn(0x7f70040f68d0 msgr2=0x7f7004064480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:00.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.965+0000 7f700b55d640 1 -- 172.21.15.134:0/2912260704 shutdown_connections 2024-02-16T22:17:00.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:00.965+0000 7f700b55d640 1 -- 172.21.15.134:0/2912260704 wait complete. 2024-02-16T22:17:00.977 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-16T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.076+0000 7fe9e319d640 1 -- 172.21.15.134:0/3214743659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9dc0fd550 msgr2=0x7fe9dc0fd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.076+0000 7fe9e319d640 1 --2- 172.21.15.134:0/3214743659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9dc0fd550 0x7fe9dc0fd9c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80048d0 tx=0x7fe9c8009da0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.076+0000 7fe9e319d640 1 -- 172.21.15.134:0/3214743659 shutdown_connections 2024-02-16T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.076+0000 7fe9e319d640 1 --2- 172.21.15.134:0/3214743659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9dc0fd550 0x7fe9dc0fd9c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.076+0000 7fe9e319d640 1 --2- 172.21.15.134:0/3214743659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9dc0fc280 0x7fe9dc0fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.076+0000 7fe9e319d640 1 -- 172.21.15.134:0/3214743659 >> 172.21.15.134:0/3214743659 conn(0x7fe9dc0f7a60 msgr2=0x7fe9dc0f9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.076+0000 7fe9e319d640 1 -- 172.21.15.134:0/3214743659 shutdown_connections 2024-02-16T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.076+0000 7fe9e319d640 1 -- 172.21.15.134:0/3214743659 wait complete. 2024-02-16T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.076+0000 7fe9e319d640 1 Processor -- start 2024-02-16T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9e319d640 1 -- start start 2024-02-16T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9e319d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9dc0fc280 0x7fe9dc10cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9e319d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9dc0fd550 0x7fe9dc10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9e319d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc10d6e0 con 0x7fe9dc0fc280 2024-02-16T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9e319d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc112130 con 0x7fe9dc0fd550 2024-02-16T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9e0f39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9dc0fc280 0x7fe9dc10cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9e0f39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9dc0fc280 0x7fe9dc10cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41638/0 (socket says 172.21.15.134:41638) 2024-02-16T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9e0f39640 1 -- 172.21.15.134:0/4078189988 learned_addr learned my addr 172.21.15.134:0/4078189988 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9dbfff640 1 --2- 172.21.15.134:0/4078189988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9dc0fd550 0x7fe9dc10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9e0f39640 1 -- 172.21.15.134:0/4078189988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9dc0fd550 msgr2=0x7fe9dc10d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9e0f39640 1 --2- 172.21.15.134:0/4078189988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9dc0fd550 0x7fe9dc10d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9e0f39640 1 -- 172.21.15.134:0/4078189988 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c8005040 con 0x7fe9dc0fc280 2024-02-16T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9e0f39640 1 --2- 172.21.15.134:0/4078189988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9dc0fc280 0x7fe9dc10cb50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0002a50 tx=0x7fe9d0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9d97fa640 1 -- 172.21.15.134:0/4078189988 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d0007c30 con 0x7fe9dc0fc280 2024-02-16T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.077+0000 7fe9d97fa640 1 -- 172.21.15.134:0/4078189988 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9d000f040 con 0x7fe9dc0fc280 2024-02-16T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.078+0000 7fe9e319d640 1 -- 172.21.15.134:0/4078189988 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc1122d0 con 0x7fe9dc0fc280 2024-02-16T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.078+0000 7fe9d97fa640 1 -- 172.21.15.134:0/4078189988 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d000db50 con 0x7fe9dc0fc280 2024-02-16T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.078+0000 7fe9e319d640 1 -- 172.21.15.134:0/4078189988 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc1127c0 con 0x7fe9dc0fc280 2024-02-16T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.078+0000 7fe9e319d640 1 -- 172.21.15.134:0/4078189988 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc104df0 con 0x7fe9dc0fc280 2024-02-16T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.079+0000 7fe9d97fa640 1 -- 172.21.15.134:0/4078189988 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe9d001c400 con 0x7fe9dc0fc280 2024-02-16T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.079+0000 7fe9d97fa640 1 --2- 172.21.15.134:0/4078189988 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe9cc069210 0x7fe9cc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.079+0000 7fe9d97fa640 1 -- 172.21.15.134:0/4078189988 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe9d0086a20 con 0x7fe9dc0fc280 2024-02-16T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.079+0000 7fe9dbfff640 1 --2- 172.21.15.134:0/4078189988 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe9cc069210 0x7fe9cc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.080+0000 7fe9dbfff640 1 --2- 172.21.15.134:0/4078189988 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe9cc069210 0x7fe9cc06b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc10e0a0 tx=0x7fe9c8009da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.084+0000 7fe9d97fa640 1 -- 172.21.15.134:0/4078189988 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe9d004cbd0 con 0x7fe9dc0fc280 2024-02-16T22:17:01.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.283+0000 7fe9e319d640 1 -- 172.21.15.134:0/4078189988 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fe9dc1129e0 con 0x7fe9dc0fc280 2024-02-16T22:17:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.283+0000 7fe9d97fa640 1 -- 172.21.15.134:0/4078189988 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe9d0052d30 con 0x7fe9dc0fc280 2024-02-16T22:17:01.285 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-16T22:17:01.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.285+0000 7fe9e319d640 1 -- 172.21.15.134:0/4078189988 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe9cc069210 msgr2=0x7fe9cc06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:01.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.285+0000 7fe9e319d640 1 --2- 172.21.15.134:0/4078189988 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe9cc069210 0x7fe9cc06b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc10e0a0 tx=0x7fe9c8009da0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.285+0000 7fe9e319d640 1 -- 172.21.15.134:0/4078189988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9dc0fc280 msgr2=0x7fe9dc10cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:01.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.285+0000 7fe9e319d640 1 --2- 172.21.15.134:0/4078189988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9dc0fc280 0x7fe9dc10cb50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0002a50 tx=0x7fe9d0004600 comp rx=0 tx=0).stop 2024-02-16T22:17:01.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.286+0000 7fe9e319d640 1 -- 172.21.15.134:0/4078189988 shutdown_connections 2024-02-16T22:17:01.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.286+0000 7fe9e319d640 1 --2- 172.21.15.134:0/4078189988 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe9cc069210 0x7fe9cc06b6c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.286+0000 7fe9e319d640 1 --2- 172.21.15.134:0/4078189988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9dc0fd550 0x7fe9dc10d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.286+0000 7fe9e319d640 1 --2- 172.21.15.134:0/4078189988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9dc0fc280 0x7fe9dc10cb50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.286+0000 7fe9e319d640 1 -- 172.21.15.134:0/4078189988 >> 172.21.15.134:0/4078189988 conn(0x7fe9dc0f7a60 msgr2=0x7fe9dc100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:01.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.286+0000 7fe9e319d640 1 -- 172.21.15.134:0/4078189988 shutdown_connections 2024-02-16T22:17:01.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.286+0000 7fe9e319d640 1 -- 172.21.15.134:0/4078189988 wait complete. 2024-02-16T22:17:01.298 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-16T22:17:01.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.395+0000 7fae03e65640 1 -- 172.21.15.134:0/61699093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0fc270 msgr2=0x7fadfc0fc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:01.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.395+0000 7fae03e65640 1 --2- 172.21.15.134:0/61699093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0fc270 0x7fadfc0fc680 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fadf80048d0 tx=0x7fadf8009da0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.395+0000 7fae03e65640 1 -- 172.21.15.134:0/61699093 shutdown_connections 2024-02-16T22:17:01.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.395+0000 7fae03e65640 1 --2- 172.21.15.134:0/61699093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadfc0fd540 0x7fadfc0fd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.395+0000 7fae03e65640 1 --2- 172.21.15.134:0/61699093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0fc270 0x7fadfc0fc680 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.395+0000 7fae03e65640 1 -- 172.21.15.134:0/61699093 >> 172.21.15.134:0/61699093 conn(0x7fadfc0f7a30 msgr2=0x7fadfc0f9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:01.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.395+0000 7fae03e65640 1 -- 172.21.15.134:0/61699093 shutdown_connections 2024-02-16T22:17:01.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.395+0000 7fae03e65640 1 -- 172.21.15.134:0/61699093 wait complete. 2024-02-16T22:17:01.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.396+0000 7fae03e65640 1 Processor -- start 2024-02-16T22:17:01.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.396+0000 7fae03e65640 1 -- start start 2024-02-16T22:17:01.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.396+0000 7fae03e65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0fc270 0x7fadfc10cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:01.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.396+0000 7fae03e65640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadfc0fd540 0x7fadfc10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:01.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.396+0000 7fae03e65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc10d6e0 con 0x7fadfc0fc270 2024-02-16T22:17:01.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.396+0000 7fae03e65640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc112130 con 0x7fadfc0fd540 2024-02-16T22:17:01.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.396+0000 7fae01c01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0fc270 0x7fadfc10cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:01.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.396+0000 7fae01c01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0fc270 0x7fadfc10cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41658/0 (socket says 172.21.15.134:41658) 2024-02-16T22:17:01.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.396+0000 7fae01c01640 1 -- 172.21.15.134:0/2769826561 learned_addr learned my addr 172.21.15.134:0/2769826561 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:17:01.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.396+0000 7fae01c01640 1 -- 172.21.15.134:0/2769826561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadfc0fd540 msgr2=0x7fadfc10d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:01.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.396+0000 7fae01c01640 1 --2- 172.21.15.134:0/2769826561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadfc0fd540 0x7fadfc10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.396+0000 7fae01c01640 1 -- 172.21.15.134:0/2769826561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf8005040 con 0x7fadfc0fc270 2024-02-16T22:17:01.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.397+0000 7fae01c01640 1 --2- 172.21.15.134:0/2769826561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0fc270 0x7fadfc10cb50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fadf8007da0 tx=0x7fadf8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:01.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.397+0000 7fadf27fc640 1 -- 172.21.15.134:0/2769826561 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadf80094c0 con 0x7fadfc0fc270 2024-02-16T22:17:01.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.397+0000 7fae03e65640 1 -- 172.21.15.134:0/2769826561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc112270 con 0x7fadfc0fc270 2024-02-16T22:17:01.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.397+0000 7fadf27fc640 1 -- 172.21.15.134:0/2769826561 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadf8009620 con 0x7fadfc0fc270 2024-02-16T22:17:01.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.397+0000 7fadf27fc640 1 -- 172.21.15.134:0/2769826561 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadf803b620 con 0x7fadfc0fc270 2024-02-16T22:17:01.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.397+0000 7fae03e65640 1 -- 172.21.15.134:0/2769826561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc112760 con 0x7fadfc0fc270 2024-02-16T22:17:01.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.398+0000 7fae03e65640 1 -- 172.21.15.134:0/2769826561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc104de0 con 0x7fadfc0fc270 2024-02-16T22:17:01.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.398+0000 7fadf27fc640 1 -- 172.21.15.134:0/2769826561 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fadf802f070 con 0x7fadfc0fc270 2024-02-16T22:17:01.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.398+0000 7fadf27fc640 1 --2- 172.21.15.134:0/2769826561 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fade8069210 0x7fade806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:01.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.399+0000 7fae01400640 1 --2- 172.21.15.134:0/2769826561 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fade8069210 0x7fade806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:01.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.399+0000 7fadf27fc640 1 -- 172.21.15.134:0/2769826561 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fadf80a9840 con 0x7fadfc0fc270 2024-02-16T22:17:01.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.399+0000 7fae01400640 1 --2- 172.21.15.134:0/2769826561 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fade8069210 0x7fade806b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fadfc10e0a0 tx=0x7fadec009c50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:01.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.403+0000 7fadf27fc640 1 -- 172.21.15.134:0/2769826561 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fadf8075aa0 con 0x7fadfc0fc270 2024-02-16T22:17:01.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.603+0000 7fae03e65640 1 -- 172.21.15.134:0/2769826561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadfc1128f0 con 0x7fadfc0fc270 2024-02-16T22:17:01.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.604+0000 7fadf27fc640 1 -- 172.21.15.134:0/2769826561 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fadf80790c0 con 0x7fadfc0fc270 2024-02-16T22:17:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:17:01.605 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14488,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2804816044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2804816044},{"type":"v1","addr":"172.21.15.134:6827","nonce":2804816044}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24279,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.173:6827/3866528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3866528665},{"type":"v1","addr":"172.21.15.173:6827","nonce":3866528665}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:16:50.465942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi134.jyajef","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6829/3374248278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3374248278},{"type":"v1","addr":"172.21.15.134:6829","nonce":3374248278}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi173.qljqef","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6825/122132522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":122132522},{"type":"v1","addr":"172.21.15.173:6825","nonce":122132522}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-16T22:17:01.606 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 16 2024-02-16T22:17:01.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.605+0000 7fae03e65640 1 -- 172.21.15.134:0/2769826561 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fade8069210 msgr2=0x7fade806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:01.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.605+0000 7fae03e65640 1 --2- 172.21.15.134:0/2769826561 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fade8069210 0x7fade806b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fadfc10e0a0 tx=0x7fadec009c50 comp rx=0 tx=0).stop 2024-02-16T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.605+0000 7fae03e65640 1 -- 172.21.15.134:0/2769826561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0fc270 msgr2=0x7fadfc10cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.605+0000 7fae03e65640 1 --2- 172.21.15.134:0/2769826561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0fc270 0x7fadfc10cb50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fadf8007da0 tx=0x7fadf8009da0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.605+0000 7fae03e65640 1 -- 172.21.15.134:0/2769826561 shutdown_connections 2024-02-16T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.605+0000 7fae03e65640 1 --2- 172.21.15.134:0/2769826561 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fade8069210 0x7fade806b6c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.605+0000 7fae03e65640 1 --2- 172.21.15.134:0/2769826561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadfc0fd540 0x7fadfc10d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.605+0000 7fae03e65640 1 --2- 172.21.15.134:0/2769826561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0fc270 0x7fadfc10cb50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.605+0000 7fae03e65640 1 -- 172.21.15.134:0/2769826561 >> 172.21.15.134:0/2769826561 conn(0x7fadfc0f7a30 msgr2=0x7fadfc100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.606+0000 7fae03e65640 1 -- 172.21.15.134:0/2769826561 shutdown_connections 2024-02-16T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:01.606+0000 7fae03e65640 1 -- 172.21.15.134:0/2769826561 wait complete. 2024-02-16T22:17:01.617 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:01 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/433745076' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-16T22:17:01.617 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:01 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/258205412' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-16T22:17:01.617 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:01 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2912260704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-16T22:17:01.617 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:01 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/4078189988' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-16T22:17:01.618 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 2, 'flags': 18} 2024-02-16T22:17:01.618 INFO:teuthology.run_tasks:Running task kclient... 2024-02-16T22:17:01.640 INFO:tasks.kclient:Mounting kernel clients... 2024-02-16T22:17:01.641 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-02-16T22:17:01.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:01.641 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-02-16T22:17:01.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:01.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-02-16T22:17:01.724 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2024-02-16T22:17:01.725 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T22:17:01.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:01.726 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-02-16T22:17:01.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:01 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/433745076' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-16T22:17:01.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:01 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/258205412' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-16T22:17:01.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:01 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2912260704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-16T22:17:01.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:01 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/4078189988' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-16T22:17:01.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:01.745 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link delete ceph-brx 2024-02-16T22:17:01.821 INFO:teuthology.orchestra.run.smithi173.stderr:Cannot find device "ceph-brx" 2024-02-16T22:17:01.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T22:17:01.822 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-02-16T22:17:01.822 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-16T22:17:01.823 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-16T22:17:01.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph fs ls 2024-02-16T22:17:02.077 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:17:02.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:02 smithi134 ceph-mon[28869]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-16T22:17:02.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:02 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2769826561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-16T22:17:02.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:02 smithi173 ceph-mon[37280]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-16T22:17:02.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:02 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2769826561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-16T22:17:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.501+0000 7f42ec054700 1 -- 172.21.15.134:0/512732530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42e40fdfe0 msgr2=0x7f42e40fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.501+0000 7f42ec054700 1 --2- 172.21.15.134:0/512732530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42e40fdfe0 0x7f42e40fe3b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f42e0004970 tx=0x7f42e0009e30 comp rx=0 tx=0).stop 2024-02-16T22:17:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.501+0000 7f42ec054700 1 -- 172.21.15.134:0/512732530 shutdown_connections 2024-02-16T22:17:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.501+0000 7f42ec054700 1 --2- 172.21.15.134:0/512732530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42e40fe8f0 0x7f42e4107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.501+0000 7f42ec054700 1 --2- 172.21.15.134:0/512732530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42e40fdfe0 0x7f42e40fe3b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.501+0000 7f42ec054700 1 -- 172.21.15.134:0/512732530 >> 172.21.15.134:0/512732530 conn(0x7f42e4071d90 msgr2=0x7f42e4072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.501+0000 7f42ec054700 1 -- 172.21.15.134:0/512732530 shutdown_connections 2024-02-16T22:17:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.501+0000 7f42ec054700 1 -- 172.21.15.134:0/512732530 wait complete. 2024-02-16T22:17:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.502+0000 7f42ec054700 1 Processor -- start 2024-02-16T22:17:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.502+0000 7f42ec054700 1 -- start start 2024-02-16T22:17:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.502+0000 7f42ec054700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42e40fdfe0 0x7f42e4113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.502+0000 7f42ec054700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42e40fe8f0 0x7f42e4113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.502+0000 7f42ec054700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e4114600 con 0x7f42e40fe8f0 2024-02-16T22:17:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.502+0000 7f42ec054700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e410d930 con 0x7f42e40fdfe0 2024-02-16T22:17:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.502+0000 7f42e95ef700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42e40fe8f0 0x7f42e4113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.502+0000 7f42e95ef700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42e40fe8f0 0x7f42e4113fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43214/0 (socket says 172.21.15.134:43214) 2024-02-16T22:17:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.502+0000 7f42e95ef700 1 -- 172.21.15.134:0/3667161953 learned_addr learned my addr 172.21.15.134:0/3667161953 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:17:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.502+0000 7f42e9df0700 1 --2- 172.21.15.134:0/3667161953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42e40fdfe0 0x7f42e4113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.503+0000 7f42e95ef700 1 -- 172.21.15.134:0/3667161953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42e40fdfe0 msgr2=0x7f42e4113a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.503+0000 7f42e95ef700 1 --2- 172.21.15.134:0/3667161953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42e40fdfe0 0x7f42e4113a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.503+0000 7f42e95ef700 1 -- 172.21.15.134:0/3667161953 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e0005040 con 0x7f42e40fe8f0 2024-02-16T22:17:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.503+0000 7f42e95ef700 1 --2- 172.21.15.134:0/3667161953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42e40fe8f0 0x7f42e4113fb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f42d4002a50 tx=0x7f42d40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:03.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.503+0000 7f42da7fc700 1 -- 172.21.15.134:0/3667161953 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42d4007cc0 con 0x7f42e40fe8f0 2024-02-16T22:17:03.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.503+0000 7f42da7fc700 1 -- 172.21.15.134:0/3667161953 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f42d400f040 con 0x7f42e40fe8f0 2024-02-16T22:17:03.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.503+0000 7f42ec054700 1 -- 172.21.15.134:0/3667161953 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e410dc10 con 0x7f42e40fe8f0 2024-02-16T22:17:03.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.503+0000 7f42da7fc700 1 -- 172.21.15.134:0/3667161953 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42d400da70 con 0x7f42e40fe8f0 2024-02-16T22:17:03.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.503+0000 7f42ec054700 1 -- 172.21.15.134:0/3667161953 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e410e150 con 0x7f42e40fe8f0 2024-02-16T22:17:03.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.504+0000 7f42ec054700 1 -- 172.21.15.134:0/3667161953 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e41046c0 con 0x7f42e40fe8f0 2024-02-16T22:17:03.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.505+0000 7f42da7fc700 1 -- 172.21.15.134:0/3667161953 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f42d400dcb0 con 0x7f42e40fe8f0 2024-02-16T22:17:03.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.505+0000 7f42da7fc700 1 --2- 172.21.15.134:0/3667161953 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f42d00692b0 0x7f42d006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:03.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.505+0000 7f42da7fc700 1 -- 172.21.15.134:0/3667161953 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f42d40868b0 con 0x7f42e40fe8f0 2024-02-16T22:17:03.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.505+0000 7f42e9df0700 1 --2- 172.21.15.134:0/3667161953 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f42d00692b0 0x7f42d006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:03.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.506+0000 7f42e9df0700 1 --2- 172.21.15.134:0/3667161953 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f42d00692b0 0x7f42d006b760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f42e0004f50 tx=0x7f42e0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.510+0000 7f42da7fc700 1 -- 172.21.15.134:0/3667161953 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f42d4056540 con 0x7f42e40fe8f0 2024-02-16T22:17:03.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.735+0000 7f42ec054700 1 -- 172.21.15.134:0/3667161953 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f42e410a050 con 0x7f42e40fe8f0 2024-02-16T22:17:03.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.736+0000 7f42da7fc700 1 -- 172.21.15.134:0/3667161953 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f42d4017070 con 0x7f42e40fe8f0 2024-02-16T22:17:03.738 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-16T22:17:03.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.738+0000 7f42ec054700 1 -- 172.21.15.134:0/3667161953 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f42d00692b0 msgr2=0x7f42d006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:03.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.738+0000 7f42ec054700 1 --2- 172.21.15.134:0/3667161953 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f42d00692b0 0x7f42d006b760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f42e0004f50 tx=0x7f42e0009e30 comp rx=0 tx=0).stop 2024-02-16T22:17:03.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.738+0000 7f42ec054700 1 -- 172.21.15.134:0/3667161953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42e40fe8f0 msgr2=0x7f42e4113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:03.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.738+0000 7f42ec054700 1 --2- 172.21.15.134:0/3667161953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42e40fe8f0 0x7f42e4113fb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f42d4002a50 tx=0x7f42d40046b0 comp rx=0 tx=0).stop 2024-02-16T22:17:03.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.738+0000 7f42ec054700 1 -- 172.21.15.134:0/3667161953 shutdown_connections 2024-02-16T22:17:03.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.738+0000 7f42ec054700 1 --2- 172.21.15.134:0/3667161953 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f42d00692b0 0x7f42d006b760 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:03.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.738+0000 7f42ec054700 1 --2- 172.21.15.134:0/3667161953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42e40fdfe0 0x7f42e4113a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:03.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.738+0000 7f42ec054700 1 --2- 172.21.15.134:0/3667161953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42e40fe8f0 0x7f42e4113fb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:03.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.738+0000 7f42ec054700 1 -- 172.21.15.134:0/3667161953 >> 172.21.15.134:0/3667161953 conn(0x7f42e4071d90 msgr2=0x7f42e4101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:03.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.738+0000 7f42ec054700 1 -- 172.21.15.134:0/3667161953 shutdown_connections 2024-02-16T22:17:03.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:03.738+0000 7f42ec054700 1 -- 172.21.15.134:0/3667161953 wait complete. 2024-02-16T22:17:04.368 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-16T22:17:04.368 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-16T22:17:04.368 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-02-16T22:17:04.368 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-16T22:17:04.368 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-16T22:17:04.368 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-16T22:17:04.368 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-16T22:17:04.368 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-16T22:17:04.368 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-16T22:17:04.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:04.369 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-02-16T22:17:04.386 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-16T22:17:04.386 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-16T22:17:04.386 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-02-16T22:17:04.386 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-02-16T22:17:04.386 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-02-16T22:17:04.386 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-02-16T22:17:04.387 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-16T22:17:04.387 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-02-16T22:17:04.387 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-02-16T22:17:04.387 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-16T22:17:04.387 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-02-16T22:17:04.387 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-02-16T22:17:04.387 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-16T22:17:04.387 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-02-16T22:17:04.387 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-16T22:17:04.387 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-02-16T22:17:04.387 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-16T22:17:04.387 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42296sec preferred_lft 42296sec 2024-02-16T22:17:04.387 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2024-02-16T22:17:04.387 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-02-16T22:17:04.388 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-16T22:17:04.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:04.388 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-16T22:17:04.388 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-16T22:17:04.388 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add name ceph-brx type bridge 2024-02-16T22:17:04.388 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr flush dev ceph-brx 2024-02-16T22:17:04.388 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set ceph-brx up 2024-02-16T22:17:04.388 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-16T22:17:04.389 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-16T22:17:04.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:04.586 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-16T22:17:04.612 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-02-16T22:17:04.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:04.614 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-02-16T22:17:04.681 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-02-16T22:17:04.682 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-16T22:17:04.682 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-16T22:17:04.682 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-16T22:17:04.682 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-16T22:17:04.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:04.682 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-16T22:17:04.682 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-16T22:17:04.682 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-16T22:17:04.683 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-16T22:17:04.683 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-16T22:17:04.683 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-16T22:17:04.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:04 smithi134 ceph-mon[28869]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-16T22:17:04.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:04 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/3667161953' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-16T22:17:04.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:04 smithi173 ceph-mon[37280]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-16T22:17:04.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:04 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/3667161953' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-16T22:17:04.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:04.956 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-02-16T22:17:05.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:05.011 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2024-02-16T22:17:05.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:05.066 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-16T22:17:05.066 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-16T22:17:05.067 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-16T22:17:05.067 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-16T22:17:05.067 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-16T22:17:05.149 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-16T22:17:05.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:05.149 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-16T22:17:05.149 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-16T22:17:05.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-16T22:17:05.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-16T22:17:05.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-16T22:17:05.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-16T22:17:05.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-16T22:17:05.149 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-16T22:17:05.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:05.282 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-16T22:17:05.282 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-16T22:17:05.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-02-16T22:17:05.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.0 master ceph-brx 2024-02-16T22:17:05.282 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-16T22:17:05.323 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-16T22:17:05.323 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-16T22:17:05.382 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-16T22:17:05.382 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-16T22:17:05.383 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-16T22:17:05.440 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-16T22:17:05.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:05.440 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-16T22:17:05.523 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-16T22:17:05.523 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-16T22:17:05.523 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-02-16T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-16T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-16T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-02-16T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.173:3300" 2024-02-16T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-16T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-16T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-16T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-02-16T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.173:3300" 2024-02-16T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-16T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.173:6789" 2024-02-16T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.173:6789:/ 2024-02-16T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f29a5372-cd17-11ee-95ba-87774f69a715" will pass to kernel 2024-02-16T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-16T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-02-16T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-16T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-02-16T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-16T22:17:05.649 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-16T22:17:05.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:05.649 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-16T22:17:05.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:05.680 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-16T22:17:05.740 INFO:teuthology.orchestra.run.smithi134.stdout:client14526 2024-02-16T22:17:05.741 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:17:05.741 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-16T22:17:05.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:05.797 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-16T22:17:05.858 INFO:teuthology.orchestra.run.smithi134.stdout:client14526 2024-02-16T22:17:05.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:05.858 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-16T22:17:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:client14526 2024-02-16T22:17:05.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:05.918 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f29a5372-cd17-11ee-95ba-87774f69a715.client14526/status') 2024-02-16T22:17:05.988 INFO:teuthology.orchestra.run.smithi134.stdout:instance: client.14526 (3)192.168.0.1:0/1977345001 2024-02-16T22:17:05.988 INFO:teuthology.orchestra.run.smithi134.stdout:blocklisted: false 2024-02-16T22:17:05.988 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2024-02-16T22:17:05.988 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2024-02-16T22:17:05.988 INFO:teuthology.orchestra.run.smithi134.stderr:70 bytes copied, 1.9998e-05 s, 3.5 MB/s 2024-02-16T22:17:05.989 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-02-16T22:17:05.990 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-16T22:17:05.990 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-16T22:17:05.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- ceph fs ls 2024-02-16T22:17:06.283 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:17:06.721 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:06 smithi134 ceph-mon[28869]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-16T22:17:06.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:06 smithi173 ceph-mon[37280]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-16T22:17:07.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.681+0000 7fab7d325700 1 -- 172.21.15.134:0/4137114542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab78102800 msgr2=0x7fab780fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:07.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.681+0000 7fab7d325700 1 --2- 172.21.15.134:0/4137114542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab78102800 0x7fab780fbe70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fab6c004940 tx=0x7fab6c009e30 comp rx=0 tx=0).stop 2024-02-16T22:17:07.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.681+0000 7fab7d325700 1 -- 172.21.15.134:0/4137114542 shutdown_connections 2024-02-16T22:17:07.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.682+0000 7fab7d325700 1 --2- 172.21.15.134:0/4137114542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab78102800 0x7fab780fbe70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:07.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.682+0000 7fab7d325700 1 --2- 172.21.15.134:0/4137114542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab78101e60 0x7fab78102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:07.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.682+0000 7fab7d325700 1 -- 172.21.15.134:0/4137114542 >> 172.21.15.134:0/4137114542 conn(0x7fab780f7a10 msgr2=0x7fab780f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:07.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.682+0000 7fab7d325700 1 -- 172.21.15.134:0/4137114542 shutdown_connections 2024-02-16T22:17:07.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.682+0000 7fab7d325700 1 -- 172.21.15.134:0/4137114542 wait complete. 2024-02-16T22:17:07.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.682+0000 7fab7d325700 1 Processor -- start 2024-02-16T22:17:07.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.682+0000 7fab7d325700 1 -- start start 2024-02-16T22:17:07.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.682+0000 7fab7d325700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab78101e60 0x7fab78112a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:07.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.682+0000 7fab7d325700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab78102800 0x7fab78112f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:07.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.682+0000 7fab7d325700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab78113590 con 0x7fab78102800 2024-02-16T22:17:07.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.682+0000 7fab7d325700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7810c8c0 con 0x7fab78101e60 2024-02-16T22:17:07.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.683+0000 7fab767fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab78102800 0x7fab78112f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:07.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.683+0000 7fab767fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab78102800 0x7fab78112f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43234/0 (socket says 172.21.15.134:43234) 2024-02-16T22:17:07.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.683+0000 7fab767fc700 1 -- 172.21.15.134:0/2574513700 learned_addr learned my addr 172.21.15.134:0/2574513700 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:17:07.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.683+0000 7fab76ffd700 1 --2- 172.21.15.134:0/2574513700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab78101e60 0x7fab78112a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:07.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.683+0000 7fab767fc700 1 -- 172.21.15.134:0/2574513700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab78101e60 msgr2=0x7fab78112a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:07.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.683+0000 7fab767fc700 1 --2- 172.21.15.134:0/2574513700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab78101e60 0x7fab78112a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:07.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.683+0000 7fab767fc700 1 -- 172.21.15.134:0/2574513700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c005040 con 0x7fab78102800 2024-02-16T22:17:07.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.683+0000 7fab767fc700 1 --2- 172.21.15.134:0/2574513700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab78102800 0x7fab78112f40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0090d0 tx=0x7fab6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:07.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.683+0000 7fab5f7fe700 1 -- 172.21.15.134:0/2574513700 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab6c00e040 con 0x7fab78102800 2024-02-16T22:17:07.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.683+0000 7fab5f7fe700 1 -- 172.21.15.134:0/2574513700 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab6c009430 con 0x7fab78102800 2024-02-16T22:17:07.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.683+0000 7fab7d325700 1 -- 172.21.15.134:0/2574513700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7810cb40 con 0x7fab78102800 2024-02-16T22:17:07.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.683+0000 7fab5f7fe700 1 -- 172.21.15.134:0/2574513700 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab6c01c3f0 con 0x7fab78102800 2024-02-16T22:17:07.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.683+0000 7fab7d325700 1 -- 172.21.15.134:0/2574513700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7810d080 con 0x7fab78102800 2024-02-16T22:17:07.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.684+0000 7fab7d325700 1 -- 172.21.15.134:0/2574513700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab78104330 con 0x7fab78102800 2024-02-16T22:17:07.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.685+0000 7fab5f7fe700 1 -- 172.21.15.134:0/2574513700 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fab6c00bbf0 con 0x7fab78102800 2024-02-16T22:17:07.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.685+0000 7fab5f7fe700 1 --2- 172.21.15.134:0/2574513700 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fab600692a0 0x7fab6006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:07.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.685+0000 7fab5f7fe700 1 -- 172.21.15.134:0/2574513700 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fab6c0884c0 con 0x7fab78102800 2024-02-16T22:17:07.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.685+0000 7fab76ffd700 1 --2- 172.21.15.134:0/2574513700 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fab600692a0 0x7fab6006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:07.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.685+0000 7fab76ffd700 1 --2- 172.21.15.134:0/2574513700 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fab600692a0 0x7fab6006b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fab680041d0 tx=0x7fab680043c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:07.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.689+0000 7fab5f7fe700 1 -- 172.21.15.134:0/2574513700 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fab6c058230 con 0x7fab78102800 2024-02-16T22:17:07.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.915+0000 7fab7d325700 1 -- 172.21.15.134:0/2574513700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fab78108f40 con 0x7fab78102800 2024-02-16T22:17:07.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.915+0000 7fab5f7fe700 1 -- 172.21.15.134:0/2574513700 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7fab6c057dc0 con 0x7fab78102800 2024-02-16T22:17:07.917 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-16T22:17:07.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.917+0000 7fab7d325700 1 -- 172.21.15.134:0/2574513700 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fab600692a0 msgr2=0x7fab6006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:07.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.917+0000 7fab7d325700 1 --2- 172.21.15.134:0/2574513700 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fab600692a0 0x7fab6006b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fab680041d0 tx=0x7fab680043c0 comp rx=0 tx=0).stop 2024-02-16T22:17:07.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.917+0000 7fab7d325700 1 -- 172.21.15.134:0/2574513700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab78102800 msgr2=0x7fab78112f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:07.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.917+0000 7fab7d325700 1 --2- 172.21.15.134:0/2574513700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab78102800 0x7fab78112f40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0090d0 tx=0x7fab6c009e30 comp rx=0 tx=0).stop 2024-02-16T22:17:07.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.917+0000 7fab7d325700 1 -- 172.21.15.134:0/2574513700 shutdown_connections 2024-02-16T22:17:07.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.917+0000 7fab7d325700 1 --2- 172.21.15.134:0/2574513700 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fab600692a0 0x7fab6006b750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:07.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.917+0000 7fab7d325700 1 --2- 172.21.15.134:0/2574513700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab78101e60 0x7fab78112a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:07.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.917+0000 7fab7d325700 1 --2- 172.21.15.134:0/2574513700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab78102800 0x7fab78112f40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:07.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.917+0000 7fab7d325700 1 -- 172.21.15.134:0/2574513700 >> 172.21.15.134:0/2574513700 conn(0x7fab780f7a10 msgr2=0x7fab780f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:07.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.917+0000 7fab7d325700 1 -- 172.21.15.134:0/2574513700 shutdown_connections 2024-02-16T22:17:07.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:07.917+0000 7fab7d325700 1 -- 172.21.15.134:0/2574513700 wait complete. 2024-02-16T22:17:08.495 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-16T22:17:08.495 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-16T22:17:08.495 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-02-16T22:17:08.495 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-16T22:17:08.495 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-16T22:17:08.495 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-16T22:17:08.495 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-16T22:17:08.496 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-16T22:17:08.496 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-16T22:17:08.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:08.496 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-02-16T22:17:08.517 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-16T22:17:08.517 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-16T22:17:08.517 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-02-16T22:17:08.517 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-02-16T22:17:08.517 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-02-16T22:17:08.517 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-02-16T22:17:08.517 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-16T22:17:08.517 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-02-16T22:17:08.518 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-02-16T22:17:08.518 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-16T22:17:08.518 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-02-16T22:17:08.518 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-02-16T22:17:08.518 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-16T22:17:08.518 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-02-16T22:17:08.518 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-16T22:17:08.518 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-02-16T22:17:08.518 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-16T22:17:08.518 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42289sec preferred_lft 42289sec 2024-02-16T22:17:08.518 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-02-16T22:17:08.518 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-02-16T22:17:08.518 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-16T22:17:08.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:08.519 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-02-16T22:17:08.519 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-02-16T22:17:08.519 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add name ceph-brx type bridge 2024-02-16T22:17:08.519 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip addr flush dev ceph-brx 2024-02-16T22:17:08.519 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set ceph-brx up 2024-02-16T22:17:08.519 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-16T22:17:08.519 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-02-16T22:17:08.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:08.685 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-16T22:17:08.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:08 smithi134 ceph-mon[28869]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-16T22:17:08.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:08 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2574513700' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-16T22:17:08.712 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-02-16T22:17:08.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:08.714 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-02-16T22:17:08.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:08 smithi173 ceph-mon[37280]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-16T22:17:08.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:08 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2574513700' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-16T22:17:08.778 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-02-16T22:17:08.778 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-16T22:17:08.778 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-16T22:17:08.779 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-16T22:17:08.779 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-16T22:17:08.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:08.779 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-02-16T22:17:08.779 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-02-16T22:17:08.779 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-16T22:17:08.779 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-16T22:17:08.779 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-16T22:17:08.779 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-02-16T22:17:09.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:09.018 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-02-16T22:17:09.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:09.033 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list-id 2024-02-16T22:17:09.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:09.088 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-02-16T22:17:09.088 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-02-16T22:17:09.088 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-16T22:17:09.088 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-16T22:17:09.088 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-02-16T22:17:09.188 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-16T22:17:09.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:09.188 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-02-16T22:17:09.188 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-02-16T22:17:09.188 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-16T22:17:09.188 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-16T22:17:09.188 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-16T22:17:09.188 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-16T22:17:09.188 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-16T22:17:09.188 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-02-16T22:17:09.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:09.285 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-02-16T22:17:09.285 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-02-16T22:17:09.285 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2024-02-16T22:17:09.285 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set dev brx.0 master ceph-brx 2024-02-16T22:17:09.285 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-02-16T22:17:09.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-16T22:17:09.326 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-16T22:17:09.382 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-16T22:17:09.382 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-16T22:17:09.382 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-16T22:17:09.437 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-16T22:17:09.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:09.437 DEBUG:teuthology.orchestra.run.smithi173:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-16T22:17:09.582 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-16T22:17:09.582 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-16T22:17:09.583 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-02-16T22:17:09.693 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-16T22:17:09.693 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-16T22:17:09.693 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-02-16T22:17:09.693 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.173:3300" 2024-02-16T22:17:09.693 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-16T22:17:09.698 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-16T22:17:09.698 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-16T22:17:09.698 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-02-16T22:17:09.698 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.173:3300" 2024-02-16T22:17:09.698 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-16T22:17:09.698 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.173:6789" 2024-02-16T22:17:09.699 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.173:6789:/ 2024-02-16T22:17:09.699 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f29a5372-cd17-11ee-95ba-87774f69a715" will pass to kernel 2024-02-16T22:17:09.702 INFO:teuthology.orchestra.run.smithi173.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-02-16T22:17:09.702 INFO:teuthology.orchestra.run.smithi173.stdout: You just mounted a file system that supports labels which does not 2024-02-16T22:17:09.702 INFO:teuthology.orchestra.run.smithi173.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-16T22:17:09.702 INFO:teuthology.orchestra.run.smithi173.stdout: applications will generate AVC messages and not be allowed access to 2024-02-16T22:17:09.702 INFO:teuthology.orchestra.run.smithi173.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-16T22:17:09.704 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-16T22:17:09.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:09.704 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-16T22:17:09.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:09.730 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-16T22:17:09.786 INFO:teuthology.orchestra.run.smithi173.stdout:client24315 2024-02-16T22:17:09.787 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:17:09.787 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-16T22:17:09.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:09.843 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-16T22:17:09.899 INFO:teuthology.orchestra.run.smithi173.stdout:client24315 2024-02-16T22:17:09.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:09.899 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-16T22:17:09.955 INFO:teuthology.orchestra.run.smithi173.stdout:client24315 2024-02-16T22:17:09.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:17:09.955 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f29a5372-cd17-11ee-95ba-87774f69a715.client24315/status') 2024-02-16T22:17:09.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:09 smithi134 ceph-mon[28869]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-16T22:17:09.977 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:09 smithi173 ceph-mon[37280]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-16T22:17:10.003 INFO:teuthology.orchestra.run.smithi173.stdout:instance: client.24315 (3)192.168.0.1:0/161177360 2024-02-16T22:17:10.003 INFO:teuthology.orchestra.run.smithi173.stdout:blocklisted: false 2024-02-16T22:17:10.003 INFO:teuthology.orchestra.run.smithi173.stderr:0+1 records in 2024-02-16T22:17:10.004 INFO:teuthology.orchestra.run.smithi173.stderr:0+1 records out 2024-02-16T22:17:10.004 INFO:teuthology.orchestra.run.smithi173.stderr:69 bytes copied, 2.1187e-05 s, 3.3 MB/s 2024-02-16T22:17:10.005 INFO:teuthology.run_tasks:Running task print... 2024-02-16T22:17:10.015 INFO:teuthology.task.print:**** done client 2024-02-16T22:17:10.015 INFO:teuthology.run_tasks:Running task parallel... 2024-02-16T22:17:10.027 INFO:teuthology.task.parallel:starting parallel... 2024-02-16T22:17:10.027 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-16T22:17:10.028 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-16T22:17:10.028 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T22:17:10.028 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-16T22:17:10.028 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-16T22:17:10.028 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-02-16T22:17:10.032 INFO:tasks.workunit:Pulling workunits from ref ed7ab725e1a43615009dfb74a42bf33d80081bc8 2024-02-16T22:17:10.032 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-16T22:17:10.032 INFO:tasks.workunit:timeout=3h 2024-02-16T22:17:10.032 INFO:tasks.workunit:cleanup=True 2024-02-16T22:17:10.032 DEBUG:teuthology.orchestra.run.smithi134:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-16T22:17:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-16T22:17:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-02-16T22:17:10.054 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 7ch/124d Inode: 1 Links: 2 2024-02-16T22:17:10.054 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T22:17:10.054 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-16T22:17:10.054 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-16T22:17:10.054 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-02-16 22:16:36.449494093 +0000 2024-02-16T22:17:10.054 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-02-16 22:17:05.672683828 +0000 2024-02-16T22:17:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-02-16 22:16:36.449494093 +0000 2024-02-16T22:17:10.054 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-16T22:17:10.054 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-16T22:17:10.127 DEBUG:teuthology.orchestra.run.smithi173:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-16T22:17:10.142 INFO:teuthology.orchestra.run.smithi173.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-16T22:17:10.142 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-02-16T22:17:10.143 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 73h/115d Inode: 1 Links: 3 2024-02-16T22:17:10.143 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T22:17:10.143 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-16T22:17:10.143 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-16T22:17:10.143 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-02-16 22:17:10.120575745 +0000 2024-02-16T22:17:10.143 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-02-16 22:17:10.120575745 +0000 2024-02-16T22:17:10.143 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-02-16 22:16:36.449494093 +0000 2024-02-16T22:17:10.143 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-16T22:17:10.143 DEBUG:teuthology.orchestra.run.smithi173:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-16T22:17:10.212 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/batrick/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ed7ab725e1a43615009dfb74a42bf33d80081bc8 2024-02-16T22:17:10.213 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/batrick/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout ed7ab725e1a43615009dfb74a42bf33d80081bc8 2024-02-16T22:17:10.228 INFO:tasks.workunit.client.0.smithi134.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-16T22:17:10.268 INFO:tasks.workunit.client.1.smithi173.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-16T22:17:10.306 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:17:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f067045a700 1 -- 172.21.15.134:0/574319734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06680fabd0 msgr2=0x7f06680fafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f067045a700 1 --2- 172.21.15.134:0/574319734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06680fabd0 0x7f06680fafe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0664004940 tx=0x7f0664009e30 comp rx=0 tx=0).stop 2024-02-16T22:17:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f067045a700 1 -- 172.21.15.134:0/574319734 shutdown_connections 2024-02-16T22:17:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f067045a700 1 --2- 172.21.15.134:0/574319734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06680fb5b0 0x7f06681027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f067045a700 1 --2- 172.21.15.134:0/574319734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06680fabd0 0x7f06680fafe0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f067045a700 1 -- 172.21.15.134:0/574319734 >> 172.21.15.134:0/574319734 conn(0x7f06680f6840 msgr2=0x7f06680f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f067045a700 1 -- 172.21.15.134:0/574319734 shutdown_connections 2024-02-16T22:17:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f067045a700 1 -- 172.21.15.134:0/574319734 wait complete. 2024-02-16T22:17:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f067045a700 1 Processor -- start 2024-02-16T22:17:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f067045a700 1 -- start start 2024-02-16T22:17:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f067045a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06680fabd0 0x7f066810d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f067045a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06680fb5b0 0x7f066810de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f067045a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066810e470 con 0x7f06680fabd0 2024-02-16T22:17:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f067045a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066810ed10 con 0x7f06680fb5b0 2024-02-16T22:17:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f066e1f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06680fabd0 0x7f066810d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.784+0000 7f066e1f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06680fabd0 0x7f066810d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37206/0 (socket says 172.21.15.134:37206) 2024-02-16T22:17:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.785+0000 7f066e1f6700 1 -- 172.21.15.134:0/1780621705 learned_addr learned my addr 172.21.15.134:0/1780621705 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:17:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.785+0000 7f066d9f5700 1 --2- 172.21.15.134:0/1780621705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06680fb5b0 0x7f066810de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.785+0000 7f066e1f6700 1 -- 172.21.15.134:0/1780621705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06680fb5b0 msgr2=0x7f066810de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.785+0000 7f066e1f6700 1 --2- 172.21.15.134:0/1780621705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06680fb5b0 0x7f066810de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.785+0000 7f066e1f6700 1 -- 172.21.15.134:0/1780621705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0664005040 con 0x7f06680fabd0 2024-02-16T22:17:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.785+0000 7f066d9f5700 1 --2- 172.21.15.134:0/1780621705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06680fb5b0 0x7f066810de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:17:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.785+0000 7f066e1f6700 1 --2- 172.21.15.134:0/1780621705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06680fabd0 0x7f066810d930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f06640093b0 tx=0x7f0664009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.785+0000 7f065effd700 1 -- 172.21.15.134:0/1780621705 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f066400e040 con 0x7f06680fabd0 2024-02-16T22:17:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.785+0000 7f065effd700 1 -- 172.21.15.134:0/1780621705 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f066400bcc0 con 0x7f06680fabd0 2024-02-16T22:17:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.785+0000 7f067045a700 1 -- 172.21.15.134:0/1780621705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066810ef90 con 0x7f06680fabd0 2024-02-16T22:17:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.785+0000 7f065effd700 1 -- 172.21.15.134:0/1780621705 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f066401c630 con 0x7f06680fabd0 2024-02-16T22:17:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.785+0000 7f067045a700 1 -- 172.21.15.134:0/1780621705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066810f4d0 con 0x7f06680fabd0 2024-02-16T22:17:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.786+0000 7f067045a700 1 -- 172.21.15.134:0/1780621705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0668107a40 con 0x7f06680fabd0 2024-02-16T22:17:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.787+0000 7f065effd700 1 -- 172.21.15.134:0/1780621705 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f06640139f0 con 0x7f06680fabd0 2024-02-16T22:17:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.787+0000 7f065effd700 1 --2- 172.21.15.134:0/1780621705 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f06540692a0 0x7f065406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.787+0000 7f065effd700 1 -- 172.21.15.134:0/1780621705 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0664088510 con 0x7f06680fabd0 2024-02-16T22:17:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.787+0000 7f066d9f5700 1 --2- 172.21.15.134:0/1780621705 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f06540692a0 0x7f065406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.787+0000 7f066d9f5700 1 --2- 172.21.15.134:0/1780621705 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f06540692a0 0x7f065406b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0658007fd0 tx=0x7f0658009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.791+0000 7f065effd700 1 -- 172.21.15.134:0/1780621705 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f0664058320 con 0x7f06680fabd0 2024-02-16T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.986+0000 7f067045a700 1 -- 172.21.15.134:0/1780621705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f066804bed0 con 0x7f06680fabd0 2024-02-16T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.987+0000 7f065effd700 1 -- 172.21.15.134:0/1780621705 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f0664057eb0 con 0x7f06680fabd0 2024-02-16T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.989+0000 7f067045a700 1 -- 172.21.15.134:0/1780621705 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f06540692a0 msgr2=0x7f065406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.989+0000 7f067045a700 1 --2- 172.21.15.134:0/1780621705 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f06540692a0 0x7f065406b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0658007fd0 tx=0x7f0658009040 comp rx=0 tx=0).stop 2024-02-16T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.989+0000 7f067045a700 1 -- 172.21.15.134:0/1780621705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06680fabd0 msgr2=0x7f066810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.989+0000 7f067045a700 1 --2- 172.21.15.134:0/1780621705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06680fabd0 0x7f066810d930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f06640093b0 tx=0x7f0664009e30 comp rx=0 tx=0).stop 2024-02-16T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.989+0000 7f067045a700 1 -- 172.21.15.134:0/1780621705 shutdown_connections 2024-02-16T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.989+0000 7f067045a700 1 --2- 172.21.15.134:0/1780621705 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f06540692a0 0x7f065406b750 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.989+0000 7f067045a700 1 --2- 172.21.15.134:0/1780621705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06680fabd0 0x7f066810d930 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.989+0000 7f067045a700 1 --2- 172.21.15.134:0/1780621705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06680fb5b0 0x7f066810de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.989+0000 7f067045a700 1 -- 172.21.15.134:0/1780621705 >> 172.21.15.134:0/1780621705 conn(0x7f06680f6840 msgr2=0x7f0668101020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.989+0000 7f067045a700 1 -- 172.21.15.134:0/1780621705 shutdown_connections 2024-02-16T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:11.989+0000 7f067045a700 1 -- 172.21.15.134:0/1780621705 wait complete. 2024-02-16T22:17:12.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-16T22:17:12.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:12 smithi134 ceph-mon[28869]: pgmap v198: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-16T22:17:12.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:12 smithi173 ceph-mon[37280]: pgmap v198: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-16T22:17:12.983 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:17:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:13 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:17:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:13 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:17:14.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.649+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/638758653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c81003b0 msgr2=0x7fc1c8102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:14.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.649+0000 7fc1cd1a9700 1 --2- 172.21.15.134:0/638758653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c81003b0 0x7fc1c8102790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8004940 tx=0x7fc1b8009e30 comp rx=0 tx=0).stop 2024-02-16T22:17:14.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.649+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/638758653 shutdown_connections 2024-02-16T22:17:14.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.649+0000 7fc1cd1a9700 1 --2- 172.21.15.134:0/638758653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c81003b0 0x7fc1c8102790 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:14.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.649+0000 7fc1cd1a9700 1 --2- 172.21.15.134:0/638758653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1c80fda90 0x7fc1c80ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:14.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.649+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/638758653 >> 172.21.15.134:0/638758653 conn(0x7fc1c80f7510 msgr2=0x7fc1c80f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:14.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.649+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/638758653 shutdown_connections 2024-02-16T22:17:14.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.649+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/638758653 wait complete. 2024-02-16T22:17:14.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.649+0000 7fc1cd1a9700 1 Processor -- start 2024-02-16T22:17:14.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.649+0000 7fc1cd1a9700 1 -- start start 2024-02-16T22:17:14.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.650+0000 7fc1cd1a9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1c80fda90 0x7fc1c810d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.650+0000 7fc1cd1a9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c81003b0 0x7fc1c810de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.650+0000 7fc1cd1a9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c810e410 con 0x7fc1c81003b0 2024-02-16T22:17:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.650+0000 7fc1cd1a9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c810ecb0 con 0x7fc1c80fda90 2024-02-16T22:17:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.650+0000 7fc1c659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c81003b0 0x7fc1c810de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.650+0000 7fc1c659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c81003b0 0x7fc1c810de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37224/0 (socket says 172.21.15.134:37224) 2024-02-16T22:17:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.650+0000 7fc1c659c700 1 -- 172.21.15.134:0/534459735 learned_addr learned my addr 172.21.15.134:0/534459735 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:17:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.650+0000 7fc1c6d9d700 1 --2- 172.21.15.134:0/534459735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1c80fda90 0x7fc1c810d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.650+0000 7fc1c659c700 1 -- 172.21.15.134:0/534459735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1c80fda90 msgr2=0x7fc1c810d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.650+0000 7fc1c659c700 1 --2- 172.21.15.134:0/534459735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1c80fda90 0x7fc1c810d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.650+0000 7fc1c659c700 1 -- 172.21.15.134:0/534459735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b8005040 con 0x7fc1c81003b0 2024-02-16T22:17:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.650+0000 7fc1c659c700 1 --2- 172.21.15.134:0/534459735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c81003b0 0x7fc1c810de10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009fd0 tx=0x7fc1b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.651+0000 7fc1af7fe700 1 -- 172.21.15.134:0/534459735 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1b8021070 con 0x7fc1c81003b0 2024-02-16T22:17:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.651+0000 7fc1af7fe700 1 -- 172.21.15.134:0/534459735 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1b801c400 con 0x7fc1c81003b0 2024-02-16T22:17:14.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.651+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/534459735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c810ef30 con 0x7fc1c81003b0 2024-02-16T22:17:14.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.651+0000 7fc1af7fe700 1 -- 172.21.15.134:0/534459735 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1b800e070 con 0x7fc1c81003b0 2024-02-16T22:17:14.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.651+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/534459735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c810f410 con 0x7fc1c81003b0 2024-02-16T22:17:14.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.652+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/534459735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c8107a60 con 0x7fc1c81003b0 2024-02-16T22:17:14.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.652+0000 7fc1af7fe700 1 -- 172.21.15.134:0/534459735 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc1b801ca50 con 0x7fc1c81003b0 2024-02-16T22:17:14.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.652+0000 7fc1af7fe700 1 --2- 172.21.15.134:0/534459735 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc1b00692a0 0x7fc1b006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:14.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.653+0000 7fc1c6d9d700 1 --2- 172.21.15.134:0/534459735 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc1b00692a0 0x7fc1b006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:14.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.653+0000 7fc1af7fe700 1 -- 172.21.15.134:0/534459735 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc1b8088400 con 0x7fc1c81003b0 2024-02-16T22:17:14.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.653+0000 7fc1c6d9d700 1 --2- 172.21.15.134:0/534459735 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc1b00692a0 0x7fc1b006b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009b80 tx=0x7fc1bc00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:14.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.657+0000 7fc1af7fe700 1 -- 172.21.15.134:0/534459735 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc1b8058170 con 0x7fc1c81003b0 2024-02-16T22:17:14.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:14 smithi134 ceph-mon[28869]: pgmap v199: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-16T22:17:14.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:14 smithi173 ceph-mon[37280]: pgmap v199: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-16T22:17:14.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.867+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/534459735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fc1c804bed0 con 0x7fc1c81003b0 2024-02-16T22:17:14.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.868+0000 7fc1af7fe700 1 -- 172.21.15.134:0/534459735 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc1b8057d00 con 0x7fc1c81003b0 2024-02-16T22:17:14.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.870+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/534459735 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc1b00692a0 msgr2=0x7fc1b006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:14.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.870+0000 7fc1cd1a9700 1 --2- 172.21.15.134:0/534459735 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc1b00692a0 0x7fc1b006b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009b80 tx=0x7fc1bc00b040 comp rx=0 tx=0).stop 2024-02-16T22:17:14.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.870+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/534459735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c81003b0 msgr2=0x7fc1c810de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:14.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.870+0000 7fc1cd1a9700 1 --2- 172.21.15.134:0/534459735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c81003b0 0x7fc1c810de10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009fd0 tx=0x7fc1b8009e30 comp rx=0 tx=0).stop 2024-02-16T22:17:14.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.870+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/534459735 shutdown_connections 2024-02-16T22:17:14.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.870+0000 7fc1cd1a9700 1 --2- 172.21.15.134:0/534459735 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fc1b00692a0 0x7fc1b006b750 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:14.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.870+0000 7fc1cd1a9700 1 --2- 172.21.15.134:0/534459735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1c80fda90 0x7fc1c810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:14.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.870+0000 7fc1cd1a9700 1 --2- 172.21.15.134:0/534459735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c81003b0 0x7fc1c810de10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:14.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.870+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/534459735 >> 172.21.15.134:0/534459735 conn(0x7fc1c80f7510 msgr2=0x7fc1c80f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:14.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.870+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/534459735 shutdown_connections 2024-02-16T22:17:14.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:14.870+0000 7fc1cd1a9700 1 -- 172.21.15.134:0/534459735 wait complete. 2024-02-16T22:17:15.576 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:15 smithi134 ceph-mon[28869]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-02-16T22:17:15.601 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-16T22:17:15.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:15 smithi173 ceph-mon[37280]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-02-16T22:17:15.918 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:17:17.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.830+0000 7f91fba4e700 1 -- 172.21.15.134:0/896347967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f40fcfb0 msgr2=0x7f91f40fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.830+0000 7f91fba4e700 1 --2- 172.21.15.134:0/896347967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f40fcfb0 0x7f91f40fd420 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f91e4004940 tx=0x7f91e4009e30 comp rx=0 tx=0).stop 2024-02-16T22:17:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.830+0000 7f91fba4e700 1 -- 172.21.15.134:0/896347967 shutdown_connections 2024-02-16T22:17:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.830+0000 7f91fba4e700 1 --2- 172.21.15.134:0/896347967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f40fcfb0 0x7f91f40fd420 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.830+0000 7f91fba4e700 1 --2- 172.21.15.134:0/896347967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91f40fbe40 0x7f91f40fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.830+0000 7f91fba4e700 1 -- 172.21.15.134:0/896347967 >> 172.21.15.134:0/896347967 conn(0x7f91f40f7520 msgr2=0x7f91f40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.831+0000 7f91fba4e700 1 -- 172.21.15.134:0/896347967 shutdown_connections 2024-02-16T22:17:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.831+0000 7f91fba4e700 1 -- 172.21.15.134:0/896347967 wait complete. 2024-02-16T22:17:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.831+0000 7f91fba4e700 1 Processor -- start 2024-02-16T22:17:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.831+0000 7f91fba4e700 1 -- start start 2024-02-16T22:17:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.831+0000 7f91fba4e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91f40fbe40 0x7f91f410d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.831+0000 7f91fba4e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f40fcfb0 0x7f91f410dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.831+0000 7f91fba4e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f410e3e0 con 0x7f91f40fcfb0 2024-02-16T22:17:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.831+0000 7f91fba4e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f410ec80 con 0x7f91f40fbe40 2024-02-16T22:17:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.832+0000 7f91f8fe9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f40fcfb0 0x7f91f410dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.832+0000 7f91f8fe9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f40fcfb0 0x7f91f410dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37244/0 (socket says 172.21.15.134:37244) 2024-02-16T22:17:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.832+0000 7f91f97ea700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91f40fbe40 0x7f91f410d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.832+0000 7f91f8fe9700 1 -- 172.21.15.134:0/1917031524 learned_addr learned my addr 172.21.15.134:0/1917031524 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:17:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.832+0000 7f91f8fe9700 1 -- 172.21.15.134:0/1917031524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91f40fbe40 msgr2=0x7f91f410d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.832+0000 7f91f8fe9700 1 --2- 172.21.15.134:0/1917031524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91f40fbe40 0x7f91f410d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.832+0000 7f91f8fe9700 1 -- 172.21.15.134:0/1917031524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e4005040 con 0x7f91f40fcfb0 2024-02-16T22:17:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.832+0000 7f91f97ea700 1 --2- 172.21.15.134:0/1917031524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91f40fbe40 0x7f91f410d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:17:17.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.832+0000 7f91f8fe9700 1 --2- 172.21.15.134:0/1917031524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f40fcfb0 0x7f91f410dde0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f91e4000c00 tx=0x7f91e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:17.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.832+0000 7f91e9ffb700 1 -- 172.21.15.134:0/1917031524 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e4021070 con 0x7f91f40fcfb0 2024-02-16T22:17:17.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.832+0000 7f91fba4e700 1 -- 172.21.15.134:0/1917031524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f410ef00 con 0x7f91f40fcfb0 2024-02-16T22:17:17.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.832+0000 7f91e9ffb700 1 -- 172.21.15.134:0/1917031524 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91e401c400 con 0x7f91f40fcfb0 2024-02-16T22:17:17.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.832+0000 7f91e9ffb700 1 -- 172.21.15.134:0/1917031524 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e400e070 con 0x7f91f40fcfb0 2024-02-16T22:17:17.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.833+0000 7f91fba4e700 1 -- 172.21.15.134:0/1917031524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f410f3e0 con 0x7f91f40fcfb0 2024-02-16T22:17:17.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.834+0000 7f91fba4e700 1 -- 172.21.15.134:0/1917031524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f404bed0 con 0x7f91f40fcfb0 2024-02-16T22:17:17.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.834+0000 7f91e9ffb700 1 -- 172.21.15.134:0/1917031524 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f91e401ca50 con 0x7f91f40fcfb0 2024-02-16T22:17:17.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.834+0000 7f91e9ffb700 1 --2- 172.21.15.134:0/1917031524 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f91e00692a0 0x7f91e006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:17.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.835+0000 7f91e9ffb700 1 -- 172.21.15.134:0/1917031524 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f91e40883e0 con 0x7f91f40fcfb0 2024-02-16T22:17:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.835+0000 7f91f97ea700 1 --2- 172.21.15.134:0/1917031524 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f91e00692a0 0x7f91e006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.835+0000 7f91f97ea700 1 --2- 172.21.15.134:0/1917031524 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f91e00692a0 0x7f91e006b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009b80 tx=0x7f91f000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:17.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:17.839+0000 7f91e9ffb700 1 -- 172.21.15.134:0/1917031524 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f91e4058150 con 0x7f91f40fcfb0 2024-02-16T22:17:18.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:18.035+0000 7f91fba4e700 1 -- 172.21.15.134:0/1917031524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f91f4104930 con 0x7f91f40fcfb0 2024-02-16T22:17:18.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:18.035+0000 7f91e9ffb700 1 -- 172.21.15.134:0/1917031524 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f91e4057ce0 con 0x7f91f40fcfb0 2024-02-16T22:17:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:18.038+0000 7f91fba4e700 1 -- 172.21.15.134:0/1917031524 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f91e00692a0 msgr2=0x7f91e006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:18.038+0000 7f91fba4e700 1 --2- 172.21.15.134:0/1917031524 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f91e00692a0 0x7f91e006b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009b80 tx=0x7f91f000b040 comp rx=0 tx=0).stop 2024-02-16T22:17:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:18.038+0000 7f91fba4e700 1 -- 172.21.15.134:0/1917031524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f40fcfb0 msgr2=0x7f91f410dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:18.038+0000 7f91fba4e700 1 --2- 172.21.15.134:0/1917031524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f40fcfb0 0x7f91f410dde0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f91e4000c00 tx=0x7f91e4009e30 comp rx=0 tx=0).stop 2024-02-16T22:17:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:18.039+0000 7f91fba4e700 1 -- 172.21.15.134:0/1917031524 shutdown_connections 2024-02-16T22:17:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:18.039+0000 7f91fba4e700 1 --2- 172.21.15.134:0/1917031524 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f91e00692a0 0x7f91e006b750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:18.039+0000 7f91fba4e700 1 --2- 172.21.15.134:0/1917031524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91f40fbe40 0x7f91f410d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:18.039+0000 7f91fba4e700 1 --2- 172.21.15.134:0/1917031524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f40fcfb0 0x7f91f410dde0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:18.039+0000 7f91fba4e700 1 -- 172.21.15.134:0/1917031524 >> 172.21.15.134:0/1917031524 conn(0x7f91f40f7520 msgr2=0x7f91f4065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:18.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:18.039+0000 7f91fba4e700 1 -- 172.21.15.134:0/1917031524 shutdown_connections 2024-02-16T22:17:18.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:18.039+0000 7f91fba4e700 1 -- 172.21.15.134:0/1917031524 wait complete. 2024-02-16T22:17:18.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:18 smithi134 ceph-mon[28869]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-02-16T22:17:18.728 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:18 smithi173 ceph-mon[37280]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-02-16T22:17:18.804 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-02-16T22:17:19.096 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:17:20.577 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:20 smithi134 ceph-mon[28869]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-02-16T22:17:20.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:20 smithi173 ceph-mon[37280]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-02-16T22:17:20.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.807+0000 7f0311568700 1 -- 172.21.15.134:0/2402622465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c0fcfb0 msgr2=0x7f030c0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:20.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.807+0000 7f0311568700 1 --2- 172.21.15.134:0/2402622465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c0fcfb0 0x7f030c0fd420 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0300004940 tx=0x7f0300009e30 comp rx=0 tx=0).stop 2024-02-16T22:17:20.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.807+0000 7f0311568700 1 -- 172.21.15.134:0/2402622465 shutdown_connections 2024-02-16T22:17:20.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.807+0000 7f0311568700 1 --2- 172.21.15.134:0/2402622465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c0fcfb0 0x7f030c0fd420 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:20.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.807+0000 7f0311568700 1 --2- 172.21.15.134:0/2402622465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f030c0fbe40 0x7f030c0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:20.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.807+0000 7f0311568700 1 -- 172.21.15.134:0/2402622465 >> 172.21.15.134:0/2402622465 conn(0x7f030c0f7500 msgr2=0x7f030c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:20.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.807+0000 7f0311568700 1 -- 172.21.15.134:0/2402622465 shutdown_connections 2024-02-16T22:17:20.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.807+0000 7f0311568700 1 -- 172.21.15.134:0/2402622465 wait complete. 2024-02-16T22:17:20.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.808+0000 7f0311568700 1 Processor -- start 2024-02-16T22:17:20.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.808+0000 7f0311568700 1 -- start start 2024-02-16T22:17:20.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.808+0000 7f0311568700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f030c0fbe40 0x7f030c1105a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:20.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.808+0000 7f0311568700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c0fcfb0 0x7f030c112af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:20.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.808+0000 7f0311568700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c066d10 con 0x7f030c0fcfb0 2024-02-16T22:17:20.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.808+0000 7f0311568700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c066e50 con 0x7f030c0fbe40 2024-02-16T22:17:20.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.808+0000 7f030a7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c0fcfb0 0x7f030c112af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:20.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.808+0000 7f030a7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c0fcfb0 0x7f030c112af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37258/0 (socket says 172.21.15.134:37258) 2024-02-16T22:17:20.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.808+0000 7f030a7fc700 1 -- 172.21.15.134:0/3199992644 learned_addr learned my addr 172.21.15.134:0/3199992644 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:17:20.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.808+0000 7f030affd700 1 --2- 172.21.15.134:0/3199992644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f030c0fbe40 0x7f030c1105a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:20.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.808+0000 7f030a7fc700 1 -- 172.21.15.134:0/3199992644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f030c0fbe40 msgr2=0x7f030c1105a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:20.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.808+0000 7f030a7fc700 1 --2- 172.21.15.134:0/3199992644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f030c0fbe40 0x7f030c1105a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:20.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.808+0000 7f030a7fc700 1 -- 172.21.15.134:0/3199992644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300005040 con 0x7f030c0fcfb0 2024-02-16T22:17:20.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.808+0000 7f030a7fc700 1 --2- 172.21.15.134:0/3199992644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c0fcfb0 0x7f030c112af0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0300000c00 tx=0x7f0300009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:20.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.809+0000 7f02f37fe700 1 -- 172.21.15.134:0/3199992644 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0300021070 con 0x7f030c0fcfb0 2024-02-16T22:17:20.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.809+0000 7f0311568700 1 -- 172.21.15.134:0/3199992644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030c1130f0 con 0x7f030c0fcfb0 2024-02-16T22:17:20.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.809+0000 7f02f37fe700 1 -- 172.21.15.134:0/3199992644 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f030001c400 con 0x7f030c0fcfb0 2024-02-16T22:17:20.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.809+0000 7f02f37fe700 1 -- 172.21.15.134:0/3199992644 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f030000e070 con 0x7f030c0fcfb0 2024-02-16T22:17:20.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.809+0000 7f0311568700 1 -- 172.21.15.134:0/3199992644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030c113580 con 0x7f030c0fcfb0 2024-02-16T22:17:20.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.810+0000 7f0311568700 1 -- 172.21.15.134:0/3199992644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030c04bed0 con 0x7f030c0fcfb0 2024-02-16T22:17:20.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.810+0000 7f02f37fe700 1 -- 172.21.15.134:0/3199992644 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f030001ca50 con 0x7f030c0fcfb0 2024-02-16T22:17:20.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.810+0000 7f02f37fe700 1 --2- 172.21.15.134:0/3199992644 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f02f40692a0 0x7f02f406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:17:20.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.810+0000 7f02f37fe700 1 -- 172.21.15.134:0/3199992644 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f03000883e0 con 0x7f030c0fcfb0 2024-02-16T22:17:20.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.810+0000 7f030affd700 1 --2- 172.21.15.134:0/3199992644 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f02f40692a0 0x7f02f406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:17:20.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.811+0000 7f030affd700 1 --2- 172.21.15.134:0/3199992644 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f02f40692a0 0x7f02f406b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f030c066990 tx=0x7f02fc00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:17:20.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:20.815+0000 7f02f37fe700 1 -- 172.21.15.134:0/3199992644 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f03000546c0 con 0x7f030c0fcfb0 2024-02-16T22:17:21.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:21.024+0000 7f0311568700 1 -- 172.21.15.134:0/3199992644 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f030c101a40 con 0x7f02f40692a0 2024-02-16T22:17:22.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:22 smithi134 ceph-mon[28869]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-16T22:17:22.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:22 smithi134 ceph-mon[28869]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:17:22.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:22 smithi173 ceph-mon[37280]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-16T22:17:22.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:22 smithi173 ceph-mon[37280]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:17:24.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:24 smithi134 ceph-mon[28869]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-16T22:17:24.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:24 smithi173 ceph-mon[37280]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-16T22:17:26.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:26 smithi134 ceph-mon[28869]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-16T22:17:26.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:26 smithi173 ceph-mon[37280]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-16T22:17:27.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:27 smithi134 ceph-mon[28869]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-16T22:17:27.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:27 smithi173 ceph-mon[37280]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-16T22:17:28.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:28 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:17:28.980 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:28 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:17:29.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:29 smithi134 ceph-mon[28869]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-16T22:17:29.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:29 smithi173 ceph-mon[37280]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-16T22:17:32.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:32 smithi134 ceph-mon[28869]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:17:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:32 smithi173 ceph-mon[37280]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:17:34.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:34 smithi134 ceph-mon[28869]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:17:34.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:34 smithi173 ceph-mon[37280]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:17:36.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:36 smithi134 ceph-mon[28869]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:17:36.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:36 smithi173 ceph-mon[37280]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:17:38.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:38 smithi134 ceph-mon[28869]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:17:38.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:38 smithi173 ceph-mon[37280]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:17:39.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:39 smithi134 ceph-mon[28869]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:17:39.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:39 smithi173 ceph-mon[37280]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:17:42.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:42 smithi134 ceph-mon[28869]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:17:42.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:42 smithi173 ceph-mon[37280]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:17:43.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:17:43.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:43 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:17:44.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:44 smithi134 ceph-mon[28869]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:17:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:44 smithi173 ceph-mon[37280]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:17:45.811 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:45 smithi173 ceph-mon[37280]: pgmap v215: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:17:45.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:45 smithi134 ceph-mon[28869]: pgmap v215: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:17:47.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:47.829+0000 7f02f37fe700 1 -- 172.21.15.134:0/3199992644 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f030c101a40 con 0x7f02f40692a0 2024-02-16T22:17:47.831 INFO:teuthology.orchestra.run.smithi134.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:17:47.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:47.831+0000 7f0311568700 1 -- 172.21.15.134:0/3199992644 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f02f40692a0 msgr2=0x7f02f406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:47.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:47.831+0000 7f0311568700 1 --2- 172.21.15.134:0/3199992644 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f02f40692a0 0x7f02f406b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f030c066990 tx=0x7f02fc00b040 comp rx=0 tx=0).stop 2024-02-16T22:17:47.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:47.831+0000 7f0311568700 1 -- 172.21.15.134:0/3199992644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c0fcfb0 msgr2=0x7f030c112af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:17:47.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:47.831+0000 7f0311568700 1 --2- 172.21.15.134:0/3199992644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c0fcfb0 0x7f030c112af0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0300000c00 tx=0x7f0300009e30 comp rx=0 tx=0).stop 2024-02-16T22:17:47.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:47.831+0000 7f0311568700 1 -- 172.21.15.134:0/3199992644 shutdown_connections 2024-02-16T22:17:47.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:47.831+0000 7f0311568700 1 --2- 172.21.15.134:0/3199992644 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f02f40692a0 0x7f02f406b750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:47.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:47.831+0000 7f0311568700 1 --2- 172.21.15.134:0/3199992644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f030c0fbe40 0x7f030c1105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:47.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:47.831+0000 7f0311568700 1 --2- 172.21.15.134:0/3199992644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f030c0fcfb0 0x7f030c112af0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:17:47.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:47.831+0000 7f0311568700 1 -- 172.21.15.134:0/3199992644 >> 172.21.15.134:0/3199992644 conn(0x7f030c0f7500 msgr2=0x7f030c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:17:47.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:47.831+0000 7f0311568700 1 -- 172.21.15.134:0/3199992644 shutdown_connections 2024-02-16T22:17:47.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:17:47.832+0000 7f0311568700 1 -- 172.21.15.134:0/3199992644 wait complete. 2024-02-16T22:17:48.625 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-16T22:17:48.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:48 smithi134 ceph-mon[28869]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:17:48.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:48 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:17:48.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:48 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:17:48.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:48 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:17:48.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:48 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:17:48.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:48 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:17:48.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:48 smithi173 ceph-mon[37280]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:17:48.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:48 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:17:48.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:48 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:17:48.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:48 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:17:48.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:48 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:17:48.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:48 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:17:48.920 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:17:49.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:49 smithi134 ceph-mon[28869]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:17:49.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:49 smithi134 ceph-mon[28869]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:17:49.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:49 smithi173 ceph-mon[37280]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:17:49.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:49 smithi173 ceph-mon[37280]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:17:50.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:50 smithi134 ceph-mon[28869]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-16T22:17:50.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:50 smithi173 ceph-mon[37280]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-16T22:17:52.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:52 smithi134 ceph-mon[28869]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-16T22:17:52.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:52 smithi173 ceph-mon[37280]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-16T22:17:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:54 smithi134 ceph-mon[28869]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-16T22:17:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:54 smithi173 ceph-mon[37280]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-16T22:17:56.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:56 smithi134 ceph-mon[28869]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-16T22:17:56.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:56 smithi173 ceph-mon[37280]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-16T22:17:57.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:57 smithi134 ceph-mon[28869]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-16T22:17:57.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:57 smithi173 ceph-mon[37280]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-16T22:17:58.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:58 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:17:58.980 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:58 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:17:59.958 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:17:59 smithi134 ceph-mon[28869]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-16T22:17:59.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:17:59 smithi173 ceph-mon[37280]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-16T22:18:00.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.370+0000 7f4e8a814700 1 -- 172.21.15.134:0/1384585078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e840fcfb0 msgr2=0x7f4e840fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:00.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.370+0000 7f4e8a814700 1 --2- 172.21.15.134:0/1384585078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e840fcfb0 0x7f4e840fd420 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4e78004940 tx=0x7f4e78009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:00.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.370+0000 7f4e8a814700 1 -- 172.21.15.134:0/1384585078 shutdown_connections 2024-02-16T22:18:00.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.370+0000 7f4e8a814700 1 --2- 172.21.15.134:0/1384585078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e840fcfb0 0x7f4e840fd420 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:00.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.370+0000 7f4e8a814700 1 --2- 172.21.15.134:0/1384585078 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e840fbe40 0x7f4e840fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:00.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.370+0000 7f4e8a814700 1 -- 172.21.15.134:0/1384585078 >> 172.21.15.134:0/1384585078 conn(0x7f4e840f7500 msgr2=0x7f4e840f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:00.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.370+0000 7f4e8a814700 1 -- 172.21.15.134:0/1384585078 shutdown_connections 2024-02-16T22:18:00.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.370+0000 7f4e8a814700 1 -- 172.21.15.134:0/1384585078 wait complete. 2024-02-16T22:18:00.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.371+0000 7f4e8a814700 1 Processor -- start 2024-02-16T22:18:00.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.371+0000 7f4e8a814700 1 -- start start 2024-02-16T22:18:00.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.371+0000 7f4e8a814700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e840fbe40 0x7f4e8406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:00.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.371+0000 7f4e8a814700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e840fcfb0 0x7f4e8406f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:00.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.371+0000 7f4e8a814700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8406fb50 con 0x7f4e840fcfb0 2024-02-16T22:18:00.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.371+0000 7f4e8a814700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e84116490 con 0x7f4e840fbe40 2024-02-16T22:18:00.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.371+0000 7f4e837fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e840fcfb0 0x7f4e8406f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:00.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.371+0000 7f4e83fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e840fbe40 0x7f4e8406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:00.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.371+0000 7f4e837fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e840fcfb0 0x7f4e8406f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41826/0 (socket says 172.21.15.134:41826) 2024-02-16T22:18:00.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.371+0000 7f4e837fe700 1 -- 172.21.15.134:0/885991609 learned_addr learned my addr 172.21.15.134:0/885991609 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:18:00.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.372+0000 7f4e837fe700 1 -- 172.21.15.134:0/885991609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e840fbe40 msgr2=0x7f4e8406efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:00.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.372+0000 7f4e837fe700 1 --2- 172.21.15.134:0/885991609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e840fbe40 0x7f4e8406efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:00.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.372+0000 7f4e837fe700 1 -- 172.21.15.134:0/885991609 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e78005040 con 0x7f4e840fcfb0 2024-02-16T22:18:00.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.372+0000 7f4e837fe700 1 --2- 172.21.15.134:0/885991609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e840fcfb0 0x7f4e8406f500 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4e780093b0 tx=0x7f4e78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:00.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.372+0000 7f4e80ff9700 1 -- 172.21.15.134:0/885991609 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e7800e040 con 0x7f4e840fcfb0 2024-02-16T22:18:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.372+0000 7f4e80ff9700 1 -- 172.21.15.134:0/885991609 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e7800bcc0 con 0x7f4e840fcfb0 2024-02-16T22:18:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.372+0000 7f4e8a814700 1 -- 172.21.15.134:0/885991609 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e84116690 con 0x7f4e840fcfb0 2024-02-16T22:18:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.372+0000 7f4e80ff9700 1 -- 172.21.15.134:0/885991609 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e7801c630 con 0x7f4e840fcfb0 2024-02-16T22:18:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.372+0000 7f4e8a814700 1 -- 172.21.15.134:0/885991609 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e84116ba0 con 0x7f4e840fcfb0 2024-02-16T22:18:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.374+0000 7f4e8a814700 1 -- 172.21.15.134:0/885991609 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8404bed0 con 0x7f4e840fcfb0 2024-02-16T22:18:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.374+0000 7f4e80ff9700 1 -- 172.21.15.134:0/885991609 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f4e78013980 con 0x7f4e840fcfb0 2024-02-16T22:18:00.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.375+0000 7f4e80ff9700 1 --2- 172.21.15.134:0/885991609 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f4e6c0692a0 0x7f4e6c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:00.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.375+0000 7f4e80ff9700 1 -- 172.21.15.134:0/885991609 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4e780886f0 con 0x7f4e840fcfb0 2024-02-16T22:18:00.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.375+0000 7f4e83fff700 1 --2- 172.21.15.134:0/885991609 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f4e6c0692a0 0x7f4e6c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:00.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.376+0000 7f4e83fff700 1 --2- 172.21.15.134:0/885991609 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f4e6c0692a0 0x7f4e6c06b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4e8406ed50 tx=0x7f4e74011040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:00.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.383+0000 7f4e80ff9700 1 -- 172.21.15.134:0/885991609 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4e78054a70 con 0x7f4e840fcfb0 2024-02-16T22:18:00.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.596+0000 7f4e8a814700 1 -- 172.21.15.134:0/885991609 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e841170f0 con 0x7f4e6c0692a0 2024-02-16T22:18:00.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.597+0000 7f4e80ff9700 1 -- 172.21.15.134:0/885991609 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f4e841170f0 con 0x7f4e6c0692a0 2024-02-16T22:18:00.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.600+0000 7f4e8a814700 1 -- 172.21.15.134:0/885991609 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f4e6c0692a0 msgr2=0x7f4e6c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:00.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.600+0000 7f4e8a814700 1 --2- 172.21.15.134:0/885991609 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f4e6c0692a0 0x7f4e6c06b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4e8406ed50 tx=0x7f4e74011040 comp rx=0 tx=0).stop 2024-02-16T22:18:00.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.600+0000 7f4e8a814700 1 -- 172.21.15.134:0/885991609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e840fcfb0 msgr2=0x7f4e8406f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:00.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.600+0000 7f4e8a814700 1 --2- 172.21.15.134:0/885991609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e840fcfb0 0x7f4e8406f500 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4e780093b0 tx=0x7f4e78009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:00.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.600+0000 7f4e8a814700 1 -- 172.21.15.134:0/885991609 shutdown_connections 2024-02-16T22:18:00.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.600+0000 7f4e8a814700 1 --2- 172.21.15.134:0/885991609 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f4e6c0692a0 0x7f4e6c06b750 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:00.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.600+0000 7f4e8a814700 1 --2- 172.21.15.134:0/885991609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e840fbe40 0x7f4e8406efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:00.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.600+0000 7f4e8a814700 1 --2- 172.21.15.134:0/885991609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e840fcfb0 0x7f4e8406f500 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:00.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.600+0000 7f4e8a814700 1 -- 172.21.15.134:0/885991609 >> 172.21.15.134:0/885991609 conn(0x7f4e840f7500 msgr2=0x7f4e84100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:00.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.600+0000 7f4e8a814700 1 -- 172.21.15.134:0/885991609 shutdown_connections 2024-02-16T22:18:00.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.600+0000 7f4e8a814700 1 -- 172.21.15.134:0/885991609 wait complete. 2024-02-16T22:18:00.612 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:18:00.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.705+0000 7fd7bb974700 1 -- 172.21.15.134:0/3297427203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7b40fda80 msgr2=0x7fd7b40ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:00.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.705+0000 7fd7bb974700 1 --2- 172.21.15.134:0/3297427203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7b40fda80 0x7fd7b40ffe60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0004940 tx=0x7fd7b0009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:00.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.705+0000 7fd7bb974700 1 -- 172.21.15.134:0/3297427203 shutdown_connections 2024-02-16T22:18:00.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.705+0000 7fd7bb974700 1 --2- 172.21.15.134:0/3297427203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7b41003a0 0x7fd7b4102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:00.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.705+0000 7fd7bb974700 1 --2- 172.21.15.134:0/3297427203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7b40fda80 0x7fd7b40ffe60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:00.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.705+0000 7fd7bb974700 1 -- 172.21.15.134:0/3297427203 >> 172.21.15.134:0/3297427203 conn(0x7fd7b40f74e0 msgr2=0x7fd7b40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:00.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.705+0000 7fd7bb974700 1 -- 172.21.15.134:0/3297427203 shutdown_connections 2024-02-16T22:18:00.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.705+0000 7fd7bb974700 1 -- 172.21.15.134:0/3297427203 wait complete. 2024-02-16T22:18:00.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.706+0000 7fd7bb974700 1 Processor -- start 2024-02-16T22:18:00.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.706+0000 7fd7bb974700 1 -- start start 2024-02-16T22:18:00.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.706+0000 7fd7bb974700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7b40fda80 0x7fd7b410d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:00.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.706+0000 7fd7bb974700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7b41003a0 0x7fd7b410de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:00.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.706+0000 7fd7bb974700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b410e400 con 0x7fd7b41003a0 2024-02-16T22:18:00.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.706+0000 7fd7bb974700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b410eca0 con 0x7fd7b40fda80 2024-02-16T22:18:00.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.706+0000 7fd7b9710700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7b40fda80 0x7fd7b410d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:00.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.706+0000 7fd7b8f0f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7b41003a0 0x7fd7b410de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:00.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.706+0000 7fd7b9710700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7b40fda80 0x7fd7b410d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.134:38164/0 (socket says 172.21.15.134:38164) 2024-02-16T22:18:00.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.706+0000 7fd7b9710700 1 -- 172.21.15.134:0/1821592231 learned_addr learned my addr 172.21.15.134:0/1821592231 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:18:00.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.707+0000 7fd7b8f0f700 1 -- 172.21.15.134:0/1821592231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7b40fda80 msgr2=0x7fd7b410d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:00.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.707+0000 7fd7b8f0f700 1 --2- 172.21.15.134:0/1821592231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7b40fda80 0x7fd7b410d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:00.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.707+0000 7fd7b8f0f700 1 -- 172.21.15.134:0/1821592231 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b0005040 con 0x7fd7b41003a0 2024-02-16T22:18:00.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.707+0000 7fd7b9710700 1 --2- 172.21.15.134:0/1821592231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7b40fda80 0x7fd7b410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:18:00.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.707+0000 7fd7b8f0f700 1 --2- 172.21.15.134:0/1821592231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7b41003a0 0x7fd7b410de00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009fd0 tx=0x7fd7a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:00.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.707+0000 7fd7a9ffb700 1 -- 172.21.15.134:0/1821592231 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7a4004e90 con 0x7fd7b41003a0 2024-02-16T22:18:00.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.707+0000 7fd7a9ffb700 1 -- 172.21.15.134:0/1821592231 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7a400f040 con 0x7fd7b41003a0 2024-02-16T22:18:00.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.707+0000 7fd7bb974700 1 -- 172.21.15.134:0/1821592231 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b410ef20 con 0x7fd7b41003a0 2024-02-16T22:18:00.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.708+0000 7fd7bb974700 1 -- 172.21.15.134:0/1821592231 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b410f460 con 0x7fd7b41003a0 2024-02-16T22:18:00.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.709+0000 7fd7a9ffb700 1 -- 172.21.15.134:0/1821592231 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7a400ca50 con 0x7fd7b41003a0 2024-02-16T22:18:00.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.709+0000 7fd7a9ffb700 1 -- 172.21.15.134:0/1821592231 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd7a400cbb0 con 0x7fd7b41003a0 2024-02-16T22:18:00.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.710+0000 7fd7a9ffb700 1 --2- 172.21.15.134:0/1821592231 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd7a00690a0 0x7fd7a006b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:00.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.710+0000 7fd7a9ffb700 1 -- 172.21.15.134:0/1821592231 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd7a4086bc0 con 0x7fd7b41003a0 2024-02-16T22:18:00.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.710+0000 7fd7bb974700 1 -- 172.21.15.134:0/1821592231 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b4107a50 con 0x7fd7b41003a0 2024-02-16T22:18:00.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.710+0000 7fd7b9710700 1 --2- 172.21.15.134:0/1821592231 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd7a00690a0 0x7fd7a006b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:00.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.711+0000 7fd7b9710700 1 --2- 172.21.15.134:0/1821592231 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd7a00690a0 0x7fd7a006b550 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00137b0 tx=0x7fd7b0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:00.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:00.715+0000 7fd7a9ffb700 1 -- 172.21.15.134:0/1821592231 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd7a404dbd0 con 0x7fd7b41003a0 2024-02-16T22:18:01.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.000+0000 7fd7bb974700 1 -- 172.21.15.134:0/1821592231 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7b410f6d0 con 0x7fd7a00690a0 2024-02-16T22:18:01.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.002+0000 7fd7a9ffb700 1 -- 172.21.15.134:0/1821592231 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7fd7b410f6d0 con 0x7fd7a00690a0 2024-02-16T22:18:01.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.004+0000 7fd7bb974700 1 -- 172.21.15.134:0/1821592231 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd7a00690a0 msgr2=0x7fd7a006b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:01.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.004+0000 7fd7bb974700 1 --2- 172.21.15.134:0/1821592231 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd7a00690a0 0x7fd7a006b550 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00137b0 tx=0x7fd7b0009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:01.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.004+0000 7fd7bb974700 1 -- 172.21.15.134:0/1821592231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7b41003a0 msgr2=0x7fd7b410de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:01.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.004+0000 7fd7bb974700 1 --2- 172.21.15.134:0/1821592231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7b41003a0 0x7fd7b410de00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009fd0 tx=0x7fd7a400b040 comp rx=0 tx=0).stop 2024-02-16T22:18:01.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.005+0000 7fd7bb974700 1 -- 172.21.15.134:0/1821592231 shutdown_connections 2024-02-16T22:18:01.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.005+0000 7fd7bb974700 1 --2- 172.21.15.134:0/1821592231 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fd7a00690a0 0x7fd7a006b550 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.005+0000 7fd7bb974700 1 --2- 172.21.15.134:0/1821592231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7b40fda80 0x7fd7b410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.005+0000 7fd7bb974700 1 --2- 172.21.15.134:0/1821592231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7b41003a0 0x7fd7b410de00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.005+0000 7fd7bb974700 1 -- 172.21.15.134:0/1821592231 >> 172.21.15.134:0/1821592231 conn(0x7fd7b40f74e0 msgr2=0x7fd7b40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:01.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.005+0000 7fd7bb974700 1 -- 172.21.15.134:0/1821592231 shutdown_connections 2024-02-16T22:18:01.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.005+0000 7fd7bb974700 1 -- 172.21.15.134:0/1821592231 wait complete. 2024-02-16T22:18:01.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.114+0000 7f87c9304700 1 -- 172.21.15.134:0/2465097915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c40fe0e0 msgr2=0x7f87c40fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:01.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.114+0000 7f87c9304700 1 --2- 172.21.15.134:0/2465097915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c40fe0e0 0x7f87c40fe550 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f87b8004940 tx=0x7f87b8009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:01.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.114+0000 7f87c9304700 1 -- 172.21.15.134:0/2465097915 shutdown_connections 2024-02-16T22:18:01.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.114+0000 7f87c9304700 1 --2- 172.21.15.134:0/2465097915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c40fe0e0 0x7f87c40fe550 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.114+0000 7f87c9304700 1 --2- 172.21.15.134:0/2465097915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87c40fcef0 0x7f87c40fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.114+0000 7f87c9304700 1 -- 172.21.15.134:0/2465097915 >> 172.21.15.134:0/2465097915 conn(0x7f87c40f8620 msgr2=0x7f87c40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:01.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.114+0000 7f87c9304700 1 -- 172.21.15.134:0/2465097915 shutdown_connections 2024-02-16T22:18:01.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.114+0000 7f87c9304700 1 -- 172.21.15.134:0/2465097915 wait complete. 2024-02-16T22:18:01.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.115+0000 7f87c9304700 1 Processor -- start 2024-02-16T22:18:01.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.115+0000 7f87c9304700 1 -- start start 2024-02-16T22:18:01.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.116+0000 7f87c9304700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c40fcef0 0x7f87c4071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:01.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.116+0000 7f87c9304700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87c40fe0e0 0x7f87c40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:01.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.116+0000 7f87c9304700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c4111670 con 0x7f87c40fcef0 2024-02-16T22:18:01.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.116+0000 7f87c9304700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c41117e0 con 0x7f87c40fe0e0 2024-02-16T22:18:01.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.116+0000 7f87c2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c40fcef0 0x7f87c4071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:01.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.116+0000 7f87c2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c40fcef0 0x7f87c4071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41848/0 (socket says 172.21.15.134:41848) 2024-02-16T22:18:01.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.116+0000 7f87c2ffd700 1 -- 172.21.15.134:0/1085296185 learned_addr learned my addr 172.21.15.134:0/1085296185 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:18:01.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.116+0000 7f87c27fc700 1 --2- 172.21.15.134:0/1085296185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87c40fe0e0 0x7f87c40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:01.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.116+0000 7f87c2ffd700 1 -- 172.21.15.134:0/1085296185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87c40fe0e0 msgr2=0x7f87c40702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:01.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.116+0000 7f87c2ffd700 1 --2- 172.21.15.134:0/1085296185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87c40fe0e0 0x7f87c40702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.116+0000 7f87c2ffd700 1 -- 172.21.15.134:0/1085296185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8005040 con 0x7f87c40fcef0 2024-02-16T22:18:01.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.116+0000 7f87c27fc700 1 --2- 172.21.15.134:0/1085296185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87c40fe0e0 0x7f87c40702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:18:01.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.117+0000 7f87c2ffd700 1 --2- 172.21.15.134:0/1085296185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c40fcef0 0x7f87c4071e60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f87b4002a80 tx=0x7f87b4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:01.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.117+0000 7f87ab7fe700 1 -- 172.21.15.134:0/1085296185 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87b4007cc0 con 0x7f87c40fcef0 2024-02-16T22:18:01.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.117+0000 7f87ab7fe700 1 -- 172.21.15.134:0/1085296185 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f87b400f040 con 0x7f87c40fcef0 2024-02-16T22:18:01.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.117+0000 7f87ab7fe700 1 -- 172.21.15.134:0/1085296185 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87b400da30 con 0x7f87c40fcef0 2024-02-16T22:18:01.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.117+0000 7f87c9304700 1 -- 172.21.15.134:0/1085296185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c4070940 con 0x7f87c40fcef0 2024-02-16T22:18:01.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.117+0000 7f87c9304700 1 -- 172.21.15.134:0/1085296185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c4070e80 con 0x7f87c40fcef0 2024-02-16T22:18:01.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.118+0000 7f87c9304700 1 -- 172.21.15.134:0/1085296185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c404bed0 con 0x7f87c40fcef0 2024-02-16T22:18:01.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.119+0000 7f87ab7fe700 1 -- 172.21.15.134:0/1085296185 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f87b400db90 con 0x7f87c40fcef0 2024-02-16T22:18:01.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.119+0000 7f87ab7fe700 1 --2- 172.21.15.134:0/1085296185 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f87ac0692a0 0x7f87ac06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:01.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.119+0000 7f87ab7fe700 1 -- 172.21.15.134:0/1085296185 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f87b4086ec0 con 0x7f87c40fcef0 2024-02-16T22:18:01.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.120+0000 7f87c27fc700 1 --2- 172.21.15.134:0/1085296185 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f87ac0692a0 0x7f87ac06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:01.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.121+0000 7f87c27fc700 1 --2- 172.21.15.134:0/1085296185 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f87ac0692a0 0x7f87ac06b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f87b800b3b0 tx=0x7f87b8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:01.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.123+0000 7f87ab7fe700 1 -- 172.21.15.134:0/1085296185 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f87b4056c30 con 0x7f87c40fcef0 2024-02-16T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.412+0000 7f87c9304700 1 -- 172.21.15.134:0/1085296185 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f87c4102ac0 con 0x7f87ac0692a0 2024-02-16T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.422+0000 7f87ab7fe700 1 -- 172.21.15.134:0/1085296185 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f87c4102ac0 con 0x7f87ac0692a0 2024-02-16T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (5m) 62s ago 6m 24.8M - 0.25.0 c8568f914cd2 62f86e3efbe2 2024-02-16T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (7m) 62s ago 7m 6660k - 17.2.7-513-gb88fae66 870a0944ccb8 a0d53bc0a925 2024-02-16T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (6m) 68s ago 6m 6669k - 17.2.7-513-gb88fae66 870a0944ccb8 a8d69537e08a 2024-02-16T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (5m) 62s ago 6m 87.8M - 9.4.7 954c08fa6188 67572f26488e 2024-02-16T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (86s) 62s ago 85s 10.4M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (79s) 62s ago 79s 15.6M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (77s) 68s ago 76s 13.5M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (83s) 68s ago 82s 16.7M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:9283 running (8m) 62s ago 8m 480M - 17.2.7-513-gb88fae66 870a0944ccb8 52095085178d 2024-02-16T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283 running (5m) 68s ago 5m 435M - 17.2.7-513-gb88fae66 870a0944ccb8 f405e50edb6b 2024-02-16T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (8m) 62s ago 8m 44.9M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 93a679740d93 2024-02-16T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (5m) 68s ago 5m 35.7M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 cfbef35950ef 2024-02-16T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 62s ago 7m 15.9M - 1.5.0 0da6a335fe13 7e7604241558 2024-02-16T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (5m) 68s ago 5m 15.7M - 1.5.0 0da6a335fe13 cddf6bc3c421 2024-02-16T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (5m) 62s ago 5m 44.7M 4288M 17.2.7-513-gb88fae66 870a0944ccb8 099f0b29d202 2024-02-16T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (4m) 62s ago 4m 48.4M 4288M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (4m) 62s ago 4m 44.4M 4288M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (3m) 68s ago 3m 44.0M 5312M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (3m) 68s ago 3m 43.9M 5312M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (2m) 68s ago 2m 41.3M 5312M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 62s ago 6m 54.3M - 2.43.0 a07b618ecd1d 37e529bd9229 2024-02-16T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.425+0000 7f87c9304700 1 -- 172.21.15.134:0/1085296185 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f87ac0692a0 msgr2=0x7f87ac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.425+0000 7f87c9304700 1 --2- 172.21.15.134:0/1085296185 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f87ac0692a0 0x7f87ac06b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f87b800b3b0 tx=0x7f87b8009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.425+0000 7f87c9304700 1 -- 172.21.15.134:0/1085296185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c40fcef0 msgr2=0x7f87c4071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.425+0000 7f87c9304700 1 --2- 172.21.15.134:0/1085296185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c40fcef0 0x7f87c4071e60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f87b4002a80 tx=0x7f87b4004600 comp rx=0 tx=0).stop 2024-02-16T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.425+0000 7f87c9304700 1 -- 172.21.15.134:0/1085296185 shutdown_connections 2024-02-16T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.425+0000 7f87c9304700 1 --2- 172.21.15.134:0/1085296185 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f87ac0692a0 0x7f87ac06b750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.425+0000 7f87c9304700 1 --2- 172.21.15.134:0/1085296185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c40fcef0 0x7f87c4071e60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.425+0000 7f87c9304700 1 --2- 172.21.15.134:0/1085296185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87c40fe0e0 0x7f87c40702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.425+0000 7f87c9304700 1 -- 172.21.15.134:0/1085296185 >> 172.21.15.134:0/1085296185 conn(0x7f87c40f8620 msgr2=0x7f87c41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.425+0000 7f87c9304700 1 -- 172.21.15.134:0/1085296185 shutdown_connections 2024-02-16T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.425+0000 7f87c9304700 1 -- 172.21.15.134:0/1085296185 wait complete. 2024-02-16T22:18:01.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.536+0000 7f2d3a118700 1 -- 172.21.15.134:0/4080744088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340fe0e0 msgr2=0x7f2d340fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:01.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.536+0000 7f2d3a118700 1 --2- 172.21.15.134:0/4080744088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340fe0e0 0x7f2d340fe550 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2d28004940 tx=0x7f2d28009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:01.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.536+0000 7f2d3a118700 1 -- 172.21.15.134:0/4080744088 shutdown_connections 2024-02-16T22:18:01.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.536+0000 7f2d3a118700 1 --2- 172.21.15.134:0/4080744088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340fe0e0 0x7f2d340fe550 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.536+0000 7f2d3a118700 1 --2- 172.21.15.134:0/4080744088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d340fcef0 0x7f2d340fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.536+0000 7f2d3a118700 1 -- 172.21.15.134:0/4080744088 >> 172.21.15.134:0/4080744088 conn(0x7f2d340f8620 msgr2=0x7f2d340faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:01.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.536+0000 7f2d3a118700 1 -- 172.21.15.134:0/4080744088 shutdown_connections 2024-02-16T22:18:01.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.536+0000 7f2d3a118700 1 -- 172.21.15.134:0/4080744088 wait complete. 2024-02-16T22:18:01.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.536+0000 7f2d3a118700 1 Processor -- start 2024-02-16T22:18:01.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.537+0000 7f2d3a118700 1 -- start start 2024-02-16T22:18:01.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.537+0000 7f2d3a118700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340fcef0 0x7f2d3410d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:01.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.537+0000 7f2d3a118700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d340fe0e0 0x7f2d3410de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:01.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.537+0000 7f2d3a118700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3410e430 con 0x7f2d340fcef0 2024-02-16T22:18:01.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.537+0000 7f2d3a118700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3410ecd0 con 0x7f2d340fe0e0 2024-02-16T22:18:01.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.537+0000 7f2d337fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340fcef0 0x7f2d3410d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:01.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.537+0000 7f2d337fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340fcef0 0x7f2d3410d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35788/0 (socket says 172.21.15.134:35788) 2024-02-16T22:18:01.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.537+0000 7f2d337fe700 1 -- 172.21.15.134:0/2832599377 learned_addr learned my addr 172.21.15.134:0/2832599377 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:18:01.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.537+0000 7f2d32ffd700 1 --2- 172.21.15.134:0/2832599377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d340fe0e0 0x7f2d3410de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:01.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.537+0000 7f2d337fe700 1 -- 172.21.15.134:0/2832599377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d340fe0e0 msgr2=0x7f2d3410de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:01.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.537+0000 7f2d337fe700 1 --2- 172.21.15.134:0/2832599377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d340fe0e0 0x7f2d3410de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.537+0000 7f2d337fe700 1 -- 172.21.15.134:0/2832599377 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28005040 con 0x7f2d340fcef0 2024-02-16T22:18:01.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.538+0000 7f2d337fe700 1 --2- 172.21.15.134:0/2832599377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340fcef0 0x7f2d3410d8f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2d24002a80 tx=0x7f2d240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:01.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.538+0000 7f2d1bfff700 1 -- 172.21.15.134:0/2832599377 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d24007cc0 con 0x7f2d340fcef0 2024-02-16T22:18:01.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.538+0000 7f2d1bfff700 1 -- 172.21.15.134:0/2832599377 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d2400f040 con 0x7f2d340fcef0 2024-02-16T22:18:01.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.538+0000 7f2d1bfff700 1 -- 172.21.15.134:0/2832599377 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d2400db30 con 0x7f2d340fcef0 2024-02-16T22:18:01.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.538+0000 7f2d3a118700 1 -- 172.21.15.134:0/2832599377 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3410efb0 con 0x7f2d340fcef0 2024-02-16T22:18:01.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.538+0000 7f2d3a118700 1 -- 172.21.15.134:0/2832599377 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3410f4f0 con 0x7f2d340fcef0 2024-02-16T22:18:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.539+0000 7f2d3a118700 1 -- 172.21.15.134:0/2832599377 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3404bed0 con 0x7f2d340fcef0 2024-02-16T22:18:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.540+0000 7f2d1bfff700 1 -- 172.21.15.134:0/2832599377 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f2d2400dc90 con 0x7f2d340fcef0 2024-02-16T22:18:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.540+0000 7f2d1bfff700 1 --2- 172.21.15.134:0/2832599377 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2d1c0692a0 0x7f2d1c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.541+0000 7f2d1bfff700 1 -- 172.21.15.134:0/2832599377 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2d240868f0 con 0x7f2d340fcef0 2024-02-16T22:18:01.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.541+0000 7f2d32ffd700 1 --2- 172.21.15.134:0/2832599377 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2d1c0692a0 0x7f2d1c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:01.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.541+0000 7f2d32ffd700 1 --2- 172.21.15.134:0/2832599377 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2d1c0692a0 0x7f2d1c06b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800b3b0 tx=0x7f2d28009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:01.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.548+0000 7f2d1bfff700 1 -- 172.21.15.134:0/2832599377 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f2d2404cbd0 con 0x7f2d340fcef0 2024-02-16T22:18:01.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.910+0000 7f2d3a118700 1 -- 172.21.15.134:0/2832599377 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2d34113f10 con 0x7f2d340fcef0 2024-02-16T22:18:01.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.911+0000 7f2d1bfff700 1 -- 172.21.15.134:0/2832599377 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f2d24056660 con 0x7f2d340fcef0 2024-02-16T22:18:01.913 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:18:01.913 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:18:01.913 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 2 2024-02-16T22:18:01.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:18:01.914 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:18:01.914 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 2 2024-02-16T22:18:01.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:18:01.914 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:18:01.914 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 6 2024-02-16T22:18:01.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:18:01.914 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:18:01.914 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:18:01.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:18:01.914 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:18:01.914 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 14 2024-02-16T22:18:01.914 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:18:01.914 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:18:01.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.913+0000 7f2d3a118700 1 -- 172.21.15.134:0/2832599377 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2d1c0692a0 msgr2=0x7f2d1c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:01.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.913+0000 7f2d3a118700 1 --2- 172.21.15.134:0/2832599377 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2d1c0692a0 0x7f2d1c06b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800b3b0 tx=0x7f2d28009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:01.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.913+0000 7f2d3a118700 1 -- 172.21.15.134:0/2832599377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340fcef0 msgr2=0x7f2d3410d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:01.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.913+0000 7f2d3a118700 1 --2- 172.21.15.134:0/2832599377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340fcef0 0x7f2d3410d8f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2d24002a80 tx=0x7f2d240046b0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.913+0000 7f2d3a118700 1 -- 172.21.15.134:0/2832599377 shutdown_connections 2024-02-16T22:18:01.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.913+0000 7f2d3a118700 1 --2- 172.21.15.134:0/2832599377 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f2d1c0692a0 0x7f2d1c06b750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.913+0000 7f2d3a118700 1 --2- 172.21.15.134:0/2832599377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340fcef0 0x7f2d3410d8f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.913+0000 7f2d3a118700 1 --2- 172.21.15.134:0/2832599377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d340fe0e0 0x7f2d3410de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:01.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.913+0000 7f2d3a118700 1 -- 172.21.15.134:0/2832599377 >> 172.21.15.134:0/2832599377 conn(0x7f2d340f8620 msgr2=0x7f2d341013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:01.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.914+0000 7f2d3a118700 1 -- 172.21.15.134:0/2832599377 shutdown_connections 2024-02-16T22:18:01.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:01.914+0000 7f2d3a118700 1 -- 172.21.15.134:0/2832599377 wait complete. 2024-02-16T22:18:02.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.019+0000 7f87596cd700 1 -- 172.21.15.134:0/3844317119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87540663a0 msgr2=0x7f87540ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:02.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.019+0000 7f87596cd700 1 --2- 172.21.15.134:0/3844317119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87540663a0 0x7f87540ffb30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8744004940 tx=0x7f8744009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:02.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.019+0000 7f87596cd700 1 -- 172.21.15.134:0/3844317119 shutdown_connections 2024-02-16T22:18:02.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.019+0000 7f87596cd700 1 --2- 172.21.15.134:0/3844317119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8754100100 0x7f8754102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:02.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.019+0000 7f87596cd700 1 --2- 172.21.15.134:0/3844317119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87540663a0 0x7f87540ffb30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:02.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.019+0000 7f87596cd700 1 -- 172.21.15.134:0/3844317119 >> 172.21.15.134:0/3844317119 conn(0x7f87540f74e0 msgr2=0x7f87540f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:02.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.019+0000 7f87596cd700 1 -- 172.21.15.134:0/3844317119 shutdown_connections 2024-02-16T22:18:02.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.019+0000 7f87596cd700 1 -- 172.21.15.134:0/3844317119 wait complete. 2024-02-16T22:18:02.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.020+0000 7f87596cd700 1 Processor -- start 2024-02-16T22:18:02.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.020+0000 7f87596cd700 1 -- start start 2024-02-16T22:18:02.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.020+0000 7f87596cd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8754100100 0x7f875410db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:02.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.020+0000 7f87596cd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f875410e040 0x7f875410eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:02.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.021+0000 7f87596cd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875410e500 con 0x7f8754100100 2024-02-16T22:18:02.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.021+0000 7f87596cd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875410e640 con 0x7f875410e040 2024-02-16T22:18:02.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.021+0000 7f87527fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f875410e040 0x7f875410eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:02.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.021+0000 7f87527fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f875410e040 0x7f875410eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.134:43470/0 (socket says 172.21.15.134:43470) 2024-02-16T22:18:02.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.021+0000 7f87527fc700 1 -- 172.21.15.134:0/21943736 learned_addr learned my addr 172.21.15.134:0/21943736 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:18:02.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.021+0000 7f8752ffd700 1 --2- 172.21.15.134:0/21943736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8754100100 0x7f875410db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:02.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.021+0000 7f87527fc700 1 -- 172.21.15.134:0/21943736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8754100100 msgr2=0x7f875410db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:02.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.021+0000 7f87527fc700 1 --2- 172.21.15.134:0/21943736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8754100100 0x7f875410db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:02.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.021+0000 7f87527fc700 1 -- 172.21.15.134:0/21943736 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8744005040 con 0x7f875410e040 2024-02-16T22:18:02.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.021+0000 7f8752ffd700 1 --2- 172.21.15.134:0/21943736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8754100100 0x7f875410db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:18:02.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.021+0000 7f87527fc700 1 --2- 172.21.15.134:0/21943736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f875410e040 0x7f875410eee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f874800eb40 tx=0x7f874800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:02.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.022+0000 7f873b7fe700 1 -- 172.21.15.134:0/21943736 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8748007cc0 con 0x7f875410e040 2024-02-16T22:18:02.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.022+0000 7f87596cd700 1 -- 172.21.15.134:0/21943736 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f875410f4e0 con 0x7f875410e040 2024-02-16T22:18:02.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.022+0000 7f87596cd700 1 -- 172.21.15.134:0/21943736 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875410f9f0 con 0x7f875410e040 2024-02-16T22:18:02.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.022+0000 7f873b7fe700 1 -- 172.21.15.134:0/21943736 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f874800f040 con 0x7f875410e040 2024-02-16T22:18:02.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.023+0000 7f873b7fe700 1 -- 172.21.15.134:0/21943736 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87480095e0 con 0x7f875410e040 2024-02-16T22:18:02.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.023+0000 7f87397fa700 1 -- 172.21.15.134:0/21943736 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87340052b0 con 0x7f875410e040 2024-02-16T22:18:02.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.024+0000 7f873b7fe700 1 -- 172.21.15.134:0/21943736 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f8748009800 con 0x7f875410e040 2024-02-16T22:18:02.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.024+0000 7f873b7fe700 1 --2- 172.21.15.134:0/21943736 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f873c0690a0 0x7f873c06b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:02.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.024+0000 7f873b7fe700 1 -- 172.21.15.134:0/21943736 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8748086c50 con 0x7f875410e040 2024-02-16T22:18:02.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.024+0000 7f8752ffd700 1 --2- 172.21.15.134:0/21943736 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f873c0690a0 0x7f873c06b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:02.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.025+0000 7f8752ffd700 1 --2- 172.21.15.134:0/21943736 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f873c0690a0 0x7f873c06b550 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8744009fd0 tx=0x7f8744009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:02.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.032+0000 7f873b7fe700 1 -- 172.21.15.134:0/21943736 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f874804dbd0 con 0x7f875410e040 2024-02-16T22:18:02.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.249+0000 7f87397fa700 1 -- 172.21.15.134:0/21943736 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8734000bc0 con 0x7f873c0690a0 2024-02-16T22:18:02.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.251+0000 7f873b7fe700 1 -- 172.21.15.134:0/21943736 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f8734000bc0 con 0x7f873c0690a0 2024-02-16T22:18:02.253 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:18:02.253 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", 2024-02-16T22:18:02.253 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:18:02.253 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-16T22:18:02.253 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-02-16T22:18:02.253 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "", 2024-02-16T22:18:02.253 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 image", 2024-02-16T22:18:02.253 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:18:02.253 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:18:02.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.253+0000 7f87397fa700 1 -- 172.21.15.134:0/21943736 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f873c0690a0 msgr2=0x7f873c06b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:02.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.253+0000 7f87397fa700 1 --2- 172.21.15.134:0/21943736 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f873c0690a0 0x7f873c06b550 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8744009fd0 tx=0x7f8744009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:02.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.253+0000 7f87397fa700 1 -- 172.21.15.134:0/21943736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f875410e040 msgr2=0x7f875410eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:02.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.253+0000 7f87397fa700 1 --2- 172.21.15.134:0/21943736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f875410e040 0x7f875410eee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f874800eb40 tx=0x7f874800b040 comp rx=0 tx=0).stop 2024-02-16T22:18:02.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.253+0000 7f87397fa700 1 -- 172.21.15.134:0/21943736 shutdown_connections 2024-02-16T22:18:02.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.253+0000 7f87397fa700 1 --2- 172.21.15.134:0/21943736 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f873c0690a0 0x7f873c06b550 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:02.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.253+0000 7f87397fa700 1 --2- 172.21.15.134:0/21943736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8754100100 0x7f875410db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:02.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.253+0000 7f87397fa700 1 --2- 172.21.15.134:0/21943736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f875410e040 0x7f875410eee0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:02.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.253+0000 7f87397fa700 1 -- 172.21.15.134:0/21943736 >> 172.21.15.134:0/21943736 conn(0x7f87540f74e0 msgr2=0x7f87540f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:02.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.254+0000 7f87397fa700 1 -- 172.21.15.134:0/21943736 shutdown_connections 2024-02-16T22:18:02.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:02.254+0000 7f87397fa700 1 -- 172.21.15.134:0/21943736 wait complete. 2024-02-16T22:18:02.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:02 smithi134 ceph-mon[28869]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:02.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:02 smithi134 ceph-mon[28869]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-16T22:18:02.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:02 smithi134 ceph-mon[28869]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:02.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:02 smithi134 ceph-mon[28869]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:02.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:02 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2832599377' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:18:02.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:02 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:18:02.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:02 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:18:02.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:02 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:18:02.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:02 smithi173 ceph-mon[37280]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:02.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:02 smithi173 ceph-mon[37280]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-16T22:18:02.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:02 smithi173 ceph-mon[37280]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:02.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:02 smithi173 ceph-mon[37280]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:02.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:02 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2832599377' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:18:02.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:02 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:18:02.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:02 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:18:02.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:02 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:18:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:03 smithi134 ceph-mon[28869]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:03 smithi134 ceph-mon[28869]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (unknown) 2024-02-16T22:18:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:03 smithi134 ceph-mon[28869]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-16T22:18:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:03 smithi134 ceph-mon[28869]: Upgrade: Need to upgrade myself (mgr.smithi134.ordace) 2024-02-16T22:18:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:03 smithi173 ceph-mon[37280]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:03 smithi173 ceph-mon[37280]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (unknown) 2024-02-16T22:18:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:03 smithi173 ceph-mon[37280]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-16T22:18:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:03 smithi173 ceph-mon[37280]: Upgrade: Need to upgrade myself (mgr.smithi134.ordace) 2024-02-16T22:18:04.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:04 smithi134 ceph-mon[28869]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 on smithi173 2024-02-16T22:18:04.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:04 smithi134 ceph-mon[28869]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-16T22:18:04.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:04 smithi173 ceph-mon[37280]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 on smithi173 2024-02-16T22:18:04.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:04 smithi173 ceph-mon[37280]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-16T22:18:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:05 smithi173 ceph-mon[37280]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-16T22:18:05.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:05 smithi134 ceph-mon[28869]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-16T22:18:08.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:08 smithi134 ceph-mon[28869]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:18:08.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:08 smithi173 ceph-mon[37280]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:18:10.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:10 smithi134 ceph-mon[28869]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:18:10.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:10 smithi173 ceph-mon[37280]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:18:12.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:12 smithi134 ceph-mon[28869]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:18:12.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:12 smithi173 ceph-mon[37280]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:18:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:13 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:18:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:13 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:18:14.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:14 smithi134 ceph-mon[28869]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:18:14.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:14 smithi173 ceph-mon[37280]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:18:15.501 INFO:tasks.workunit.client.1.smithi173.stderr:Note: switching to 'ed7ab725e1a43615009dfb74a42bf33d80081bc8'. 2024-02-16T22:18:15.501 INFO:tasks.workunit.client.1.smithi173.stderr: 2024-02-16T22:18:15.501 INFO:tasks.workunit.client.1.smithi173.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-16T22:18:15.501 INFO:tasks.workunit.client.1.smithi173.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-16T22:18:15.501 INFO:tasks.workunit.client.1.smithi173.stderr:state without impacting any branches by switching back to a branch. 2024-02-16T22:18:15.501 INFO:tasks.workunit.client.1.smithi173.stderr: 2024-02-16T22:18:15.501 INFO:tasks.workunit.client.1.smithi173.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-16T22:18:15.501 INFO:tasks.workunit.client.1.smithi173.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-16T22:18:15.502 INFO:tasks.workunit.client.1.smithi173.stderr: 2024-02-16T22:18:15.502 INFO:tasks.workunit.client.1.smithi173.stderr: git switch -c 2024-02-16T22:18:15.502 INFO:tasks.workunit.client.1.smithi173.stderr: 2024-02-16T22:18:15.502 INFO:tasks.workunit.client.1.smithi173.stderr:Or undo this operation with: 2024-02-16T22:18:15.502 INFO:tasks.workunit.client.1.smithi173.stderr: 2024-02-16T22:18:15.502 INFO:tasks.workunit.client.1.smithi173.stderr: git switch - 2024-02-16T22:18:15.502 INFO:tasks.workunit.client.1.smithi173.stderr: 2024-02-16T22:18:15.502 INFO:tasks.workunit.client.1.smithi173.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-16T22:18:15.502 INFO:tasks.workunit.client.1.smithi173.stderr: 2024-02-16T22:18:15.502 INFO:tasks.workunit.client.1.smithi173.stderr:HEAD is now at ed7ab725e1a qa: test fuse/kclient for mds upgrade seq 2024-02-16T22:18:15.506 DEBUG:teuthology.orchestra.run.smithi173:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-16T22:18:15.578 INFO:tasks.workunit.client.1.smithi173.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-16T22:18:15.580 INFO:tasks.workunit.client.1.smithi173.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-16T22:18:15.580 INFO:tasks.workunit.client.1.smithi173.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-16T22:18:15.745 INFO:tasks.workunit.client.0.smithi134.stderr:Note: switching to 'ed7ab725e1a43615009dfb74a42bf33d80081bc8'. 2024-02-16T22:18:15.745 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-02-16T22:18:15.745 INFO:tasks.workunit.client.0.smithi134.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-16T22:18:15.745 INFO:tasks.workunit.client.0.smithi134.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-16T22:18:15.745 INFO:tasks.workunit.client.0.smithi134.stderr:state without impacting any branches by switching back to a branch. 2024-02-16T22:18:15.745 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-02-16T22:18:15.745 INFO:tasks.workunit.client.0.smithi134.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-16T22:18:15.745 INFO:tasks.workunit.client.0.smithi134.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-16T22:18:15.745 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-02-16T22:18:15.745 INFO:tasks.workunit.client.0.smithi134.stderr: git switch -c 2024-02-16T22:18:15.745 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-02-16T22:18:15.745 INFO:tasks.workunit.client.0.smithi134.stderr:Or undo this operation with: 2024-02-16T22:18:15.746 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-02-16T22:18:15.746 INFO:tasks.workunit.client.0.smithi134.stderr: git switch - 2024-02-16T22:18:15.746 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-02-16T22:18:15.746 INFO:tasks.workunit.client.0.smithi134.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-16T22:18:15.746 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-02-16T22:18:15.746 INFO:tasks.workunit.client.0.smithi134.stderr:HEAD is now at ed7ab725e1a qa: test fuse/kclient for mds upgrade seq 2024-02-16T22:18:15.751 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-16T22:18:15.811 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:15 smithi173 ceph-mon[37280]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:18:15.830 INFO:tasks.workunit.client.0.smithi134.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-16T22:18:15.832 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-16T22:18:15.832 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-16T22:18:15.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:15 smithi134 ceph-mon[28869]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:18:16.328 INFO:tasks.workunit.client.1.smithi173.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-16T22:18:16.401 INFO:tasks.workunit.client.1.smithi173.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-16T22:18:16.440 INFO:tasks.workunit.client.1.smithi173.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-16T22:18:16.442 INFO:tasks.workunit.client.1.smithi173.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-16T22:18:16.442 INFO:tasks.workunit.client.1.smithi173.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-16T22:18:16.484 INFO:tasks.workunit.client.1.smithi173.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-16T22:18:16.487 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:18:16.488 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-16T22:18:16.544 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-16T22:18:16.545 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-16T22:18:16.545 DEBUG:teuthology.orchestra.run.smithi173:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ed7ab725e1a43615009dfb74a42bf33d80081bc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-16T22:18:16.606 INFO:tasks.workunit.client.1.smithi173.stderr:+ mkdir -p fsstress 2024-02-16T22:18:16.608 INFO:tasks.workunit.client.1.smithi173.stderr:+ pushd fsstress 2024-02-16T22:18:16.609 INFO:tasks.workunit.client.1.smithi173.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-16T22:18:16.609 INFO:tasks.workunit.client.1.smithi173.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-16T22:18:17.149 INFO:tasks.workunit.client.1.smithi173.stderr:+ tar xzf ltp-full.tgz 2024-02-16T22:18:17.502 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-16T22:18:17.611 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-16T22:18:17.690 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-16T22:18:17.692 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-16T22:18:17.692 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-16T22:18:17.831 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-16T22:18:17.835 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:18:17.835 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-16T22:18:17.850 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-16T22:18:17.851 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-16T22:18:17.851 DEBUG:teuthology.orchestra.run.smithi134:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ed7ab725e1a43615009dfb74a42bf33d80081bc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-16T22:18:17.911 INFO:tasks.workunit.client.0.smithi134.stderr:+ mkdir -p fsstress 2024-02-16T22:18:17.913 INFO:tasks.workunit.client.0.smithi134.stderr:+ pushd fsstress 2024-02-16T22:18:17.913 INFO:tasks.workunit.client.0.smithi134.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-16T22:18:17.913 INFO:tasks.workunit.client.0.smithi134.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-16T22:18:18.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:18 smithi134 ceph-mon[28869]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:18:18.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:18 smithi173 ceph-mon[37280]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:18:20.004 INFO:tasks.workunit.client.0.smithi134.stderr:+ tar xzf ltp-full.tgz 2024-02-16T22:18:20.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:20 smithi134 ceph-mon[28869]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-02-16T22:18:20.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:20 smithi173 ceph-mon[37280]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-02-16T22:18:22.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:22 smithi134 ceph-mon[28869]: pgmap v233: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s wr, 0 op/s 2024-02-16T22:18:22.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:22 smithi173 ceph-mon[37280]: pgmap v233: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s wr, 0 op/s 2024-02-16T22:18:23.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:23 smithi134 ceph-mon[28869]: pgmap v234: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s wr, 0 op/s 2024-02-16T22:18:23.980 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:23 smithi173 ceph-mon[37280]: pgmap v234: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s wr, 0 op/s 2024-02-16T22:18:26.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:25 smithi173 ceph-mon[37280]: pgmap v235: 65 pgs: 65 active+clean; 43 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s wr, 281 op/s 2024-02-16T22:18:26.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:25 smithi134 ceph-mon[28869]: pgmap v235: 65 pgs: 65 active+clean; 43 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s wr, 281 op/s 2024-02-16T22:18:28.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:28 smithi134 ceph-mon[28869]: pgmap v236: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.6 MiB/s wr, 473 op/s 2024-02-16T22:18:28.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:28 smithi134 ceph-mon[28869]: fsmap cephfs:2 {0=cephfs.smithi134.jyajef=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:18:28.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:28 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:18:28.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:28 smithi173 ceph-mon[37280]: pgmap v236: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.6 MiB/s wr, 473 op/s 2024-02-16T22:18:28.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:28 smithi173 ceph-mon[37280]: fsmap cephfs:2 {0=cephfs.smithi134.jyajef=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:18:28.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:28 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:18:29.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:29 smithi134 ceph-mon[28869]: pgmap v237: 65 pgs: 65 active+clean; 72 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.3 MiB/s wr, 519 op/s 2024-02-16T22:18:29.980 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:29 smithi173 ceph-mon[37280]: pgmap v237: 65 pgs: 65 active+clean; 72 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.3 MiB/s wr, 519 op/s 2024-02-16T22:18:32.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.393+0000 7f49c61a0700 1 -- 172.21.15.134:0/1788930224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49c00fbc40 msgr2=0x7f49c00fc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:32.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.393+0000 7f49c61a0700 1 --2- 172.21.15.134:0/1788930224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49c00fbc40 0x7f49c00fc050 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f49bc004940 tx=0x7f49bc009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:32.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.393+0000 7f49c61a0700 1 -- 172.21.15.134:0/1788930224 shutdown_connections 2024-02-16T22:18:32.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.393+0000 7f49c61a0700 1 --2- 172.21.15.134:0/1788930224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c00fce50 0x7f49c00fd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:32.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.393+0000 7f49c61a0700 1 --2- 172.21.15.134:0/1788930224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49c00fbc40 0x7f49c00fc050 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:32.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.393+0000 7f49c61a0700 1 -- 172.21.15.134:0/1788930224 >> 172.21.15.134:0/1788930224 conn(0x7f49c00f72c0 msgr2=0x7f49c00f9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:32.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.393+0000 7f49c61a0700 1 -- 172.21.15.134:0/1788930224 shutdown_connections 2024-02-16T22:18:32.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.393+0000 7f49c61a0700 1 -- 172.21.15.134:0/1788930224 wait complete. 2024-02-16T22:18:32.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.394+0000 7f49c61a0700 1 Processor -- start 2024-02-16T22:18:32.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.394+0000 7f49c61a0700 1 -- start start 2024-02-16T22:18:32.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.394+0000 7f49c61a0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49c00fbc40 0x7f49c010c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:32.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.394+0000 7f49c61a0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c00fce50 0x7f49c010cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:32.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.394+0000 7f49c61a0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c010d200 con 0x7f49c00fbc40 2024-02-16T22:18:32.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.394+0000 7f49c61a0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c010daa0 con 0x7f49c00fce50 2024-02-16T22:18:32.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.394+0000 7f49c519e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49c00fbc40 0x7f49c010c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:32.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.394+0000 7f49c519e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49c00fbc40 0x7f49c010c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38754/0 (socket says 172.21.15.134:38754) 2024-02-16T22:18:32.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.394+0000 7f49c519e700 1 -- 172.21.15.134:0/1576037699 learned_addr learned my addr 172.21.15.134:0/1576037699 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:18:32.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.394+0000 7f49c499d700 1 --2- 172.21.15.134:0/1576037699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c00fce50 0x7f49c010cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:32.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.395+0000 7f49c519e700 1 -- 172.21.15.134:0/1576037699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c00fce50 msgr2=0x7f49c010cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:32.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.395+0000 7f49c519e700 1 --2- 172.21.15.134:0/1576037699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c00fce50 0x7f49c010cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:32.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.395+0000 7f49c519e700 1 -- 172.21.15.134:0/1576037699 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc005040 con 0x7f49c00fbc40 2024-02-16T22:18:32.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.395+0000 7f49c519e700 1 --2- 172.21.15.134:0/1576037699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49c00fbc40 0x7f49c010c6c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f49bc000c00 tx=0x7f49bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:32.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.395+0000 7f49b5ffb700 1 -- 172.21.15.134:0/1576037699 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49bc021070 con 0x7f49c00fbc40 2024-02-16T22:18:32.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.395+0000 7f49b5ffb700 1 -- 172.21.15.134:0/1576037699 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49bc009430 con 0x7f49c00fbc40 2024-02-16T22:18:32.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.395+0000 7f49c61a0700 1 -- 172.21.15.134:0/1576037699 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c010dd20 con 0x7f49c00fbc40 2024-02-16T22:18:32.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.395+0000 7f49b5ffb700 1 -- 172.21.15.134:0/1576037699 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49bc00e070 con 0x7f49c00fbc40 2024-02-16T22:18:32.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.395+0000 7f49c61a0700 1 -- 172.21.15.134:0/1576037699 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c010e260 con 0x7f49c00fbc40 2024-02-16T22:18:32.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.396+0000 7f49c61a0700 1 -- 172.21.15.134:0/1576037699 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c004bed0 con 0x7f49c00fbc40 2024-02-16T22:18:32.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.397+0000 7f49b5ffb700 1 -- 172.21.15.134:0/1576037699 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f49bc01c400 con 0x7f49c00fbc40 2024-02-16T22:18:32.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.397+0000 7f49b5ffb700 1 --2- 172.21.15.134:0/1576037699 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f49ac0692a0 0x7f49ac06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:32.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.397+0000 7f49b5ffb700 1 -- 172.21.15.134:0/1576037699 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f49bc0884f0 con 0x7f49c00fbc40 2024-02-16T22:18:32.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.397+0000 7f49c499d700 1 --2- 172.21.15.134:0/1576037699 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f49ac0692a0 0x7f49ac06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:32.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.398+0000 7f49c499d700 1 --2- 172.21.15.134:0/1576037699 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f49ac0692a0 0x7f49ac06b750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009b80 tx=0x7f49b000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:32.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.402+0000 7f49b5ffb700 1 -- 172.21.15.134:0/1576037699 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f49bc058260 con 0x7f49c00fbc40 2024-02-16T22:18:32.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.709+0000 7f49c61a0700 1 -- 172.21.15.134:0/1576037699 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49c010e8b0 con 0x7f49ac0692a0 2024-02-16T22:18:32.711 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:32 smithi134 ceph-mon[28869]: pgmap v238: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 7.1 MiB/s wr, 533 op/s 2024-02-16T22:18:32.711 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:18:32.711 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi173.kbofaa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:18:32.711 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:18:32.711 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:32 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:18:32.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.710+0000 7f49b5ffb700 1 -- 172.21.15.134:0/1576037699 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f49c010e8b0 con 0x7f49ac0692a0 2024-02-16T22:18:32.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.713+0000 7f49c61a0700 1 -- 172.21.15.134:0/1576037699 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f49ac0692a0 msgr2=0x7f49ac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:32.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.713+0000 7f49c61a0700 1 --2- 172.21.15.134:0/1576037699 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f49ac0692a0 0x7f49ac06b750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009b80 tx=0x7f49b000b040 comp rx=0 tx=0).stop 2024-02-16T22:18:32.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.713+0000 7f49c61a0700 1 -- 172.21.15.134:0/1576037699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49c00fbc40 msgr2=0x7f49c010c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:32.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.713+0000 7f49c61a0700 1 --2- 172.21.15.134:0/1576037699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49c00fbc40 0x7f49c010c6c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f49bc000c00 tx=0x7f49bc009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:32.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.713+0000 7f49c61a0700 1 -- 172.21.15.134:0/1576037699 shutdown_connections 2024-02-16T22:18:32.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.713+0000 7f49c61a0700 1 --2- 172.21.15.134:0/1576037699 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f49ac0692a0 0x7f49ac06b750 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:32.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.713+0000 7f49c61a0700 1 --2- 172.21.15.134:0/1576037699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49c00fbc40 0x7f49c010c6c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:32.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.713+0000 7f49c61a0700 1 --2- 172.21.15.134:0/1576037699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c00fce50 0x7f49c010cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:32.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.713+0000 7f49c61a0700 1 -- 172.21.15.134:0/1576037699 >> 172.21.15.134:0/1576037699 conn(0x7f49c00f72c0 msgr2=0x7f49c00f9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:32.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.714+0000 7f49c61a0700 1 -- 172.21.15.134:0/1576037699 shutdown_connections 2024-02-16T22:18:32.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.714+0000 7f49c61a0700 1 -- 172.21.15.134:0/1576037699 wait complete. 2024-02-16T22:18:32.725 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:18:32.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:32 smithi173 ceph-mon[37280]: pgmap v238: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 7.1 MiB/s wr, 533 op/s 2024-02-16T22:18:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:18:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi173.kbofaa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:18:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:18:32.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:32 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:18:32.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.822+0000 7fe9ece0b700 1 -- 172.21.15.134:0/146742038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9e80fda80 msgr2=0x7fe9e80ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:32.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.822+0000 7fe9ece0b700 1 --2- 172.21.15.134:0/146742038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9e80fda80 0x7fe9e80ffe60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8004940 tx=0x7fe9d8009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:32.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.822+0000 7fe9ece0b700 1 -- 172.21.15.134:0/146742038 shutdown_connections 2024-02-16T22:18:32.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.822+0000 7fe9ece0b700 1 --2- 172.21.15.134:0/146742038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e81003a0 0x7fe9e8102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:32.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.822+0000 7fe9ece0b700 1 --2- 172.21.15.134:0/146742038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9e80fda80 0x7fe9e80ffe60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:32.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.822+0000 7fe9ece0b700 1 -- 172.21.15.134:0/146742038 >> 172.21.15.134:0/146742038 conn(0x7fe9e80f74e0 msgr2=0x7fe9e80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:32.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.822+0000 7fe9ece0b700 1 -- 172.21.15.134:0/146742038 shutdown_connections 2024-02-16T22:18:32.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.822+0000 7fe9ece0b700 1 -- 172.21.15.134:0/146742038 wait complete. 2024-02-16T22:18:32.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.823+0000 7fe9ece0b700 1 Processor -- start 2024-02-16T22:18:32.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.823+0000 7fe9ece0b700 1 -- start start 2024-02-16T22:18:32.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.823+0000 7fe9ece0b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9e80fda80 0x7fe9e80fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:32.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.823+0000 7fe9ece0b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e81003a0 0x7fe9e80fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:32.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.823+0000 7fe9ece0b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80fbf90 con 0x7fe9e80fda80 2024-02-16T22:18:32.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.823+0000 7fe9ece0b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80fc100 con 0x7fe9e81003a0 2024-02-16T22:18:32.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.823+0000 7fe9e659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9e80fda80 0x7fe9e80fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:32.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.823+0000 7fe9e659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9e80fda80 0x7fe9e80fd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38770/0 (socket says 172.21.15.134:38770) 2024-02-16T22:18:32.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.823+0000 7fe9e659c700 1 -- 172.21.15.134:0/4015406130 learned_addr learned my addr 172.21.15.134:0/4015406130 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:18:32.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.824+0000 7fe9e5d9b700 1 --2- 172.21.15.134:0/4015406130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e81003a0 0x7fe9e80fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:32.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.824+0000 7fe9e659c700 1 -- 172.21.15.134:0/4015406130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e81003a0 msgr2=0x7fe9e80fb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:32.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.824+0000 7fe9e659c700 1 --2- 172.21.15.134:0/4015406130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e81003a0 0x7fe9e80fb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:32.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.824+0000 7fe9e659c700 1 -- 172.21.15.134:0/4015406130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d8005040 con 0x7fe9e80fda80 2024-02-16T22:18:32.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.824+0000 7fe9e659c700 1 --2- 172.21.15.134:0/4015406130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9e80fda80 0x7fe9e80fd510 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8000c00 tx=0x7fe9d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:32.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.824+0000 7fe9d6ffd700 1 -- 172.21.15.134:0/4015406130 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d8021070 con 0x7fe9e80fda80 2024-02-16T22:18:32.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.824+0000 7fe9ece0b700 1 -- 172.21.15.134:0/4015406130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e80fc380 con 0x7fe9e80fda80 2024-02-16T22:18:32.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.824+0000 7fe9d6ffd700 1 -- 172.21.15.134:0/4015406130 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9d801c400 con 0x7fe9e80fda80 2024-02-16T22:18:32.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.824+0000 7fe9d6ffd700 1 -- 172.21.15.134:0/4015406130 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d800e070 con 0x7fe9e80fda80 2024-02-16T22:18:32.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.824+0000 7fe9ece0b700 1 -- 172.21.15.134:0/4015406130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e81158f0 con 0x7fe9e80fda80 2024-02-16T22:18:32.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.826+0000 7fe9ece0b700 1 -- 172.21.15.134:0/4015406130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e8107a50 con 0x7fe9e80fda80 2024-02-16T22:18:32.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.826+0000 7fe9d6ffd700 1 -- 172.21.15.134:0/4015406130 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe9d801ca50 con 0x7fe9e80fda80 2024-02-16T22:18:32.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.826+0000 7fe9d6ffd700 1 --2- 172.21.15.134:0/4015406130 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe9d00692a0 0x7fe9d006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:32.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.826+0000 7fe9d6ffd700 1 -- 172.21.15.134:0/4015406130 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe9d80882e0 con 0x7fe9e80fda80 2024-02-16T22:18:32.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.826+0000 7fe9e5d9b700 1 --2- 172.21.15.134:0/4015406130 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe9d00692a0 0x7fe9d006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:32.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.827+0000 7fe9e5d9b700 1 --2- 172.21.15.134:0/4015406130 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe9d00692a0 0x7fe9d006b750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009b80 tx=0x7fe9dc00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:32.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:32.834+0000 7fe9d6ffd700 1 -- 172.21.15.134:0/4015406130 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe9d80580f0 con 0x7fe9e80fda80 2024-02-16T22:18:33.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.108+0000 7fe9ece0b700 1 -- 172.21.15.134:0/4015406130 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9e802b310 con 0x7fe9d00692a0 2024-02-16T22:18:33.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.109+0000 7fe9d6ffd700 1 -- 172.21.15.134:0/4015406130 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fe9e802b310 con 0x7fe9d00692a0 2024-02-16T22:18:33.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.111+0000 7fe9ece0b700 1 -- 172.21.15.134:0/4015406130 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe9d00692a0 msgr2=0x7fe9d006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:33.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.111+0000 7fe9ece0b700 1 --2- 172.21.15.134:0/4015406130 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe9d00692a0 0x7fe9d006b750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009b80 tx=0x7fe9dc00b040 comp rx=0 tx=0).stop 2024-02-16T22:18:33.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.111+0000 7fe9ece0b700 1 -- 172.21.15.134:0/4015406130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9e80fda80 msgr2=0x7fe9e80fd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:33.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.111+0000 7fe9ece0b700 1 --2- 172.21.15.134:0/4015406130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9e80fda80 0x7fe9e80fd510 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8000c00 tx=0x7fe9d8009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:33.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.111+0000 7fe9ece0b700 1 -- 172.21.15.134:0/4015406130 shutdown_connections 2024-02-16T22:18:33.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.111+0000 7fe9ece0b700 1 --2- 172.21.15.134:0/4015406130 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fe9d00692a0 0x7fe9d006b750 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:33.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.111+0000 7fe9ece0b700 1 --2- 172.21.15.134:0/4015406130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9e80fda80 0x7fe9e80fd510 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:33.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.111+0000 7fe9ece0b700 1 --2- 172.21.15.134:0/4015406130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e81003a0 0x7fe9e80fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:33.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.111+0000 7fe9ece0b700 1 -- 172.21.15.134:0/4015406130 >> 172.21.15.134:0/4015406130 conn(0x7fe9e80f74e0 msgr2=0x7fe9e80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:33.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.111+0000 7fe9ece0b700 1 -- 172.21.15.134:0/4015406130 shutdown_connections 2024-02-16T22:18:33.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.112+0000 7fe9ece0b700 1 -- 172.21.15.134:0/4015406130 wait complete. 2024-02-16T22:18:33.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.221+0000 7f6d48984700 1 -- 172.21.15.134:0/1019705987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d440fe0e0 msgr2=0x7f6d440fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.221+0000 7f6d48984700 1 --2- 172.21.15.134:0/1019705987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d440fe0e0 0x7f6d440fe550 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6d38004940 tx=0x7f6d38009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.221+0000 7f6d48984700 1 -- 172.21.15.134:0/1019705987 shutdown_connections 2024-02-16T22:18:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.221+0000 7f6d48984700 1 --2- 172.21.15.134:0/1019705987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d440fe0e0 0x7f6d440fe550 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.221+0000 7f6d48984700 1 --2- 172.21.15.134:0/1019705987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d440fcef0 0x7f6d440fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.221+0000 7f6d48984700 1 -- 172.21.15.134:0/1019705987 >> 172.21.15.134:0/1019705987 conn(0x7f6d440f8620 msgr2=0x7f6d440faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.221+0000 7f6d48984700 1 -- 172.21.15.134:0/1019705987 shutdown_connections 2024-02-16T22:18:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.221+0000 7f6d48984700 1 -- 172.21.15.134:0/1019705987 wait complete. 2024-02-16T22:18:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.222+0000 7f6d48984700 1 Processor -- start 2024-02-16T22:18:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.222+0000 7f6d48984700 1 -- start start 2024-02-16T22:18:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.222+0000 7f6d48984700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d440fcef0 0x7f6d4410d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.222+0000 7f6d48984700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d440fe0e0 0x7f6d4410de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:33.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.222+0000 7f6d48984700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4410e430 con 0x7f6d440fe0e0 2024-02-16T22:18:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.222+0000 7f6d48984700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4410ecd0 con 0x7f6d440fcef0 2024-02-16T22:18:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.222+0000 7f6d41d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d440fe0e0 0x7f6d4410de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.222+0000 7f6d41d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d440fe0e0 0x7f6d4410de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38784/0 (socket says 172.21.15.134:38784) 2024-02-16T22:18:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.222+0000 7f6d41d9b700 1 -- 172.21.15.134:0/634122170 learned_addr learned my addr 172.21.15.134:0/634122170 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:18:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.222+0000 7f6d4259c700 1 --2- 172.21.15.134:0/634122170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d440fcef0 0x7f6d4410d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.223+0000 7f6d41d9b700 1 -- 172.21.15.134:0/634122170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d440fcef0 msgr2=0x7f6d4410d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.223+0000 7f6d41d9b700 1 --2- 172.21.15.134:0/634122170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d440fcef0 0x7f6d4410d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.223+0000 7f6d41d9b700 1 -- 172.21.15.134:0/634122170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d38005040 con 0x7f6d440fe0e0 2024-02-16T22:18:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.223+0000 7f6d41d9b700 1 --2- 172.21.15.134:0/634122170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d440fe0e0 0x7f6d4410de30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6d38000c00 tx=0x7f6d38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.223+0000 7f6d32ffd700 1 -- 172.21.15.134:0/634122170 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d3800e070 con 0x7f6d440fe0e0 2024-02-16T22:18:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.223+0000 7f6d32ffd700 1 -- 172.21.15.134:0/634122170 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d3801c400 con 0x7f6d440fe0e0 2024-02-16T22:18:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.223+0000 7f6d32ffd700 1 -- 172.21.15.134:0/634122170 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d3800b650 con 0x7f6d440fe0e0 2024-02-16T22:18:33.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.223+0000 7f6d48984700 1 -- 172.21.15.134:0/634122170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4410ef50 con 0x7f6d440fe0e0 2024-02-16T22:18:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.223+0000 7f6d48984700 1 -- 172.21.15.134:0/634122170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4410f3e0 con 0x7f6d440fe0e0 2024-02-16T22:18:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.224+0000 7f6d48984700 1 -- 172.21.15.134:0/634122170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4404bed0 con 0x7f6d440fe0e0 2024-02-16T22:18:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.224+0000 7f6d32ffd700 1 -- 172.21.15.134:0/634122170 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f6d3801ca50 con 0x7f6d440fe0e0 2024-02-16T22:18:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.225+0000 7f6d32ffd700 1 --2- 172.21.15.134:0/634122170 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6d2c0692a0 0x7f6d2c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.225+0000 7f6d32ffd700 1 -- 172.21.15.134:0/634122170 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6d38088760 con 0x7f6d440fe0e0 2024-02-16T22:18:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.225+0000 7f6d4259c700 1 --2- 172.21.15.134:0/634122170 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6d2c0692a0 0x7f6d2c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.226+0000 7f6d4259c700 1 --2- 172.21.15.134:0/634122170 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6d2c0692a0 0x7f6d2c06b750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009b80 tx=0x7f6d3400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:33.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.229+0000 7f6d32ffd700 1 -- 172.21.15.134:0/634122170 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6d380584d0 con 0x7f6d440fe0e0 2024-02-16T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.435+0000 7f6d48984700 1 -- 172.21.15.134:0/634122170 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d4410f880 con 0x7f6d2c0692a0 2024-02-16T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.445+0000 7f6d32ffd700 1 -- 172.21.15.134:0/634122170 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f6d4410f880 con 0x7f6d2c0692a0 2024-02-16T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (6m) 94s ago 7m 24.8M - 0.25.0 c8568f914cd2 62f86e3efbe2 2024-02-16T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (7m) 94s ago 7m 6660k - 17.2.7-513-gb88fae66 870a0944ccb8 a0d53bc0a925 2024-02-16T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (6m) 100s ago 6m 6669k - 17.2.7-513-gb88fae66 870a0944ccb8 a8d69537e08a 2024-02-16T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (5m) 94s ago 7m 87.8M - 9.4.7 954c08fa6188 67572f26488e 2024-02-16T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (118s) 94s ago 117s 10.4M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (111s) 94s ago 111s 15.6M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (109s) 100s ago 108s 13.5M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (115s) 100s ago 114s 16.7M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:9283 running (9m) 94s ago 9m 480M - 17.2.7-513-gb88fae66 870a0944ccb8 52095085178d 2024-02-16T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283 running (6m) 100s ago 6m 435M - 17.2.7-513-gb88fae66 870a0944ccb8 f405e50edb6b 2024-02-16T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (9m) 94s ago 9m 44.9M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 93a679740d93 2024-02-16T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (6m) 100s ago 6m 35.7M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 cfbef35950ef 2024-02-16T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 94s ago 7m 15.9M - 1.5.0 0da6a335fe13 7e7604241558 2024-02-16T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (6m) 100s ago 6m 15.7M - 1.5.0 0da6a335fe13 cddf6bc3c421 2024-02-16T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (5m) 94s ago 5m 44.7M 4288M 17.2.7-513-gb88fae66 870a0944ccb8 099f0b29d202 2024-02-16T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (5m) 94s ago 5m 48.4M 4288M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (4m) 94s ago 4m 44.4M 4288M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (4m) 100s ago 4m 44.0M 5312M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (3m) 100s ago 3m 43.9M 5312M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (3m) 100s ago 3m 41.3M 5312M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 94s ago 6m 54.3M - 2.43.0 a07b618ecd1d 37e529bd9229 2024-02-16T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.447+0000 7f6d48984700 1 -- 172.21.15.134:0/634122170 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6d2c0692a0 msgr2=0x7f6d2c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.447+0000 7f6d48984700 1 --2- 172.21.15.134:0/634122170 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6d2c0692a0 0x7f6d2c06b750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009b80 tx=0x7f6d3400b040 comp rx=0 tx=0).stop 2024-02-16T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.447+0000 7f6d48984700 1 -- 172.21.15.134:0/634122170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d440fe0e0 msgr2=0x7f6d4410de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.447+0000 7f6d48984700 1 --2- 172.21.15.134:0/634122170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d440fe0e0 0x7f6d4410de30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6d38000c00 tx=0x7f6d38009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.447+0000 7f6d48984700 1 -- 172.21.15.134:0/634122170 shutdown_connections 2024-02-16T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.447+0000 7f6d48984700 1 --2- 172.21.15.134:0/634122170 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f6d2c0692a0 0x7f6d2c06b750 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.447+0000 7f6d48984700 1 --2- 172.21.15.134:0/634122170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d440fcef0 0x7f6d4410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.447+0000 7f6d48984700 1 --2- 172.21.15.134:0/634122170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d440fe0e0 0x7f6d4410de30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.447+0000 7f6d48984700 1 -- 172.21.15.134:0/634122170 >> 172.21.15.134:0/634122170 conn(0x7f6d440f8620 msgr2=0x7f6d441013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.447+0000 7f6d48984700 1 -- 172.21.15.134:0/634122170 shutdown_connections 2024-02-16T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.447+0000 7f6d48984700 1 -- 172.21.15.134:0/634122170 wait complete. 2024-02-16T22:18:33.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.611+0000 7f8f2359e700 1 -- 172.21.15.134:0/4210691122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f2406e7c0 msgr2=0x7f8f2406ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:33.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.611+0000 7f8f2359e700 1 --2- 172.21.15.134:0/4210691122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f2406e7c0 0x7f8f2406ec10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8f18004940 tx=0x7f8f18009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:33.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.612+0000 7f8f2359e700 1 -- 172.21.15.134:0/4210691122 shutdown_connections 2024-02-16T22:18:33.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.612+0000 7f8f2359e700 1 --2- 172.21.15.134:0/4210691122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f2406e7c0 0x7f8f2406ec10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:33.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.612+0000 7f8f2359e700 1 --2- 172.21.15.134:0/4210691122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f2406fd80 0x7f8f2406e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:33.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.612+0000 7f8f2359e700 1 -- 172.21.15.134:0/4210691122 >> 172.21.15.134:0/4210691122 conn(0x7f8f24069ec0 msgr2=0x7f8f2406c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:33.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.614+0000 7f8f2359e700 1 -- 172.21.15.134:0/4210691122 shutdown_connections 2024-02-16T22:18:33.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.614+0000 7f8f2359e700 1 -- 172.21.15.134:0/4210691122 wait complete. 2024-02-16T22:18:33.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.615+0000 7f8f2359e700 1 Processor -- start 2024-02-16T22:18:33.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.615+0000 7f8f2359e700 1 -- start start 2024-02-16T22:18:33.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.615+0000 7f8f2359e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f2406e7c0 0x7f8f24112aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:33.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.615+0000 7f8f2359e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f2406fd80 0x7f8f24113000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:33.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.615+0000 7f8f2359e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f241136e0 con 0x7f8f2406e7c0 2024-02-16T22:18:33.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.615+0000 7f8f2359e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f24126170 con 0x7f8f2406fd80 2024-02-16T22:18:33.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.616+0000 7f8f21d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f2406fd80 0x7f8f24113000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:33.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.616+0000 7f8f2259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f2406e7c0 0x7f8f24112aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:33.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.616+0000 7f8f2259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f2406e7c0 0x7f8f24112aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38802/0 (socket says 172.21.15.134:38802) 2024-02-16T22:18:33.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.616+0000 7f8f2259c700 1 -- 172.21.15.134:0/1745669730 learned_addr learned my addr 172.21.15.134:0/1745669730 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:18:33.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.619+0000 7f8f2259c700 1 -- 172.21.15.134:0/1745669730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f2406fd80 msgr2=0x7f8f24113000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:33.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.619+0000 7f8f2259c700 1 --2- 172.21.15.134:0/1745669730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f2406fd80 0x7f8f24113000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:33.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.619+0000 7f8f2259c700 1 -- 172.21.15.134:0/1745669730 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f18005040 con 0x7f8f2406e7c0 2024-02-16T22:18:33.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.619+0000 7f8f2259c700 1 --2- 172.21.15.134:0/1745669730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f2406e7c0 0x7f8f24112aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00bae0 tx=0x7f8f1c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:33.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.620+0000 7f8f12ffd700 1 -- 172.21.15.134:0/1745669730 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f1c00c8c0 con 0x7f8f2406e7c0 2024-02-16T22:18:33.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.620+0000 7f8f12ffd700 1 -- 172.21.15.134:0/1745669730 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f1c014410 con 0x7f8f2406e7c0 2024-02-16T22:18:33.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.620+0000 7f8f12ffd700 1 -- 172.21.15.134:0/1745669730 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f1c007610 con 0x7f8f2406e7c0 2024-02-16T22:18:33.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.620+0000 7f8f2359e700 1 -- 172.21.15.134:0/1745669730 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f24126450 con 0x7f8f2406e7c0 2024-02-16T22:18:33.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.620+0000 7f8f2359e700 1 -- 172.21.15.134:0/1745669730 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f24126990 con 0x7f8f2406e7c0 2024-02-16T22:18:33.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.622+0000 7f8f2359e700 1 -- 172.21.15.134:0/1745669730 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f040052e0 con 0x7f8f2406e7c0 2024-02-16T22:18:33.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.623+0000 7f8f12ffd700 1 -- 172.21.15.134:0/1745669730 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f8f1c007830 con 0x7f8f2406e7c0 2024-02-16T22:18:33.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.623+0000 7f8f12ffd700 1 --2- 172.21.15.134:0/1745669730 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8f0c069490 0x7f8f0c06b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:33.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.624+0000 7f8f12ffd700 1 -- 172.21.15.134:0/1745669730 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8f1c0871b0 con 0x7f8f2406e7c0 2024-02-16T22:18:33.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.624+0000 7f8f21d9b700 1 --2- 172.21.15.134:0/1745669730 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8f0c069490 0x7f8f0c06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:33.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.625+0000 7f8f21d9b700 1 --2- 172.21.15.134:0/1745669730 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8f0c069490 0x7f8f0c06b940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800b3b0 tx=0x7f8f18009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:33.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:33.632+0000 7f8f12ffd700 1 -- 172.21.15.134:0/1745669730 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8f1c04cbd0 con 0x7f8f2406e7c0 2024-02-16T22:18:33.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:33 smithi134 ceph-mon[28869]: Upgrade: Updating mgr.smithi173.kbofaa 2024-02-16T22:18:33.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:33 smithi134 ceph-mon[28869]: Deploying daemon mgr.smithi173.kbofaa on smithi173 2024-02-16T22:18:33.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:33 smithi173 ceph-mon[37280]: Upgrade: Updating mgr.smithi173.kbofaa 2024-02-16T22:18:33.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:33 smithi173 ceph-mon[37280]: Deploying daemon mgr.smithi173.kbofaa on smithi173 2024-02-16T22:18:34.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.201+0000 7f8f2359e700 1 -- 172.21.15.134:0/1745669730 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8f04005da0 con 0x7f8f2406e7c0 2024-02-16T22:18:34.205 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:18:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:18:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 2 2024-02-16T22:18:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:18:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:18:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 2 2024-02-16T22:18:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:18:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:18:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 6 2024-02-16T22:18:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:18:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:18:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:18:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:18:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:18:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 14 2024-02-16T22:18:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:18:34.206 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:18:34.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.203+0000 7f8f12ffd700 1 -- 172.21.15.134:0/1745669730 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f8f1c053470 con 0x7f8f2406e7c0 2024-02-16T22:18:34.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.208+0000 7f8f2359e700 1 -- 172.21.15.134:0/1745669730 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8f0c069490 msgr2=0x7f8f0c06b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:34.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.208+0000 7f8f2359e700 1 --2- 172.21.15.134:0/1745669730 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8f0c069490 0x7f8f0c06b940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800b3b0 tx=0x7f8f18009e30 comp rx=0 tx=0).stop 2024-02-16T22:18:34.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.208+0000 7f8f2359e700 1 -- 172.21.15.134:0/1745669730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f2406e7c0 msgr2=0x7f8f24112aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:34.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.208+0000 7f8f2359e700 1 --2- 172.21.15.134:0/1745669730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f2406e7c0 0x7f8f24112aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00bae0 tx=0x7f8f1c009810 comp rx=0 tx=0).stop 2024-02-16T22:18:34.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.210+0000 7f8f2359e700 1 -- 172.21.15.134:0/1745669730 shutdown_connections 2024-02-16T22:18:34.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.210+0000 7f8f2359e700 1 --2- 172.21.15.134:0/1745669730 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f8f0c069490 0x7f8f0c06b940 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:34.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.210+0000 7f8f2359e700 1 --2- 172.21.15.134:0/1745669730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f2406e7c0 0x7f8f24112aa0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:34.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.210+0000 7f8f2359e700 1 --2- 172.21.15.134:0/1745669730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f2406fd80 0x7f8f24113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:34.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.210+0000 7f8f2359e700 1 -- 172.21.15.134:0/1745669730 >> 172.21.15.134:0/1745669730 conn(0x7f8f24069ec0 msgr2=0x7f8f24106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:34.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.210+0000 7f8f2359e700 1 -- 172.21.15.134:0/1745669730 shutdown_connections 2024-02-16T22:18:34.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.210+0000 7f8f2359e700 1 -- 172.21.15.134:0/1745669730 wait complete. 2024-02-16T22:18:34.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.407+0000 7f113ff37700 1 -- 172.21.15.134:0/4185376507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1138071f10 msgr2=0x7f1138070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:34.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.407+0000 7f113ff37700 1 --2- 172.21.15.134:0/4185376507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1138071f10 0x7f1138070380 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f112c009ce0 tx=0x7f112c004d10 comp rx=0 tx=0).stop 2024-02-16T22:18:34.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.407+0000 7f113ff37700 1 -- 172.21.15.134:0/4185376507 shutdown_connections 2024-02-16T22:18:34.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.407+0000 7f113ff37700 1 --2- 172.21.15.134:0/4185376507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11380708c0 0x7f1138070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:34.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.407+0000 7f113ff37700 1 --2- 172.21.15.134:0/4185376507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1138071f10 0x7f1138070380 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:34.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.407+0000 7f113ff37700 1 -- 172.21.15.134:0/4185376507 >> 172.21.15.134:0/4185376507 conn(0x7f11380f8620 msgr2=0x7f11380faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:34.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.408+0000 7f113ff37700 1 -- 172.21.15.134:0/4185376507 shutdown_connections 2024-02-16T22:18:34.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.408+0000 7f113ff37700 1 -- 172.21.15.134:0/4185376507 wait complete. 2024-02-16T22:18:34.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.409+0000 7f113ff37700 1 Processor -- start 2024-02-16T22:18:34.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.409+0000 7f113ff37700 1 -- start start 2024-02-16T22:18:34.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.409+0000 7f113ff37700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11380708c0 0x7f11381084a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:34.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.409+0000 7f113ff37700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1138071f10 0x7f11381089e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:34.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.409+0000 7f113ff37700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1138109030 con 0x7f11380708c0 2024-02-16T22:18:34.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.409+0000 7f113ff37700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113811dbe0 con 0x7f1138071f10 2024-02-16T22:18:34.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.410+0000 7f113d4d2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1138071f10 0x7f11381089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:34.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.410+0000 7f113d4d2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1138071f10 0x7f11381089e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.134:49538/0 (socket says 172.21.15.134:49538) 2024-02-16T22:18:34.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.410+0000 7f113d4d2700 1 -- 172.21.15.134:0/3521677202 learned_addr learned my addr 172.21.15.134:0/3521677202 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:18:34.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.412+0000 7f113dcd3700 1 --2- 172.21.15.134:0/3521677202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11380708c0 0x7f11381084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:34.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.412+0000 7f113d4d2700 1 -- 172.21.15.134:0/3521677202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11380708c0 msgr2=0x7f11381084a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:34.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.412+0000 7f113d4d2700 1 --2- 172.21.15.134:0/3521677202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11380708c0 0x7f11381084a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:34.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.412+0000 7f113d4d2700 1 -- 172.21.15.134:0/3521677202 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c009940 con 0x7f1138071f10 2024-02-16T22:18:34.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.412+0000 7f113dcd3700 1 --2- 172.21.15.134:0/3521677202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11380708c0 0x7f11381084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:18:34.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.412+0000 7f113d4d2700 1 --2- 172.21.15.134:0/3521677202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1138071f10 0x7f11381089e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1124002a50 tx=0x7f11240046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:34.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.412+0000 7f11367fc700 1 -- 172.21.15.134:0/3521677202 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1124007cc0 con 0x7f1138071f10 2024-02-16T22:18:34.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.412+0000 7f11367fc700 1 -- 172.21.15.134:0/3521677202 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f112400f040 con 0x7f1138071f10 2024-02-16T22:18:34.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.412+0000 7f113ff37700 1 -- 172.21.15.134:0/3521677202 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113811dec0 con 0x7f1138071f10 2024-02-16T22:18:34.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.413+0000 7f113ff37700 1 -- 172.21.15.134:0/3521677202 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113811e400 con 0x7f1138071f10 2024-02-16T22:18:34.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.414+0000 7f11367fc700 1 -- 172.21.15.134:0/3521677202 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f112400d870 con 0x7f1138071f10 2024-02-16T22:18:34.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.415+0000 7f113ff37700 1 -- 172.21.15.134:0/3521677202 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113804bed0 con 0x7f1138071f10 2024-02-16T22:18:34.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.419+0000 7f11367fc700 1 -- 172.21.15.134:0/3521677202 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f1124009400 con 0x7f1138071f10 2024-02-16T22:18:34.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.419+0000 7f11367fc700 1 --2- 172.21.15.134:0/3521677202 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f1128069410 0x7f112806b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:18:34.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.419+0000 7f11367fc700 1 -- 172.21.15.134:0/3521677202 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1124086a80 con 0x7f1138071f10 2024-02-16T22:18:34.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.421+0000 7f113dcd3700 1 --2- 172.21.15.134:0/3521677202 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f1128069410 0x7f112806b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:18:34.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.422+0000 7f113dcd3700 1 --2- 172.21.15.134:0/3521677202 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f1128069410 0x7f112806b8c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f112c0048c0 tx=0x7f112c004d10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:18:34.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.430+0000 7f11367fc700 1 -- 172.21.15.134:0/3521677202 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1124052cc0 con 0x7f1138071f10 2024-02-16T22:18:34.815 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:34 smithi173 ceph-mon[37280]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:34.815 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:34 smithi173 ceph-mon[37280]: pgmap v239: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.7 MiB/s wr, 533 op/s 2024-02-16T22:18:34.815 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:34 smithi173 ceph-mon[37280]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:34.815 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:34 smithi173 ceph-mon[37280]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:34.815 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:34 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/1745669730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:18:34.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.844+0000 7f113ff37700 1 -- 172.21.15.134:0/3521677202 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11381000a0 con 0x7f1128069410 2024-02-16T22:18:34.846 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:34 smithi134 ceph-mon[28869]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:34.847 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:34 smithi134 ceph-mon[28869]: pgmap v239: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.7 MiB/s wr, 533 op/s 2024-02-16T22:18:34.847 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:34 smithi134 ceph-mon[28869]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:34.847 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:34 smithi134 ceph-mon[28869]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:34.847 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:34 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/1745669730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:18:34.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.846+0000 7f11367fc700 1 -- 172.21.15.134:0/3521677202 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f11381000a0 con 0x7f1128069410 2024-02-16T22:18:34.847 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:18:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:18:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:18:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-16T22:18:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-02-16T22:18:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "0/2 daemons upgraded", 2024-02-16T22:18:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mgr daemons", 2024-02-16T22:18:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:18:34.848 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:18:34.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.849+0000 7f113ff37700 1 -- 172.21.15.134:0/3521677202 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f1128069410 msgr2=0x7f112806b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:34.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.849+0000 7f113ff37700 1 --2- 172.21.15.134:0/3521677202 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f1128069410 0x7f112806b8c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f112c0048c0 tx=0x7f112c004d10 comp rx=0 tx=0).stop 2024-02-16T22:18:34.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.849+0000 7f113ff37700 1 -- 172.21.15.134:0/3521677202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1138071f10 msgr2=0x7f11381089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:18:34.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.849+0000 7f113ff37700 1 --2- 172.21.15.134:0/3521677202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1138071f10 0x7f11381089e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1124002a50 tx=0x7f11240046b0 comp rx=0 tx=0).stop 2024-02-16T22:18:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.849+0000 7f113ff37700 1 -- 172.21.15.134:0/3521677202 shutdown_connections 2024-02-16T22:18:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.849+0000 7f113ff37700 1 --2- 172.21.15.134:0/3521677202 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f1128069410 0x7f112806b8c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.849+0000 7f113ff37700 1 --2- 172.21.15.134:0/3521677202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11380708c0 0x7f11381084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.849+0000 7f113ff37700 1 --2- 172.21.15.134:0/3521677202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1138071f10 0x7f11381089e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:18:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.849+0000 7f113ff37700 1 -- 172.21.15.134:0/3521677202 >> 172.21.15.134:0/3521677202 conn(0x7f11380f8620 msgr2=0x7f11380fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:18:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.849+0000 7f113ff37700 1 -- 172.21.15.134:0/3521677202 shutdown_connections 2024-02-16T22:18:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:18:34.849+0000 7f113ff37700 1 -- 172.21.15.134:0/3521677202 wait complete. 2024-02-16T22:18:35.313 INFO:tasks.workunit.client.1.smithi173.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-16T22:18:35.313 INFO:tasks.workunit.client.1.smithi173.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-16T22:18:35.314 INFO:tasks.workunit.client.1.smithi173.stderr:+ make 2024-02-16T22:18:35.417 INFO:tasks.workunit.client.1.smithi173.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-16T22:18:35.617 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:35 smithi173 ceph-mon[37280]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:35.617 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:35 smithi173 ceph-mon[37280]: pgmap v240: 65 pgs: 65 active+clean; 109 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 9.2 MiB/s wr, 659 op/s 2024-02-16T22:18:35.735 INFO:tasks.workunit.client.1.smithi173.stderr:++ readlink -f fsstress 2024-02-16T22:18:35.736 INFO:tasks.workunit.client.1.smithi173.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-16T22:18:35.736 INFO:tasks.workunit.client.1.smithi173.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-16T22:18:35.736 INFO:tasks.workunit.client.1.smithi173.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-16T22:18:35.737 INFO:tasks.workunit.client.1.smithi173.stderr:+ popd 2024-02-16T22:18:35.737 INFO:tasks.workunit.client.1.smithi173.stderr:+ popd 2024-02-16T22:18:35.737 INFO:tasks.workunit.client.1.smithi173.stderr:++ mktemp -d -p . 2024-02-16T22:18:35.739 INFO:tasks.workunit.client.1.smithi173.stderr:+ T=./tmp.GEfnZhx8qB 2024-02-16T22:18:35.739 INFO:tasks.workunit.client.1.smithi173.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.GEfnZhx8qB -l 1 -n 1000 -p 10 -v 2024-02-16T22:18:35.740 INFO:tasks.workunit.client.1.smithi173.stdout:seed = 1707382300 2024-02-16T22:18:35.742 INFO:tasks.workunit.client.1.smithi173.stdout:0/0: chown . 10554 1 2024-02-16T22:18:35.742 INFO:tasks.workunit.client.1.smithi173.stdout:0/1: write - no filename 2024-02-16T22:18:35.742 INFO:tasks.workunit.client.1.smithi173.stdout:0/2: getdents . 0 2024-02-16T22:18:35.742 INFO:tasks.workunit.client.1.smithi173.stdout:0/3: read - no filename 2024-02-16T22:18:35.742 INFO:tasks.workunit.client.1.smithi173.stdout:0/4: chown . 3211154 1 2024-02-16T22:18:35.742 INFO:tasks.workunit.client.1.smithi173.stdout:0/5: chown . 4207 1 2024-02-16T22:18:35.743 INFO:tasks.workunit.client.1.smithi173.stdout:0/6: mkdir d0 0 2024-02-16T22:18:35.743 INFO:tasks.workunit.client.1.smithi173.stdout:0/7: dread - no filename 2024-02-16T22:18:35.743 INFO:tasks.workunit.client.1.smithi173.stdout:0/8: truncate - no filename 2024-02-16T22:18:35.744 INFO:tasks.workunit.client.1.smithi173.stdout:2/0: dwrite - no filename 2024-02-16T22:18:35.744 INFO:tasks.workunit.client.1.smithi173.stdout:2/1: fsync - no filename 2024-02-16T22:18:35.744 INFO:tasks.workunit.client.1.smithi173.stdout:0/9: creat d0/f1 x:0 0 0 2024-02-16T22:18:35.744 INFO:tasks.workunit.client.1.smithi173.stdout:0/10: truncate d0/f1 693868 0 2024-02-16T22:18:35.748 INFO:tasks.workunit.client.1.smithi173.stdout:3/0: getdents . 0 2024-02-16T22:18:35.748 INFO:tasks.workunit.client.1.smithi173.stdout:2/2: symlink l0 0 2024-02-16T22:18:35.748 INFO:tasks.workunit.client.1.smithi173.stdout:0/11: mknod d0/c2 0 2024-02-16T22:18:35.748 INFO:tasks.workunit.client.1.smithi173.stdout:3/1: mknod c0 0 2024-02-16T22:18:35.748 INFO:tasks.workunit.client.1.smithi173.stdout:2/3: creat f1 x:0 0 0 2024-02-16T22:18:35.748 INFO:tasks.workunit.client.1.smithi173.stdout:2/4: truncate f1 547851 0 2024-02-16T22:18:35.748 INFO:tasks.workunit.client.1.smithi173.stdout:2/5: write f1 [913191,101896] 0 2024-02-16T22:18:35.748 INFO:tasks.workunit.client.1.smithi173.stdout:2/6: chown l0 232943636 1 2024-02-16T22:18:35.748 INFO:tasks.workunit.client.1.smithi173.stdout:0/12: symlink d0/l3 0 2024-02-16T22:18:35.749 INFO:tasks.workunit.client.1.smithi173.stdout:5/0: read - no filename 2024-02-16T22:18:35.749 INFO:tasks.workunit.client.1.smithi173.stdout:5/1: write - no filename 2024-02-16T22:18:35.749 INFO:tasks.workunit.client.1.smithi173.stdout:5/2: dwrite - no filename 2024-02-16T22:18:35.749 INFO:tasks.workunit.client.1.smithi173.stdout:5/3: fdatasync - no filename 2024-02-16T22:18:35.749 INFO:tasks.workunit.client.1.smithi173.stdout:5/4: write - no filename 2024-02-16T22:18:35.749 INFO:tasks.workunit.client.1.smithi173.stdout:5/5: read - no filename 2024-02-16T22:18:35.749 INFO:tasks.workunit.client.1.smithi173.stdout:4/0: creat f0 x:0 0 0 2024-02-16T22:18:35.749 INFO:tasks.workunit.client.1.smithi173.stdout:4/1: truncate f0 685422 0 2024-02-16T22:18:35.750 INFO:tasks.workunit.client.1.smithi173.stdout:3/2: creat f1 x:0 0 0 2024-02-16T22:18:35.750 INFO:tasks.workunit.client.1.smithi173.stdout:0/13: mkdir d0/d4 0 2024-02-16T22:18:35.750 INFO:tasks.workunit.client.1.smithi173.stdout:0/14: stat d0/c2 0 2024-02-16T22:18:35.751 INFO:tasks.workunit.client.1.smithi173.stdout:0/15: truncate d0/f1 1271344 0 2024-02-16T22:18:35.751 INFO:tasks.workunit.client.1.smithi173.stdout:0/16: readlink d0/l3 0 2024-02-16T22:18:35.751 INFO:tasks.workunit.client.1.smithi173.stdout:0/17: creat d0/f5 x:0 0 0 2024-02-16T22:18:35.751 INFO:tasks.workunit.client.1.smithi173.stdout:5/6: symlink l0 0 2024-02-16T22:18:35.751 INFO:tasks.workunit.client.1.smithi173.stdout:5/7: chown l0 127830776 1 2024-02-16T22:18:35.752 INFO:tasks.workunit.client.1.smithi173.stdout:0/18: creat d0/d4/f6 x:0 0 0 2024-02-16T22:18:35.754 INFO:tasks.workunit.client.1.smithi173.stdout:6/0: mkdir d0 0 2024-02-16T22:18:35.754 INFO:tasks.workunit.client.1.smithi173.stdout:6/1: stat d0 0 2024-02-16T22:18:35.754 INFO:tasks.workunit.client.1.smithi173.stdout:6/2: write - no filename 2024-02-16T22:18:35.754 INFO:tasks.workunit.client.1.smithi173.stdout:5/8: mknod c1 0 2024-02-16T22:18:35.756 INFO:tasks.workunit.client.1.smithi173.stdout:0/19: link d0/d4/f6 d0/d4/f7 0 2024-02-16T22:18:35.756 INFO:tasks.workunit.client.1.smithi173.stdout:0/20: stat d0/d4/f7 0 2024-02-16T22:18:35.757 INFO:tasks.workunit.client.1.smithi173.stdout:8/0: read - no filename 2024-02-16T22:18:35.757 INFO:tasks.workunit.client.1.smithi173.stdout:8/1: dwrite - no filename 2024-02-16T22:18:35.757 INFO:tasks.workunit.client.1.smithi173.stdout:8/2: stat - no entries 2024-02-16T22:18:35.758 INFO:tasks.workunit.client.1.smithi173.stdout:7/0: symlink l0 0 2024-02-16T22:18:35.758 INFO:tasks.workunit.client.1.smithi173.stdout:7/1: write - no filename 2024-02-16T22:18:35.758 INFO:tasks.workunit.client.1.smithi173.stdout:7/2: fsync - no filename 2024-02-16T22:18:35.759 INFO:tasks.workunit.client.1.smithi173.stdout:5/9: mknod c2 0 2024-02-16T22:18:35.759 INFO:tasks.workunit.client.1.smithi173.stdout:5/10: chown c1 15 1 2024-02-16T22:18:35.759 INFO:tasks.workunit.client.1.smithi173.stdout:5/11: chown l0 31861 1 2024-02-16T22:18:35.760 INFO:tasks.workunit.client.1.smithi173.stdout:5/12: write - no filename 2024-02-16T22:18:35.760 INFO:tasks.workunit.client.1.smithi173.stdout:5/13: dread - no filename 2024-02-16T22:18:35.760 INFO:tasks.workunit.client.1.smithi173.stdout:0/21: link d0/d4/f6 d0/d4/f8 0 2024-02-16T22:18:35.763 INFO:tasks.workunit.client.1.smithi173.stdout:9/0: rename - no filename 2024-02-16T22:18:35.763 INFO:tasks.workunit.client.1.smithi173.stdout:9/1: read - no filename 2024-02-16T22:18:35.763 INFO:tasks.workunit.client.1.smithi173.stdout:9/2: rmdir - no directory 2024-02-16T22:18:35.763 INFO:tasks.workunit.client.1.smithi173.stdout:9/3: dwrite - no filename 2024-02-16T22:18:35.763 INFO:tasks.workunit.client.1.smithi173.stdout:9/4: dread - no filename 2024-02-16T22:18:35.763 INFO:tasks.workunit.client.1.smithi173.stdout:8/3: creat f0 x:0 0 0 2024-02-16T22:18:35.765 INFO:tasks.workunit.client.1.smithi173.stdout:7/3: mkdir d1 0 2024-02-16T22:18:35.765 INFO:tasks.workunit.client.1.smithi173.stdout:7/4: fsync - no filename 2024-02-16T22:18:35.765 INFO:tasks.workunit.client.1.smithi173.stdout:5/14: rename l0 to l3 0 2024-02-16T22:18:35.765 INFO:tasks.workunit.client.1.smithi173.stdout:5/15: write - no filename 2024-02-16T22:18:35.765 INFO:tasks.workunit.client.1.smithi173.stdout:5/16: chown c1 44217587 1 2024-02-16T22:18:35.767 INFO:tasks.workunit.client.1.smithi173.stdout:8/4: link f0 f1 0 2024-02-16T22:18:35.767 INFO:tasks.workunit.client.1.smithi173.stdout:8/5: truncate f1 313975 0 2024-02-16T22:18:35.767 INFO:tasks.workunit.client.1.smithi173.stdout:8/6: creat f2 x:0 0 0 2024-02-16T22:18:35.767 INFO:tasks.workunit.client.1.smithi173.stdout:7/5: mknod d1/c2 0 2024-02-16T22:18:35.767 INFO:tasks.workunit.client.1.smithi173.stdout:7/6: write - no filename 2024-02-16T22:18:35.770 INFO:tasks.workunit.client.1.smithi173.stdout:5/17: creat f4 x:0 0 0 2024-02-16T22:18:35.771 INFO:tasks.workunit.client.1.smithi173.stdout:8/7: mknod c3 0 2024-02-16T22:18:35.771 INFO:tasks.workunit.client.1.smithi173.stdout:8/8: creat f4 x:0 0 0 2024-02-16T22:18:35.771 INFO:tasks.workunit.client.1.smithi173.stdout:8/9: creat f5 x:0 0 0 2024-02-16T22:18:35.772 INFO:tasks.workunit.client.1.smithi173.stdout:7/7: mkdir d1/d3 0 2024-02-16T22:18:35.774 INFO:tasks.workunit.client.1.smithi173.stdout:5/18: mknod c5 0 2024-02-16T22:18:35.779 INFO:tasks.workunit.client.1.smithi173.stdout:7/8: creat d1/d3/f4 x:0 0 0 2024-02-16T22:18:35.779 INFO:tasks.workunit.client.1.smithi173.stdout:8/10: rename f0 to f6 0 2024-02-16T22:18:35.779 INFO:tasks.workunit.client.1.smithi173.stdout:5/19: rename c2 to c6 0 2024-02-16T22:18:35.779 INFO:tasks.workunit.client.1.smithi173.stdout:5/20: write f4 [630514,99670] 0 2024-02-16T22:18:35.779 INFO:tasks.workunit.client.1.smithi173.stdout:5/21: truncate f4 1239706 0 2024-02-16T22:18:35.779 INFO:tasks.workunit.client.1.smithi173.stdout:5/22: creat f7 x:0 0 0 2024-02-16T22:18:35.780 INFO:tasks.workunit.client.1.smithi173.stdout:8/11: mknod c7 0 2024-02-16T22:18:35.785 INFO:tasks.workunit.client.1.smithi173.stdout:8/12: symlink l8 0 2024-02-16T22:18:35.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:35 smithi134 ceph-mon[28869]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:18:35.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:35 smithi134 ceph-mon[28869]: pgmap v240: 65 pgs: 65 active+clean; 109 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 9.2 MiB/s wr, 659 op/s 2024-02-16T22:18:36.003 INFO:tasks.workunit.client.1.smithi173.stdout:4/2: dread f0 [0,4194304] 0 2024-02-16T22:18:36.003 INFO:tasks.workunit.client.1.smithi173.stdout:4/3: stat f0 0 2024-02-16T22:18:36.073 INFO:tasks.workunit.client.1.smithi173.stdout:5/23: getdents . 0 2024-02-16T22:18:36.073 INFO:tasks.workunit.client.1.smithi173.stdout:5/24: truncate f4 1842461 0 2024-02-16T22:18:36.073 INFO:tasks.workunit.client.1.smithi173.stdout:5/25: readlink l3 0 2024-02-16T22:18:36.320 INFO:tasks.workunit.client.1.smithi173.stdout:0/22: dwrite d0/d4/f6 [0,4194304] 0 2024-02-16T22:18:36.331 INFO:tasks.workunit.client.1.smithi173.stdout:2/7: fdatasync f1 0 2024-02-16T22:18:36.773 INFO:tasks.workunit.client.1.smithi173.stdout:8/13: dwrite f5 [0,4194304] 0 2024-02-16T22:18:36.774 INFO:tasks.workunit.client.1.smithi173.stdout:8/14: creat f9 x:0 0 0 2024-02-16T22:18:36.870 INFO:tasks.workunit.client.1.smithi173.stdout:5/26: mkdir d8 0 2024-02-16T22:18:36.978 INFO:tasks.workunit.client.1.smithi173.stdout:5/27: fsync f4 0 2024-02-16T22:18:36.978 INFO:tasks.workunit.client.1.smithi173.stdout:5/28: write f7 [859956,39473] 0 2024-02-16T22:18:37.394 INFO:tasks.workunit.client.1.smithi173.stdout:7/9: dwrite d1/d3/f4 [0,4194304] 0 2024-02-16T22:18:37.500 INFO:tasks.workunit.client.1.smithi173.stdout:2/8: dwrite f1 [0,4194304] 0 2024-02-16T22:18:37.501 INFO:tasks.workunit.client.1.smithi173.stdout:2/9: fdatasync f1 0 2024-02-16T22:18:37.501 INFO:tasks.workunit.client.1.smithi173.stdout:2/10: stat f1 0 2024-02-16T22:18:37.514 INFO:tasks.workunit.client.1.smithi173.stdout:2/11: dwrite f1 [0,4194304] 0 2024-02-16T22:18:37.522 INFO:tasks.workunit.client.1.smithi173.stdout:2/12: dread f1 [0,4194304] 0 2024-02-16T22:18:37.524 INFO:tasks.workunit.client.1.smithi173.stdout:2/13: dread f1 [0,4194304] 0 2024-02-16T22:18:37.527 INFO:tasks.workunit.client.1.smithi173.stdout:2/14: dread f1 [0,4194304] 0 2024-02-16T22:18:37.816 INFO:tasks.workunit.client.1.smithi173.stdout:0/23: symlink d0/l9 0 2024-02-16T22:18:37.817 INFO:tasks.workunit.client.1.smithi173.stdout:0/24: chown d0/d4 85 1 2024-02-16T22:18:37.817 INFO:tasks.workunit.client.1.smithi173.stdout:0/25: creat d0/d4/fa x:0 0 0 2024-02-16T22:18:37.817 INFO:tasks.workunit.client.1.smithi173.stdout:0/26: creat d0/fb x:0 0 0 2024-02-16T22:18:37.817 INFO:tasks.workunit.client.1.smithi173.stdout:0/27: dread - d0/f5 zero size 2024-02-16T22:18:37.817 INFO:tasks.workunit.client.1.smithi173.stdout:0/28: creat d0/d4/fc x:0 0 0 2024-02-16T22:18:38.249 INFO:tasks.workunit.client.1.smithi173.stdout:4/4: getdents . 0 2024-02-16T22:18:38.705 INFO:tasks.workunit.client.1.smithi173.stdout:8/15: mknod ca 0 2024-02-16T22:18:38.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:38 smithi134 ceph-mon[28869]: pgmap v241: 65 pgs: 65 active+clean; 136 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 8.2 MiB/s wr, 706 op/s 2024-02-16T22:18:38.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:38 smithi173 ceph-mon[37280]: pgmap v241: 65 pgs: 65 active+clean; 136 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 8.2 MiB/s wr, 706 op/s 2024-02-16T22:18:39.256 INFO:tasks.workunit.client.1.smithi173.stdout:5/29: link c5 d8/c9 0 2024-02-16T22:18:39.257 INFO:tasks.workunit.client.1.smithi173.stdout:5/30: fsync f7 0 2024-02-16T22:18:39.261 INFO:tasks.workunit.client.1.smithi173.stdout:5/31: dread f7 [0,4194304] 0 2024-02-16T22:18:39.261 INFO:tasks.workunit.client.1.smithi173.stdout:5/32: chown c1 994 1 2024-02-16T22:18:39.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:39 smithi134 ceph-mon[28869]: pgmap v242: 65 pgs: 65 active+clean; 161 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 8.5 MiB/s wr, 870 op/s 2024-02-16T22:18:39.980 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:39 smithi173 ceph-mon[37280]: pgmap v242: 65 pgs: 65 active+clean; 161 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 8.5 MiB/s wr, 870 op/s 2024-02-16T22:18:40.096 INFO:tasks.workunit.client.1.smithi173.stdout:2/15: mkdir d2 0 2024-02-16T22:18:40.102 INFO:tasks.workunit.client.1.smithi173.stdout:4/5: link f0 f1 0 2024-02-16T22:18:40.102 INFO:tasks.workunit.client.1.smithi173.stdout:4/6: truncate f1 869576 0 2024-02-16T22:18:40.103 INFO:tasks.workunit.client.1.smithi173.stdout:8/16: rename c7 to cb 0 2024-02-16T22:18:40.103 INFO:tasks.workunit.client.1.smithi173.stdout:8/17: creat fc x:0 0 0 2024-02-16T22:18:40.103 INFO:tasks.workunit.client.1.smithi173.stdout:8/18: write f9 [967165,11124] 0 2024-02-16T22:18:40.105 INFO:tasks.workunit.client.1.smithi173.stdout:5/33: mkdir d8/da 0 2024-02-16T22:18:40.107 INFO:tasks.workunit.client.1.smithi173.stdout:2/16: symlink d2/l3 0 2024-02-16T22:18:40.108 INFO:tasks.workunit.client.1.smithi173.stdout:0/29: rename d0/d4/fc to d0/fd 0 2024-02-16T22:18:40.108 INFO:tasks.workunit.client.1.smithi173.stdout:0/30: creat d0/d4/fe x:0 0 0 2024-02-16T22:18:40.108 INFO:tasks.workunit.client.1.smithi173.stdout:0/31: chown d0/fb 14 1 2024-02-16T22:18:40.109 INFO:tasks.workunit.client.1.smithi173.stdout:4/7: symlink l2 0 2024-02-16T22:18:40.111 INFO:tasks.workunit.client.1.smithi173.stdout:8/19: unlink f6 0 2024-02-16T22:18:40.113 INFO:tasks.workunit.client.1.smithi173.stdout:5/34: creat d8/fb x:0 0 0 2024-02-16T22:18:40.113 INFO:tasks.workunit.client.1.smithi173.stdout:7/10: rename d1/d3 to d1/d5 0 2024-02-16T22:18:40.114 INFO:tasks.workunit.client.1.smithi173.stdout:2/17: mkdir d2/d4 0 2024-02-16T22:18:40.116 INFO:tasks.workunit.client.1.smithi173.stdout:4/8: creat f3 x:0 0 0 2024-02-16T22:18:40.118 INFO:tasks.workunit.client.1.smithi173.stdout:2/18: dread f1 [0,4194304] 0 2024-02-16T22:18:40.119 INFO:tasks.workunit.client.1.smithi173.stdout:7/11: rename l0 to d1/d5/l6 0 2024-02-16T22:18:40.121 INFO:tasks.workunit.client.1.smithi173.stdout:4/9: unlink f0 0 2024-02-16T22:18:40.123 INFO:tasks.workunit.client.1.smithi173.stdout:2/19: symlink d2/l5 0 2024-02-16T22:18:40.123 INFO:tasks.workunit.client.1.smithi173.stdout:2/20: chown l0 121769 1 2024-02-16T22:18:40.126 INFO:tasks.workunit.client.1.smithi173.stdout:4/10: dread f1 [0,4194304] 0 2024-02-16T22:18:40.126 INFO:tasks.workunit.client.1.smithi173.stdout:2/21: unlink l0 0 2024-02-16T22:18:40.127 INFO:tasks.workunit.client.1.smithi173.stdout:0/32: dwrite d0/d4/f7 [0,4194304] 0 2024-02-16T22:18:40.128 INFO:tasks.workunit.client.1.smithi173.stdout:4/11: rename f3 to f4 0 2024-02-16T22:18:40.148 INFO:tasks.workunit.client.1.smithi173.stdout:8/20: dwrite f4 [0,4194304] 0 2024-02-16T22:18:40.148 INFO:tasks.workunit.client.1.smithi173.stdout:2/22: dwrite f1 [0,4194304] 0 2024-02-16T22:18:40.151 INFO:tasks.workunit.client.1.smithi173.stdout:2/23: creat d2/d4/f6 x:0 0 0 2024-02-16T22:18:40.167 INFO:tasks.workunit.client.1.smithi173.stdout:8/21: dwrite f5 [0,4194304] 0 2024-02-16T22:18:40.174 INFO:tasks.workunit.client.1.smithi173.stdout:8/22: dread f5 [0,4194304] 0 2024-02-16T22:18:40.175 INFO:tasks.workunit.client.1.smithi173.stdout:2/24: dwrite d2/d4/f6 [0,4194304] 0 2024-02-16T22:18:40.175 INFO:tasks.workunit.client.1.smithi173.stdout:2/25: creat d2/d4/f7 x:0 0 0 2024-02-16T22:18:40.196 INFO:tasks.workunit.client.1.smithi173.stdout:8/23: dwrite f2 [0,4194304] 0 2024-02-16T22:18:40.196 INFO:tasks.workunit.client.1.smithi173.stdout:2/26: dwrite f1 [0,4194304] 0 2024-02-16T22:18:40.197 INFO:tasks.workunit.client.1.smithi173.stdout:2/27: dread - d2/d4/f7 zero size 2024-02-16T22:18:40.198 INFO:tasks.workunit.client.1.smithi173.stdout:8/24: mkdir dd 0 2024-02-16T22:18:40.199 INFO:tasks.workunit.client.1.smithi173.stdout:2/28: mkdir d2/d4/d8 0 2024-02-16T22:18:40.199 INFO:tasks.workunit.client.1.smithi173.stdout:2/29: getdents d2/d4/d8 0 2024-02-16T22:18:40.200 INFO:tasks.workunit.client.1.smithi173.stdout:8/25: symlink dd/le 0 2024-02-16T22:18:40.201 INFO:tasks.workunit.client.1.smithi173.stdout:2/30: symlink d2/d4/d8/l9 0 2024-02-16T22:18:40.391 INFO:tasks.workunit.client.1.smithi173.stdout:0/33: getdents d0 0 2024-02-16T22:18:40.391 INFO:tasks.workunit.client.1.smithi173.stdout:5/35: fsync d8/fb 0 2024-02-16T22:18:40.391 INFO:tasks.workunit.client.1.smithi173.stdout:5/36: chown c1 3 1 2024-02-16T22:18:40.391 INFO:tasks.workunit.client.1.smithi173.stdout:7/12: rename d1/d5/l6 to d1/l7 0 2024-02-16T22:18:40.395 INFO:tasks.workunit.client.1.smithi173.stdout:0/34: creat d0/ff x:0 0 0 2024-02-16T22:18:40.395 INFO:tasks.workunit.client.1.smithi173.stdout:0/35: creat d0/f10 x:0 0 0 2024-02-16T22:18:40.396 INFO:tasks.workunit.client.1.smithi173.stdout:0/36: chown d0/f5 376681 1 2024-02-16T22:18:40.396 INFO:tasks.workunit.client.1.smithi173.stdout:0/37: write d0/d4/fa [239850,18613] 0 2024-02-16T22:18:40.396 INFO:tasks.workunit.client.1.smithi173.stdout:0/38: creat d0/f11 x:0 0 0 2024-02-16T22:18:40.396 INFO:tasks.workunit.client.1.smithi173.stdout:0/39: read d0/f1 [605724,116946] 0 2024-02-16T22:18:40.396 INFO:tasks.workunit.client.1.smithi173.stdout:5/37: creat d8/da/fc x:0 0 0 2024-02-16T22:18:40.396 INFO:tasks.workunit.client.1.smithi173.stdout:5/38: creat d8/fd x:0 0 0 2024-02-16T22:18:40.399 INFO:tasks.workunit.client.1.smithi173.stdout:7/13: creat d1/d5/f8 x:0 0 0 2024-02-16T22:18:40.399 INFO:tasks.workunit.client.1.smithi173.stdout:7/14: stat d1 0 2024-02-16T22:18:40.402 INFO:tasks.workunit.client.1.smithi173.stdout:4/12: rename f4 to f5 0 2024-02-16T22:18:40.404 INFO:tasks.workunit.client.1.smithi173.stdout:2/31: write d2/d4/f6 [4802253,72930] 0 2024-02-16T22:18:40.404 INFO:tasks.workunit.client.1.smithi173.stdout:2/32: readlink d2/l3 0 2024-02-16T22:18:40.404 INFO:tasks.workunit.client.1.smithi173.stdout:2/33: read - d2/d4/f7 zero size 2024-02-16T22:18:40.407 INFO:tasks.workunit.client.1.smithi173.stdout:0/40: mkdir d0/d12 0 2024-02-16T22:18:40.409 INFO:tasks.workunit.client.1.smithi173.stdout:5/39: mknod d8/da/ce 0 2024-02-16T22:18:40.410 INFO:tasks.workunit.client.1.smithi173.stdout:5/40: truncate d8/fd 337490 0 2024-02-16T22:18:40.410 INFO:tasks.workunit.client.1.smithi173.stdout:5/41: creat d8/da/ff x:0 0 0 2024-02-16T22:18:40.410 INFO:tasks.workunit.client.1.smithi173.stdout:5/42: write d8/fb [120373,78689] 0 2024-02-16T22:18:40.410 INFO:tasks.workunit.client.1.smithi173.stdout:5/43: dread - d8/da/ff zero size 2024-02-16T22:18:40.411 INFO:tasks.workunit.client.1.smithi173.stdout:7/15: creat d1/f9 x:0 0 0 2024-02-16T22:18:40.416 INFO:tasks.workunit.client.1.smithi173.stdout:2/34: link d2/d4/d8/l9 d2/d4/d8/la 0 2024-02-16T22:18:40.419 INFO:tasks.workunit.client.1.smithi173.stdout:8/26: dwrite f4 [4194304,4194304] 0 2024-02-16T22:18:40.419 INFO:tasks.workunit.client.1.smithi173.stdout:0/41: symlink d0/d12/l13 0 2024-02-16T22:18:40.420 INFO:tasks.workunit.client.1.smithi173.stdout:5/44: symlink d8/l10 0 2024-02-16T22:18:40.420 INFO:tasks.workunit.client.1.smithi173.stdout:5/45: chown f7 179 1 2024-02-16T22:18:40.420 INFO:tasks.workunit.client.1.smithi173.stdout:5/46: creat d8/da/f11 x:0 0 0 2024-02-16T22:18:40.420 INFO:tasks.workunit.client.1.smithi173.stdout:5/47: creat d8/da/f12 x:0 0 0 2024-02-16T22:18:40.421 INFO:tasks.workunit.client.1.smithi173.stdout:5/48: dread - d8/da/f11 zero size 2024-02-16T22:18:40.421 INFO:tasks.workunit.client.1.smithi173.stdout:2/35: mkdir d2/db 0 2024-02-16T22:18:40.424 INFO:tasks.workunit.client.1.smithi173.stdout:0/42: mkdir d0/d4/d14 0 2024-02-16T22:18:40.427 INFO:tasks.workunit.client.1.smithi173.stdout:2/36: mkdir d2/dc 0 2024-02-16T22:18:40.428 INFO:tasks.workunit.client.1.smithi173.stdout:8/27: creat dd/ff x:0 0 0 2024-02-16T22:18:40.429 INFO:tasks.workunit.client.1.smithi173.stdout:2/37: mknod d2/dc/cd 0 2024-02-16T22:18:40.430 INFO:tasks.workunit.client.1.smithi173.stdout:8/28: link dd/le dd/l10 0 2024-02-16T22:18:40.493 INFO:tasks.workunit.client.1.smithi173.stdout:0/43: dread d0/d4/fa [0,4194304] 0 2024-02-16T22:18:40.494 INFO:tasks.workunit.client.1.smithi173.stdout:0/44: dread d0/d4/fa [0,4194304] 0 2024-02-16T22:18:40.496 INFO:tasks.workunit.client.1.smithi173.stdout:0/45: mkdir d0/d12/d15 0 2024-02-16T22:18:40.497 INFO:tasks.workunit.client.1.smithi173.stdout:0/46: creat d0/d4/d14/f16 x:0 0 0 2024-02-16T22:18:40.498 INFO:tasks.workunit.client.1.smithi173.stdout:0/47: mknod d0/d12/d15/c17 0 2024-02-16T22:18:40.502 INFO:tasks.workunit.client.1.smithi173.stdout:7/16: dwrite d1/d5/f8 [0,4194304] 0 2024-02-16T22:18:40.502 INFO:tasks.workunit.client.1.smithi173.stdout:7/17: chown d1/d5/f4 31 1 2024-02-16T22:18:40.502 INFO:tasks.workunit.client.1.smithi173.stdout:2/38: dwrite d2/d4/f7 [0,4194304] 0 2024-02-16T22:18:40.510 INFO:tasks.workunit.client.1.smithi173.stdout:2/39: rmdir d2/dc 39 2024-02-16T22:18:40.512 INFO:tasks.workunit.client.1.smithi173.stdout:7/18: write d1/d5/f8 [1752904,41571] 0 2024-02-16T22:18:40.515 INFO:tasks.workunit.client.1.smithi173.stdout:2/40: mkdir d2/db/de 0 2024-02-16T22:18:40.517 INFO:tasks.workunit.client.1.smithi173.stdout:4/13: dwrite f5 [0,4194304] 0 2024-02-16T22:18:40.518 INFO:tasks.workunit.client.1.smithi173.stdout:5/49: getdents d8/da 0 2024-02-16T22:18:40.524 INFO:tasks.workunit.client.1.smithi173.stdout:8/29: truncate f9 57774 0 2024-02-16T22:18:40.525 INFO:tasks.workunit.client.1.smithi173.stdout:4/14: write f1 [56147,113411] 0 2024-02-16T22:18:40.525 INFO:tasks.workunit.client.1.smithi173.stdout:4/15: write f1 [460773,12433] 0 2024-02-16T22:18:40.531 INFO:tasks.workunit.client.1.smithi173.stdout:5/50: rename d8/c9 to d8/da/c13 0 2024-02-16T22:18:40.533 INFO:tasks.workunit.client.1.smithi173.stdout:0/48: rmdir d0/d4 39 2024-02-16T22:18:40.533 INFO:tasks.workunit.client.1.smithi173.stdout:0/49: write d0/f11 [947547,92628] 0 2024-02-16T22:18:40.533 INFO:tasks.workunit.client.1.smithi173.stdout:0/50: truncate d0/f10 246112 0 2024-02-16T22:18:40.535 INFO:tasks.workunit.client.1.smithi173.stdout:8/30: truncate fc 517945 0 2024-02-16T22:18:40.535 INFO:tasks.workunit.client.1.smithi173.stdout:8/31: readlink dd/l10 0 2024-02-16T22:18:40.536 INFO:tasks.workunit.client.1.smithi173.stdout:5/51: dread f4 [0,4194304] 0 2024-02-16T22:18:40.536 INFO:tasks.workunit.client.1.smithi173.stdout:5/52: creat d8/f14 x:0 0 0 2024-02-16T22:18:40.536 INFO:tasks.workunit.client.1.smithi173.stdout:5/53: truncate d8/fb 736132 0 2024-02-16T22:18:40.536 INFO:tasks.workunit.client.1.smithi173.stdout:2/41: dwrite d2/d4/f6 [0,4194304] 0 2024-02-16T22:18:40.545 INFO:tasks.workunit.client.1.smithi173.stdout:2/42: read f1 [898994,70112] 0 2024-02-16T22:18:40.545 INFO:tasks.workunit.client.1.smithi173.stdout:2/43: fsync d2/d4/f7 0 2024-02-16T22:18:40.549 INFO:tasks.workunit.client.1.smithi173.stdout:0/51: rename d0/fd to d0/d4/f18 0 2024-02-16T22:18:40.549 INFO:tasks.workunit.client.1.smithi173.stdout:0/52: write d0/d4/f18 [304774,101217] 0 2024-02-16T22:18:40.550 INFO:tasks.workunit.client.1.smithi173.stdout:8/32: mkdir dd/d11 0 2024-02-16T22:18:40.554 INFO:tasks.workunit.client.1.smithi173.stdout:2/44: dread d2/d4/f7 [0,4194304] 0 2024-02-16T22:18:40.554 INFO:tasks.workunit.client.1.smithi173.stdout:4/16: truncate f5 3719716 0 2024-02-16T22:18:40.556 INFO:tasks.workunit.client.1.smithi173.stdout:2/45: dread d2/d4/f6 [4194304,4194304] 0 2024-02-16T22:18:40.572 INFO:tasks.workunit.client.1.smithi173.stdout:4/17: dwrite f1 [0,4194304] 0 2024-02-16T22:18:40.582 INFO:tasks.workunit.client.1.smithi173.stdout:4/18: dread f5 [0,4194304] 0 2024-02-16T22:18:40.671 INFO:tasks.workunit.client.1.smithi173.stdout:0/53: mknod d0/d12/c19 0 2024-02-16T22:18:40.671 INFO:tasks.workunit.client.1.smithi173.stdout:8/33: creat dd/d11/f12 x:0 0 0 2024-02-16T22:18:40.671 INFO:tasks.workunit.client.1.smithi173.stdout:8/34: creat dd/d11/f13 x:0 0 0 2024-02-16T22:18:40.672 INFO:tasks.workunit.client.1.smithi173.stdout:2/46: getdents d2/db 0 2024-02-16T22:18:40.674 INFO:tasks.workunit.client.1.smithi173.stdout:4/19: mknod c6 0 2024-02-16T22:18:40.674 INFO:tasks.workunit.client.1.smithi173.stdout:4/20: chown c6 1768 1 2024-02-16T22:18:40.678 INFO:tasks.workunit.client.1.smithi173.stdout:4/21: write f5 [2806312,12685] 0 2024-02-16T22:18:40.681 INFO:tasks.workunit.client.1.smithi173.stdout:2/47: write d2/d4/f6 [1579821,51194] 0 2024-02-16T22:18:40.682 INFO:tasks.workunit.client.1.smithi173.stdout:2/48: creat d2/ff x:0 0 0 2024-02-16T22:18:40.682 INFO:tasks.workunit.client.1.smithi173.stdout:2/49: truncate d2/ff 138321 0 2024-02-16T22:18:40.682 INFO:tasks.workunit.client.1.smithi173.stdout:2/50: write f1 [2623865,107091] 0 2024-02-16T22:18:40.682 INFO:tasks.workunit.client.1.smithi173.stdout:2/51: stat d2/l5 0 2024-02-16T22:18:40.683 INFO:tasks.workunit.client.1.smithi173.stdout:2/52: mkdir d2/d10 0 2024-02-16T22:18:40.684 INFO:tasks.workunit.client.1.smithi173.stdout:2/53: mknod d2/db/c11 0 2024-02-16T22:18:40.685 INFO:tasks.workunit.client.1.smithi173.stdout:2/54: symlink d2/d10/l12 0 2024-02-16T22:18:40.702 INFO:tasks.workunit.client.1.smithi173.stdout:2/55: dwrite d2/d4/f7 [4194304,4194304] 0 2024-02-16T22:18:40.703 INFO:tasks.workunit.client.1.smithi173.stdout:2/56: mknod d2/d10/c13 0 2024-02-16T22:18:40.710 INFO:tasks.workunit.client.1.smithi173.stdout:0/54: rmdir d0 39 2024-02-16T22:18:40.711 INFO:tasks.workunit.client.1.smithi173.stdout:0/55: dread - d0/fb zero size 2024-02-16T22:18:40.711 INFO:tasks.workunit.client.1.smithi173.stdout:0/56: symlink d0/d4/d14/l1a 0 2024-02-16T22:18:40.712 INFO:tasks.workunit.client.1.smithi173.stdout:0/57: dread d0/f10 [0,4194304] 0 2024-02-16T22:18:40.712 INFO:tasks.workunit.client.1.smithi173.stdout:0/58: write d0/f10 [920541,76679] 0 2024-02-16T22:18:40.713 INFO:tasks.workunit.client.1.smithi173.stdout:8/35: truncate f1 913 0 2024-02-16T22:18:40.713 INFO:tasks.workunit.client.1.smithi173.stdout:8/36: creat dd/d11/f14 x:0 0 0 2024-02-16T22:18:40.715 INFO:tasks.workunit.client.1.smithi173.stdout:0/59: rename d0/d12/l13 to d0/d4/d14/l1b 0 2024-02-16T22:18:40.715 INFO:tasks.workunit.client.1.smithi173.stdout:0/60: dread - d0/f5 zero size 2024-02-16T22:18:40.717 INFO:tasks.workunit.client.1.smithi173.stdout:0/61: creat d0/d12/d15/f1c x:0 0 0 2024-02-16T22:18:40.719 INFO:tasks.workunit.client.1.smithi173.stdout:2/57: truncate d2/d4/f6 1718494 0 2024-02-16T22:18:40.722 INFO:tasks.workunit.client.1.smithi173.stdout:8/37: getdents dd/d11 0 2024-02-16T22:18:40.722 INFO:tasks.workunit.client.1.smithi173.stdout:8/38: write f9 [983628,24207] 0 2024-02-16T22:18:40.732 INFO:tasks.workunit.client.1.smithi173.stdout:0/62: dwrite d0/d4/f7 [4194304,4194304] 0 2024-02-16T22:18:40.758 INFO:tasks.workunit.client.1.smithi173.stdout:8/39: mknod dd/c15 0 2024-02-16T22:18:40.758 INFO:tasks.workunit.client.1.smithi173.stdout:8/40: creat dd/f16 x:0 0 0 2024-02-16T22:18:40.763 INFO:tasks.workunit.client.1.smithi173.stdout:8/41: unlink dd/d11/f12 0 2024-02-16T22:18:40.763 INFO:tasks.workunit.client.1.smithi173.stdout:8/42: write fc [941850,50060] 0 2024-02-16T22:18:40.763 INFO:tasks.workunit.client.1.smithi173.stdout:8/43: rename dd/d11 to dd/d11/d17 22 2024-02-16T22:18:40.763 INFO:tasks.workunit.client.1.smithi173.stdout:2/58: dread d2/d4/f6 [0,4194304] 0 2024-02-16T22:18:40.765 INFO:tasks.workunit.client.1.smithi173.stdout:8/44: link dd/l10 dd/d11/l18 0 2024-02-16T22:18:40.766 INFO:tasks.workunit.client.1.smithi173.stdout:2/59: mknod d2/db/de/c14 0 2024-02-16T22:18:40.768 INFO:tasks.workunit.client.1.smithi173.stdout:2/60: getdents d2/d4 0 2024-02-16T22:18:40.769 INFO:tasks.workunit.client.1.smithi173.stdout:2/61: creat d2/db/f15 x:0 0 0 2024-02-16T22:18:40.769 INFO:tasks.workunit.client.1.smithi173.stdout:2/62: write d2/ff [828722,74717] 0 2024-02-16T22:18:40.770 INFO:tasks.workunit.client.1.smithi173.stdout:0/63: truncate d0/d4/f8 5797726 0 2024-02-16T22:18:40.770 INFO:tasks.workunit.client.1.smithi173.stdout:2/63: creat d2/db/de/f16 x:0 0 0 2024-02-16T22:18:40.771 INFO:tasks.workunit.client.1.smithi173.stdout:2/64: creat d2/f17 x:0 0 0 2024-02-16T22:18:40.771 INFO:tasks.workunit.client.1.smithi173.stdout:8/45: dread f9 [0,4194304] 0 2024-02-16T22:18:40.772 INFO:tasks.workunit.client.1.smithi173.stdout:8/46: fdatasync dd/ff 0 2024-02-16T22:18:40.772 INFO:tasks.workunit.client.1.smithi173.stdout:8/47: dread - dd/d11/f14 zero size 2024-02-16T22:18:40.772 INFO:tasks.workunit.client.1.smithi173.stdout:0/64: unlink d0/l3 0 2024-02-16T22:18:40.772 INFO:tasks.workunit.client.1.smithi173.stdout:0/65: read d0/d4/f18 [362298,84093] 0 2024-02-16T22:18:40.772 INFO:tasks.workunit.client.1.smithi173.stdout:2/65: stat d2/d4/d8/l9 0 2024-02-16T22:18:40.774 INFO:tasks.workunit.client.1.smithi173.stdout:8/48: rename ca to dd/c19 0 2024-02-16T22:18:40.774 INFO:tasks.workunit.client.1.smithi173.stdout:0/66: rename d0/d12/d15 to d0/d12/d15/d1d 22 2024-02-16T22:18:40.849 INFO:tasks.workunit.client.1.smithi173.stdout:8/49: dwrite f5 [4194304,4194304] 0 2024-02-16T22:18:40.849 INFO:tasks.workunit.client.1.smithi173.stdout:8/50: fdatasync f5 0 2024-02-16T22:18:40.850 INFO:tasks.workunit.client.1.smithi173.stdout:8/51: getdents dd/d11 0 2024-02-16T22:18:40.850 INFO:tasks.workunit.client.1.smithi173.stdout:8/52: write f9 [1161024,2255] 0 2024-02-16T22:18:40.850 INFO:tasks.workunit.client.1.smithi173.stdout:8/53: chown f9 33222118 1 2024-02-16T22:18:40.854 INFO:tasks.workunit.client.1.smithi173.stdout:0/67: rename d0/d4/f6 to d0/f1e 0 2024-02-16T22:18:40.854 INFO:tasks.workunit.client.1.smithi173.stdout:2/66: dread d2/ff [0,4194304] 0 2024-02-16T22:18:40.854 INFO:tasks.workunit.client.1.smithi173.stdout:2/67: truncate d2/db/de/f16 912141 0 2024-02-16T22:18:40.854 INFO:tasks.workunit.client.1.smithi173.stdout:2/68: write d2/db/de/f16 [1825034,73072] 0 2024-02-16T22:18:40.855 INFO:tasks.workunit.client.1.smithi173.stdout:8/54: dread f5 [0,4194304] 0 2024-02-16T22:18:40.866 INFO:tasks.workunit.client.1.smithi173.stdout:8/55: write f4 [4160918,3834] 0 2024-02-16T22:18:40.866 INFO:tasks.workunit.client.1.smithi173.stdout:8/56: getdents dd/d11 0 2024-02-16T22:18:40.872 INFO:tasks.workunit.client.1.smithi173.stdout:0/68: dwrite d0/d4/fa [0,4194304] 0 2024-02-16T22:18:40.878 INFO:tasks.workunit.client.1.smithi173.stdout:8/57: write f2 [1907011,85750] 0 2024-02-16T22:18:40.879 INFO:tasks.workunit.client.1.smithi173.stdout:8/58: getdents dd 0 2024-02-16T22:18:40.880 INFO:tasks.workunit.client.1.smithi173.stdout:8/59: creat dd/d11/f1a x:0 0 0 2024-02-16T22:18:40.881 INFO:tasks.workunit.client.1.smithi173.stdout:8/60: chown dd/le 0 1 2024-02-16T22:18:40.883 INFO:tasks.workunit.client.1.smithi173.stdout:8/61: dread fc [0,4194304] 0 2024-02-16T22:18:40.883 INFO:tasks.workunit.client.1.smithi173.stdout:8/62: rmdir dd 39 2024-02-16T22:18:40.884 INFO:tasks.workunit.client.1.smithi173.stdout:8/63: dread - dd/f16 zero size 2024-02-16T22:18:40.885 INFO:tasks.workunit.client.1.smithi173.stdout:8/64: symlink dd/l1b 0 2024-02-16T22:18:40.886 INFO:tasks.workunit.client.1.smithi173.stdout:8/65: rename f1 to dd/d11/f1c 0 2024-02-16T22:18:40.887 INFO:tasks.workunit.client.1.smithi173.stdout:8/66: mknod dd/c1d 0 2024-02-16T22:18:40.887 INFO:tasks.workunit.client.1.smithi173.stdout:8/67: symlink dd/d11/l1e 0 2024-02-16T22:18:40.888 INFO:tasks.workunit.client.1.smithi173.stdout:0/69: dwrite d0/f11 [0,4194304] 0 2024-02-16T22:18:40.888 INFO:tasks.workunit.client.1.smithi173.stdout:0/70: truncate d0/fb 375290 0 2024-02-16T22:18:40.888 INFO:tasks.workunit.client.1.smithi173.stdout:0/71: write d0/d4/d14/f16 [444005,64251] 0 2024-02-16T22:18:40.889 INFO:tasks.workunit.client.1.smithi173.stdout:8/68: mknod dd/c1f 0 2024-02-16T22:18:40.889 INFO:tasks.workunit.client.1.smithi173.stdout:8/69: fdatasync dd/d11/f13 0 2024-02-16T22:18:40.889 INFO:tasks.workunit.client.1.smithi173.stdout:8/70: dread - dd/d11/f1a zero size 2024-02-16T22:18:40.912 INFO:tasks.workunit.client.1.smithi173.stdout:8/71: dwrite f5 [0,4194304] 0 2024-02-16T22:18:40.912 INFO:tasks.workunit.client.1.smithi173.stdout:0/72: dwrite d0/d4/f7 [0,4194304] 0 2024-02-16T22:18:40.912 INFO:tasks.workunit.client.1.smithi173.stdout:8/72: read - dd/d11/f13 zero size 2024-02-16T22:18:40.913 INFO:tasks.workunit.client.1.smithi173.stdout:0/73: mknod d0/d12/c1f 0 2024-02-16T22:18:40.914 INFO:tasks.workunit.client.1.smithi173.stdout:8/73: getdents dd 0 2024-02-16T22:18:40.914 INFO:tasks.workunit.client.1.smithi173.stdout:8/74: readlink dd/le 0 2024-02-16T22:18:40.914 INFO:tasks.workunit.client.1.smithi173.stdout:8/75: creat dd/d11/f20 x:0 0 0 2024-02-16T22:18:42.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:42 smithi134 ceph-mon[28869]: pgmap v243: 65 pgs: 65 active+clean; 193 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1024 KiB/s rd, 11 MiB/s wr, 989 op/s 2024-02-16T22:18:42.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:42 smithi173 ceph-mon[37280]: pgmap v243: 65 pgs: 65 active+clean; 193 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1024 KiB/s rd, 11 MiB/s wr, 989 op/s 2024-02-16T22:18:43.366 INFO:tasks.workunit.client.0.smithi134.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-16T22:18:43.372 INFO:tasks.workunit.client.0.smithi134.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-16T22:18:43.372 INFO:tasks.workunit.client.0.smithi134.stderr:+ make 2024-02-16T22:18:43.504 INFO:tasks.workunit.client.0.smithi134.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-16T22:18:43.780 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:43 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:18:43.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:43 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:18:44.330 INFO:tasks.workunit.client.0.smithi134.stderr:++ readlink -f fsstress 2024-02-16T22:18:44.330 INFO:tasks.workunit.client.0.smithi134.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-16T22:18:44.330 INFO:tasks.workunit.client.0.smithi134.stderr:+ popd 2024-02-16T22:18:44.331 INFO:tasks.workunit.client.0.smithi134.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-16T22:18:44.331 INFO:tasks.workunit.client.0.smithi134.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-16T22:18:44.332 INFO:tasks.workunit.client.0.smithi134.stderr:+ popd 2024-02-16T22:18:44.332 INFO:tasks.workunit.client.0.smithi134.stderr:++ mktemp -d -p . 2024-02-16T22:18:44.333 INFO:tasks.workunit.client.0.smithi134.stderr:+ T=./tmp.MZEO0YumiE 2024-02-16T22:18:44.333 INFO:tasks.workunit.client.0.smithi134.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.MZEO0YumiE -l 1 -n 1000 -p 10 -v 2024-02-16T22:18:44.334 INFO:tasks.workunit.client.0.smithi134.stdout:seed = 1707788343 2024-02-16T22:18:44.336 INFO:tasks.workunit.client.0.smithi134.stdout:0/0: truncate - no filename 2024-02-16T22:18:44.338 INFO:tasks.workunit.client.0.smithi134.stdout:1/0: mknod c0 0 2024-02-16T22:18:44.338 INFO:tasks.workunit.client.0.smithi134.stdout:1/1: truncate - no filename 2024-02-16T22:18:44.338 INFO:tasks.workunit.client.0.smithi134.stdout:1/2: stat c0 0 2024-02-16T22:18:44.339 INFO:tasks.workunit.client.0.smithi134.stdout:3/0: dwrite - no filename 2024-02-16T22:18:44.339 INFO:tasks.workunit.client.0.smithi134.stdout:2/0: creat f0 x:0 0 0 2024-02-16T22:18:44.339 INFO:tasks.workunit.client.0.smithi134.stdout:2/1: stat f0 0 2024-02-16T22:18:44.340 INFO:tasks.workunit.client.0.smithi134.stdout:1/3: creat f1 x:0 0 0 2024-02-16T22:18:44.340 INFO:tasks.workunit.client.0.smithi134.stdout:1/4: creat f2 x:0 0 0 2024-02-16T22:18:44.340 INFO:tasks.workunit.client.0.smithi134.stdout:1/5: write f2 [166558,58676] 0 2024-02-16T22:18:44.341 INFO:tasks.workunit.client.0.smithi134.stdout:3/1: mknod c0 0 2024-02-16T22:18:44.341 INFO:tasks.workunit.client.0.smithi134.stdout:3/2: chown c0 379 1 2024-02-16T22:18:44.341 INFO:tasks.workunit.client.0.smithi134.stdout:3/3: dread - no filename 2024-02-16T22:18:44.341 INFO:tasks.workunit.client.0.smithi134.stdout:3/4: read - no filename 2024-02-16T22:18:44.341 INFO:tasks.workunit.client.0.smithi134.stdout:5/0: rmdir - no directory 2024-02-16T22:18:44.342 INFO:tasks.workunit.client.0.smithi134.stdout:5/1: read - no filename 2024-02-16T22:18:44.342 INFO:tasks.workunit.client.0.smithi134.stdout:5/2: read - no filename 2024-02-16T22:18:44.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/0: mkdir d0 0 2024-02-16T22:18:44.343 INFO:tasks.workunit.client.0.smithi134.stdout:6/0: fdatasync - no filename 2024-02-16T22:18:44.343 INFO:tasks.workunit.client.0.smithi134.stdout:6/1: write - no filename 2024-02-16T22:18:44.343 INFO:tasks.workunit.client.0.smithi134.stdout:6/2: fsync - no filename 2024-02-16T22:18:44.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/3: creat f0 x:0 0 0 2024-02-16T22:18:44.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/4: write f0 [441906,94329] 0 2024-02-16T22:18:44.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/5: creat f1 x:0 0 0 2024-02-16T22:18:44.344 INFO:tasks.workunit.client.0.smithi134.stdout:6/3: mknod c0 0 2024-02-16T22:18:44.345 INFO:tasks.workunit.client.0.smithi134.stdout:6/4: dread - no filename 2024-02-16T22:18:44.345 INFO:tasks.workunit.client.0.smithi134.stdout:6/5: chown c0 390 1 2024-02-16T22:18:44.345 INFO:tasks.workunit.client.0.smithi134.stdout:6/6: rmdir - no directory 2024-02-16T22:18:44.346 INFO:tasks.workunit.client.0.smithi134.stdout:8/0: write - no filename 2024-02-16T22:18:44.346 INFO:tasks.workunit.client.0.smithi134.stdout:8/1: write - no filename 2024-02-16T22:18:44.346 INFO:tasks.workunit.client.0.smithi134.stdout:8/2: chown . 0 1 2024-02-16T22:18:44.346 INFO:tasks.workunit.client.0.smithi134.stdout:8/3: dread - no filename 2024-02-16T22:18:44.347 INFO:tasks.workunit.client.0.smithi134.stdout:8/4: dwrite - no filename 2024-02-16T22:18:44.347 INFO:tasks.workunit.client.0.smithi134.stdout:8/5: dread - no filename 2024-02-16T22:18:44.349 INFO:tasks.workunit.client.0.smithi134.stdout:8/6: creat f0 x:0 0 0 2024-02-16T22:18:44.358 INFO:tasks.workunit.client.0.smithi134.stdout:3/5: getdents . 0 2024-02-16T22:18:44.358 INFO:tasks.workunit.client.0.smithi134.stdout:3/6: truncate - no filename 2024-02-16T22:18:44.365 INFO:tasks.workunit.client.0.smithi134.stdout:3/7: creat f1 x:0 0 0 2024-02-16T22:18:44.367 INFO:tasks.workunit.client.0.smithi134.stdout:3/8: symlink l2 0 2024-02-16T22:18:44.368 INFO:tasks.workunit.client.0.smithi134.stdout:3/9: stat f1 0 2024-02-16T22:18:44.368 INFO:tasks.workunit.client.0.smithi134.stdout:3/10: readlink l2 0 2024-02-16T22:18:44.553 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:44 smithi173 ceph-mon[37280]: pgmap v244: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 15 MiB/s wr, 1.04k op/s 2024-02-16T22:18:44.553 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:44 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:18:44.553 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:44 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:18:44.553 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:44 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:18:44.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:44 smithi134 ceph-mon[28869]: pgmap v244: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 15 MiB/s wr, 1.04k op/s 2024-02-16T22:18:44.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:44 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:18:44.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:44 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:18:44.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:44 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:18:45.073 INFO:tasks.workunit.client.0.smithi134.stdout:8/7: dwrite f0 [0,4194304] 0 2024-02-16T22:18:45.111 INFO:tasks.workunit.client.0.smithi134.stdout:8/8: dread f0 [0,4194304] 0 2024-02-16T22:18:45.111 INFO:tasks.workunit.client.0.smithi134.stdout:3/11: dwrite f1 [0,4194304] 0 2024-02-16T22:18:45.120 INFO:tasks.workunit.client.0.smithi134.stdout:8/9: dread f0 [0,4194304] 0 2024-02-16T22:18:45.120 INFO:tasks.workunit.client.0.smithi134.stdout:8/10: creat f1 x:0 0 0 2024-02-16T22:18:45.120 INFO:tasks.workunit.client.0.smithi134.stdout:8/11: dread - f1 zero size 2024-02-16T22:18:45.125 INFO:tasks.workunit.client.0.smithi134.stdout:5/6: dwrite f0 [0,4194304] 0 2024-02-16T22:18:45.125 INFO:tasks.workunit.client.0.smithi134.stdout:5/7: dread - f1 zero size 2024-02-16T22:18:45.125 INFO:tasks.workunit.client.0.smithi134.stdout:3/12: write f1 [4061309,53288] 0 2024-02-16T22:18:45.136 INFO:tasks.workunit.client.0.smithi134.stdout:3/13: dread f1 [0,4194304] 0 2024-02-16T22:18:45.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/0: dwrite - no filename 2024-02-16T22:18:45.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/1: write - no filename 2024-02-16T22:18:45.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/2: chown . 29616210 1 2024-02-16T22:18:45.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/3: truncate - no filename 2024-02-16T22:18:45.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/4: dwrite - no filename 2024-02-16T22:18:45.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/5: stat - no entries 2024-02-16T22:18:45.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/6: dread - no filename 2024-02-16T22:18:45.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/7: rmdir - no directory 2024-02-16T22:18:45.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/8: dread - no filename 2024-02-16T22:18:45.155 INFO:tasks.workunit.client.0.smithi134.stdout:9/9: write - no filename 2024-02-16T22:18:45.155 INFO:tasks.workunit.client.0.smithi134.stdout:9/10: fsync - no filename 2024-02-16T22:18:45.168 INFO:tasks.workunit.client.0.smithi134.stdout:1/6: dwrite f2 [0,4194304] 0 2024-02-16T22:18:45.168 INFO:tasks.workunit.client.0.smithi134.stdout:1/7: creat f3 x:0 0 0 2024-02-16T22:18:45.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:45 smithi134 ceph-mon[28869]: pgmap v245: 65 pgs: 65 active+clean; 279 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s rd, 20 MiB/s wr, 1.10k op/s 2024-02-16T22:18:45.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:45 smithi173 ceph-mon[37280]: pgmap v245: 65 pgs: 65 active+clean; 279 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s rd, 20 MiB/s wr, 1.10k op/s 2024-02-16T22:18:46.083 INFO:tasks.workunit.client.0.smithi134.stdout:8/12: mkdir d2 0 2024-02-16T22:18:46.140 INFO:tasks.workunit.client.0.smithi134.stdout:5/8: mkdir d2 0 2024-02-16T22:18:46.179 INFO:tasks.workunit.client.0.smithi134.stdout:3/14: mknod c3 0 2024-02-16T22:18:46.226 INFO:tasks.workunit.client.0.smithi134.stdout:9/11: mknod c0 0 2024-02-16T22:18:46.264 INFO:tasks.workunit.client.0.smithi134.stdout:1/8: symlink l4 0 2024-02-16T22:18:46.288 INFO:tasks.workunit.client.0.smithi134.stdout:1/9: dwrite f1 [0,4194304] 0 2024-02-16T22:18:46.355 INFO:tasks.workunit.client.0.smithi134.stdout:8/13: mkdir d2/d3 0 2024-02-16T22:18:46.355 INFO:tasks.workunit.client.0.smithi134.stdout:8/14: write f1 [975637,55248] 0 2024-02-16T22:18:46.355 INFO:tasks.workunit.client.0.smithi134.stdout:8/15: stat d2 0 2024-02-16T22:18:46.356 INFO:tasks.workunit.client.0.smithi134.stdout:5/9: rename f1 to d2/f3 0 2024-02-16T22:18:46.356 INFO:tasks.workunit.client.0.smithi134.stdout:5/10: dread - d2/f3 zero size 2024-02-16T22:18:46.358 INFO:tasks.workunit.client.0.smithi134.stdout:9/12: rename c0 to c1 0 2024-02-16T22:18:46.361 INFO:tasks.workunit.client.0.smithi134.stdout:1/10: mkdir d5 0 2024-02-16T22:18:46.364 INFO:tasks.workunit.client.0.smithi134.stdout:9/13: creat f2 x:0 0 0 2024-02-16T22:18:46.367 INFO:tasks.workunit.client.0.smithi134.stdout:1/11: rename f2 to d5/f6 0 2024-02-16T22:18:46.385 INFO:tasks.workunit.client.0.smithi134.stdout:8/16: dwrite f1 [0,4194304] 0 2024-02-16T22:18:46.385 INFO:tasks.workunit.client.0.smithi134.stdout:9/14: dwrite f2 [0,4194304] 0 2024-02-16T22:18:46.386 INFO:tasks.workunit.client.0.smithi134.stdout:8/17: symlink d2/d3/l4 0 2024-02-16T22:18:46.405 INFO:tasks.workunit.client.0.smithi134.stdout:8/18: dwrite f1 [0,4194304] 0 2024-02-16T22:18:46.406 INFO:tasks.workunit.client.0.smithi134.stdout:8/19: creat d2/d3/f5 x:0 0 0 2024-02-16T22:18:46.407 INFO:tasks.workunit.client.0.smithi134.stdout:8/20: creat d2/d3/f6 x:0 0 0 2024-02-16T22:18:46.691 INFO:tasks.workunit.client.0.smithi134.stdout:3/15: truncate f1 1880806 0 2024-02-16T22:18:46.693 INFO:tasks.workunit.client.0.smithi134.stdout:9/15: truncate f2 2756383 0 2024-02-16T22:18:46.695 INFO:tasks.workunit.client.0.smithi134.stdout:9/16: mknod c3 0 2024-02-16T22:18:46.695 INFO:tasks.workunit.client.0.smithi134.stdout:9/17: rmdir - no directory 2024-02-16T22:18:46.696 INFO:tasks.workunit.client.0.smithi134.stdout:9/18: link c3 c4 0 2024-02-16T22:18:46.696 INFO:tasks.workunit.client.0.smithi134.stdout:8/21: getdents d2/d3 0 2024-02-16T22:18:46.697 INFO:tasks.workunit.client.0.smithi134.stdout:3/16: write f1 [1974924,12927] 0 2024-02-16T22:18:46.699 INFO:tasks.workunit.client.0.smithi134.stdout:3/17: symlink l4 0 2024-02-16T22:18:46.699 INFO:tasks.workunit.client.0.smithi134.stdout:3/18: creat f5 x:0 0 0 2024-02-16T22:18:46.707 INFO:tasks.workunit.client.0.smithi134.stdout:3/19: fsync f5 0 2024-02-16T22:18:46.709 INFO:tasks.workunit.client.0.smithi134.stdout:9/19: write f2 [1874932,42124] 0 2024-02-16T22:18:46.711 INFO:tasks.workunit.client.0.smithi134.stdout:9/20: rename c4 to c5 0 2024-02-16T22:18:46.712 INFO:tasks.workunit.client.0.smithi134.stdout:1/12: dwrite f1 [4194304,4194304] 0 2024-02-16T22:18:46.712 INFO:tasks.workunit.client.0.smithi134.stdout:1/13: dread - f3 zero size 2024-02-16T22:18:46.713 INFO:tasks.workunit.client.0.smithi134.stdout:1/14: getdents d5 0 2024-02-16T22:18:46.713 INFO:tasks.workunit.client.0.smithi134.stdout:1/15: readlink l4 0 2024-02-16T22:18:46.715 INFO:tasks.workunit.client.0.smithi134.stdout:1/16: creat d5/f7 x:0 0 0 2024-02-16T22:18:46.715 INFO:tasks.workunit.client.0.smithi134.stdout:1/17: chown l4 2042924 1 2024-02-16T22:18:46.715 INFO:tasks.workunit.client.0.smithi134.stdout:1/18: chown f1 43 1 2024-02-16T22:18:46.717 INFO:tasks.workunit.client.0.smithi134.stdout:1/19: creat d5/f8 x:0 0 0 2024-02-16T22:18:46.719 INFO:tasks.workunit.client.0.smithi134.stdout:1/20: mknod d5/c9 0 2024-02-16T22:18:46.719 INFO:tasks.workunit.client.0.smithi134.stdout:1/21: dread - f3 zero size 2024-02-16T22:18:46.721 INFO:tasks.workunit.client.0.smithi134.stdout:9/21: dread f2 [0,4194304] 0 2024-02-16T22:18:46.721 INFO:tasks.workunit.client.0.smithi134.stdout:9/22: chown f2 196906 1 2024-02-16T22:18:46.722 INFO:tasks.workunit.client.0.smithi134.stdout:9/23: mknod c6 0 2024-02-16T22:18:46.728 INFO:tasks.workunit.client.0.smithi134.stdout:3/20: dwrite f5 [0,4194304] 0 2024-02-16T22:18:46.732 INFO:tasks.workunit.client.0.smithi134.stdout:3/21: unlink l2 0 2024-02-16T22:18:46.732 INFO:tasks.workunit.client.0.smithi134.stdout:3/22: write f1 [2331773,19869] 0 2024-02-16T22:18:46.732 INFO:tasks.workunit.client.0.smithi134.stdout:3/23: truncate f5 4381966 0 2024-02-16T22:18:46.732 INFO:tasks.workunit.client.0.smithi134.stdout:3/24: stat f1 0 2024-02-16T22:18:46.772 INFO:tasks.workunit.client.0.smithi134.stdout:9/24: dwrite f2 [0,4194304] 0 2024-02-16T22:18:46.772 INFO:tasks.workunit.client.0.smithi134.stdout:9/25: chown f2 699725114 1 2024-02-16T22:18:46.772 INFO:tasks.workunit.client.0.smithi134.stdout:9/26: stat f2 0 2024-02-16T22:18:46.772 INFO:tasks.workunit.client.0.smithi134.stdout:9/27: fdatasync f2 0 2024-02-16T22:18:46.789 INFO:tasks.workunit.client.0.smithi134.stdout:9/28: dwrite f2 [0,4194304] 0 2024-02-16T22:18:46.789 INFO:tasks.workunit.client.0.smithi134.stdout:9/29: truncate f2 4971905 0 2024-02-16T22:18:46.798 INFO:tasks.workunit.client.0.smithi134.stdout:9/30: write f2 [2966412,5182] 0 2024-02-16T22:18:46.798 INFO:tasks.workunit.client.0.smithi134.stdout:9/31: chown c3 79 1 2024-02-16T22:18:46.799 INFO:tasks.workunit.client.0.smithi134.stdout:9/32: fdatasync f2 0 2024-02-16T22:18:46.799 INFO:tasks.workunit.client.0.smithi134.stdout:9/33: chown c1 327684457 1 2024-02-16T22:18:46.805 INFO:tasks.workunit.client.0.smithi134.stdout:9/34: dread f2 [0,4194304] 0 2024-02-16T22:18:46.805 INFO:tasks.workunit.client.0.smithi134.stdout:9/35: write f2 [3996380,98790] 0 2024-02-16T22:18:46.806 INFO:tasks.workunit.client.0.smithi134.stdout:9/36: mknod c7 0 2024-02-16T22:18:46.806 INFO:tasks.workunit.client.0.smithi134.stdout:9/37: readlink - no filename 2024-02-16T22:18:46.806 INFO:tasks.workunit.client.0.smithi134.stdout:9/38: creat f8 x:0 0 0 2024-02-16T22:18:46.807 INFO:tasks.workunit.client.0.smithi134.stdout:9/39: mknod c9 0 2024-02-16T22:18:46.808 INFO:tasks.workunit.client.0.smithi134.stdout:9/40: unlink c3 0 2024-02-16T22:18:46.809 INFO:tasks.workunit.client.0.smithi134.stdout:9/41: mknod ca 0 2024-02-16T22:18:46.809 INFO:tasks.workunit.client.0.smithi134.stdout:9/42: chown c7 0 1 2024-02-16T22:18:46.810 INFO:tasks.workunit.client.0.smithi134.stdout:9/43: mkdir db 0 2024-02-16T22:18:46.810 INFO:tasks.workunit.client.0.smithi134.stdout:9/44: write f2 [5082405,41392] 0 2024-02-16T22:18:46.810 INFO:tasks.workunit.client.0.smithi134.stdout:9/45: write f8 [704639,65236] 0 2024-02-16T22:18:46.810 INFO:tasks.workunit.client.0.smithi134.stdout:9/46: truncate f8 1793335 0 2024-02-16T22:18:46.811 INFO:tasks.workunit.client.0.smithi134.stdout:9/47: mkdir db/dc 0 2024-02-16T22:18:46.811 INFO:tasks.workunit.client.0.smithi134.stdout:9/48: rename db to db/dc/dd 22 2024-02-16T22:18:46.811 INFO:tasks.workunit.client.0.smithi134.stdout:9/49: write f2 [2551066,4676] 0 2024-02-16T22:18:46.812 INFO:tasks.workunit.client.0.smithi134.stdout:9/50: rename c9 to db/dc/ce 0 2024-02-16T22:18:46.812 INFO:tasks.workunit.client.0.smithi134.stdout:9/51: mknod db/cf 0 2024-02-16T22:18:46.821 INFO:tasks.workunit.client.0.smithi134.stdout:9/52: link db/dc/ce db/c10 0 2024-02-16T22:18:46.858 INFO:tasks.workunit.client.0.smithi134.stdout:9/53: dread f8 [0,4194304] 0 2024-02-16T22:18:46.860 INFO:tasks.workunit.client.0.smithi134.stdout:9/54: rmdir db/dc 39 2024-02-16T22:18:46.862 INFO:tasks.workunit.client.0.smithi134.stdout:9/55: truncate f8 222340 0 2024-02-16T22:18:46.863 INFO:tasks.workunit.client.0.smithi134.stdout:9/56: mknod db/c11 0 2024-02-16T22:18:46.864 INFO:tasks.workunit.client.0.smithi134.stdout:9/57: creat db/dc/f12 x:0 0 0 2024-02-16T22:18:46.866 INFO:tasks.workunit.client.0.smithi134.stdout:9/58: dread f8 [0,4194304] 0 2024-02-16T22:18:46.866 INFO:tasks.workunit.client.0.smithi134.stdout:9/59: truncate db/dc/f12 829125 0 2024-02-16T22:18:46.870 INFO:tasks.workunit.client.0.smithi134.stdout:9/60: truncate f2 4404453 0 2024-02-16T22:18:46.870 INFO:tasks.workunit.client.0.smithi134.stdout:9/61: write f8 [1195306,21725] 0 2024-02-16T22:18:46.894 INFO:tasks.workunit.client.0.smithi134.stdout:9/62: dwrite f2 [0,4194304] 0 2024-02-16T22:18:46.894 INFO:tasks.workunit.client.0.smithi134.stdout:9/63: chown db/dc 1714 1 2024-02-16T22:18:46.902 INFO:tasks.workunit.client.0.smithi134.stdout:9/64: read f2 [3874245,66217] 0 2024-02-16T22:18:46.904 INFO:tasks.workunit.client.0.smithi134.stdout:9/65: rename c5 to db/c13 0 2024-02-16T22:18:46.904 INFO:tasks.workunit.client.0.smithi134.stdout:9/66: creat db/dc/f14 x:0 0 0 2024-02-16T22:18:46.904 INFO:tasks.workunit.client.0.smithi134.stdout:9/67: dread - db/dc/f14 zero size 2024-02-16T22:18:46.904 INFO:tasks.workunit.client.0.smithi134.stdout:9/68: read - db/dc/f14 zero size 2024-02-16T22:18:46.905 INFO:tasks.workunit.client.0.smithi134.stdout:9/69: link db/dc/f14 db/dc/f15 0 2024-02-16T22:18:46.905 INFO:tasks.workunit.client.0.smithi134.stdout:9/70: creat db/dc/f16 x:0 0 0 2024-02-16T22:18:46.906 INFO:tasks.workunit.client.0.smithi134.stdout:9/71: creat db/dc/f17 x:0 0 0 2024-02-16T22:18:46.906 INFO:tasks.workunit.client.0.smithi134.stdout:9/72: read - db/dc/f17 zero size 2024-02-16T22:18:46.906 INFO:tasks.workunit.client.0.smithi134.stdout:9/73: dread db/dc/f12 [0,4194304] 0 2024-02-16T22:18:46.908 INFO:tasks.workunit.client.0.smithi134.stdout:9/74: creat db/f18 x:0 0 0 2024-02-16T22:18:46.913 INFO:tasks.workunit.client.0.smithi134.stdout:9/75: getdents db/dc 0 2024-02-16T22:18:46.913 INFO:tasks.workunit.client.0.smithi134.stdout:9/76: write db/f18 [198609,97810] 0 2024-02-16T22:18:46.928 INFO:tasks.workunit.client.0.smithi134.stdout:9/77: dwrite f8 [0,4194304] 0 2024-02-16T22:18:46.952 INFO:tasks.workunit.client.0.smithi134.stdout:9/78: dwrite db/dc/f15 [0,4194304] 0 2024-02-16T22:18:46.959 INFO:tasks.workunit.client.0.smithi134.stdout:9/79: read f8 [4074504,123443] 0 2024-02-16T22:18:46.960 INFO:tasks.workunit.client.0.smithi134.stdout:9/80: symlink db/dc/l19 0 2024-02-16T22:18:46.961 INFO:tasks.workunit.client.0.smithi134.stdout:9/81: mknod db/dc/c1a 0 2024-02-16T22:18:46.962 INFO:tasks.workunit.client.0.smithi134.stdout:9/82: rename db/dc/l19 to db/dc/l1b 0 2024-02-16T22:18:46.962 INFO:tasks.workunit.client.0.smithi134.stdout:9/83: fdatasync db/dc/f15 0 2024-02-16T22:18:46.962 INFO:tasks.workunit.client.0.smithi134.stdout:9/84: chown f2 1072723 1 2024-02-16T22:18:46.962 INFO:tasks.workunit.client.0.smithi134.stdout:9/85: write db/dc/f16 [524736,6826] 0 2024-02-16T22:18:46.963 INFO:tasks.workunit.client.0.smithi134.stdout:9/86: rename c1 to db/dc/c1c 0 2024-02-16T22:18:46.964 INFO:tasks.workunit.client.0.smithi134.stdout:9/87: rmdir db/dc 39 2024-02-16T22:18:46.964 INFO:tasks.workunit.client.0.smithi134.stdout:9/88: mknod db/c1d 0 2024-02-16T22:18:46.969 INFO:tasks.workunit.client.0.smithi134.stdout:9/89: dread f2 [0,4194304] 0 2024-02-16T22:18:46.970 INFO:tasks.workunit.client.0.smithi134.stdout:9/90: dread f2 [4194304,4194304] 0 2024-02-16T22:18:46.979 INFO:tasks.workunit.client.0.smithi134.stdout:9/91: dread db/dc/f15 [0,4194304] 0 2024-02-16T22:18:46.980 INFO:tasks.workunit.client.0.smithi134.stdout:9/92: mknod db/dc/c1e 0 2024-02-16T22:18:46.980 INFO:tasks.workunit.client.0.smithi134.stdout:9/93: mknod db/c1f 0 2024-02-16T22:18:46.980 INFO:tasks.workunit.client.0.smithi134.stdout:9/94: chown db/dc 218233751 1 2024-02-16T22:18:46.986 INFO:tasks.workunit.client.0.smithi134.stdout:9/95: getdents db 0 2024-02-16T22:18:46.987 INFO:tasks.workunit.client.0.smithi134.stdout:9/96: mkdir db/d20 0 2024-02-16T22:18:46.988 INFO:tasks.workunit.client.0.smithi134.stdout:9/97: mknod db/c21 0 2024-02-16T22:18:46.988 INFO:tasks.workunit.client.0.smithi134.stdout:9/98: chown f8 7501272 1 2024-02-16T22:18:46.992 INFO:tasks.workunit.client.0.smithi134.stdout:9/99: dread f2 [0,4194304] 0 2024-02-16T22:18:46.993 INFO:tasks.workunit.client.0.smithi134.stdout:9/100: getdents db/d20 0 2024-02-16T22:18:46.993 INFO:tasks.workunit.client.0.smithi134.stdout:9/101: mkdir db/d20/d22 0 2024-02-16T22:18:46.993 INFO:tasks.workunit.client.0.smithi134.stdout:9/102: readlink db/dc/l1b 0 2024-02-16T22:18:46.994 INFO:tasks.workunit.client.0.smithi134.stdout:9/103: rmdir db 39 2024-02-16T22:18:47.009 INFO:tasks.workunit.client.0.smithi134.stdout:9/104: dwrite f8 [0,4194304] 0 2024-02-16T22:18:47.009 INFO:tasks.workunit.client.0.smithi134.stdout:9/105: mknod db/c23 0 2024-02-16T22:18:47.014 INFO:tasks.workunit.client.0.smithi134.stdout:9/106: read db/dc/f14 [1875676,93060] 0 2024-02-16T22:18:47.031 INFO:tasks.workunit.client.0.smithi134.stdout:9/107: dwrite db/dc/f17 [0,4194304] 0 2024-02-16T22:18:47.033 INFO:tasks.workunit.client.0.smithi134.stdout:9/108: creat db/dc/f24 x:0 0 0 2024-02-16T22:18:47.034 INFO:tasks.workunit.client.0.smithi134.stdout:9/109: creat db/d20/d22/f25 x:0 0 0 2024-02-16T22:18:47.051 INFO:tasks.workunit.client.0.smithi134.stdout:9/110: dwrite db/dc/f14 [4194304,4194304] 0 2024-02-16T22:18:48.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:48 smithi173 ceph-mon[37280]: pgmap v246: 65 pgs: 65 active+clean; 298 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s rd, 19 MiB/s wr, 1.07k op/s 2024-02-16T22:18:48.757 INFO:tasks.workunit.client.0.smithi134.stdout:4/1: sync 2024-02-16T22:18:48.757 INFO:tasks.workunit.client.0.smithi134.stdout:9/111: sync 2024-02-16T22:18:48.757 INFO:tasks.workunit.client.0.smithi134.stdout:7/0: sync 2024-02-16T22:18:48.757 INFO:tasks.workunit.client.0.smithi134.stdout:4/2: write - no filename 2024-02-16T22:18:48.757 INFO:tasks.workunit.client.0.smithi134.stdout:7/1: stat - no entries 2024-02-16T22:18:48.757 INFO:tasks.workunit.client.0.smithi134.stdout:4/3: fdatasync - no filename 2024-02-16T22:18:48.757 INFO:tasks.workunit.client.0.smithi134.stdout:0/1: sync 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:2/2: sync 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:7/2: readlink - no filename 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:0/2: write - no filename 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:0/3: link - no file 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:5/11: sync 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:0/4: chown . 35464198 1 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:5/12: stat f0 0 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:5/13: stat d2/f3 0 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:6/7: sync 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:8/22: sync 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:1/22: sync 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:1/23: dread - d5/f7 zero size 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:8/23: truncate d2/d3/f5 650956 0 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:3/25: sync 2024-02-16T22:18:48.758 INFO:tasks.workunit.client.0.smithi134.stdout:8/24: stat d2/d3/l4 0 2024-02-16T22:18:48.759 INFO:tasks.workunit.client.0.smithi134.stdout:1/24: write f3 [1006821,130658] 0 2024-02-16T22:18:48.759 INFO:tasks.workunit.client.0.smithi134.stdout:3/26: write f1 [3035307,47516] 0 2024-02-16T22:18:48.759 INFO:tasks.workunit.client.0.smithi134.stdout:3/27: fdatasync f1 0 2024-02-16T22:18:48.763 INFO:tasks.workunit.client.0.smithi134.stdout:9/112: dread f2 [0,4194304] 0 2024-02-16T22:18:48.763 INFO:tasks.workunit.client.0.smithi134.stdout:9/113: truncate db/d20/d22/f25 981793 0 2024-02-16T22:18:48.769 INFO:tasks.workunit.client.0.smithi134.stdout:8/25: read f1 [550990,24176] 0 2024-02-16T22:18:48.769 INFO:tasks.workunit.client.0.smithi134.stdout:8/26: truncate d2/d3/f6 254259 0 2024-02-16T22:18:48.769 INFO:tasks.workunit.client.0.smithi134.stdout:8/27: fdatasync f0 0 2024-02-16T22:18:48.769 INFO:tasks.workunit.client.0.smithi134.stdout:8/28: fdatasync d2/d3/f5 0 2024-02-16T22:18:48.865 INFO:tasks.workunit.client.0.smithi134.stdout:4/4: mknod d0/c1 0 2024-02-16T22:18:48.866 INFO:tasks.workunit.client.0.smithi134.stdout:0/5: symlink l0 0 2024-02-16T22:18:48.868 INFO:tasks.workunit.client.0.smithi134.stdout:5/14: creat d2/f4 x:0 0 0 2024-02-16T22:18:48.868 INFO:tasks.workunit.client.0.smithi134.stdout:5/15: truncate d2/f3 574976 0 2024-02-16T22:18:48.868 INFO:tasks.workunit.client.0.smithi134.stdout:5/16: truncate d2/f4 653386 0 2024-02-16T22:18:48.868 INFO:tasks.workunit.client.0.smithi134.stdout:5/17: fsync f0 0 2024-02-16T22:18:48.868 INFO:tasks.workunit.client.0.smithi134.stdout:6/8: rename c0 to c1 0 2024-02-16T22:18:48.870 INFO:tasks.workunit.client.0.smithi134.stdout:3/28: truncate f5 44022 0 2024-02-16T22:18:48.870 INFO:tasks.workunit.client.0.smithi134.stdout:3/29: fsync f1 0 2024-02-16T22:18:48.870 INFO:tasks.workunit.client.0.smithi134.stdout:3/30: chown f5 1628852 1 2024-02-16T22:18:48.871 INFO:tasks.workunit.client.0.smithi134.stdout:8/29: creat d2/f7 x:0 0 0 2024-02-16T22:18:48.872 INFO:tasks.workunit.client.0.smithi134.stdout:8/30: write d2/f7 [477843,107109] 0 2024-02-16T22:18:48.877 INFO:tasks.workunit.client.0.smithi134.stdout:4/5: creat d0/f2 x:0 0 0 2024-02-16T22:18:48.877 INFO:tasks.workunit.client.0.smithi134.stdout:4/6: fdatasync d0/f2 0 2024-02-16T22:18:48.877 INFO:tasks.workunit.client.0.smithi134.stdout:4/7: readlink - no filename 2024-02-16T22:18:48.878 INFO:tasks.workunit.client.0.smithi134.stdout:0/6: link l0 l1 0 2024-02-16T22:18:48.879 INFO:tasks.workunit.client.0.smithi134.stdout:6/9: creat f2 x:0 0 0 2024-02-16T22:18:48.879 INFO:tasks.workunit.client.0.smithi134.stdout:6/10: dread - f2 zero size 2024-02-16T22:18:48.879 INFO:tasks.workunit.client.0.smithi134.stdout:6/11: write f2 [404933,29577] 0 2024-02-16T22:18:48.880 INFO:tasks.workunit.client.0.smithi134.stdout:1/25: mkdir d5/da 0 2024-02-16T22:18:48.881 INFO:tasks.workunit.client.0.smithi134.stdout:6/12: fdatasync f2 0 2024-02-16T22:18:48.881 INFO:tasks.workunit.client.0.smithi134.stdout:6/13: fdatasync f2 0 2024-02-16T22:18:48.882 INFO:tasks.workunit.client.0.smithi134.stdout:6/14: read f2 [307813,22533] 0 2024-02-16T22:18:48.882 INFO:tasks.workunit.client.0.smithi134.stdout:9/114: getdents db/d20/d22 0 2024-02-16T22:18:48.884 INFO:tasks.workunit.client.0.smithi134.stdout:6/15: dread f2 [0,4194304] 0 2024-02-16T22:18:48.884 INFO:tasks.workunit.client.0.smithi134.stdout:6/16: creat f3 x:0 0 0 2024-02-16T22:18:48.884 INFO:tasks.workunit.client.0.smithi134.stdout:8/31: mknod d2/d3/c8 0 2024-02-16T22:18:48.884 INFO:tasks.workunit.client.0.smithi134.stdout:8/32: chown d2/d3/f6 15832 1 2024-02-16T22:18:48.885 INFO:tasks.workunit.client.0.smithi134.stdout:6/17: dread f2 [0,4194304] 0 2024-02-16T22:18:48.885 INFO:tasks.workunit.client.0.smithi134.stdout:6/18: creat f4 x:0 0 0 2024-02-16T22:18:48.885 INFO:tasks.workunit.client.0.smithi134.stdout:6/19: write f4 [262670,40520] 0 2024-02-16T22:18:48.886 INFO:tasks.workunit.client.0.smithi134.stdout:4/8: mknod d0/c3 0 2024-02-16T22:18:48.887 INFO:tasks.workunit.client.0.smithi134.stdout:0/7: mkdir d2 0 2024-02-16T22:18:48.887 INFO:tasks.workunit.client.0.smithi134.stdout:0/8: dread - no filename 2024-02-16T22:18:48.890 INFO:tasks.workunit.client.0.smithi134.stdout:1/26: creat d5/da/fb x:0 0 0 2024-02-16T22:18:48.892 INFO:tasks.workunit.client.0.smithi134.stdout:9/115: creat db/d20/d22/f26 x:0 0 0 2024-02-16T22:18:48.897 INFO:tasks.workunit.client.0.smithi134.stdout:8/33: creat d2/d3/f9 x:0 0 0 2024-02-16T22:18:48.897 INFO:tasks.workunit.client.0.smithi134.stdout:8/34: readlink d2/d3/l4 0 2024-02-16T22:18:48.899 INFO:tasks.workunit.client.0.smithi134.stdout:0/9: mknod d2/c3 0 2024-02-16T22:18:48.903 INFO:tasks.workunit.client.0.smithi134.stdout:8/35: mknod d2/d3/ca 0 2024-02-16T22:18:48.904 INFO:tasks.workunit.client.0.smithi134.stdout:0/10: symlink d2/l4 0 2024-02-16T22:18:48.904 INFO:tasks.workunit.client.0.smithi134.stdout:0/11: readlink l1 0 2024-02-16T22:18:48.904 INFO:tasks.workunit.client.0.smithi134.stdout:0/12: write - no filename 2024-02-16T22:18:48.904 INFO:tasks.workunit.client.0.smithi134.stdout:0/13: chown d2/l4 2 1 2024-02-16T22:18:48.904 INFO:tasks.workunit.client.0.smithi134.stdout:0/14: write - no filename 2024-02-16T22:18:48.904 INFO:tasks.workunit.client.0.smithi134.stdout:1/27: mknod d5/cc 0 2024-02-16T22:18:48.905 INFO:tasks.workunit.client.0.smithi134.stdout:8/36: rename d2/d3/c8 to d2/d3/cb 0 2024-02-16T22:18:48.907 INFO:tasks.workunit.client.0.smithi134.stdout:0/15: mknod d2/c5 0 2024-02-16T22:18:48.908 INFO:tasks.workunit.client.0.smithi134.stdout:9/116: read db/dc/f17 [2766049,72483] 0 2024-02-16T22:18:48.908 INFO:tasks.workunit.client.0.smithi134.stdout:9/117: chown db/c11 8203132 1 2024-02-16T22:18:48.908 INFO:tasks.workunit.client.0.smithi134.stdout:9/118: write db/d20/d22/f26 [925781,80908] 0 2024-02-16T22:18:48.911 INFO:tasks.workunit.client.0.smithi134.stdout:0/16: creat d2/f6 x:0 0 0 2024-02-16T22:18:48.914 INFO:tasks.workunit.client.0.smithi134.stdout:8/37: truncate d2/d3/f5 114849 0 2024-02-16T22:18:48.914 INFO:tasks.workunit.client.0.smithi134.stdout:8/38: creat d2/d3/fc x:0 0 0 2024-02-16T22:18:48.915 INFO:tasks.workunit.client.0.smithi134.stdout:9/119: symlink db/d20/d22/l27 0 2024-02-16T22:18:48.917 INFO:tasks.workunit.client.0.smithi134.stdout:8/39: mknod d2/cd 0 2024-02-16T22:18:48.918 INFO:tasks.workunit.client.0.smithi134.stdout:6/20: dwrite f3 [0,4194304] 0 2024-02-16T22:18:48.919 INFO:tasks.workunit.client.0.smithi134.stdout:3/31: dread f5 [0,4194304] 0 2024-02-16T22:18:48.919 INFO:tasks.workunit.client.0.smithi134.stdout:3/32: stat f5 0 2024-02-16T22:18:48.919 INFO:tasks.workunit.client.0.smithi134.stdout:4/9: dwrite d0/f2 [0,4194304] 0 2024-02-16T22:18:48.921 INFO:tasks.workunit.client.0.smithi134.stdout:5/18: truncate d2/f3 221982 0 2024-02-16T22:18:48.921 INFO:tasks.workunit.client.0.smithi134.stdout:5/19: chown d2 25483 1 2024-02-16T22:18:48.934 INFO:tasks.workunit.client.0.smithi134.stdout:3/33: link f1 f6 0 2024-02-16T22:18:48.935 INFO:tasks.workunit.client.0.smithi134.stdout:3/34: write f6 [2289221,15946] 0 2024-02-16T22:18:48.935 INFO:tasks.workunit.client.0.smithi134.stdout:1/28: rmdir d5 39 2024-02-16T22:18:48.935 INFO:tasks.workunit.client.0.smithi134.stdout:1/29: readlink l4 0 2024-02-16T22:18:48.935 INFO:tasks.workunit.client.0.smithi134.stdout:3/35: creat f7 x:0 0 0 2024-02-16T22:18:48.936 INFO:tasks.workunit.client.0.smithi134.stdout:5/20: symlink d2/l5 0 2024-02-16T22:18:48.939 INFO:tasks.workunit.client.0.smithi134.stdout:1/30: mknod d5/da/cd 0 2024-02-16T22:18:48.941 INFO:tasks.workunit.client.0.smithi134.stdout:3/36: symlink l8 0 2024-02-16T22:18:48.941 INFO:tasks.workunit.client.0.smithi134.stdout:0/17: getdents d2 0 2024-02-16T22:18:48.944 INFO:tasks.workunit.client.0.smithi134.stdout:1/31: mknod d5/da/ce 0 2024-02-16T22:18:48.946 INFO:tasks.workunit.client.0.smithi134.stdout:3/37: symlink l9 0 2024-02-16T22:18:48.946 INFO:tasks.workunit.client.0.smithi134.stdout:3/38: write f5 [925087,128480] 0 2024-02-16T22:18:48.947 INFO:tasks.workunit.client.0.smithi134.stdout:3/39: mkdir da 0 2024-02-16T22:18:48.949 INFO:tasks.workunit.client.0.smithi134.stdout:3/40: rename f6 to da/fb 0 2024-02-16T22:18:48.951 INFO:tasks.workunit.client.0.smithi134.stdout:9/120: dwrite db/d20/d22/f25 [0,4194304] 0 2024-02-16T22:18:48.951 INFO:tasks.workunit.client.0.smithi134.stdout:5/21: write f0 [1273292,84025] 0 2024-02-16T22:18:48.951 INFO:tasks.workunit.client.0.smithi134.stdout:5/22: chown d2/f4 2132450 1 2024-02-16T22:18:48.951 INFO:tasks.workunit.client.0.smithi134.stdout:5/23: write d2/f4 [814067,32121] 0 2024-02-16T22:18:48.951 INFO:tasks.workunit.client.0.smithi134.stdout:5/24: truncate d2/f4 1315593 0 2024-02-16T22:18:48.951 INFO:tasks.workunit.client.0.smithi134.stdout:5/25: creat d2/f6 x:0 0 0 2024-02-16T22:18:48.951 INFO:tasks.workunit.client.0.smithi134.stdout:8/40: dwrite f0 [4194304,4194304] 0 2024-02-16T22:18:48.952 INFO:tasks.workunit.client.0.smithi134.stdout:6/21: dwrite f4 [0,4194304] 0 2024-02-16T22:18:48.952 INFO:tasks.workunit.client.0.smithi134.stdout:6/22: creat f5 x:0 0 0 2024-02-16T22:18:48.952 INFO:tasks.workunit.client.0.smithi134.stdout:3/41: creat da/fc x:0 0 0 2024-02-16T22:18:48.955 INFO:tasks.workunit.client.0.smithi134.stdout:1/32: write f1 [3735701,46186] 0 2024-02-16T22:18:48.955 INFO:tasks.workunit.client.0.smithi134.stdout:9/121: creat db/d20/f28 x:0 0 0 2024-02-16T22:18:48.962 INFO:tasks.workunit.client.0.smithi134.stdout:2/3: sync 2024-02-16T22:18:48.962 INFO:tasks.workunit.client.0.smithi134.stdout:7/3: sync 2024-02-16T22:18:48.962 INFO:tasks.workunit.client.0.smithi134.stdout:7/4: rename - no filename 2024-02-16T22:18:48.962 INFO:tasks.workunit.client.0.smithi134.stdout:8/41: mknod d2/ce 0 2024-02-16T22:18:48.962 INFO:tasks.workunit.client.0.smithi134.stdout:7/5: fdatasync - no filename 2024-02-16T22:18:48.962 INFO:tasks.workunit.client.0.smithi134.stdout:2/4: fdatasync f0 0 2024-02-16T22:18:48.962 INFO:tasks.workunit.client.0.smithi134.stdout:8/42: write d2/d3/fc [318490,51005] 0 2024-02-16T22:18:48.962 INFO:tasks.workunit.client.0.smithi134.stdout:4/10: write d0/f2 [4549050,108333] 0 2024-02-16T22:18:48.971 INFO:tasks.workunit.client.0.smithi134.stdout:1/33: mkdir d5/da/df 0 2024-02-16T22:18:48.971 INFO:tasks.workunit.client.0.smithi134.stdout:5/26: dwrite f0 [0,4194304] 0 2024-02-16T22:18:48.973 INFO:tasks.workunit.client.0.smithi134.stdout:2/5: link f0 f1 0 2024-02-16T22:18:48.974 INFO:tasks.workunit.client.0.smithi134.stdout:2/6: creat f2 x:0 0 0 2024-02-16T22:18:48.974 INFO:tasks.workunit.client.0.smithi134.stdout:2/7: dread - f0 zero size 2024-02-16T22:18:48.974 INFO:tasks.workunit.client.0.smithi134.stdout:2/8: stat f1 0 2024-02-16T22:18:48.974 INFO:tasks.workunit.client.0.smithi134.stdout:2/9: chown f1 2 1 2024-02-16T22:18:48.974 INFO:tasks.workunit.client.0.smithi134.stdout:2/10: read - f0 zero size 2024-02-16T22:18:48.974 INFO:tasks.workunit.client.0.smithi134.stdout:2/11: dread - f1 zero size 2024-02-16T22:18:48.975 INFO:tasks.workunit.client.0.smithi134.stdout:7/6: mknod c0 0 2024-02-16T22:18:48.975 INFO:tasks.workunit.client.0.smithi134.stdout:8/43: mkdir d2/df 0 2024-02-16T22:18:48.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:48 smithi134 ceph-mon[28869]: pgmap v246: 65 pgs: 65 active+clean; 298 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s rd, 19 MiB/s wr, 1.07k op/s 2024-02-16T22:18:48.978 INFO:tasks.workunit.client.0.smithi134.stdout:6/23: rename f5 to f6 0 2024-02-16T22:18:48.979 INFO:tasks.workunit.client.0.smithi134.stdout:1/34: read f1 [5012945,94607] 0 2024-02-16T22:18:48.980 INFO:tasks.workunit.client.0.smithi134.stdout:3/42: rmdir da 39 2024-02-16T22:18:48.981 INFO:tasks.workunit.client.0.smithi134.stdout:5/27: mknod d2/c7 0 2024-02-16T22:18:48.982 INFO:tasks.workunit.client.0.smithi134.stdout:9/122: rmdir db/d20/d22 39 2024-02-16T22:18:48.984 INFO:tasks.workunit.client.0.smithi134.stdout:2/12: mknod c3 0 2024-02-16T22:18:48.987 INFO:tasks.workunit.client.0.smithi134.stdout:7/7: rename c0 to c1 0 2024-02-16T22:18:48.987 INFO:tasks.workunit.client.0.smithi134.stdout:6/24: mknod c7 0 2024-02-16T22:18:48.987 INFO:tasks.workunit.client.0.smithi134.stdout:3/43: creat da/fd x:0 0 0 2024-02-16T22:18:48.988 INFO:tasks.workunit.client.0.smithi134.stdout:3/44: write f1 [1245469,60741] 0 2024-02-16T22:18:48.988 INFO:tasks.workunit.client.0.smithi134.stdout:3/45: creat da/fe x:0 0 0 2024-02-16T22:18:48.990 INFO:tasks.workunit.client.0.smithi134.stdout:3/46: read f5 [308628,128263] 0 2024-02-16T22:18:48.990 INFO:tasks.workunit.client.0.smithi134.stdout:5/28: rename d2/c7 to d2/c8 0 2024-02-16T22:18:48.990 INFO:tasks.workunit.client.0.smithi134.stdout:3/47: read - f7 zero size 2024-02-16T22:18:48.990 INFO:tasks.workunit.client.0.smithi134.stdout:3/48: write f5 [1878978,109179] 0 2024-02-16T22:18:48.990 INFO:tasks.workunit.client.0.smithi134.stdout:3/49: chown l9 0 1 2024-02-16T22:18:48.990 INFO:tasks.workunit.client.0.smithi134.stdout:9/123: chown c6 14 1 2024-02-16T22:18:48.990 INFO:tasks.workunit.client.0.smithi134.stdout:9/124: chown db/dc/ce 249924 1 2024-02-16T22:18:48.990 INFO:tasks.workunit.client.0.smithi134.stdout:9/125: chown db/c1f 174 1 2024-02-16T22:18:48.993 INFO:tasks.workunit.client.0.smithi134.stdout:6/25: truncate f3 1123456 0 2024-02-16T22:18:48.994 INFO:tasks.workunit.client.0.smithi134.stdout:7/8: mkdir d2 0 2024-02-16T22:18:48.998 INFO:tasks.workunit.client.0.smithi134.stdout:3/50: rename f1 to da/ff 0 2024-02-16T22:18:48.999 INFO:tasks.workunit.client.0.smithi134.stdout:6/26: mknod c8 0 2024-02-16T22:18:48.999 INFO:tasks.workunit.client.0.smithi134.stdout:7/9: mknod d2/c3 0 2024-02-16T22:18:49.001 INFO:tasks.workunit.client.0.smithi134.stdout:6/27: unlink f2 0 2024-02-16T22:18:49.001 INFO:tasks.workunit.client.0.smithi134.stdout:7/10: creat d2/f4 x:0 0 0 2024-02-16T22:18:49.002 INFO:tasks.workunit.client.0.smithi134.stdout:6/28: rename f4 to f9 0 2024-02-16T22:18:49.003 INFO:tasks.workunit.client.0.smithi134.stdout:7/11: mkdir d2/d5 0 2024-02-16T22:18:49.004 INFO:tasks.workunit.client.0.smithi134.stdout:7/12: mkdir d2/d6 0 2024-02-16T22:18:49.005 INFO:tasks.workunit.client.0.smithi134.stdout:7/13: mkdir d2/d7 0 2024-02-16T22:18:49.005 INFO:tasks.workunit.client.0.smithi134.stdout:7/14: creat d2/d6/f8 x:0 0 0 2024-02-16T22:18:49.006 INFO:tasks.workunit.client.0.smithi134.stdout:7/15: symlink d2/d5/l9 0 2024-02-16T22:18:49.006 INFO:tasks.workunit.client.0.smithi134.stdout:7/16: write d2/f4 [126998,128593] 0 2024-02-16T22:18:49.007 INFO:tasks.workunit.client.0.smithi134.stdout:7/17: stat d2/d7 0 2024-02-16T22:18:49.009 INFO:tasks.workunit.client.0.smithi134.stdout:4/11: dwrite d0/f2 [4194304,4194304] 0 2024-02-16T22:18:49.015 INFO:tasks.workunit.client.0.smithi134.stdout:8/44: dwrite d2/d3/f5 [0,4194304] 0 2024-02-16T22:18:49.020 INFO:tasks.workunit.client.0.smithi134.stdout:2/13: dwrite f2 [0,4194304] 0 2024-02-16T22:18:49.025 INFO:tasks.workunit.client.0.smithi134.stdout:5/29: dwrite d2/f6 [0,4194304] 0 2024-02-16T22:18:49.027 INFO:tasks.workunit.client.0.smithi134.stdout:3/51: dread da/ff [0,4194304] 0 2024-02-16T22:18:49.027 INFO:tasks.workunit.client.0.smithi134.stdout:3/52: rename da to da/d10 22 2024-02-16T22:18:49.028 INFO:tasks.workunit.client.0.smithi134.stdout:5/30: mkdir d2/d9 0 2024-02-16T22:18:49.029 INFO:tasks.workunit.client.0.smithi134.stdout:3/53: link da/fb da/f11 0 2024-02-16T22:18:49.031 INFO:tasks.workunit.client.0.smithi134.stdout:3/54: mkdir da/d12 0 2024-02-16T22:18:49.040 INFO:tasks.workunit.client.0.smithi134.stdout:6/29: dwrite f6 [0,4194304] 0 2024-02-16T22:18:49.045 INFO:tasks.workunit.client.0.smithi134.stdout:7/18: dwrite d2/d6/f8 [0,4194304] 0 2024-02-16T22:18:49.045 INFO:tasks.workunit.client.0.smithi134.stdout:7/19: truncate d2/f4 489416 0 2024-02-16T22:18:49.048 INFO:tasks.workunit.client.0.smithi134.stdout:7/20: mkdir d2/da 0 2024-02-16T22:18:49.050 INFO:tasks.workunit.client.0.smithi134.stdout:6/30: rename f3 to fa 0 2024-02-16T22:18:49.050 INFO:tasks.workunit.client.0.smithi134.stdout:6/31: chown c7 2000274465 1 2024-02-16T22:18:49.051 INFO:tasks.workunit.client.0.smithi134.stdout:6/32: truncate f9 2136416 0 2024-02-16T22:18:49.055 INFO:tasks.workunit.client.0.smithi134.stdout:2/14: dwrite f0 [0,4194304] 0 2024-02-16T22:18:49.055 INFO:tasks.workunit.client.0.smithi134.stdout:2/15: creat f4 x:0 0 0 2024-02-16T22:18:49.055 INFO:tasks.workunit.client.0.smithi134.stdout:2/16: dread - f4 zero size 2024-02-16T22:18:49.056 INFO:tasks.workunit.client.0.smithi134.stdout:5/31: dwrite d2/f6 [0,4194304] 0 2024-02-16T22:18:49.056 INFO:tasks.workunit.client.0.smithi134.stdout:5/32: stat d2 0 2024-02-16T22:18:49.056 INFO:tasks.workunit.client.0.smithi134.stdout:3/55: dwrite da/fd [0,4194304] 0 2024-02-16T22:18:49.056 INFO:tasks.workunit.client.0.smithi134.stdout:4/12: dwrite d0/f2 [4194304,4194304] 0 2024-02-16T22:18:49.056 INFO:tasks.workunit.client.0.smithi134.stdout:4/13: write d0/f2 [8684566,1198] 0 2024-02-16T22:18:49.061 INFO:tasks.workunit.client.0.smithi134.stdout:6/33: write fa [724942,35869] 0 2024-02-16T22:18:49.062 INFO:tasks.workunit.client.0.smithi134.stdout:6/34: readlink - no filename 2024-02-16T22:18:49.062 INFO:tasks.workunit.client.0.smithi134.stdout:5/33: link d2/f6 d2/fa 0 2024-02-16T22:18:49.062 INFO:tasks.workunit.client.0.smithi134.stdout:5/34: read d2/f3 [66522,22710] 0 2024-02-16T22:18:49.070 INFO:tasks.workunit.client.0.smithi134.stdout:4/14: dread d0/f2 [0,4194304] 0 2024-02-16T22:18:49.071 INFO:tasks.workunit.client.0.smithi134.stdout:4/15: link d0/f2 d0/f4 0 2024-02-16T22:18:49.072 INFO:tasks.workunit.client.0.smithi134.stdout:4/16: mkdir d0/d5 0 2024-02-16T22:18:49.073 INFO:tasks.workunit.client.0.smithi134.stdout:4/17: rename d0/d5 to d0/d6 0 2024-02-16T22:18:49.074 INFO:tasks.workunit.client.0.smithi134.stdout:4/18: chown d0/d6 67276154 1 2024-02-16T22:18:49.075 INFO:tasks.workunit.client.0.smithi134.stdout:3/56: dwrite da/ff [0,4194304] 0 2024-02-16T22:18:49.076 INFO:tasks.workunit.client.0.smithi134.stdout:6/35: fsync f9 0 2024-02-16T22:18:49.080 INFO:tasks.workunit.client.0.smithi134.stdout:3/57: mknod da/d12/c13 0 2024-02-16T22:18:49.085 INFO:tasks.workunit.client.0.smithi134.stdout:5/35: getdents d2 0 2024-02-16T22:18:49.088 INFO:tasks.workunit.client.0.smithi134.stdout:4/19: write d0/f4 [2722105,57866] 0 2024-02-16T22:18:49.088 INFO:tasks.workunit.client.0.smithi134.stdout:4/20: chown d0/f2 64 1 2024-02-16T22:18:49.090 INFO:tasks.workunit.client.0.smithi134.stdout:4/21: symlink d0/l7 0 2024-02-16T22:18:49.092 INFO:tasks.workunit.client.0.smithi134.stdout:4/22: mkdir d0/d6/d8 0 2024-02-16T22:18:49.103 INFO:tasks.workunit.client.0.smithi134.stdout:3/58: dread da/ff [0,4194304] 0 2024-02-16T22:18:49.104 INFO:tasks.workunit.client.0.smithi134.stdout:3/59: link c0 da/d12/c14 0 2024-02-16T22:18:49.106 INFO:tasks.workunit.client.0.smithi134.stdout:3/60: mkdir da/d12/d15 0 2024-02-16T22:18:49.106 INFO:tasks.workunit.client.0.smithi134.stdout:6/36: dwrite fa [0,4194304] 0 2024-02-16T22:18:49.106 INFO:tasks.workunit.client.0.smithi134.stdout:6/37: creat fb x:0 0 0 2024-02-16T22:18:49.106 INFO:tasks.workunit.client.0.smithi134.stdout:6/38: dread - fb zero size 2024-02-16T22:18:49.106 INFO:tasks.workunit.client.0.smithi134.stdout:2/17: dwrite f0 [4194304,4194304] 0 2024-02-16T22:18:49.106 INFO:tasks.workunit.client.0.smithi134.stdout:2/18: chown f4 1282444 1 2024-02-16T22:18:49.108 INFO:tasks.workunit.client.0.smithi134.stdout:6/39: symlink lc 0 2024-02-16T22:18:49.112 INFO:tasks.workunit.client.0.smithi134.stdout:2/19: symlink l5 0 2024-02-16T22:18:49.112 INFO:tasks.workunit.client.0.smithi134.stdout:2/20: chown f0 2029 1 2024-02-16T22:18:49.112 INFO:tasks.workunit.client.0.smithi134.stdout:6/40: mknod cd 0 2024-02-16T22:18:49.112 INFO:tasks.workunit.client.0.smithi134.stdout:6/41: truncate f6 5150829 0 2024-02-16T22:18:49.114 INFO:tasks.workunit.client.0.smithi134.stdout:2/21: mknod c6 0 2024-02-16T22:18:49.114 INFO:tasks.workunit.client.0.smithi134.stdout:2/22: chown c6 9156 1 2024-02-16T22:18:49.115 INFO:tasks.workunit.client.0.smithi134.stdout:6/42: link c1 ce 0 2024-02-16T22:18:49.116 INFO:tasks.workunit.client.0.smithi134.stdout:2/23: symlink l7 0 2024-02-16T22:18:49.116 INFO:tasks.workunit.client.0.smithi134.stdout:2/24: readlink l5 0 2024-02-16T22:18:49.117 INFO:tasks.workunit.client.0.smithi134.stdout:6/43: rename c8 to cf 0 2024-02-16T22:18:49.117 INFO:tasks.workunit.client.0.smithi134.stdout:6/44: creat f10 x:0 0 0 2024-02-16T22:18:49.117 INFO:tasks.workunit.client.0.smithi134.stdout:6/45: creat f11 x:0 0 0 2024-02-16T22:18:49.127 INFO:tasks.workunit.client.0.smithi134.stdout:0/18: sync 2024-02-16T22:18:49.127 INFO:tasks.workunit.client.0.smithi134.stdout:0/19: dread - d2/f6 zero size 2024-02-16T22:18:49.129 INFO:tasks.workunit.client.0.smithi134.stdout:6/46: dread f6 [0,4194304] 0 2024-02-16T22:18:49.129 INFO:tasks.workunit.client.0.smithi134.stdout:0/20: creat d2/f7 x:0 0 0 2024-02-16T22:18:49.130 INFO:tasks.workunit.client.0.smithi134.stdout:0/21: mkdir d2/d8 0 2024-02-16T22:18:49.130 INFO:tasks.workunit.client.0.smithi134.stdout:0/22: write d2/f6 [971381,77823] 0 2024-02-16T22:18:49.131 INFO:tasks.workunit.client.0.smithi134.stdout:2/25: truncate f0 3979555 0 2024-02-16T22:18:49.133 INFO:tasks.workunit.client.0.smithi134.stdout:6/47: dread f6 [0,4194304] 0 2024-02-16T22:18:49.156 INFO:tasks.workunit.client.0.smithi134.stdout:0/23: dwrite d2/f7 [0,4194304] 0 2024-02-16T22:18:49.156 INFO:tasks.workunit.client.0.smithi134.stdout:6/48: dwrite f6 [0,4194304] 0 2024-02-16T22:18:49.156 INFO:tasks.workunit.client.0.smithi134.stdout:6/49: readlink lc 0 2024-02-16T22:18:49.156 INFO:tasks.workunit.client.0.smithi134.stdout:0/24: write d2/f6 [1934788,16637] 0 2024-02-16T22:18:49.157 INFO:tasks.workunit.client.0.smithi134.stdout:0/25: readlink d2/l4 0 2024-02-16T22:18:49.158 INFO:tasks.workunit.client.0.smithi134.stdout:6/50: link f10 f12 0 2024-02-16T22:18:49.159 INFO:tasks.workunit.client.0.smithi134.stdout:6/51: write f6 [6110547,129865] 0 2024-02-16T22:18:49.166 INFO:tasks.workunit.client.0.smithi134.stdout:0/26: dread d2/f7 [0,4194304] 0 2024-02-16T22:18:49.171 INFO:tasks.workunit.client.0.smithi134.stdout:7/21: dwrite d2/d6/f8 [4194304,4194304] 0 2024-02-16T22:18:49.173 INFO:tasks.workunit.client.0.smithi134.stdout:5/36: dwrite d2/fa [0,4194304] 0 2024-02-16T22:18:49.174 INFO:tasks.workunit.client.0.smithi134.stdout:4/23: truncate d0/f4 1287146 0 2024-02-16T22:18:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:7/22: unlink d2/d6/f8 0 2024-02-16T22:18:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:7/23: truncate d2/f4 809839 0 2024-02-16T22:18:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:7/24: chown d2 5373 1 2024-02-16T22:18:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:5/37: mknod d2/d9/cb 0 2024-02-16T22:18:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:4/24: dread d0/f2 [0,4194304] 0 2024-02-16T22:18:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:4/25: chown d0/d6 172 1 2024-02-16T22:18:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:4/26: readlink d0/l7 0 2024-02-16T22:18:49.179 INFO:tasks.workunit.client.0.smithi134.stdout:5/38: truncate f0 2260270 0 2024-02-16T22:18:49.179 INFO:tasks.workunit.client.0.smithi134.stdout:5/39: fdatasync d2/f6 0 2024-02-16T22:18:49.179 INFO:tasks.workunit.client.0.smithi134.stdout:5/40: fsync d2/f3 0 2024-02-16T22:18:49.180 INFO:tasks.workunit.client.0.smithi134.stdout:4/27: symlink d0/d6/d8/l9 0 2024-02-16T22:18:49.180 INFO:tasks.workunit.client.0.smithi134.stdout:4/28: chown d0 0 1 2024-02-16T22:18:49.180 INFO:tasks.workunit.client.0.smithi134.stdout:5/41: dread d2/f3 [0,4194304] 0 2024-02-16T22:18:49.182 INFO:tasks.workunit.client.0.smithi134.stdout:4/29: creat d0/d6/d8/fa x:0 0 0 2024-02-16T22:18:49.185 INFO:tasks.workunit.client.0.smithi134.stdout:6/52: dwrite f9 [0,4194304] 0 2024-02-16T22:18:49.186 INFO:tasks.workunit.client.0.smithi134.stdout:6/53: rename lc to l13 0 2024-02-16T22:18:49.195 INFO:tasks.workunit.client.0.smithi134.stdout:3/61: dwrite f5 [0,4194304] 0 2024-02-16T22:18:49.196 INFO:tasks.workunit.client.0.smithi134.stdout:0/27: dwrite d2/f7 [4194304,4194304] 0 2024-02-16T22:18:49.196 INFO:tasks.workunit.client.0.smithi134.stdout:2/26: dwrite f4 [0,4194304] 0 2024-02-16T22:18:49.202 INFO:tasks.workunit.client.0.smithi134.stdout:0/28: unlink d2/c3 0 2024-02-16T22:18:49.203 INFO:tasks.workunit.client.0.smithi134.stdout:3/62: write da/f11 [1473356,4466] 0 2024-02-16T22:18:49.203 INFO:tasks.workunit.client.0.smithi134.stdout:7/25: dwrite d2/f4 [0,4194304] 0 2024-02-16T22:18:49.204 INFO:tasks.workunit.client.0.smithi134.stdout:5/42: truncate d2/f6 4169617 0 2024-02-16T22:18:49.207 INFO:tasks.workunit.client.0.smithi134.stdout:2/27: unlink l7 0 2024-02-16T22:18:49.214 INFO:tasks.workunit.client.0.smithi134.stdout:7/26: write d2/f4 [1297634,99871] 0 2024-02-16T22:18:49.216 INFO:tasks.workunit.client.0.smithi134.stdout:3/63: dread da/fd [0,4194304] 0 2024-02-16T22:18:49.216 INFO:tasks.workunit.client.0.smithi134.stdout:3/64: stat da/ff 0 2024-02-16T22:18:49.216 INFO:tasks.workunit.client.0.smithi134.stdout:3/65: write da/f11 [909621,99528] 0 2024-02-16T22:18:49.216 INFO:tasks.workunit.client.0.smithi134.stdout:7/27: link d2/f4 d2/fb 0 2024-02-16T22:18:49.216 INFO:tasks.workunit.client.0.smithi134.stdout:7/28: readlink d2/d5/l9 0 2024-02-16T22:18:49.216 INFO:tasks.workunit.client.0.smithi134.stdout:7/29: rename d2 to d2/da/dc 22 2024-02-16T22:18:49.216 INFO:tasks.workunit.client.0.smithi134.stdout:7/30: chown d2 36325540 1 2024-02-16T22:18:49.218 INFO:tasks.workunit.client.0.smithi134.stdout:6/54: dwrite fa [0,4194304] 0 2024-02-16T22:18:49.218 INFO:tasks.workunit.client.0.smithi134.stdout:6/55: creat f14 x:0 0 0 2024-02-16T22:18:49.218 INFO:tasks.workunit.client.0.smithi134.stdout:6/56: truncate f14 291779 0 2024-02-16T22:18:49.220 INFO:tasks.workunit.client.0.smithi134.stdout:7/31: rename d2/c3 to d2/da/cd 0 2024-02-16T22:18:49.221 INFO:tasks.workunit.client.0.smithi134.stdout:0/29: dwrite d2/f6 [0,4194304] 0 2024-02-16T22:18:49.222 INFO:tasks.workunit.client.0.smithi134.stdout:1/35: sync 2024-02-16T22:18:49.222 INFO:tasks.workunit.client.0.smithi134.stdout:9/126: sync 2024-02-16T22:18:49.222 INFO:tasks.workunit.client.0.smithi134.stdout:3/66: rmdir da 39 2024-02-16T22:18:49.222 INFO:tasks.workunit.client.0.smithi134.stdout:9/127: truncate db/dc/f16 1429891 0 2024-02-16T22:18:49.228 INFO:tasks.workunit.client.0.smithi134.stdout:0/30: symlink d2/l9 0 2024-02-16T22:18:49.234 INFO:tasks.workunit.client.0.smithi134.stdout:0/31: rmdir d2/d8 0 2024-02-16T22:18:49.236 INFO:tasks.workunit.client.0.smithi134.stdout:1/36: symlink d5/l10 0 2024-02-16T22:18:49.236 INFO:tasks.workunit.client.0.smithi134.stdout:1/37: dread - d5/f8 zero size 2024-02-16T22:18:49.236 INFO:tasks.workunit.client.0.smithi134.stdout:1/38: dread - d5/f7 zero size 2024-02-16T22:18:49.236 INFO:tasks.workunit.client.0.smithi134.stdout:3/67: dread da/ff [0,4194304] 0 2024-02-16T22:18:49.236 INFO:tasks.workunit.client.0.smithi134.stdout:3/68: fsync da/f11 0 2024-02-16T22:18:49.236 INFO:tasks.workunit.client.0.smithi134.stdout:2/28: dwrite f4 [0,4194304] 0 2024-02-16T22:18:49.237 INFO:tasks.workunit.client.0.smithi134.stdout:0/32: rename l0 to d2/la 0 2024-02-16T22:18:49.238 INFO:tasks.workunit.client.0.smithi134.stdout:1/39: truncate f1 5505790 0 2024-02-16T22:18:49.240 INFO:tasks.workunit.client.0.smithi134.stdout:3/69: link c3 da/d12/d15/c16 0 2024-02-16T22:18:49.240 INFO:tasks.workunit.client.0.smithi134.stdout:3/70: fdatasync da/ff 0 2024-02-16T22:18:49.243 INFO:tasks.workunit.client.0.smithi134.stdout:2/29: rename f4 to f8 0 2024-02-16T22:18:49.244 INFO:tasks.workunit.client.0.smithi134.stdout:1/40: unlink l4 0 2024-02-16T22:18:49.250 INFO:tasks.workunit.client.0.smithi134.stdout:0/33: dread d2/f6 [0,4194304] 0 2024-02-16T22:18:49.252 INFO:tasks.workunit.client.0.smithi134.stdout:0/34: link d2/c5 d2/cb 0 2024-02-16T22:18:49.255 INFO:tasks.workunit.client.0.smithi134.stdout:2/30: write f2 [3868813,54231] 0 2024-02-16T22:18:49.255 INFO:tasks.workunit.client.0.smithi134.stdout:5/43: dwrite d2/fa [0,4194304] 0 2024-02-16T22:18:49.257 INFO:tasks.workunit.client.0.smithi134.stdout:0/35: dread d2/f6 [0,4194304] 0 2024-02-16T22:18:49.257 INFO:tasks.workunit.client.0.smithi134.stdout:0/36: truncate d2/f6 4632687 0 2024-02-16T22:18:49.257 INFO:tasks.workunit.client.0.smithi134.stdout:6/57: truncate fa 1124012 0 2024-02-16T22:18:49.266 INFO:tasks.workunit.client.0.smithi134.stdout:1/41: dwrite d5/f6 [4194304,4194304] 0 2024-02-16T22:18:49.268 INFO:tasks.workunit.client.0.smithi134.stdout:3/71: dwrite da/ff [0,4194304] 0 2024-02-16T22:18:49.269 INFO:tasks.workunit.client.0.smithi134.stdout:2/31: write f8 [457047,6809] 0 2024-02-16T22:18:49.269 INFO:tasks.workunit.client.0.smithi134.stdout:9/128: dwrite db/d20/f28 [0,4194304] 0 2024-02-16T22:18:49.274 INFO:tasks.workunit.client.0.smithi134.stdout:2/32: symlink l9 0 2024-02-16T22:18:49.275 INFO:tasks.workunit.client.0.smithi134.stdout:9/129: truncate f8 2196732 0 2024-02-16T22:18:49.276 INFO:tasks.workunit.client.0.smithi134.stdout:2/33: symlink la 0 2024-02-16T22:18:49.277 INFO:tasks.workunit.client.0.smithi134.stdout:9/130: truncate db/dc/f17 978319 0 2024-02-16T22:18:49.283 INFO:tasks.workunit.client.0.smithi134.stdout:3/72: write f5 [2917838,3004] 0 2024-02-16T22:18:49.283 INFO:tasks.workunit.client.0.smithi134.stdout:5/44: dwrite f0 [0,4194304] 0 2024-02-16T22:18:49.285 INFO:tasks.workunit.client.0.smithi134.stdout:1/42: dread f1 [0,4194304] 0 2024-02-16T22:18:49.286 INFO:tasks.workunit.client.0.smithi134.stdout:5/45: mkdir d2/d9/dc 0 2024-02-16T22:18:49.288 INFO:tasks.workunit.client.0.smithi134.stdout:1/43: symlink d5/da/df/l11 0 2024-02-16T22:18:49.291 INFO:tasks.workunit.client.0.smithi134.stdout:0/37: getdents d2 0 2024-02-16T22:18:49.293 INFO:tasks.workunit.client.0.smithi134.stdout:1/44: rename d5/l10 to d5/da/df/l12 0 2024-02-16T22:18:49.299 INFO:tasks.workunit.client.0.smithi134.stdout:2/34: truncate f8 3619703 0 2024-02-16T22:18:49.331 INFO:tasks.workunit.client.0.smithi134.stdout:5/46: dwrite d2/fa [0,4194304] 0 2024-02-16T22:18:49.332 INFO:tasks.workunit.client.0.smithi134.stdout:0/38: dwrite d2/f6 [0,4194304] 0 2024-02-16T22:18:49.333 INFO:tasks.workunit.client.0.smithi134.stdout:2/35: dwrite f2 [0,4194304] 0 2024-02-16T22:18:49.333 INFO:tasks.workunit.client.0.smithi134.stdout:3/73: dwrite da/f11 [0,4194304] 0 2024-02-16T22:18:49.333 INFO:tasks.workunit.client.0.smithi134.stdout:9/131: dwrite db/dc/f14 [0,4194304] 0 2024-02-16T22:18:49.333 INFO:tasks.workunit.client.0.smithi134.stdout:9/132: write db/d20/d22/f26 [1799296,70669] 0 2024-02-16T22:18:49.333 INFO:tasks.workunit.client.0.smithi134.stdout:5/47: rmdir d2 39 2024-02-16T22:18:49.333 INFO:tasks.workunit.client.0.smithi134.stdout:5/48: truncate d2/f3 1072703 0 2024-02-16T22:18:49.333 INFO:tasks.workunit.client.0.smithi134.stdout:0/39: truncate d2/f7 6685732 0 2024-02-16T22:18:49.334 INFO:tasks.workunit.client.0.smithi134.stdout:1/45: getdents d5/da/df 0 2024-02-16T22:18:49.337 INFO:tasks.workunit.client.0.smithi134.stdout:3/74: creat da/d12/f17 x:0 0 0 2024-02-16T22:18:49.345 INFO:tasks.workunit.client.0.smithi134.stdout:2/36: write f1 [3021933,102285] 0 2024-02-16T22:18:49.345 INFO:tasks.workunit.client.0.smithi134.stdout:2/37: chown l5 106 1 2024-02-16T22:18:49.347 INFO:tasks.workunit.client.0.smithi134.stdout:5/49: symlink d2/d9/ld 0 2024-02-16T22:18:49.348 INFO:tasks.workunit.client.0.smithi134.stdout:1/46: symlink d5/l13 0 2024-02-16T22:18:49.349 INFO:tasks.workunit.client.0.smithi134.stdout:1/47: chown d5/l13 13674 1 2024-02-16T22:18:49.349 INFO:tasks.workunit.client.0.smithi134.stdout:1/48: write f1 [2851663,76375] 0 2024-02-16T22:18:49.349 INFO:tasks.workunit.client.0.smithi134.stdout:9/133: dwrite db/dc/f12 [0,4194304] 0 2024-02-16T22:18:49.349 INFO:tasks.workunit.client.0.smithi134.stdout:9/134: fsync db/dc/f16 0 2024-02-16T22:18:49.349 INFO:tasks.workunit.client.0.smithi134.stdout:9/135: fdatasync db/d20/d22/f25 0 2024-02-16T22:18:49.350 INFO:tasks.workunit.client.0.smithi134.stdout:9/136: chown db/dc/l1b 31385967 1 2024-02-16T22:18:49.350 INFO:tasks.workunit.client.0.smithi134.stdout:5/50: creat d2/d9/dc/fe x:0 0 0 2024-02-16T22:18:49.353 INFO:tasks.workunit.client.0.smithi134.stdout:9/137: creat db/f29 x:0 0 0 2024-02-16T22:18:49.355 INFO:tasks.workunit.client.0.smithi134.stdout:9/138: mknod db/d20/d22/c2a 0 2024-02-16T22:18:49.357 INFO:tasks.workunit.client.0.smithi134.stdout:9/139: mknod db/c2b 0 2024-02-16T22:18:49.359 INFO:tasks.workunit.client.0.smithi134.stdout:8/45: sync 2024-02-16T22:18:49.360 INFO:tasks.workunit.client.0.smithi134.stdout:1/49: fsync f1 0 2024-02-16T22:18:49.362 INFO:tasks.workunit.client.0.smithi134.stdout:8/46: creat d2/df/f10 x:0 0 0 2024-02-16T22:18:49.363 INFO:tasks.workunit.client.0.smithi134.stdout:3/75: dwrite da/fc [0,4194304] 0 2024-02-16T22:18:49.363 INFO:tasks.workunit.client.0.smithi134.stdout:3/76: chown da/fb 928956281 1 2024-02-16T22:18:49.365 INFO:tasks.workunit.client.0.smithi134.stdout:8/47: symlink d2/l11 0 2024-02-16T22:18:49.366 INFO:tasks.workunit.client.0.smithi134.stdout:8/48: fsync d2/d3/f9 0 2024-02-16T22:18:49.366 INFO:tasks.workunit.client.0.smithi134.stdout:8/49: write d2/f7 [1104080,22050] 0 2024-02-16T22:18:49.366 INFO:tasks.workunit.client.0.smithi134.stdout:1/50: dread f1 [0,4194304] 0 2024-02-16T22:18:49.367 INFO:tasks.workunit.client.0.smithi134.stdout:0/40: dwrite d2/f7 [0,4194304] 0 2024-02-16T22:18:49.367 INFO:tasks.workunit.client.0.smithi134.stdout:0/41: write d2/f6 [5596800,74773] 0 2024-02-16T22:18:49.369 INFO:tasks.workunit.client.0.smithi134.stdout:8/50: mkdir d2/d3/d12 0 2024-02-16T22:18:49.370 INFO:tasks.workunit.client.0.smithi134.stdout:1/51: creat d5/da/f14 x:0 0 0 2024-02-16T22:18:49.370 INFO:tasks.workunit.client.0.smithi134.stdout:1/52: creat d5/da/f15 x:0 0 0 2024-02-16T22:18:49.371 INFO:tasks.workunit.client.0.smithi134.stdout:1/53: rename d5 to d5/da/d16 22 2024-02-16T22:18:49.371 INFO:tasks.workunit.client.0.smithi134.stdout:0/42: mkdir d2/dc 0 2024-02-16T22:18:49.372 INFO:tasks.workunit.client.0.smithi134.stdout:8/51: symlink d2/d3/d12/l13 0 2024-02-16T22:18:49.375 INFO:tasks.workunit.client.0.smithi134.stdout:8/52: link d2/d3/f6 d2/df/f14 0 2024-02-16T22:18:49.377 INFO:tasks.workunit.client.0.smithi134.stdout:8/53: creat d2/d3/d12/f15 x:0 0 0 2024-02-16T22:18:49.377 INFO:tasks.workunit.client.0.smithi134.stdout:8/54: stat d2/d3/cb 0 2024-02-16T22:18:49.378 INFO:tasks.workunit.client.0.smithi134.stdout:3/77: dread da/ff [0,4194304] 0 2024-02-16T22:18:49.378 INFO:tasks.workunit.client.0.smithi134.stdout:3/78: dread - da/d12/f17 zero size 2024-02-16T22:18:49.379 INFO:tasks.workunit.client.0.smithi134.stdout:5/51: dwrite d2/f4 [0,4194304] 0 2024-02-16T22:18:49.379 INFO:tasks.workunit.client.0.smithi134.stdout:5/52: chown d2/f6 399 1 2024-02-16T22:18:49.382 INFO:tasks.workunit.client.0.smithi134.stdout:5/53: symlink d2/d9/dc/lf 0 2024-02-16T22:18:49.383 INFO:tasks.workunit.client.0.smithi134.stdout:5/54: mknod d2/d9/dc/c10 0 2024-02-16T22:18:49.384 INFO:tasks.workunit.client.0.smithi134.stdout:0/43: write d2/f7 [3272548,2930] 0 2024-02-16T22:18:49.385 INFO:tasks.workunit.client.0.smithi134.stdout:5/55: creat d2/d9/f11 x:0 0 0 2024-02-16T22:18:49.388 INFO:tasks.workunit.client.0.smithi134.stdout:5/56: link d2/f3 d2/d9/f12 0 2024-02-16T22:18:49.388 INFO:tasks.workunit.client.0.smithi134.stdout:5/57: chown d2/d9/dc/fe 114834866 1 2024-02-16T22:18:49.388 INFO:tasks.workunit.client.0.smithi134.stdout:5/58: write d2/d9/f11 [510467,11471] 0 2024-02-16T22:18:49.388 INFO:tasks.workunit.client.0.smithi134.stdout:5/59: write d2/d9/f12 [1110077,62986] 0 2024-02-16T22:18:49.388 INFO:tasks.workunit.client.0.smithi134.stdout:2/38: dwrite f0 [0,4194304] 0 2024-02-16T22:18:49.389 INFO:tasks.workunit.client.0.smithi134.stdout:2/39: creat fb x:0 0 0 2024-02-16T22:18:49.389 INFO:tasks.workunit.client.0.smithi134.stdout:1/54: dwrite d5/f6 [4194304,4194304] 0 2024-02-16T22:18:49.389 INFO:tasks.workunit.client.0.smithi134.stdout:9/140: dwrite db/dc/f14 [4194304,4194304] 0 2024-02-16T22:18:49.389 INFO:tasks.workunit.client.0.smithi134.stdout:9/141: chown db/c1d 0 1 2024-02-16T22:18:49.390 INFO:tasks.workunit.client.0.smithi134.stdout:9/142: chown db/c1f 14789619 1 2024-02-16T22:18:49.390 INFO:tasks.workunit.client.0.smithi134.stdout:1/55: dread - d5/f8 zero size 2024-02-16T22:18:49.390 INFO:tasks.workunit.client.0.smithi134.stdout:1/56: chown d5/f7 2 1 2024-02-16T22:18:49.390 INFO:tasks.workunit.client.0.smithi134.stdout:1/57: dread - d5/f7 zero size 2024-02-16T22:18:49.393 INFO:tasks.workunit.client.0.smithi134.stdout:0/44: fsync d2/f6 0 2024-02-16T22:18:49.393 INFO:tasks.workunit.client.0.smithi134.stdout:2/40: rename c6 to cc 0 2024-02-16T22:18:49.399 INFO:tasks.workunit.client.0.smithi134.stdout:9/143: mknod db/d20/c2c 0 2024-02-16T22:18:49.401 INFO:tasks.workunit.client.0.smithi134.stdout:1/58: creat d5/f17 x:0 0 0 2024-02-16T22:18:49.401 INFO:tasks.workunit.client.0.smithi134.stdout:1/59: rename d5 to d5/da/d18 22 2024-02-16T22:18:49.402 INFO:tasks.workunit.client.0.smithi134.stdout:1/60: link d5/da/fb d5/da/df/f19 0 2024-02-16T22:18:49.403 INFO:tasks.workunit.client.0.smithi134.stdout:1/61: stat d5/da/df/f19 0 2024-02-16T22:18:49.404 INFO:tasks.workunit.client.0.smithi134.stdout:1/62: mkdir d5/d1a 0 2024-02-16T22:18:49.405 INFO:tasks.workunit.client.0.smithi134.stdout:1/63: dread - d5/da/f14 zero size 2024-02-16T22:18:49.405 INFO:tasks.workunit.client.0.smithi134.stdout:1/64: mknod d5/da/c1b 0 2024-02-16T22:18:49.406 INFO:tasks.workunit.client.0.smithi134.stdout:1/65: rmdir d5/da/df 39 2024-02-16T22:18:49.406 INFO:tasks.workunit.client.0.smithi134.stdout:1/66: write d5/f8 [967793,110313] 0 2024-02-16T22:18:49.407 INFO:tasks.workunit.client.0.smithi134.stdout:1/67: mkdir d5/da/d1c 0 2024-02-16T22:18:49.407 INFO:tasks.workunit.client.0.smithi134.stdout:1/68: write f3 [1781529,76626] 0 2024-02-16T22:18:49.407 INFO:tasks.workunit.client.0.smithi134.stdout:1/69: creat d5/da/f1d x:0 0 0 2024-02-16T22:18:49.407 INFO:tasks.workunit.client.0.smithi134.stdout:1/70: read - d5/da/f15 zero size 2024-02-16T22:18:49.407 INFO:tasks.workunit.client.0.smithi134.stdout:1/71: dread - d5/f17 zero size 2024-02-16T22:18:49.407 INFO:tasks.workunit.client.0.smithi134.stdout:1/72: write d5/da/fb [901703,17637] 0 2024-02-16T22:18:49.408 INFO:tasks.workunit.client.0.smithi134.stdout:1/73: mknod d5/da/c1e 0 2024-02-16T22:18:49.408 INFO:tasks.workunit.client.0.smithi134.stdout:1/74: truncate d5/da/df/f19 1191362 0 2024-02-16T22:18:49.409 INFO:tasks.workunit.client.0.smithi134.stdout:3/79: dwrite da/ff [0,4194304] 0 2024-02-16T22:18:49.409 INFO:tasks.workunit.client.0.smithi134.stdout:3/80: truncate f7 293106 0 2024-02-16T22:18:49.409 INFO:tasks.workunit.client.0.smithi134.stdout:1/75: mknod d5/da/c1f 0 2024-02-16T22:18:49.411 INFO:tasks.workunit.client.0.smithi134.stdout:8/55: dwrite f0 [4194304,4194304] 0 2024-02-16T22:18:49.411 INFO:tasks.workunit.client.0.smithi134.stdout:8/56: chown d2 1 1 2024-02-16T22:18:49.411 INFO:tasks.workunit.client.0.smithi134.stdout:8/57: chown d2/d3/f5 3298173 1 2024-02-16T22:18:49.411 INFO:tasks.workunit.client.0.smithi134.stdout:8/58: fsync f1 0 2024-02-16T22:18:49.411 INFO:tasks.workunit.client.0.smithi134.stdout:0/45: dwrite d2/f6 [0,4194304] 0 2024-02-16T22:18:49.411 INFO:tasks.workunit.client.0.smithi134.stdout:3/81: link l4 da/l18 0 2024-02-16T22:18:49.411 INFO:tasks.workunit.client.0.smithi134.stdout:9/144: write db/dc/f14 [1052514,4603] 0 2024-02-16T22:18:49.412 INFO:tasks.workunit.client.0.smithi134.stdout:1/76: creat d5/da/df/f20 x:0 0 0 2024-02-16T22:18:49.415 INFO:tasks.workunit.client.0.smithi134.stdout:8/59: fsync d2/df/f14 0 2024-02-16T22:18:49.418 INFO:tasks.workunit.client.0.smithi134.stdout:5/60: rmdir d2/d9/dc 39 2024-02-16T22:18:49.420 INFO:tasks.workunit.client.0.smithi134.stdout:0/46: unlink d2/l4 0 2024-02-16T22:18:49.422 INFO:tasks.workunit.client.0.smithi134.stdout:3/82: creat da/f19 x:0 0 0 2024-02-16T22:18:49.423 INFO:tasks.workunit.client.0.smithi134.stdout:9/145: getdents db/d20/d22 0 2024-02-16T22:18:49.425 INFO:tasks.workunit.client.0.smithi134.stdout:2/41: link cc cd 0 2024-02-16T22:18:49.425 INFO:tasks.workunit.client.0.smithi134.stdout:2/42: chown cc 29302737 1 2024-02-16T22:18:49.427 INFO:tasks.workunit.client.0.smithi134.stdout:1/77: mkdir d5/da/d21 0 2024-02-16T22:18:49.428 INFO:tasks.workunit.client.0.smithi134.stdout:8/60: symlink d2/l16 0 2024-02-16T22:18:49.428 INFO:tasks.workunit.client.0.smithi134.stdout:3/83: dread f5 [0,4194304] 0 2024-02-16T22:18:49.429 INFO:tasks.workunit.client.0.smithi134.stdout:9/146: creat db/d20/d22/f2d x:0 0 0 2024-02-16T22:18:49.430 INFO:tasks.workunit.client.0.smithi134.stdout:1/78: symlink d5/d1a/l22 0 2024-02-16T22:18:49.430 INFO:tasks.workunit.client.0.smithi134.stdout:1/79: fdatasync d5/f17 0 2024-02-16T22:18:49.432 INFO:tasks.workunit.client.0.smithi134.stdout:5/61: read d2/f6 [1112102,53957] 0 2024-02-16T22:18:49.433 INFO:tasks.workunit.client.0.smithi134.stdout:8/61: rename d2/l16 to d2/l17 0 2024-02-16T22:18:49.434 INFO:tasks.workunit.client.0.smithi134.stdout:4/30: sync 2024-02-16T22:18:49.435 INFO:tasks.workunit.client.0.smithi134.stdout:1/80: unlink d5/da/cd 0 2024-02-16T22:18:49.438 INFO:tasks.workunit.client.0.smithi134.stdout:5/62: creat d2/d9/dc/f13 x:0 0 0 2024-02-16T22:18:49.440 INFO:tasks.workunit.client.0.smithi134.stdout:9/147: mknod db/d20/d22/c2e 0 2024-02-16T22:18:49.442 INFO:tasks.workunit.client.0.smithi134.stdout:4/31: rename d0/l7 to d0/lb 0 2024-02-16T22:18:49.442 INFO:tasks.workunit.client.0.smithi134.stdout:4/32: write d0/d6/d8/fa [1037519,16637] 0 2024-02-16T22:18:49.442 INFO:tasks.workunit.client.0.smithi134.stdout:4/33: write d0/f2 [1922369,96099] 0 2024-02-16T22:18:49.444 INFO:tasks.workunit.client.0.smithi134.stdout:0/47: dwrite d2/f7 [0,4194304] 0 2024-02-16T22:18:49.446 INFO:tasks.workunit.client.0.smithi134.stdout:9/148: creat db/d20/d22/f2f x:0 0 0 2024-02-16T22:18:49.446 INFO:tasks.workunit.client.0.smithi134.stdout:9/149: creat db/f30 x:0 0 0 2024-02-16T22:18:49.446 INFO:tasks.workunit.client.0.smithi134.stdout:9/150: write db/d20/d22/f2f [680638,3298] 0 2024-02-16T22:18:49.449 INFO:tasks.workunit.client.0.smithi134.stdout:4/34: symlink d0/lc 0 2024-02-16T22:18:49.452 INFO:tasks.workunit.client.0.smithi134.stdout:0/48: creat d2/dc/fd x:0 0 0 2024-02-16T22:18:49.456 INFO:tasks.workunit.client.0.smithi134.stdout:1/81: rename d5/da/df to d5/d1a/d23 0 2024-02-16T22:18:49.459 INFO:tasks.workunit.client.0.smithi134.stdout:9/151: rename db/d20/d22/f26 to db/d20/f31 0 2024-02-16T22:18:49.461 INFO:tasks.workunit.client.0.smithi134.stdout:9/152: unlink db/f30 0 2024-02-16T22:18:49.461 INFO:tasks.workunit.client.0.smithi134.stdout:7/32: sync 2024-02-16T22:18:49.461 INFO:tasks.workunit.client.0.smithi134.stdout:6/58: sync 2024-02-16T22:18:49.462 INFO:tasks.workunit.client.0.smithi134.stdout:6/59: chown fb 10269 1 2024-02-16T22:18:49.462 INFO:tasks.workunit.client.0.smithi134.stdout:6/60: chown ce 7 1 2024-02-16T22:18:49.462 INFO:tasks.workunit.client.0.smithi134.stdout:7/33: fdatasync d2/f4 0 2024-02-16T22:18:49.462 INFO:tasks.workunit.client.0.smithi134.stdout:9/153: mkdir db/d20/d32 0 2024-02-16T22:18:49.462 INFO:tasks.workunit.client.0.smithi134.stdout:9/154: creat db/f33 x:0 0 0 2024-02-16T22:18:49.462 INFO:tasks.workunit.client.0.smithi134.stdout:9/155: creat db/d20/f34 x:0 0 0 2024-02-16T22:18:49.471 INFO:tasks.workunit.client.0.smithi134.stdout:6/61: dread f9 [0,4194304] 0 2024-02-16T22:18:49.471 INFO:tasks.workunit.client.0.smithi134.stdout:6/62: chown c7 12120 1 2024-02-16T22:18:49.471 INFO:tasks.workunit.client.0.smithi134.stdout:6/63: creat f15 x:0 0 0 2024-02-16T22:18:49.475 INFO:tasks.workunit.client.0.smithi134.stdout:8/62: dwrite d2/d3/f9 [0,4194304] 0 2024-02-16T22:18:49.476 INFO:tasks.workunit.client.0.smithi134.stdout:4/35: fdatasync d0/d6/d8/fa 0 2024-02-16T22:18:49.476 INFO:tasks.workunit.client.0.smithi134.stdout:1/82: dread d5/da/fb [0,4194304] 0 2024-02-16T22:18:49.478 INFO:tasks.workunit.client.0.smithi134.stdout:4/36: read d0/d6/d8/fa [379832,8461] 0 2024-02-16T22:18:49.478 INFO:tasks.workunit.client.0.smithi134.stdout:4/37: chown d0/c3 190576604 1 2024-02-16T22:18:49.478 INFO:tasks.workunit.client.0.smithi134.stdout:4/38: stat d0/c3 0 2024-02-16T22:18:49.478 INFO:tasks.workunit.client.0.smithi134.stdout:4/39: readlink d0/lb 0 2024-02-16T22:18:49.482 INFO:tasks.workunit.client.0.smithi134.stdout:1/83: creat d5/f24 x:0 0 0 2024-02-16T22:18:49.482 INFO:tasks.workunit.client.0.smithi134.stdout:1/84: creat d5/da/f25 x:0 0 0 2024-02-16T22:18:49.482 INFO:tasks.workunit.client.0.smithi134.stdout:1/85: fsync d5/f7 0 2024-02-16T22:18:49.483 INFO:tasks.workunit.client.0.smithi134.stdout:4/40: symlink d0/d6/d8/ld 0 2024-02-16T22:18:49.484 INFO:tasks.workunit.client.0.smithi134.stdout:8/63: rmdir d2/d3/d12 39 2024-02-16T22:18:49.484 INFO:tasks.workunit.client.0.smithi134.stdout:8/64: chown f1 2238 1 2024-02-16T22:18:49.485 INFO:tasks.workunit.client.0.smithi134.stdout:5/63: dwrite f0 [0,4194304] 0 2024-02-16T22:18:49.486 INFO:tasks.workunit.client.0.smithi134.stdout:3/84: dwrite da/fb [0,4194304] 0 2024-02-16T22:18:49.486 INFO:tasks.workunit.client.0.smithi134.stdout:3/85: chown da/d12/f17 228899 1 2024-02-16T22:18:49.486 INFO:tasks.workunit.client.0.smithi134.stdout:3/86: chown f7 11252 1 2024-02-16T22:18:49.486 INFO:tasks.workunit.client.0.smithi134.stdout:1/86: fdatasync d5/f8 0 2024-02-16T22:18:49.488 INFO:tasks.workunit.client.0.smithi134.stdout:5/64: link d2/d9/cb d2/d9/c14 0 2024-02-16T22:18:49.489 INFO:tasks.workunit.client.0.smithi134.stdout:3/87: rmdir da/d12/d15 39 2024-02-16T22:18:49.489 INFO:tasks.workunit.client.0.smithi134.stdout:3/88: chown da 4136 1 2024-02-16T22:18:49.489 INFO:tasks.workunit.client.0.smithi134.stdout:3/89: creat da/f1a x:0 0 0 2024-02-16T22:18:49.489 INFO:tasks.workunit.client.0.smithi134.stdout:3/90: chown c3 922836971 1 2024-02-16T22:18:49.490 INFO:tasks.workunit.client.0.smithi134.stdout:5/65: mkdir d2/d9/dc/d15 0 2024-02-16T22:18:49.492 INFO:tasks.workunit.client.0.smithi134.stdout:8/65: rename d2/d3 to d2/df/d18 0 2024-02-16T22:18:49.497 INFO:tasks.workunit.client.0.smithi134.stdout:1/87: read d5/f6 [3671815,50239] 0 2024-02-16T22:18:49.498 INFO:tasks.workunit.client.0.smithi134.stdout:1/88: creat d5/f26 x:0 0 0 2024-02-16T22:18:49.501 INFO:tasks.workunit.client.0.smithi134.stdout:2/43: dwrite f2 [0,4194304] 0 2024-02-16T22:18:49.504 INFO:tasks.workunit.client.0.smithi134.stdout:8/66: write d2/df/d18/f5 [3844632,110164] 0 2024-02-16T22:18:49.506 INFO:tasks.workunit.client.0.smithi134.stdout:0/49: dwrite d2/dc/fd [0,4194304] 0 2024-02-16T22:18:49.507 INFO:tasks.workunit.client.0.smithi134.stdout:3/91: dwrite da/d12/f17 [0,4194304] 0 2024-02-16T22:18:49.507 INFO:tasks.workunit.client.0.smithi134.stdout:3/92: write da/f1a [539331,103486] 0 2024-02-16T22:18:49.507 INFO:tasks.workunit.client.0.smithi134.stdout:3/93: truncate da/f1a 1258377 0 2024-02-16T22:18:49.507 INFO:tasks.workunit.client.0.smithi134.stdout:3/94: write f7 [391627,75423] 0 2024-02-16T22:18:49.507 INFO:tasks.workunit.client.0.smithi134.stdout:7/34: dwrite d2/f4 [0,4194304] 0 2024-02-16T22:18:49.508 INFO:tasks.workunit.client.0.smithi134.stdout:2/44: dread f8 [0,4194304] 0 2024-02-16T22:18:49.508 INFO:tasks.workunit.client.0.smithi134.stdout:6/64: dwrite f15 [0,4194304] 0 2024-02-16T22:18:49.513 INFO:tasks.workunit.client.0.smithi134.stdout:3/95: unlink l4 0 2024-02-16T22:18:49.518 INFO:tasks.workunit.client.0.smithi134.stdout:1/89: dwrite d5/d1a/d23/f20 [0,4194304] 0 2024-02-16T22:18:49.518 INFO:tasks.workunit.client.0.smithi134.stdout:1/90: chown d5/da/c1e 308 1 2024-02-16T22:18:49.518 INFO:tasks.workunit.client.0.smithi134.stdout:1/91: read f3 [1047589,25414] 0 2024-02-16T22:18:49.519 INFO:tasks.workunit.client.0.smithi134.stdout:4/41: rmdir d0/d6/d8 39 2024-02-16T22:18:49.522 INFO:tasks.workunit.client.0.smithi134.stdout:5/66: getdents d2/d9/dc 0 2024-02-16T22:18:49.522 INFO:tasks.workunit.client.0.smithi134.stdout:5/67: chown d2/d9/dc/f13 107380712 1 2024-02-16T22:18:49.525 INFO:tasks.workunit.client.0.smithi134.stdout:2/45: mknod ce 0 2024-02-16T22:18:49.529 INFO:tasks.workunit.client.0.smithi134.stdout:1/92: creat d5/d1a/d23/f27 x:0 0 0 2024-02-16T22:18:49.531 INFO:tasks.workunit.client.0.smithi134.stdout:6/65: dwrite f6 [0,4194304] 0 2024-02-16T22:18:49.531 INFO:tasks.workunit.client.0.smithi134.stdout:4/42: mkdir d0/d6/d8/de 0 2024-02-16T22:18:49.531 INFO:tasks.workunit.client.0.smithi134.stdout:4/43: write d0/f4 [2858396,62825] 0 2024-02-16T22:18:49.531 INFO:tasks.workunit.client.0.smithi134.stdout:1/93: write d5/f8 [552928,83333] 0 2024-02-16T22:18:49.532 INFO:tasks.workunit.client.0.smithi134.stdout:5/68: symlink d2/d9/dc/d15/l16 0 2024-02-16T22:18:49.532 INFO:tasks.workunit.client.0.smithi134.stdout:5/69: dread - d2/d9/dc/f13 zero size 2024-02-16T22:18:49.534 INFO:tasks.workunit.client.0.smithi134.stdout:3/96: rename da/f1a to da/d12/d15/f1b 0 2024-02-16T22:18:49.537 INFO:tasks.workunit.client.0.smithi134.stdout:6/66: mknod c16 0 2024-02-16T22:18:49.537 INFO:tasks.workunit.client.0.smithi134.stdout:7/35: truncate d2/f4 4193188 0 2024-02-16T22:18:49.538 INFO:tasks.workunit.client.0.smithi134.stdout:3/97: dread da/fd [0,4194304] 0 2024-02-16T22:18:49.539 INFO:tasks.workunit.client.0.smithi134.stdout:1/94: symlink d5/da/d21/l28 0 2024-02-16T22:18:49.539 INFO:tasks.workunit.client.0.smithi134.stdout:6/67: dread f14 [0,4194304] 0 2024-02-16T22:18:49.540 INFO:tasks.workunit.client.0.smithi134.stdout:5/70: rmdir d2 39 2024-02-16T22:18:49.540 INFO:tasks.workunit.client.0.smithi134.stdout:0/50: dwrite d2/dc/fd [4194304,4194304] 0 2024-02-16T22:18:49.540 INFO:tasks.workunit.client.0.smithi134.stdout:0/51: creat d2/dc/fe x:0 0 0 2024-02-16T22:18:49.542 INFO:tasks.workunit.client.0.smithi134.stdout:6/68: dread f9 [0,4194304] 0 2024-02-16T22:18:49.544 INFO:tasks.workunit.client.0.smithi134.stdout:1/95: creat d5/da/d1c/f29 x:0 0 0 2024-02-16T22:18:49.544 INFO:tasks.workunit.client.0.smithi134.stdout:3/98: dread f5 [0,4194304] 0 2024-02-16T22:18:49.548 INFO:tasks.workunit.client.0.smithi134.stdout:2/46: getdents . 0 2024-02-16T22:18:49.548 INFO:tasks.workunit.client.0.smithi134.stdout:2/47: fdatasync f1 0 2024-02-16T22:18:49.551 INFO:tasks.workunit.client.0.smithi134.stdout:0/52: write d2/dc/fd [3878303,87290] 0 2024-02-16T22:18:49.551 INFO:tasks.workunit.client.0.smithi134.stdout:0/53: creat d2/dc/ff x:0 0 0 2024-02-16T22:18:49.554 INFO:tasks.workunit.client.0.smithi134.stdout:3/99: mkdir da/d1c 0 2024-02-16T22:18:49.557 INFO:tasks.workunit.client.0.smithi134.stdout:2/48: dread f1 [0,4194304] 0 2024-02-16T22:18:49.562 INFO:tasks.workunit.client.0.smithi134.stdout:0/54: rename d2/la to d2/dc/l10 0 2024-02-16T22:18:49.565 INFO:tasks.workunit.client.0.smithi134.stdout:3/100: symlink da/d12/l1d 0 2024-02-16T22:18:49.566 INFO:tasks.workunit.client.0.smithi134.stdout:4/44: dwrite d0/f2 [0,4194304] 0 2024-02-16T22:18:49.582 INFO:tasks.workunit.client.0.smithi134.stdout:5/71: dwrite d2/d9/f11 [0,4194304] 0 2024-02-16T22:18:49.589 INFO:tasks.workunit.client.0.smithi134.stdout:7/36: write d2/f4 [3527356,111201] 0 2024-02-16T22:18:49.590 INFO:tasks.workunit.client.0.smithi134.stdout:5/72: dread d2/d9/f11 [0,4194304] 0 2024-02-16T22:18:49.608 INFO:tasks.workunit.client.0.smithi134.stdout:1/96: dwrite d5/f24 [0,4194304] 0 2024-02-16T22:18:49.608 INFO:tasks.workunit.client.0.smithi134.stdout:2/49: dwrite f2 [0,4194304] 0 2024-02-16T22:18:49.608 INFO:tasks.workunit.client.0.smithi134.stdout:0/55: dwrite d2/f6 [4194304,4194304] 0 2024-02-16T22:18:49.609 INFO:tasks.workunit.client.0.smithi134.stdout:0/56: write d2/dc/fe [250664,112686] 0 2024-02-16T22:18:49.609 INFO:tasks.workunit.client.0.smithi134.stdout:3/101: dwrite da/fe [0,4194304] 0 2024-02-16T22:18:49.609 INFO:tasks.workunit.client.0.smithi134.stdout:4/45: dwrite d0/f4 [0,4194304] 0 2024-02-16T22:18:49.609 INFO:tasks.workunit.client.0.smithi134.stdout:0/57: read d2/dc/fe [120178,33317] 0 2024-02-16T22:18:49.609 INFO:tasks.workunit.client.0.smithi134.stdout:1/97: mkdir d5/da/d2a 0 2024-02-16T22:18:49.610 INFO:tasks.workunit.client.0.smithi134.stdout:1/98: write d5/f17 [225034,26128] 0 2024-02-16T22:18:49.610 INFO:tasks.workunit.client.0.smithi134.stdout:2/50: mkdir df 0 2024-02-16T22:18:49.610 INFO:tasks.workunit.client.0.smithi134.stdout:2/51: stat f2 0 2024-02-16T22:18:49.611 INFO:tasks.workunit.client.0.smithi134.stdout:3/102: write da/f19 [1025066,57133] 0 2024-02-16T22:18:49.612 INFO:tasks.workunit.client.0.smithi134.stdout:7/37: dread d2/fb [0,4194304] 0 2024-02-16T22:18:49.612 INFO:tasks.workunit.client.0.smithi134.stdout:7/38: fdatasync d2/fb 0 2024-02-16T22:18:49.617 INFO:tasks.workunit.client.0.smithi134.stdout:0/58: unlink d2/dc/fd 0 2024-02-16T22:18:49.618 INFO:tasks.workunit.client.0.smithi134.stdout:2/52: mkdir df/d10 0 2024-02-16T22:18:49.619 INFO:tasks.workunit.client.0.smithi134.stdout:7/39: symlink d2/da/le 0 2024-02-16T22:18:49.619 INFO:tasks.workunit.client.0.smithi134.stdout:7/40: creat d2/ff x:0 0 0 2024-02-16T22:18:49.621 INFO:tasks.workunit.client.0.smithi134.stdout:2/53: mkdir df/d10/d11 0 2024-02-16T22:18:49.624 INFO:tasks.workunit.client.0.smithi134.stdout:7/41: truncate d2/fb 3273193 0 2024-02-16T22:18:49.625 INFO:tasks.workunit.client.0.smithi134.stdout:3/103: dwrite da/d12/f17 [0,4194304] 0 2024-02-16T22:18:49.625 INFO:tasks.workunit.client.0.smithi134.stdout:9/156: sync 2024-02-16T22:18:49.625 INFO:tasks.workunit.client.0.smithi134.stdout:8/67: sync 2024-02-16T22:18:49.625 INFO:tasks.workunit.client.0.smithi134.stdout:8/68: chown d2/df/f10 233713944 1 2024-02-16T22:18:49.626 INFO:tasks.workunit.client.0.smithi134.stdout:7/42: rmdir d2/da 39 2024-02-16T22:18:49.626 INFO:tasks.workunit.client.0.smithi134.stdout:7/43: chown d2/ff 206636 1 2024-02-16T22:18:49.627 INFO:tasks.workunit.client.0.smithi134.stdout:7/44: chown d2/d5/l9 48497106 1 2024-02-16T22:18:49.627 INFO:tasks.workunit.client.0.smithi134.stdout:2/54: dread f8 [0,4194304] 0 2024-02-16T22:18:49.627 INFO:tasks.workunit.client.0.smithi134.stdout:2/55: write f2 [4616930,15706] 0 2024-02-16T22:18:49.629 INFO:tasks.workunit.client.0.smithi134.stdout:9/157: rmdir db/d20/d22 39 2024-02-16T22:18:49.629 INFO:tasks.workunit.client.0.smithi134.stdout:9/158: chown db/d20/d22/f2f 6 1 2024-02-16T22:18:49.629 INFO:tasks.workunit.client.0.smithi134.stdout:8/69: getdents d2 0 2024-02-16T22:18:49.634 INFO:tasks.workunit.client.0.smithi134.stdout:1/99: truncate d5/f17 149146 0 2024-02-16T22:18:49.638 INFO:tasks.workunit.client.0.smithi134.stdout:0/59: dwrite d2/f7 [4194304,4194304] 0 2024-02-16T22:18:49.640 INFO:tasks.workunit.client.0.smithi134.stdout:0/60: rename d2/f6 to d2/f11 0 2024-02-16T22:18:49.640 INFO:tasks.workunit.client.0.smithi134.stdout:0/61: chown d2/dc/fe 87979883 1 2024-02-16T22:18:49.643 INFO:tasks.workunit.client.0.smithi134.stdout:0/62: creat d2/f12 x:0 0 0 2024-02-16T22:18:49.644 INFO:tasks.workunit.client.0.smithi134.stdout:3/104: dwrite da/fe [4194304,4194304] 0 2024-02-16T22:18:49.646 INFO:tasks.workunit.client.0.smithi134.stdout:9/159: dread db/d20/f28 [0,4194304] 0 2024-02-16T22:18:49.649 INFO:tasks.workunit.client.0.smithi134.stdout:9/160: creat db/d20/d22/f35 x:0 0 0 2024-02-16T22:18:49.649 INFO:tasks.workunit.client.0.smithi134.stdout:9/161: fdatasync db/dc/f14 0 2024-02-16T22:18:49.649 INFO:tasks.workunit.client.0.smithi134.stdout:9/162: read - db/d20/f34 zero size 2024-02-16T22:18:49.658 INFO:tasks.workunit.client.0.smithi134.stdout:3/105: write da/fb [3485714,105040] 0 2024-02-16T22:18:49.662 INFO:tasks.workunit.client.0.smithi134.stdout:9/163: read db/dc/f15 [8049801,45763] 0 2024-02-16T22:18:49.663 INFO:tasks.workunit.client.0.smithi134.stdout:9/164: link db/c11 db/dc/c36 0 2024-02-16T22:18:49.665 INFO:tasks.workunit.client.0.smithi134.stdout:9/165: mknod db/d20/d22/c37 0 2024-02-16T22:18:49.666 INFO:tasks.workunit.client.0.smithi134.stdout:2/56: dwrite f2 [0,4194304] 0 2024-02-16T22:18:49.667 INFO:tasks.workunit.client.0.smithi134.stdout:8/70: dwrite d2/df/f14 [0,4194304] 0 2024-02-16T22:18:49.669 INFO:tasks.workunit.client.0.smithi134.stdout:1/100: dwrite d5/da/d1c/f29 [0,4194304] 0 2024-02-16T22:18:49.670 INFO:tasks.workunit.client.0.smithi134.stdout:2/57: dread f1 [0,4194304] 0 2024-02-16T22:18:49.670 INFO:tasks.workunit.client.0.smithi134.stdout:2/58: truncate fb 640172 0 2024-02-16T22:18:49.670 INFO:tasks.workunit.client.0.smithi134.stdout:2/59: chown fb 104923 1 2024-02-16T22:18:49.670 INFO:tasks.workunit.client.0.smithi134.stdout:2/60: readlink la 0 2024-02-16T22:18:49.670 INFO:tasks.workunit.client.0.smithi134.stdout:2/61: stat df/d10/d11 0 2024-02-16T22:18:49.670 INFO:tasks.workunit.client.0.smithi134.stdout:2/62: write f1 [4991565,70606] 0 2024-02-16T22:18:49.671 INFO:tasks.workunit.client.0.smithi134.stdout:0/63: fsync d2/f11 0 2024-02-16T22:18:49.674 INFO:tasks.workunit.client.0.smithi134.stdout:3/106: dwrite da/fd [0,4194304] 0 2024-02-16T22:18:49.679 INFO:tasks.workunit.client.0.smithi134.stdout:3/107: unlink da/d12/l1d 0 2024-02-16T22:18:49.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/71: dread d2/df/f14 [0,4194304] 0 2024-02-16T22:18:49.680 INFO:tasks.workunit.client.0.smithi134.stdout:7/45: truncate d2/f4 2680563 0 2024-02-16T22:18:49.681 INFO:tasks.workunit.client.0.smithi134.stdout:2/63: dread f2 [0,4194304] 0 2024-02-16T22:18:49.682 INFO:tasks.workunit.client.0.smithi134.stdout:3/108: link da/fd da/d1c/f1e 0 2024-02-16T22:18:49.682 INFO:tasks.workunit.client.0.smithi134.stdout:3/109: rename da/d12/d15 to da/d12/d15/d1f 22 2024-02-16T22:18:49.683 INFO:tasks.workunit.client.0.smithi134.stdout:8/72: mkdir d2/df/d19 0 2024-02-16T22:18:49.684 INFO:tasks.workunit.client.0.smithi134.stdout:8/73: rename d2/df/d18/l4 to d2/l1a 0 2024-02-16T22:18:49.684 INFO:tasks.workunit.client.0.smithi134.stdout:8/74: chown d2/cd 76861 1 2024-02-16T22:18:49.684 INFO:tasks.workunit.client.0.smithi134.stdout:8/75: chown d2/df/d18/d12/f15 1 1 2024-02-16T22:18:49.687 INFO:tasks.workunit.client.0.smithi134.stdout:8/76: link d2/df/d18/f9 d2/f1b 0 2024-02-16T22:18:49.687 INFO:tasks.workunit.client.0.smithi134.stdout:8/77: creat d2/df/f1c x:0 0 0 2024-02-16T22:18:49.687 INFO:tasks.workunit.client.0.smithi134.stdout:8/78: chown d2/f7 9942516 1 2024-02-16T22:18:49.687 INFO:tasks.workunit.client.0.smithi134.stdout:8/79: creat d2/df/f1d x:0 0 0 2024-02-16T22:18:49.689 INFO:tasks.workunit.client.0.smithi134.stdout:0/64: dread d2/f7 [0,4194304] 0 2024-02-16T22:18:49.690 INFO:tasks.workunit.client.0.smithi134.stdout:1/101: dwrite d5/f7 [0,4194304] 0 2024-02-16T22:18:49.690 INFO:tasks.workunit.client.0.smithi134.stdout:1/102: write d5/da/f14 [230064,40305] 0 2024-02-16T22:18:49.691 INFO:tasks.workunit.client.0.smithi134.stdout:8/80: rename d2/cd to d2/df/d18/c1e 0 2024-02-16T22:18:49.694 INFO:tasks.workunit.client.0.smithi134.stdout:1/103: rename d5/f17 to d5/d1a/d23/f2b 0 2024-02-16T22:18:49.694 INFO:tasks.workunit.client.0.smithi134.stdout:8/81: mknod d2/df/c1f 0 2024-02-16T22:18:49.697 INFO:tasks.workunit.client.0.smithi134.stdout:8/82: rename d2/df/f1d to d2/df/d19/f20 0 2024-02-16T22:18:49.702 INFO:tasks.workunit.client.0.smithi134.stdout:7/46: read d2/fb [2519672,105760] 0 2024-02-16T22:18:49.703 INFO:tasks.workunit.client.0.smithi134.stdout:8/83: write d2/df/f14 [80223,74742] 0 2024-02-16T22:18:49.705 INFO:tasks.workunit.client.0.smithi134.stdout:6/69: sync 2024-02-16T22:18:49.705 INFO:tasks.workunit.client.0.smithi134.stdout:5/73: sync 2024-02-16T22:18:49.705 INFO:tasks.workunit.client.0.smithi134.stdout:4/46: sync 2024-02-16T22:18:49.706 INFO:tasks.workunit.client.0.smithi134.stdout:6/70: mkdir d17 0 2024-02-16T22:18:49.708 INFO:tasks.workunit.client.0.smithi134.stdout:5/74: rename d2/d9/dc/c10 to d2/d9/c17 0 2024-02-16T22:18:49.713 INFO:tasks.workunit.client.0.smithi134.stdout:5/75: creat d2/f18 x:0 0 0 2024-02-16T22:18:49.713 INFO:tasks.workunit.client.0.smithi134.stdout:5/76: creat d2/f19 x:0 0 0 2024-02-16T22:18:49.713 INFO:tasks.workunit.client.0.smithi134.stdout:5/77: dread - d2/d9/dc/f13 zero size 2024-02-16T22:18:49.717 INFO:tasks.workunit.client.0.smithi134.stdout:2/64: dwrite f2 [4194304,4194304] 0 2024-02-16T22:18:49.717 INFO:tasks.workunit.client.0.smithi134.stdout:2/65: readlink la 0 2024-02-16T22:18:49.717 INFO:tasks.workunit.client.0.smithi134.stdout:0/65: dwrite d2/f12 [0,4194304] 0 2024-02-16T22:18:49.717 INFO:tasks.workunit.client.0.smithi134.stdout:5/78: creat d2/d9/dc/d15/f1a x:0 0 0 2024-02-16T22:18:49.718 INFO:tasks.workunit.client.0.smithi134.stdout:3/110: dwrite da/d12/f17 [0,4194304] 0 2024-02-16T22:18:49.723 INFO:tasks.workunit.client.0.smithi134.stdout:5/79: mknod d2/d9/dc/c1b 0 2024-02-16T22:18:49.723 INFO:tasks.workunit.client.0.smithi134.stdout:4/47: write d0/f2 [976134,29363] 0 2024-02-16T22:18:49.723 INFO:tasks.workunit.client.0.smithi134.stdout:3/111: rename da/fe to da/d12/f20 0 2024-02-16T22:18:49.724 INFO:tasks.workunit.client.0.smithi134.stdout:5/80: symlink d2/l1c 0 2024-02-16T22:18:49.724 INFO:tasks.workunit.client.0.smithi134.stdout:5/81: write d2/f6 [5181718,108471] 0 2024-02-16T22:18:49.724 INFO:tasks.workunit.client.0.smithi134.stdout:5/82: chown d2/d9/dc 31 1 2024-02-16T22:18:49.725 INFO:tasks.workunit.client.0.smithi134.stdout:4/48: symlink d0/d6/d8/lf 0 2024-02-16T22:18:49.725 INFO:tasks.workunit.client.0.smithi134.stdout:4/49: chown d0/d6/d8/l9 1091 1 2024-02-16T22:18:49.725 INFO:tasks.workunit.client.0.smithi134.stdout:4/50: fsync d0/d6/d8/fa 0 2024-02-16T22:18:49.725 INFO:tasks.workunit.client.0.smithi134.stdout:3/112: rmdir da 39 2024-02-16T22:18:49.727 INFO:tasks.workunit.client.0.smithi134.stdout:5/83: rename d2/d9/f12 to d2/d9/dc/f1d 0 2024-02-16T22:18:49.727 INFO:tasks.workunit.client.0.smithi134.stdout:5/84: write d2/d9/dc/f13 [570015,124672] 0 2024-02-16T22:18:49.727 INFO:tasks.workunit.client.0.smithi134.stdout:5/85: truncate d2/f19 474877 0 2024-02-16T22:18:49.727 INFO:tasks.workunit.client.0.smithi134.stdout:5/86: chown d2/d9/cb 1607 1 2024-02-16T22:18:49.728 INFO:tasks.workunit.client.0.smithi134.stdout:3/113: rename f5 to da/d12/f21 0 2024-02-16T22:18:49.729 INFO:tasks.workunit.client.0.smithi134.stdout:5/87: mknod d2/c1e 0 2024-02-16T22:18:49.729 INFO:tasks.workunit.client.0.smithi134.stdout:2/66: dread f2 [4194304,4194304] 0 2024-02-16T22:18:49.731 INFO:tasks.workunit.client.0.smithi134.stdout:5/88: unlink d2/l5 0 2024-02-16T22:18:49.732 INFO:tasks.workunit.client.0.smithi134.stdout:5/89: rename d2/d9/dc/lf to d2/l1f 0 2024-02-16T22:18:49.738 INFO:tasks.workunit.client.0.smithi134.stdout:7/47: dwrite d2/ff [0,4194304] 0 2024-02-16T22:18:49.740 INFO:tasks.workunit.client.0.smithi134.stdout:6/71: dwrite f12 [0,4194304] 0 2024-02-16T22:18:49.740 INFO:tasks.workunit.client.0.smithi134.stdout:6/72: chown f12 18456 1 2024-02-16T22:18:49.740 INFO:tasks.workunit.client.0.smithi134.stdout:8/84: dwrite d2/df/f10 [0,4194304] 0 2024-02-16T22:18:49.740 INFO:tasks.workunit.client.0.smithi134.stdout:8/85: chown d2/df/c1f 56 1 2024-02-16T22:18:49.740 INFO:tasks.workunit.client.0.smithi134.stdout:8/86: fsync d2/f7 0 2024-02-16T22:18:49.741 INFO:tasks.workunit.client.0.smithi134.stdout:0/66: dwrite d2/dc/ff [0,4194304] 0 2024-02-16T22:18:49.744 INFO:tasks.workunit.client.0.smithi134.stdout:6/73: write f9 [676505,12155] 0 2024-02-16T22:18:49.745 INFO:tasks.workunit.client.0.smithi134.stdout:7/48: dread d2/fb [0,4194304] 0 2024-02-16T22:18:49.745 INFO:tasks.workunit.client.0.smithi134.stdout:7/49: write d2/f4 [311608,50777] 0 2024-02-16T22:18:49.750 INFO:tasks.workunit.client.0.smithi134.stdout:3/114: dwrite da/ff [0,4194304] 0 2024-02-16T22:18:49.750 INFO:tasks.workunit.client.0.smithi134.stdout:8/87: dread d2/df/d18/f6 [0,4194304] 0 2024-02-16T22:18:49.750 INFO:tasks.workunit.client.0.smithi134.stdout:3/115: write da/ff [4891500,59402] 0 2024-02-16T22:18:49.750 INFO:tasks.workunit.client.0.smithi134.stdout:0/67: read d2/f12 [3870686,126357] 0 2024-02-16T22:18:49.757 INFO:tasks.workunit.client.0.smithi134.stdout:6/74: rename fb to d17/f18 0 2024-02-16T22:18:49.757 INFO:tasks.workunit.client.0.smithi134.stdout:5/90: dread d2/fa [0,4194304] 0 2024-02-16T22:18:49.757 INFO:tasks.workunit.client.0.smithi134.stdout:5/91: chown d2/d9/dc/d15/f1a 2922729 1 2024-02-16T22:18:49.758 INFO:tasks.workunit.client.0.smithi134.stdout:7/50: creat d2/d5/f10 x:0 0 0 2024-02-16T22:18:49.758 INFO:tasks.workunit.client.0.smithi134.stdout:5/92: write d2/d9/dc/f1d [682422,120539] 0 2024-02-16T22:18:49.760 INFO:tasks.workunit.client.0.smithi134.stdout:8/88: mkdir d2/df/d21 0 2024-02-16T22:18:49.760 INFO:tasks.workunit.client.0.smithi134.stdout:8/89: read d2/df/d18/fc [45932,115091] 0 2024-02-16T22:18:49.761 INFO:tasks.workunit.client.0.smithi134.stdout:0/68: mknod d2/dc/c13 0 2024-02-16T22:18:49.763 INFO:tasks.workunit.client.0.smithi134.stdout:5/93: symlink d2/d9/dc/d15/l20 0 2024-02-16T22:18:49.765 INFO:tasks.workunit.client.0.smithi134.stdout:8/90: rmdir d2/df/d18 39 2024-02-16T22:18:49.765 INFO:tasks.workunit.client.0.smithi134.stdout:8/91: chown d2/df/d18/fc 45 1 2024-02-16T22:18:49.765 INFO:tasks.workunit.client.0.smithi134.stdout:8/92: truncate d2/df/d19/f20 814247 0 2024-02-16T22:18:49.765 INFO:tasks.workunit.client.0.smithi134.stdout:8/93: chown d2/f1b 28662455 1 2024-02-16T22:18:49.765 INFO:tasks.workunit.client.0.smithi134.stdout:8/94: write d2/df/d18/fc [1202758,88377] 0 2024-02-16T22:18:49.766 INFO:tasks.workunit.client.0.smithi134.stdout:0/69: mknod d2/dc/c14 0 2024-02-16T22:18:49.766 INFO:tasks.workunit.client.0.smithi134.stdout:0/70: write d2/dc/fe [386952,18293] 0 2024-02-16T22:18:49.766 INFO:tasks.workunit.client.0.smithi134.stdout:0/71: creat d2/dc/f15 x:0 0 0 2024-02-16T22:18:49.767 INFO:tasks.workunit.client.0.smithi134.stdout:0/72: creat d2/f16 x:0 0 0 2024-02-16T22:18:49.767 INFO:tasks.workunit.client.0.smithi134.stdout:0/73: chown d2/cb 39055 1 2024-02-16T22:18:49.767 INFO:tasks.workunit.client.0.smithi134.stdout:8/95: symlink d2/l22 0 2024-02-16T22:18:49.768 INFO:tasks.workunit.client.0.smithi134.stdout:6/75: read f10 [4128993,102774] 0 2024-02-16T22:18:49.769 INFO:tasks.workunit.client.0.smithi134.stdout:4/51: dwrite d0/f2 [0,4194304] 0 2024-02-16T22:18:49.769 INFO:tasks.workunit.client.0.smithi134.stdout:5/94: dread d2/f6 [0,4194304] 0 2024-02-16T22:18:49.771 INFO:tasks.workunit.client.0.smithi134.stdout:8/96: link d2/df/d18/f6 d2/df/f23 0 2024-02-16T22:18:49.772 INFO:tasks.workunit.client.0.smithi134.stdout:3/116: dread da/ff [0,4194304] 0 2024-02-16T22:18:49.773 INFO:tasks.workunit.client.0.smithi134.stdout:4/52: mknod d0/d6/d8/c10 0 2024-02-16T22:18:49.773 INFO:tasks.workunit.client.0.smithi134.stdout:4/53: creat d0/f11 x:0 0 0 2024-02-16T22:18:49.776 INFO:tasks.workunit.client.0.smithi134.stdout:8/97: creat d2/f24 x:0 0 0 2024-02-16T22:18:49.776 INFO:tasks.workunit.client.0.smithi134.stdout:8/98: fdatasync d2/df/d18/f9 0 2024-02-16T22:18:49.776 INFO:tasks.workunit.client.0.smithi134.stdout:8/99: write f0 [8730292,24070] 0 2024-02-16T22:18:49.776 INFO:tasks.workunit.client.0.smithi134.stdout:8/100: creat d2/f25 x:0 0 0 2024-02-16T22:18:49.777 INFO:tasks.workunit.client.0.smithi134.stdout:5/95: getdents d2 0 2024-02-16T22:18:49.777 INFO:tasks.workunit.client.0.smithi134.stdout:7/51: dread d2/f4 [0,4194304] 0 2024-02-16T22:18:49.777 INFO:tasks.workunit.client.0.smithi134.stdout:5/96: write d2/f19 [701974,76171] 0 2024-02-16T22:18:49.777 INFO:tasks.workunit.client.0.smithi134.stdout:5/97: fdatasync d2/d9/dc/d15/f1a 0 2024-02-16T22:18:49.778 INFO:tasks.workunit.client.0.smithi134.stdout:8/101: dread d2/df/d19/f20 [0,4194304] 0 2024-02-16T22:18:49.779 INFO:tasks.workunit.client.0.smithi134.stdout:6/76: dread f9 [0,4194304] 0 2024-02-16T22:18:49.783 INFO:tasks.workunit.client.0.smithi134.stdout:0/74: dwrite d2/f12 [0,4194304] 0 2024-02-16T22:18:49.783 INFO:tasks.workunit.client.0.smithi134.stdout:0/75: chown d2/c5 196841 1 2024-02-16T22:18:49.784 INFO:tasks.workunit.client.0.smithi134.stdout:9/166: sync 2024-02-16T22:18:49.785 INFO:tasks.workunit.client.0.smithi134.stdout:3/117: readlink da/l18 0 2024-02-16T22:18:49.791 INFO:tasks.workunit.client.0.smithi134.stdout:5/98: truncate d2/f4 2472336 0 2024-02-16T22:18:49.792 INFO:tasks.workunit.client.0.smithi134.stdout:0/76: read d2/f7 [7411443,72945] 0 2024-02-16T22:18:49.792 INFO:tasks.workunit.client.0.smithi134.stdout:5/99: fdatasync d2/f4 0 2024-02-16T22:18:49.793 INFO:tasks.workunit.client.0.smithi134.stdout:8/102: rename d2/l11 to d2/df/d19/l26 0 2024-02-16T22:18:49.793 INFO:tasks.workunit.client.0.smithi134.stdout:8/103: stat d2/df/d18/f9 0 2024-02-16T22:18:49.793 INFO:tasks.workunit.client.0.smithi134.stdout:8/104: fsync d2/df/f10 0 2024-02-16T22:18:49.793 INFO:tasks.workunit.client.0.smithi134.stdout:8/105: readlink d2/l17 0 2024-02-16T22:18:49.797 INFO:tasks.workunit.client.0.smithi134.stdout:6/77: dwrite f14 [0,4194304] 0 2024-02-16T22:18:49.797 INFO:tasks.workunit.client.0.smithi134.stdout:6/78: chown ce 12784 1 2024-02-16T22:18:49.797 INFO:tasks.workunit.client.0.smithi134.stdout:6/79: chown c1 297094 1 2024-02-16T22:18:49.799 INFO:tasks.workunit.client.0.smithi134.stdout:0/77: truncate d2/f7 594298 0 2024-02-16T22:18:49.799 INFO:tasks.workunit.client.0.smithi134.stdout:0/78: creat d2/f17 x:0 0 0 2024-02-16T22:18:49.801 INFO:tasks.workunit.client.0.smithi134.stdout:9/167: rename db/d20/d22/f2d to db/dc/f38 0 2024-02-16T22:18:49.801 INFO:tasks.workunit.client.0.smithi134.stdout:9/168: chown db/dc/c1e 767502 1 2024-02-16T22:18:49.801 INFO:tasks.workunit.client.0.smithi134.stdout:9/169: write db/d20/f31 [2862206,47611] 0 2024-02-16T22:18:49.801 INFO:tasks.workunit.client.0.smithi134.stdout:9/170: chown db/c10 10 1 2024-02-16T22:18:49.801 INFO:tasks.workunit.client.0.smithi134.stdout:9/171: creat db/d20/f39 x:0 0 0 2024-02-16T22:18:49.802 INFO:tasks.workunit.client.0.smithi134.stdout:8/106: mkdir d2/df/d18/d27 0 2024-02-16T22:18:49.805 INFO:tasks.workunit.client.0.smithi134.stdout:6/80: mknod d17/c19 0 2024-02-16T22:18:49.805 INFO:tasks.workunit.client.0.smithi134.stdout:6/81: fdatasync f12 0 2024-02-16T22:18:49.805 INFO:tasks.workunit.client.0.smithi134.stdout:1/104: sync 2024-02-16T22:18:49.805 INFO:tasks.workunit.client.0.smithi134.stdout:1/105: fdatasync d5/da/fb 0 2024-02-16T22:18:49.805 INFO:tasks.workunit.client.0.smithi134.stdout:1/106: truncate f3 2284055 0 2024-02-16T22:18:49.806 INFO:tasks.workunit.client.0.smithi134.stdout:5/100: dwrite d2/d9/f11 [0,4194304] 0 2024-02-16T22:18:49.807 INFO:tasks.workunit.client.0.smithi134.stdout:0/79: symlink d2/l18 0 2024-02-16T22:18:49.807 INFO:tasks.workunit.client.0.smithi134.stdout:4/54: getdents d0 0 2024-02-16T22:18:49.809 INFO:tasks.workunit.client.0.smithi134.stdout:3/118: rename da/d12/d15/f1b to da/d1c/f22 0 2024-02-16T22:18:49.811 INFO:tasks.workunit.client.0.smithi134.stdout:4/55: dread d0/d6/d8/fa [0,4194304] 0 2024-02-16T22:18:49.813 INFO:tasks.workunit.client.0.smithi134.stdout:8/107: creat d2/df/d19/f28 x:0 0 0 2024-02-16T22:18:49.814 INFO:tasks.workunit.client.0.smithi134.stdout:8/108: dread - d2/f24 zero size 2024-02-16T22:18:49.814 INFO:tasks.workunit.client.0.smithi134.stdout:8/109: chown d2/df 15477 1 2024-02-16T22:18:49.814 INFO:tasks.workunit.client.0.smithi134.stdout:8/110: creat d2/df/d19/f29 x:0 0 0 2024-02-16T22:18:49.814 INFO:tasks.workunit.client.0.smithi134.stdout:8/111: fsync d2/df/d18/fc 0 2024-02-16T22:18:49.815 INFO:tasks.workunit.client.0.smithi134.stdout:6/82: rename d17/c19 to d17/c1a 0 2024-02-16T22:18:49.815 INFO:tasks.workunit.client.0.smithi134.stdout:8/112: read d2/f7 [173569,65297] 0 2024-02-16T22:18:49.818 INFO:tasks.workunit.client.0.smithi134.stdout:0/80: mknod d2/c19 0 2024-02-16T22:18:49.818 INFO:tasks.workunit.client.0.smithi134.stdout:0/81: creat d2/f1a x:0 0 0 2024-02-16T22:18:49.818 INFO:tasks.workunit.client.0.smithi134.stdout:1/107: write d5/da/d1c/f29 [1846476,19979] 0 2024-02-16T22:18:49.821 INFO:tasks.workunit.client.0.smithi134.stdout:3/119: write da/d12/f20 [1437171,56134] 0 2024-02-16T22:18:49.822 INFO:tasks.workunit.client.0.smithi134.stdout:4/56: link d0/d6/d8/c10 d0/d6/d8/de/c12 0 2024-02-16T22:18:49.823 INFO:tasks.workunit.client.0.smithi134.stdout:5/101: dwrite d2/d9/f11 [0,4194304] 0 2024-02-16T22:18:49.824 INFO:tasks.workunit.client.0.smithi134.stdout:2/67: sync 2024-02-16T22:18:49.824 INFO:tasks.workunit.client.0.smithi134.stdout:2/68: fsync f0 0 2024-02-16T22:18:49.824 INFO:tasks.workunit.client.0.smithi134.stdout:2/69: chown f2 144942340 1 2024-02-16T22:18:49.824 INFO:tasks.workunit.client.0.smithi134.stdout:8/113: mkdir d2/df/d18/d2a 0 2024-02-16T22:18:49.825 INFO:tasks.workunit.client.0.smithi134.stdout:8/114: chown d2/df/d18/cb 2313 1 2024-02-16T22:18:49.825 INFO:tasks.workunit.client.0.smithi134.stdout:6/83: dread f14 [0,4194304] 0 2024-02-16T22:18:49.826 INFO:tasks.workunit.client.0.smithi134.stdout:0/82: symlink d2/dc/l1b 0 2024-02-16T22:18:49.828 INFO:tasks.workunit.client.0.smithi134.stdout:1/108: link d5/da/c1e d5/da/c2c 0 2024-02-16T22:18:49.833 INFO:tasks.workunit.client.0.smithi134.stdout:9/172: rename db/dc/ce to db/d20/d22/c3a 0 2024-02-16T22:18:49.837 INFO:tasks.workunit.client.0.smithi134.stdout:5/102: creat d2/d9/dc/f21 x:0 0 0 2024-02-16T22:18:49.837 INFO:tasks.workunit.client.0.smithi134.stdout:5/103: readlink d2/l1c 0 2024-02-16T22:18:49.837 INFO:tasks.workunit.client.0.smithi134.stdout:5/104: fdatasync d2/f3 0 2024-02-16T22:18:49.837 INFO:tasks.workunit.client.0.smithi134.stdout:5/105: chown d2/f6 5 1 2024-02-16T22:18:49.837 INFO:tasks.workunit.client.0.smithi134.stdout:5/106: dread - d2/d9/dc/fe zero size 2024-02-16T22:18:49.838 INFO:tasks.workunit.client.0.smithi134.stdout:6/84: rmdir d17 39 2024-02-16T22:18:49.840 INFO:tasks.workunit.client.0.smithi134.stdout:0/83: unlink d2/l18 0 2024-02-16T22:18:49.841 INFO:tasks.workunit.client.0.smithi134.stdout:1/109: rename d5/da/d2a to d5/da/d2d 0 2024-02-16T22:18:49.842 INFO:tasks.workunit.client.0.smithi134.stdout:1/110: dread - d5/d1a/d23/f27 zero size 2024-02-16T22:18:49.844 INFO:tasks.workunit.client.0.smithi134.stdout:6/85: dread f10 [0,4194304] 0 2024-02-16T22:18:49.845 INFO:tasks.workunit.client.0.smithi134.stdout:8/115: rename d2/df/f14 to d2/df/d18/d2a/f2b 0 2024-02-16T22:18:49.845 INFO:tasks.workunit.client.0.smithi134.stdout:2/70: dwrite f0 [4194304,4194304] 0 2024-02-16T22:18:49.845 INFO:tasks.workunit.client.0.smithi134.stdout:4/57: dwrite d0/f4 [0,4194304] 0 2024-02-16T22:18:49.845 INFO:tasks.workunit.client.0.smithi134.stdout:4/58: fsync d0/f4 0 2024-02-16T22:18:49.849 INFO:tasks.workunit.client.0.smithi134.stdout:1/111: rename c0 to d5/da/d2d/c2e 0 2024-02-16T22:18:49.849 INFO:tasks.workunit.client.0.smithi134.stdout:1/112: write d5/f24 [4734893,44530] 0 2024-02-16T22:18:49.849 INFO:tasks.workunit.client.0.smithi134.stdout:1/113: write d5/da/fb [1473758,49188] 0 2024-02-16T22:18:49.849 INFO:tasks.workunit.client.0.smithi134.stdout:1/114: chown d5/da/c2c 0 1 2024-02-16T22:18:49.849 INFO:tasks.workunit.client.0.smithi134.stdout:1/115: creat d5/da/d1c/f2f x:0 0 0 2024-02-16T22:18:49.849 INFO:tasks.workunit.client.0.smithi134.stdout:1/116: chown d5/da/d1c/f2f 473 1 2024-02-16T22:18:49.853 INFO:tasks.workunit.client.0.smithi134.stdout:3/120: read da/fc [1668227,117530] 0 2024-02-16T22:18:49.854 INFO:tasks.workunit.client.0.smithi134.stdout:2/71: symlink df/l12 0 2024-02-16T22:18:49.854 INFO:tasks.workunit.client.0.smithi134.stdout:2/72: write fb [342375,80700] 0 2024-02-16T22:18:49.854 INFO:tasks.workunit.client.0.smithi134.stdout:4/59: rmdir d0 39 2024-02-16T22:18:49.856 INFO:tasks.workunit.client.0.smithi134.stdout:8/116: rename d2/df/d18/f9 to d2/f2c 0 2024-02-16T22:18:49.859 INFO:tasks.workunit.client.0.smithi134.stdout:1/117: link d5/d1a/d23/l11 d5/d1a/l30 0 2024-02-16T22:18:49.861 INFO:tasks.workunit.client.0.smithi134.stdout:6/86: dread f14 [0,4194304] 0 2024-02-16T22:18:49.862 INFO:tasks.workunit.client.0.smithi134.stdout:6/87: chown fa 30789904 1 2024-02-16T22:18:49.862 INFO:tasks.workunit.client.0.smithi134.stdout:4/60: creat d0/d6/d8/de/f13 x:0 0 0 2024-02-16T22:18:49.863 INFO:tasks.workunit.client.0.smithi134.stdout:3/121: rename da/fd to da/d1c/f23 0 2024-02-16T22:18:49.863 INFO:tasks.workunit.client.0.smithi134.stdout:3/122: readlink l8 0 2024-02-16T22:18:49.865 INFO:tasks.workunit.client.0.smithi134.stdout:8/117: creat d2/df/d18/d12/f2d x:0 0 0 2024-02-16T22:18:49.865 INFO:tasks.workunit.client.0.smithi134.stdout:8/118: fsync d2/f25 0 2024-02-16T22:18:49.865 INFO:tasks.workunit.client.0.smithi134.stdout:8/119: dread - d2/df/d19/f28 zero size 2024-02-16T22:18:49.866 INFO:tasks.workunit.client.0.smithi134.stdout:1/118: creat d5/d1a/f31 x:0 0 0 2024-02-16T22:18:49.866 INFO:tasks.workunit.client.0.smithi134.stdout:6/88: mknod d17/c1b 0 2024-02-16T22:18:49.869 INFO:tasks.workunit.client.0.smithi134.stdout:4/61: rename d0/c3 to d0/c14 0 2024-02-16T22:18:49.869 INFO:tasks.workunit.client.0.smithi134.stdout:4/62: truncate d0/f2 4511039 0 2024-02-16T22:18:49.871 INFO:tasks.workunit.client.0.smithi134.stdout:2/73: rename f0 to df/d10/d11/f13 0 2024-02-16T22:18:49.872 INFO:tasks.workunit.client.0.smithi134.stdout:9/173: dwrite f8 [0,4194304] 0 2024-02-16T22:18:49.872 INFO:tasks.workunit.client.0.smithi134.stdout:1/119: dread d5/f6 [0,4194304] 0 2024-02-16T22:18:49.872 INFO:tasks.workunit.client.0.smithi134.stdout:3/123: rmdir da/d1c 39 2024-02-16T22:18:49.872 INFO:tasks.workunit.client.0.smithi134.stdout:0/84: dwrite d2/f1a [0,4194304] 0 2024-02-16T22:18:49.872 INFO:tasks.workunit.client.0.smithi134.stdout:0/85: creat d2/f1c x:0 0 0 2024-02-16T22:18:49.872 INFO:tasks.workunit.client.0.smithi134.stdout:0/86: creat d2/dc/f1d x:0 0 0 2024-02-16T22:18:49.873 INFO:tasks.workunit.client.0.smithi134.stdout:5/107: dwrite f0 [0,4194304] 0 2024-02-16T22:18:49.873 INFO:tasks.workunit.client.0.smithi134.stdout:8/120: mknod d2/df/c2e 0 2024-02-16T22:18:49.873 INFO:tasks.workunit.client.0.smithi134.stdout:8/121: dread - d2/df/d18/d12/f2d zero size 2024-02-16T22:18:49.873 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:49 smithi173 ceph-mon[37280]: pgmap v247: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 6.9 MiB/s rd, 19 MiB/s wr, 822 op/s 2024-02-16T22:18:49.875 INFO:tasks.workunit.client.0.smithi134.stdout:6/89: creat d17/f1c x:0 0 0 2024-02-16T22:18:49.875 INFO:tasks.workunit.client.0.smithi134.stdout:6/90: chown f14 40 1 2024-02-16T22:18:49.875 INFO:tasks.workunit.client.0.smithi134.stdout:6/91: write f12 [1960015,119446] 0 2024-02-16T22:18:49.876 INFO:tasks.workunit.client.0.smithi134.stdout:4/63: unlink d0/c1 0 2024-02-16T22:18:49.882 INFO:tasks.workunit.client.0.smithi134.stdout:2/74: write df/d10/d11/f13 [4569912,44684] 0 2024-02-16T22:18:49.884 INFO:tasks.workunit.client.0.smithi134.stdout:1/120: dread d5/da/fb [0,4194304] 0 2024-02-16T22:18:49.884 INFO:tasks.workunit.client.0.smithi134.stdout:1/121: write d5/da/d1c/f2f [420237,42662] 0 2024-02-16T22:18:49.884 INFO:tasks.workunit.client.0.smithi134.stdout:1/122: creat d5/da/d1c/f32 x:0 0 0 2024-02-16T22:18:49.966 INFO:tasks.workunit.client.0.smithi134.stdout:0/87: link d2/f17 d2/dc/f1e 0 2024-02-16T22:18:49.966 INFO:tasks.workunit.client.0.smithi134.stdout:0/88: chown d2/c5 237 1 2024-02-16T22:18:49.966 INFO:tasks.workunit.client.0.smithi134.stdout:0/89: chown d2/f12 45 1 2024-02-16T22:18:49.966 INFO:tasks.workunit.client.0.smithi134.stdout:0/90: creat d2/f1f x:0 0 0 2024-02-16T22:18:49.968 INFO:tasks.workunit.client.0.smithi134.stdout:6/92: mknod d17/c1d 0 2024-02-16T22:18:49.970 INFO:tasks.workunit.client.0.smithi134.stdout:4/64: link d0/f4 d0/f15 0 2024-02-16T22:18:49.970 INFO:tasks.workunit.client.0.smithi134.stdout:4/65: stat d0/d6/d8/de/f13 0 2024-02-16T22:18:49.971 INFO:tasks.workunit.client.0.smithi134.stdout:9/174: link db/d20/d22/c2a db/d20/d32/c3b 0 2024-02-16T22:18:49.971 INFO:tasks.workunit.client.0.smithi134.stdout:9/175: chown db/d20/d32/c3b 126533 1 2024-02-16T22:18:49.974 INFO:tasks.workunit.client.0.smithi134.stdout:1/123: symlink d5/da/l33 0 2024-02-16T22:18:49.975 INFO:tasks.workunit.client.0.smithi134.stdout:5/108: dwrite d2/f19 [0,4194304] 0 2024-02-16T22:18:49.975 INFO:tasks.workunit.client.0.smithi134.stdout:5/109: dread - d2/d9/dc/fe zero size 2024-02-16T22:18:49.975 INFO:tasks.workunit.client.0.smithi134.stdout:8/122: dwrite f0 [0,4194304] 0 2024-02-16T22:18:49.975 INFO:tasks.workunit.client.0.smithi134.stdout:3/124: dwrite da/f11 [4194304,4194304] 0 2024-02-16T22:18:49.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:49 smithi134 ceph-mon[28869]: pgmap v247: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 6.9 MiB/s rd, 19 MiB/s wr, 822 op/s 2024-02-16T22:18:49.978 INFO:tasks.workunit.client.0.smithi134.stdout:7/52: sync 2024-02-16T22:18:49.981 INFO:tasks.workunit.client.0.smithi134.stdout:6/93: unlink c16 0 2024-02-16T22:18:49.983 INFO:tasks.workunit.client.0.smithi134.stdout:9/176: symlink db/d20/l3c 0 2024-02-16T22:18:49.988 INFO:tasks.workunit.client.0.smithi134.stdout:4/66: dwrite d0/f2 [0,4194304] 0 2024-02-16T22:18:49.988 INFO:tasks.workunit.client.0.smithi134.stdout:4/67: write d0/f11 [611306,1856] 0 2024-02-16T22:18:49.991 INFO:tasks.workunit.client.0.smithi134.stdout:1/124: unlink d5/da/c1e 0 2024-02-16T22:18:49.992 INFO:tasks.workunit.client.0.smithi134.stdout:1/125: dread d5/d1a/d23/f2b [0,4194304] 0 2024-02-16T22:18:49.992 INFO:tasks.workunit.client.0.smithi134.stdout:1/126: truncate d5/f26 253735 0 2024-02-16T22:18:49.992 INFO:tasks.workunit.client.0.smithi134.stdout:1/127: stat d5/da/d1c/f29 0 2024-02-16T22:18:49.992 INFO:tasks.workunit.client.0.smithi134.stdout:1/128: chown d5/da/c2c 3503 1 2024-02-16T22:18:49.995 INFO:tasks.workunit.client.0.smithi134.stdout:1/129: write f3 [244006,56982] 0 2024-02-16T22:18:49.996 INFO:tasks.workunit.client.0.smithi134.stdout:5/110: mkdir d2/d9/dc/d22 0 2024-02-16T22:18:49.998 INFO:tasks.workunit.client.0.smithi134.stdout:8/123: unlink d2/df/d19/f20 0 2024-02-16T22:18:50.001 INFO:tasks.workunit.client.0.smithi134.stdout:4/68: dread d0/f4 [0,4194304] 0 2024-02-16T22:18:50.002 INFO:tasks.workunit.client.0.smithi134.stdout:3/125: unlink f7 0 2024-02-16T22:18:50.003 INFO:tasks.workunit.client.0.smithi134.stdout:7/53: mknod d2/c11 0 2024-02-16T22:18:50.003 INFO:tasks.workunit.client.0.smithi134.stdout:7/54: chown d2/d6 509046 1 2024-02-16T22:18:50.005 INFO:tasks.workunit.client.0.smithi134.stdout:5/111: dread d2/d9/f11 [0,4194304] 0 2024-02-16T22:18:50.006 INFO:tasks.workunit.client.0.smithi134.stdout:0/91: truncate d2/f1a 1325024 0 2024-02-16T22:18:50.007 INFO:tasks.workunit.client.0.smithi134.stdout:9/177: dwrite db/d20/f34 [0,4194304] 0 2024-02-16T22:18:50.007 INFO:tasks.workunit.client.0.smithi134.stdout:9/178: fdatasync db/dc/f16 0 2024-02-16T22:18:50.008 INFO:tasks.workunit.client.0.smithi134.stdout:6/94: dwrite f12 [0,4194304] 0 2024-02-16T22:18:50.009 INFO:tasks.workunit.client.0.smithi134.stdout:1/130: rename d5/d1a/d23/f19 to d5/da/d2d/f34 0 2024-02-16T22:18:50.009 INFO:tasks.workunit.client.0.smithi134.stdout:8/124: rename d2/df/d18/d27 to d2/df/d18/d27/d2f 22 2024-02-16T22:18:50.009 INFO:tasks.workunit.client.0.smithi134.stdout:8/125: write d2/df/f23 [4619310,5882] 0 2024-02-16T22:18:50.009 INFO:tasks.workunit.client.0.smithi134.stdout:8/126: dread - d2/f24 zero size 2024-02-16T22:18:50.009 INFO:tasks.workunit.client.0.smithi134.stdout:8/127: read d2/df/d18/f5 [3230776,128064] 0 2024-02-16T22:18:50.009 INFO:tasks.workunit.client.0.smithi134.stdout:4/69: rmdir d0/d6/d8 39 2024-02-16T22:18:50.013 INFO:tasks.workunit.client.0.smithi134.stdout:5/112: rmdir d2/d9/dc/d22 0 2024-02-16T22:18:50.013 INFO:tasks.workunit.client.0.smithi134.stdout:5/113: read d2/f3 [896628,41486] 0 2024-02-16T22:18:50.015 INFO:tasks.workunit.client.0.smithi134.stdout:9/179: dread db/dc/f12 [0,4194304] 0 2024-02-16T22:18:50.022 INFO:tasks.workunit.client.0.smithi134.stdout:6/95: symlink d17/l1e 0 2024-02-16T22:18:50.024 INFO:tasks.workunit.client.0.smithi134.stdout:5/114: write d2/f4 [1251879,104208] 0 2024-02-16T22:18:50.024 INFO:tasks.workunit.client.0.smithi134.stdout:5/115: read d2/d9/dc/f13 [608989,71624] 0 2024-02-16T22:18:50.024 INFO:tasks.workunit.client.0.smithi134.stdout:5/116: getdents d2 0 2024-02-16T22:18:50.024 INFO:tasks.workunit.client.0.smithi134.stdout:5/117: stat d2/f18 0 2024-02-16T22:18:50.024 INFO:tasks.workunit.client.0.smithi134.stdout:1/131: link d5/d1a/d23/f27 d5/da/f35 0 2024-02-16T22:18:50.027 INFO:tasks.workunit.client.0.smithi134.stdout:1/132: dread d5/f8 [0,4194304] 0 2024-02-16T22:18:50.027 INFO:tasks.workunit.client.0.smithi134.stdout:8/128: creat d2/df/d18/d27/f30 x:0 0 0 2024-02-16T22:18:50.030 INFO:tasks.workunit.client.0.smithi134.stdout:4/70: fsync d0/f11 0 2024-02-16T22:18:50.030 INFO:tasks.workunit.client.0.smithi134.stdout:4/71: write d0/d6/d8/fa [120805,23466] 0 2024-02-16T22:18:50.030 INFO:tasks.workunit.client.0.smithi134.stdout:3/126: rename da/d12/d15 to da/d1c/d24 0 2024-02-16T22:18:50.031 INFO:tasks.workunit.client.0.smithi134.stdout:5/118: symlink d2/d9/l23 0 2024-02-16T22:18:50.033 INFO:tasks.workunit.client.0.smithi134.stdout:1/133: unlink d5/d1a/d23/l11 0 2024-02-16T22:18:50.033 INFO:tasks.workunit.client.0.smithi134.stdout:1/134: truncate d5/f26 1087424 0 2024-02-16T22:18:50.034 INFO:tasks.workunit.client.0.smithi134.stdout:6/96: dread f15 [0,4194304] 0 2024-02-16T22:18:50.034 INFO:tasks.workunit.client.0.smithi134.stdout:7/55: dwrite d2/f4 [0,4194304] 0 2024-02-16T22:18:50.035 INFO:tasks.workunit.client.0.smithi134.stdout:4/72: mkdir d0/d6/d16 0 2024-02-16T22:18:50.035 INFO:tasks.workunit.client.0.smithi134.stdout:5/119: dread d2/d9/f11 [0,4194304] 0 2024-02-16T22:18:50.037 INFO:tasks.workunit.client.0.smithi134.stdout:9/180: rename db/d20/f34 to db/f3d 0 2024-02-16T22:18:50.043 INFO:tasks.workunit.client.0.smithi134.stdout:8/129: dread f0 [4194304,4194304] 0 2024-02-16T22:18:50.043 INFO:tasks.workunit.client.0.smithi134.stdout:0/92: dwrite d2/f1c [0,4194304] 0 2024-02-16T22:18:50.046 INFO:tasks.workunit.client.0.smithi134.stdout:5/120: link d2/d9/f11 d2/d9/dc/f24 0 2024-02-16T22:18:50.046 INFO:tasks.workunit.client.0.smithi134.stdout:9/181: mknod db/c3e 0 2024-02-16T22:18:50.047 INFO:tasks.workunit.client.0.smithi134.stdout:9/182: read db/dc/f17 [604921,126582] 0 2024-02-16T22:18:50.052 INFO:tasks.workunit.client.0.smithi134.stdout:7/56: write d2/fb [950227,121315] 0 2024-02-16T22:18:50.052 INFO:tasks.workunit.client.0.smithi134.stdout:7/57: chown c1 89 1 2024-02-16T22:18:50.052 INFO:tasks.workunit.client.0.smithi134.stdout:5/121: write d2/d9/f11 [618276,12427] 0 2024-02-16T22:18:50.053 INFO:tasks.workunit.client.0.smithi134.stdout:6/97: write f14 [226159,127999] 0 2024-02-16T22:18:50.054 INFO:tasks.workunit.client.0.smithi134.stdout:6/98: chown f10 13735 1 2024-02-16T22:18:50.054 INFO:tasks.workunit.client.0.smithi134.stdout:8/130: getdents d2/df/d18 0 2024-02-16T22:18:50.060 INFO:tasks.workunit.client.0.smithi134.stdout:5/122: symlink d2/d9/dc/l25 0 2024-02-16T22:18:50.060 INFO:tasks.workunit.client.0.smithi134.stdout:5/123: chown d2/l1c 12 1 2024-02-16T22:18:50.060 INFO:tasks.workunit.client.0.smithi134.stdout:5/124: creat d2/d9/dc/f26 x:0 0 0 2024-02-16T22:18:50.065 INFO:tasks.workunit.client.0.smithi134.stdout:7/58: fsync d2/fb 0 2024-02-16T22:18:50.065 INFO:tasks.workunit.client.0.smithi134.stdout:2/75: sync 2024-02-16T22:18:50.065 INFO:tasks.workunit.client.0.smithi134.stdout:2/76: chown fb 4 1 2024-02-16T22:18:50.066 INFO:tasks.workunit.client.0.smithi134.stdout:1/135: dwrite d5/da/f1d [0,4194304] 0 2024-02-16T22:18:50.066 INFO:tasks.workunit.client.0.smithi134.stdout:1/136: chown d5/d1a/d23/f27 1 1 2024-02-16T22:18:50.068 INFO:tasks.workunit.client.0.smithi134.stdout:6/99: mknod d17/c1f 0 2024-02-16T22:18:50.069 INFO:tasks.workunit.client.0.smithi134.stdout:8/131: truncate f1 2987554 0 2024-02-16T22:18:50.069 INFO:tasks.workunit.client.0.smithi134.stdout:8/132: stat d2/f2c 0 2024-02-16T22:18:50.069 INFO:tasks.workunit.client.0.smithi134.stdout:8/133: creat d2/df/d19/f31 x:0 0 0 2024-02-16T22:18:50.069 INFO:tasks.workunit.client.0.smithi134.stdout:8/134: stat d2/df/d18/d12/f15 0 2024-02-16T22:18:50.069 INFO:tasks.workunit.client.0.smithi134.stdout:8/135: chown d2/df/f10 0 1 2024-02-16T22:18:50.073 INFO:tasks.workunit.client.0.smithi134.stdout:5/125: mkdir d2/d9/dc/d27 0 2024-02-16T22:18:50.075 INFO:tasks.workunit.client.0.smithi134.stdout:7/59: mkdir d2/d6/d12 0 2024-02-16T22:18:50.076 INFO:tasks.workunit.client.0.smithi134.stdout:2/77: mknod df/c14 0 2024-02-16T22:18:50.080 INFO:tasks.workunit.client.0.smithi134.stdout:2/78: dread df/d10/d11/f13 [0,4194304] 0 2024-02-16T22:18:50.081 INFO:tasks.workunit.client.0.smithi134.stdout:4/73: dwrite d0/f2 [0,4194304] 0 2024-02-16T22:18:50.081 INFO:tasks.workunit.client.0.smithi134.stdout:0/93: dwrite d2/f1f [0,4194304] 0 2024-02-16T22:18:50.081 INFO:tasks.workunit.client.0.smithi134.stdout:9/183: dwrite db/f29 [0,4194304] 0 2024-02-16T22:18:50.083 INFO:tasks.workunit.client.0.smithi134.stdout:6/100: symlink d17/l20 0 2024-02-16T22:18:50.083 INFO:tasks.workunit.client.0.smithi134.stdout:6/101: chown d17/c1f 16091 1 2024-02-16T22:18:50.083 INFO:tasks.workunit.client.0.smithi134.stdout:6/102: read - d17/f1c zero size 2024-02-16T22:18:50.083 INFO:tasks.workunit.client.0.smithi134.stdout:6/103: chown cf 1720186 1 2024-02-16T22:18:50.083 INFO:tasks.workunit.client.0.smithi134.stdout:7/60: dread d2/ff [0,4194304] 0 2024-02-16T22:18:50.083 INFO:tasks.workunit.client.0.smithi134.stdout:6/104: write f11 [705408,36696] 0 2024-02-16T22:18:50.083 INFO:tasks.workunit.client.0.smithi134.stdout:6/105: creat d17/f21 x:0 0 0 2024-02-16T22:18:50.083 INFO:tasks.workunit.client.0.smithi134.stdout:6/106: write f11 [1359824,48201] 0 2024-02-16T22:18:50.083 INFO:tasks.workunit.client.0.smithi134.stdout:2/79: write df/d10/d11/f13 [1525872,90839] 0 2024-02-16T22:18:50.086 INFO:tasks.workunit.client.0.smithi134.stdout:5/126: write f0 [3077738,121828] 0 2024-02-16T22:18:50.089 INFO:tasks.workunit.client.0.smithi134.stdout:0/94: mkdir d2/d20 0 2024-02-16T22:18:50.091 INFO:tasks.workunit.client.0.smithi134.stdout:9/184: mknod db/d20/d32/c3f 0 2024-02-16T22:18:50.092 INFO:tasks.workunit.client.0.smithi134.stdout:4/74: read d0/f15 [818771,130023] 0 2024-02-16T22:18:50.095 INFO:tasks.workunit.client.0.smithi134.stdout:1/137: creat d5/da/d2d/f36 x:0 0 0 2024-02-16T22:18:50.099 INFO:tasks.workunit.client.0.smithi134.stdout:7/61: dwrite d2/ff [0,4194304] 0 2024-02-16T22:18:50.099 INFO:tasks.workunit.client.0.smithi134.stdout:7/62: stat d2/da 0 2024-02-16T22:18:50.099 INFO:tasks.workunit.client.0.smithi134.stdout:7/63: fsync d2/fb 0 2024-02-16T22:18:50.099 INFO:tasks.workunit.client.0.smithi134.stdout:6/107: mkdir d17/d22 0 2024-02-16T22:18:50.100 INFO:tasks.workunit.client.0.smithi134.stdout:2/80: mkdir df/d10/d15 0 2024-02-16T22:18:50.102 INFO:tasks.workunit.client.0.smithi134.stdout:5/127: mknod d2/d9/dc/d27/c28 0 2024-02-16T22:18:50.102 INFO:tasks.workunit.client.0.smithi134.stdout:5/128: fsync d2/d9/f11 0 2024-02-16T22:18:50.104 INFO:tasks.workunit.client.0.smithi134.stdout:0/95: rename d2/dc/c14 to d2/dc/c21 0 2024-02-16T22:18:50.104 INFO:tasks.workunit.client.0.smithi134.stdout:0/96: creat d2/f22 x:0 0 0 2024-02-16T22:18:50.104 INFO:tasks.workunit.client.0.smithi134.stdout:0/97: chown d2/d20 3380 1 2024-02-16T22:18:50.104 INFO:tasks.workunit.client.0.smithi134.stdout:9/185: stat c7 0 2024-02-16T22:18:50.107 INFO:tasks.workunit.client.0.smithi134.stdout:4/75: link d0/f2 d0/d6/d16/f17 0 2024-02-16T22:18:50.107 INFO:tasks.workunit.client.0.smithi134.stdout:4/76: rename d0 to d0/d6/d8/d18 22 2024-02-16T22:18:50.107 INFO:tasks.workunit.client.0.smithi134.stdout:4/77: chown d0/d6 5631 1 2024-02-16T22:18:50.107 INFO:tasks.workunit.client.0.smithi134.stdout:1/138: chown d5/da/d1c/f2f 1750 1 2024-02-16T22:18:50.110 INFO:tasks.workunit.client.0.smithi134.stdout:4/78: dread d0/d6/d8/fa [0,4194304] 0 2024-02-16T22:18:50.110 INFO:tasks.workunit.client.0.smithi134.stdout:4/79: write d0/d6/d8/de/f13 [26113,1842] 0 2024-02-16T22:18:50.114 INFO:tasks.workunit.client.0.smithi134.stdout:7/64: link d2/d5/l9 d2/d6/d12/l13 0 2024-02-16T22:18:50.114 INFO:tasks.workunit.client.0.smithi134.stdout:9/186: write db/f29 [3837066,84144] 0 2024-02-16T22:18:50.117 INFO:tasks.workunit.client.0.smithi134.stdout:6/108: unlink c7 0 2024-02-16T22:18:50.117 INFO:tasks.workunit.client.0.smithi134.stdout:5/129: dwrite d2/d9/dc/f26 [0,4194304] 0 2024-02-16T22:18:50.117 INFO:tasks.workunit.client.0.smithi134.stdout:5/130: creat d2/d9/dc/d15/f29 x:0 0 0 2024-02-16T22:18:50.119 INFO:tasks.workunit.client.0.smithi134.stdout:2/81: creat df/d10/d15/f16 x:0 0 0 2024-02-16T22:18:50.119 INFO:tasks.workunit.client.0.smithi134.stdout:2/82: chown df/d10/d11 1693218 1 2024-02-16T22:18:50.121 INFO:tasks.workunit.client.0.smithi134.stdout:0/98: creat d2/d20/f23 x:0 0 0 2024-02-16T22:18:50.129 INFO:tasks.workunit.client.0.smithi134.stdout:9/187: rename db/dc/c36 to db/d20/c40 0 2024-02-16T22:18:50.130 INFO:tasks.workunit.client.0.smithi134.stdout:7/65: dwrite d2/ff [4194304,4194304] 0 2024-02-16T22:18:50.130 INFO:tasks.workunit.client.0.smithi134.stdout:7/66: write d2/d5/f10 [662434,39897] 0 2024-02-16T22:18:50.134 INFO:tasks.workunit.client.0.smithi134.stdout:6/109: mknod d17/d22/c23 0 2024-02-16T22:18:50.136 INFO:tasks.workunit.client.0.smithi134.stdout:5/131: link d2/d9/cb d2/d9/dc/d27/c2a 0 2024-02-16T22:18:50.137 INFO:tasks.workunit.client.0.smithi134.stdout:7/67: dread d2/d5/f10 [0,4194304] 0 2024-02-16T22:18:50.137 INFO:tasks.workunit.client.0.smithi134.stdout:7/68: readlink d2/d5/l9 0 2024-02-16T22:18:50.137 INFO:tasks.workunit.client.0.smithi134.stdout:7/69: chown d2/d5/l9 41813 1 2024-02-16T22:18:50.138 INFO:tasks.workunit.client.0.smithi134.stdout:2/83: mkdir df/d10/d11/d17 0 2024-02-16T22:18:50.138 INFO:tasks.workunit.client.0.smithi134.stdout:0/99: dwrite d2/f1c [0,4194304] 0 2024-02-16T22:18:50.139 INFO:tasks.workunit.client.0.smithi134.stdout:1/139: creat d5/da/d21/f37 x:0 0 0 2024-02-16T22:18:50.142 INFO:tasks.workunit.client.0.smithi134.stdout:6/110: creat d17/d22/f24 x:0 0 0 2024-02-16T22:18:50.143 INFO:tasks.workunit.client.0.smithi134.stdout:6/111: chown f10 25760 1 2024-02-16T22:18:50.144 INFO:tasks.workunit.client.0.smithi134.stdout:5/132: truncate d2/fa 4454005 0 2024-02-16T22:18:50.145 INFO:tasks.workunit.client.0.smithi134.stdout:7/70: unlink d2/da/cd 0 2024-02-16T22:18:50.145 INFO:tasks.workunit.client.0.smithi134.stdout:7/71: chown d2 0 1 2024-02-16T22:18:50.147 INFO:tasks.workunit.client.0.smithi134.stdout:0/100: dread d2/f1f [0,4194304] 0 2024-02-16T22:18:50.147 INFO:tasks.workunit.client.0.smithi134.stdout:0/101: write d2/f1c [4622195,56215] 0 2024-02-16T22:18:50.149 INFO:tasks.workunit.client.0.smithi134.stdout:1/140: write d5/d1a/d23/f2b [791102,872] 0 2024-02-16T22:18:50.149 INFO:tasks.workunit.client.0.smithi134.stdout:9/188: truncate db/d20/d22/f25 47606 0 2024-02-16T22:18:50.153 INFO:tasks.workunit.client.0.smithi134.stdout:5/133: creat d2/f2b x:0 0 0 2024-02-16T22:18:50.153 INFO:tasks.workunit.client.0.smithi134.stdout:5/134: fsync f0 0 2024-02-16T22:18:50.153 INFO:tasks.workunit.client.0.smithi134.stdout:5/135: chown d2/f4 5905 1 2024-02-16T22:18:50.154 INFO:tasks.workunit.client.0.smithi134.stdout:7/72: creat d2/da/f14 x:0 0 0 2024-02-16T22:18:50.154 INFO:tasks.workunit.client.0.smithi134.stdout:2/84: getdents df/d10/d11 0 2024-02-16T22:18:50.159 INFO:tasks.workunit.client.0.smithi134.stdout:6/112: dwrite f9 [0,4194304] 0 2024-02-16T22:18:50.159 INFO:tasks.workunit.client.0.smithi134.stdout:6/113: creat d17/d22/f25 x:0 0 0 2024-02-16T22:18:50.159 INFO:tasks.workunit.client.0.smithi134.stdout:1/141: symlink d5/da/d2d/l38 0 2024-02-16T22:18:50.160 INFO:tasks.workunit.client.0.smithi134.stdout:1/142: readlink d5/da/d2d/l38 0 2024-02-16T22:18:50.162 INFO:tasks.workunit.client.0.smithi134.stdout:3/127: sync 2024-02-16T22:18:50.162 INFO:tasks.workunit.client.0.smithi134.stdout:3/128: creat da/d12/f25 x:0 0 0 2024-02-16T22:18:50.162 INFO:tasks.workunit.client.0.smithi134.stdout:3/129: write da/d12/f21 [3038153,67781] 0 2024-02-16T22:18:50.162 INFO:tasks.workunit.client.0.smithi134.stdout:9/189: unlink db/d20/d22/c3a 0 2024-02-16T22:18:50.162 INFO:tasks.workunit.client.0.smithi134.stdout:9/190: write db/f29 [584358,94157] 0 2024-02-16T22:18:50.162 INFO:tasks.workunit.client.0.smithi134.stdout:9/191: write db/f33 [298271,38321] 0 2024-02-16T22:18:50.164 INFO:tasks.workunit.client.0.smithi134.stdout:5/136: creat d2/d9/dc/d27/f2c x:0 0 0 2024-02-16T22:18:50.166 INFO:tasks.workunit.client.0.smithi134.stdout:7/73: link c1 d2/d5/c15 0 2024-02-16T22:18:50.167 INFO:tasks.workunit.client.0.smithi134.stdout:7/74: creat d2/d6/f16 x:0 0 0 2024-02-16T22:18:50.172 INFO:tasks.workunit.client.0.smithi134.stdout:0/102: rmdir d2 39 2024-02-16T22:18:50.176 INFO:tasks.workunit.client.0.smithi134.stdout:1/143: rename d5/f6 to d5/d1a/d23/f39 0 2024-02-16T22:18:50.176 INFO:tasks.workunit.client.0.smithi134.stdout:1/144: chown d5/f24 424129 1 2024-02-16T22:18:50.178 INFO:tasks.workunit.client.0.smithi134.stdout:3/130: mknod da/d12/c26 0 2024-02-16T22:18:50.179 INFO:tasks.workunit.client.0.smithi134.stdout:2/85: dwrite f2 [8388608,4194304] 0 2024-02-16T22:18:50.180 INFO:tasks.workunit.client.0.smithi134.stdout:9/192: mknod db/d20/c41 0 2024-02-16T22:18:50.182 INFO:tasks.workunit.client.0.smithi134.stdout:7/75: truncate d2/ff 4316611 0 2024-02-16T22:18:50.183 INFO:tasks.workunit.client.0.smithi134.stdout:7/76: readlink d2/da/le 0 2024-02-16T22:18:50.183 INFO:tasks.workunit.client.0.smithi134.stdout:0/103: symlink d2/l24 0 2024-02-16T22:18:50.183 INFO:tasks.workunit.client.0.smithi134.stdout:0/104: fdatasync d2/f12 0 2024-02-16T22:18:50.183 INFO:tasks.workunit.client.0.smithi134.stdout:3/131: creat da/d1c/d24/f27 x:0 0 0 2024-02-16T22:18:50.188 INFO:tasks.workunit.client.0.smithi134.stdout:8/136: sync 2024-02-16T22:18:50.188 INFO:tasks.workunit.client.0.smithi134.stdout:8/137: truncate d2/f1b 5089931 0 2024-02-16T22:18:50.188 INFO:tasks.workunit.client.0.smithi134.stdout:8/138: chown d2/df/f10 6091828 1 2024-02-16T22:18:50.189 INFO:tasks.workunit.client.0.smithi134.stdout:5/137: dwrite d2/d9/f11 [0,4194304] 0 2024-02-16T22:18:50.189 INFO:tasks.workunit.client.0.smithi134.stdout:5/138: fdatasync d2/d9/dc/fe 0 2024-02-16T22:18:50.189 INFO:tasks.workunit.client.0.smithi134.stdout:6/114: dwrite d17/d22/f24 [0,4194304] 0 2024-02-16T22:18:50.189 INFO:tasks.workunit.client.0.smithi134.stdout:6/115: chown d17/c1a 121186 1 2024-02-16T22:18:50.190 INFO:tasks.workunit.client.0.smithi134.stdout:0/105: creat d2/dc/f25 x:0 0 0 2024-02-16T22:18:50.190 INFO:tasks.workunit.client.0.smithi134.stdout:0/106: truncate d2/dc/fe 743761 0 2024-02-16T22:18:50.203 INFO:tasks.workunit.client.0.smithi134.stdout:6/116: truncate f6 2837089 0 2024-02-16T22:18:50.203 INFO:tasks.workunit.client.0.smithi134.stdout:6/117: chown d17/c1b 1480293 1 2024-02-16T22:18:50.203 INFO:tasks.workunit.client.0.smithi134.stdout:6/118: fsync d17/f18 0 2024-02-16T22:18:50.203 INFO:tasks.workunit.client.0.smithi134.stdout:6/119: stat d17/l20 0 2024-02-16T22:18:50.203 INFO:tasks.workunit.client.0.smithi134.stdout:6/120: fsync d17/f18 0 2024-02-16T22:18:50.204 INFO:tasks.workunit.client.0.smithi134.stdout:3/132: link l9 da/l28 0 2024-02-16T22:18:50.206 INFO:tasks.workunit.client.0.smithi134.stdout:7/77: rename d2/da to d2/d6/d17 0 2024-02-16T22:18:50.206 INFO:tasks.workunit.client.0.smithi134.stdout:7/78: write d2/d5/f10 [1653591,75315] 0 2024-02-16T22:18:50.207 INFO:tasks.workunit.client.0.smithi134.stdout:7/79: fdatasync d2/ff 0 2024-02-16T22:18:50.207 INFO:tasks.workunit.client.0.smithi134.stdout:3/133: mkdir da/d1c/d24/d29 0 2024-02-16T22:18:50.207 INFO:tasks.workunit.client.0.smithi134.stdout:7/80: creat d2/d6/d17/f18 x:0 0 0 2024-02-16T22:18:50.208 INFO:tasks.workunit.client.0.smithi134.stdout:3/134: rmdir da 39 2024-02-16T22:18:50.209 INFO:tasks.workunit.client.0.smithi134.stdout:7/81: mkdir d2/d5/d19 0 2024-02-16T22:18:50.213 INFO:tasks.workunit.client.0.smithi134.stdout:6/121: write f12 [1008125,49518] 0 2024-02-16T22:18:50.213 INFO:tasks.workunit.client.0.smithi134.stdout:6/122: chown f10 121302554 1 2024-02-16T22:18:50.213 INFO:tasks.workunit.client.0.smithi134.stdout:6/123: write d17/d22/f25 [352026,34309] 0 2024-02-16T22:18:50.215 INFO:tasks.workunit.client.0.smithi134.stdout:6/124: link d17/c1a d17/c26 0 2024-02-16T22:18:50.215 INFO:tasks.workunit.client.0.smithi134.stdout:6/125: chown d17/d22/c23 114676 1 2024-02-16T22:18:50.215 INFO:tasks.workunit.client.0.smithi134.stdout:6/126: write fa [1784758,109331] 0 2024-02-16T22:18:50.215 INFO:tasks.workunit.client.0.smithi134.stdout:6/127: chown d17/l20 88 1 2024-02-16T22:18:50.220 INFO:tasks.workunit.client.0.smithi134.stdout:6/128: unlink l13 0 2024-02-16T22:18:50.221 INFO:tasks.workunit.client.0.smithi134.stdout:6/129: write f12 [4587658,41178] 0 2024-02-16T22:18:50.221 INFO:tasks.workunit.client.0.smithi134.stdout:7/82: dread d2/f4 [0,4194304] 0 2024-02-16T22:18:50.221 INFO:tasks.workunit.client.0.smithi134.stdout:6/130: mkdir d17/d27 0 2024-02-16T22:18:50.221 INFO:tasks.workunit.client.0.smithi134.stdout:7/83: rename d2/d6/d17/f18 to d2/f1a 0 2024-02-16T22:18:50.222 INFO:tasks.workunit.client.0.smithi134.stdout:7/84: creat d2/f1b x:0 0 0 2024-02-16T22:18:50.222 INFO:tasks.workunit.client.0.smithi134.stdout:7/85: readlink d2/d5/l9 0 2024-02-16T22:18:50.223 INFO:tasks.workunit.client.0.smithi134.stdout:2/86: dwrite fb [0,4194304] 0 2024-02-16T22:18:50.223 INFO:tasks.workunit.client.0.smithi134.stdout:5/139: dwrite d2/f6 [0,4194304] 0 2024-02-16T22:18:50.223 INFO:tasks.workunit.client.0.smithi134.stdout:9/193: dwrite db/d20/d22/f35 [0,4194304] 0 2024-02-16T22:18:50.223 INFO:tasks.workunit.client.0.smithi134.stdout:3/135: dread da/d1c/f23 [0,4194304] 0 2024-02-16T22:18:50.223 INFO:tasks.workunit.client.0.smithi134.stdout:6/131: mkdir d17/d22/d28 0 2024-02-16T22:18:50.223 INFO:tasks.workunit.client.0.smithi134.stdout:8/139: dwrite d2/df/d19/f31 [0,4194304] 0 2024-02-16T22:18:50.224 INFO:tasks.workunit.client.0.smithi134.stdout:8/140: fsync d2/f1b 0 2024-02-16T22:18:50.228 INFO:tasks.workunit.client.0.smithi134.stdout:2/87: read f2 [4838138,26337] 0 2024-02-16T22:18:50.228 INFO:tasks.workunit.client.0.smithi134.stdout:2/88: rename df to df/d10/d11/d17/d18 22 2024-02-16T22:18:50.236 INFO:tasks.workunit.client.0.smithi134.stdout:9/194: truncate f8 2534752 0 2024-02-16T22:18:50.237 INFO:tasks.workunit.client.0.smithi134.stdout:7/86: dread d2/ff [0,4194304] 0 2024-02-16T22:18:50.237 INFO:tasks.workunit.client.0.smithi134.stdout:7/87: chown d2/ff 186545028 1 2024-02-16T22:18:50.237 INFO:tasks.workunit.client.0.smithi134.stdout:7/88: chown d2/d6/d12 29 1 2024-02-16T22:18:50.237 INFO:tasks.workunit.client.0.smithi134.stdout:7/89: readlink d2/d5/l9 0 2024-02-16T22:18:50.237 INFO:tasks.workunit.client.0.smithi134.stdout:2/89: dread f2 [4194304,4194304] 0 2024-02-16T22:18:50.237 INFO:tasks.workunit.client.0.smithi134.stdout:3/136: mkdir da/d12/d2a 0 2024-02-16T22:18:50.242 INFO:tasks.workunit.client.0.smithi134.stdout:9/195: fdatasync db/dc/f15 0 2024-02-16T22:18:50.242 INFO:tasks.workunit.client.0.smithi134.stdout:7/90: dread d2/fb [0,4194304] 0 2024-02-16T22:18:50.243 INFO:tasks.workunit.client.0.smithi134.stdout:2/90: mknod df/d10/d15/c19 0 2024-02-16T22:18:50.246 INFO:tasks.workunit.client.0.smithi134.stdout:7/91: mknod d2/d6/d17/c1c 0 2024-02-16T22:18:50.246 INFO:tasks.workunit.client.0.smithi134.stdout:7/92: fdatasync d2/fb 0 2024-02-16T22:18:50.247 INFO:tasks.workunit.client.0.smithi134.stdout:3/137: mkdir da/d2b 0 2024-02-16T22:18:50.247 INFO:tasks.workunit.client.0.smithi134.stdout:3/138: write da/d12/f25 [140043,41843] 0 2024-02-16T22:18:50.249 INFO:tasks.workunit.client.0.smithi134.stdout:7/93: creat d2/d5/d19/f1d x:0 0 0 2024-02-16T22:18:50.256 INFO:tasks.workunit.client.0.smithi134.stdout:2/91: dread f2 [8388608,4194304] 0 2024-02-16T22:18:50.257 INFO:tasks.workunit.client.0.smithi134.stdout:2/92: truncate df/d10/d11/f13 2882970 0 2024-02-16T22:18:50.260 INFO:tasks.workunit.client.0.smithi134.stdout:3/139: dread da/d12/f17 [0,4194304] 0 2024-02-16T22:18:50.261 INFO:tasks.workunit.client.0.smithi134.stdout:5/140: dwrite d2/d9/dc/f1d [0,4194304] 0 2024-02-16T22:18:50.261 INFO:tasks.workunit.client.0.smithi134.stdout:5/141: chown d2/c8 11684 1 2024-02-16T22:18:50.262 INFO:tasks.workunit.client.0.smithi134.stdout:3/140: mkdir da/d1c/d24/d2c 0 2024-02-16T22:18:50.263 INFO:tasks.workunit.client.0.smithi134.stdout:6/132: dwrite d17/f1c [0,4194304] 0 2024-02-16T22:18:50.265 INFO:tasks.workunit.client.0.smithi134.stdout:9/196: dwrite db/dc/f12 [0,4194304] 0 2024-02-16T22:18:50.267 INFO:tasks.workunit.client.0.smithi134.stdout:4/80: sync 2024-02-16T22:18:50.268 INFO:tasks.workunit.client.0.smithi134.stdout:7/94: truncate d2/d5/f10 293583 0 2024-02-16T22:18:50.268 INFO:tasks.workunit.client.0.smithi134.stdout:7/95: fsync d2/f1b 0 2024-02-16T22:18:50.268 INFO:tasks.workunit.client.0.smithi134.stdout:7/96: write d2/f1a [163691,59681] 0 2024-02-16T22:18:50.268 INFO:tasks.workunit.client.0.smithi134.stdout:7/97: dread - d2/d5/d19/f1d zero size 2024-02-16T22:18:50.268 INFO:tasks.workunit.client.0.smithi134.stdout:8/141: dwrite d2/df/d19/f28 [0,4194304] 0 2024-02-16T22:18:50.273 INFO:tasks.workunit.client.0.smithi134.stdout:7/98: mkdir d2/d1e 0 2024-02-16T22:18:50.273 INFO:tasks.workunit.client.0.smithi134.stdout:4/81: dread d0/d6/d16/f17 [0,4194304] 0 2024-02-16T22:18:50.275 INFO:tasks.workunit.client.0.smithi134.stdout:5/142: dwrite d2/d9/dc/f13 [0,4194304] 0 2024-02-16T22:18:50.276 INFO:tasks.workunit.client.0.smithi134.stdout:5/143: creat d2/f2d x:0 0 0 2024-02-16T22:18:50.276 INFO:tasks.workunit.client.0.smithi134.stdout:5/144: creat d2/f2e x:0 0 0 2024-02-16T22:18:50.278 INFO:tasks.workunit.client.0.smithi134.stdout:5/145: dread d2/f6 [4194304,4194304] 0 2024-02-16T22:18:50.278 INFO:tasks.workunit.client.0.smithi134.stdout:5/146: dread - d2/d9/dc/fe zero size 2024-02-16T22:18:50.283 INFO:tasks.workunit.client.0.smithi134.stdout:4/82: truncate d0/f4 3168644 0 2024-02-16T22:18:50.283 INFO:tasks.workunit.client.0.smithi134.stdout:4/83: readlink d0/lb 0 2024-02-16T22:18:50.288 INFO:tasks.workunit.client.0.smithi134.stdout:5/147: mkdir d2/d9/dc/d15/d2f 0 2024-02-16T22:18:50.289 INFO:tasks.workunit.client.0.smithi134.stdout:7/99: rmdir d2/d5 39 2024-02-16T22:18:50.290 INFO:tasks.workunit.client.0.smithi134.stdout:4/84: symlink d0/d6/d16/l19 0 2024-02-16T22:18:50.290 INFO:tasks.workunit.client.0.smithi134.stdout:4/85: fdatasync d0/f2 0 2024-02-16T22:18:50.292 INFO:tasks.workunit.client.0.smithi134.stdout:9/197: dwrite db/d20/d22/f35 [0,4194304] 0 2024-02-16T22:18:50.295 INFO:tasks.workunit.client.0.smithi134.stdout:8/142: dwrite f1 [0,4194304] 0 2024-02-16T22:18:50.296 INFO:tasks.workunit.client.0.smithi134.stdout:1/145: sync 2024-02-16T22:18:50.296 INFO:tasks.workunit.client.0.smithi134.stdout:1/146: stat d5/da/c1f 0 2024-02-16T22:18:50.297 INFO:tasks.workunit.client.0.smithi134.stdout:0/107: sync 2024-02-16T22:18:50.297 INFO:tasks.workunit.client.0.smithi134.stdout:5/148: dread f0 [0,4194304] 0 2024-02-16T22:18:50.300 INFO:tasks.workunit.client.0.smithi134.stdout:0/108: rename d2/f1a to d2/f26 0 2024-02-16T22:18:50.305 INFO:tasks.workunit.client.0.smithi134.stdout:9/198: dread db/f33 [0,4194304] 0 2024-02-16T22:18:50.309 INFO:tasks.workunit.client.0.smithi134.stdout:1/147: dread d5/f24 [0,4194304] 0 2024-02-16T22:18:50.309 INFO:tasks.workunit.client.0.smithi134.stdout:9/199: symlink db/d20/d32/l42 0 2024-02-16T22:18:50.314 INFO:tasks.workunit.client.0.smithi134.stdout:1/148: mknod d5/c3a 0 2024-02-16T22:18:50.315 INFO:tasks.workunit.client.0.smithi134.stdout:5/149: write d2/f6 [950944,102831] 0 2024-02-16T22:18:50.321 INFO:tasks.workunit.client.0.smithi134.stdout:4/86: dread d0/f2 [0,4194304] 0 2024-02-16T22:18:50.322 INFO:tasks.workunit.client.0.smithi134.stdout:4/87: mkdir d0/d6/d16/d1a 0 2024-02-16T22:18:50.323 INFO:tasks.workunit.client.0.smithi134.stdout:7/100: dwrite d2/f1a [0,4194304] 0 2024-02-16T22:18:50.326 INFO:tasks.workunit.client.0.smithi134.stdout:7/101: link c1 d2/d6/c1f 0 2024-02-16T22:18:50.326 INFO:tasks.workunit.client.0.smithi134.stdout:4/88: getdents d0/d6/d8/de 0 2024-02-16T22:18:50.328 INFO:tasks.workunit.client.0.smithi134.stdout:7/102: symlink d2/d6/l20 0 2024-02-16T22:18:50.331 INFO:tasks.workunit.client.0.smithi134.stdout:8/143: dwrite d2/f7 [0,4194304] 0 2024-02-16T22:18:50.331 INFO:tasks.workunit.client.0.smithi134.stdout:8/144: truncate d2/f25 1031231 0 2024-02-16T22:18:50.332 INFO:tasks.workunit.client.0.smithi134.stdout:0/109: dwrite d2/dc/f15 [0,4194304] 0 2024-02-16T22:18:50.333 INFO:tasks.workunit.client.0.smithi134.stdout:8/145: mknod d2/df/d18/d2a/c32 0 2024-02-16T22:18:50.334 INFO:tasks.workunit.client.0.smithi134.stdout:8/146: write d2/f1b [4255347,66351] 0 2024-02-16T22:18:50.334 INFO:tasks.workunit.client.0.smithi134.stdout:8/147: truncate d2/df/d19/f29 642770 0 2024-02-16T22:18:50.334 INFO:tasks.workunit.client.0.smithi134.stdout:8/148: chown d2/df/c1f 13895174 1 2024-02-16T22:18:50.335 INFO:tasks.workunit.client.0.smithi134.stdout:4/89: dread d0/d6/d16/f17 [0,4194304] 0 2024-02-16T22:18:50.337 INFO:tasks.workunit.client.0.smithi134.stdout:4/90: creat d0/d6/d16/d1a/f1b x:0 0 0 2024-02-16T22:18:50.339 INFO:tasks.workunit.client.0.smithi134.stdout:4/91: unlink d0/c14 0 2024-02-16T22:18:50.340 INFO:tasks.workunit.client.0.smithi134.stdout:0/110: fsync d2/f26 0 2024-02-16T22:18:50.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/92: mknod d0/d6/d16/c1c 0 2024-02-16T22:18:50.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/93: write d0/d6/d8/de/f13 [231585,19992] 0 2024-02-16T22:18:50.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/94: creat d0/d6/d16/d1a/f1d x:0 0 0 2024-02-16T22:18:50.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/95: chown d0/d6/d8/c10 274851 1 2024-02-16T22:18:50.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/96: truncate d0/f11 996728 0 2024-02-16T22:18:50.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/97: chown d0/d6 100 1 2024-02-16T22:18:50.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/98: chown d0/d6/d8/de 19395157 1 2024-02-16T22:18:50.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/99: readlink d0/lc 0 2024-02-16T22:18:50.343 INFO:tasks.workunit.client.0.smithi134.stdout:0/111: rename d2/f7 to d2/f27 0 2024-02-16T22:18:50.345 INFO:tasks.workunit.client.0.smithi134.stdout:7/103: write d2/f1a [2799857,128782] 0 2024-02-16T22:18:50.346 INFO:tasks.workunit.client.0.smithi134.stdout:0/112: rename d2/dc/fe to d2/dc/f28 0 2024-02-16T22:18:50.347 INFO:tasks.workunit.client.0.smithi134.stdout:1/149: dwrite d5/f7 [0,4194304] 0 2024-02-16T22:18:50.347 INFO:tasks.workunit.client.0.smithi134.stdout:1/150: write d5/da/d1c/f29 [136885,19654] 0 2024-02-16T22:18:50.347 INFO:tasks.workunit.client.0.smithi134.stdout:1/151: stat d5/f7 0 2024-02-16T22:18:50.347 INFO:tasks.workunit.client.0.smithi134.stdout:1/152: chown d5/f26 221 1 2024-02-16T22:18:50.348 INFO:tasks.workunit.client.0.smithi134.stdout:1/153: creat d5/da/d21/f3b x:0 0 0 2024-02-16T22:18:50.348 INFO:tasks.workunit.client.0.smithi134.stdout:1/154: chown d5/da/d1c 773613 1 2024-02-16T22:18:50.348 INFO:tasks.workunit.client.0.smithi134.stdout:5/150: dwrite d2/d9/dc/f13 [0,4194304] 0 2024-02-16T22:18:50.348 INFO:tasks.workunit.client.0.smithi134.stdout:9/200: dwrite db/dc/f17 [0,4194304] 0 2024-02-16T22:18:50.350 INFO:tasks.workunit.client.0.smithi134.stdout:7/104: link d2/f4 d2/d6/f21 0 2024-02-16T22:18:50.352 INFO:tasks.workunit.client.0.smithi134.stdout:8/149: dwrite f0 [0,4194304] 0 2024-02-16T22:18:50.353 INFO:tasks.workunit.client.0.smithi134.stdout:0/113: creat d2/d20/f29 x:0 0 0 2024-02-16T22:18:50.357 INFO:tasks.workunit.client.0.smithi134.stdout:1/155: mkdir d5/d1a/d23/d3c 0 2024-02-16T22:18:50.357 INFO:tasks.workunit.client.0.smithi134.stdout:1/156: write d5/d1a/d23/f27 [937686,113470] 0 2024-02-16T22:18:50.357 INFO:tasks.workunit.client.0.smithi134.stdout:1/157: creat d5/d1a/d23/f3d x:0 0 0 2024-02-16T22:18:50.358 INFO:tasks.workunit.client.0.smithi134.stdout:5/151: mkdir d2/d9/dc/d15/d2f/d30 0 2024-02-16T22:18:50.358 INFO:tasks.workunit.client.0.smithi134.stdout:5/152: chown d2/d9/dc/f26 1816511 1 2024-02-16T22:18:50.361 INFO:tasks.workunit.client.0.smithi134.stdout:4/100: dwrite d0/f2 [0,4194304] 0 2024-02-16T22:18:50.365 INFO:tasks.workunit.client.0.smithi134.stdout:7/105: mkdir d2/d5/d22 0 2024-02-16T22:18:50.368 INFO:tasks.workunit.client.0.smithi134.stdout:0/114: mknod d2/c2a 0 2024-02-16T22:18:50.368 INFO:tasks.workunit.client.0.smithi134.stdout:0/115: creat d2/dc/f2b x:0 0 0 2024-02-16T22:18:50.368 INFO:tasks.workunit.client.0.smithi134.stdout:1/158: truncate d5/d1a/f31 945212 0 2024-02-16T22:18:50.370 INFO:tasks.workunit.client.0.smithi134.stdout:4/101: getdents d0/d6 0 2024-02-16T22:18:50.370 INFO:tasks.workunit.client.0.smithi134.stdout:4/102: fsync d0/d6/d8/de/f13 0 2024-02-16T22:18:50.373 INFO:tasks.workunit.client.0.smithi134.stdout:7/106: creat d2/d6/d17/f23 x:0 0 0 2024-02-16T22:18:50.373 INFO:tasks.workunit.client.0.smithi134.stdout:7/107: write d2/d5/f10 [378985,8960] 0 2024-02-16T22:18:50.373 INFO:tasks.workunit.client.0.smithi134.stdout:7/108: chown d2/fb 7576 1 2024-02-16T22:18:50.373 INFO:tasks.workunit.client.0.smithi134.stdout:7/109: read - d2/f1b zero size 2024-02-16T22:18:50.373 INFO:tasks.workunit.client.0.smithi134.stdout:5/153: dwrite d2/d9/dc/f26 [0,4194304] 0 2024-02-16T22:18:50.373 INFO:tasks.workunit.client.0.smithi134.stdout:5/154: fsync f0 0 2024-02-16T22:18:50.374 INFO:tasks.workunit.client.0.smithi134.stdout:5/155: creat d2/d9/dc/d15/f31 x:0 0 0 2024-02-16T22:18:50.374 INFO:tasks.workunit.client.0.smithi134.stdout:5/156: readlink d2/d9/ld 0 2024-02-16T22:18:50.374 INFO:tasks.workunit.client.0.smithi134.stdout:8/150: rename d2/f7 to d2/df/f33 0 2024-02-16T22:18:50.377 INFO:tasks.workunit.client.0.smithi134.stdout:0/116: mknod d2/d20/c2c 0 2024-02-16T22:18:50.378 INFO:tasks.workunit.client.0.smithi134.stdout:0/117: truncate d2/f17 572076 0 2024-02-16T22:18:50.378 INFO:tasks.workunit.client.0.smithi134.stdout:0/118: truncate d2/f16 178601 0 2024-02-16T22:18:50.378 INFO:tasks.workunit.client.0.smithi134.stdout:0/119: dread - d2/dc/f1d zero size 2024-02-16T22:18:50.378 INFO:tasks.workunit.client.0.smithi134.stdout:0/120: truncate d2/dc/f1e 1540965 0 2024-02-16T22:18:50.379 INFO:tasks.workunit.client.0.smithi134.stdout:1/159: symlink d5/da/d21/l3e 0 2024-02-16T22:18:50.379 INFO:tasks.workunit.client.0.smithi134.stdout:7/110: dread d2/fb [0,4194304] 0 2024-02-16T22:18:50.379 INFO:tasks.workunit.client.0.smithi134.stdout:7/111: write d2/d5/d19/f1d [114844,92237] 0 2024-02-16T22:18:50.379 INFO:tasks.workunit.client.0.smithi134.stdout:7/112: chown d2/d1e 89945 1 2024-02-16T22:18:50.379 INFO:tasks.workunit.client.0.smithi134.stdout:7/113: chown d2/d5/f10 723985886 1 2024-02-16T22:18:50.379 INFO:tasks.workunit.client.0.smithi134.stdout:7/114: stat d2/c11 0 2024-02-16T22:18:50.382 INFO:tasks.workunit.client.0.smithi134.stdout:0/121: mkdir d2/dc/d2d 0 2024-02-16T22:18:50.383 INFO:tasks.workunit.client.0.smithi134.stdout:1/160: creat d5/f3f x:0 0 0 2024-02-16T22:18:50.384 INFO:tasks.workunit.client.0.smithi134.stdout:0/122: symlink d2/dc/d2d/l2e 0 2024-02-16T22:18:50.388 INFO:tasks.workunit.client.0.smithi134.stdout:1/161: dread d5/da/f14 [0,4194304] 0 2024-02-16T22:18:50.389 INFO:tasks.workunit.client.0.smithi134.stdout:5/157: dwrite d2/f19 [0,4194304] 0 2024-02-16T22:18:50.390 INFO:tasks.workunit.client.0.smithi134.stdout:7/115: dread d2/d5/d19/f1d [0,4194304] 0 2024-02-16T22:18:50.393 INFO:tasks.workunit.client.0.smithi134.stdout:1/162: link d5/da/f15 d5/d1a/f40 0 2024-02-16T22:18:50.393 INFO:tasks.workunit.client.0.smithi134.stdout:6/133: sync 2024-02-16T22:18:50.394 INFO:tasks.workunit.client.0.smithi134.stdout:2/93: sync 2024-02-16T22:18:50.394 INFO:tasks.workunit.client.0.smithi134.stdout:3/141: sync 2024-02-16T22:18:50.394 INFO:tasks.workunit.client.0.smithi134.stdout:3/142: chown da/d1c/d24/c16 474488 1 2024-02-16T22:18:50.394 INFO:tasks.workunit.client.0.smithi134.stdout:6/134: creat d17/d22/f29 x:0 0 0 2024-02-16T22:18:50.394 INFO:tasks.workunit.client.0.smithi134.stdout:6/135: fdatasync f12 0 2024-02-16T22:18:50.394 INFO:tasks.workunit.client.0.smithi134.stdout:6/136: getdents d17/d22/d28 0 2024-02-16T22:18:50.394 INFO:tasks.workunit.client.0.smithi134.stdout:6/137: readlink d17/l1e 0 2024-02-16T22:18:50.394 INFO:tasks.workunit.client.0.smithi134.stdout:6/138: chown f11 9121620 1 2024-02-16T22:18:50.394 INFO:tasks.workunit.client.0.smithi134.stdout:7/116: mkdir d2/d1e/d24 0 2024-02-16T22:18:50.395 INFO:tasks.workunit.client.0.smithi134.stdout:3/143: dread da/d12/f25 [0,4194304] 0 2024-02-16T22:18:50.395 INFO:tasks.workunit.client.0.smithi134.stdout:2/94: mknod df/d10/d11/c1a 0 2024-02-16T22:18:50.396 INFO:tasks.workunit.client.0.smithi134.stdout:2/95: getdents df/d10/d11/d17 0 2024-02-16T22:18:50.397 INFO:tasks.workunit.client.0.smithi134.stdout:6/139: symlink d17/l2a 0 2024-02-16T22:18:50.398 INFO:tasks.workunit.client.0.smithi134.stdout:7/117: mkdir d2/d6/d17/d25 0 2024-02-16T22:18:50.399 INFO:tasks.workunit.client.0.smithi134.stdout:5/158: write d2/d9/dc/f26 [2443175,64823] 0 2024-02-16T22:18:50.399 INFO:tasks.workunit.client.0.smithi134.stdout:2/96: mkdir df/d10/d11/d17/d1b 0 2024-02-16T22:18:50.400 INFO:tasks.workunit.client.0.smithi134.stdout:6/140: rename f9 to d17/d22/f2b 0 2024-02-16T22:18:50.400 INFO:tasks.workunit.client.0.smithi134.stdout:1/163: dread d5/d1a/d23/f20 [0,4194304] 0 2024-02-16T22:18:50.402 INFO:tasks.workunit.client.0.smithi134.stdout:5/159: mkdir d2/d9/dc/d32 0 2024-02-16T22:18:50.402 INFO:tasks.workunit.client.0.smithi134.stdout:7/118: dread d2/d5/f10 [0,4194304] 0 2024-02-16T22:18:50.402 INFO:tasks.workunit.client.0.smithi134.stdout:7/119: chown d2/d1e 1 1 2024-02-16T22:18:50.403 INFO:tasks.workunit.client.0.smithi134.stdout:6/141: rename d17/c1f to d17/d22/d28/c2c 0 2024-02-16T22:18:50.404 INFO:tasks.workunit.client.0.smithi134.stdout:7/120: mkdir d2/d5/d22/d26 0 2024-02-16T22:18:50.405 INFO:tasks.workunit.client.0.smithi134.stdout:7/121: readlink d2/d6/d17/le 0 2024-02-16T22:18:50.405 INFO:tasks.workunit.client.0.smithi134.stdout:7/122: fsync d2/d5/d19/f1d 0 2024-02-16T22:18:50.405 INFO:tasks.workunit.client.0.smithi134.stdout:7/123: fdatasync d2/f1a 0 2024-02-16T22:18:50.406 INFO:tasks.workunit.client.0.smithi134.stdout:7/124: creat d2/d1e/d24/f27 x:0 0 0 2024-02-16T22:18:50.407 INFO:tasks.workunit.client.0.smithi134.stdout:7/125: mkdir d2/d6/d12/d28 0 2024-02-16T22:18:50.409 INFO:tasks.workunit.client.0.smithi134.stdout:5/160: dread d2/f4 [0,4194304] 0 2024-02-16T22:18:50.409 INFO:tasks.workunit.client.0.smithi134.stdout:0/123: dwrite d2/f26 [0,4194304] 0 2024-02-16T22:18:50.409 INFO:tasks.workunit.client.0.smithi134.stdout:7/126: mknod d2/d7/c29 0 2024-02-16T22:18:50.409 INFO:tasks.workunit.client.0.smithi134.stdout:7/127: write d2/d5/f10 [650007,82168] 0 2024-02-16T22:18:50.411 INFO:tasks.workunit.client.0.smithi134.stdout:7/128: dread d2/d5/d19/f1d [0,4194304] 0 2024-02-16T22:18:50.411 INFO:tasks.workunit.client.0.smithi134.stdout:5/161: rename d2/d9/dc/d27/c28 to d2/d9/dc/d32/c33 0 2024-02-16T22:18:50.411 INFO:tasks.workunit.client.0.smithi134.stdout:5/162: write d2/f2b [195863,45306] 0 2024-02-16T22:18:50.412 INFO:tasks.workunit.client.0.smithi134.stdout:0/124: symlink d2/dc/l2f 0 2024-02-16T22:18:50.414 INFO:tasks.workunit.client.0.smithi134.stdout:2/97: read fb [2966356,31994] 0 2024-02-16T22:18:50.419 INFO:tasks.workunit.client.0.smithi134.stdout:1/164: getdents d5/d1a 0 2024-02-16T22:18:50.419 INFO:tasks.workunit.client.0.smithi134.stdout:1/165: chown d5/da/d2d/f36 26350 1 2024-02-16T22:18:50.419 INFO:tasks.workunit.client.0.smithi134.stdout:1/166: chown d5/d1a/d23 15564257 1 2024-02-16T22:18:50.420 INFO:tasks.workunit.client.0.smithi134.stdout:1/167: chown d5/d1a 49637589 1 2024-02-16T22:18:50.423 INFO:tasks.workunit.client.0.smithi134.stdout:0/125: mknod d2/dc/d2d/c30 0 2024-02-16T22:18:50.423 INFO:tasks.workunit.client.0.smithi134.stdout:0/126: rename d2 to d2/dc/d2d/d31 22 2024-02-16T22:18:50.424 INFO:tasks.workunit.client.0.smithi134.stdout:1/168: stat d5/da/ce 0 2024-02-16T22:18:50.424 INFO:tasks.workunit.client.0.smithi134.stdout:0/127: mkdir d2/dc/d32 0 2024-02-16T22:18:50.424 INFO:tasks.workunit.client.0.smithi134.stdout:1/169: truncate f1 251333 0 2024-02-16T22:18:50.424 INFO:tasks.workunit.client.0.smithi134.stdout:1/170: write f3 [2898498,78736] 0 2024-02-16T22:18:50.426 INFO:tasks.workunit.client.0.smithi134.stdout:0/128: creat d2/f33 x:0 0 0 2024-02-16T22:18:50.428 INFO:tasks.workunit.client.0.smithi134.stdout:1/171: getdents d5/da 0 2024-02-16T22:18:50.429 INFO:tasks.workunit.client.0.smithi134.stdout:6/142: dwrite d17/f1c [0,4194304] 0 2024-02-16T22:18:50.430 INFO:tasks.workunit.client.0.smithi134.stdout:0/129: mkdir d2/dc/d2d/d34 0 2024-02-16T22:18:50.433 INFO:tasks.workunit.client.0.smithi134.stdout:6/143: unlink d17/d22/f2b 0 2024-02-16T22:18:50.434 INFO:tasks.workunit.client.0.smithi134.stdout:7/129: dwrite d2/d6/f16 [0,4194304] 0 2024-02-16T22:18:50.435 INFO:tasks.workunit.client.0.smithi134.stdout:0/130: truncate d2/f11 793877 0 2024-02-16T22:18:50.438 INFO:tasks.workunit.client.0.smithi134.stdout:7/130: write d2/ff [1126634,88836] 0 2024-02-16T22:18:50.441 INFO:tasks.workunit.client.0.smithi134.stdout:7/131: creat d2/d6/d17/d25/f2a x:0 0 0 2024-02-16T22:18:50.442 INFO:tasks.workunit.client.0.smithi134.stdout:7/132: creat d2/d5/d19/f2b x:0 0 0 2024-02-16T22:18:50.442 INFO:tasks.workunit.client.0.smithi134.stdout:6/144: dread f6 [0,4194304] 0 2024-02-16T22:18:50.442 INFO:tasks.workunit.client.0.smithi134.stdout:2/98: dwrite df/d10/d11/f13 [0,4194304] 0 2024-02-16T22:18:50.443 INFO:tasks.workunit.client.0.smithi134.stdout:7/133: symlink d2/d6/d12/d28/l2c 0 2024-02-16T22:18:50.443 INFO:tasks.workunit.client.0.smithi134.stdout:7/134: write d2/d5/d19/f1d [477614,35709] 0 2024-02-16T22:18:50.444 INFO:tasks.workunit.client.0.smithi134.stdout:7/135: creat d2/d5/f2d x:0 0 0 2024-02-16T22:18:50.449 INFO:tasks.workunit.client.0.smithi134.stdout:1/172: dwrite d5/f3f [0,4194304] 0 2024-02-16T22:18:50.450 INFO:tasks.workunit.client.0.smithi134.stdout:0/131: write d2/dc/f15 [3920157,96083] 0 2024-02-16T22:18:50.450 INFO:tasks.workunit.client.0.smithi134.stdout:0/132: creat d2/d20/f35 x:0 0 0 2024-02-16T22:18:50.455 INFO:tasks.workunit.client.0.smithi134.stdout:7/136: dread d2/d5/d19/f1d [0,4194304] 0 2024-02-16T22:18:50.460 INFO:tasks.workunit.client.0.smithi134.stdout:7/137: link d2/ff d2/d6/d17/f2e 0 2024-02-16T22:18:50.473 INFO:tasks.workunit.client.0.smithi134.stdout:0/133: write d2/f1c [1429269,64304] 0 2024-02-16T22:18:50.484 INFO:tasks.workunit.client.0.smithi134.stdout:6/145: dwrite d17/f18 [0,4194304] 0 2024-02-16T22:18:50.484 INFO:tasks.workunit.client.0.smithi134.stdout:2/99: dwrite df/d10/d11/f13 [0,4194304] 0 2024-02-16T22:18:50.484 INFO:tasks.workunit.client.0.smithi134.stdout:6/146: chown ce 56297 1 2024-02-16T22:18:50.487 INFO:tasks.workunit.client.0.smithi134.stdout:1/173: dwrite d5/d1a/d23/f27 [0,4194304] 0 2024-02-16T22:18:50.488 INFO:tasks.workunit.client.0.smithi134.stdout:7/138: dwrite d2/d6/f21 [0,4194304] 0 2024-02-16T22:18:50.488 INFO:tasks.workunit.client.0.smithi134.stdout:0/134: dwrite d2/f11 [0,4194304] 0 2024-02-16T22:18:50.488 INFO:tasks.workunit.client.0.smithi134.stdout:0/135: readlink d2/dc/l2f 0 2024-02-16T22:18:50.488 INFO:tasks.workunit.client.0.smithi134.stdout:0/136: stat d2/d20/f35 0 2024-02-16T22:18:50.488 INFO:tasks.workunit.client.0.smithi134.stdout:0/137: readlink d2/l24 0 2024-02-16T22:18:50.488 INFO:tasks.workunit.client.0.smithi134.stdout:0/138: creat d2/d20/f36 x:0 0 0 2024-02-16T22:18:50.489 INFO:tasks.workunit.client.0.smithi134.stdout:2/100: rename df/d10/d11/c1a to df/d10/d11/c1c 0 2024-02-16T22:18:50.489 INFO:tasks.workunit.client.0.smithi134.stdout:2/101: chown fb 2 1 2024-02-16T22:18:50.489 INFO:tasks.workunit.client.0.smithi134.stdout:2/102: creat df/d10/d15/f1d x:0 0 0 2024-02-16T22:18:50.490 INFO:tasks.workunit.client.0.smithi134.stdout:1/174: dread d5/f24 [4194304,4194304] 0 2024-02-16T22:18:50.495 INFO:tasks.workunit.client.0.smithi134.stdout:9/201: sync 2024-02-16T22:18:50.498 INFO:tasks.workunit.client.0.smithi134.stdout:0/139: creat d2/dc/d2d/d34/f37 x:0 0 0 2024-02-16T22:18:50.499 INFO:tasks.workunit.client.0.smithi134.stdout:2/103: rmdir df/d10/d11 39 2024-02-16T22:18:50.499 INFO:tasks.workunit.client.0.smithi134.stdout:2/104: dread - df/d10/d15/f16 zero size 2024-02-16T22:18:50.500 INFO:tasks.workunit.client.0.smithi134.stdout:9/202: creat db/f43 x:0 0 0 2024-02-16T22:18:50.500 INFO:tasks.workunit.client.0.smithi134.stdout:9/203: fdatasync db/d20/d22/f25 0 2024-02-16T22:18:50.501 INFO:tasks.workunit.client.0.smithi134.stdout:0/140: mknod d2/c38 0 2024-02-16T22:18:50.503 INFO:tasks.workunit.client.0.smithi134.stdout:0/141: unlink d2/d20/c2c 0 2024-02-16T22:18:50.504 INFO:tasks.workunit.client.0.smithi134.stdout:7/139: dread d2/fb [0,4194304] 0 2024-02-16T22:18:50.504 INFO:tasks.workunit.client.0.smithi134.stdout:7/140: chown d2/d1e/d24 142683913 1 2024-02-16T22:18:50.504 INFO:tasks.workunit.client.0.smithi134.stdout:7/141: write d2/f1a [2655489,13996] 0 2024-02-16T22:18:50.505 INFO:tasks.workunit.client.0.smithi134.stdout:7/142: write d2/d5/f2d [455105,1467] 0 2024-02-16T22:18:50.505 INFO:tasks.workunit.client.0.smithi134.stdout:0/142: mkdir d2/dc/d2d/d34/d39 0 2024-02-16T22:18:50.511 INFO:tasks.workunit.client.0.smithi134.stdout:6/147: dwrite d17/d22/f25 [0,4194304] 0 2024-02-16T22:18:50.511 INFO:tasks.workunit.client.0.smithi134.stdout:6/148: chown d17/c1d 1 1 2024-02-16T22:18:50.512 INFO:tasks.workunit.client.0.smithi134.stdout:6/149: fdatasync f15 0 2024-02-16T22:18:50.518 INFO:tasks.workunit.client.0.smithi134.stdout:1/175: dwrite d5/da/d2d/f34 [0,4194304] 0 2024-02-16T22:18:50.518 INFO:tasks.workunit.client.0.smithi134.stdout:9/204: dread db/dc/f17 [0,4194304] 0 2024-02-16T22:18:50.518 INFO:tasks.workunit.client.0.smithi134.stdout:9/205: dread - db/f43 zero size 2024-02-16T22:18:50.518 INFO:tasks.workunit.client.0.smithi134.stdout:7/143: dread d2/d5/f2d [0,4194304] 0 2024-02-16T22:18:50.519 INFO:tasks.workunit.client.0.smithi134.stdout:9/206: read db/d20/d22/f25 [20162,11590] 0 2024-02-16T22:18:50.521 INFO:tasks.workunit.client.0.smithi134.stdout:9/207: creat db/d20/d22/f44 x:0 0 0 2024-02-16T22:18:50.525 INFO:tasks.workunit.client.0.smithi134.stdout:9/208: rename db/c11 to db/d20/d22/c45 0 2024-02-16T22:18:50.525 INFO:tasks.workunit.client.0.smithi134.stdout:9/209: fsync db/f33 0 2024-02-16T22:18:50.525 INFO:tasks.workunit.client.0.smithi134.stdout:9/210: readlink db/dc/l1b 0 2024-02-16T22:18:50.527 INFO:tasks.workunit.client.0.smithi134.stdout:9/211: mkdir db/d20/d22/d46 0 2024-02-16T22:18:50.528 INFO:tasks.workunit.client.0.smithi134.stdout:2/105: dwrite df/d10/d15/f1d [0,4194304] 0 2024-02-16T22:18:50.528 INFO:tasks.workunit.client.0.smithi134.stdout:2/106: stat df/d10/d15/f16 0 2024-02-16T22:18:50.532 INFO:tasks.workunit.client.0.smithi134.stdout:2/107: link f8 df/d10/d15/f1e 0 2024-02-16T22:18:50.532 INFO:tasks.workunit.client.0.smithi134.stdout:2/108: fdatasync f2 0 2024-02-16T22:18:50.534 INFO:tasks.workunit.client.0.smithi134.stdout:0/143: dwrite d2/f1f [0,4194304] 0 2024-02-16T22:18:50.534 INFO:tasks.workunit.client.0.smithi134.stdout:6/150: dwrite f10 [0,4194304] 0 2024-02-16T22:18:50.534 INFO:tasks.workunit.client.0.smithi134.stdout:0/144: read d2/dc/f15 [2820683,106469] 0 2024-02-16T22:18:50.534 INFO:tasks.workunit.client.0.smithi134.stdout:6/151: creat d17/f2d x:0 0 0 2024-02-16T22:18:50.534 INFO:tasks.workunit.client.0.smithi134.stdout:2/109: rename f8 to df/f1f 0 2024-02-16T22:18:50.542 INFO:tasks.workunit.client.0.smithi134.stdout:0/145: rmdir d2/dc/d2d/d34/d39 0 2024-02-16T22:18:50.543 INFO:tasks.workunit.client.0.smithi134.stdout:2/110: creat df/d10/d11/d17/f20 x:0 0 0 2024-02-16T22:18:50.545 INFO:tasks.workunit.client.0.smithi134.stdout:0/146: rename d2/dc/d2d/c30 to d2/dc/d2d/d34/c3a 0 2024-02-16T22:18:50.545 INFO:tasks.workunit.client.0.smithi134.stdout:6/152: write d17/d22/f25 [5029245,2842] 0 2024-02-16T22:18:50.546 INFO:tasks.workunit.client.0.smithi134.stdout:4/103: sync 2024-02-16T22:18:50.546 INFO:tasks.workunit.client.0.smithi134.stdout:3/144: sync 2024-02-16T22:18:50.546 INFO:tasks.workunit.client.0.smithi134.stdout:8/151: sync 2024-02-16T22:18:50.547 INFO:tasks.workunit.client.0.smithi134.stdout:8/152: chown d2/df/d19/f28 1322742 1 2024-02-16T22:18:50.547 INFO:tasks.workunit.client.0.smithi134.stdout:3/145: read da/fc [1801966,94729] 0 2024-02-16T22:18:50.547 INFO:tasks.workunit.client.0.smithi134.stdout:3/146: chown c0 138173 1 2024-02-16T22:18:50.548 INFO:tasks.workunit.client.0.smithi134.stdout:4/104: mkdir d0/d6/d1e 0 2024-02-16T22:18:50.548 INFO:tasks.workunit.client.0.smithi134.stdout:4/105: dread - d0/d6/d16/d1a/f1b zero size 2024-02-16T22:18:50.549 INFO:tasks.workunit.client.0.smithi134.stdout:3/147: symlink da/d1c/d24/d2c/l2d 0 2024-02-16T22:18:50.549 INFO:tasks.workunit.client.0.smithi134.stdout:3/148: chown da 30878996 1 2024-02-16T22:18:50.551 INFO:tasks.workunit.client.0.smithi134.stdout:4/106: rename d0/d6/d8/l9 to d0/d6/d8/l1f 0 2024-02-16T22:18:50.551 INFO:tasks.workunit.client.0.smithi134.stdout:4/107: write d0/d6/d16/d1a/f1d [631909,16133] 0 2024-02-16T22:18:50.560 INFO:tasks.workunit.client.0.smithi134.stdout:4/108: fsync d0/d6/d16/d1a/f1d 0 2024-02-16T22:18:50.560 INFO:tasks.workunit.client.0.smithi134.stdout:4/109: write d0/d6/d8/fa [584841,29177] 0 2024-02-16T22:18:50.566 INFO:tasks.workunit.client.0.smithi134.stdout:9/212: dwrite db/f29 [0,4194304] 0 2024-02-16T22:18:50.568 INFO:tasks.workunit.client.0.smithi134.stdout:8/153: dread f1 [0,4194304] 0 2024-02-16T22:18:50.568 INFO:tasks.workunit.client.0.smithi134.stdout:7/144: dwrite d2/d5/d19/f2b [0,4194304] 0 2024-02-16T22:18:50.568 INFO:tasks.workunit.client.0.smithi134.stdout:7/145: creat d2/d5/d19/f2f x:0 0 0 2024-02-16T22:18:50.568 INFO:tasks.workunit.client.0.smithi134.stdout:4/110: creat d0/d6/d16/f20 x:0 0 0 2024-02-16T22:18:50.568 INFO:tasks.workunit.client.0.smithi134.stdout:4/111: write d0/f15 [4872070,71065] 0 2024-02-16T22:18:50.568 INFO:tasks.workunit.client.0.smithi134.stdout:4/112: creat d0/d6/d16/d1a/f21 x:0 0 0 2024-02-16T22:18:50.568 INFO:tasks.workunit.client.0.smithi134.stdout:1/176: dwrite d5/d1a/f40 [0,4194304] 0 2024-02-16T22:18:50.574 INFO:tasks.workunit.client.0.smithi134.stdout:8/154: symlink d2/df/d18/l34 0 2024-02-16T22:18:50.574 INFO:tasks.workunit.client.0.smithi134.stdout:8/155: chown d2/df/d18/d27/f30 0 1 2024-02-16T22:18:50.574 INFO:tasks.workunit.client.0.smithi134.stdout:1/177: read f3 [1899569,30600] 0 2024-02-16T22:18:50.574 INFO:tasks.workunit.client.0.smithi134.stdout:9/213: write db/dc/f17 [3151326,101191] 0 2024-02-16T22:18:50.579 INFO:tasks.workunit.client.0.smithi134.stdout:8/156: unlink d2/df/f23 0 2024-02-16T22:18:50.579 INFO:tasks.workunit.client.0.smithi134.stdout:8/157: write d2/df/d18/fc [203854,86003] 0 2024-02-16T22:18:50.579 INFO:tasks.workunit.client.0.smithi134.stdout:8/158: readlink d2/df/d19/l26 0 2024-02-16T22:18:50.579 INFO:tasks.workunit.client.0.smithi134.stdout:8/159: write d2/df/d18/d12/f2d [1040762,11795] 0 2024-02-16T22:18:50.580 INFO:tasks.workunit.client.0.smithi134.stdout:1/178: creat d5/d1a/d23/d3c/f41 x:0 0 0 2024-02-16T22:18:50.581 INFO:tasks.workunit.client.0.smithi134.stdout:9/214: creat db/d20/d22/d46/f47 x:0 0 0 2024-02-16T22:18:50.582 INFO:tasks.workunit.client.0.smithi134.stdout:9/215: truncate db/d20/f31 297353 0 2024-02-16T22:18:50.582 INFO:tasks.workunit.client.0.smithi134.stdout:9/216: stat db/d20/f31 0 2024-02-16T22:18:50.584 INFO:tasks.workunit.client.0.smithi134.stdout:9/217: symlink db/l48 0 2024-02-16T22:18:50.587 INFO:tasks.workunit.client.0.smithi134.stdout:8/160: dread d2/df/d18/d2a/f2b [0,4194304] 0 2024-02-16T22:18:50.587 INFO:tasks.workunit.client.0.smithi134.stdout:8/161: truncate d2/df/d19/f28 1279866 0 2024-02-16T22:18:50.588 INFO:tasks.workunit.client.0.smithi134.stdout:9/218: dread db/dc/f16 [0,4194304] 0 2024-02-16T22:18:50.588 INFO:tasks.workunit.client.0.smithi134.stdout:9/219: creat db/d20/d22/d46/f49 x:0 0 0 2024-02-16T22:18:50.591 INFO:tasks.workunit.client.0.smithi134.stdout:9/220: unlink db/dc/c1e 0 2024-02-16T22:18:50.591 INFO:tasks.workunit.client.0.smithi134.stdout:9/221: readlink db/l48 0 2024-02-16T22:18:50.591 INFO:tasks.workunit.client.0.smithi134.stdout:9/222: chown c7 119421 1 2024-02-16T22:18:50.592 INFO:tasks.workunit.client.0.smithi134.stdout:9/223: symlink db/dc/l4a 0 2024-02-16T22:18:50.601 INFO:tasks.workunit.client.0.smithi134.stdout:4/113: write d0/d6/d16/f17 [1073349,112809] 0 2024-02-16T22:18:50.601 INFO:tasks.workunit.client.0.smithi134.stdout:4/114: write d0/d6/d8/de/f13 [428181,128850] 0 2024-02-16T22:18:50.601 INFO:tasks.workunit.client.0.smithi134.stdout:4/115: chown d0/lb 69029 1 2024-02-16T22:18:50.603 INFO:tasks.workunit.client.0.smithi134.stdout:4/116: mkdir d0/d6/d22 0 2024-02-16T22:18:50.605 INFO:tasks.workunit.client.0.smithi134.stdout:4/117: rename d0/d6/d16/c1c to d0/d6/d8/c23 0 2024-02-16T22:18:50.605 INFO:tasks.workunit.client.0.smithi134.stdout:1/179: dread d5/da/d2d/f34 [0,4194304] 0 2024-02-16T22:18:50.606 INFO:tasks.workunit.client.0.smithi134.stdout:4/118: creat d0/d6/f24 x:0 0 0 2024-02-16T22:18:50.612 INFO:tasks.workunit.client.0.smithi134.stdout:2/111: dwrite df/d10/d15/f1d [0,4194304] 0 2024-02-16T22:18:50.613 INFO:tasks.workunit.client.0.smithi134.stdout:2/112: fsync fb 0 2024-02-16T22:18:50.613 INFO:tasks.workunit.client.0.smithi134.stdout:2/113: readlink df/l12 0 2024-02-16T22:18:50.613 INFO:tasks.workunit.client.0.smithi134.stdout:2/114: dread - df/d10/d15/f16 zero size 2024-02-16T22:18:50.613 INFO:tasks.workunit.client.0.smithi134.stdout:2/115: stat df/d10/d15 0 2024-02-16T22:18:50.613 INFO:tasks.workunit.client.0.smithi134.stdout:6/153: dwrite f15 [4194304,4194304] 0 2024-02-16T22:18:50.613 INFO:tasks.workunit.client.0.smithi134.stdout:6/154: truncate d17/f21 492193 0 2024-02-16T22:18:50.613 INFO:tasks.workunit.client.0.smithi134.stdout:7/146: dwrite d2/d5/d19/f1d [0,4194304] 0 2024-02-16T22:18:50.613 INFO:tasks.workunit.client.0.smithi134.stdout:6/155: creat d17/d22/f2e x:0 0 0 2024-02-16T22:18:50.613 INFO:tasks.workunit.client.0.smithi134.stdout:3/149: dwrite da/d12/f20 [8388608,4194304] 0 2024-02-16T22:18:50.613 INFO:tasks.workunit.client.0.smithi134.stdout:3/150: chown da/d1c/f22 477215652 1 2024-02-16T22:18:50.616 INFO:tasks.workunit.client.0.smithi134.stdout:0/147: dwrite d2/f1c [4194304,4194304] 0 2024-02-16T22:18:50.616 INFO:tasks.workunit.client.0.smithi134.stdout:0/148: getdents d2/dc/d32 0 2024-02-16T22:18:50.616 INFO:tasks.workunit.client.0.smithi134.stdout:0/149: readlink d2/l24 0 2024-02-16T22:18:50.619 INFO:tasks.workunit.client.0.smithi134.stdout:2/116: write f1 [2510578,15662] 0 2024-02-16T22:18:50.621 INFO:tasks.workunit.client.0.smithi134.stdout:6/156: truncate f6 1169733 0 2024-02-16T22:18:50.622 INFO:tasks.workunit.client.0.smithi134.stdout:4/119: dread d0/d6/d8/de/f13 [0,4194304] 0 2024-02-16T22:18:50.627 INFO:tasks.workunit.client.0.smithi134.stdout:3/151: dread da/ff [4194304,4194304] 0 2024-02-16T22:18:50.628 INFO:tasks.workunit.client.0.smithi134.stdout:0/150: mkdir d2/dc/d32/d3b 0 2024-02-16T22:18:50.630 INFO:tasks.workunit.client.0.smithi134.stdout:7/147: read d2/d5/d19/f1d [1044612,20054] 0 2024-02-16T22:18:50.630 INFO:tasks.workunit.client.0.smithi134.stdout:1/180: dwrite f3 [0,4194304] 0 2024-02-16T22:18:50.631 INFO:tasks.workunit.client.0.smithi134.stdout:6/157: mknod d17/d22/c2f 0 2024-02-16T22:18:50.633 INFO:tasks.workunit.client.0.smithi134.stdout:4/120: mkdir d0/d6/d22/d25 0 2024-02-16T22:18:50.634 INFO:tasks.workunit.client.0.smithi134.stdout:3/152: write da/d12/f20 [8247853,113848] 0 2024-02-16T22:18:50.634 INFO:tasks.workunit.client.0.smithi134.stdout:3/153: chown da/d12 21721 1 2024-02-16T22:18:50.636 INFO:tasks.workunit.client.0.smithi134.stdout:6/158: mkdir d17/d27/d30 0 2024-02-16T22:18:50.637 INFO:tasks.workunit.client.0.smithi134.stdout:9/224: rmdir db 39 2024-02-16T22:18:50.637 INFO:tasks.workunit.client.0.smithi134.stdout:9/225: read - db/d20/d22/d46/f49 zero size 2024-02-16T22:18:50.637 INFO:tasks.workunit.client.0.smithi134.stdout:9/226: write db/dc/f15 [1216581,34117] 0 2024-02-16T22:18:50.637 INFO:tasks.workunit.client.0.smithi134.stdout:9/227: chown db/d20/d32/c3f 1830661083 1 2024-02-16T22:18:50.639 INFO:tasks.workunit.client.0.smithi134.stdout:7/148: getdents d2 0 2024-02-16T22:18:50.642 INFO:tasks.workunit.client.0.smithi134.stdout:6/159: symlink d17/d27/d30/l31 0 2024-02-16T22:18:50.642 INFO:tasks.workunit.client.0.smithi134.stdout:4/121: fsync d0/d6/f24 0 2024-02-16T22:18:50.643 INFO:tasks.workunit.client.0.smithi134.stdout:2/117: dwrite df/d10/d15/f1e [0,4194304] 0 2024-02-16T22:18:50.643 INFO:tasks.workunit.client.0.smithi134.stdout:2/118: dread - df/d10/d15/f16 zero size 2024-02-16T22:18:50.646 INFO:tasks.workunit.client.0.smithi134.stdout:7/149: dread d2/fb [0,4194304] 0 2024-02-16T22:18:50.646 INFO:tasks.workunit.client.0.smithi134.stdout:7/150: stat d2/d6 0 2024-02-16T22:18:50.646 INFO:tasks.workunit.client.0.smithi134.stdout:7/151: chown d2/d5/l9 54 1 2024-02-16T22:18:50.646 INFO:tasks.workunit.client.0.smithi134.stdout:7/152: creat d2/d5/d19/f30 x:0 0 0 2024-02-16T22:18:50.647 INFO:tasks.workunit.client.0.smithi134.stdout:9/228: symlink db/l4b 0 2024-02-16T22:18:50.647 INFO:tasks.workunit.client.0.smithi134.stdout:9/229: fsync db/d20/f39 0 2024-02-16T22:18:50.649 INFO:tasks.workunit.client.0.smithi134.stdout:6/160: dread f14 [0,4194304] 0 2024-02-16T22:18:50.650 INFO:tasks.workunit.client.0.smithi134.stdout:6/161: readlink d17/l1e 0 2024-02-16T22:18:50.650 INFO:tasks.workunit.client.0.smithi134.stdout:7/153: rename d2/d6/d12 to d2/d6/d17/d31 0 2024-02-16T22:18:50.651 INFO:tasks.workunit.client.0.smithi134.stdout:9/230: link db/dc/c1c db/dc/c4c 0 2024-02-16T22:18:50.652 INFO:tasks.workunit.client.0.smithi134.stdout:3/154: dwrite da/d12/f25 [0,4194304] 0 2024-02-16T22:18:50.653 INFO:tasks.workunit.client.0.smithi134.stdout:6/162: mkdir d17/d27/d30/d32 0 2024-02-16T22:18:50.653 INFO:tasks.workunit.client.0.smithi134.stdout:6/163: truncate d17/d22/f29 446568 0 2024-02-16T22:18:50.653 INFO:tasks.workunit.client.0.smithi134.stdout:6/164: write d17/f2d [153240,7189] 0 2024-02-16T22:18:50.655 INFO:tasks.workunit.client.0.smithi134.stdout:7/154: mknod d2/d5/d19/c32 0 2024-02-16T22:18:50.660 INFO:tasks.workunit.client.0.smithi134.stdout:6/165: creat d17/d27/d30/f33 x:0 0 0 2024-02-16T22:18:50.662 INFO:tasks.workunit.client.0.smithi134.stdout:3/155: unlink da/d12/f20 0 2024-02-16T22:18:50.662 INFO:tasks.workunit.client.0.smithi134.stdout:3/156: write da/d1c/f1e [5175610,45070] 0 2024-02-16T22:18:50.663 INFO:tasks.workunit.client.0.smithi134.stdout:5/163: sync 2024-02-16T22:18:50.663 INFO:tasks.workunit.client.0.smithi134.stdout:5/164: write d2/d9/dc/f21 [249379,72235] 0 2024-02-16T22:18:50.663 INFO:tasks.workunit.client.0.smithi134.stdout:5/165: chown d2/d9/l23 1081 1 2024-02-16T22:18:50.671 INFO:tasks.workunit.client.0.smithi134.stdout:5/166: dread d2/d9/dc/f13 [0,4194304] 0 2024-02-16T22:18:50.672 INFO:tasks.workunit.client.0.smithi134.stdout:2/119: dwrite f2 [0,4194304] 0 2024-02-16T22:18:50.672 INFO:tasks.workunit.client.0.smithi134.stdout:4/122: dwrite d0/d6/d8/de/f13 [0,4194304] 0 2024-02-16T22:18:50.673 INFO:tasks.workunit.client.0.smithi134.stdout:7/155: dwrite d2/d6/d17/f23 [0,4194304] 0 2024-02-16T22:18:50.674 INFO:tasks.workunit.client.0.smithi134.stdout:5/167: rename d2/d9/dc/d15/f29 to d2/f34 0 2024-02-16T22:18:50.683 INFO:tasks.workunit.client.0.smithi134.stdout:2/120: symlink df/d10/d11/l21 0 2024-02-16T22:18:50.685 INFO:tasks.workunit.client.0.smithi134.stdout:4/123: getdents d0/d6/d8 0 2024-02-16T22:18:50.689 INFO:tasks.workunit.client.0.smithi134.stdout:5/168: mkdir d2/d35 0 2024-02-16T22:18:50.689 INFO:tasks.workunit.client.0.smithi134.stdout:5/169: mkdir d2/d35/d36 0 2024-02-16T22:18:50.691 INFO:tasks.workunit.client.0.smithi134.stdout:7/156: dwrite d2/d5/d19/f2f [0,4194304] 0 2024-02-16T22:18:50.691 INFO:tasks.workunit.client.0.smithi134.stdout:7/157: stat d2/d6/d17/f14 0 2024-02-16T22:18:50.691 INFO:tasks.workunit.client.0.smithi134.stdout:6/166: truncate d17/d22/f29 422135 0 2024-02-16T22:18:50.691 INFO:tasks.workunit.client.0.smithi134.stdout:6/167: write f11 [1875845,13191] 0 2024-02-16T22:18:50.697 INFO:tasks.workunit.client.0.smithi134.stdout:2/121: dread f2 [0,4194304] 0 2024-02-16T22:18:50.697 INFO:tasks.workunit.client.0.smithi134.stdout:2/122: chown f1 15765 1 2024-02-16T22:18:50.697 INFO:tasks.workunit.client.0.smithi134.stdout:6/168: creat d17/d27/f34 x:0 0 0 2024-02-16T22:18:50.701 INFO:tasks.workunit.client.0.smithi134.stdout:2/123: truncate f2 6751399 0 2024-02-16T22:18:50.704 INFO:tasks.workunit.client.0.smithi134.stdout:2/124: link fb df/d10/d11/d17/d1b/f22 0 2024-02-16T22:18:50.705 INFO:tasks.workunit.client.0.smithi134.stdout:2/125: truncate df/d10/d15/f1d 3206998 0 2024-02-16T22:18:50.707 INFO:tasks.workunit.client.0.smithi134.stdout:2/126: creat df/d10/d11/d17/d1b/f23 x:0 0 0 2024-02-16T22:18:50.709 INFO:tasks.workunit.client.0.smithi134.stdout:2/127: mknod df/d10/d11/c24 0 2024-02-16T22:18:50.709 INFO:tasks.workunit.client.0.smithi134.stdout:2/128: write df/d10/d15/f16 [840622,12778] 0 2024-02-16T22:18:50.709 INFO:tasks.workunit.client.0.smithi134.stdout:2/129: chown df/d10/d11/c24 16233 1 2024-02-16T22:18:50.710 INFO:tasks.workunit.client.0.smithi134.stdout:2/130: fsync df/d10/d11/d17/f20 0 2024-02-16T22:18:50.710 INFO:tasks.workunit.client.0.smithi134.stdout:6/169: dread d17/f18 [0,4194304] 0 2024-02-16T22:18:50.710 INFO:tasks.workunit.client.0.smithi134.stdout:6/170: creat d17/d27/d30/f35 x:0 0 0 2024-02-16T22:18:50.710 INFO:tasks.workunit.client.0.smithi134.stdout:6/171: write f11 [2632176,94058] 0 2024-02-16T22:18:50.710 INFO:tasks.workunit.client.0.smithi134.stdout:6/172: stat d17/d22/d28/c2c 0 2024-02-16T22:18:50.710 INFO:tasks.workunit.client.0.smithi134.stdout:6/173: chown d17/l2a 103236 1 2024-02-16T22:18:50.711 INFO:tasks.workunit.client.0.smithi134.stdout:6/174: mkdir d17/d36 0 2024-02-16T22:18:50.711 INFO:tasks.workunit.client.0.smithi134.stdout:6/175: readlink d17/l20 0 2024-02-16T22:18:50.711 INFO:tasks.workunit.client.0.smithi134.stdout:6/176: dread d17/f21 [0,4194304] 0 2024-02-16T22:18:50.712 INFO:tasks.workunit.client.0.smithi134.stdout:6/177: symlink d17/d27/d30/d32/l37 0 2024-02-16T22:18:50.713 INFO:tasks.workunit.client.0.smithi134.stdout:6/178: read d17/f2d [2847,47320] 0 2024-02-16T22:18:50.713 INFO:tasks.workunit.client.0.smithi134.stdout:6/179: truncate d17/d27/d30/f35 447896 0 2024-02-16T22:18:50.713 INFO:tasks.workunit.client.0.smithi134.stdout:8/162: sync 2024-02-16T22:18:50.713 INFO:tasks.workunit.client.0.smithi134.stdout:8/163: write d2/df/d18/d2a/f2b [441387,32123] 0 2024-02-16T22:18:50.719 INFO:tasks.workunit.client.0.smithi134.stdout:5/170: dwrite d2/d9/dc/f13 [0,4194304] 0 2024-02-16T22:18:50.721 INFO:tasks.workunit.client.0.smithi134.stdout:4/124: dwrite d0/d6/d16/d1a/f21 [0,4194304] 0 2024-02-16T22:18:50.721 INFO:tasks.workunit.client.0.smithi134.stdout:4/125: chown d0/d6/d22/d25 987 1 2024-02-16T22:18:50.721 INFO:tasks.workunit.client.0.smithi134.stdout:4/126: write d0/d6/d16/d1a/f1d [817728,121431] 0 2024-02-16T22:18:50.721 INFO:tasks.workunit.client.0.smithi134.stdout:5/171: creat d2/d35/d36/f37 x:0 0 0 2024-02-16T22:18:50.722 INFO:tasks.workunit.client.0.smithi134.stdout:5/172: creat d2/d9/dc/f38 x:0 0 0 2024-02-16T22:18:50.722 INFO:tasks.workunit.client.0.smithi134.stdout:5/173: stat d2/c8 0 2024-02-16T22:18:50.722 INFO:tasks.workunit.client.0.smithi134.stdout:5/174: chown d2/d9 0 1 2024-02-16T22:18:50.724 INFO:tasks.workunit.client.0.smithi134.stdout:4/127: symlink d0/d6/d22/l26 0 2024-02-16T22:18:50.726 INFO:tasks.workunit.client.0.smithi134.stdout:4/128: link d0/d6/d16/d1a/f1d d0/d6/d1e/f27 0 2024-02-16T22:18:50.727 INFO:tasks.workunit.client.0.smithi134.stdout:4/129: rename d0/d6/d16/d1a/f21 to d0/d6/d16/f28 0 2024-02-16T22:18:50.728 INFO:tasks.workunit.client.0.smithi134.stdout:4/130: symlink d0/d6/d16/d1a/l29 0 2024-02-16T22:18:50.729 INFO:tasks.workunit.client.0.smithi134.stdout:4/131: mkdir d0/d6/d22/d25/d2a 0 2024-02-16T22:18:50.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:50 smithi173 ceph-mon[37280]: Standby manager daemon smithi173.kbofaa restarted 2024-02-16T22:18:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:50 smithi173 ceph-mon[37280]: Standby manager daemon smithi173.kbofaa started 2024-02-16T22:18:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:50 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/crt"}]: dispatch 2024-02-16T22:18:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:50 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-16T22:18:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:50 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/key"}]: dispatch 2024-02-16T22:18:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:50 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-16T22:18:50.731 INFO:tasks.workunit.client.0.smithi134.stdout:7/158: dwrite d2/d5/d19/f30 [0,4194304] 0 2024-02-16T22:18:50.739 INFO:tasks.workunit.client.0.smithi134.stdout:6/180: dwrite f6 [0,4194304] 0 2024-02-16T22:18:50.739 INFO:tasks.workunit.client.0.smithi134.stdout:5/175: dwrite d2/f2b [0,4194304] 0 2024-02-16T22:18:50.739 INFO:tasks.workunit.client.0.smithi134.stdout:5/176: write d2/d35/d36/f37 [882847,124960] 0 2024-02-16T22:18:50.739 INFO:tasks.workunit.client.0.smithi134.stdout:5/177: write d2/f4 [474852,102192] 0 2024-02-16T22:18:50.742 INFO:tasks.workunit.client.0.smithi134.stdout:5/178: rename d2/d9/f11 to d2/d9/dc/d15/d2f/d30/f39 0 2024-02-16T22:18:50.742 INFO:tasks.workunit.client.0.smithi134.stdout:5/179: creat d2/d9/dc/f3a x:0 0 0 2024-02-16T22:18:50.742 INFO:tasks.workunit.client.0.smithi134.stdout:5/180: creat d2/d9/dc/d15/f3b x:0 0 0 2024-02-16T22:18:50.742 INFO:tasks.workunit.client.0.smithi134.stdout:4/132: dread d0/d6/d1e/f27 [0,4194304] 0 2024-02-16T22:18:50.744 INFO:tasks.workunit.client.0.smithi134.stdout:4/133: write d0/f4 [4280207,114666] 0 2024-02-16T22:18:50.744 INFO:tasks.workunit.client.0.smithi134.stdout:4/134: write d0/d6/f24 [782113,18977] 0 2024-02-16T22:18:50.744 INFO:tasks.workunit.client.0.smithi134.stdout:5/181: unlink d2/d9/dc/d15/l20 0 2024-02-16T22:18:50.745 INFO:tasks.workunit.client.0.smithi134.stdout:5/182: mkdir d2/d9/dc/d15/d2f/d3c 0 2024-02-16T22:18:50.745 INFO:tasks.workunit.client.0.smithi134.stdout:5/183: write d2/f4 [2086161,11246] 0 2024-02-16T22:18:50.851 INFO:tasks.workunit.client.0.smithi134.stdout:2/131: dread df/f1f [0,4194304] 0 2024-02-16T22:18:50.851 INFO:tasks.workunit.client.0.smithi134.stdout:2/132: creat df/d10/d11/d17/d1b/f25 x:0 0 0 2024-02-16T22:18:50.859 INFO:tasks.workunit.client.0.smithi134.stdout:2/133: creat df/d10/d11/f26 x:0 0 0 2024-02-16T22:18:50.859 INFO:tasks.workunit.client.0.smithi134.stdout:2/134: fdatasync fb 0 2024-02-16T22:18:50.859 INFO:tasks.workunit.client.0.smithi134.stdout:2/135: write df/d10/d11/d17/d1b/f23 [684181,79699] 0 2024-02-16T22:18:50.859 INFO:tasks.workunit.client.0.smithi134.stdout:2/136: write df/d10/d11/f13 [1255293,12178] 0 2024-02-16T22:18:50.859 INFO:tasks.workunit.client.0.smithi134.stdout:2/137: chown df/d10/d11/l21 3 1 2024-02-16T22:18:50.859 INFO:tasks.workunit.client.0.smithi134.stdout:2/138: dread - df/d10/d11/d17/f20 zero size 2024-02-16T22:18:50.859 INFO:tasks.workunit.client.0.smithi134.stdout:2/139: fsync fb 0 2024-02-16T22:18:50.859 INFO:tasks.workunit.client.0.smithi134.stdout:6/181: getdents d17/d27/d30/d32 0 2024-02-16T22:18:50.863 INFO:tasks.workunit.client.0.smithi134.stdout:8/164: dread d2/df/d18/d2a/f2b [0,4194304] 0 2024-02-16T22:18:50.863 INFO:tasks.workunit.client.0.smithi134.stdout:6/182: dread d17/f2d [0,4194304] 0 2024-02-16T22:18:50.870 INFO:tasks.workunit.client.0.smithi134.stdout:5/184: getdents d2/d9/dc/d15 0 2024-02-16T22:18:50.871 INFO:tasks.workunit.client.0.smithi134.stdout:5/185: read - d2/d9/dc/d15/f3b zero size 2024-02-16T22:18:50.872 INFO:tasks.workunit.client.0.smithi134.stdout:5/186: truncate d2/f3 154755 0 2024-02-16T22:18:50.873 INFO:tasks.workunit.client.0.smithi134.stdout:5/187: mkdir d2/d35/d36/d3d 0 2024-02-16T22:18:50.875 INFO:tasks.workunit.client.0.smithi134.stdout:5/188: unlink d2/d9/dc/d15/f1a 0 2024-02-16T22:18:50.876 INFO:tasks.workunit.client.0.smithi134.stdout:6/183: dread d17/f1c [0,4194304] 0 2024-02-16T22:18:50.878 INFO:tasks.workunit.client.0.smithi134.stdout:6/184: truncate f12 184158 0 2024-02-16T22:18:50.878 INFO:tasks.workunit.client.0.smithi134.stdout:6/185: truncate d17/d27/d30/f33 753457 0 2024-02-16T22:18:50.889 INFO:tasks.workunit.client.0.smithi134.stdout:6/186: write f15 [4242806,775] 0 2024-02-16T22:18:50.889 INFO:tasks.workunit.client.0.smithi134.stdout:7/159: dwrite d2/fb [4194304,4194304] 0 2024-02-16T22:18:50.893 INFO:tasks.workunit.client.0.smithi134.stdout:4/135: dwrite d0/f4 [4194304,4194304] 0 2024-02-16T22:18:50.893 INFO:tasks.workunit.client.0.smithi134.stdout:2/140: dwrite df/d10/d11/d17/d1b/f22 [0,4194304] 0 2024-02-16T22:18:50.894 INFO:tasks.workunit.client.0.smithi134.stdout:7/160: symlink d2/d1e/l33 0 2024-02-16T22:18:50.894 INFO:tasks.workunit.client.0.smithi134.stdout:7/161: dread - d2/d1e/d24/f27 zero size 2024-02-16T22:18:50.895 INFO:tasks.workunit.client.0.smithi134.stdout:8/165: dwrite d2/df/d18/d12/f15 [0,4194304] 0 2024-02-16T22:18:50.895 INFO:tasks.workunit.client.0.smithi134.stdout:8/166: readlink d2/l1a 0 2024-02-16T22:18:50.895 INFO:tasks.workunit.client.0.smithi134.stdout:8/167: readlink d2/l17 0 2024-02-16T22:18:50.895 INFO:tasks.workunit.client.0.smithi134.stdout:8/168: write d2/df/d18/f6 [5117166,67276] 0 2024-02-16T22:18:50.896 INFO:tasks.workunit.client.0.smithi134.stdout:6/187: mknod d17/d36/c38 0 2024-02-16T22:18:50.901 INFO:tasks.workunit.client.0.smithi134.stdout:2/141: rename l9 to df/l27 0 2024-02-16T22:18:50.902 INFO:tasks.workunit.client.0.smithi134.stdout:7/162: symlink d2/d6/d17/d31/d28/l34 0 2024-02-16T22:18:50.903 INFO:tasks.workunit.client.0.smithi134.stdout:5/189: truncate d2/d9/dc/f1d 227371 0 2024-02-16T22:18:50.906 INFO:tasks.workunit.client.0.smithi134.stdout:8/169: dread d2/df/f10 [0,4194304] 0 2024-02-16T22:18:50.906 INFO:tasks.workunit.client.0.smithi134.stdout:8/170: creat d2/f35 x:0 0 0 2024-02-16T22:18:50.906 INFO:tasks.workunit.client.0.smithi134.stdout:8/171: chown d2/df/d18/f6 203 1 2024-02-16T22:18:50.907 INFO:tasks.workunit.client.0.smithi134.stdout:6/188: mkdir d17/d22/d39 0 2024-02-16T22:18:50.907 INFO:tasks.workunit.client.0.smithi134.stdout:6/189: write f10 [1221103,108600] 0 2024-02-16T22:18:50.908 INFO:tasks.workunit.client.0.smithi134.stdout:6/190: creat d17/f3a x:0 0 0 2024-02-16T22:18:50.908 INFO:tasks.workunit.client.0.smithi134.stdout:6/191: chown d17/l1e 60391271 1 2024-02-16T22:18:50.909 INFO:tasks.workunit.client.0.smithi134.stdout:5/190: mknod d2/d9/dc/d27/c3e 0 2024-02-16T22:18:50.911 INFO:tasks.workunit.client.0.smithi134.stdout:4/136: dwrite d0/d6/d1e/f27 [0,4194304] 0 2024-02-16T22:18:50.917 INFO:tasks.workunit.client.0.smithi134.stdout:6/192: link d17/d27/d30/f35 d17/d22/f3b 0 2024-02-16T22:18:50.922 INFO:tasks.workunit.client.0.smithi134.stdout:1/181: sync 2024-02-16T22:18:50.924 INFO:tasks.workunit.client.0.smithi134.stdout:3/157: sync 2024-02-16T22:18:50.924 INFO:tasks.workunit.client.0.smithi134.stdout:0/151: sync 2024-02-16T22:18:50.924 INFO:tasks.workunit.client.0.smithi134.stdout:9/231: sync 2024-02-16T22:18:50.925 INFO:tasks.workunit.client.0.smithi134.stdout:9/232: fdatasync f8 0 2024-02-16T22:18:50.925 INFO:tasks.workunit.client.0.smithi134.stdout:9/233: truncate db/d20/d22/f2f 1631996 0 2024-02-16T22:18:50.925 INFO:tasks.workunit.client.0.smithi134.stdout:7/163: write d2/d6/f21 [5144012,39193] 0 2024-02-16T22:18:50.925 INFO:tasks.workunit.client.0.smithi134.stdout:7/164: truncate d2/d1e/d24/f27 295956 0 2024-02-16T22:18:50.926 INFO:tasks.workunit.client.0.smithi134.stdout:1/182: truncate d5/d1a/f40 400303 0 2024-02-16T22:18:50.926 INFO:tasks.workunit.client.0.smithi134.stdout:1/183: readlink d5/d1a/l22 0 2024-02-16T22:18:50.927 INFO:tasks.workunit.client.0.smithi134.stdout:3/158: mknod da/d2b/c2e 0 2024-02-16T22:18:50.928 INFO:tasks.workunit.client.0.smithi134.stdout:9/234: symlink db/d20/l4d 0 2024-02-16T22:18:50.931 INFO:tasks.workunit.client.0.smithi134.stdout:1/184: mknod d5/da/d1c/c42 0 2024-02-16T22:18:50.931 INFO:tasks.workunit.client.0.smithi134.stdout:1/185: write f3 [5087978,1785] 0 2024-02-16T22:18:50.935 INFO:tasks.workunit.client.0.smithi134.stdout:9/235: mknod db/dc/c4e 0 2024-02-16T22:18:50.935 INFO:tasks.workunit.client.0.smithi134.stdout:7/165: rmdir d2/d5/d19 39 2024-02-16T22:18:50.936 INFO:tasks.workunit.client.0.smithi134.stdout:0/152: dread d2/f1f [0,4194304] 0 2024-02-16T22:18:50.936 INFO:tasks.workunit.client.0.smithi134.stdout:0/153: write d2/f33 [798613,16863] 0 2024-02-16T22:18:50.938 INFO:tasks.workunit.client.0.smithi134.stdout:7/166: link c1 d2/d5/d19/c35 0 2024-02-16T22:18:50.938 INFO:tasks.workunit.client.0.smithi134.stdout:9/236: dread db/d20/d22/f2f [0,4194304] 0 2024-02-16T22:18:50.938 INFO:tasks.workunit.client.0.smithi134.stdout:9/237: fsync db/d20/d22/f25 0 2024-02-16T22:18:50.939 INFO:tasks.workunit.client.0.smithi134.stdout:7/167: dread d2/d1e/d24/f27 [0,4194304] 0 2024-02-16T22:18:50.940 INFO:tasks.workunit.client.0.smithi134.stdout:9/238: symlink db/d20/d22/d46/l4f 0 2024-02-16T22:18:50.941 INFO:tasks.workunit.client.0.smithi134.stdout:7/168: creat d2/d6/d17/d31/d28/f36 x:0 0 0 2024-02-16T22:18:50.942 INFO:tasks.workunit.client.0.smithi134.stdout:9/239: dread db/f33 [0,4194304] 0 2024-02-16T22:18:50.942 INFO:tasks.workunit.client.0.smithi134.stdout:9/240: read db/dc/f16 [713904,42254] 0 2024-02-16T22:18:50.942 INFO:tasks.workunit.client.0.smithi134.stdout:9/241: write db/d20/f31 [797635,60762] 0 2024-02-16T22:18:50.954 INFO:tasks.workunit.client.0.smithi134.stdout:5/191: dwrite d2/d9/dc/d15/d2f/d30/f39 [0,4194304] 0 2024-02-16T22:18:50.954 INFO:tasks.workunit.client.0.smithi134.stdout:8/172: dwrite d2/df/d18/f6 [0,4194304] 0 2024-02-16T22:18:50.955 INFO:tasks.workunit.client.0.smithi134.stdout:8/173: chown d2/df/d18/c1e 330911 1 2024-02-16T22:18:50.956 INFO:tasks.workunit.client.0.smithi134.stdout:5/192: rename d2/c1e to d2/d9/dc/d32/c3f 0 2024-02-16T22:18:50.957 INFO:tasks.workunit.client.0.smithi134.stdout:8/174: link d2/df/d18/fc d2/f36 0 2024-02-16T22:18:50.961 INFO:tasks.workunit.client.0.smithi134.stdout:5/193: rename d2/d9/dc/d27/c2a to d2/d9/dc/d15/d2f/d3c/c40 0 2024-02-16T22:18:50.961 INFO:tasks.workunit.client.0.smithi134.stdout:5/194: write d2/fa [1206164,115060] 0 2024-02-16T22:18:50.962 INFO:tasks.workunit.client.0.smithi134.stdout:5/195: creat d2/d9/dc/d15/f41 x:0 0 0 2024-02-16T22:18:50.962 INFO:tasks.workunit.client.0.smithi134.stdout:5/196: stat d2/d9/dc/d15/d2f/d30/f39 0 2024-02-16T22:18:50.962 INFO:tasks.workunit.client.0.smithi134.stdout:6/193: dwrite d17/d27/f34 [0,4194304] 0 2024-02-16T22:18:50.962 INFO:tasks.workunit.client.0.smithi134.stdout:2/142: dwrite df/d10/d11/f13 [0,4194304] 0 2024-02-16T22:18:50.963 INFO:tasks.workunit.client.0.smithi134.stdout:2/143: readlink df/l12 0 2024-02-16T22:18:50.964 INFO:tasks.workunit.client.0.smithi134.stdout:5/197: rename d2/d9/dc/d15/d2f/d30/f39 to d2/d35/d36/d3d/f42 0 2024-02-16T22:18:50.964 INFO:tasks.workunit.client.0.smithi134.stdout:4/137: dwrite d0/d6/d16/f17 [4194304,4194304] 0 2024-02-16T22:18:50.964 INFO:tasks.workunit.client.0.smithi134.stdout:0/154: dwrite d2/f16 [0,4194304] 0 2024-02-16T22:18:50.966 INFO:tasks.workunit.client.0.smithi134.stdout:3/159: rename da/d2b to da/d2f 0 2024-02-16T22:18:50.973 INFO:tasks.workunit.client.0.smithi134.stdout:5/198: mknod d2/d9/dc/d27/c43 0 2024-02-16T22:18:50.973 INFO:tasks.workunit.client.0.smithi134.stdout:5/199: write d2/d9/dc/f38 [522407,124913] 0 2024-02-16T22:18:50.973 INFO:tasks.workunit.client.0.smithi134.stdout:9/242: dwrite db/dc/f14 [0,4194304] 0 2024-02-16T22:18:50.973 INFO:tasks.workunit.client.0.smithi134.stdout:4/138: rename d0/d6/d22/l26 to d0/d6/d22/d25/d2a/l2b 0 2024-02-16T22:18:50.976 INFO:tasks.workunit.client.0.smithi134.stdout:2/144: read df/d10/d11/d17/d1b/f22 [3882388,32191] 0 2024-02-16T22:18:50.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:50 smithi134 ceph-mon[28869]: Standby manager daemon smithi173.kbofaa restarted 2024-02-16T22:18:50.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:50 smithi134 ceph-mon[28869]: Standby manager daemon smithi173.kbofaa started 2024-02-16T22:18:50.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:50 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/crt"}]: dispatch 2024-02-16T22:18:50.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:50 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-16T22:18:50.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:50 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/key"}]: dispatch 2024-02-16T22:18:50.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:50 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-16T22:18:50.979 INFO:tasks.workunit.client.0.smithi134.stdout:9/243: creat db/d20/d22/f50 x:0 0 0 2024-02-16T22:18:50.980 INFO:tasks.workunit.client.0.smithi134.stdout:4/139: symlink d0/d6/d22/l2c 0 2024-02-16T22:18:50.981 INFO:tasks.workunit.client.0.smithi134.stdout:2/145: rename df/d10/d11/d17/d1b/f25 to df/d10/d15/f28 0 2024-02-16T22:18:50.981 INFO:tasks.workunit.client.0.smithi134.stdout:2/146: fsync df/d10/d15/f1d 0 2024-02-16T22:18:50.981 INFO:tasks.workunit.client.0.smithi134.stdout:2/147: fdatasync df/d10/d11/d17/f20 0 2024-02-16T22:18:50.981 INFO:tasks.workunit.client.0.smithi134.stdout:2/148: fsync df/d10/d11/d17/d1b/f23 0 2024-02-16T22:18:50.982 INFO:tasks.workunit.client.0.smithi134.stdout:2/149: chown df/c14 1 1 2024-02-16T22:18:50.982 INFO:tasks.workunit.client.0.smithi134.stdout:2/150: stat df/d10/d15 0 2024-02-16T22:18:50.982 INFO:tasks.workunit.client.0.smithi134.stdout:3/160: symlink da/l30 0 2024-02-16T22:18:50.983 INFO:tasks.workunit.client.0.smithi134.stdout:9/244: unlink db/d20/d22/c2a 0 2024-02-16T22:18:50.984 INFO:tasks.workunit.client.0.smithi134.stdout:3/161: mkdir da/d12/d31 0 2024-02-16T22:18:50.986 INFO:tasks.workunit.client.0.smithi134.stdout:4/140: getdents d0/d6 0 2024-02-16T22:18:50.987 INFO:tasks.workunit.client.0.smithi134.stdout:2/151: getdents df/d10/d11 0 2024-02-16T22:18:50.989 INFO:tasks.workunit.client.0.smithi134.stdout:3/162: truncate da/fc 3131560 0 2024-02-16T22:18:50.989 INFO:tasks.workunit.client.0.smithi134.stdout:6/194: dwrite d17/d22/f2e [0,4194304] 0 2024-02-16T22:18:50.990 INFO:tasks.workunit.client.0.smithi134.stdout:9/245: mkdir db/d20/d22/d51 0 2024-02-16T22:18:50.990 INFO:tasks.workunit.client.0.smithi134.stdout:0/155: dwrite d2/d20/f35 [0,4194304] 0 2024-02-16T22:18:50.990 INFO:tasks.workunit.client.0.smithi134.stdout:0/156: creat d2/f3c x:0 0 0 2024-02-16T22:18:50.991 INFO:tasks.workunit.client.0.smithi134.stdout:8/175: dwrite d2/df/d18/f6 [0,4194304] 0 2024-02-16T22:18:50.991 INFO:tasks.workunit.client.0.smithi134.stdout:8/176: chown d2/l17 24 1 2024-02-16T22:18:50.991 INFO:tasks.workunit.client.0.smithi134.stdout:4/141: creat d0/d6/d22/d25/f2d x:0 0 0 2024-02-16T22:18:50.992 INFO:tasks.workunit.client.0.smithi134.stdout:2/152: symlink df/d10/l29 0 2024-02-16T22:18:50.994 INFO:tasks.workunit.client.0.smithi134.stdout:6/195: dread f14 [0,4194304] 0 2024-02-16T22:18:50.994 INFO:tasks.workunit.client.0.smithi134.stdout:6/196: creat d17/d22/f3c x:0 0 0 2024-02-16T22:18:50.995 INFO:tasks.workunit.client.0.smithi134.stdout:3/163: unlink da/l28 0 2024-02-16T22:18:50.998 INFO:tasks.workunit.client.0.smithi134.stdout:3/164: write da/f19 [834996,129256] 0 2024-02-16T22:18:51.000 INFO:tasks.workunit.client.0.smithi134.stdout:9/246: mknod db/d20/d22/d51/c52 0 2024-02-16T22:18:51.000 INFO:tasks.workunit.client.0.smithi134.stdout:9/247: readlink db/l4b 0 2024-02-16T22:18:51.000 INFO:tasks.workunit.client.0.smithi134.stdout:9/248: dread - db/f43 zero size 2024-02-16T22:18:51.000 INFO:tasks.workunit.client.0.smithi134.stdout:9/249: truncate db/d20/d22/d46/f47 537839 0 2024-02-16T22:18:51.000 INFO:tasks.workunit.client.0.smithi134.stdout:9/250: write db/d20/d22/d46/f49 [898676,8708] 0 2024-02-16T22:18:51.001 INFO:tasks.workunit.client.0.smithi134.stdout:9/251: read db/dc/f14 [5075077,125021] 0 2024-02-16T22:18:51.003 INFO:tasks.workunit.client.0.smithi134.stdout:0/157: mknod d2/d20/c3d 0 2024-02-16T22:18:51.005 INFO:tasks.workunit.client.0.smithi134.stdout:8/177: rename d2/df/d18/ca to d2/df/d18/d2a/c37 0 2024-02-16T22:18:51.005 INFO:tasks.workunit.client.0.smithi134.stdout:8/178: stat d2/df/d18/d27 0 2024-02-16T22:18:51.005 INFO:tasks.workunit.client.0.smithi134.stdout:8/179: chown d2/f25 112385555 1 2024-02-16T22:18:51.006 INFO:tasks.workunit.client.0.smithi134.stdout:2/153: mknod df/d10/d11/c2a 0 2024-02-16T22:18:51.009 INFO:tasks.workunit.client.0.smithi134.stdout:3/165: creat da/d1c/f32 x:0 0 0 2024-02-16T22:18:51.009 INFO:tasks.workunit.client.0.smithi134.stdout:3/166: chown da/ff 2329 1 2024-02-16T22:18:51.009 INFO:tasks.workunit.client.0.smithi134.stdout:3/167: fsync da/d12/f21 0 2024-02-16T22:18:51.013 INFO:tasks.workunit.client.0.smithi134.stdout:4/142: rename d0/d6/d8/de/f13 to d0/d6/d22/d25/d2a/f2e 0 2024-02-16T22:18:51.015 INFO:tasks.workunit.client.0.smithi134.stdout:2/154: symlink df/d10/d11/d17/d1b/l2b 0 2024-02-16T22:18:51.015 INFO:tasks.workunit.client.0.smithi134.stdout:2/155: chown df/d10/d11/c1c 662578 1 2024-02-16T22:18:51.016 INFO:tasks.workunit.client.0.smithi134.stdout:9/252: symlink db/d20/d22/l53 0 2024-02-16T22:18:51.018 INFO:tasks.workunit.client.0.smithi134.stdout:8/180: rename d2/l22 to d2/df/l38 0 2024-02-16T22:18:51.020 INFO:tasks.workunit.client.0.smithi134.stdout:6/197: dwrite d17/d27/f34 [0,4194304] 0 2024-02-16T22:18:51.020 INFO:tasks.workunit.client.0.smithi134.stdout:6/198: dread - d17/f3a zero size 2024-02-16T22:18:51.020 INFO:tasks.workunit.client.0.smithi134.stdout:2/156: unlink f1 0 2024-02-16T22:18:51.021 INFO:tasks.workunit.client.0.smithi134.stdout:0/158: dwrite d2/f17 [0,4194304] 0 2024-02-16T22:18:51.021 INFO:tasks.workunit.client.0.smithi134.stdout:0/159: read - d2/dc/f2b zero size 2024-02-16T22:18:51.021 INFO:tasks.workunit.client.0.smithi134.stdout:0/160: dread - d2/dc/f1d zero size 2024-02-16T22:18:51.022 INFO:tasks.workunit.client.0.smithi134.stdout:9/253: creat db/dc/f54 x:0 0 0 2024-02-16T22:18:51.023 INFO:tasks.workunit.client.0.smithi134.stdout:5/200: dwrite d2/fa [4194304,4194304] 0 2024-02-16T22:18:51.023 INFO:tasks.workunit.client.0.smithi134.stdout:5/201: read - d2/d9/dc/fe zero size 2024-02-16T22:18:51.023 INFO:tasks.workunit.client.0.smithi134.stdout:6/199: mkdir d17/d27/d30/d3d 0 2024-02-16T22:18:51.031 INFO:tasks.workunit.client.0.smithi134.stdout:9/254: unlink db/d20/c41 0 2024-02-16T22:18:51.032 INFO:tasks.workunit.client.0.smithi134.stdout:5/202: symlink d2/d9/dc/d15/l44 0 2024-02-16T22:18:51.034 INFO:tasks.workunit.client.0.smithi134.stdout:6/200: mknod d17/d27/c3e 0 2024-02-16T22:18:51.034 INFO:tasks.workunit.client.0.smithi134.stdout:6/201: read d17/d22/f3b [280249,56580] 0 2024-02-16T22:18:51.036 INFO:tasks.workunit.client.0.smithi134.stdout:9/255: write db/f18 [535246,81656] 0 2024-02-16T22:18:51.036 INFO:tasks.workunit.client.0.smithi134.stdout:9/256: read db/dc/f14 [4317762,441] 0 2024-02-16T22:18:51.036 INFO:tasks.workunit.client.0.smithi134.stdout:9/257: read - db/dc/f38 zero size 2024-02-16T22:18:51.036 INFO:tasks.workunit.client.0.smithi134.stdout:9/258: write db/f33 [1009159,110628] 0 2024-02-16T22:18:51.037 INFO:tasks.workunit.client.0.smithi134.stdout:5/203: mknod d2/d9/dc/d15/d2f/c45 0 2024-02-16T22:18:51.038 INFO:tasks.workunit.client.0.smithi134.stdout:6/202: mknod d17/d27/d30/d32/c3f 0 2024-02-16T22:18:51.040 INFO:tasks.workunit.client.0.smithi134.stdout:9/259: mkdir db/d20/d55 0 2024-02-16T22:18:51.041 INFO:tasks.workunit.client.0.smithi134.stdout:5/204: mkdir d2/d35/d36/d46 0 2024-02-16T22:18:51.042 INFO:tasks.workunit.client.0.smithi134.stdout:6/203: rename d17/d27/d30/l31 to d17/d36/l40 0 2024-02-16T22:18:51.042 INFO:tasks.workunit.client.0.smithi134.stdout:6/204: truncate d17/d22/f25 5700777 0 2024-02-16T22:18:51.043 INFO:tasks.workunit.client.0.smithi134.stdout:3/168: dwrite da/ff [0,4194304] 0 2024-02-16T22:18:51.043 INFO:tasks.workunit.client.0.smithi134.stdout:5/205: unlink d2/f2e 0 2024-02-16T22:18:51.043 INFO:tasks.workunit.client.0.smithi134.stdout:5/206: readlink d2/d9/dc/l25 0 2024-02-16T22:18:51.044 INFO:tasks.workunit.client.0.smithi134.stdout:5/207: readlink d2/d9/ld 0 2024-02-16T22:18:51.044 INFO:tasks.workunit.client.0.smithi134.stdout:6/205: mknod d17/d27/d30/c41 0 2024-02-16T22:18:51.053 INFO:tasks.workunit.client.0.smithi134.stdout:4/143: dwrite d0/f4 [4194304,4194304] 0 2024-02-16T22:18:51.053 INFO:tasks.workunit.client.0.smithi134.stdout:3/169: symlink da/d12/d2a/l33 0 2024-02-16T22:18:51.054 INFO:tasks.workunit.client.0.smithi134.stdout:4/144: fdatasync d0/d6/d16/f28 0 2024-02-16T22:18:51.054 INFO:tasks.workunit.client.0.smithi134.stdout:2/157: dwrite fb [0,4194304] 0 2024-02-16T22:18:51.054 INFO:tasks.workunit.client.0.smithi134.stdout:8/181: dwrite d2/f36 [0,4194304] 0 2024-02-16T22:18:51.054 INFO:tasks.workunit.client.0.smithi134.stdout:2/158: chown ce 151 1 2024-02-16T22:18:51.054 INFO:tasks.workunit.client.0.smithi134.stdout:2/159: readlink df/l12 0 2024-02-16T22:18:51.054 INFO:tasks.workunit.client.0.smithi134.stdout:2/160: chown la 483189 1 2024-02-16T22:18:51.055 INFO:tasks.workunit.client.0.smithi134.stdout:3/170: rmdir da/d12/d31 0 2024-02-16T22:18:51.057 INFO:tasks.workunit.client.0.smithi134.stdout:4/145: mknod d0/d6/d22/d25/c2f 0 2024-02-16T22:18:51.059 INFO:tasks.workunit.client.0.smithi134.stdout:0/161: getdents d2 0 2024-02-16T22:18:51.059 INFO:tasks.workunit.client.0.smithi134.stdout:0/162: stat d2/f1f 0 2024-02-16T22:18:51.059 INFO:tasks.workunit.client.0.smithi134.stdout:0/163: chown d2/dc/f1d 993560 1 2024-02-16T22:18:51.062 INFO:tasks.workunit.client.0.smithi134.stdout:4/146: dread d0/d6/d8/fa [0,4194304] 0 2024-02-16T22:18:51.062 INFO:tasks.workunit.client.0.smithi134.stdout:4/147: fsync d0/d6/d16/d1a/f1d 0 2024-02-16T22:18:51.062 INFO:tasks.workunit.client.0.smithi134.stdout:4/148: chown d0/f2 71 1 2024-02-16T22:18:51.062 INFO:tasks.workunit.client.0.smithi134.stdout:2/161: symlink df/l2c 0 2024-02-16T22:18:51.063 INFO:tasks.workunit.client.0.smithi134.stdout:0/164: getdents d2/dc/d32 0 2024-02-16T22:18:51.063 INFO:tasks.workunit.client.0.smithi134.stdout:0/165: chown d2/f27 46532 1 2024-02-16T22:18:51.064 INFO:tasks.workunit.client.0.smithi134.stdout:4/149: mkdir d0/d6/d8/d30 0 2024-02-16T22:18:51.066 INFO:tasks.workunit.client.0.smithi134.stdout:2/162: mkdir df/d10/d11/d2d 0 2024-02-16T22:18:51.066 INFO:tasks.workunit.client.0.smithi134.stdout:2/163: creat df/d10/d15/f2e x:0 0 0 2024-02-16T22:18:51.066 INFO:tasks.workunit.client.0.smithi134.stdout:2/164: read df/d10/d11/d17/d1b/f23 [725432,119526] 0 2024-02-16T22:18:51.068 INFO:tasks.workunit.client.0.smithi134.stdout:8/182: dread d2/f36 [0,4194304] 0 2024-02-16T22:18:51.068 INFO:tasks.workunit.client.0.smithi134.stdout:8/183: truncate d2/f2c 5664045 0 2024-02-16T22:18:51.068 INFO:tasks.workunit.client.0.smithi134.stdout:0/166: mkdir d2/dc/d32/d3e 0 2024-02-16T22:18:51.068 INFO:tasks.workunit.client.0.smithi134.stdout:0/167: write d2/dc/f2b [448442,121922] 0 2024-02-16T22:18:51.070 INFO:tasks.workunit.client.0.smithi134.stdout:4/150: mkdir d0/d31 0 2024-02-16T22:18:51.070 INFO:tasks.workunit.client.0.smithi134.stdout:5/208: dwrite d2/d9/dc/f21 [0,4194304] 0 2024-02-16T22:18:51.071 INFO:tasks.workunit.client.0.smithi134.stdout:3/171: write da/fb [4341297,18179] 0 2024-02-16T22:18:51.072 INFO:tasks.workunit.client.0.smithi134.stdout:3/172: chown da/fb 34956 1 2024-02-16T22:18:51.072 INFO:tasks.workunit.client.0.smithi134.stdout:6/206: dwrite d17/d27/d30/f35 [0,4194304] 0 2024-02-16T22:18:51.074 INFO:tasks.workunit.client.0.smithi134.stdout:2/165: link df/d10/d11/d17/d1b/f23 df/d10/d11/d17/d1b/f2f 0 2024-02-16T22:18:51.074 INFO:tasks.workunit.client.0.smithi134.stdout:2/166: dread - df/d10/d11/f26 zero size 2024-02-16T22:18:51.074 INFO:tasks.workunit.client.0.smithi134.stdout:2/167: fdatasync df/d10/d11/d17/d1b/f2f 0 2024-02-16T22:18:51.075 INFO:tasks.workunit.client.0.smithi134.stdout:8/184: link d2/df/c2e d2/c39 0 2024-02-16T22:18:51.079 INFO:tasks.workunit.client.0.smithi134.stdout:4/151: mkdir d0/d6/d8/d32 0 2024-02-16T22:18:51.086 INFO:tasks.workunit.client.0.smithi134.stdout:3/173: link da/d12/c26 da/d1c/d24/d2c/c34 0 2024-02-16T22:18:51.090 INFO:tasks.workunit.client.0.smithi134.stdout:9/260: mkdir db/d20/d32/d56 0 2024-02-16T22:18:51.090 INFO:tasks.workunit.client.0.smithi134.stdout:9/261: chown db/dc/l4a 1199224 1 2024-02-16T22:18:51.092 INFO:tasks.workunit.client.0.smithi134.stdout:6/207: rename d17/f18 to d17/f42 0 2024-02-16T22:18:51.094 INFO:tasks.workunit.client.0.smithi134.stdout:8/185: dwrite d2/f25 [0,4194304] 0 2024-02-16T22:18:51.094 INFO:tasks.workunit.client.0.smithi134.stdout:8/186: truncate d2/df/d18/f6 5367984 0 2024-02-16T22:18:51.096 INFO:tasks.workunit.client.0.smithi134.stdout:0/168: mknod d2/dc/d32/c3f 0 2024-02-16T22:18:51.097 INFO:tasks.workunit.client.0.smithi134.stdout:4/152: creat d0/d6/d8/d32/f33 x:0 0 0 2024-02-16T22:18:51.097 INFO:tasks.workunit.client.0.smithi134.stdout:4/153: fdatasync d0/f2 0 2024-02-16T22:18:51.098 INFO:tasks.workunit.client.0.smithi134.stdout:3/174: unlink da/fc 0 2024-02-16T22:18:51.099 INFO:tasks.workunit.client.0.smithi134.stdout:9/262: creat db/f57 x:0 0 0 2024-02-16T22:18:51.103 INFO:tasks.workunit.client.0.smithi134.stdout:6/208: dread d17/d22/f3b [0,4194304] 0 2024-02-16T22:18:51.103 INFO:tasks.workunit.client.0.smithi134.stdout:6/209: truncate d17/f1c 4289566 0 2024-02-16T22:18:51.103 INFO:tasks.workunit.client.0.smithi134.stdout:6/210: chown d17/c1b 4385 1 2024-02-16T22:18:51.109 INFO:tasks.workunit.client.0.smithi134.stdout:0/169: truncate d2/f1f 1392022 0 2024-02-16T22:18:51.110 INFO:tasks.workunit.client.0.smithi134.stdout:4/154: link d0/d6/d22/l2c d0/d6/d16/d1a/l34 0 2024-02-16T22:18:51.111 INFO:tasks.workunit.client.0.smithi134.stdout:4/155: write d0/d6/d8/fa [1623950,121986] 0 2024-02-16T22:18:51.112 INFO:tasks.workunit.client.0.smithi134.stdout:9/263: unlink db/d20/f31 0 2024-02-16T22:18:51.114 INFO:tasks.workunit.client.0.smithi134.stdout:6/211: rmdir d17/d22/d39 0 2024-02-16T22:18:51.114 INFO:tasks.workunit.client.0.smithi134.stdout:6/212: write d17/d22/f29 [797034,104047] 0 2024-02-16T22:18:51.114 INFO:tasks.workunit.client.0.smithi134.stdout:6/213: fdatasync d17/f2d 0 2024-02-16T22:18:51.114 INFO:tasks.workunit.client.0.smithi134.stdout:6/214: fdatasync f12 0 2024-02-16T22:18:51.114 INFO:tasks.workunit.client.0.smithi134.stdout:6/215: write f14 [4953427,37945] 0 2024-02-16T22:18:51.120 INFO:tasks.workunit.client.0.smithi134.stdout:2/168: dwrite df/d10/d11/f13 [0,4194304] 0 2024-02-16T22:18:51.120 INFO:tasks.workunit.client.0.smithi134.stdout:2/169: chown cc 1411 1 2024-02-16T22:18:51.120 INFO:tasks.workunit.client.0.smithi134.stdout:3/175: dwrite da/d1c/f32 [0,4194304] 0 2024-02-16T22:18:51.121 INFO:tasks.workunit.client.0.smithi134.stdout:4/156: mknod d0/d6/d22/d25/d2a/c35 0 2024-02-16T22:18:51.121 INFO:tasks.workunit.client.0.smithi134.stdout:4/157: truncate d0/d6/d16/d1a/f1b 64053 0 2024-02-16T22:18:51.124 INFO:tasks.workunit.client.0.smithi134.stdout:6/216: link d17/f3a d17/d27/d30/d32/f43 0 2024-02-16T22:18:51.125 INFO:tasks.workunit.client.0.smithi134.stdout:0/170: rmdir d2/dc/d32/d3b 0 2024-02-16T22:18:51.127 INFO:tasks.workunit.client.0.smithi134.stdout:8/187: rmdir d2/df 39 2024-02-16T22:18:51.129 INFO:tasks.workunit.client.0.smithi134.stdout:3/176: rmdir da/d2f 39 2024-02-16T22:18:51.132 INFO:tasks.workunit.client.0.smithi134.stdout:4/158: rename d0/d6/d8/lf to d0/d6/d22/d25/d2a/l36 0 2024-02-16T22:18:51.132 INFO:tasks.workunit.client.0.smithi134.stdout:4/159: fsync d0/d6/d22/d25/d2a/f2e 0 2024-02-16T22:18:51.132 INFO:tasks.workunit.client.0.smithi134.stdout:6/217: mkdir d17/d22/d44 0 2024-02-16T22:18:51.134 INFO:tasks.workunit.client.0.smithi134.stdout:3/177: symlink da/d12/d2a/l35 0 2024-02-16T22:18:51.135 INFO:tasks.workunit.client.0.smithi134.stdout:6/218: mknod d17/d36/c45 0 2024-02-16T22:18:51.137 INFO:tasks.workunit.client.0.smithi134.stdout:3/178: symlink da/d12/d2a/l36 0 2024-02-16T22:18:51.137 INFO:tasks.workunit.client.0.smithi134.stdout:3/179: truncate da/d12/f25 4722351 0 2024-02-16T22:18:51.137 INFO:tasks.workunit.client.0.smithi134.stdout:3/180: chown da/d2f 411 1 2024-02-16T22:18:51.138 INFO:tasks.workunit.client.0.smithi134.stdout:0/171: dread d2/dc/f1e [0,4194304] 0 2024-02-16T22:18:51.138 INFO:tasks.workunit.client.0.smithi134.stdout:6/219: rename d17/d27/d30/d3d to d17/d27/d30/d46 0 2024-02-16T22:18:51.140 INFO:tasks.workunit.client.0.smithi134.stdout:8/188: write f0 [1415222,94129] 0 2024-02-16T22:18:51.140 INFO:tasks.workunit.client.0.smithi134.stdout:8/189: write d2/df/d18/f5 [2839440,118746] 0 2024-02-16T22:18:51.140 INFO:tasks.workunit.client.0.smithi134.stdout:8/190: fsync d2/f36 0 2024-02-16T22:18:51.141 INFO:tasks.workunit.client.0.smithi134.stdout:1/186: sync 2024-02-16T22:18:51.141 INFO:tasks.workunit.client.0.smithi134.stdout:7/169: sync 2024-02-16T22:18:51.141 INFO:tasks.workunit.client.0.smithi134.stdout:1/187: truncate d5/da/d1c/f29 4234436 0 2024-02-16T22:18:51.141 INFO:tasks.workunit.client.0.smithi134.stdout:2/170: dwrite df/d10/d11/d17/d1b/f2f [0,4194304] 0 2024-02-16T22:18:51.142 INFO:tasks.workunit.client.0.smithi134.stdout:0/172: creat d2/f40 x:0 0 0 2024-02-16T22:18:51.142 INFO:tasks.workunit.client.0.smithi134.stdout:0/173: write d2/f3c [278035,113928] 0 2024-02-16T22:18:51.142 INFO:tasks.workunit.client.0.smithi134.stdout:0/174: write d2/f16 [5015845,45826] 0 2024-02-16T22:18:51.144 INFO:tasks.workunit.client.0.smithi134.stdout:3/181: symlink da/l37 0 2024-02-16T22:18:51.144 INFO:tasks.workunit.client.0.smithi134.stdout:3/182: write da/d1c/d24/f27 [551052,91728] 0 2024-02-16T22:18:51.144 INFO:tasks.workunit.client.0.smithi134.stdout:3/183: chown da/d12/c13 21596863 1 2024-02-16T22:18:51.144 INFO:tasks.workunit.client.0.smithi134.stdout:3/184: stat da/l30 0 2024-02-16T22:18:51.144 INFO:tasks.workunit.client.0.smithi134.stdout:9/264: dwrite db/dc/f17 [0,4194304] 0 2024-02-16T22:18:51.144 INFO:tasks.workunit.client.0.smithi134.stdout:4/160: dread d0/d6/d16/f17 [4194304,4194304] 0 2024-02-16T22:18:51.148 INFO:tasks.workunit.client.0.smithi134.stdout:8/191: rmdir d2/df/d21 0 2024-02-16T22:18:51.148 INFO:tasks.workunit.client.0.smithi134.stdout:6/220: dread f14 [0,4194304] 0 2024-02-16T22:18:51.148 INFO:tasks.workunit.client.0.smithi134.stdout:6/221: readlink d17/l1e 0 2024-02-16T22:18:51.148 INFO:tasks.workunit.client.0.smithi134.stdout:6/222: creat d17/d22/f47 x:0 0 0 2024-02-16T22:18:51.150 INFO:tasks.workunit.client.0.smithi134.stdout:7/170: unlink d2/d7/c29 0 2024-02-16T22:18:51.153 INFO:tasks.workunit.client.0.smithi134.stdout:2/171: truncate f2 6454732 0 2024-02-16T22:18:51.155 INFO:tasks.workunit.client.0.smithi134.stdout:3/185: creat da/d12/d2a/f38 x:0 0 0 2024-02-16T22:18:51.159 INFO:tasks.workunit.client.0.smithi134.stdout:9/265: creat db/d20/d22/f58 x:0 0 0 2024-02-16T22:18:51.160 INFO:tasks.workunit.client.0.smithi134.stdout:8/192: dread f1 [0,4194304] 0 2024-02-16T22:18:51.162 INFO:tasks.workunit.client.0.smithi134.stdout:4/161: symlink d0/d6/d1e/l37 0 2024-02-16T22:18:51.162 INFO:tasks.workunit.client.0.smithi134.stdout:4/162: readlink d0/d6/d22/l2c 0 2024-02-16T22:18:51.162 INFO:tasks.workunit.client.0.smithi134.stdout:4/163: creat d0/d6/d8/d32/f38 x:0 0 0 2024-02-16T22:18:51.165 INFO:tasks.workunit.client.0.smithi134.stdout:7/171: symlink d2/d1e/l37 0 2024-02-16T22:18:51.166 INFO:tasks.workunit.client.0.smithi134.stdout:2/172: dread df/d10/d11/d17/d1b/f22 [0,4194304] 0 2024-02-16T22:18:51.167 INFO:tasks.workunit.client.0.smithi134.stdout:2/173: write df/d10/d11/f26 [212930,69146] 0 2024-02-16T22:18:51.167 INFO:tasks.workunit.client.0.smithi134.stdout:2/174: getdents df/d10/d11/d2d 0 2024-02-16T22:18:51.167 INFO:tasks.workunit.client.0.smithi134.stdout:2/175: chown df/f1f 4214 1 2024-02-16T22:18:51.168 INFO:tasks.workunit.client.0.smithi134.stdout:7/172: mkdir d2/d5/d22/d26/d38 0 2024-02-16T22:18:51.170 INFO:tasks.workunit.client.0.smithi134.stdout:9/266: rmdir db/d20/d32/d56 0 2024-02-16T22:18:51.171 INFO:tasks.workunit.client.0.smithi134.stdout:1/188: dwrite d5/d1a/d23/f27 [0,4194304] 0 2024-02-16T22:18:51.171 INFO:tasks.workunit.client.0.smithi134.stdout:1/189: chown d5/da/d2d/f34 23246824 1 2024-02-16T22:18:51.172 INFO:tasks.workunit.client.0.smithi134.stdout:7/173: creat d2/d1e/f39 x:0 0 0 2024-02-16T22:18:51.172 INFO:tasks.workunit.client.0.smithi134.stdout:7/174: chown d2/d6/d17/d31/d28 719 1 2024-02-16T22:18:51.172 INFO:tasks.workunit.client.0.smithi134.stdout:2/176: dread fb [0,4194304] 0 2024-02-16T22:18:51.173 INFO:tasks.workunit.client.0.smithi134.stdout:1/190: getdents d5/da 0 2024-02-16T22:18:51.174 INFO:tasks.workunit.client.0.smithi134.stdout:7/175: rmdir d2/d6/d17/d31 39 2024-02-16T22:18:51.177 INFO:tasks.workunit.client.0.smithi134.stdout:2/177: mkdir df/d10/d30 0 2024-02-16T22:18:51.177 INFO:tasks.workunit.client.0.smithi134.stdout:2/178: truncate df/d10/d11/d17/d1b/f2f 5210644 0 2024-02-16T22:18:51.179 INFO:tasks.workunit.client.0.smithi134.stdout:7/176: creat d2/d7/f3a x:0 0 0 2024-02-16T22:18:51.179 INFO:tasks.workunit.client.0.smithi134.stdout:7/177: write d2/d6/d17/f2e [3099699,120136] 0 2024-02-16T22:18:51.181 INFO:tasks.workunit.client.0.smithi134.stdout:7/178: mknod d2/d5/d22/d26/c3b 0 2024-02-16T22:18:51.181 INFO:tasks.workunit.client.0.smithi134.stdout:7/179: truncate d2/d5/d19/f1d 4593578 0 2024-02-16T22:18:51.181 INFO:tasks.workunit.client.0.smithi134.stdout:7/180: creat d2/d1e/d24/f3c x:0 0 0 2024-02-16T22:18:51.181 INFO:tasks.workunit.client.0.smithi134.stdout:6/223: dwrite d17/f21 [0,4194304] 0 2024-02-16T22:18:51.187 INFO:tasks.workunit.client.0.smithi134.stdout:6/224: rename cf to d17/d27/d30/c48 0 2024-02-16T22:18:51.187 INFO:tasks.workunit.client.0.smithi134.stdout:6/225: dread - d17/d22/f47 zero size 2024-02-16T22:18:51.190 INFO:tasks.workunit.client.0.smithi134.stdout:6/226: link d17/d22/f25 d17/d22/d28/f49 0 2024-02-16T22:18:51.191 INFO:tasks.workunit.client.0.smithi134.stdout:0/175: dwrite d2/f16 [0,4194304] 0 2024-02-16T22:18:51.191 INFO:tasks.workunit.client.0.smithi134.stdout:6/227: rmdir d17/d36 39 2024-02-16T22:18:51.194 INFO:tasks.workunit.client.0.smithi134.stdout:6/228: creat d17/d22/d44/f4a x:0 0 0 2024-02-16T22:18:51.196 INFO:tasks.workunit.client.0.smithi134.stdout:3/186: dwrite da/d1c/f1e [0,4194304] 0 2024-02-16T22:18:51.197 INFO:tasks.workunit.client.0.smithi134.stdout:4/164: dwrite d0/d6/d22/d25/d2a/f2e [0,4194304] 0 2024-02-16T22:18:51.198 INFO:tasks.workunit.client.0.smithi134.stdout:8/193: dwrite d2/df/d18/d27/f30 [0,4194304] 0 2024-02-16T22:18:51.198 INFO:tasks.workunit.client.0.smithi134.stdout:8/194: chown d2/df/c2e 1235 1 2024-02-16T22:18:51.199 INFO:tasks.workunit.client.0.smithi134.stdout:3/187: creat da/d1c/d24/d2c/f39 x:0 0 0 2024-02-16T22:18:51.199 INFO:tasks.workunit.client.0.smithi134.stdout:4/165: mkdir d0/d6/d1e/d39 0 2024-02-16T22:18:51.205 INFO:tasks.workunit.client.0.smithi134.stdout:0/176: dread d2/f3c [0,4194304] 0 2024-02-16T22:18:51.205 INFO:tasks.workunit.client.0.smithi134.stdout:0/177: creat d2/d20/f41 x:0 0 0 2024-02-16T22:18:51.205 INFO:tasks.workunit.client.0.smithi134.stdout:9/267: dwrite db/d20/d22/d46/f49 [0,4194304] 0 2024-02-16T22:18:51.209 INFO:tasks.workunit.client.0.smithi134.stdout:4/166: dread d0/f15 [0,4194304] 0 2024-02-16T22:18:51.212 INFO:tasks.workunit.client.0.smithi134.stdout:7/181: dread d2/d6/d17/f2e [0,4194304] 0 2024-02-16T22:18:51.215 INFO:tasks.workunit.client.0.smithi134.stdout:2/179: dwrite df/f1f [0,4194304] 0 2024-02-16T22:18:51.215 INFO:tasks.workunit.client.0.smithi134.stdout:3/188: dread da/fb [4194304,4194304] 0 2024-02-16T22:18:51.222 INFO:tasks.workunit.client.0.smithi134.stdout:2/180: symlink df/d10/l31 0 2024-02-16T22:18:51.227 INFO:tasks.workunit.client.0.smithi134.stdout:0/178: rename d2/f3c to d2/dc/d32/f42 0 2024-02-16T22:18:51.227 INFO:tasks.workunit.client.0.smithi134.stdout:4/167: rename d0 to d0/d6/d3a 22 2024-02-16T22:18:51.227 INFO:tasks.workunit.client.0.smithi134.stdout:0/179: chown d2/dc/l1b 3 1 2024-02-16T22:18:51.227 INFO:tasks.workunit.client.0.smithi134.stdout:0/180: chown d2/f11 251038232 1 2024-02-16T22:18:51.227 INFO:tasks.workunit.client.0.smithi134.stdout:0/181: fdatasync d2/dc/f15 0 2024-02-16T22:18:51.227 INFO:tasks.workunit.client.0.smithi134.stdout:9/268: dwrite db/f33 [0,4194304] 0 2024-02-16T22:18:51.227 INFO:tasks.workunit.client.0.smithi134.stdout:0/182: write d2/d20/f29 [370160,124497] 0 2024-02-16T22:18:51.231 INFO:tasks.workunit.client.0.smithi134.stdout:9/269: symlink db/d20/d22/d46/l59 0 2024-02-16T22:18:51.233 INFO:tasks.workunit.client.0.smithi134.stdout:4/168: dread d0/f2 [4194304,4194304] 0 2024-02-16T22:18:51.234 INFO:tasks.workunit.client.0.smithi134.stdout:9/270: mkdir db/dc/d5a 0 2024-02-16T22:18:51.234 INFO:tasks.workunit.client.0.smithi134.stdout:0/183: dread d2/dc/f28 [0,4194304] 0 2024-02-16T22:18:51.234 INFO:tasks.workunit.client.0.smithi134.stdout:4/169: dread d0/d6/d16/d1a/f1b [0,4194304] 0 2024-02-16T22:18:51.234 INFO:tasks.workunit.client.0.smithi134.stdout:6/229: dwrite d17/d22/f29 [0,4194304] 0 2024-02-16T22:18:51.234 INFO:tasks.workunit.client.0.smithi134.stdout:6/230: creat d17/d22/f4b x:0 0 0 2024-02-16T22:18:51.236 INFO:tasks.workunit.client.0.smithi134.stdout:0/184: mknod d2/d20/c43 0 2024-02-16T22:18:51.237 INFO:tasks.workunit.client.0.smithi134.stdout:4/170: mkdir d0/d6/d1e/d3b 0 2024-02-16T22:18:51.237 INFO:tasks.workunit.client.0.smithi134.stdout:4/171: chown d0/d6/d16/f20 0 1 2024-02-16T22:18:51.237 INFO:tasks.workunit.client.0.smithi134.stdout:4/172: stat d0 0 2024-02-16T22:18:51.239 INFO:tasks.workunit.client.0.smithi134.stdout:8/195: dwrite d2/df/d18/d2a/f2b [0,4194304] 0 2024-02-16T22:18:51.240 INFO:tasks.workunit.client.0.smithi134.stdout:0/185: read d2/dc/f1e [3024824,67710] 0 2024-02-16T22:18:51.241 INFO:tasks.workunit.client.0.smithi134.stdout:9/271: rename db/d20/d32/l42 to db/d20/d22/d51/l5b 0 2024-02-16T22:18:51.241 INFO:tasks.workunit.client.0.smithi134.stdout:9/272: getdents db/d20/d55 0 2024-02-16T22:18:51.242 INFO:tasks.workunit.client.0.smithi134.stdout:4/173: truncate d0/d6/d16/d1a/f1d 1104172 0 2024-02-16T22:18:51.250 INFO:tasks.workunit.client.0.smithi134.stdout:8/196: mknod d2/c3a 0 2024-02-16T22:18:51.250 INFO:tasks.workunit.client.0.smithi134.stdout:7/182: dwrite d2/d5/d19/f2f [0,4194304] 0 2024-02-16T22:18:51.250 INFO:tasks.workunit.client.0.smithi134.stdout:7/183: chown d2/d5/d19/f2b 1667 1 2024-02-16T22:18:51.250 INFO:tasks.workunit.client.0.smithi134.stdout:7/184: stat d2/d6/l20 0 2024-02-16T22:18:51.250 INFO:tasks.workunit.client.0.smithi134.stdout:7/185: write d2/f1a [5097412,68426] 0 2024-02-16T22:18:51.252 INFO:tasks.workunit.client.0.smithi134.stdout:4/174: rename d0/d6/d22/d25/c2f to d0/d6/d8/d30/c3c 0 2024-02-16T22:18:51.252 INFO:tasks.workunit.client.0.smithi134.stdout:4/175: creat d0/d6/d22/d25/f3d x:0 0 0 2024-02-16T22:18:51.254 INFO:tasks.workunit.client.0.smithi134.stdout:8/197: rename f1 to d2/df/f3b 0 2024-02-16T22:18:51.256 INFO:tasks.workunit.client.0.smithi134.stdout:4/176: truncate d0/f11 736561 0 2024-02-16T22:18:51.258 INFO:tasks.workunit.client.0.smithi134.stdout:8/198: mknod d2/df/d18/d2a/c3c 0 2024-02-16T22:18:51.258 INFO:tasks.workunit.client.0.smithi134.stdout:8/199: write d2/f24 [317435,46839] 0 2024-02-16T22:18:51.260 INFO:tasks.workunit.client.0.smithi134.stdout:8/200: mkdir d2/df/d18/d12/d3d 0 2024-02-16T22:18:51.261 INFO:tasks.workunit.client.0.smithi134.stdout:3/189: dwrite da/f11 [4194304,4194304] 0 2024-02-16T22:18:51.264 INFO:tasks.workunit.client.0.smithi134.stdout:8/201: symlink d2/df/d19/l3e 0 2024-02-16T22:18:51.265 INFO:tasks.workunit.client.0.smithi134.stdout:3/190: rename da/d1c/d24/d2c/f39 to da/f3a 0 2024-02-16T22:18:51.266 INFO:tasks.workunit.client.0.smithi134.stdout:3/191: truncate da/d12/f17 398811 0 2024-02-16T22:18:51.326 INFO:tasks.workunit.client.0.smithi134.stdout:2/181: dwrite df/d10/d11/f26 [0,4194304] 0 2024-02-16T22:18:51.326 INFO:tasks.workunit.client.0.smithi134.stdout:2/182: chown df/f1f 1859731 1 2024-02-16T22:18:51.326 INFO:tasks.workunit.client.0.smithi134.stdout:2/183: truncate df/d10/d15/f16 1532073 0 2024-02-16T22:18:51.326 INFO:tasks.workunit.client.0.smithi134.stdout:6/231: dwrite d17/f3a [0,4194304] 0 2024-02-16T22:18:51.328 INFO:tasks.workunit.client.0.smithi134.stdout:0/186: dwrite d2/dc/d32/f42 [0,4194304] 0 2024-02-16T22:18:51.328 INFO:tasks.workunit.client.0.smithi134.stdout:0/187: creat d2/dc/f44 x:0 0 0 2024-02-16T22:18:51.333 INFO:tasks.workunit.client.0.smithi134.stdout:2/184: mknod df/d10/d11/d17/d1b/c32 0 2024-02-16T22:18:51.335 INFO:tasks.workunit.client.0.smithi134.stdout:6/232: dread d17/f3a [0,4194304] 0 2024-02-16T22:18:51.338 INFO:tasks.workunit.client.0.smithi134.stdout:7/186: dwrite d2/d6/f21 [0,4194304] 0 2024-02-16T22:18:51.338 INFO:tasks.workunit.client.0.smithi134.stdout:7/187: write d2/fb [4738423,53347] 0 2024-02-16T22:18:51.341 INFO:tasks.workunit.client.0.smithi134.stdout:2/185: symlink df/d10/d11/l33 0 2024-02-16T22:18:51.343 INFO:tasks.workunit.client.0.smithi134.stdout:7/188: mkdir d2/d6/d17/d3d 0 2024-02-16T22:18:51.343 INFO:tasks.workunit.client.0.smithi134.stdout:7/189: creat d2/d7/f3e x:0 0 0 2024-02-16T22:18:51.343 INFO:tasks.workunit.client.0.smithi134.stdout:7/190: truncate d2/d1e/d24/f3c 708852 0 2024-02-16T22:18:51.344 INFO:tasks.workunit.client.0.smithi134.stdout:0/188: mkdir d2/dc/d32/d45 0 2024-02-16T22:18:51.344 INFO:tasks.workunit.client.0.smithi134.stdout:0/189: stat d2/dc/ff 0 2024-02-16T22:18:51.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/209: sync 2024-02-16T22:18:51.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/210: chown d2/f4 3 1 2024-02-16T22:18:51.344 INFO:tasks.workunit.client.0.smithi134.stdout:3/192: dwrite da/d1c/d24/f27 [0,4194304] 0 2024-02-16T22:18:51.346 INFO:tasks.workunit.client.0.smithi134.stdout:5/211: symlink d2/d35/d36/d46/l47 0 2024-02-16T22:18:51.346 INFO:tasks.workunit.client.0.smithi134.stdout:5/212: dread - d2/f18 zero size 2024-02-16T22:18:51.346 INFO:tasks.workunit.client.0.smithi134.stdout:5/213: stat d2/d9/dc/d15/f3b 0 2024-02-16T22:18:51.346 INFO:tasks.workunit.client.0.smithi134.stdout:5/214: fsync d2/d9/dc/f1d 0 2024-02-16T22:18:51.351 INFO:tasks.workunit.client.0.smithi134.stdout:4/177: rmdir d0 39 2024-02-16T22:18:51.351 INFO:tasks.workunit.client.0.smithi134.stdout:4/178: read d0/f15 [1914718,69295] 0 2024-02-16T22:18:51.354 INFO:tasks.workunit.client.0.smithi134.stdout:3/193: getdents da/d12/d2a 0 2024-02-16T22:18:51.355 INFO:tasks.workunit.client.0.smithi134.stdout:3/194: chown c3 11384 1 2024-02-16T22:18:51.355 INFO:tasks.workunit.client.0.smithi134.stdout:3/195: write da/f3a [356494,92683] 0 2024-02-16T22:18:51.355 INFO:tasks.workunit.client.0.smithi134.stdout:3/196: stat da/f3a 0 2024-02-16T22:18:51.355 INFO:tasks.workunit.client.0.smithi134.stdout:3/197: readlink da/l18 0 2024-02-16T22:18:51.355 INFO:tasks.workunit.client.0.smithi134.stdout:3/198: write da/f19 [1678411,112878] 0 2024-02-16T22:18:51.357 INFO:tasks.workunit.client.0.smithi134.stdout:5/215: dread d2/d9/dc/f21 [0,4194304] 0 2024-02-16T22:18:51.358 INFO:tasks.workunit.client.0.smithi134.stdout:3/199: link da/d1c/f32 da/d2f/f3b 0 2024-02-16T22:18:51.359 INFO:tasks.workunit.client.0.smithi134.stdout:5/216: rename d2/d9/dc/d32/c3f to d2/d9/dc/d32/c48 0 2024-02-16T22:18:51.372 INFO:tasks.workunit.client.0.smithi134.stdout:1/191: sync 2024-02-16T22:18:51.403 INFO:tasks.workunit.client.0.smithi134.stdout:0/190: dwrite d2/dc/f2b [0,4194304] 0 2024-02-16T22:18:51.403 INFO:tasks.workunit.client.0.smithi134.stdout:6/233: dwrite f14 [4194304,4194304] 0 2024-02-16T22:18:51.403 INFO:tasks.workunit.client.0.smithi134.stdout:7/191: dwrite d2/d1e/d24/f3c [0,4194304] 0 2024-02-16T22:18:51.404 INFO:tasks.workunit.client.0.smithi134.stdout:5/217: dwrite d2/d9/dc/f24 [0,4194304] 0 2024-02-16T22:18:51.404 INFO:tasks.workunit.client.0.smithi134.stdout:5/218: write d2/f34 [1032227,55965] 0 2024-02-16T22:18:51.404 INFO:tasks.workunit.client.0.smithi134.stdout:1/192: dwrite d5/da/f14 [0,4194304] 0 2024-02-16T22:18:51.407 INFO:tasks.workunit.client.0.smithi134.stdout:3/200: dwrite da/d1c/f22 [0,4194304] 0 2024-02-16T22:18:51.407 INFO:tasks.workunit.client.0.smithi134.stdout:3/201: truncate da/f3a 767504 0 2024-02-16T22:18:51.407 INFO:tasks.workunit.client.0.smithi134.stdout:3/202: stat da/f3a 0 2024-02-16T22:18:51.407 INFO:tasks.workunit.client.0.smithi134.stdout:3/203: truncate da/d12/d2a/f38 699846 0 2024-02-16T22:18:51.407 INFO:tasks.workunit.client.0.smithi134.stdout:4/179: dwrite d0/d6/d16/f28 [0,4194304] 0 2024-02-16T22:18:51.409 INFO:tasks.workunit.client.0.smithi134.stdout:6/234: rename fa to d17/f4c 0 2024-02-16T22:18:51.414 INFO:tasks.workunit.client.0.smithi134.stdout:0/191: read d2/dc/d32/f42 [2190107,61513] 0 2024-02-16T22:18:51.417 INFO:tasks.workunit.client.0.smithi134.stdout:3/204: write da/d12/f25 [453195,26986] 0 2024-02-16T22:18:51.417 INFO:tasks.workunit.client.0.smithi134.stdout:3/205: chown da/d2f 55983 1 2024-02-16T22:18:51.419 INFO:tasks.workunit.client.0.smithi134.stdout:4/180: link d0/d6/d22/d25/d2a/f2e d0/d6/d8/de/f3e 0 2024-02-16T22:18:51.420 INFO:tasks.workunit.client.0.smithi134.stdout:0/192: rmdir d2/dc/d32 39 2024-02-16T22:18:51.421 INFO:tasks.workunit.client.0.smithi134.stdout:6/235: read f6 [66568,15451] 0 2024-02-16T22:18:51.421 INFO:tasks.workunit.client.0.smithi134.stdout:6/236: truncate d17/f2d 928290 0 2024-02-16T22:18:51.423 INFO:tasks.workunit.client.0.smithi134.stdout:4/181: mknod d0/d6/d22/d25/c3f 0 2024-02-16T22:18:51.423 INFO:tasks.workunit.client.0.smithi134.stdout:4/182: chown d0/f2 442 1 2024-02-16T22:18:51.425 INFO:tasks.workunit.client.0.smithi134.stdout:0/193: getdents d2 0 2024-02-16T22:18:51.425 INFO:tasks.workunit.client.0.smithi134.stdout:7/192: dwrite d2/d6/d17/d25/f2a [0,4194304] 0 2024-02-16T22:18:51.427 INFO:tasks.workunit.client.0.smithi134.stdout:4/183: dread d0/d6/d1e/f27 [0,4194304] 0 2024-02-16T22:18:51.427 INFO:tasks.workunit.client.0.smithi134.stdout:4/184: chown d0/d6/d16 470 1 2024-02-16T22:18:51.427 INFO:tasks.workunit.client.0.smithi134.stdout:0/194: unlink d2/dc/l10 0 2024-02-16T22:18:51.428 INFO:tasks.workunit.client.0.smithi134.stdout:6/237: dread d17/f1c [0,4194304] 0 2024-02-16T22:18:51.431 INFO:tasks.workunit.client.0.smithi134.stdout:7/193: mknod d2/d5/d22/c3f 0 2024-02-16T22:18:51.433 INFO:tasks.workunit.client.0.smithi134.stdout:0/195: rename d2/f1f to d2/dc/d2d/d34/f46 0 2024-02-16T22:18:51.433 INFO:tasks.workunit.client.0.smithi134.stdout:0/196: write d2/f1c [778046,121156] 0 2024-02-16T22:18:51.434 INFO:tasks.workunit.client.0.smithi134.stdout:8/202: sync 2024-02-16T22:18:51.434 INFO:tasks.workunit.client.0.smithi134.stdout:9/273: sync 2024-02-16T22:18:51.434 INFO:tasks.workunit.client.0.smithi134.stdout:0/197: stat d2/c38 0 2024-02-16T22:18:51.434 INFO:tasks.workunit.client.0.smithi134.stdout:0/198: dread - d2/dc/f25 zero size 2024-02-16T22:18:51.434 INFO:tasks.workunit.client.0.smithi134.stdout:0/199: write d2/dc/f44 [164652,19539] 0 2024-02-16T22:18:51.435 INFO:tasks.workunit.client.0.smithi134.stdout:6/238: rename d17/d27/d30/c48 to d17/d27/d30/d32/c4d 0 2024-02-16T22:18:51.437 INFO:tasks.workunit.client.0.smithi134.stdout:1/193: dwrite d5/da/f25 [0,4194304] 0 2024-02-16T22:18:51.438 INFO:tasks.workunit.client.0.smithi134.stdout:6/239: dread f10 [0,4194304] 0 2024-02-16T22:18:51.438 INFO:tasks.workunit.client.0.smithi134.stdout:6/240: stat d17/f3a 0 2024-02-16T22:18:51.438 INFO:tasks.workunit.client.0.smithi134.stdout:8/203: symlink d2/df/d18/d12/d3d/l3f 0 2024-02-16T22:18:51.440 INFO:tasks.workunit.client.0.smithi134.stdout:9/274: creat db/d20/d22/d46/f5c x:0 0 0 2024-02-16T22:18:51.440 INFO:tasks.workunit.client.0.smithi134.stdout:3/206: dwrite da/d1c/f32 [4194304,4194304] 0 2024-02-16T22:18:51.445 INFO:tasks.workunit.client.0.smithi134.stdout:1/194: rename d5/d1a/d23/f3d to d5/d1a/d23/f43 0 2024-02-16T22:18:51.445 INFO:tasks.workunit.client.0.smithi134.stdout:1/195: chown d5/da/c1f 943613409 1 2024-02-16T22:18:51.446 INFO:tasks.workunit.client.0.smithi134.stdout:1/196: write d5/da/d1c/f29 [3094445,127876] 0 2024-02-16T22:18:51.447 INFO:tasks.workunit.client.0.smithi134.stdout:8/204: mkdir d2/df/d19/d40 0 2024-02-16T22:18:51.449 INFO:tasks.workunit.client.0.smithi134.stdout:1/197: mknod d5/da/d1c/c44 0 2024-02-16T22:18:51.449 INFO:tasks.workunit.client.0.smithi134.stdout:2/186: sync 2024-02-16T22:18:51.449 INFO:tasks.workunit.client.0.smithi134.stdout:2/187: truncate df/d10/d15/f28 11711 0 2024-02-16T22:18:51.453 INFO:tasks.workunit.client.0.smithi134.stdout:7/194: dwrite d2/d5/d19/f30 [0,4194304] 0 2024-02-16T22:18:51.454 INFO:tasks.workunit.client.0.smithi134.stdout:8/205: mkdir d2/df/d18/d2a/d41 0 2024-02-16T22:18:51.456 INFO:tasks.workunit.client.0.smithi134.stdout:9/275: rename db/d20/d22/d46/f47 to db/d20/d22/f5d 0 2024-02-16T22:18:51.457 INFO:tasks.workunit.client.0.smithi134.stdout:1/198: truncate d5/d1a/d23/f39 1555157 0 2024-02-16T22:18:51.458 INFO:tasks.workunit.client.0.smithi134.stdout:2/188: mkdir df/d10/d11/d34 0 2024-02-16T22:18:51.462 INFO:tasks.workunit.client.0.smithi134.stdout:1/199: mkdir d5/da/d21/d45 0 2024-02-16T22:18:51.462 INFO:tasks.workunit.client.0.smithi134.stdout:1/200: chown d5/da/d2d/f34 0 1 2024-02-16T22:18:51.463 INFO:tasks.workunit.client.0.smithi134.stdout:2/189: mknod df/d10/d11/d34/c35 0 2024-02-16T22:18:51.464 INFO:tasks.workunit.client.0.smithi134.stdout:9/276: mknod db/c5e 0 2024-02-16T22:18:51.464 INFO:tasks.workunit.client.0.smithi134.stdout:9/277: truncate db/d20/d22/d46/f5c 251810 0 2024-02-16T22:18:51.464 INFO:tasks.workunit.client.0.smithi134.stdout:9/278: readlink db/l4b 0 2024-02-16T22:18:51.464 INFO:tasks.workunit.client.0.smithi134.stdout:9/279: stat db/dc/f12 0 2024-02-16T22:18:51.468 INFO:tasks.workunit.client.0.smithi134.stdout:1/201: read d5/d1a/f40 [12321,93954] 0 2024-02-16T22:18:51.469 INFO:tasks.workunit.client.0.smithi134.stdout:1/202: dread d5/f26 [0,4194304] 0 2024-02-16T22:18:51.470 INFO:tasks.workunit.client.0.smithi134.stdout:1/203: write d5/da/d21/f37 [577111,69608] 0 2024-02-16T22:18:51.474 INFO:tasks.workunit.client.0.smithi134.stdout:1/204: dread f1 [0,4194304] 0 2024-02-16T22:18:51.474 INFO:tasks.workunit.client.0.smithi134.stdout:1/205: write d5/f26 [1036795,47908] 0 2024-02-16T22:18:51.475 INFO:tasks.workunit.client.0.smithi134.stdout:8/206: dread d2/f2c [0,4194304] 0 2024-02-16T22:18:51.476 INFO:tasks.workunit.client.0.smithi134.stdout:1/206: creat d5/f46 x:0 0 0 2024-02-16T22:18:51.478 INFO:tasks.workunit.client.0.smithi134.stdout:8/207: rename f0 to d2/df/d18/d2a/d41/f42 0 2024-02-16T22:18:51.479 INFO:tasks.workunit.client.0.smithi134.stdout:6/241: dwrite f12 [0,4194304] 0 2024-02-16T22:18:51.479 INFO:tasks.workunit.client.0.smithi134.stdout:8/208: mknod d2/df/d18/d12/c43 0 2024-02-16T22:18:51.480 INFO:tasks.workunit.client.0.smithi134.stdout:2/190: write df/f1f [1566168,69841] 0 2024-02-16T22:18:51.480 INFO:tasks.workunit.client.0.smithi134.stdout:2/191: dread - df/d10/d11/d17/f20 zero size 2024-02-16T22:18:51.481 INFO:tasks.workunit.client.0.smithi134.stdout:6/242: rename d17/c1a to d17/d27/d30/d32/c4e 0 2024-02-16T22:18:51.483 INFO:tasks.workunit.client.0.smithi134.stdout:2/192: symlink df/d10/l36 0 2024-02-16T22:18:51.483 INFO:tasks.workunit.client.0.smithi134.stdout:2/193: fsync df/d10/d11/d17/d1b/f23 0 2024-02-16T22:18:51.484 INFO:tasks.workunit.client.0.smithi134.stdout:1/207: dread d5/da/f25 [0,4194304] 0 2024-02-16T22:18:51.484 INFO:tasks.workunit.client.0.smithi134.stdout:1/208: chown d5/da/f25 26704472 1 2024-02-16T22:18:51.485 INFO:tasks.workunit.client.0.smithi134.stdout:6/243: rmdir d17/d27/d30/d46 0 2024-02-16T22:18:51.485 INFO:tasks.workunit.client.0.smithi134.stdout:2/194: write df/d10/d15/f16 [442331,19474] 0 2024-02-16T22:18:51.485 INFO:tasks.workunit.client.0.smithi134.stdout:6/244: mkdir d17/d27/d4f 0 2024-02-16T22:18:51.485 INFO:tasks.workunit.client.0.smithi134.stdout:6/245: readlink d17/d36/l40 0 2024-02-16T22:18:51.485 INFO:tasks.workunit.client.0.smithi134.stdout:6/246: fsync d17/d22/f29 0 2024-02-16T22:18:51.486 INFO:tasks.workunit.client.0.smithi134.stdout:2/195: truncate df/d10/d15/f1d 2710501 0 2024-02-16T22:18:51.488 INFO:tasks.workunit.client.0.smithi134.stdout:0/200: dwrite d2/f16 [0,4194304] 0 2024-02-16T22:18:51.489 INFO:tasks.workunit.client.0.smithi134.stdout:7/195: dwrite d2/f4 [8388608,4194304] 0 2024-02-16T22:18:51.489 INFO:tasks.workunit.client.0.smithi134.stdout:3/207: dwrite da/d12/d2a/f38 [0,4194304] 0 2024-02-16T22:18:51.489 INFO:tasks.workunit.client.0.smithi134.stdout:9/280: dwrite db/f29 [0,4194304] 0 2024-02-16T22:18:51.489 INFO:tasks.workunit.client.0.smithi134.stdout:9/281: chown db/d20/d22/d51/c52 31 1 2024-02-16T22:18:51.495 INFO:tasks.workunit.client.0.smithi134.stdout:6/247: dread d17/d22/f29 [0,4194304] 0 2024-02-16T22:18:51.497 INFO:tasks.workunit.client.0.smithi134.stdout:9/282: truncate f8 971250 0 2024-02-16T22:18:51.499 INFO:tasks.workunit.client.0.smithi134.stdout:0/201: creat d2/dc/d32/d3e/f47 x:0 0 0 2024-02-16T22:18:51.506 INFO:tasks.workunit.client.0.smithi134.stdout:7/196: dread d2/d6/d17/f23 [0,4194304] 0 2024-02-16T22:18:51.510 INFO:tasks.workunit.client.0.smithi134.stdout:1/209: dwrite d5/f7 [0,4194304] 0 2024-02-16T22:18:51.510 INFO:tasks.workunit.client.0.smithi134.stdout:3/208: dwrite da/d12/f21 [0,4194304] 0 2024-02-16T22:18:51.515 INFO:tasks.workunit.client.0.smithi134.stdout:7/197: write d2/d6/d17/d25/f2a [796470,68834] 0 2024-02-16T22:18:51.515 INFO:tasks.workunit.client.0.smithi134.stdout:6/248: rename f12 to d17/d27/d4f/f50 0 2024-02-16T22:18:51.516 INFO:tasks.workunit.client.0.smithi134.stdout:9/283: link db/dc/f15 db/d20/d22/d51/f5f 0 2024-02-16T22:18:51.517 INFO:tasks.workunit.client.0.smithi134.stdout:0/202: unlink d2/d20/c43 0 2024-02-16T22:18:51.518 INFO:tasks.workunit.client.0.smithi134.stdout:0/203: truncate d2/d20/f23 958446 0 2024-02-16T22:18:51.519 INFO:tasks.workunit.client.0.smithi134.stdout:1/210: getdents d5/da/d2d 0 2024-02-16T22:18:51.520 INFO:tasks.workunit.client.0.smithi134.stdout:2/196: rmdir df/d10/d15 39 2024-02-16T22:18:51.521 INFO:tasks.workunit.client.0.smithi134.stdout:3/209: creat da/d12/d2a/f3c x:0 0 0 2024-02-16T22:18:51.522 INFO:tasks.workunit.client.0.smithi134.stdout:3/210: fsync da/f19 0 2024-02-16T22:18:51.524 INFO:tasks.workunit.client.0.smithi134.stdout:7/198: mkdir d2/d7/d40 0 2024-02-16T22:18:51.526 INFO:tasks.workunit.client.0.smithi134.stdout:6/249: unlink cd 0 2024-02-16T22:18:51.526 INFO:tasks.workunit.client.0.smithi134.stdout:6/250: chown d17/d22/f3c 57 1 2024-02-16T22:18:51.526 INFO:tasks.workunit.client.0.smithi134.stdout:6/251: creat d17/f51 x:0 0 0 2024-02-16T22:18:51.527 INFO:tasks.workunit.client.0.smithi134.stdout:9/284: readlink db/d20/d22/l27 0 2024-02-16T22:18:51.529 INFO:tasks.workunit.client.0.smithi134.stdout:0/204: mkdir d2/dc/d48 0 2024-02-16T22:18:51.530 INFO:tasks.workunit.client.0.smithi134.stdout:1/211: rename d5/da/d2d/l38 to d5/da/d2d/l47 0 2024-02-16T22:18:51.532 INFO:tasks.workunit.client.0.smithi134.stdout:2/197: symlink df/d10/d11/d17/d1b/l37 0 2024-02-16T22:18:51.535 INFO:tasks.workunit.client.0.smithi134.stdout:0/205: rename d2/d20/c3d to d2/c49 0 2024-02-16T22:18:51.535 INFO:tasks.workunit.client.0.smithi134.stdout:0/206: write d2/dc/d2d/d34/f37 [597362,22158] 0 2024-02-16T22:18:51.535 INFO:tasks.workunit.client.0.smithi134.stdout:1/212: mknod d5/d1a/d23/d3c/c48 0 2024-02-16T22:18:51.536 INFO:tasks.workunit.client.0.smithi134.stdout:0/207: rename d2/dc/d2d/d34/c3a to d2/d20/c4a 0 2024-02-16T22:18:51.536 INFO:tasks.workunit.client.0.smithi134.stdout:0/208: read - d2/dc/f25 zero size 2024-02-16T22:18:51.538 INFO:tasks.workunit.client.0.smithi134.stdout:0/209: mkdir d2/d4b 0 2024-02-16T22:18:51.538 INFO:tasks.workunit.client.0.smithi134.stdout:0/210: fdatasync d2/dc/f15 0 2024-02-16T22:18:51.539 INFO:tasks.workunit.client.0.smithi134.stdout:1/213: rmdir d5/da/d1c 39 2024-02-16T22:18:51.540 INFO:tasks.workunit.client.0.smithi134.stdout:1/214: fsync d5/f24 0 2024-02-16T22:18:51.542 INFO:tasks.workunit.client.0.smithi134.stdout:0/211: stat d2/c5 0 2024-02-16T22:18:51.550 INFO:tasks.workunit.client.0.smithi134.stdout:5/219: sync 2024-02-16T22:18:51.563 INFO:tasks.workunit.client.0.smithi134.stdout:7/199: dwrite d2/d7/f3e [0,4194304] 0 2024-02-16T22:18:51.565 INFO:tasks.workunit.client.0.smithi134.stdout:7/200: link d2/d1e/d24/f27 d2/d6/f41 0 2024-02-16T22:18:51.566 INFO:tasks.workunit.client.0.smithi134.stdout:7/201: rmdir d2/d5/d19 39 2024-02-16T22:18:51.567 INFO:tasks.workunit.client.0.smithi134.stdout:7/202: symlink d2/d6/d17/d31/l42 0 2024-02-16T22:18:51.567 INFO:tasks.workunit.client.0.smithi134.stdout:7/203: creat d2/d6/f43 x:0 0 0 2024-02-16T22:18:51.568 INFO:tasks.workunit.client.0.smithi134.stdout:7/204: link d2/d1e/d24/f3c d2/d5/d19/f44 0 2024-02-16T22:18:51.572 INFO:tasks.workunit.client.0.smithi134.stdout:7/205: dread d2/d6/d17/f23 [0,4194304] 0 2024-02-16T22:18:51.572 INFO:tasks.workunit.client.0.smithi134.stdout:7/206: readlink d2/d6/l20 0 2024-02-16T22:18:51.572 INFO:tasks.workunit.client.0.smithi134.stdout:7/207: write d2/d5/d19/f1d [910032,117490] 0 2024-02-16T22:18:51.572 INFO:tasks.workunit.client.0.smithi134.stdout:7/208: dread - d2/d6/f43 zero size 2024-02-16T22:18:51.573 INFO:tasks.workunit.client.0.smithi134.stdout:7/209: truncate d2/d5/f2d 77779 0 2024-02-16T22:18:51.574 INFO:tasks.workunit.client.0.smithi134.stdout:7/210: mknod d2/c45 0 2024-02-16T22:18:51.574 INFO:tasks.workunit.client.0.smithi134.stdout:7/211: chown d2/d5/f10 4374 1 2024-02-16T22:18:51.575 INFO:tasks.workunit.client.0.smithi134.stdout:7/212: rename d2/d5/d22/d26/c3b to d2/d5/d22/c46 0 2024-02-16T22:18:51.575 INFO:tasks.workunit.client.0.smithi134.stdout:7/213: fdatasync d2/d5/d19/f44 0 2024-02-16T22:18:51.575 INFO:tasks.workunit.client.0.smithi134.stdout:7/214: chown d2/c45 19917 1 2024-02-16T22:18:51.581 INFO:tasks.workunit.client.0.smithi134.stdout:3/211: dwrite da/d12/f21 [0,4194304] 0 2024-02-16T22:18:51.581 INFO:tasks.workunit.client.0.smithi134.stdout:3/212: readlink da/d12/d2a/l36 0 2024-02-16T22:18:51.581 INFO:tasks.workunit.client.0.smithi134.stdout:3/213: creat da/d1c/d24/f3d x:0 0 0 2024-02-16T22:18:51.581 INFO:tasks.workunit.client.0.smithi134.stdout:3/214: fsync da/d12/f21 0 2024-02-16T22:18:51.581 INFO:tasks.workunit.client.0.smithi134.stdout:6/252: dwrite f6 [0,4194304] 0 2024-02-16T22:18:51.581 INFO:tasks.workunit.client.0.smithi134.stdout:9/285: dwrite db/f43 [0,4194304] 0 2024-02-16T22:18:51.581 INFO:tasks.workunit.client.0.smithi134.stdout:2/198: dwrite df/d10/d11/d17/d1b/f22 [0,4194304] 0 2024-02-16T22:18:51.582 INFO:tasks.workunit.client.0.smithi134.stdout:3/215: write da/f3a [497644,129802] 0 2024-02-16T22:18:51.582 INFO:tasks.workunit.client.0.smithi134.stdout:3/216: stat da/d12 0 2024-02-16T22:18:51.582 INFO:tasks.workunit.client.0.smithi134.stdout:1/215: dwrite f3 [0,4194304] 0 2024-02-16T22:18:51.582 INFO:tasks.workunit.client.0.smithi134.stdout:5/220: dwrite d2/f2d [0,4194304] 0 2024-02-16T22:18:51.591 INFO:tasks.workunit.client.0.smithi134.stdout:2/199: write df/d10/d11/d17/d1b/f23 [199368,129477] 0 2024-02-16T22:18:51.593 INFO:tasks.workunit.client.0.smithi134.stdout:5/221: write d2/f2b [1786851,79584] 0 2024-02-16T22:18:51.593 INFO:tasks.workunit.client.0.smithi134.stdout:5/222: truncate d2/f3 655344 0 2024-02-16T22:18:51.596 INFO:tasks.workunit.client.0.smithi134.stdout:0/212: getdents d2 0 2024-02-16T22:18:51.599 INFO:tasks.workunit.client.0.smithi134.stdout:3/217: unlink da/ff 0 2024-02-16T22:18:51.603 INFO:tasks.workunit.client.0.smithi134.stdout:1/216: creat d5/da/d1c/f49 x:0 0 0 2024-02-16T22:18:51.604 INFO:tasks.workunit.client.0.smithi134.stdout:6/253: dwrite d17/f2d [0,4194304] 0 2024-02-16T22:18:51.606 INFO:tasks.workunit.client.0.smithi134.stdout:5/223: mknod d2/d9/dc/c49 0 2024-02-16T22:18:51.608 INFO:tasks.workunit.client.0.smithi134.stdout:7/215: dwrite d2/d6/d17/d25/f2a [4194304,4194304] 0 2024-02-16T22:18:51.608 INFO:tasks.workunit.client.0.smithi134.stdout:0/213: unlink d2/dc/d2d/l2e 0 2024-02-16T22:18:51.608 INFO:tasks.workunit.client.0.smithi134.stdout:0/214: getdents d2/d4b 0 2024-02-16T22:18:51.611 INFO:tasks.workunit.client.0.smithi134.stdout:9/286: rename db/d20/d22/d46/l59 to db/l60 0 2024-02-16T22:18:51.611 INFO:tasks.workunit.client.0.smithi134.stdout:9/287: truncate db/dc/f54 308968 0 2024-02-16T22:18:51.611 INFO:tasks.workunit.client.0.smithi134.stdout:9/288: creat db/dc/f61 x:0 0 0 2024-02-16T22:18:51.611 INFO:tasks.workunit.client.0.smithi134.stdout:1/217: stat d5/da/d2d/l47 0 2024-02-16T22:18:51.612 INFO:tasks.workunit.client.0.smithi134.stdout:1/218: creat d5/da/d21/f4a x:0 0 0 2024-02-16T22:18:51.615 INFO:tasks.workunit.client.0.smithi134.stdout:6/254: mkdir d17/d27/d4f/d52 0 2024-02-16T22:18:51.616 INFO:tasks.workunit.client.0.smithi134.stdout:5/224: mknod d2/d9/dc/d15/d2f/d30/c4a 0 2024-02-16T22:18:51.616 INFO:tasks.workunit.client.0.smithi134.stdout:5/225: dread - d2/d9/dc/d15/f31 zero size 2024-02-16T22:18:51.619 INFO:tasks.workunit.client.0.smithi134.stdout:4/185: sync 2024-02-16T22:18:51.621 INFO:tasks.workunit.client.0.smithi134.stdout:1/219: dread d5/d1a/d23/f27 [0,4194304] 0 2024-02-16T22:18:51.621 INFO:tasks.workunit.client.0.smithi134.stdout:1/220: fdatasync d5/f24 0 2024-02-16T22:18:51.622 INFO:tasks.workunit.client.0.smithi134.stdout:1/221: chown d5/d1a/d23/f43 28480 1 2024-02-16T22:18:51.622 INFO:tasks.workunit.client.0.smithi134.stdout:7/216: unlink d2/d5/d19/f30 0 2024-02-16T22:18:51.622 INFO:tasks.workunit.client.0.smithi134.stdout:7/217: fdatasync d2/f1a 0 2024-02-16T22:18:51.622 INFO:tasks.workunit.client.0.smithi134.stdout:6/255: dread f6 [0,4194304] 0 2024-02-16T22:18:51.624 INFO:tasks.workunit.client.0.smithi134.stdout:0/215: link d2/dc/d32/d3e/f47 d2/dc/d48/f4c 0 2024-02-16T22:18:51.624 INFO:tasks.workunit.client.0.smithi134.stdout:8/209: sync 2024-02-16T22:18:51.624 INFO:tasks.workunit.client.0.smithi134.stdout:0/216: write d2/dc/f25 [383156,75355] 0 2024-02-16T22:18:51.626 INFO:tasks.workunit.client.0.smithi134.stdout:3/218: rename da/d12/c14 to da/d1c/d24/c3e 0 2024-02-16T22:18:51.628 INFO:tasks.workunit.client.0.smithi134.stdout:8/210: write d2/f36 [3766693,3119] 0 2024-02-16T22:18:51.630 INFO:tasks.workunit.client.0.smithi134.stdout:8/211: dread d2/f1b [4194304,4194304] 0 2024-02-16T22:18:51.630 INFO:tasks.workunit.client.0.smithi134.stdout:5/226: rmdir d2/d35 39 2024-02-16T22:18:51.632 INFO:tasks.workunit.client.0.smithi134.stdout:4/186: mkdir d0/d6/d22/d40 0 2024-02-16T22:18:51.635 INFO:tasks.workunit.client.0.smithi134.stdout:7/218: mknod d2/d5/d19/c47 0 2024-02-16T22:18:51.637 INFO:tasks.workunit.client.0.smithi134.stdout:6/256: symlink d17/d22/d44/l53 0 2024-02-16T22:18:51.637 INFO:tasks.workunit.client.0.smithi134.stdout:6/257: fdatasync d17/d22/f24 0 2024-02-16T22:18:51.637 INFO:tasks.workunit.client.0.smithi134.stdout:6/258: stat d17/d22/f24 0 2024-02-16T22:18:51.637 INFO:tasks.workunit.client.0.smithi134.stdout:6/259: stat d17/d27 0 2024-02-16T22:18:51.637 INFO:tasks.workunit.client.0.smithi134.stdout:6/260: write d17/d22/f3c [366893,82332] 0 2024-02-16T22:18:51.638 INFO:tasks.workunit.client.0.smithi134.stdout:0/217: symlink d2/d4b/l4d 0 2024-02-16T22:18:51.638 INFO:tasks.workunit.client.0.smithi134.stdout:9/289: write db/f3d [1236324,57198] 0 2024-02-16T22:18:51.640 INFO:tasks.workunit.client.0.smithi134.stdout:3/219: creat da/d2f/f3f x:0 0 0 2024-02-16T22:18:51.643 INFO:tasks.workunit.client.0.smithi134.stdout:5/227: dwrite d2/f34 [0,4194304] 0 2024-02-16T22:18:51.643 INFO:tasks.workunit.client.0.smithi134.stdout:5/228: write d2/f3 [1512755,124078] 0 2024-02-16T22:18:51.647 INFO:tasks.workunit.client.0.smithi134.stdout:8/212: symlink d2/df/l44 0 2024-02-16T22:18:51.649 INFO:tasks.workunit.client.0.smithi134.stdout:4/187: creat d0/d6/d22/d40/f41 x:0 0 0 2024-02-16T22:18:51.651 INFO:tasks.workunit.client.0.smithi134.stdout:6/261: dread d17/d22/d28/f49 [0,4194304] 0 2024-02-16T22:18:51.651 INFO:tasks.workunit.client.0.smithi134.stdout:1/222: mkdir d5/da/d2d/d4b 0 2024-02-16T22:18:51.651 INFO:tasks.workunit.client.0.smithi134.stdout:1/223: read d5/da/d1c/f29 [1800070,92509] 0 2024-02-16T22:18:51.653 INFO:tasks.workunit.client.0.smithi134.stdout:7/219: mkdir d2/d5/d22/d26/d48 0 2024-02-16T22:18:51.654 INFO:tasks.workunit.client.0.smithi134.stdout:6/262: dread d17/d27/d30/f35 [0,4194304] 0 2024-02-16T22:18:51.656 INFO:tasks.workunit.client.0.smithi134.stdout:5/229: mkdir d2/d9/dc/d27/d4b 0 2024-02-16T22:18:51.657 INFO:tasks.workunit.client.0.smithi134.stdout:8/213: rmdir d2/df/d18/d27 39 2024-02-16T22:18:51.659 INFO:tasks.workunit.client.0.smithi134.stdout:1/224: creat d5/d1a/f4c x:0 0 0 2024-02-16T22:18:51.659 INFO:tasks.workunit.client.0.smithi134.stdout:1/225: chown d5/da/d1c/f32 151747155 1 2024-02-16T22:18:51.661 INFO:tasks.workunit.client.0.smithi134.stdout:7/220: rename d2/d6/d17/d3d to d2/d49 0 2024-02-16T22:18:51.662 INFO:tasks.workunit.client.0.smithi134.stdout:3/220: mkdir da/d1c/d24/d29/d40 0 2024-02-16T22:18:51.665 INFO:tasks.workunit.client.0.smithi134.stdout:8/214: dread d2/df/d18/f5 [0,4194304] 0 2024-02-16T22:18:51.665 INFO:tasks.workunit.client.0.smithi134.stdout:5/230: unlink d2/d35/d36/d3d/f42 0 2024-02-16T22:18:51.668 INFO:tasks.workunit.client.0.smithi134.stdout:3/221: symlink da/d12/d2a/l41 0 2024-02-16T22:18:51.668 INFO:tasks.workunit.client.0.smithi134.stdout:3/222: creat da/d12/f42 x:0 0 0 2024-02-16T22:18:51.670 INFO:tasks.workunit.client.0.smithi134.stdout:5/231: rmdir d2/d35 39 2024-02-16T22:18:51.673 INFO:tasks.workunit.client.0.smithi134.stdout:0/218: dwrite d2/dc/f1d [0,4194304] 0 2024-02-16T22:18:51.674 INFO:tasks.workunit.client.0.smithi134.stdout:3/223: link c0 da/d12/c43 0 2024-02-16T22:18:51.674 INFO:tasks.workunit.client.0.smithi134.stdout:3/224: write da/d12/f25 [679697,19853] 0 2024-02-16T22:18:51.674 INFO:tasks.workunit.client.0.smithi134.stdout:5/232: creat d2/d35/d36/d3d/f4c x:0 0 0 2024-02-16T22:18:51.674 INFO:tasks.workunit.client.0.smithi134.stdout:5/233: chown d2/l1c 5757861 1 2024-02-16T22:18:51.676 INFO:tasks.workunit.client.0.smithi134.stdout:9/290: dwrite db/f57 [0,4194304] 0 2024-02-16T22:18:51.676 INFO:tasks.workunit.client.0.smithi134.stdout:7/221: write d2/d5/d19/f2b [2587351,48795] 0 2024-02-16T22:18:51.676 INFO:tasks.workunit.client.0.smithi134.stdout:4/188: dwrite d0/d6/d8/d32/f38 [0,4194304] 0 2024-02-16T22:18:51.676 INFO:tasks.workunit.client.0.smithi134.stdout:4/189: write d0/d6/d8/fa [461735,13355] 0 2024-02-16T22:18:51.678 INFO:tasks.workunit.client.0.smithi134.stdout:0/219: truncate d2/f11 1646544 0 2024-02-16T22:18:51.679 INFO:tasks.workunit.client.0.smithi134.stdout:1/226: dread d5/da/f1d [0,4194304] 0 2024-02-16T22:18:51.682 INFO:tasks.workunit.client.0.smithi134.stdout:3/225: creat da/d2f/f44 x:0 0 0 2024-02-16T22:18:51.684 INFO:tasks.workunit.client.0.smithi134.stdout:5/234: unlink d2/f3 0 2024-02-16T22:18:51.695 INFO:tasks.workunit.client.0.smithi134.stdout:3/226: dread da/d2f/f3b [0,4194304] 0 2024-02-16T22:18:51.697 INFO:tasks.workunit.client.0.smithi134.stdout:7/222: mkdir d2/d5/d19/d4a 0 2024-02-16T22:18:51.698 INFO:tasks.workunit.client.0.smithi134.stdout:4/190: creat d0/d6/d8/d30/f42 x:0 0 0 2024-02-16T22:18:51.698 INFO:tasks.workunit.client.0.smithi134.stdout:4/191: truncate d0/d6/d16/d1a/f1b 715901 0 2024-02-16T22:18:51.699 INFO:tasks.workunit.client.0.smithi134.stdout:1/227: mkdir d5/d1a/d4d 0 2024-02-16T22:18:51.702 INFO:tasks.workunit.client.0.smithi134.stdout:3/227: creat da/d1c/d24/d29/f45 x:0 0 0 2024-02-16T22:18:51.703 INFO:tasks.workunit.client.0.smithi134.stdout:7/223: link d2/d5/d19/c47 d2/d6/d17/d31/c4b 0 2024-02-16T22:18:51.704 INFO:tasks.workunit.client.0.smithi134.stdout:4/192: getdents d0/d6/d16/d1a 0 2024-02-16T22:18:51.706 INFO:tasks.workunit.client.0.smithi134.stdout:7/224: mkdir d2/d5/d4c 0 2024-02-16T22:18:51.707 INFO:tasks.workunit.client.0.smithi134.stdout:7/225: readlink d2/d6/d17/d31/d28/l2c 0 2024-02-16T22:18:51.707 INFO:tasks.workunit.client.0.smithi134.stdout:7/226: write d2/d6/f43 [480727,123964] 0 2024-02-16T22:18:51.707 INFO:tasks.workunit.client.0.smithi134.stdout:5/235: dwrite d2/d9/dc/d27/f2c [0,4194304] 0 2024-02-16T22:18:51.707 INFO:tasks.workunit.client.0.smithi134.stdout:8/215: dwrite d2/df/d18/fc [0,4194304] 0 2024-02-16T22:18:51.708 INFO:tasks.workunit.client.0.smithi134.stdout:9/291: dwrite db/d20/d22/f5d [0,4194304] 0 2024-02-16T22:18:51.708 INFO:tasks.workunit.client.0.smithi134.stdout:9/292: dread - db/d20/d22/f50 zero size 2024-02-16T22:18:51.708 INFO:tasks.workunit.client.0.smithi134.stdout:9/293: dread - db/d20/d22/f44 zero size 2024-02-16T22:18:51.709 INFO:tasks.workunit.client.0.smithi134.stdout:9/294: chown db/dc/l4a 1 1 2024-02-16T22:18:51.713 INFO:tasks.workunit.client.0.smithi134.stdout:7/227: creat d2/d5/d4c/f4d x:0 0 0 2024-02-16T22:18:51.713 INFO:tasks.workunit.client.0.smithi134.stdout:7/228: fdatasync d2/d1e/f39 0 2024-02-16T22:18:51.716 INFO:tasks.workunit.client.0.smithi134.stdout:5/236: creat d2/d9/dc/d15/f4d x:0 0 0 2024-02-16T22:18:51.717 INFO:tasks.workunit.client.0.smithi134.stdout:5/237: creat d2/f4e x:0 0 0 2024-02-16T22:18:51.718 INFO:tasks.workunit.client.0.smithi134.stdout:2/200: sync 2024-02-16T22:18:51.719 INFO:tasks.workunit.client.0.smithi134.stdout:8/216: creat d2/df/d18/f45 x:0 0 0 2024-02-16T22:18:51.723 INFO:tasks.workunit.client.0.smithi134.stdout:9/295: rename db/dc/f17 to db/dc/f62 0 2024-02-16T22:18:51.724 INFO:tasks.workunit.client.0.smithi134.stdout:7/229: creat d2/d5/d22/f4e x:0 0 0 2024-02-16T22:18:51.725 INFO:tasks.workunit.client.0.smithi134.stdout:2/201: dread df/d10/d15/f1e [0,4194304] 0 2024-02-16T22:18:51.726 INFO:tasks.workunit.client.0.smithi134.stdout:3/228: dwrite da/f11 [4194304,4194304] 0 2024-02-16T22:18:51.726 INFO:tasks.workunit.client.0.smithi134.stdout:3/229: creat da/d1c/f46 x:0 0 0 2024-02-16T22:18:51.726 INFO:tasks.workunit.client.0.smithi134.stdout:1/228: rmdir d5 39 2024-02-16T22:18:51.728 INFO:tasks.workunit.client.0.smithi134.stdout:8/217: symlink d2/df/d18/d27/l46 0 2024-02-16T22:18:51.732 INFO:tasks.workunit.client.0.smithi134.stdout:9/296: truncate db/dc/f12 3580738 0 2024-02-16T22:18:51.732 INFO:tasks.workunit.client.0.smithi134.stdout:9/297: write db/d20/d22/d46/f5c [971506,85012] 0 2024-02-16T22:18:51.733 INFO:tasks.workunit.client.0.smithi134.stdout:2/202: truncate df/d10/d11/f26 1042993 0 2024-02-16T22:18:51.734 INFO:tasks.workunit.client.0.smithi134.stdout:2/203: write df/d10/d15/f2e [9248,64274] 0 2024-02-16T22:18:51.734 INFO:tasks.workunit.client.0.smithi134.stdout:2/204: readlink df/l27 0 2024-02-16T22:18:51.738 INFO:tasks.workunit.client.0.smithi134.stdout:1/229: creat d5/da/d21/d45/f4e x:0 0 0 2024-02-16T22:18:51.738 INFO:tasks.workunit.client.0.smithi134.stdout:1/230: readlink d5/d1a/l22 0 2024-02-16T22:18:51.738 INFO:tasks.workunit.client.0.smithi134.stdout:2/205: dread df/d10/d15/f16 [0,4194304] 0 2024-02-16T22:18:51.739 INFO:tasks.workunit.client.0.smithi134.stdout:8/218: mkdir d2/df/d19/d47 0 2024-02-16T22:18:51.740 INFO:tasks.workunit.client.0.smithi134.stdout:3/230: write da/d12/f21 [3576834,53892] 0 2024-02-16T22:18:51.740 INFO:tasks.workunit.client.0.smithi134.stdout:1/231: getdents d5/da/d21 0 2024-02-16T22:18:51.742 INFO:tasks.workunit.client.0.smithi134.stdout:2/206: truncate fb 759337 0 2024-02-16T22:18:51.743 INFO:tasks.workunit.client.0.smithi134.stdout:8/219: rmdir d2/df 39 2024-02-16T22:18:51.743 INFO:tasks.workunit.client.0.smithi134.stdout:8/220: chown d2/df/l38 855 1 2024-02-16T22:18:51.743 INFO:tasks.workunit.client.0.smithi134.stdout:3/231: fdatasync da/d12/f21 0 2024-02-16T22:18:51.743 INFO:tasks.workunit.client.0.smithi134.stdout:3/232: rename da to da/d1c/d24/d47 22 2024-02-16T22:18:51.743 INFO:tasks.workunit.client.0.smithi134.stdout:5/238: dwrite d2/d9/dc/fe [0,4194304] 0 2024-02-16T22:18:51.743 INFO:tasks.workunit.client.0.smithi134.stdout:5/239: rename d2/d9/dc/d15 to d2/d9/dc/d15/d2f/d4f 22 2024-02-16T22:18:51.743 INFO:tasks.workunit.client.0.smithi134.stdout:5/240: creat d2/f50 x:0 0 0 2024-02-16T22:18:51.745 INFO:tasks.workunit.client.0.smithi134.stdout:9/298: dread db/d20/d22/d46/f49 [0,4194304] 0 2024-02-16T22:18:51.749 INFO:tasks.workunit.client.0.smithi134.stdout:5/241: dread d2/d9/dc/fe [0,4194304] 0 2024-02-16T22:18:51.750 INFO:tasks.workunit.client.0.smithi134.stdout:1/232: creat d5/da/d2d/f4f x:0 0 0 2024-02-16T22:18:51.750 INFO:tasks.workunit.client.0.smithi134.stdout:2/207: symlink df/d10/l38 0 2024-02-16T22:18:51.752 INFO:tasks.workunit.client.0.smithi134.stdout:3/233: mknod da/d2f/c48 0 2024-02-16T22:18:51.758 INFO:tasks.workunit.client.0.smithi134.stdout:3/234: dread da/d2f/f3b [0,4194304] 0 2024-02-16T22:18:51.758 INFO:tasks.workunit.client.0.smithi134.stdout:3/235: getdents da/d1c/d24/d29/d40 0 2024-02-16T22:18:51.759 INFO:tasks.workunit.client.0.smithi134.stdout:5/242: fdatasync d2/d9/dc/f38 0 2024-02-16T22:18:51.759 INFO:tasks.workunit.client.0.smithi134.stdout:5/243: chown d2/f18 58 1 2024-02-16T22:18:51.760 INFO:tasks.workunit.client.0.smithi134.stdout:1/233: creat d5/da/d2d/f50 x:0 0 0 2024-02-16T22:18:51.761 INFO:tasks.workunit.client.0.smithi134.stdout:9/299: rmdir db/dc 39 2024-02-16T22:18:51.762 INFO:tasks.workunit.client.0.smithi134.stdout:9/300: write db/d20/d22/f44 [878734,130956] 0 2024-02-16T22:18:51.772 INFO:tasks.workunit.client.0.smithi134.stdout:2/208: dwrite df/d10/d11/d17/f20 [0,4194304] 0 2024-02-16T22:18:51.772 INFO:tasks.workunit.client.0.smithi134.stdout:2/209: chown df/d10/l31 37791308 1 2024-02-16T22:18:51.773 INFO:tasks.workunit.client.0.smithi134.stdout:5/244: dread d2/d9/dc/f24 [0,4194304] 0 2024-02-16T22:18:51.773 INFO:tasks.workunit.client.0.smithi134.stdout:5/245: read d2/f2b [3279245,76539] 0 2024-02-16T22:18:51.776 INFO:tasks.workunit.client.0.smithi134.stdout:3/236: read da/d12/d2a/f38 [1438283,93375] 0 2024-02-16T22:18:51.776 INFO:tasks.workunit.client.0.smithi134.stdout:3/237: creat da/d1c/d24/d29/f49 x:0 0 0 2024-02-16T22:18:51.776 INFO:tasks.workunit.client.0.smithi134.stdout:3/238: readlink l9 0 2024-02-16T22:18:51.776 INFO:tasks.workunit.client.0.smithi134.stdout:3/239: write da/d1c/d24/f3d [36112,131069] 0 2024-02-16T22:18:51.776 INFO:tasks.workunit.client.0.smithi134.stdout:3/240: creat da/d1c/d24/f4a x:0 0 0 2024-02-16T22:18:51.777 INFO:tasks.workunit.client.0.smithi134.stdout:2/210: mknod df/d10/d30/c39 0 2024-02-16T22:18:51.780 INFO:tasks.workunit.client.0.smithi134.stdout:5/246: link d2/d9/dc/d15/l16 d2/d9/dc/d32/l51 0 2024-02-16T22:18:51.780 INFO:tasks.workunit.client.0.smithi134.stdout:5/247: fsync d2/d9/dc/d15/f3b 0 2024-02-16T22:18:51.784 INFO:tasks.workunit.client.0.smithi134.stdout:2/211: read df/d10/d11/f13 [1680158,53933] 0 2024-02-16T22:18:51.784 INFO:tasks.workunit.client.0.smithi134.stdout:2/212: readlink df/l27 0 2024-02-16T22:18:51.784 INFO:tasks.workunit.client.0.smithi134.stdout:2/213: write df/d10/d15/f28 [610064,28879] 0 2024-02-16T22:18:51.785 INFO:tasks.workunit.client.0.smithi134.stdout:5/248: dread d2/d35/d36/f37 [0,4194304] 0 2024-02-16T22:18:51.786 INFO:tasks.workunit.client.0.smithi134.stdout:5/249: chown d2/d9/dc/d27/c3e 255 1 2024-02-16T22:18:51.789 INFO:tasks.workunit.client.0.smithi134.stdout:3/241: read da/f11 [4510639,123006] 0 2024-02-16T22:18:51.789 INFO:tasks.workunit.client.0.smithi134.stdout:1/234: dwrite d5/da/fb [0,4194304] 0 2024-02-16T22:18:51.789 INFO:tasks.workunit.client.0.smithi134.stdout:9/301: dwrite db/dc/f15 [4194304,4194304] 0 2024-02-16T22:18:51.791 INFO:tasks.workunit.client.0.smithi134.stdout:3/242: link l8 da/d12/l4b 0 2024-02-16T22:18:51.791 INFO:tasks.workunit.client.0.smithi134.stdout:6/263: sync 2024-02-16T22:18:51.791 INFO:tasks.workunit.client.0.smithi134.stdout:6/264: creat d17/d22/f54 x:0 0 0 2024-02-16T22:18:51.794 INFO:tasks.workunit.client.0.smithi134.stdout:9/302: creat db/d20/d55/f63 x:0 0 0 2024-02-16T22:18:51.794 INFO:tasks.workunit.client.0.smithi134.stdout:9/303: chown db/l60 236980 1 2024-02-16T22:18:51.797 INFO:tasks.workunit.client.0.smithi134.stdout:9/304: mkdir db/d20/d22/d64 0 2024-02-16T22:18:51.799 INFO:tasks.workunit.client.0.smithi134.stdout:9/305: rename db/d20/d55/f63 to db/d20/d22/d51/f65 0 2024-02-16T22:18:51.801 INFO:tasks.workunit.client.0.smithi134.stdout:9/306: creat db/dc/f66 x:0 0 0 2024-02-16T22:18:51.802 INFO:tasks.workunit.client.0.smithi134.stdout:9/307: truncate db/d20/f28 40494 0 2024-02-16T22:18:51.803 INFO:tasks.workunit.client.0.smithi134.stdout:9/308: mknod db/d20/d32/c67 0 2024-02-16T22:18:51.803 INFO:tasks.workunit.client.0.smithi134.stdout:9/309: creat db/dc/f68 x:0 0 0 2024-02-16T22:18:51.803 INFO:tasks.workunit.client.0.smithi134.stdout:9/310: readlink db/d20/d22/d46/l4f 0 2024-02-16T22:18:51.807 INFO:tasks.workunit.client.0.smithi134.stdout:9/311: mkdir db/d20/d22/d64/d69 0 2024-02-16T22:18:51.808 INFO:tasks.workunit.client.0.smithi134.stdout:2/214: dwrite df/d10/d11/d17/d1b/f23 [0,4194304] 0 2024-02-16T22:18:51.810 INFO:tasks.workunit.client.0.smithi134.stdout:9/312: rename db/d20/d22/c2e to db/d20/d32/c6a 0 2024-02-16T22:18:51.811 INFO:tasks.workunit.client.0.smithi134.stdout:2/215: mkdir df/d10/d3a 0 2024-02-16T22:18:51.812 INFO:tasks.workunit.client.0.smithi134.stdout:3/243: getdents da/d1c/d24/d29 0 2024-02-16T22:18:51.812 INFO:tasks.workunit.client.0.smithi134.stdout:3/244: creat da/d1c/d24/d2c/f4c x:0 0 0 2024-02-16T22:18:51.814 INFO:tasks.workunit.client.0.smithi134.stdout:2/216: unlink df/d10/d11/d17/d1b/l2b 0 2024-02-16T22:18:51.815 INFO:tasks.workunit.client.0.smithi134.stdout:9/313: mknod db/d20/d32/c6b 0 2024-02-16T22:18:51.817 INFO:tasks.workunit.client.0.smithi134.stdout:3/245: symlink da/d1c/d24/d29/l4d 0 2024-02-16T22:18:51.817 INFO:tasks.workunit.client.0.smithi134.stdout:2/217: rmdir df/d10 39 2024-02-16T22:18:51.818 INFO:tasks.workunit.client.0.smithi134.stdout:9/314: chown db/c2b 0 1 2024-02-16T22:18:51.819 INFO:tasks.workunit.client.0.smithi134.stdout:9/315: symlink db/d20/d22/d51/l6c 0 2024-02-16T22:18:51.820 INFO:tasks.workunit.client.0.smithi134.stdout:9/316: chown db/cf 4261544 1 2024-02-16T22:18:51.820 INFO:tasks.workunit.client.0.smithi134.stdout:9/317: readlink db/d20/d22/l27 0 2024-02-16T22:18:51.820 INFO:tasks.workunit.client.0.smithi134.stdout:9/318: write f2 [739845,97007] 0 2024-02-16T22:18:51.900 INFO:tasks.workunit.client.0.smithi134.stdout:5/250: dwrite d2/d9/dc/d15/f41 [0,4194304] 0 2024-02-16T22:18:51.902 INFO:tasks.workunit.client.0.smithi134.stdout:9/319: getdents db/d20/d22/d64 0 2024-02-16T22:18:51.902 INFO:tasks.workunit.client.0.smithi134.stdout:9/320: chown db/d20/d22/f5d 6595 1 2024-02-16T22:18:51.902 INFO:tasks.workunit.client.0.smithi134.stdout:9/321: fsync db/d20/d22/d46/f49 0 2024-02-16T22:18:51.904 INFO:tasks.workunit.client.0.smithi134.stdout:5/251: symlink d2/d9/l52 0 2024-02-16T22:18:51.904 INFO:tasks.workunit.client.0.smithi134.stdout:5/252: creat d2/d9/f53 x:0 0 0 2024-02-16T22:18:51.904 INFO:tasks.workunit.client.0.smithi134.stdout:5/253: stat d2/d35/d36/d3d/f4c 0 2024-02-16T22:18:51.905 INFO:tasks.workunit.client.0.smithi134.stdout:5/254: chown f0 417789 1 2024-02-16T22:18:51.908 INFO:tasks.workunit.client.0.smithi134.stdout:9/322: truncate db/dc/f15 1283822 0 2024-02-16T22:18:51.908 INFO:tasks.workunit.client.0.smithi134.stdout:6/265: dwrite d17/d22/f47 [0,4194304] 0 2024-02-16T22:18:51.909 INFO:tasks.workunit.client.0.smithi134.stdout:1/235: dwrite d5/da/d2d/f36 [0,4194304] 0 2024-02-16T22:18:51.910 INFO:tasks.workunit.client.0.smithi134.stdout:3/246: dwrite da/d12/f17 [0,4194304] 0 2024-02-16T22:18:51.910 INFO:tasks.workunit.client.0.smithi134.stdout:9/323: mkdir db/d20/d22/d64/d69/d6d 0 2024-02-16T22:18:51.913 INFO:tasks.workunit.client.0.smithi134.stdout:6/266: getdents d17/d22/d28 0 2024-02-16T22:18:51.918 INFO:tasks.workunit.client.0.smithi134.stdout:9/324: mkdir db/d20/d22/d64/d69/d6e 0 2024-02-16T22:18:51.919 INFO:tasks.workunit.client.0.smithi134.stdout:6/267: creat d17/d27/d4f/f55 x:0 0 0 2024-02-16T22:18:51.919 INFO:tasks.workunit.client.0.smithi134.stdout:5/255: dwrite d2/d35/d36/f37 [0,4194304] 0 2024-02-16T22:18:51.920 INFO:tasks.workunit.client.0.smithi134.stdout:1/236: dread d5/da/fb [0,4194304] 0 2024-02-16T22:18:51.920 INFO:tasks.workunit.client.0.smithi134.stdout:1/237: readlink d5/da/d21/l28 0 2024-02-16T22:18:51.920 INFO:tasks.workunit.client.0.smithi134.stdout:1/238: write d5/f26 [690694,62518] 0 2024-02-16T22:18:51.920 INFO:tasks.workunit.client.0.smithi134.stdout:1/239: write d5/d1a/d23/f27 [4717476,58279] 0 2024-02-16T22:18:51.921 INFO:tasks.workunit.client.0.smithi134.stdout:3/247: write da/f19 [1374063,123798] 0 2024-02-16T22:18:51.921 INFO:tasks.workunit.client.0.smithi134.stdout:3/248: truncate da/d1c/f22 4510767 0 2024-02-16T22:18:51.921 INFO:tasks.workunit.client.0.smithi134.stdout:3/249: fdatasync da/d1c/f1e 0 2024-02-16T22:18:51.921 INFO:tasks.workunit.client.0.smithi134.stdout:9/325: rename db/d20/c40 to db/d20/c6f 0 2024-02-16T22:18:51.927 INFO:tasks.workunit.client.0.smithi134.stdout:5/256: symlink d2/d9/dc/d27/l54 0 2024-02-16T22:18:51.927 INFO:tasks.workunit.client.0.smithi134.stdout:5/257: readlink d2/l1c 0 2024-02-16T22:18:51.931 INFO:tasks.workunit.client.0.smithi134.stdout:6/268: getdents d17/d22 0 2024-02-16T22:18:51.932 INFO:tasks.workunit.client.0.smithi134.stdout:4/193: sync 2024-02-16T22:18:51.932 INFO:tasks.workunit.client.0.smithi134.stdout:4/194: chown d0/d6/d22/d25/f2d 14 1 2024-02-16T22:18:51.932 INFO:tasks.workunit.client.0.smithi134.stdout:7/230: sync 2024-02-16T22:18:51.932 INFO:tasks.workunit.client.0.smithi134.stdout:0/220: sync 2024-02-16T22:18:51.933 INFO:tasks.workunit.client.0.smithi134.stdout:4/195: chown d0/d6/d16/l19 675035 1 2024-02-16T22:18:51.933 INFO:tasks.workunit.client.0.smithi134.stdout:0/221: readlink d2/dc/l2f 0 2024-02-16T22:18:51.933 INFO:tasks.workunit.client.0.smithi134.stdout:3/250: dread da/f19 [0,4194304] 0 2024-02-16T22:18:51.933 INFO:tasks.workunit.client.0.smithi134.stdout:3/251: readlink l8 0 2024-02-16T22:18:51.933 INFO:tasks.workunit.client.0.smithi134.stdout:3/252: truncate da/d12/f42 714458 0 2024-02-16T22:18:51.934 INFO:tasks.workunit.client.0.smithi134.stdout:1/240: rename d5/da/d2d/f36 to d5/da/d2d/d4b/f51 0 2024-02-16T22:18:51.934 INFO:tasks.workunit.client.0.smithi134.stdout:8/221: sync 2024-02-16T22:18:51.935 INFO:tasks.workunit.client.0.smithi134.stdout:4/196: rmdir d0/d6/d22/d25/d2a 39 2024-02-16T22:18:51.937 INFO:tasks.workunit.client.0.smithi134.stdout:5/258: write d2/f34 [2750181,57739] 0 2024-02-16T22:18:51.937 INFO:tasks.workunit.client.0.smithi134.stdout:0/222: creat d2/f4e x:0 0 0 2024-02-16T22:18:51.937 INFO:tasks.workunit.client.0.smithi134.stdout:4/197: creat d0/d6/d22/d25/f43 x:0 0 0 2024-02-16T22:18:51.937 INFO:tasks.workunit.client.0.smithi134.stdout:0/223: creat d2/dc/f4f x:0 0 0 2024-02-16T22:18:51.938 INFO:tasks.workunit.client.0.smithi134.stdout:0/224: write d2/d20/f41 [88205,89169] 0 2024-02-16T22:18:51.941 INFO:tasks.workunit.client.0.smithi134.stdout:1/241: write d5/da/d1c/f2f [98707,78445] 0 2024-02-16T22:18:51.943 INFO:tasks.workunit.client.0.smithi134.stdout:4/198: rmdir d0/d6/d16/d1a 39 2024-02-16T22:18:51.944 INFO:tasks.workunit.client.0.smithi134.stdout:0/225: mkdir d2/d20/d50 0 2024-02-16T22:18:51.945 INFO:tasks.workunit.client.0.smithi134.stdout:5/259: truncate d2/d9/dc/f1d 676231 0 2024-02-16T22:18:51.947 INFO:tasks.workunit.client.0.smithi134.stdout:0/226: rename d2/d20/f36 to d2/d20/d50/f51 0 2024-02-16T22:18:51.947 INFO:tasks.workunit.client.0.smithi134.stdout:0/227: fsync d2/dc/d32/f42 0 2024-02-16T22:18:51.948 INFO:tasks.workunit.client.0.smithi134.stdout:5/260: mknod d2/c55 0 2024-02-16T22:18:51.951 INFO:tasks.workunit.client.0.smithi134.stdout:0/228: rename d2/c5 to d2/d20/d50/c52 0 2024-02-16T22:18:51.951 INFO:tasks.workunit.client.0.smithi134.stdout:5/261: mknod d2/d9/dc/d15/c56 0 2024-02-16T22:18:51.953 INFO:tasks.workunit.client.0.smithi134.stdout:0/229: write d2/d20/f23 [676399,10138] 0 2024-02-16T22:18:51.954 INFO:tasks.workunit.client.0.smithi134.stdout:5/262: write d2/d9/dc/f3a [839769,91506] 0 2024-02-16T22:18:51.960 INFO:tasks.workunit.client.0.smithi134.stdout:9/326: dwrite db/dc/f15 [0,4194304] 0 2024-02-16T22:18:51.960 INFO:tasks.workunit.client.0.smithi134.stdout:9/327: truncate db/d20/f39 975553 0 2024-02-16T22:18:51.963 INFO:tasks.workunit.client.0.smithi134.stdout:1/242: dread f3 [0,4194304] 0 2024-02-16T22:18:51.965 INFO:tasks.workunit.client.0.smithi134.stdout:3/253: dwrite da/d1c/f23 [0,4194304] 0 2024-02-16T22:18:51.965 INFO:tasks.workunit.client.0.smithi134.stdout:3/254: chown da/d2f/f3b 40617172 1 2024-02-16T22:18:51.965 INFO:tasks.workunit.client.0.smithi134.stdout:3/255: write da/d1c/f22 [5031287,28931] 0 2024-02-16T22:18:51.965 INFO:tasks.workunit.client.0.smithi134.stdout:3/256: chown da 40 1 2024-02-16T22:18:51.967 INFO:tasks.workunit.client.0.smithi134.stdout:6/269: dwrite d17/f42 [0,4194304] 0 2024-02-16T22:18:51.967 INFO:tasks.workunit.client.0.smithi134.stdout:6/270: creat d17/d27/f56 x:0 0 0 2024-02-16T22:18:51.967 INFO:tasks.workunit.client.0.smithi134.stdout:6/271: truncate d17/d22/d44/f4a 92829 0 2024-02-16T22:18:51.968 INFO:tasks.workunit.client.0.smithi134.stdout:1/243: unlink d5/da/d1c/f2f 0 2024-02-16T22:18:51.968 INFO:tasks.workunit.client.0.smithi134.stdout:1/244: readlink d5/da/d21/l3e 0 2024-02-16T22:18:51.970 INFO:tasks.workunit.client.0.smithi134.stdout:1/245: mkdir d5/da/d21/d52 0 2024-02-16T22:18:51.970 INFO:tasks.workunit.client.0.smithi134.stdout:0/230: dread d2/f1c [4194304,4194304] 0 2024-02-16T22:18:51.975 INFO:tasks.workunit.client.0.smithi134.stdout:1/246: dread d5/d1a/d23/f39 [0,4194304] 0 2024-02-16T22:18:51.975 INFO:tasks.workunit.client.0.smithi134.stdout:1/247: chown d5/da/d21 42122 1 2024-02-16T22:18:51.975 INFO:tasks.workunit.client.0.smithi134.stdout:1/248: chown d5/da/f1d 63648374 1 2024-02-16T22:18:51.975 INFO:tasks.workunit.client.0.smithi134.stdout:1/249: chown d5/da/d2d/d4b/f51 488510873 1 2024-02-16T22:18:51.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:51 smithi134 ceph-mon[28869]: mgrmap e20: smithi134.ordace(active, since 7m), standbys: smithi173.kbofaa 2024-02-16T22:18:51.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:51 smithi134 ceph-mon[28869]: pgmap v248: 65 pgs: 65 active+clean; 394 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 14 MiB/s rd, 28 MiB/s wr, 533 op/s 2024-02-16T22:18:51.979 INFO:tasks.workunit.client.0.smithi134.stdout:3/257: dread da/d1c/f1e [0,4194304] 0 2024-02-16T22:18:51.979 INFO:tasks.workunit.client.0.smithi134.stdout:3/258: creat da/d2f/f4e x:0 0 0 2024-02-16T22:18:51.979 INFO:tasks.workunit.client.0.smithi134.stdout:3/259: creat da/d12/d2a/f4f x:0 0 0 2024-02-16T22:18:51.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:51 smithi173 ceph-mon[37280]: mgrmap e20: smithi134.ordace(active, since 7m), standbys: smithi173.kbofaa 2024-02-16T22:18:51.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:51 smithi173 ceph-mon[37280]: pgmap v248: 65 pgs: 65 active+clean; 394 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 14 MiB/s rd, 28 MiB/s wr, 533 op/s 2024-02-16T22:18:51.986 INFO:tasks.workunit.client.0.smithi134.stdout:3/260: rename da/l30 to da/d1c/d24/d29/d40/l50 0 2024-02-16T22:18:51.990 INFO:tasks.workunit.client.0.smithi134.stdout:6/272: write d17/d27/d4f/f50 [3942807,124527] 0 2024-02-16T22:18:51.994 INFO:tasks.workunit.client.0.smithi134.stdout:5/263: dwrite d2/d9/dc/f24 [0,4194304] 0 2024-02-16T22:18:51.994 INFO:tasks.workunit.client.0.smithi134.stdout:8/222: dwrite d2/df/d18/f6 [4194304,4194304] 0 2024-02-16T22:18:51.997 INFO:tasks.workunit.client.0.smithi134.stdout:4/199: dwrite d0/d6/d8/fa [0,4194304] 0 2024-02-16T22:18:51.997 INFO:tasks.workunit.client.0.smithi134.stdout:6/273: write d17/f4c [1174623,79061] 0 2024-02-16T22:18:51.997 INFO:tasks.workunit.client.0.smithi134.stdout:6/274: readlink d17/l2a 0 2024-02-16T22:18:51.997 INFO:tasks.workunit.client.0.smithi134.stdout:5/264: unlink d2/d9/dc/f21 0 2024-02-16T22:18:52.000 INFO:tasks.workunit.client.0.smithi134.stdout:0/231: dwrite d2/dc/d32/f42 [0,4194304] 0 2024-02-16T22:18:52.007 INFO:tasks.workunit.client.0.smithi134.stdout:4/200: mkdir d0/d6/d44 0 2024-02-16T22:18:52.007 INFO:tasks.workunit.client.0.smithi134.stdout:6/275: write d17/f1c [487368,73181] 0 2024-02-16T22:18:52.007 INFO:tasks.workunit.client.0.smithi134.stdout:6/276: stat d17/l20 0 2024-02-16T22:18:52.007 INFO:tasks.workunit.client.0.smithi134.stdout:6/277: write d17/d22/f4b [984088,72356] 0 2024-02-16T22:18:52.010 INFO:tasks.workunit.client.0.smithi134.stdout:4/201: creat d0/d6/d1e/d39/f45 x:0 0 0 2024-02-16T22:18:52.011 INFO:tasks.workunit.client.0.smithi134.stdout:5/265: rename d2/d9/dc/d15/d2f/d3c/c40 to d2/d9/dc/c57 0 2024-02-16T22:18:52.011 INFO:tasks.workunit.client.0.smithi134.stdout:5/266: fdatasync d2/d35/d36/d3d/f4c 0 2024-02-16T22:18:52.011 INFO:tasks.workunit.client.0.smithi134.stdout:5/267: dread - d2/d9/f53 zero size 2024-02-16T22:18:52.012 INFO:tasks.workunit.client.0.smithi134.stdout:0/232: getdents d2/dc/d32/d3e 0 2024-02-16T22:18:52.012 INFO:tasks.workunit.client.0.smithi134.stdout:0/233: chown d2/f12 318545706 1 2024-02-16T22:18:52.013 INFO:tasks.workunit.client.0.smithi134.stdout:4/202: mkdir d0/d6/d16/d46 0 2024-02-16T22:18:52.014 INFO:tasks.workunit.client.0.smithi134.stdout:4/203: write d0/d6/f24 [149971,27402] 0 2024-02-16T22:18:52.014 INFO:tasks.workunit.client.0.smithi134.stdout:4/204: creat d0/d6/d22/d25/f47 x:0 0 0 2024-02-16T22:18:52.014 INFO:tasks.workunit.client.0.smithi134.stdout:5/268: creat d2/d35/f58 x:0 0 0 2024-02-16T22:18:52.015 INFO:tasks.workunit.client.0.smithi134.stdout:5/269: fsync d2/f4 0 2024-02-16T22:18:52.016 INFO:tasks.workunit.client.0.smithi134.stdout:5/270: mknod d2/d9/dc/d15/d2f/d30/c59 0 2024-02-16T22:18:52.016 INFO:tasks.workunit.client.0.smithi134.stdout:2/218: sync 2024-02-16T22:18:52.021 INFO:tasks.workunit.client.0.smithi134.stdout:6/278: dread d17/d22/f25 [0,4194304] 0 2024-02-16T22:18:52.021 INFO:tasks.workunit.client.0.smithi134.stdout:1/250: dwrite d5/f24 [0,4194304] 0 2024-02-16T22:18:52.022 INFO:tasks.workunit.client.0.smithi134.stdout:8/223: dwrite d2/df/d18/d12/f15 [0,4194304] 0 2024-02-16T22:18:52.022 INFO:tasks.workunit.client.0.smithi134.stdout:8/224: chown d2/f2c 10753 1 2024-02-16T22:18:52.022 INFO:tasks.workunit.client.0.smithi134.stdout:8/225: chown d2/df/l44 1943834272 1 2024-02-16T22:18:52.022 INFO:tasks.workunit.client.0.smithi134.stdout:5/271: write d2/d9/dc/f1d [403012,4366] 0 2024-02-16T22:18:52.025 INFO:tasks.workunit.client.0.smithi134.stdout:6/279: truncate d17/d22/f25 54166 0 2024-02-16T22:18:52.026 INFO:tasks.workunit.client.0.smithi134.stdout:6/280: dread d17/d27/d30/f33 [0,4194304] 0 2024-02-16T22:18:52.027 INFO:tasks.workunit.client.0.smithi134.stdout:6/281: stat d17/d27/f34 0 2024-02-16T22:18:52.027 INFO:tasks.workunit.client.0.smithi134.stdout:0/234: write d2/dc/d32/f42 [3035913,117596] 0 2024-02-16T22:18:52.027 INFO:tasks.workunit.client.0.smithi134.stdout:0/235: chown d2/l9 55732913 1 2024-02-16T22:18:52.027 INFO:tasks.workunit.client.0.smithi134.stdout:3/261: dwrite da/d1c/d24/f4a [0,4194304] 0 2024-02-16T22:18:52.027 INFO:tasks.workunit.client.0.smithi134.stdout:1/251: mkdir d5/d1a/d53 0 2024-02-16T22:18:52.029 INFO:tasks.workunit.client.0.smithi134.stdout:4/205: dread d0/d6/d16/f17 [4194304,4194304] 0 2024-02-16T22:18:52.033 INFO:tasks.workunit.client.0.smithi134.stdout:5/272: creat d2/d9/dc/d32/f5a x:0 0 0 2024-02-16T22:18:52.035 INFO:tasks.workunit.client.0.smithi134.stdout:6/282: symlink d17/d22/d28/l57 0 2024-02-16T22:18:52.042 INFO:tasks.workunit.client.0.smithi134.stdout:5/273: dread d2/f19 [0,4194304] 0 2024-02-16T22:18:52.042 INFO:tasks.workunit.client.0.smithi134.stdout:5/274: write d2/f50 [170420,26742] 0 2024-02-16T22:18:52.045 INFO:tasks.workunit.client.0.smithi134.stdout:3/262: write da/d1c/d24/f27 [1074893,112183] 0 2024-02-16T22:18:52.045 INFO:tasks.workunit.client.0.smithi134.stdout:3/263: fdatasync da/d1c/d24/f3d 0 2024-02-16T22:18:52.045 INFO:tasks.workunit.client.0.smithi134.stdout:3/264: chown da/d1c/f22 91453 1 2024-02-16T22:18:52.046 INFO:tasks.workunit.client.0.smithi134.stdout:0/236: mkdir d2/d4b/d53 0 2024-02-16T22:18:52.046 INFO:tasks.workunit.client.0.smithi134.stdout:0/237: chown d2/f16 18346688 1 2024-02-16T22:18:52.047 INFO:tasks.workunit.client.0.smithi134.stdout:6/283: rename d17/d22/f3c to d17/d36/f58 0 2024-02-16T22:18:52.052 INFO:tasks.workunit.client.0.smithi134.stdout:3/265: mkdir da/d1c/d24/d29/d51 0 2024-02-16T22:18:52.053 INFO:tasks.workunit.client.0.smithi134.stdout:0/238: getdents d2/dc/d2d 0 2024-02-16T22:18:52.053 INFO:tasks.workunit.client.0.smithi134.stdout:0/239: chown d2/dc 37623251 1 2024-02-16T22:18:52.055 INFO:tasks.workunit.client.0.smithi134.stdout:8/226: dwrite d2/df/d18/fc [0,4194304] 0 2024-02-16T22:18:52.056 INFO:tasks.workunit.client.0.smithi134.stdout:0/240: dread d2/d20/f29 [0,4194304] 0 2024-02-16T22:18:52.057 INFO:tasks.workunit.client.0.smithi134.stdout:0/241: write d2/f4e [319319,91006] 0 2024-02-16T22:18:52.057 INFO:tasks.workunit.client.0.smithi134.stdout:0/242: write d2/dc/f1d [5235670,62364] 0 2024-02-16T22:18:52.059 INFO:tasks.workunit.client.0.smithi134.stdout:0/243: creat d2/dc/d2d/f54 x:0 0 0 2024-02-16T22:18:52.063 INFO:tasks.workunit.client.0.smithi134.stdout:3/266: fsync da/d1c/d24/f27 0 2024-02-16T22:18:52.063 INFO:tasks.workunit.client.0.smithi134.stdout:3/267: chown da/d1c/d24 2457 1 2024-02-16T22:18:52.063 INFO:tasks.workunit.client.0.smithi134.stdout:1/252: dwrite d5/da/f1d [0,4194304] 0 2024-02-16T22:18:52.063 INFO:tasks.workunit.client.0.smithi134.stdout:3/268: creat da/d1c/d24/f52 x:0 0 0 2024-02-16T22:18:52.064 INFO:tasks.workunit.client.0.smithi134.stdout:4/206: dwrite d0/d6/d16/f20 [0,4194304] 0 2024-02-16T22:18:52.065 INFO:tasks.workunit.client.0.smithi134.stdout:5/275: dwrite d2/f6 [4194304,4194304] 0 2024-02-16T22:18:52.066 INFO:tasks.workunit.client.0.smithi134.stdout:5/276: fsync d2/d9/dc/f24 0 2024-02-16T22:18:52.066 INFO:tasks.workunit.client.0.smithi134.stdout:5/277: creat d2/d9/dc/d32/f5b x:0 0 0 2024-02-16T22:18:52.067 INFO:tasks.workunit.client.0.smithi134.stdout:3/269: rename da/d12/c26 to da/d1c/d24/c53 0 2024-02-16T22:18:52.067 INFO:tasks.workunit.client.0.smithi134.stdout:3/270: read - da/d12/d2a/f4f zero size 2024-02-16T22:18:52.067 INFO:tasks.workunit.client.0.smithi134.stdout:3/271: stat da/d1c/d24/d2c 0 2024-02-16T22:18:52.067 INFO:tasks.workunit.client.0.smithi134.stdout:3/272: creat da/d1c/f54 x:0 0 0 2024-02-16T22:18:52.067 INFO:tasks.workunit.client.0.smithi134.stdout:3/273: chown da/d1c/f46 40485 1 2024-02-16T22:18:52.067 INFO:tasks.workunit.client.0.smithi134.stdout:3/274: creat da/d2f/f55 x:0 0 0 2024-02-16T22:18:52.067 INFO:tasks.workunit.client.0.smithi134.stdout:3/275: read - da/d2f/f3f zero size 2024-02-16T22:18:52.067 INFO:tasks.workunit.client.0.smithi134.stdout:3/276: chown da/d1c/d24/c3e 459 1 2024-02-16T22:18:52.076 INFO:tasks.workunit.client.0.smithi134.stdout:4/207: rename d0/d6/d8/d32/f33 to d0/d6/d22/d25/f48 0 2024-02-16T22:18:52.079 INFO:tasks.workunit.client.0.smithi134.stdout:9/328: sync 2024-02-16T22:18:52.079 INFO:tasks.workunit.client.0.smithi134.stdout:7/231: sync 2024-02-16T22:18:52.079 INFO:tasks.workunit.client.0.smithi134.stdout:7/232: chown d2/d1e/l33 28004 1 2024-02-16T22:18:52.080 INFO:tasks.workunit.client.0.smithi134.stdout:4/208: rmdir d0/d6/d1e 39 2024-02-16T22:18:52.080 INFO:tasks.workunit.client.0.smithi134.stdout:4/209: truncate d0/d6/d22/d25/f48 77021 0 2024-02-16T22:18:52.080 INFO:tasks.workunit.client.0.smithi134.stdout:4/210: stat d0/d6/d1e/d39 0 2024-02-16T22:18:52.081 INFO:tasks.workunit.client.0.smithi134.stdout:3/277: mkdir da/d1c/d24/d29/d56 0 2024-02-16T22:18:52.081 INFO:tasks.workunit.client.0.smithi134.stdout:3/278: write da/d1c/d24/f52 [97039,37324] 0 2024-02-16T22:18:52.081 INFO:tasks.workunit.client.0.smithi134.stdout:3/279: chown da/d1c/f46 46 1 2024-02-16T22:18:52.082 INFO:tasks.workunit.client.0.smithi134.stdout:7/233: unlink d2/d1e/d24/f27 0 2024-02-16T22:18:52.083 INFO:tasks.workunit.client.0.smithi134.stdout:5/278: rename d2/d9/dc/d15/d2f/d3c to d2/d9/dc/d5c 0 2024-02-16T22:18:52.084 INFO:tasks.workunit.client.0.smithi134.stdout:4/211: creat d0/d6/d8/de/f49 x:0 0 0 2024-02-16T22:18:52.084 INFO:tasks.workunit.client.0.smithi134.stdout:7/234: truncate d2/ff 2109233 0 2024-02-16T22:18:52.085 INFO:tasks.workunit.client.0.smithi134.stdout:7/235: chown d2/d6/d17/f14 5650 1 2024-02-16T22:18:52.085 INFO:tasks.workunit.client.0.smithi134.stdout:7/236: chown d2/f1a 1049644921 1 2024-02-16T22:18:52.086 INFO:tasks.workunit.client.0.smithi134.stdout:9/329: rename db/cf to db/d20/d22/d64/d69/d6d/c70 0 2024-02-16T22:18:52.088 INFO:tasks.workunit.client.0.smithi134.stdout:9/330: getdents db/d20/d55 0 2024-02-16T22:18:52.093 INFO:tasks.workunit.client.0.smithi134.stdout:0/244: dwrite d2/dc/d2d/d34/f37 [0,4194304] 0 2024-02-16T22:18:52.093 INFO:tasks.workunit.client.0.smithi134.stdout:0/245: chown d2/f1c 248 1 2024-02-16T22:18:52.093 INFO:tasks.workunit.client.0.smithi134.stdout:0/246: dread - d2/dc/d2d/f54 zero size 2024-02-16T22:18:52.093 INFO:tasks.workunit.client.0.smithi134.stdout:0/247: fdatasync d2/dc/d2d/d34/f46 0 2024-02-16T22:18:52.093 INFO:tasks.workunit.client.0.smithi134.stdout:0/248: write d2/d20/d50/f51 [756744,103070] 0 2024-02-16T22:18:52.093 INFO:tasks.workunit.client.0.smithi134.stdout:8/227: dwrite d2/df/f1c [0,4194304] 0 2024-02-16T22:18:52.093 INFO:tasks.workunit.client.0.smithi134.stdout:3/280: dread da/d12/f17 [0,4194304] 0 2024-02-16T22:18:52.097 INFO:tasks.workunit.client.0.smithi134.stdout:0/249: creat d2/d4b/f55 x:0 0 0 2024-02-16T22:18:52.097 INFO:tasks.workunit.client.0.smithi134.stdout:5/279: write d2/f6 [4956708,36586] 0 2024-02-16T22:18:52.098 INFO:tasks.workunit.client.0.smithi134.stdout:1/253: dwrite d5/f24 [0,4194304] 0 2024-02-16T22:18:52.100 INFO:tasks.workunit.client.0.smithi134.stdout:8/228: truncate d2/f25 1128163 0 2024-02-16T22:18:52.104 INFO:tasks.workunit.client.0.smithi134.stdout:7/237: dread d2/fb [8388608,4194304] 0 2024-02-16T22:18:52.104 INFO:tasks.workunit.client.0.smithi134.stdout:0/250: mkdir d2/d56 0 2024-02-16T22:18:52.105 INFO:tasks.workunit.client.0.smithi134.stdout:0/251: fdatasync d2/dc/d48/f4c 0 2024-02-16T22:18:52.105 INFO:tasks.workunit.client.0.smithi134.stdout:0/252: chown d2/d20/f29 102 1 2024-02-16T22:18:52.111 INFO:tasks.workunit.client.0.smithi134.stdout:5/280: rename d2/d9/dc/d15/l16 to d2/l5d 0 2024-02-16T22:18:52.113 INFO:tasks.workunit.client.0.smithi134.stdout:0/253: rename d2/d4b/f55 to d2/dc/d48/f57 0 2024-02-16T22:18:52.114 INFO:tasks.workunit.client.0.smithi134.stdout:0/254: chown d2/d20/f23 102139844 1 2024-02-16T22:18:52.115 INFO:tasks.workunit.client.0.smithi134.stdout:5/281: symlink d2/d9/dc/d27/d4b/l5e 0 2024-02-16T22:18:52.116 INFO:tasks.workunit.client.0.smithi134.stdout:0/255: unlink d2/d20/f35 0 2024-02-16T22:18:52.118 INFO:tasks.workunit.client.0.smithi134.stdout:0/256: rmdir d2/dc/d32 39 2024-02-16T22:18:52.118 INFO:tasks.workunit.client.0.smithi134.stdout:8/229: write d2/df/f1c [47483,105619] 0 2024-02-16T22:18:52.118 INFO:tasks.workunit.client.0.smithi134.stdout:8/230: chown d2/df/d18/d12/l13 4512071 1 2024-02-16T22:18:52.118 INFO:tasks.workunit.client.0.smithi134.stdout:8/231: chown d2/df/d18/d2a/d41 728 1 2024-02-16T22:18:52.121 INFO:tasks.workunit.client.0.smithi134.stdout:9/331: dwrite db/d20/d22/f44 [0,4194304] 0 2024-02-16T22:18:52.122 INFO:tasks.workunit.client.0.smithi134.stdout:9/332: dread - db/dc/f68 zero size 2024-02-16T22:18:52.122 INFO:tasks.workunit.client.0.smithi134.stdout:8/232: truncate d2/f36 2091294 0 2024-02-16T22:18:52.122 INFO:tasks.workunit.client.0.smithi134.stdout:8/233: readlink d2/l1a 0 2024-02-16T22:18:52.122 INFO:tasks.workunit.client.0.smithi134.stdout:8/234: readlink d2/df/l38 0 2024-02-16T22:18:52.125 INFO:tasks.workunit.client.0.smithi134.stdout:4/212: dwrite d0/d6/d16/f20 [0,4194304] 0 2024-02-16T22:18:52.138 INFO:tasks.workunit.client.0.smithi134.stdout:3/281: dwrite da/d12/f25 [0,4194304] 0 2024-02-16T22:18:52.138 INFO:tasks.workunit.client.0.smithi134.stdout:1/254: dwrite d5/da/f14 [0,4194304] 0 2024-02-16T22:18:52.138 INFO:tasks.workunit.client.0.smithi134.stdout:1/255: fsync d5/d1a/f40 0 2024-02-16T22:18:52.144 INFO:tasks.workunit.client.0.smithi134.stdout:7/238: dwrite d2/f1a [0,4194304] 0 2024-02-16T22:18:52.144 INFO:tasks.workunit.client.0.smithi134.stdout:7/239: write d2/d1e/f39 [484916,90011] 0 2024-02-16T22:18:52.304 INFO:tasks.workunit.client.0.smithi134.stdout:8/235: symlink d2/df/d19/d40/l48 0 2024-02-16T22:18:52.305 INFO:tasks.workunit.client.0.smithi134.stdout:4/213: write d0/d6/d16/f28 [905726,20046] 0 2024-02-16T22:18:52.305 INFO:tasks.workunit.client.0.smithi134.stdout:4/214: fdatasync d0/d6/d8/d30/f42 0 2024-02-16T22:18:52.307 INFO:tasks.workunit.client.0.smithi134.stdout:1/256: write f3 [394553,102241] 0 2024-02-16T22:18:52.313 INFO:tasks.workunit.client.0.smithi134.stdout:3/282: mknod da/d1c/d24/d29/d51/c57 0 2024-02-16T22:18:52.316 INFO:tasks.workunit.client.0.smithi134.stdout:5/282: dwrite d2/d35/f58 [0,4194304] 0 2024-02-16T22:18:52.317 INFO:tasks.workunit.client.0.smithi134.stdout:0/257: dwrite d2/f26 [0,4194304] 0 2024-02-16T22:18:52.317 INFO:tasks.workunit.client.0.smithi134.stdout:0/258: read - d2/dc/d2d/f54 zero size 2024-02-16T22:18:52.318 INFO:tasks.workunit.client.0.smithi134.stdout:9/333: dwrite db/d20/d22/f25 [0,4194304] 0 2024-02-16T22:18:52.319 INFO:tasks.workunit.client.0.smithi134.stdout:8/236: unlink d2/df/d18/d12/f2d 0 2024-02-16T22:18:52.320 INFO:tasks.workunit.client.0.smithi134.stdout:9/334: write db/d20/d22/f2f [386527,27411] 0 2024-02-16T22:18:52.321 INFO:tasks.workunit.client.0.smithi134.stdout:4/215: mknod d0/c4a 0 2024-02-16T22:18:52.325 INFO:tasks.workunit.client.0.smithi134.stdout:1/257: creat d5/da/d2d/f54 x:0 0 0 2024-02-16T22:18:52.326 INFO:tasks.workunit.client.0.smithi134.stdout:1/258: dread f1 [0,4194304] 0 2024-02-16T22:18:52.330 INFO:tasks.workunit.client.0.smithi134.stdout:2/219: sync 2024-02-16T22:18:52.331 INFO:tasks.workunit.client.0.smithi134.stdout:4/216: write d0/d6/d8/d32/f38 [2688585,126195] 0 2024-02-16T22:18:52.331 INFO:tasks.workunit.client.0.smithi134.stdout:5/283: mknod d2/d35/d36/d46/c5f 0 2024-02-16T22:18:52.332 INFO:tasks.workunit.client.0.smithi134.stdout:6/284: sync 2024-02-16T22:18:52.335 INFO:tasks.workunit.client.0.smithi134.stdout:7/240: symlink d2/d6/l4f 0 2024-02-16T22:18:52.336 INFO:tasks.workunit.client.0.smithi134.stdout:0/259: unlink d2/d20/d50/c52 0 2024-02-16T22:18:52.340 INFO:tasks.workunit.client.0.smithi134.stdout:9/335: link c6 db/d20/d55/c71 0 2024-02-16T22:18:52.341 INFO:tasks.workunit.client.0.smithi134.stdout:2/220: write df/d10/d11/d17/d1b/f2f [1812940,33439] 0 2024-02-16T22:18:52.342 INFO:tasks.workunit.client.0.smithi134.stdout:5/284: symlink d2/d9/dc/d27/d4b/l60 0 2024-02-16T22:18:52.343 INFO:tasks.workunit.client.0.smithi134.stdout:0/260: symlink d2/d20/l58 0 2024-02-16T22:18:52.343 INFO:tasks.workunit.client.0.smithi134.stdout:0/261: chown d2/d4b/d53 0 1 2024-02-16T22:18:52.343 INFO:tasks.workunit.client.0.smithi134.stdout:9/336: chown db/c13 3918443 1 2024-02-16T22:18:52.343 INFO:tasks.workunit.client.0.smithi134.stdout:4/217: rmdir d0/d6/d22/d40 39 2024-02-16T22:18:52.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/285: mkdir d2/d9/dc/d32/d61 0 2024-02-16T22:18:52.346 INFO:tasks.workunit.client.0.smithi134.stdout:7/241: mknod d2/d6/d17/d25/c50 0 2024-02-16T22:18:52.349 INFO:tasks.workunit.client.0.smithi134.stdout:5/286: mknod d2/d35/d36/d3d/c62 0 2024-02-16T22:18:52.349 INFO:tasks.workunit.client.0.smithi134.stdout:1/259: dwrite d5/d1a/d23/d3c/f41 [0,4194304] 0 2024-02-16T22:18:52.349 INFO:tasks.workunit.client.0.smithi134.stdout:9/337: mknod db/c72 0 2024-02-16T22:18:52.352 INFO:tasks.workunit.client.0.smithi134.stdout:1/260: mknod d5/da/d1c/c55 0 2024-02-16T22:18:52.352 INFO:tasks.workunit.client.0.smithi134.stdout:1/261: creat d5/da/d21/d45/f56 x:0 0 0 2024-02-16T22:18:52.352 INFO:tasks.workunit.client.0.smithi134.stdout:1/262: chown f3 12 1 2024-02-16T22:18:52.355 INFO:tasks.workunit.client.0.smithi134.stdout:9/338: mkdir db/d20/d55/d73 0 2024-02-16T22:18:52.355 INFO:tasks.workunit.client.0.smithi134.stdout:2/221: write df/d10/d15/f1d [1599916,27051] 0 2024-02-16T22:18:52.357 INFO:tasks.workunit.client.0.smithi134.stdout:6/285: write d17/f3a [2202701,44722] 0 2024-02-16T22:18:52.357 INFO:tasks.workunit.client.0.smithi134.stdout:6/286: creat d17/d27/d4f/f59 x:0 0 0 2024-02-16T22:18:52.357 INFO:tasks.workunit.client.0.smithi134.stdout:6/287: chown d17/d22/c23 49 1 2024-02-16T22:18:52.357 INFO:tasks.workunit.client.0.smithi134.stdout:8/237: dwrite d2/df/d19/f31 [0,4194304] 0 2024-02-16T22:18:52.359 INFO:tasks.workunit.client.0.smithi134.stdout:2/222: read df/d10/d11/d17/d1b/f22 [434021,71984] 0 2024-02-16T22:18:52.362 INFO:tasks.workunit.client.0.smithi134.stdout:0/262: truncate d2/f26 844874 0 2024-02-16T22:18:52.365 INFO:tasks.workunit.client.0.smithi134.stdout:6/288: symlink d17/d27/d30/l5a 0 2024-02-16T22:18:52.365 INFO:tasks.workunit.client.0.smithi134.stdout:6/289: chown d17/d27/d30/c41 7 1 2024-02-16T22:18:52.367 INFO:tasks.workunit.client.0.smithi134.stdout:2/223: dread df/d10/d15/f2e [0,4194304] 0 2024-02-16T22:18:52.367 INFO:tasks.workunit.client.0.smithi134.stdout:2/224: fdatasync df/d10/d11/d17/d1b/f22 0 2024-02-16T22:18:52.368 INFO:tasks.workunit.client.0.smithi134.stdout:8/238: rename d2/df/d19/f31 to d2/df/d19/d47/f49 0 2024-02-16T22:18:52.370 INFO:tasks.workunit.client.0.smithi134.stdout:1/263: dread d5/da/d2d/f34 [0,4194304] 0 2024-02-16T22:18:52.374 INFO:tasks.workunit.client.0.smithi134.stdout:6/290: mkdir d17/d22/d28/d5b 0 2024-02-16T22:18:52.376 INFO:tasks.workunit.client.0.smithi134.stdout:2/225: creat df/d10/f3b x:0 0 0 2024-02-16T22:18:52.377 INFO:tasks.workunit.client.0.smithi134.stdout:1/264: mknod d5/da/d21/c57 0 2024-02-16T22:18:52.377 INFO:tasks.workunit.client.0.smithi134.stdout:1/265: truncate d5/da/d21/f4a 538992 0 2024-02-16T22:18:52.377 INFO:tasks.workunit.client.0.smithi134.stdout:0/263: symlink d2/dc/d2d/l59 0 2024-02-16T22:18:52.379 INFO:tasks.workunit.client.0.smithi134.stdout:1/266: truncate d5/da/d2d/d4b/f51 3647783 0 2024-02-16T22:18:52.379 INFO:tasks.workunit.client.0.smithi134.stdout:1/267: dread - d5/da/d21/d45/f4e zero size 2024-02-16T22:18:52.379 INFO:tasks.workunit.client.0.smithi134.stdout:0/264: symlink d2/dc/d32/d45/l5a 0 2024-02-16T22:18:52.380 INFO:tasks.workunit.client.0.smithi134.stdout:1/268: truncate d5/f24 4144099 0 2024-02-16T22:18:52.382 INFO:tasks.workunit.client.0.smithi134.stdout:7/242: dwrite d2/d1e/d24/f3c [4194304,4194304] 0 2024-02-16T22:18:52.384 INFO:tasks.workunit.client.0.smithi134.stdout:2/226: fsync df/d10/d11/d17/d1b/f23 0 2024-02-16T22:18:52.384 INFO:tasks.workunit.client.0.smithi134.stdout:2/227: chown df/d10/d15/f1e 10886616 1 2024-02-16T22:18:52.384 INFO:tasks.workunit.client.0.smithi134.stdout:4/218: dwrite d0/f11 [0,4194304] 0 2024-02-16T22:18:52.384 INFO:tasks.workunit.client.0.smithi134.stdout:9/339: dwrite db/f29 [4194304,4194304] 0 2024-02-16T22:18:52.386 INFO:tasks.workunit.client.0.smithi134.stdout:7/243: rmdir d2/d5/d22/d26/d38 0 2024-02-16T22:18:52.386 INFO:tasks.workunit.client.0.smithi134.stdout:7/244: readlink d2/d1e/l33 0 2024-02-16T22:18:52.386 INFO:tasks.workunit.client.0.smithi134.stdout:7/245: chown d2/fb 9563 1 2024-02-16T22:18:52.388 INFO:tasks.workunit.client.0.smithi134.stdout:8/239: dwrite d2/df/f10 [0,4194304] 0 2024-02-16T22:18:52.388 INFO:tasks.workunit.client.0.smithi134.stdout:6/291: write d17/d22/f2e [2425402,106043] 0 2024-02-16T22:18:52.389 INFO:tasks.workunit.client.0.smithi134.stdout:2/228: creat df/f3c x:0 0 0 2024-02-16T22:18:52.389 INFO:tasks.workunit.client.0.smithi134.stdout:2/229: write df/d10/d15/f28 [985843,61850] 0 2024-02-16T22:18:52.391 INFO:tasks.workunit.client.0.smithi134.stdout:5/287: dwrite d2/d35/d36/f37 [0,4194304] 0 2024-02-16T22:18:52.392 INFO:tasks.workunit.client.0.smithi134.stdout:7/246: write d2/d6/d17/f23 [1521394,91729] 0 2024-02-16T22:18:52.396 INFO:tasks.workunit.client.0.smithi134.stdout:6/292: symlink d17/d22/l5c 0 2024-02-16T22:18:52.396 INFO:tasks.workunit.client.0.smithi134.stdout:6/293: chown d17/d27/d30/c41 6 1 2024-02-16T22:18:52.399 INFO:tasks.workunit.client.0.smithi134.stdout:2/230: symlink df/d10/d15/l3d 0 2024-02-16T22:18:52.403 INFO:tasks.workunit.client.0.smithi134.stdout:7/247: symlink d2/d5/d22/l51 0 2024-02-16T22:18:52.408 INFO:tasks.workunit.client.0.smithi134.stdout:8/240: rmdir d2 39 2024-02-16T22:18:52.410 INFO:tasks.workunit.client.0.smithi134.stdout:0/265: dwrite d2/f40 [0,4194304] 0 2024-02-16T22:18:52.411 INFO:tasks.workunit.client.0.smithi134.stdout:6/294: rename c1 to d17/d22/d28/c5d 0 2024-02-16T22:18:52.413 INFO:tasks.workunit.client.0.smithi134.stdout:7/248: link d2/d6/d17/d31/d28/l2c d2/d7/l52 0 2024-02-16T22:18:52.413 INFO:tasks.workunit.client.0.smithi134.stdout:7/249: creat d2/d6/d17/d25/f53 x:0 0 0 2024-02-16T22:18:52.413 INFO:tasks.workunit.client.0.smithi134.stdout:7/250: dread - d2/d6/d17/d31/d28/f36 zero size 2024-02-16T22:18:52.413 INFO:tasks.workunit.client.0.smithi134.stdout:7/251: creat d2/d1e/f54 x:0 0 0 2024-02-16T22:18:52.415 INFO:tasks.workunit.client.0.smithi134.stdout:1/269: dwrite d5/da/d21/f37 [0,4194304] 0 2024-02-16T22:18:52.415 INFO:tasks.workunit.client.0.smithi134.stdout:9/340: dwrite db/dc/f14 [0,4194304] 0 2024-02-16T22:18:52.415 INFO:tasks.workunit.client.0.smithi134.stdout:9/341: readlink db/d20/d22/d46/l4f 0 2024-02-16T22:18:52.415 INFO:tasks.workunit.client.0.smithi134.stdout:5/288: dwrite d2/f18 [0,4194304] 0 2024-02-16T22:18:52.416 INFO:tasks.workunit.client.0.smithi134.stdout:8/241: rename d2/df/d18/l34 to d2/df/d18/l4a 0 2024-02-16T22:18:52.418 INFO:tasks.workunit.client.0.smithi134.stdout:0/266: write d2/f4e [1403854,100911] 0 2024-02-16T22:18:52.421 INFO:tasks.workunit.client.0.smithi134.stdout:6/295: symlink d17/d27/d4f/d52/l5e 0 2024-02-16T22:18:52.426 INFO:tasks.workunit.client.0.smithi134.stdout:9/342: dread db/f57 [0,4194304] 0 2024-02-16T22:18:52.426 INFO:tasks.workunit.client.0.smithi134.stdout:7/252: dread d2/f1a [0,4194304] 0 2024-02-16T22:18:52.427 INFO:tasks.workunit.client.0.smithi134.stdout:1/270: dread d5/da/d21/f37 [0,4194304] 0 2024-02-16T22:18:52.432 INFO:tasks.workunit.client.0.smithi134.stdout:5/289: dwrite d2/d9/dc/f24 [0,4194304] 0 2024-02-16T22:18:52.434 INFO:tasks.workunit.client.0.smithi134.stdout:8/242: link d2/df/d19/d40/l48 d2/l4b 0 2024-02-16T22:18:52.436 INFO:tasks.workunit.client.0.smithi134.stdout:6/296: link d17/d27/d4f/f50 d17/d22/f5f 0 2024-02-16T22:18:52.438 INFO:tasks.workunit.client.0.smithi134.stdout:9/343: creat db/d20/d22/d51/f74 x:0 0 0 2024-02-16T22:18:52.438 INFO:tasks.workunit.client.0.smithi134.stdout:9/344: fsync db/d20/d22/d46/f49 0 2024-02-16T22:18:52.442 INFO:tasks.workunit.client.0.smithi134.stdout:0/267: unlink d2/f27 0 2024-02-16T22:18:52.442 INFO:tasks.workunit.client.0.smithi134.stdout:6/297: dread d17/d22/f2e [0,4194304] 0 2024-02-16T22:18:52.445 INFO:tasks.workunit.client.0.smithi134.stdout:6/298: rename d17/d27/d4f/d52/l5e to d17/d27/d4f/d52/l60 0 2024-02-16T22:18:52.445 INFO:tasks.workunit.client.0.smithi134.stdout:6/299: write d17/d27/d30/f35 [5044277,59218] 0 2024-02-16T22:18:52.445 INFO:tasks.workunit.client.0.smithi134.stdout:6/300: chown d17/d22/f25 1602094 1 2024-02-16T22:18:52.446 INFO:tasks.workunit.client.0.smithi134.stdout:9/345: mknod db/d20/d32/c75 0 2024-02-16T22:18:52.446 INFO:tasks.workunit.client.0.smithi134.stdout:9/346: readlink db/d20/d22/l53 0 2024-02-16T22:18:52.446 INFO:tasks.workunit.client.0.smithi134.stdout:9/347: fdatasync f8 0 2024-02-16T22:18:52.447 INFO:tasks.workunit.client.0.smithi134.stdout:6/301: mkdir d17/d27/d61 0 2024-02-16T22:18:52.448 INFO:tasks.workunit.client.0.smithi134.stdout:6/302: rmdir d17/d22/d28 39 2024-02-16T22:18:52.449 INFO:tasks.workunit.client.0.smithi134.stdout:3/283: sync 2024-02-16T22:18:52.451 INFO:tasks.workunit.client.0.smithi134.stdout:5/290: dread d2/d9/dc/f13 [0,4194304] 0 2024-02-16T22:18:52.451 INFO:tasks.workunit.client.0.smithi134.stdout:7/253: dwrite d2/d6/d17/d25/f2a [0,4194304] 0 2024-02-16T22:18:52.451 INFO:tasks.workunit.client.0.smithi134.stdout:5/291: fdatasync d2/d35/d36/f37 0 2024-02-16T22:18:52.451 INFO:tasks.workunit.client.0.smithi134.stdout:7/254: write d2/d5/d22/f4e [51207,83609] 0 2024-02-16T22:18:52.451 INFO:tasks.workunit.client.0.smithi134.stdout:8/243: getdents d2 0 2024-02-16T22:18:52.451 INFO:tasks.workunit.client.0.smithi134.stdout:8/244: fsync d2/f24 0 2024-02-16T22:18:52.451 INFO:tasks.workunit.client.0.smithi134.stdout:8/245: fdatasync d2/df/d18/d27/f30 0 2024-02-16T22:18:52.454 INFO:tasks.workunit.client.0.smithi134.stdout:5/292: rename d2/d9/dc/d15/d2f/d30 to d2/d35/d36/d3d/d63 0 2024-02-16T22:18:52.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/303: dread d17/f1c [0,4194304] 0 2024-02-16T22:18:52.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/304: creat d17/d27/f62 x:0 0 0 2024-02-16T22:18:52.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/305: chown d17/f2d 112 1 2024-02-16T22:18:52.456 INFO:tasks.workunit.client.0.smithi134.stdout:8/246: symlink d2/df/d18/d27/l4c 0 2024-02-16T22:18:52.456 INFO:tasks.workunit.client.0.smithi134.stdout:8/247: fsync d2/df/d18/fc 0 2024-02-16T22:18:52.457 INFO:tasks.workunit.client.0.smithi134.stdout:0/268: dread d2/f16 [0,4194304] 0 2024-02-16T22:18:52.457 INFO:tasks.workunit.client.0.smithi134.stdout:0/269: stat d2/dc/f1e 0 2024-02-16T22:18:52.457 INFO:tasks.workunit.client.0.smithi134.stdout:0/270: write d2/dc/f4f [66399,110504] 0 2024-02-16T22:18:52.464 INFO:tasks.workunit.client.0.smithi134.stdout:6/306: rmdir d17/d27/d61 0 2024-02-16T22:18:52.464 INFO:tasks.workunit.client.0.smithi134.stdout:8/248: creat d2/df/d18/d2a/d41/f4d x:0 0 0 2024-02-16T22:18:52.464 INFO:tasks.workunit.client.0.smithi134.stdout:8/249: dread - d2/f35 zero size 2024-02-16T22:18:52.465 INFO:tasks.workunit.client.0.smithi134.stdout:8/250: fsync d2/df/f3b 0 2024-02-16T22:18:52.476 INFO:tasks.workunit.client.0.smithi134.stdout:6/307: dread d17/d22/f47 [0,4194304] 0 2024-02-16T22:18:52.476 INFO:tasks.workunit.client.0.smithi134.stdout:6/308: stat d17/l1e 0 2024-02-16T22:18:52.478 INFO:tasks.workunit.client.0.smithi134.stdout:8/251: read d2/df/d18/f6 [3959393,46671] 0 2024-02-16T22:18:52.479 INFO:tasks.workunit.client.0.smithi134.stdout:8/252: creat d2/df/d18/d12/f4e x:0 0 0 2024-02-16T22:18:52.480 INFO:tasks.workunit.client.0.smithi134.stdout:6/309: dread d17/d22/f2e [0,4194304] 0 2024-02-16T22:18:52.480 INFO:tasks.workunit.client.0.smithi134.stdout:8/253: creat d2/df/d19/f4f x:0 0 0 2024-02-16T22:18:52.481 INFO:tasks.workunit.client.0.smithi134.stdout:6/310: mkdir d17/d63 0 2024-02-16T22:18:52.481 INFO:tasks.workunit.client.0.smithi134.stdout:6/311: chown d17/f42 0 1 2024-02-16T22:18:52.481 INFO:tasks.workunit.client.0.smithi134.stdout:6/312: creat d17/d22/d44/f64 x:0 0 0 2024-02-16T22:18:52.481 INFO:tasks.workunit.client.0.smithi134.stdout:6/313: stat d17/f51 0 2024-02-16T22:18:52.482 INFO:tasks.workunit.client.0.smithi134.stdout:8/254: symlink d2/df/d18/l50 0 2024-02-16T22:18:52.482 INFO:tasks.workunit.client.0.smithi134.stdout:8/255: readlink d2/df/d18/d12/d3d/l3f 0 2024-02-16T22:18:52.482 INFO:tasks.workunit.client.0.smithi134.stdout:8/256: creat d2/df/d19/f51 x:0 0 0 2024-02-16T22:18:52.484 INFO:tasks.workunit.client.0.smithi134.stdout:8/257: rename d2/df/d18/d12/l13 to d2/df/d18/d12/l52 0 2024-02-16T22:18:52.486 INFO:tasks.workunit.client.0.smithi134.stdout:8/258: mkdir d2/df/d19/d40/d53 0 2024-02-16T22:18:52.488 INFO:tasks.workunit.client.0.smithi134.stdout:8/259: symlink d2/df/d19/l54 0 2024-02-16T22:18:52.488 INFO:tasks.workunit.client.0.smithi134.stdout:8/260: readlink d2/df/l44 0 2024-02-16T22:18:52.488 INFO:tasks.workunit.client.0.smithi134.stdout:7/255: dwrite d2/d6/d17/f14 [0,4194304] 0 2024-02-16T22:18:52.488 INFO:tasks.workunit.client.0.smithi134.stdout:7/256: creat d2/d1e/f55 x:0 0 0 2024-02-16T22:18:52.488 INFO:tasks.workunit.client.0.smithi134.stdout:7/257: creat d2/d6/d17/f56 x:0 0 0 2024-02-16T22:18:52.488 INFO:tasks.workunit.client.0.smithi134.stdout:7/258: truncate d2/d1e/f39 1391000 0 2024-02-16T22:18:52.488 INFO:tasks.workunit.client.0.smithi134.stdout:9/348: dwrite db/dc/f14 [0,4194304] 0 2024-02-16T22:18:52.489 INFO:tasks.workunit.client.0.smithi134.stdout:8/261: mknod d2/df/d19/d40/d53/c55 0 2024-02-16T22:18:52.490 INFO:tasks.workunit.client.0.smithi134.stdout:0/271: dwrite d2/f4e [0,4194304] 0 2024-02-16T22:18:52.492 INFO:tasks.workunit.client.0.smithi134.stdout:5/293: dwrite d2/f4 [0,4194304] 0 2024-02-16T22:18:52.495 INFO:tasks.workunit.client.0.smithi134.stdout:0/272: dread d2/dc/d32/f42 [0,4194304] 0 2024-02-16T22:18:52.497 INFO:tasks.workunit.client.0.smithi134.stdout:6/314: dwrite d17/d22/f5f [0,4194304] 0 2024-02-16T22:18:52.497 INFO:tasks.workunit.client.0.smithi134.stdout:8/262: rename d2/df/d19/f29 to d2/df/d18/d12/d3d/f56 0 2024-02-16T22:18:52.499 INFO:tasks.workunit.client.0.smithi134.stdout:6/315: fsync d17/d22/d44/f64 0 2024-02-16T22:18:52.500 INFO:tasks.workunit.client.0.smithi134.stdout:6/316: dread - d17/d22/f54 zero size 2024-02-16T22:18:52.502 INFO:tasks.workunit.client.0.smithi134.stdout:7/259: getdents d2/d6/d17/d25 0 2024-02-16T22:18:52.504 INFO:tasks.workunit.client.0.smithi134.stdout:9/349: mknod db/c76 0 2024-02-16T22:18:52.504 INFO:tasks.workunit.client.0.smithi134.stdout:9/350: stat db/d20/d22/d46/l4f 0 2024-02-16T22:18:52.506 INFO:tasks.workunit.client.0.smithi134.stdout:8/263: dread d2/df/f10 [0,4194304] 0 2024-02-16T22:18:52.509 INFO:tasks.workunit.client.0.smithi134.stdout:0/273: dread d2/f11 [0,4194304] 0 2024-02-16T22:18:52.509 INFO:tasks.workunit.client.0.smithi134.stdout:7/260: mknod d2/d5/c57 0 2024-02-16T22:18:52.510 INFO:tasks.workunit.client.0.smithi134.stdout:7/261: fdatasync d2/fb 0 2024-02-16T22:18:52.510 INFO:tasks.workunit.client.0.smithi134.stdout:7/262: chown d2/fb 908 1 2024-02-16T22:18:52.511 INFO:tasks.workunit.client.0.smithi134.stdout:8/264: creat d2/df/d18/d2a/f57 x:0 0 0 2024-02-16T22:18:52.511 INFO:tasks.workunit.client.0.smithi134.stdout:9/351: write db/dc/f12 [2812009,25901] 0 2024-02-16T22:18:52.513 INFO:tasks.workunit.client.0.smithi134.stdout:5/294: rmdir d2/d9/dc/d5c 0 2024-02-16T22:18:52.513 INFO:tasks.workunit.client.0.smithi134.stdout:5/295: chown d2/d9/dc/fe 81 1 2024-02-16T22:18:52.514 INFO:tasks.workunit.client.0.smithi134.stdout:0/274: truncate d2/dc/d32/f42 1130510 0 2024-02-16T22:18:52.515 INFO:tasks.workunit.client.0.smithi134.stdout:8/265: symlink d2/df/d18/l58 0 2024-02-16T22:18:52.517 INFO:tasks.workunit.client.0.smithi134.stdout:5/296: truncate d2/d9/dc/d15/f41 562715 0 2024-02-16T22:18:52.520 INFO:tasks.workunit.client.0.smithi134.stdout:8/266: rename d2/df/d18/d12/d3d to d2/df/d18/d2a/d41/d59 0 2024-02-16T22:18:52.520 INFO:tasks.workunit.client.0.smithi134.stdout:9/352: symlink db/d20/d22/l77 0 2024-02-16T22:18:52.521 INFO:tasks.workunit.client.0.smithi134.stdout:6/317: dwrite f6 [0,4194304] 0 2024-02-16T22:18:52.521 INFO:tasks.workunit.client.0.smithi134.stdout:6/318: fsync d17/d22/f54 0 2024-02-16T22:18:52.521 INFO:tasks.workunit.client.0.smithi134.stdout:6/319: chown d17/d22/l5c 111 1 2024-02-16T22:18:52.522 INFO:tasks.workunit.client.0.smithi134.stdout:0/275: write d2/f16 [2773134,56980] 0 2024-02-16T22:18:52.522 INFO:tasks.workunit.client.0.smithi134.stdout:9/353: rmdir db/dc/d5a 0 2024-02-16T22:18:52.524 INFO:tasks.workunit.client.0.smithi134.stdout:8/267: write d2/f25 [105897,16130] 0 2024-02-16T22:18:52.524 INFO:tasks.workunit.client.0.smithi134.stdout:8/268: fsync d2/f2c 0 2024-02-16T22:18:52.525 INFO:tasks.workunit.client.0.smithi134.stdout:2/231: sync 2024-02-16T22:18:52.525 INFO:tasks.workunit.client.0.smithi134.stdout:1/271: sync 2024-02-16T22:18:52.525 INFO:tasks.workunit.client.0.smithi134.stdout:4/219: sync 2024-02-16T22:18:52.525 INFO:tasks.workunit.client.0.smithi134.stdout:4/220: read - d0/d6/d1e/d39/f45 zero size 2024-02-16T22:18:52.525 INFO:tasks.workunit.client.0.smithi134.stdout:1/272: chown d5/da/fb 247628502 1 2024-02-16T22:18:52.525 INFO:tasks.workunit.client.0.smithi134.stdout:1/273: write d5/d1a/f40 [323603,91736] 0 2024-02-16T22:18:52.525 INFO:tasks.workunit.client.0.smithi134.stdout:1/274: creat d5/da/d21/d45/f58 x:0 0 0 2024-02-16T22:18:52.531 INFO:tasks.workunit.client.0.smithi134.stdout:0/276: dread d2/d20/f29 [0,4194304] 0 2024-02-16T22:18:52.531 INFO:tasks.workunit.client.0.smithi134.stdout:9/354: rmdir db/d20/d55/d73 0 2024-02-16T22:18:52.539 INFO:tasks.workunit.client.0.smithi134.stdout:8/269: rename d2/df/d19/d47 to d2/df/d18/d5a 0 2024-02-16T22:18:52.541 INFO:tasks.workunit.client.0.smithi134.stdout:9/355: link db/dc/c1c db/d20/d22/d64/d69/c78 0 2024-02-16T22:18:52.542 INFO:tasks.workunit.client.0.smithi134.stdout:1/275: getdents d5/da/d1c 0 2024-02-16T22:18:52.542 INFO:tasks.workunit.client.0.smithi134.stdout:1/276: chown d5/da/d1c/f49 33 1 2024-02-16T22:18:52.544 INFO:tasks.workunit.client.0.smithi134.stdout:8/270: creat d2/df/f5b x:0 0 0 2024-02-16T22:18:52.544 INFO:tasks.workunit.client.0.smithi134.stdout:9/356: symlink db/dc/l79 0 2024-02-16T22:18:52.545 INFO:tasks.workunit.client.0.smithi134.stdout:9/357: fdatasync db/dc/f66 0 2024-02-16T22:18:52.545 INFO:tasks.workunit.client.0.smithi134.stdout:1/277: mknod d5/d1a/d23/c59 0 2024-02-16T22:18:52.546 INFO:tasks.workunit.client.0.smithi134.stdout:8/271: mkdir d2/df/d18/d2a/d5c 0 2024-02-16T22:18:52.546 INFO:tasks.workunit.client.0.smithi134.stdout:8/272: chown d2/df/d19 1 1 2024-02-16T22:18:52.547 INFO:tasks.workunit.client.0.smithi134.stdout:9/358: symlink db/d20/d22/d64/d69/l7a 0 2024-02-16T22:18:52.547 INFO:tasks.workunit.client.0.smithi134.stdout:9/359: truncate db/d20/f28 421378 0 2024-02-16T22:18:52.547 INFO:tasks.workunit.client.0.smithi134.stdout:9/360: chown db/d20/d22 108168 1 2024-02-16T22:18:52.547 INFO:tasks.workunit.client.0.smithi134.stdout:9/361: creat db/d20/d22/d51/f7b x:0 0 0 2024-02-16T22:18:52.547 INFO:tasks.workunit.client.0.smithi134.stdout:9/362: stat db/dc 0 2024-02-16T22:18:52.547 INFO:tasks.workunit.client.0.smithi134.stdout:1/278: creat d5/d1a/d4d/f5a x:0 0 0 2024-02-16T22:18:52.548 INFO:tasks.workunit.client.0.smithi134.stdout:1/279: getdents d5/d1a/d53 0 2024-02-16T22:18:52.548 INFO:tasks.workunit.client.0.smithi134.stdout:8/273: creat d2/f5d x:0 0 0 2024-02-16T22:18:52.551 INFO:tasks.workunit.client.0.smithi134.stdout:9/363: link db/dc/l1b db/d20/d55/l7c 0 2024-02-16T22:18:52.551 INFO:tasks.workunit.client.0.smithi134.stdout:9/364: dread - db/d20/d22/f58 zero size 2024-02-16T22:18:52.551 INFO:tasks.workunit.client.0.smithi134.stdout:9/365: write db/dc/f54 [778668,26748] 0 2024-02-16T22:18:52.551 INFO:tasks.workunit.client.0.smithi134.stdout:9/366: dread - db/dc/f24 zero size 2024-02-16T22:18:52.551 INFO:tasks.workunit.client.0.smithi134.stdout:9/367: read db/d20/d22/d46/f5c [994247,46730] 0 2024-02-16T22:18:52.552 INFO:tasks.workunit.client.0.smithi134.stdout:1/280: mkdir d5/da/d21/d52/d5b 0 2024-02-16T22:18:52.552 INFO:tasks.workunit.client.0.smithi134.stdout:3/284: sync 2024-02-16T22:18:52.552 INFO:tasks.workunit.client.0.smithi134.stdout:9/368: mknod db/d20/c7d 0 2024-02-16T22:18:52.554 INFO:tasks.workunit.client.0.smithi134.stdout:1/281: mkdir d5/da/d2d/d4b/d5c 0 2024-02-16T22:18:52.555 INFO:tasks.workunit.client.0.smithi134.stdout:1/282: dread f1 [0,4194304] 0 2024-02-16T22:18:52.555 INFO:tasks.workunit.client.0.smithi134.stdout:1/283: chown d5/da/d21/l28 484 1 2024-02-16T22:18:52.555 INFO:tasks.workunit.client.0.smithi134.stdout:1/284: write d5/da/d1c/f29 [2111071,47958] 0 2024-02-16T22:18:52.561 INFO:tasks.workunit.client.0.smithi134.stdout:3/285: read da/d12/f17 [2771505,98398] 0 2024-02-16T22:18:52.563 INFO:tasks.workunit.client.0.smithi134.stdout:3/286: unlink da/d1c/f54 0 2024-02-16T22:18:52.563 INFO:tasks.workunit.client.0.smithi134.stdout:7/263: dwrite d2/d6/f16 [0,4194304] 0 2024-02-16T22:18:52.563 INFO:tasks.workunit.client.0.smithi134.stdout:7/264: chown d2/d1e/l37 668 1 2024-02-16T22:18:52.566 INFO:tasks.workunit.client.0.smithi134.stdout:7/265: unlink d2/f1b 0 2024-02-16T22:18:52.566 INFO:tasks.workunit.client.0.smithi134.stdout:7/266: write d2/d5/d19/f2b [3928172,87671] 0 2024-02-16T22:18:52.567 INFO:tasks.workunit.client.0.smithi134.stdout:7/267: creat d2/d5/d19/d4a/f58 x:0 0 0 2024-02-16T22:18:52.567 INFO:tasks.workunit.client.0.smithi134.stdout:7/268: write d2/d6/d17/d31/d28/f36 [230289,122161] 0 2024-02-16T22:18:52.567 INFO:tasks.workunit.client.0.smithi134.stdout:7/269: read d2/ff [1266546,121646] 0 2024-02-16T22:18:52.568 INFO:tasks.workunit.client.0.smithi134.stdout:7/270: mknod d2/d6/d17/d25/c59 0 2024-02-16T22:18:52.568 INFO:tasks.workunit.client.0.smithi134.stdout:7/271: dread - d2/d7/f3a zero size 2024-02-16T22:18:52.569 INFO:tasks.workunit.client.0.smithi134.stdout:7/272: unlink d2/d5/d22/f4e 0 2024-02-16T22:18:52.571 INFO:tasks.workunit.client.0.smithi134.stdout:5/297: dwrite f0 [4194304,4194304] 0 2024-02-16T22:18:52.571 INFO:tasks.workunit.client.0.smithi134.stdout:5/298: truncate d2/d9/dc/d32/f5b 878913 0 2024-02-16T22:18:52.571 INFO:tasks.workunit.client.0.smithi134.stdout:5/299: stat d2/d35/f58 0 2024-02-16T22:18:52.573 INFO:tasks.workunit.client.0.smithi134.stdout:5/300: rename d2/f2d to d2/d35/d36/f64 0 2024-02-16T22:18:52.573 INFO:tasks.workunit.client.0.smithi134.stdout:5/301: chown d2/f4 329431527 1 2024-02-16T22:18:52.573 INFO:tasks.workunit.client.0.smithi134.stdout:3/287: dread da/d1c/f23 [0,4194304] 0 2024-02-16T22:18:52.573 INFO:tasks.workunit.client.0.smithi134.stdout:5/302: write d2/d9/dc/d15/f31 [618359,53105] 0 2024-02-16T22:18:52.574 INFO:tasks.workunit.client.0.smithi134.stdout:3/288: getdents da/d1c/d24/d29/d40 0 2024-02-16T22:18:52.574 INFO:tasks.workunit.client.0.smithi134.stdout:5/303: read d2/d9/dc/f38 [54339,72402] 0 2024-02-16T22:18:52.574 INFO:tasks.workunit.client.0.smithi134.stdout:5/304: readlink d2/d9/l23 0 2024-02-16T22:18:52.574 INFO:tasks.workunit.client.0.smithi134.stdout:3/289: truncate da/f11 4906308 0 2024-02-16T22:18:52.574 INFO:tasks.workunit.client.0.smithi134.stdout:3/290: fdatasync da/d1c/d24/f52 0 2024-02-16T22:18:52.576 INFO:tasks.workunit.client.0.smithi134.stdout:6/320: dwrite d17/f42 [0,4194304] 0 2024-02-16T22:18:52.576 INFO:tasks.workunit.client.0.smithi134.stdout:2/232: dwrite df/d10/d11/d17/d1b/f2f [4194304,4194304] 0 2024-02-16T22:18:52.576 INFO:tasks.workunit.client.0.smithi134.stdout:2/233: fdatasync f2 0 2024-02-16T22:18:52.576 INFO:tasks.workunit.client.0.smithi134.stdout:2/234: fsync df/d10/d11/d17/d1b/f22 0 2024-02-16T22:18:52.576 INFO:tasks.workunit.client.0.smithi134.stdout:1/285: dwrite d5/d1a/f4c [0,4194304] 0 2024-02-16T22:18:52.576 INFO:tasks.workunit.client.0.smithi134.stdout:5/305: unlink d2/d9/ld 0 2024-02-16T22:18:52.577 INFO:tasks.workunit.client.0.smithi134.stdout:7/273: read d2/d6/d17/d25/f2a [1622463,15461] 0 2024-02-16T22:18:52.577 INFO:tasks.workunit.client.0.smithi134.stdout:3/291: unlink da/d12/d2a/l36 0 2024-02-16T22:18:52.577 INFO:tasks.workunit.client.0.smithi134.stdout:7/274: chown d2/f1a 139 1 2024-02-16T22:18:52.578 INFO:tasks.workunit.client.0.smithi134.stdout:7/275: creat d2/d1e/d24/f5a x:0 0 0 2024-02-16T22:18:52.578 INFO:tasks.workunit.client.0.smithi134.stdout:7/276: fsync d2/d5/f2d 0 2024-02-16T22:18:52.580 INFO:tasks.workunit.client.0.smithi134.stdout:5/306: dread d2/d9/dc/f1d [0,4194304] 0 2024-02-16T22:18:52.580 INFO:tasks.workunit.client.0.smithi134.stdout:5/307: chown d2/d35/d36/d46/c5f 1 1 2024-02-16T22:18:52.582 INFO:tasks.workunit.client.0.smithi134.stdout:0/277: dread d2/f16 [0,4194304] 0 2024-02-16T22:18:52.583 INFO:tasks.workunit.client.0.smithi134.stdout:2/235: dread df/d10/d11/d17/d1b/f23 [0,4194304] 0 2024-02-16T22:18:52.583 INFO:tasks.workunit.client.0.smithi134.stdout:2/236: readlink l5 0 2024-02-16T22:18:52.587 INFO:tasks.workunit.client.0.smithi134.stdout:6/321: symlink d17/d27/d4f/d52/l65 0 2024-02-16T22:18:52.589 INFO:tasks.workunit.client.0.smithi134.stdout:5/308: dread d2/fa [4194304,4194304] 0 2024-02-16T22:18:52.590 INFO:tasks.workunit.client.0.smithi134.stdout:1/286: symlink d5/da/d2d/d4b/l5d 0 2024-02-16T22:18:52.592 INFO:tasks.workunit.client.0.smithi134.stdout:1/287: dread d5/d1a/d23/f39 [0,4194304] 0 2024-02-16T22:18:52.592 INFO:tasks.workunit.client.0.smithi134.stdout:1/288: write f1 [647665,47368] 0 2024-02-16T22:18:52.593 INFO:tasks.workunit.client.0.smithi134.stdout:1/289: chown d5/da/d1c/f32 134803 1 2024-02-16T22:18:52.595 INFO:tasks.workunit.client.0.smithi134.stdout:7/277: symlink d2/d6/d17/d31/l5b 0 2024-02-16T22:18:52.596 INFO:tasks.workunit.client.0.smithi134.stdout:0/278: creat d2/d4b/f5b x:0 0 0 2024-02-16T22:18:52.597 INFO:tasks.workunit.client.0.smithi134.stdout:2/237: dwrite df/d10/d11/f26 [0,4194304] 0 2024-02-16T22:18:52.597 INFO:tasks.workunit.client.0.smithi134.stdout:2/238: dread - df/d10/f3b zero size 2024-02-16T22:18:52.599 INFO:tasks.workunit.client.0.smithi134.stdout:6/322: dread f15 [0,4194304] 0 2024-02-16T22:18:52.600 INFO:tasks.workunit.client.0.smithi134.stdout:1/290: creat d5/da/d21/d52/d5b/f5e x:0 0 0 2024-02-16T22:18:52.600 INFO:tasks.workunit.client.0.smithi134.stdout:1/291: getdents d5/da/d2d/d4b/d5c 0 2024-02-16T22:18:52.602 INFO:tasks.workunit.client.0.smithi134.stdout:5/309: dread d2/d35/d36/f64 [0,4194304] 0 2024-02-16T22:18:52.602 INFO:tasks.workunit.client.0.smithi134.stdout:5/310: stat d2/d9/dc/d32 0 2024-02-16T22:18:52.603 INFO:tasks.workunit.client.0.smithi134.stdout:2/239: creat df/d10/d11/d34/f3e x:0 0 0 2024-02-16T22:18:52.604 INFO:tasks.workunit.client.0.smithi134.stdout:6/323: truncate d17/d22/f29 1833910 0 2024-02-16T22:18:52.607 INFO:tasks.workunit.client.0.smithi134.stdout:2/240: rename df/d10/d15/f2e to df/d10/d15/f3f 0 2024-02-16T22:18:52.607 INFO:tasks.workunit.client.0.smithi134.stdout:2/241: fsync df/d10/d11/f13 0 2024-02-16T22:18:52.607 INFO:tasks.workunit.client.0.smithi134.stdout:2/242: fsync df/d10/d11/f26 0 2024-02-16T22:18:52.608 INFO:tasks.workunit.client.0.smithi134.stdout:6/324: symlink d17/d22/d44/l66 0 2024-02-16T22:18:52.608 INFO:tasks.workunit.client.0.smithi134.stdout:6/325: chown d17/d27/f56 10 1 2024-02-16T22:18:52.608 INFO:tasks.workunit.client.0.smithi134.stdout:6/326: fdatasync d17/d27/d4f/f50 0 2024-02-16T22:18:52.612 INFO:tasks.workunit.client.0.smithi134.stdout:2/243: dread df/d10/d15/f1d [0,4194304] 0 2024-02-16T22:18:52.613 INFO:tasks.workunit.client.0.smithi134.stdout:3/292: rename da/fb to da/d1c/d24/d2c/f58 0 2024-02-16T22:18:52.613 INFO:tasks.workunit.client.0.smithi134.stdout:1/292: rename d5/da/d21 to d5/da/d21/d52/d5f 22 2024-02-16T22:18:52.613 INFO:tasks.workunit.client.0.smithi134.stdout:3/293: dread - da/d1c/f46 zero size 2024-02-16T22:18:52.613 INFO:tasks.workunit.client.0.smithi134.stdout:3/294: stat da/d1c/d24/d2c/f4c 0 2024-02-16T22:18:52.613 INFO:tasks.workunit.client.0.smithi134.stdout:3/295: readlink da/d12/d2a/l41 0 2024-02-16T22:18:52.613 INFO:tasks.workunit.client.0.smithi134.stdout:3/296: chown da/d12/f42 6 1 2024-02-16T22:18:52.613 INFO:tasks.workunit.client.0.smithi134.stdout:3/297: fsync da/d2f/f3f 0 2024-02-16T22:18:52.614 INFO:tasks.workunit.client.0.smithi134.stdout:2/244: mknod df/d10/d11/d34/c40 0 2024-02-16T22:18:52.614 INFO:tasks.workunit.client.0.smithi134.stdout:2/245: chown df/d10/d15/l3d 11 1 2024-02-16T22:18:52.615 INFO:tasks.workunit.client.0.smithi134.stdout:1/293: link d5/d1a/d23/d3c/c48 d5/da/d21/d52/d5b/c60 0 2024-02-16T22:18:52.615 INFO:tasks.workunit.client.0.smithi134.stdout:1/294: stat d5/da/fb 0 2024-02-16T22:18:52.618 INFO:tasks.workunit.client.0.smithi134.stdout:3/298: creat da/d1c/d24/d29/d51/f59 x:0 0 0 2024-02-16T22:18:52.619 INFO:tasks.workunit.client.0.smithi134.stdout:2/246: mkdir df/d41 0 2024-02-16T22:18:52.620 INFO:tasks.workunit.client.0.smithi134.stdout:2/247: chown df/d10/d15/f1d 29 1 2024-02-16T22:18:52.621 INFO:tasks.workunit.client.0.smithi134.stdout:1/295: unlink d5/f26 0 2024-02-16T22:18:52.632 INFO:tasks.workunit.client.0.smithi134.stdout:5/311: dwrite d2/d9/dc/d32/f5a [0,4194304] 0 2024-02-16T22:18:52.634 INFO:tasks.workunit.client.0.smithi134.stdout:0/279: dwrite d2/f1c [8388608,4194304] 0 2024-02-16T22:18:52.635 INFO:tasks.workunit.client.0.smithi134.stdout:5/312: symlink d2/d35/d36/d3d/d63/l65 0 2024-02-16T22:18:52.635 INFO:tasks.workunit.client.0.smithi134.stdout:5/313: readlink d2/d9/dc/d32/l51 0 2024-02-16T22:18:52.636 INFO:tasks.workunit.client.0.smithi134.stdout:0/280: readlink l1 0 2024-02-16T22:18:52.636 INFO:tasks.workunit.client.0.smithi134.stdout:5/314: symlink d2/d9/l66 0 2024-02-16T22:18:52.639 INFO:tasks.workunit.client.0.smithi134.stdout:0/281: rename d2/f17 to d2/f5c 0 2024-02-16T22:18:52.643 INFO:tasks.workunit.client.0.smithi134.stdout:0/282: dread d2/dc/f4f [0,4194304] 0 2024-02-16T22:18:52.659 INFO:tasks.workunit.client.0.smithi134.stdout:6/327: dwrite f14 [4194304,4194304] 0 2024-02-16T22:18:52.659 INFO:tasks.workunit.client.0.smithi134.stdout:6/328: fdatasync d17/d22/f25 0 2024-02-16T22:18:52.659 INFO:tasks.workunit.client.0.smithi134.stdout:3/299: dwrite da/d2f/f3f [0,4194304] 0 2024-02-16T22:18:52.664 INFO:tasks.workunit.client.0.smithi134.stdout:3/300: mknod da/d1c/c5a 0 2024-02-16T22:18:52.666 INFO:tasks.workunit.client.0.smithi134.stdout:6/329: dread d17/d22/f3b [0,4194304] 0 2024-02-16T22:18:52.666 INFO:tasks.workunit.client.0.smithi134.stdout:1/296: dwrite d5/d1a/d4d/f5a [0,4194304] 0 2024-02-16T22:18:52.666 INFO:tasks.workunit.client.0.smithi134.stdout:6/330: creat d17/d27/d4f/f67 x:0 0 0 2024-02-16T22:18:52.666 INFO:tasks.workunit.client.0.smithi134.stdout:6/331: creat d17/d27/d4f/f68 x:0 0 0 2024-02-16T22:18:52.666 INFO:tasks.workunit.client.0.smithi134.stdout:0/283: dwrite d2/dc/d48/f57 [0,4194304] 0 2024-02-16T22:18:52.667 INFO:tasks.workunit.client.0.smithi134.stdout:5/315: dwrite f0 [4194304,4194304] 0 2024-02-16T22:18:52.667 INFO:tasks.workunit.client.0.smithi134.stdout:5/316: fdatasync d2/d9/dc/f13 0 2024-02-16T22:18:52.667 INFO:tasks.workunit.client.0.smithi134.stdout:5/317: creat d2/d9/dc/d15/f67 x:0 0 0 2024-02-16T22:18:52.667 INFO:tasks.workunit.client.0.smithi134.stdout:0/284: read d2/d20/f29 [231543,128141] 0 2024-02-16T22:18:52.667 INFO:tasks.workunit.client.0.smithi134.stdout:0/285: creat d2/dc/d2d/f5d x:0 0 0 2024-02-16T22:18:52.667 INFO:tasks.workunit.client.0.smithi134.stdout:3/301: rename da/d2f to da/d1c/d24/d29/d51/d5b 0 2024-02-16T22:18:52.671 INFO:tasks.workunit.client.0.smithi134.stdout:6/332: mknod d17/d36/c69 0 2024-02-16T22:18:52.680 INFO:tasks.workunit.client.0.smithi134.stdout:0/286: mkdir d2/dc/d32/d3e/d5e 0 2024-02-16T22:18:52.680 INFO:tasks.workunit.client.0.smithi134.stdout:3/302: chown da/l18 0 1 2024-02-16T22:18:52.681 INFO:tasks.workunit.client.0.smithi134.stdout:5/318: getdents d2/d35 0 2024-02-16T22:18:52.681 INFO:tasks.workunit.client.0.smithi134.stdout:0/287: mkdir d2/d4b/d5f 0 2024-02-16T22:18:52.682 INFO:tasks.workunit.client.0.smithi134.stdout:1/297: dwrite d5/d1a/f31 [0,4194304] 0 2024-02-16T22:18:52.682 INFO:tasks.workunit.client.0.smithi134.stdout:3/303: mkdir da/d12/d2a/d5c 0 2024-02-16T22:18:52.683 INFO:tasks.workunit.client.0.smithi134.stdout:0/288: mkdir d2/dc/d48/d60 0 2024-02-16T22:18:52.683 INFO:tasks.workunit.client.0.smithi134.stdout:0/289: creat d2/dc/d2d/d34/f61 x:0 0 0 2024-02-16T22:18:52.683 INFO:tasks.workunit.client.0.smithi134.stdout:0/290: fsync d2/dc/d2d/d34/f37 0 2024-02-16T22:18:52.689 INFO:tasks.workunit.client.0.smithi134.stdout:3/304: rename da/d1c/f23 to da/d1c/f5d 0 2024-02-16T22:18:52.689 INFO:tasks.workunit.client.0.smithi134.stdout:3/305: creat da/d12/f5e x:0 0 0 2024-02-16T22:18:52.691 INFO:tasks.workunit.client.0.smithi134.stdout:1/298: read d5/f7 [3997023,71258] 0 2024-02-16T22:18:52.692 INFO:tasks.workunit.client.0.smithi134.stdout:1/299: stat d5/d1a 0 2024-02-16T22:18:52.692 INFO:tasks.workunit.client.0.smithi134.stdout:1/300: truncate d5/da/d21/d45/f58 95569 0 2024-02-16T22:18:52.692 INFO:tasks.workunit.client.0.smithi134.stdout:3/306: mkdir da/d1c/d24/d29/d51/d5b/d5f 0 2024-02-16T22:18:52.693 INFO:tasks.workunit.client.0.smithi134.stdout:3/307: write da/d12/f42 [255549,37915] 0 2024-02-16T22:18:52.694 INFO:tasks.workunit.client.0.smithi134.stdout:1/301: mkdir d5/d1a/d23/d61 0 2024-02-16T22:18:52.694 INFO:tasks.workunit.client.0.smithi134.stdout:1/302: chown d5/da/c1f 1507023 1 2024-02-16T22:18:52.694 INFO:tasks.workunit.client.0.smithi134.stdout:1/303: fsync d5/f8 0 2024-02-16T22:18:52.694 INFO:tasks.workunit.client.0.smithi134.stdout:3/308: symlink da/d1c/d24/d29/d40/l60 0 2024-02-16T22:18:52.696 INFO:tasks.workunit.client.0.smithi134.stdout:1/304: creat d5/d1a/f62 x:0 0 0 2024-02-16T22:18:52.696 INFO:tasks.workunit.client.0.smithi134.stdout:1/305: fsync d5/da/d2d/f54 0 2024-02-16T22:18:52.696 INFO:tasks.workunit.client.0.smithi134.stdout:1/306: write d5/d1a/f40 [1254097,26866] 0 2024-02-16T22:18:52.696 INFO:tasks.workunit.client.0.smithi134.stdout:1/307: fsync d5/da/d21/d45/f56 0 2024-02-16T22:18:52.698 INFO:tasks.workunit.client.0.smithi134.stdout:1/308: mkdir d5/d1a/d63 0 2024-02-16T22:18:52.699 INFO:tasks.workunit.client.0.smithi134.stdout:3/309: symlink da/d1c/d24/d29/l61 0 2024-02-16T22:18:52.700 INFO:tasks.workunit.client.0.smithi134.stdout:6/333: dwrite d17/d22/d44/f4a [0,4194304] 0 2024-02-16T22:18:52.700 INFO:tasks.workunit.client.0.smithi134.stdout:0/291: dwrite d2/dc/d2d/f54 [0,4194304] 0 2024-02-16T22:18:52.701 INFO:tasks.workunit.client.0.smithi134.stdout:1/309: symlink d5/d1a/d63/l64 0 2024-02-16T22:18:52.701 INFO:tasks.workunit.client.0.smithi134.stdout:1/310: dread - d5/da/d21/d45/f4e zero size 2024-02-16T22:18:52.701 INFO:tasks.workunit.client.0.smithi134.stdout:1/311: chown d5/d1a/d4d/f5a 477 1 2024-02-16T22:18:52.701 INFO:tasks.workunit.client.0.smithi134.stdout:3/310: dread da/d1c/d24/d2c/f58 [4194304,4194304] 0 2024-02-16T22:18:52.702 INFO:tasks.workunit.client.0.smithi134.stdout:4/221: sync 2024-02-16T22:18:52.702 INFO:tasks.workunit.client.0.smithi134.stdout:4/222: chown d0/d6/d22/d25/c3f 398 1 2024-02-16T22:18:52.702 INFO:tasks.workunit.client.0.smithi134.stdout:4/223: write d0/d6/d22/d40/f41 [926362,4512] 0 2024-02-16T22:18:52.702 INFO:tasks.workunit.client.0.smithi134.stdout:6/334: mknod d17/d36/c6a 0 2024-02-16T22:18:52.704 INFO:tasks.workunit.client.0.smithi134.stdout:5/319: dwrite d2/d9/f53 [0,4194304] 0 2024-02-16T22:18:52.705 INFO:tasks.workunit.client.0.smithi134.stdout:5/320: chown d2/d9/l52 9 1 2024-02-16T22:18:52.706 INFO:tasks.workunit.client.0.smithi134.stdout:1/312: link d5/d1a/d23/d3c/f41 d5/d1a/d53/f65 0 2024-02-16T22:18:52.707 INFO:tasks.workunit.client.0.smithi134.stdout:3/311: fsync da/d1c/f5d 0 2024-02-16T22:18:52.708 INFO:tasks.workunit.client.0.smithi134.stdout:4/224: symlink d0/d6/d16/d46/l4b 0 2024-02-16T22:18:52.714 INFO:tasks.workunit.client.0.smithi134.stdout:1/313: dread d5/da/d2d/d4b/f51 [0,4194304] 0 2024-02-16T22:18:52.715 INFO:tasks.workunit.client.0.smithi134.stdout:1/314: dread - d5/da/d1c/f32 zero size 2024-02-16T22:18:52.715 INFO:tasks.workunit.client.0.smithi134.stdout:5/321: mkdir d2/d35/d36/d46/d68 0 2024-02-16T22:18:52.715 INFO:tasks.workunit.client.0.smithi134.stdout:0/292: rmdir d2/dc/d2d/d34 39 2024-02-16T22:18:52.718 INFO:tasks.workunit.client.0.smithi134.stdout:3/312: mkdir da/d1c/d24/d29/d51/d5b/d5f/d62 0 2024-02-16T22:18:52.719 INFO:tasks.workunit.client.0.smithi134.stdout:4/225: creat d0/d31/f4c x:0 0 0 2024-02-16T22:18:52.719 INFO:tasks.workunit.client.0.smithi134.stdout:4/226: fdatasync d0/d6/d22/d25/f2d 0 2024-02-16T22:18:52.719 INFO:tasks.workunit.client.0.smithi134.stdout:4/227: chown d0/d6/d16/d46/l4b 271352706 1 2024-02-16T22:18:52.719 INFO:tasks.workunit.client.0.smithi134.stdout:4/228: chown d0/d31 159407788 1 2024-02-16T22:18:52.721 INFO:tasks.workunit.client.0.smithi134.stdout:1/315: unlink d5/d1a/d53/f65 0 2024-02-16T22:18:52.721 INFO:tasks.workunit.client.0.smithi134.stdout:1/316: dread - d5/da/d21/d45/f4e zero size 2024-02-16T22:18:52.721 INFO:tasks.workunit.client.0.smithi134.stdout:1/317: chown d5/da/d21/f3b 803391 1 2024-02-16T22:18:52.724 INFO:tasks.workunit.client.0.smithi134.stdout:4/229: symlink d0/d6/d8/d32/l4d 0 2024-02-16T22:18:52.724 INFO:tasks.workunit.client.0.smithi134.stdout:4/230: chown d0/d6/d8/ld 201229 1 2024-02-16T22:18:52.725 INFO:tasks.workunit.client.0.smithi134.stdout:8/274: sync 2024-02-16T22:18:52.725 INFO:tasks.workunit.client.0.smithi134.stdout:2/248: sync 2024-02-16T22:18:52.725 INFO:tasks.workunit.client.0.smithi134.stdout:7/278: sync 2024-02-16T22:18:52.726 INFO:tasks.workunit.client.0.smithi134.stdout:9/369: sync 2024-02-16T22:18:52.726 INFO:tasks.workunit.client.0.smithi134.stdout:8/275: write d2/f5d [692455,2728] 0 2024-02-16T22:18:52.726 INFO:tasks.workunit.client.0.smithi134.stdout:7/279: write d2/d6/d17/f23 [4356962,112400] 0 2024-02-16T22:18:52.726 INFO:tasks.workunit.client.0.smithi134.stdout:7/280: readlink d2/d1e/l33 0 2024-02-16T22:18:52.726 INFO:tasks.workunit.client.0.smithi134.stdout:0/293: rmdir d2/dc/d2d 39 2024-02-16T22:18:52.727 INFO:tasks.workunit.client.0.smithi134.stdout:3/313: symlink da/d1c/d24/d29/l63 0 2024-02-16T22:18:52.727 INFO:tasks.workunit.client.0.smithi134.stdout:1/318: rmdir d5/da/d21/d45 39 2024-02-16T22:18:52.730 INFO:tasks.workunit.client.0.smithi134.stdout:2/249: link df/d10/d11/d34/c40 df/d10/d11/d34/c42 0 2024-02-16T22:18:52.731 INFO:tasks.workunit.client.0.smithi134.stdout:9/370: creat db/d20/d22/d64/d69/f7e x:0 0 0 2024-02-16T22:18:52.732 INFO:tasks.workunit.client.0.smithi134.stdout:8/276: rmdir d2/df/d18 39 2024-02-16T22:18:52.732 INFO:tasks.workunit.client.0.smithi134.stdout:2/250: dread df/d10/d11/d17/d1b/f22 [0,4194304] 0 2024-02-16T22:18:52.734 INFO:tasks.workunit.client.0.smithi134.stdout:0/294: mknod d2/d20/c62 0 2024-02-16T22:18:52.735 INFO:tasks.workunit.client.0.smithi134.stdout:3/314: mknod da/d12/d2a/c64 0 2024-02-16T22:18:52.736 INFO:tasks.workunit.client.0.smithi134.stdout:8/277: truncate d2/df/d19/f28 601052 0 2024-02-16T22:18:52.737 INFO:tasks.workunit.client.0.smithi134.stdout:4/231: dwrite d0/d6/d22/d25/f47 [0,4194304] 0 2024-02-16T22:18:52.737 INFO:tasks.workunit.client.0.smithi134.stdout:4/232: read d0/d6/d16/f28 [1395795,104563] 0 2024-02-16T22:18:52.738 INFO:tasks.workunit.client.0.smithi134.stdout:7/281: symlink d2/d6/l5c 0 2024-02-16T22:18:52.738 INFO:tasks.workunit.client.0.smithi134.stdout:7/282: creat d2/d5/d4c/f5d x:0 0 0 2024-02-16T22:18:52.738 INFO:tasks.workunit.client.0.smithi134.stdout:0/295: creat d2/d20/d50/f63 x:0 0 0 2024-02-16T22:18:52.744 INFO:tasks.workunit.client.0.smithi134.stdout:4/233: mkdir d0/d6/d1e/d39/d4e 0 2024-02-16T22:18:52.745 INFO:tasks.workunit.client.0.smithi134.stdout:4/234: chown d0/d6/d8/ld 1937537 1 2024-02-16T22:18:52.745 INFO:tasks.workunit.client.0.smithi134.stdout:4/235: dread - d0/d6/d22/d25/f2d zero size 2024-02-16T22:18:52.745 INFO:tasks.workunit.client.0.smithi134.stdout:9/371: rmdir db/d20/d22 39 2024-02-16T22:18:52.748 INFO:tasks.workunit.client.0.smithi134.stdout:0/296: rename d2/dc/d2d/f5d to d2/dc/d48/d60/f64 0 2024-02-16T22:18:52.751 INFO:tasks.workunit.client.0.smithi134.stdout:3/315: rmdir da/d1c 39 2024-02-16T22:18:52.752 INFO:tasks.workunit.client.0.smithi134.stdout:2/251: dwrite df/f3c [0,4194304] 0 2024-02-16T22:18:52.752 INFO:tasks.workunit.client.0.smithi134.stdout:4/236: symlink d0/d6/d16/d1a/l4f 0 2024-02-16T22:18:52.754 INFO:tasks.workunit.client.0.smithi134.stdout:9/372: creat db/d20/d22/d64/d69/d6e/f7f x:0 0 0 2024-02-16T22:18:52.754 INFO:tasks.workunit.client.0.smithi134.stdout:7/283: rmdir d2/d5/d19/d4a 39 2024-02-16T22:18:52.756 INFO:tasks.workunit.client.0.smithi134.stdout:3/316: symlink da/d12/l65 0 2024-02-16T22:18:52.759 INFO:tasks.workunit.client.0.smithi134.stdout:2/252: mknod df/d10/d11/d17/c43 0 2024-02-16T22:18:52.760 INFO:tasks.workunit.client.0.smithi134.stdout:4/237: creat d0/d6/d1e/d3b/f50 x:0 0 0 2024-02-16T22:18:52.763 INFO:tasks.workunit.client.0.smithi134.stdout:2/253: creat df/d10/d3a/f44 x:0 0 0 2024-02-16T22:18:52.763 INFO:tasks.workunit.client.0.smithi134.stdout:2/254: readlink df/l27 0 2024-02-16T22:18:52.765 INFO:tasks.workunit.client.0.smithi134.stdout:4/238: creat d0/d6/d22/d25/d2a/f51 x:0 0 0 2024-02-16T22:18:52.766 INFO:tasks.workunit.client.0.smithi134.stdout:2/255: mknod df/d10/d11/d17/d1b/c45 0 2024-02-16T22:18:52.767 INFO:tasks.workunit.client.0.smithi134.stdout:4/239: creat d0/d6/d8/f52 x:0 0 0 2024-02-16T22:18:52.768 INFO:tasks.workunit.client.0.smithi134.stdout:4/240: rename d0 to d0/d6/d1e/d39/d4e/d53 22 2024-02-16T22:18:52.768 INFO:tasks.workunit.client.0.smithi134.stdout:3/317: mkdir da/d1c/d24/d29/d66 0 2024-02-16T22:18:52.769 INFO:tasks.workunit.client.0.smithi134.stdout:2/256: truncate df/d10/d11/d17/d1b/f23 8028129 0 2024-02-16T22:18:52.770 INFO:tasks.workunit.client.0.smithi134.stdout:3/318: creat da/d1c/f67 x:0 0 0 2024-02-16T22:18:52.771 INFO:tasks.workunit.client.0.smithi134.stdout:2/257: rename df/d10/l29 to df/d10/d30/l46 0 2024-02-16T22:18:52.771 INFO:tasks.workunit.client.0.smithi134.stdout:2/258: chown df/d10/d11/d34/f3e 1070167849 1 2024-02-16T22:18:52.773 INFO:tasks.workunit.client.0.smithi134.stdout:9/373: dwrite db/d20/d22/f35 [0,4194304] 0 2024-02-16T22:18:52.784 INFO:tasks.workunit.client.0.smithi134.stdout:2/259: write df/d10/d11/f26 [3413576,115557] 0 2024-02-16T22:18:52.784 INFO:tasks.workunit.client.0.smithi134.stdout:3/319: write da/d1c/f1e [2963455,114693] 0 2024-02-16T22:18:52.784 INFO:tasks.workunit.client.0.smithi134.stdout:3/320: dread - da/d1c/d24/d2c/f4c zero size 2024-02-16T22:18:52.786 INFO:tasks.workunit.client.0.smithi134.stdout:3/321: mknod da/d1c/d24/d29/c68 0 2024-02-16T22:18:52.788 INFO:tasks.workunit.client.0.smithi134.stdout:3/322: link da/d1c/d24/d29/d40/l60 da/d12/d2a/l69 0 2024-02-16T22:18:52.788 INFO:tasks.workunit.client.0.smithi134.stdout:3/323: dread - da/d12/d2a/f4f zero size 2024-02-16T22:18:52.788 INFO:tasks.workunit.client.0.smithi134.stdout:3/324: chown da/d12/d2a/f4f 6656 1 2024-02-16T22:18:52.790 INFO:tasks.workunit.client.0.smithi134.stdout:4/241: dwrite d0/d6/d8/de/f3e [4194304,4194304] 0 2024-02-16T22:18:52.791 INFO:tasks.workunit.client.0.smithi134.stdout:4/242: mknod d0/c54 0 2024-02-16T22:18:52.791 INFO:tasks.workunit.client.0.smithi134.stdout:4/243: rmdir d0/d6/d16/d46 39 2024-02-16T22:18:52.840 INFO:tasks.workunit.client.0.smithi134.stdout:9/374: write db/d20/d22/f2f [1437346,40799] 0 2024-02-16T22:18:52.840 INFO:tasks.workunit.client.0.smithi134.stdout:9/375: readlink db/d20/l4d 0 2024-02-16T22:18:52.842 INFO:tasks.workunit.client.0.smithi134.stdout:9/376: dread db/d20/f39 [0,4194304] 0 2024-02-16T22:18:52.844 INFO:tasks.workunit.client.0.smithi134.stdout:9/377: mkdir db/d20/d22/d80 0 2024-02-16T22:18:52.844 INFO:tasks.workunit.client.0.smithi134.stdout:7/284: dwrite d2/fb [8388608,4194304] 0 2024-02-16T22:18:52.845 INFO:tasks.workunit.client.0.smithi134.stdout:7/285: fdatasync d2/d1e/f39 0 2024-02-16T22:18:52.845 INFO:tasks.workunit.client.0.smithi134.stdout:7/286: mknod d2/d6/d17/d31/d28/c5e 0 2024-02-16T22:18:52.845 INFO:tasks.workunit.client.0.smithi134.stdout:7/287: chown d2/d5/d22/l51 29018 1 2024-02-16T22:18:52.850 INFO:tasks.workunit.client.0.smithi134.stdout:3/325: rmdir da/d12 39 2024-02-16T22:18:52.851 INFO:tasks.workunit.client.0.smithi134.stdout:3/326: chown da/d12/d2a/d5c 57517 1 2024-02-16T22:18:52.851 INFO:tasks.workunit.client.0.smithi134.stdout:3/327: fdatasync da/d12/d2a/f38 0 2024-02-16T22:18:52.851 INFO:tasks.workunit.client.0.smithi134.stdout:9/378: read db/f33 [1304971,88217] 0 2024-02-16T22:18:52.851 INFO:tasks.workunit.client.0.smithi134.stdout:9/379: fdatasync db/d20/d22/f5d 0 2024-02-16T22:18:52.852 INFO:tasks.workunit.client.0.smithi134.stdout:9/380: stat db/d20/d22/d64/d69/d6d 0 2024-02-16T22:18:52.852 INFO:tasks.workunit.client.0.smithi134.stdout:9/381: rmdir db/d20/d22/d51 39 2024-02-16T22:18:52.856 INFO:tasks.workunit.client.0.smithi134.stdout:2/260: dwrite df/d10/d11/f26 [4194304,4194304] 0 2024-02-16T22:18:52.856 INFO:tasks.workunit.client.0.smithi134.stdout:2/261: stat df/d10/d11/d2d 0 2024-02-16T22:18:52.856 INFO:tasks.workunit.client.0.smithi134.stdout:2/262: chown df/d41 49 1 2024-02-16T22:18:52.856 INFO:tasks.workunit.client.0.smithi134.stdout:2/263: creat df/d10/f47 x:0 0 0 2024-02-16T22:18:52.862 INFO:tasks.workunit.client.0.smithi134.stdout:3/328: read da/d1c/d24/d29/d51/d5b/f3b [6326517,30048] 0 2024-02-16T22:18:52.863 INFO:tasks.workunit.client.0.smithi134.stdout:7/288: dwrite d2/f4 [8388608,4194304] 0 2024-02-16T22:18:52.864 INFO:tasks.workunit.client.0.smithi134.stdout:3/329: mkdir da/d1c/d24/d29/d51/d6a 0 2024-02-16T22:18:52.866 INFO:tasks.workunit.client.0.smithi134.stdout:9/382: truncate db/d20/d22/f2f 52724 0 2024-02-16T22:18:52.869 INFO:tasks.workunit.client.0.smithi134.stdout:7/289: creat d2/d5/d22/d26/f5f x:0 0 0 2024-02-16T22:18:52.869 INFO:tasks.workunit.client.0.smithi134.stdout:7/290: dread - d2/d5/d22/d26/f5f zero size 2024-02-16T22:18:52.871 INFO:tasks.workunit.client.0.smithi134.stdout:7/291: rename d2/d6/d17/f2e to d2/d49/f60 0 2024-02-16T22:18:52.873 INFO:tasks.workunit.client.0.smithi134.stdout:7/292: fsync d2/d6/f43 0 2024-02-16T22:18:52.873 INFO:tasks.workunit.client.0.smithi134.stdout:9/383: dread db/f43 [0,4194304] 0 2024-02-16T22:18:52.875 INFO:tasks.workunit.client.0.smithi134.stdout:7/293: unlink d2/d6/d17/d31/d28/l2c 0 2024-02-16T22:18:52.875 INFO:tasks.workunit.client.0.smithi134.stdout:6/335: sync 2024-02-16T22:18:52.875 INFO:tasks.workunit.client.0.smithi134.stdout:8/278: sync 2024-02-16T22:18:52.875 INFO:tasks.workunit.client.0.smithi134.stdout:0/297: sync 2024-02-16T22:18:52.875 INFO:tasks.workunit.client.0.smithi134.stdout:1/319: sync 2024-02-16T22:18:52.876 INFO:tasks.workunit.client.0.smithi134.stdout:5/322: sync 2024-02-16T22:18:52.876 INFO:tasks.workunit.client.0.smithi134.stdout:1/320: write d5/da/d21/d45/f56 [888058,114410] 0 2024-02-16T22:18:52.876 INFO:tasks.workunit.client.0.smithi134.stdout:7/294: read d2/d6/d17/d31/d28/f36 [48726,44972] 0 2024-02-16T22:18:52.877 INFO:tasks.workunit.client.0.smithi134.stdout:4/244: sync 2024-02-16T22:18:52.880 INFO:tasks.workunit.client.0.smithi134.stdout:0/298: unlink d2/dc/f28 0 2024-02-16T22:18:52.880 INFO:tasks.workunit.client.0.smithi134.stdout:4/245: dread d0/d6/f24 [0,4194304] 0 2024-02-16T22:18:52.880 INFO:tasks.workunit.client.0.smithi134.stdout:4/246: chown d0/d6/d16/d1a/l4f 132963878 1 2024-02-16T22:18:52.880 INFO:tasks.workunit.client.0.smithi134.stdout:5/323: unlink d2/d9/c14 0 2024-02-16T22:18:52.882 INFO:tasks.workunit.client.0.smithi134.stdout:9/384: getdents db 0 2024-02-16T22:18:52.883 INFO:tasks.workunit.client.0.smithi134.stdout:3/330: dwrite da/d12/d2a/f38 [0,4194304] 0 2024-02-16T22:18:52.883 INFO:tasks.workunit.client.0.smithi134.stdout:6/336: dread d17/d22/f47 [0,4194304] 0 2024-02-16T22:18:52.884 INFO:tasks.workunit.client.0.smithi134.stdout:6/337: creat d17/d22/d44/f6b x:0 0 0 2024-02-16T22:18:52.884 INFO:tasks.workunit.client.0.smithi134.stdout:0/299: mkdir d2/d4b/d5f/d65 0 2024-02-16T22:18:52.884 INFO:tasks.workunit.client.0.smithi134.stdout:8/279: dread d2/df/f10 [0,4194304] 0 2024-02-16T22:18:52.885 INFO:tasks.workunit.client.0.smithi134.stdout:4/247: mknod d0/d6/d1e/d3b/c55 0 2024-02-16T22:18:52.886 INFO:tasks.workunit.client.0.smithi134.stdout:4/248: readlink d0/d6/d16/d46/l4b 0 2024-02-16T22:18:52.888 INFO:tasks.workunit.client.0.smithi134.stdout:4/249: dread d0/d6/d16/d1a/f1b [0,4194304] 0 2024-02-16T22:18:52.888 INFO:tasks.workunit.client.0.smithi134.stdout:4/250: write d0/d6/d22/d25/f2d [420965,77320] 0 2024-02-16T22:18:52.888 INFO:tasks.workunit.client.0.smithi134.stdout:5/324: mknod d2/d9/dc/d15/c69 0 2024-02-16T22:18:52.891 INFO:tasks.workunit.client.0.smithi134.stdout:1/321: rename d5/d1a/d63/l64 to d5/l66 0 2024-02-16T22:18:52.891 INFO:tasks.workunit.client.0.smithi134.stdout:1/322: write d5/f7 [5152267,17083] 0 2024-02-16T22:18:52.893 INFO:tasks.workunit.client.0.smithi134.stdout:9/385: mkdir db/d20/d22/d64/d69/d6e/d81 0 2024-02-16T22:18:52.893 INFO:tasks.workunit.client.0.smithi134.stdout:9/386: write db/dc/f68 [732899,48365] 0 2024-02-16T22:18:52.893 INFO:tasks.workunit.client.0.smithi134.stdout:6/338: dread d17/f3a [0,4194304] 0 2024-02-16T22:18:52.893 INFO:tasks.workunit.client.0.smithi134.stdout:6/339: truncate d17/f51 740900 0 2024-02-16T22:18:52.894 INFO:tasks.workunit.client.0.smithi134.stdout:8/280: dread d2/df/f10 [0,4194304] 0 2024-02-16T22:18:52.894 INFO:tasks.workunit.client.0.smithi134.stdout:8/281: fsync d2/df/d18/d2a/d41/d59/f56 0 2024-02-16T22:18:52.896 INFO:tasks.workunit.client.0.smithi134.stdout:0/300: symlink d2/dc/d48/d60/l66 0 2024-02-16T22:18:52.898 INFO:tasks.workunit.client.0.smithi134.stdout:4/251: unlink d0/d6/d22/l2c 0 2024-02-16T22:18:52.899 INFO:tasks.workunit.client.0.smithi134.stdout:5/325: creat d2/d35/d36/d46/f6a x:0 0 0 2024-02-16T22:18:52.900 INFO:tasks.workunit.client.0.smithi134.stdout:1/323: mknod d5/d1a/d23/c67 0 2024-02-16T22:18:52.901 INFO:tasks.workunit.client.0.smithi134.stdout:0/301: dread d2/dc/f1d [4194304,4194304] 0 2024-02-16T22:18:52.902 INFO:tasks.workunit.client.0.smithi134.stdout:9/387: rename db/d20/d22/d64/d69/l7a to db/l82 0 2024-02-16T22:18:52.906 INFO:tasks.workunit.client.0.smithi134.stdout:9/388: truncate db/f33 569059 0 2024-02-16T22:18:52.907 INFO:tasks.workunit.client.0.smithi134.stdout:1/324: dread d5/da/f25 [0,4194304] 0 2024-02-16T22:18:52.907 INFO:tasks.workunit.client.0.smithi134.stdout:1/325: readlink d5/da/d21/l3e 0 2024-02-16T22:18:52.907 INFO:tasks.workunit.client.0.smithi134.stdout:1/326: chown d5/da/d21/d52 2 1 2024-02-16T22:18:52.912 INFO:tasks.workunit.client.0.smithi134.stdout:0/302: dread d2/dc/f25 [0,4194304] 0 2024-02-16T22:18:52.912 INFO:tasks.workunit.client.0.smithi134.stdout:0/303: truncate d2/dc/d48/d60/f64 890977 0 2024-02-16T22:18:52.913 INFO:tasks.workunit.client.0.smithi134.stdout:0/304: write d2/dc/f44 [776526,25070] 0 2024-02-16T22:18:52.913 INFO:tasks.workunit.client.0.smithi134.stdout:1/327: write d5/da/d2d/f34 [699971,56316] 0 2024-02-16T22:18:52.916 INFO:tasks.workunit.client.0.smithi134.stdout:0/305: link d2/l24 d2/dc/d32/d3e/d5e/l67 0 2024-02-16T22:18:52.916 INFO:tasks.workunit.client.0.smithi134.stdout:0/306: write d2/dc/ff [5190074,43472] 0 2024-02-16T22:18:52.917 INFO:tasks.workunit.client.0.smithi134.stdout:4/252: dread d0/f11 [0,4194304] 0 2024-02-16T22:18:52.918 INFO:tasks.workunit.client.0.smithi134.stdout:0/307: rmdir d2/dc/d32/d3e/d5e 39 2024-02-16T22:18:52.920 INFO:tasks.workunit.client.0.smithi134.stdout:4/253: link d0/d6/d8/d30/f42 d0/d6/d22/d25/f56 0 2024-02-16T22:18:52.922 INFO:tasks.workunit.client.0.smithi134.stdout:4/254: symlink d0/d6/l57 0 2024-02-16T22:18:52.923 INFO:tasks.workunit.client.0.smithi134.stdout:7/295: dwrite d2/d5/d19/d4a/f58 [0,4194304] 0 2024-02-16T22:18:52.923 INFO:tasks.workunit.client.0.smithi134.stdout:7/296: fdatasync d2/d5/d4c/f5d 0 2024-02-16T22:18:52.923 INFO:tasks.workunit.client.0.smithi134.stdout:7/297: creat d2/d1e/f61 x:0 0 0 2024-02-16T22:18:52.923 INFO:tasks.workunit.client.0.smithi134.stdout:7/298: write d2/d5/d19/f2b [4551174,13270] 0 2024-02-16T22:18:52.923 INFO:tasks.workunit.client.0.smithi134.stdout:7/299: write d2/d6/d17/f14 [4598407,89015] 0 2024-02-16T22:18:52.925 INFO:tasks.workunit.client.0.smithi134.stdout:6/340: dwrite d17/d22/f54 [0,4194304] 0 2024-02-16T22:18:52.927 INFO:tasks.workunit.client.0.smithi134.stdout:7/300: creat d2/f62 x:0 0 0 2024-02-16T22:18:52.927 INFO:tasks.workunit.client.0.smithi134.stdout:5/326: dwrite d2/d9/dc/f13 [0,4194304] 0 2024-02-16T22:18:52.927 INFO:tasks.workunit.client.0.smithi134.stdout:5/327: chown d2/d35/d36/d3d/d63/c59 161697848 1 2024-02-16T22:18:52.927 INFO:tasks.workunit.client.0.smithi134.stdout:5/328: creat d2/d35/d36/d46/f6b x:0 0 0 2024-02-16T22:18:52.927 INFO:tasks.workunit.client.0.smithi134.stdout:0/308: read d2/f40 [2768091,12307] 0 2024-02-16T22:18:52.927 INFO:tasks.workunit.client.0.smithi134.stdout:3/331: dwrite da/d12/d2a/f3c [0,4194304] 0 2024-02-16T22:18:52.929 INFO:tasks.workunit.client.0.smithi134.stdout:0/309: dread d2/dc/f25 [0,4194304] 0 2024-02-16T22:18:52.929 INFO:tasks.workunit.client.0.smithi134.stdout:6/341: link d17/d27/d4f/d52/l60 d17/d22/d28/l6c 0 2024-02-16T22:18:52.931 INFO:tasks.workunit.client.0.smithi134.stdout:7/301: rename d2/d49 to d2/d6/d17/d25/d63 0 2024-02-16T22:18:52.931 INFO:tasks.workunit.client.0.smithi134.stdout:7/302: dread - d2/d5/d4c/f4d zero size 2024-02-16T22:18:52.937 INFO:tasks.workunit.client.0.smithi134.stdout:1/328: dwrite d5/da/f25 [0,4194304] 0 2024-02-16T22:18:52.937 INFO:tasks.workunit.client.0.smithi134.stdout:1/329: write d5/f7 [5667237,98581] 0 2024-02-16T22:18:52.937 INFO:tasks.workunit.client.0.smithi134.stdout:0/310: symlink d2/d4b/d5f/d65/l68 0 2024-02-16T22:18:52.937 INFO:tasks.workunit.client.0.smithi134.stdout:0/311: write d2/d4b/f5b [685539,102343] 0 2024-02-16T22:18:52.937 INFO:tasks.workunit.client.0.smithi134.stdout:0/312: dread - d2/dc/d32/d3e/f47 zero size 2024-02-16T22:18:52.937 INFO:tasks.workunit.client.0.smithi134.stdout:0/313: truncate d2/dc/d32/d3e/f47 1037567 0 2024-02-16T22:18:52.945 INFO:tasks.workunit.client.0.smithi134.stdout:5/329: dwrite d2/f4e [0,4194304] 0 2024-02-16T22:18:52.947 INFO:tasks.workunit.client.0.smithi134.stdout:6/342: rmdir d17/d22/d28 39 2024-02-16T22:18:52.950 INFO:tasks.workunit.client.0.smithi134.stdout:3/332: mkdir da/d6b 0 2024-02-16T22:18:52.951 INFO:tasks.workunit.client.0.smithi134.stdout:1/330: truncate d5/d1a/d23/f27 969618 0 2024-02-16T22:18:52.952 INFO:tasks.workunit.client.0.smithi134.stdout:1/331: getdents d5/da/d2d/d4b/d5c 0 2024-02-16T22:18:52.952 INFO:tasks.workunit.client.0.smithi134.stdout:1/332: fsync d5/da/d2d/d4b/f51 0 2024-02-16T22:18:52.952 INFO:tasks.workunit.client.0.smithi134.stdout:0/314: getdents d2/dc/d32/d3e/d5e 0 2024-02-16T22:18:52.961 INFO:tasks.workunit.client.0.smithi134.stdout:5/330: link d2/d9/dc/d15/c56 d2/d9/dc/d27/d4b/c6c 0 2024-02-16T22:18:52.962 INFO:tasks.workunit.client.0.smithi134.stdout:6/343: creat d17/d22/d28/d5b/f6d x:0 0 0 2024-02-16T22:18:52.964 INFO:tasks.workunit.client.0.smithi134.stdout:7/303: rmdir d2/d6/d17 39 2024-02-16T22:18:52.967 INFO:tasks.workunit.client.0.smithi134.stdout:3/333: rename da/d1c/f46 to da/d1c/d24/d29/d51/d5b/d5f/d62/f6c 0 2024-02-16T22:18:52.968 INFO:tasks.workunit.client.0.smithi134.stdout:1/333: mknod d5/da/d21/d45/c68 0 2024-02-16T22:18:52.969 INFO:tasks.workunit.client.0.smithi134.stdout:1/334: chown d5/da/d21/l28 2893244 1 2024-02-16T22:18:52.969 INFO:tasks.workunit.client.0.smithi134.stdout:0/315: truncate d2/f26 976467 0 2024-02-16T22:18:52.969 INFO:tasks.workunit.client.0.smithi134.stdout:5/331: dread d2/d35/f58 [0,4194304] 0 2024-02-16T22:18:52.969 INFO:tasks.workunit.client.0.smithi134.stdout:5/332: creat d2/f6d x:0 0 0 2024-02-16T22:18:52.974 INFO:tasks.workunit.client.0.smithi134.stdout:3/334: truncate da/d1c/f1e 2318683 0 2024-02-16T22:18:52.974 INFO:tasks.workunit.client.0.smithi134.stdout:3/335: chown da/d1c/d24/d29/d40/l50 84 1 2024-02-16T22:18:52.974 INFO:tasks.workunit.client.0.smithi134.stdout:3/336: chown da/d12/f17 7410692 1 2024-02-16T22:18:52.974 INFO:tasks.workunit.client.0.smithi134.stdout:3/337: chown da/d1c/d24/f4a 14737 1 2024-02-16T22:18:52.978 INFO:tasks.workunit.client.0.smithi134.stdout:1/335: creat d5/d1a/d63/f69 x:0 0 0 2024-02-16T22:18:52.978 INFO:tasks.workunit.client.0.smithi134.stdout:1/336: chown d5/da/d1c/c55 221 1 2024-02-16T22:18:52.978 INFO:tasks.workunit.client.0.smithi134.stdout:1/337: write f1 [740490,33101] 0 2024-02-16T22:18:52.979 INFO:tasks.workunit.client.0.smithi134.stdout:1/338: chown d5/f3f 857 1 2024-02-16T22:18:52.979 INFO:tasks.workunit.client.0.smithi134.stdout:0/316: creat d2/dc/d32/d3e/f69 x:0 0 0 2024-02-16T22:18:52.981 INFO:tasks.workunit.client.0.smithi134.stdout:2/264: sync 2024-02-16T22:18:52.981 INFO:tasks.workunit.client.0.smithi134.stdout:2/265: read df/d10/d15/f1d [34650,110896] 0 2024-02-16T22:18:52.984 INFO:tasks.workunit.client.0.smithi134.stdout:1/339: rename d5/da/d2d/d4b to d5/d1a/d23/d3c/d6a 0 2024-02-16T22:18:52.985 INFO:tasks.workunit.client.0.smithi134.stdout:0/317: mknod d2/dc/d2d/c6a 0 2024-02-16T22:18:52.985 INFO:tasks.workunit.client.0.smithi134.stdout:5/333: dwrite d2/d9/dc/d15/f41 [0,4194304] 0 2024-02-16T22:18:52.988 INFO:tasks.workunit.client.0.smithi134.stdout:2/266: rename df/f1f to df/d10/d11/f48 0 2024-02-16T22:18:52.989 INFO:tasks.workunit.client.0.smithi134.stdout:1/340: symlink d5/d1a/d23/d61/l6b 0 2024-02-16T22:18:52.989 INFO:tasks.workunit.client.0.smithi134.stdout:6/344: rmdir d17/d22/d28/d5b 39 2024-02-16T22:18:52.990 INFO:tasks.workunit.client.0.smithi134.stdout:1/341: dread d5/da/d21/d45/f58 [0,4194304] 0 2024-02-16T22:18:52.992 INFO:tasks.workunit.client.0.smithi134.stdout:9/389: sync 2024-02-16T22:18:52.992 INFO:tasks.workunit.client.0.smithi134.stdout:8/282: sync 2024-02-16T22:18:52.992 INFO:tasks.workunit.client.0.smithi134.stdout:9/390: read - db/dc/f24 zero size 2024-02-16T22:18:52.993 INFO:tasks.workunit.client.0.smithi134.stdout:2/267: mkdir df/d10/d30/d49 0 2024-02-16T22:18:52.994 INFO:tasks.workunit.client.0.smithi134.stdout:6/345: symlink d17/d27/d30/d32/l6e 0 2024-02-16T22:18:52.996 INFO:tasks.workunit.client.0.smithi134.stdout:0/318: mknod d2/d56/c6b 0 2024-02-16T22:18:52.998 INFO:tasks.workunit.client.0.smithi134.stdout:8/283: mkdir d2/df/d19/d40/d53/d5e 0 2024-02-16T22:18:52.998 INFO:tasks.workunit.client.0.smithi134.stdout:8/284: stat d2/df/d18/d27/f30 0 2024-02-16T22:18:52.998 INFO:tasks.workunit.client.0.smithi134.stdout:3/338: dwrite da/d12/f42 [0,4194304] 0 2024-02-16T22:18:52.998 INFO:tasks.workunit.client.0.smithi134.stdout:3/339: dread - da/d1c/d24/d29/d51/d5b/f4e zero size 2024-02-16T22:18:52.998 INFO:tasks.workunit.client.0.smithi134.stdout:3/340: fsync da/d1c/f22 0 2024-02-16T22:18:53.000 INFO:tasks.workunit.client.0.smithi134.stdout:2/268: creat df/d10/d11/d2d/f4a x:0 0 0 2024-02-16T22:18:53.000 INFO:tasks.workunit.client.0.smithi134.stdout:2/269: write df/d10/d15/f1d [2724050,48004] 0 2024-02-16T22:18:53.000 INFO:tasks.workunit.client.0.smithi134.stdout:2/270: fsync df/d10/d11/d17/f20 0 2024-02-16T22:18:53.002 INFO:tasks.workunit.client.0.smithi134.stdout:0/319: read d2/f26 [933918,24080] 0 2024-02-16T22:18:53.002 INFO:tasks.workunit.client.0.smithi134.stdout:6/346: getdents d17/d22 0 2024-02-16T22:18:53.002 INFO:tasks.workunit.client.0.smithi134.stdout:6/347: chown d17/d27/c3e 0 1 2024-02-16T22:18:53.004 INFO:tasks.workunit.client.0.smithi134.stdout:8/285: link d2/df/d18/d27/f30 d2/f5f 0 2024-02-16T22:18:53.004 INFO:tasks.workunit.client.0.smithi134.stdout:8/286: truncate d2/df/d19/f4f 934056 0 2024-02-16T22:18:53.005 INFO:tasks.workunit.client.0.smithi134.stdout:3/341: mkdir da/d1c/d24/d29/d51/d5b/d6d 0 2024-02-16T22:18:53.010 INFO:tasks.workunit.client.0.smithi134.stdout:5/334: dwrite d2/d9/dc/fe [0,4194304] 0 2024-02-16T22:18:53.013 INFO:tasks.workunit.client.0.smithi134.stdout:5/335: truncate d2/d9/dc/f3a 258104 0 2024-02-16T22:18:53.018 INFO:tasks.workunit.client.0.smithi134.stdout:8/287: dread d2/f25 [0,4194304] 0 2024-02-16T22:18:53.021 INFO:tasks.workunit.client.0.smithi134.stdout:3/342: write da/d12/d2a/f3c [2157560,113747] 0 2024-02-16T22:18:53.021 INFO:tasks.workunit.client.0.smithi134.stdout:8/288: rename d2/df/d19/l26 to d2/df/d18/d2a/d41/l60 0 2024-02-16T22:18:53.023 INFO:tasks.workunit.client.0.smithi134.stdout:3/343: rmdir da/d1c/d24/d29/d40 39 2024-02-16T22:18:53.024 INFO:tasks.workunit.client.0.smithi134.stdout:8/289: mkdir d2/df/d18/d2a/d41/d61 0 2024-02-16T22:18:53.024 INFO:tasks.workunit.client.0.smithi134.stdout:8/290: truncate d2/df/f5b 44471 0 2024-02-16T22:18:53.025 INFO:tasks.workunit.client.0.smithi134.stdout:3/344: mknod da/d1c/d24/d29/d56/c6e 0 2024-02-16T22:18:53.025 INFO:tasks.workunit.client.0.smithi134.stdout:3/345: dread - da/d1c/d24/d29/d51/d5b/f44 zero size 2024-02-16T22:18:53.026 INFO:tasks.workunit.client.0.smithi134.stdout:8/291: unlink d2/df/d18/d12/f15 0 2024-02-16T22:18:53.026 INFO:tasks.workunit.client.0.smithi134.stdout:3/346: mknod da/d1c/d24/d29/d51/d5b/c6f 0 2024-02-16T22:18:53.029 INFO:tasks.workunit.client.0.smithi134.stdout:3/347: rename da/d1c/d24/d29/d51/d5b/f55 to da/d1c/d24/d29/d51/f70 0 2024-02-16T22:18:53.030 INFO:tasks.workunit.client.0.smithi134.stdout:3/348: getdents da/d1c/d24/d29/d51/d5b/d5f 0 2024-02-16T22:18:53.030 INFO:tasks.workunit.client.0.smithi134.stdout:3/349: dread - da/d1c/d24/d29/d51/d5b/f44 zero size 2024-02-16T22:18:53.031 INFO:tasks.workunit.client.0.smithi134.stdout:3/350: symlink da/d1c/d24/d29/d51/d5b/l71 0 2024-02-16T22:18:53.032 INFO:tasks.workunit.client.0.smithi134.stdout:3/351: fsync da/d12/f42 0 2024-02-16T22:18:53.032 INFO:tasks.workunit.client.0.smithi134.stdout:3/352: stat da/d1c/d24/d29/d51/d5b 0 2024-02-16T22:18:53.032 INFO:tasks.workunit.client.0.smithi134.stdout:3/353: stat da/d12/d2a/f3c 0 2024-02-16T22:18:53.034 INFO:tasks.workunit.client.0.smithi134.stdout:3/354: link da/d1c/d24/d29/f49 da/f72 0 2024-02-16T22:18:53.039 INFO:tasks.workunit.client.0.smithi134.stdout:9/391: dwrite db/f18 [0,4194304] 0 2024-02-16T22:18:53.042 INFO:tasks.workunit.client.0.smithi134.stdout:9/392: rmdir db/d20/d22/d64/d69/d6e 39 2024-02-16T22:18:53.042 INFO:tasks.workunit.client.0.smithi134.stdout:2/271: dwrite df/f3c [0,4194304] 0 2024-02-16T22:18:53.042 INFO:tasks.workunit.client.0.smithi134.stdout:2/272: write df/d10/d11/f13 [2946987,121568] 0 2024-02-16T22:18:53.042 INFO:tasks.workunit.client.0.smithi134.stdout:2/273: stat df/d10/d3a/f44 0 2024-02-16T22:18:53.042 INFO:tasks.workunit.client.0.smithi134.stdout:2/274: creat df/d10/f4b x:0 0 0 2024-02-16T22:18:53.043 INFO:tasks.workunit.client.0.smithi134.stdout:0/320: dwrite d2/f22 [0,4194304] 0 2024-02-16T22:18:53.043 INFO:tasks.workunit.client.0.smithi134.stdout:6/348: dwrite d17/d22/f25 [0,4194304] 0 2024-02-16T22:18:53.044 INFO:tasks.workunit.client.0.smithi134.stdout:0/321: dread d2/dc/f25 [0,4194304] 0 2024-02-16T22:18:53.044 INFO:tasks.workunit.client.0.smithi134.stdout:9/393: link db/d20/d22/d51/f74 db/d20/d22/d80/f83 0 2024-02-16T22:18:53.044 INFO:tasks.workunit.client.0.smithi134.stdout:9/394: readlink db/d20/d22/l77 0 2024-02-16T22:18:53.044 INFO:tasks.workunit.client.0.smithi134.stdout:2/275: write df/d10/d15/f28 [123868,91647] 0 2024-02-16T22:18:53.045 INFO:tasks.workunit.client.0.smithi134.stdout:2/276: write df/d10/d11/d17/d1b/f23 [3432718,39425] 0 2024-02-16T22:18:53.046 INFO:tasks.workunit.client.0.smithi134.stdout:9/395: dread db/dc/f16 [0,4194304] 0 2024-02-16T22:18:53.050 INFO:tasks.workunit.client.0.smithi134.stdout:6/349: creat d17/d36/f6f x:0 0 0 2024-02-16T22:18:53.050 INFO:tasks.workunit.client.0.smithi134.stdout:6/350: chown d17/f51 202 1 2024-02-16T22:18:53.051 INFO:tasks.workunit.client.0.smithi134.stdout:5/336: dwrite d2/d9/dc/f24 [0,4194304] 0 2024-02-16T22:18:53.051 INFO:tasks.workunit.client.0.smithi134.stdout:8/292: dwrite d2/df/d18/d2a/d41/d59/f56 [0,4194304] 0 2024-02-16T22:18:53.053 INFO:tasks.workunit.client.0.smithi134.stdout:2/277: creat df/d10/d11/f4c x:0 0 0 2024-02-16T22:18:53.053 INFO:tasks.workunit.client.0.smithi134.stdout:2/278: readlink df/d10/d15/l3d 0 2024-02-16T22:18:53.054 INFO:tasks.workunit.client.0.smithi134.stdout:9/396: getdents db/d20/d32 0 2024-02-16T22:18:53.054 INFO:tasks.workunit.client.0.smithi134.stdout:9/397: write db/f33 [872278,113598] 0 2024-02-16T22:18:53.054 INFO:tasks.workunit.client.0.smithi134.stdout:9/398: write db/d20/d22/d51/f74 [590127,86819] 0 2024-02-16T22:18:53.054 INFO:tasks.workunit.client.0.smithi134.stdout:9/399: fsync db/d20/d22/f50 0 2024-02-16T22:18:53.060 INFO:tasks.workunit.client.0.smithi134.stdout:3/355: dwrite da/d12/d2a/f38 [4194304,4194304] 0 2024-02-16T22:18:53.062 INFO:tasks.workunit.client.0.smithi134.stdout:2/279: mkdir df/d10/d30/d4d 0 2024-02-16T22:18:53.063 INFO:tasks.workunit.client.0.smithi134.stdout:6/351: write d17/d22/d28/f49 [1615932,54981] 0 2024-02-16T22:18:53.063 INFO:tasks.workunit.client.0.smithi134.stdout:6/352: write d17/d36/f6f [596719,69205] 0 2024-02-16T22:18:53.066 INFO:tasks.workunit.client.0.smithi134.stdout:9/400: dread db/f18 [0,4194304] 0 2024-02-16T22:18:53.066 INFO:tasks.workunit.client.0.smithi134.stdout:9/401: truncate db/f29 8430509 0 2024-02-16T22:18:53.069 INFO:tasks.workunit.client.0.smithi134.stdout:3/356: rmdir da/d1c/d24/d29/d66 0 2024-02-16T22:18:53.069 INFO:tasks.workunit.client.0.smithi134.stdout:2/280: dread df/d10/d15/f1d [0,4194304] 0 2024-02-16T22:18:53.069 INFO:tasks.workunit.client.0.smithi134.stdout:2/281: readlink la 0 2024-02-16T22:18:53.072 INFO:tasks.workunit.client.0.smithi134.stdout:6/353: mkdir d17/d22/d70 0 2024-02-16T22:18:53.072 INFO:tasks.workunit.client.0.smithi134.stdout:6/354: stat d17/f51 0 2024-02-16T22:18:53.074 INFO:tasks.workunit.client.0.smithi134.stdout:9/402: mkdir db/d20/d32/d84 0 2024-02-16T22:18:53.074 INFO:tasks.workunit.client.0.smithi134.stdout:5/337: dwrite d2/d9/dc/d32/f5a [0,4194304] 0 2024-02-16T22:18:53.074 INFO:tasks.workunit.client.0.smithi134.stdout:5/338: write d2/f2b [4482780,16741] 0 2024-02-16T22:18:53.074 INFO:tasks.workunit.client.0.smithi134.stdout:5/339: fsync d2/d9/dc/d27/f2c 0 2024-02-16T22:18:53.074 INFO:tasks.workunit.client.0.smithi134.stdout:8/293: dwrite d2/f35 [0,4194304] 0 2024-02-16T22:18:53.075 INFO:tasks.workunit.client.0.smithi134.stdout:3/357: truncate da/f19 872315 0 2024-02-16T22:18:53.075 INFO:tasks.workunit.client.0.smithi134.stdout:8/294: dread d2/df/f5b [0,4194304] 0 2024-02-16T22:18:53.075 INFO:tasks.workunit.client.0.smithi134.stdout:8/295: write d2/df/d18/d2a/d41/f42 [9089503,77629] 0 2024-02-16T22:18:53.075 INFO:tasks.workunit.client.0.smithi134.stdout:8/296: getdents d2/df/d18/d2a/d41/d61 0 2024-02-16T22:18:53.076 INFO:tasks.workunit.client.0.smithi134.stdout:5/340: fsync d2/f2b 0 2024-02-16T22:18:53.076 INFO:tasks.workunit.client.0.smithi134.stdout:2/282: mknod df/d10/d11/d2d/c4e 0 2024-02-16T22:18:53.077 INFO:tasks.workunit.client.0.smithi134.stdout:6/355: unlink d17/d27/d30/d32/f43 0 2024-02-16T22:18:53.077 INFO:tasks.workunit.client.0.smithi134.stdout:6/356: fdatasync d17/f4c 0 2024-02-16T22:18:53.077 INFO:tasks.workunit.client.0.smithi134.stdout:6/357: chown d17/c1b 0 1 2024-02-16T22:18:53.077 INFO:tasks.workunit.client.0.smithi134.stdout:6/358: stat d17/d27/c3e 0 2024-02-16T22:18:53.078 INFO:tasks.workunit.client.0.smithi134.stdout:9/403: symlink db/dc/l85 0 2024-02-16T22:18:53.078 INFO:tasks.workunit.client.0.smithi134.stdout:9/404: chown db/dc/c4c 32640 1 2024-02-16T22:18:53.086 INFO:tasks.workunit.client.0.smithi134.stdout:5/341: unlink d2/d9/c17 0 2024-02-16T22:18:53.086 INFO:tasks.workunit.client.0.smithi134.stdout:5/342: fdatasync d2/f18 0 2024-02-16T22:18:53.087 INFO:tasks.workunit.client.0.smithi134.stdout:2/283: dread df/d10/d11/d17/d1b/f2f [4194304,4194304] 0 2024-02-16T22:18:53.087 INFO:tasks.workunit.client.0.smithi134.stdout:5/343: symlink d2/l6e 0 2024-02-16T22:18:53.089 INFO:tasks.workunit.client.0.smithi134.stdout:2/284: creat df/d10/d30/d49/f4f x:0 0 0 2024-02-16T22:18:53.089 INFO:tasks.workunit.client.0.smithi134.stdout:2/285: creat df/d10/d3a/f50 x:0 0 0 2024-02-16T22:18:53.094 INFO:tasks.workunit.client.0.smithi134.stdout:4/255: sync 2024-02-16T22:18:53.096 INFO:tasks.workunit.client.0.smithi134.stdout:4/256: mkdir d0/d6/d58 0 2024-02-16T22:18:53.096 INFO:tasks.workunit.client.0.smithi134.stdout:4/257: dread - d0/d6/d8/de/f49 zero size 2024-02-16T22:18:53.096 INFO:tasks.workunit.client.0.smithi134.stdout:7/304: sync 2024-02-16T22:18:53.097 INFO:tasks.workunit.client.0.smithi134.stdout:4/258: readlink d0/d6/d16/d1a/l4f 0 2024-02-16T22:18:53.100 INFO:tasks.workunit.client.0.smithi134.stdout:4/259: mkdir d0/d6/d58/d59 0 2024-02-16T22:18:53.100 INFO:tasks.workunit.client.0.smithi134.stdout:4/260: chown d0/f2 762 1 2024-02-16T22:18:53.101 INFO:tasks.workunit.client.0.smithi134.stdout:4/261: chown d0/d6/d22/d25/f48 751 1 2024-02-16T22:18:53.103 INFO:tasks.workunit.client.0.smithi134.stdout:4/262: unlink d0/d6/d22/d25/f47 0 2024-02-16T22:18:53.104 INFO:tasks.workunit.client.0.smithi134.stdout:4/263: symlink d0/d6/d8/l5a 0 2024-02-16T22:18:53.104 INFO:tasks.workunit.client.0.smithi134.stdout:4/264: fsync d0/f2 0 2024-02-16T22:18:53.104 INFO:tasks.workunit.client.0.smithi134.stdout:4/265: chown d0/d6/d16/d1a/l4f 26802 1 2024-02-16T22:18:53.109 INFO:tasks.workunit.client.0.smithi134.stdout:8/297: dwrite d2/f24 [0,4194304] 0 2024-02-16T22:18:53.109 INFO:tasks.workunit.client.0.smithi134.stdout:7/305: write d2/d6/f16 [3362276,29023] 0 2024-02-16T22:18:53.109 INFO:tasks.workunit.client.0.smithi134.stdout:3/358: dwrite da/d1c/d24/f52 [0,4194304] 0 2024-02-16T22:18:53.211 INFO:tasks.workunit.client.0.smithi134.stdout:8/298: symlink d2/df/d19/d40/d53/d5e/l62 0 2024-02-16T22:18:53.211 INFO:tasks.workunit.client.0.smithi134.stdout:8/299: stat d2/df/d18/f45 0 2024-02-16T22:18:53.214 INFO:tasks.workunit.client.0.smithi134.stdout:7/306: symlink d2/d5/d4c/l64 0 2024-02-16T22:18:53.215 INFO:tasks.workunit.client.0.smithi134.stdout:7/307: rename d2 to d2/d7/d65 22 2024-02-16T22:18:53.215 INFO:tasks.workunit.client.0.smithi134.stdout:7/308: creat d2/d5/d22/f66 x:0 0 0 2024-02-16T22:18:53.218 INFO:tasks.workunit.client.0.smithi134.stdout:7/309: rmdir d2/d1e/d24 39 2024-02-16T22:18:53.227 INFO:tasks.workunit.client.0.smithi134.stdout:2/286: write df/d10/d11/d17/f20 [2344523,36272] 0 2024-02-16T22:18:53.233 INFO:tasks.workunit.client.0.smithi134.stdout:3/359: dread da/d12/d2a/f3c [0,4194304] 0 2024-02-16T22:18:53.234 INFO:tasks.workunit.client.0.smithi134.stdout:3/360: chown da/d1c/d24 21 1 2024-02-16T22:18:53.234 INFO:tasks.workunit.client.0.smithi134.stdout:3/361: creat da/d12/d2a/d5c/f73 x:0 0 0 2024-02-16T22:18:53.236 INFO:tasks.workunit.client.0.smithi134.stdout:9/405: dwrite db/d20/d22/d64/d69/d6e/f7f [0,4194304] 0 2024-02-16T22:18:53.236 INFO:tasks.workunit.client.0.smithi134.stdout:9/406: write db/f18 [4324256,21866] 0 2024-02-16T22:18:53.236 INFO:tasks.workunit.client.0.smithi134.stdout:3/362: mkdir da/d1c/d24/d2c/d74 0 2024-02-16T22:18:53.240 INFO:tasks.workunit.client.0.smithi134.stdout:3/363: symlink da/d1c/d24/d2c/d74/l75 0 2024-02-16T22:18:53.240 INFO:tasks.workunit.client.0.smithi134.stdout:3/364: dread - da/d1c/d24/d29/d51/d5b/f44 zero size 2024-02-16T22:18:53.241 INFO:tasks.workunit.client.0.smithi134.stdout:3/365: truncate da/d12/f42 3986043 0 2024-02-16T22:18:53.242 INFO:tasks.workunit.client.0.smithi134.stdout:3/366: truncate da/d1c/d24/d29/d51/d5b/f3f 2222986 0 2024-02-16T22:18:53.244 INFO:tasks.workunit.client.0.smithi134.stdout:3/367: creat da/d12/f76 x:0 0 0 2024-02-16T22:18:53.244 INFO:tasks.workunit.client.0.smithi134.stdout:3/368: fsync da/d1c/f5d 0 2024-02-16T22:18:53.246 INFO:tasks.workunit.client.0.smithi134.stdout:5/344: dwrite d2/d35/d36/d3d/f4c [0,4194304] 0 2024-02-16T22:18:53.247 INFO:tasks.workunit.client.0.smithi134.stdout:6/359: dwrite d17/d22/d28/f49 [0,4194304] 0 2024-02-16T22:18:53.247 INFO:tasks.workunit.client.0.smithi134.stdout:5/345: creat d2/d9/f6f x:0 0 0 2024-02-16T22:18:53.247 INFO:tasks.workunit.client.0.smithi134.stdout:5/346: write d2/fa [8960928,6405] 0 2024-02-16T22:18:53.249 INFO:tasks.workunit.client.0.smithi134.stdout:4/266: dwrite d0/d6/d16/f20 [4194304,4194304] 0 2024-02-16T22:18:53.250 INFO:tasks.workunit.client.0.smithi134.stdout:8/300: dwrite d2/df/f10 [0,4194304] 0 2024-02-16T22:18:53.250 INFO:tasks.workunit.client.0.smithi134.stdout:8/301: creat d2/f63 x:0 0 0 2024-02-16T22:18:53.250 INFO:tasks.workunit.client.0.smithi134.stdout:6/360: rename d17/c1b to d17/d22/d28/c71 0 2024-02-16T22:18:53.250 INFO:tasks.workunit.client.0.smithi134.stdout:6/361: dread - d17/d27/f62 zero size 2024-02-16T22:18:53.250 INFO:tasks.workunit.client.0.smithi134.stdout:5/347: creat d2/d35/d36/d3d/d63/f70 x:0 0 0 2024-02-16T22:18:53.251 INFO:tasks.workunit.client.0.smithi134.stdout:2/287: dwrite df/d10/d11/f26 [0,4194304] 0 2024-02-16T22:18:53.253 INFO:tasks.workunit.client.0.smithi134.stdout:2/288: dread fb [0,4194304] 0 2024-02-16T22:18:53.253 INFO:tasks.workunit.client.0.smithi134.stdout:9/407: dwrite db/d20/d22/d64/d69/d6e/f7f [0,4194304] 0 2024-02-16T22:18:53.253 INFO:tasks.workunit.client.0.smithi134.stdout:2/289: stat df/d10/f47 0 2024-02-16T22:18:53.253 INFO:tasks.workunit.client.0.smithi134.stdout:2/290: creat df/f51 x:0 0 0 2024-02-16T22:18:53.253 INFO:tasks.workunit.client.0.smithi134.stdout:2/291: write df/d10/d15/f1e [3452985,91883] 0 2024-02-16T22:18:53.258 INFO:tasks.workunit.client.0.smithi134.stdout:6/362: truncate f6 1883639 0 2024-02-16T22:18:53.260 INFO:tasks.workunit.client.0.smithi134.stdout:5/348: rename d2/d9/dc/d27/c3e to d2/d35/d36/d46/c71 0 2024-02-16T22:18:53.262 INFO:tasks.workunit.client.0.smithi134.stdout:9/408: rmdir db/d20/d22/d64/d69/d6d 39 2024-02-16T22:18:53.262 INFO:tasks.workunit.client.0.smithi134.stdout:9/409: chown db/d20/d22/d80/f83 15760860 1 2024-02-16T22:18:53.262 INFO:tasks.workunit.client.0.smithi134.stdout:9/410: chown db/d20/l3c 4 1 2024-02-16T22:18:53.262 INFO:tasks.workunit.client.0.smithi134.stdout:8/302: dread d2/f24 [0,4194304] 0 2024-02-16T22:18:53.264 INFO:tasks.workunit.client.0.smithi134.stdout:2/292: creat df/d10/d30/d4d/f52 x:0 0 0 2024-02-16T22:18:53.265 INFO:tasks.workunit.client.0.smithi134.stdout:5/349: chown d2/d9/dc/c1b 1467717 1 2024-02-16T22:18:53.267 INFO:tasks.workunit.client.0.smithi134.stdout:2/293: truncate fb 70607 0 2024-02-16T22:18:53.267 INFO:tasks.workunit.client.0.smithi134.stdout:2/294: write df/d10/d30/d49/f4f [557361,97240] 0 2024-02-16T22:18:53.267 INFO:tasks.workunit.client.0.smithi134.stdout:4/267: dwrite d0/d6/d22/d25/d2a/f51 [0,4194304] 0 2024-02-16T22:18:53.269 INFO:tasks.workunit.client.0.smithi134.stdout:5/350: mkdir d2/d35/d72 0 2024-02-16T22:18:53.271 INFO:tasks.workunit.client.0.smithi134.stdout:2/295: rename df/d10/d11/d17/d1b/c45 to df/d10/d15/c53 0 2024-02-16T22:18:53.271 INFO:tasks.workunit.client.0.smithi134.stdout:2/296: fdatasync df/d10/d11/d17/d1b/f2f 0 2024-02-16T22:18:53.271 INFO:tasks.workunit.client.0.smithi134.stdout:2/297: creat df/d10/d30/d49/f54 x:0 0 0 2024-02-16T22:18:53.273 INFO:tasks.workunit.client.0.smithi134.stdout:9/411: dread db/d20/d22/f44 [0,4194304] 0 2024-02-16T22:18:53.274 INFO:tasks.workunit.client.0.smithi134.stdout:4/268: symlink d0/d6/d1e/d3b/l5b 0 2024-02-16T22:18:53.276 INFO:tasks.workunit.client.0.smithi134.stdout:9/412: rmdir db/d20/d32/d84 0 2024-02-16T22:18:53.278 INFO:tasks.workunit.client.0.smithi134.stdout:9/413: rename db/d20/d22/d80 to db/d20/d22/d64/d86 0 2024-02-16T22:18:53.280 INFO:tasks.workunit.client.0.smithi134.stdout:5/351: dread d2/d9/dc/d27/f2c [0,4194304] 0 2024-02-16T22:18:53.280 INFO:tasks.workunit.client.0.smithi134.stdout:5/352: fsync d2/d9/dc/d32/f5a 0 2024-02-16T22:18:53.280 INFO:tasks.workunit.client.0.smithi134.stdout:9/414: creat db/d20/d22/d64/d69/f87 x:0 0 0 2024-02-16T22:18:53.280 INFO:tasks.workunit.client.0.smithi134.stdout:1/342: sync 2024-02-16T22:18:53.281 INFO:tasks.workunit.client.0.smithi134.stdout:0/322: sync 2024-02-16T22:18:53.281 INFO:tasks.workunit.client.0.smithi134.stdout:0/323: read d2/dc/f1e [1654296,33244] 0 2024-02-16T22:18:53.281 INFO:tasks.workunit.client.0.smithi134.stdout:5/353: mknod d2/d35/c73 0 2024-02-16T22:18:53.281 INFO:tasks.workunit.client.0.smithi134.stdout:5/354: write d2/f6d [879305,94513] 0 2024-02-16T22:18:53.282 INFO:tasks.workunit.client.0.smithi134.stdout:9/415: mknod db/d20/d22/d64/d86/c88 0 2024-02-16T22:18:53.283 INFO:tasks.workunit.client.0.smithi134.stdout:8/303: dwrite d2/df/d19/f51 [0,4194304] 0 2024-02-16T22:18:53.284 INFO:tasks.workunit.client.0.smithi134.stdout:1/343: creat d5/da/d21/d52/f6c x:0 0 0 2024-02-16T22:18:53.284 INFO:tasks.workunit.client.0.smithi134.stdout:3/369: write da/d1c/d24/d29/d51/d5b/f3f [989606,65128] 0 2024-02-16T22:18:53.285 INFO:tasks.workunit.client.0.smithi134.stdout:0/324: truncate d2/f22 1983959 0 2024-02-16T22:18:53.286 INFO:tasks.workunit.client.0.smithi134.stdout:5/355: unlink d2/f19 0 2024-02-16T22:18:53.288 INFO:tasks.workunit.client.0.smithi134.stdout:9/416: unlink db/d20/d32/c3f 0 2024-02-16T22:18:53.291 INFO:tasks.workunit.client.0.smithi134.stdout:1/344: mkdir d5/da/d21/d52/d5b/d6d 0 2024-02-16T22:18:53.292 INFO:tasks.workunit.client.0.smithi134.stdout:3/370: truncate da/d1c/f1e 660357 0 2024-02-16T22:18:53.294 INFO:tasks.workunit.client.0.smithi134.stdout:5/356: mkdir d2/d35/d36/d46/d68/d74 0 2024-02-16T22:18:53.294 INFO:tasks.workunit.client.0.smithi134.stdout:5/357: write d2/f2b [1803493,107101] 0 2024-02-16T22:18:53.296 INFO:tasks.workunit.client.0.smithi134.stdout:3/371: unlink da/d12/f5e 0 2024-02-16T22:18:53.301 INFO:tasks.workunit.client.0.smithi134.stdout:5/358: write d2/d35/f58 [580674,26760] 0 2024-02-16T22:18:53.307 INFO:tasks.workunit.client.0.smithi134.stdout:2/298: dwrite df/f51 [0,4194304] 0 2024-02-16T22:18:53.308 INFO:tasks.workunit.client.0.smithi134.stdout:8/304: dwrite d2/df/d18/d2a/d41/f42 [0,4194304] 0 2024-02-16T22:18:53.310 INFO:tasks.workunit.client.0.smithi134.stdout:2/299: rmdir df/d10/d30 39 2024-02-16T22:18:53.310 INFO:tasks.workunit.client.0.smithi134.stdout:2/300: dread - df/d10/d3a/f50 zero size 2024-02-16T22:18:53.310 INFO:tasks.workunit.client.0.smithi134.stdout:2/301: write df/d10/d3a/f50 [588634,130292] 0 2024-02-16T22:18:53.311 INFO:tasks.workunit.client.0.smithi134.stdout:8/305: mknod d2/df/d18/c64 0 2024-02-16T22:18:53.311 INFO:tasks.workunit.client.0.smithi134.stdout:8/306: fdatasync d2/df/d18/d2a/d41/f4d 0 2024-02-16T22:18:53.311 INFO:tasks.workunit.client.0.smithi134.stdout:8/307: chown d2/df/d19/f28 4856 1 2024-02-16T22:18:53.311 INFO:tasks.workunit.client.0.smithi134.stdout:8/308: creat d2/f65 x:0 0 0 2024-02-16T22:18:53.312 INFO:tasks.workunit.client.0.smithi134.stdout:2/302: mknod df/d10/d11/c55 0 2024-02-16T22:18:53.312 INFO:tasks.workunit.client.0.smithi134.stdout:2/303: chown df/d10/d11/d17/d1b 144588 1 2024-02-16T22:18:53.312 INFO:tasks.workunit.client.0.smithi134.stdout:2/304: creat df/d10/d11/d17/d1b/f56 x:0 0 0 2024-02-16T22:18:53.315 INFO:tasks.workunit.client.0.smithi134.stdout:3/372: write da/d12/d2a/f38 [7222112,50565] 0 2024-02-16T22:18:53.323 INFO:tasks.workunit.client.0.smithi134.stdout:0/325: dwrite d2/dc/d2d/d34/f46 [0,4194304] 0 2024-02-16T22:18:53.323 INFO:tasks.workunit.client.0.smithi134.stdout:0/326: readlink d2/dc/l2f 0 2024-02-16T22:18:53.324 INFO:tasks.workunit.client.0.smithi134.stdout:8/309: dread d2/df/d19/f51 [0,4194304] 0 2024-02-16T22:18:53.325 INFO:tasks.workunit.client.0.smithi134.stdout:0/327: creat d2/f6c x:0 0 0 2024-02-16T22:18:53.327 INFO:tasks.workunit.client.0.smithi134.stdout:5/359: dread d2/d9/f53 [0,4194304] 0 2024-02-16T22:18:53.328 INFO:tasks.workunit.client.0.smithi134.stdout:0/328: write d2/f33 [66852,88925] 0 2024-02-16T22:18:53.328 INFO:tasks.workunit.client.0.smithi134.stdout:5/360: creat d2/d35/d36/d46/d68/d74/f75 x:0 0 0 2024-02-16T22:18:53.328 INFO:tasks.workunit.client.0.smithi134.stdout:5/361: stat d2/d9/dc/d27/d4b/l60 0 2024-02-16T22:18:53.328 INFO:tasks.workunit.client.0.smithi134.stdout:0/329: creat d2/dc/d48/d60/f6d x:0 0 0 2024-02-16T22:18:53.330 INFO:tasks.workunit.client.0.smithi134.stdout:0/330: creat d2/d4b/d53/f6e x:0 0 0 2024-02-16T22:18:53.331 INFO:tasks.workunit.client.0.smithi134.stdout:5/362: getdents d2 0 2024-02-16T22:18:53.332 INFO:tasks.workunit.client.0.smithi134.stdout:3/373: dwrite da/d1c/f22 [0,4194304] 0 2024-02-16T22:18:53.337 INFO:tasks.workunit.client.0.smithi134.stdout:1/345: dwrite d5/da/d21/d45/f4e [0,4194304] 0 2024-02-16T22:18:53.337 INFO:tasks.workunit.client.0.smithi134.stdout:8/310: dread d2/f2c [0,4194304] 0 2024-02-16T22:18:53.340 INFO:tasks.workunit.client.0.smithi134.stdout:5/363: symlink d2/d9/dc/l76 0 2024-02-16T22:18:53.340 INFO:tasks.workunit.client.0.smithi134.stdout:5/364: getdents d2/d35/d72 0 2024-02-16T22:18:53.343 INFO:tasks.workunit.client.0.smithi134.stdout:8/311: truncate d2/df/d18/d27/f30 187720 0 2024-02-16T22:18:53.343 INFO:tasks.workunit.client.0.smithi134.stdout:8/312: rename d2/df/d19 to d2/df/d19/d40/d53/d66 22 2024-02-16T22:18:53.343 INFO:tasks.workunit.client.0.smithi134.stdout:8/313: creat d2/f67 x:0 0 0 2024-02-16T22:18:53.343 INFO:tasks.workunit.client.0.smithi134.stdout:3/374: write da/d1c/f32 [3525867,29445] 0 2024-02-16T22:18:53.344 INFO:tasks.workunit.client.0.smithi134.stdout:1/346: mknod d5/d1a/d4d/c6e 0 2024-02-16T22:18:53.346 INFO:tasks.workunit.client.0.smithi134.stdout:0/331: dwrite d2/dc/d2d/f54 [0,4194304] 0 2024-02-16T22:18:53.349 INFO:tasks.workunit.client.0.smithi134.stdout:5/365: write d2/d9/dc/f26 [4772462,124123] 0 2024-02-16T22:18:53.351 INFO:tasks.workunit.client.0.smithi134.stdout:8/314: rename d2/df/d18/c1e to d2/df/d18/d2a/c68 0 2024-02-16T22:18:53.351 INFO:tasks.workunit.client.0.smithi134.stdout:0/332: write d2/f22 [667531,82308] 0 2024-02-16T22:18:53.352 INFO:tasks.workunit.client.0.smithi134.stdout:0/333: dread d2/dc/d48/f4c [0,4194304] 0 2024-02-16T22:18:53.353 INFO:tasks.workunit.client.0.smithi134.stdout:3/375: truncate da/d12/f42 384474 0 2024-02-16T22:18:53.353 INFO:tasks.workunit.client.0.smithi134.stdout:0/334: dread d2/dc/f4f [0,4194304] 0 2024-02-16T22:18:53.354 INFO:tasks.workunit.client.0.smithi134.stdout:1/347: symlink d5/d1a/d4d/l6f 0 2024-02-16T22:18:53.358 INFO:tasks.workunit.client.0.smithi134.stdout:5/366: rename d2/f4e to d2/d35/d36/f77 0 2024-02-16T22:18:53.358 INFO:tasks.workunit.client.0.smithi134.stdout:5/367: stat d2/f4 0 2024-02-16T22:18:53.359 INFO:tasks.workunit.client.0.smithi134.stdout:8/315: write d2/df/f3b [4170689,69698] 0 2024-02-16T22:18:53.362 INFO:tasks.workunit.client.0.smithi134.stdout:3/376: write da/d1c/d24/f4a [1760630,43550] 0 2024-02-16T22:18:53.363 INFO:tasks.workunit.client.0.smithi134.stdout:3/377: read da/d1c/d24/d29/d51/d5b/f3b [5124096,49287] 0 2024-02-16T22:18:53.363 INFO:tasks.workunit.client.0.smithi134.stdout:1/348: mknod d5/d1a/c70 0 2024-02-16T22:18:53.368 INFO:tasks.workunit.client.0.smithi134.stdout:8/316: unlink d2/l17 0 2024-02-16T22:18:53.370 INFO:tasks.workunit.client.0.smithi134.stdout:3/378: mknod da/d1c/d24/c77 0 2024-02-16T22:18:53.371 INFO:tasks.workunit.client.0.smithi134.stdout:3/379: readlink da/d1c/d24/d29/l63 0 2024-02-16T22:18:53.371 INFO:tasks.workunit.client.0.smithi134.stdout:3/380: fdatasync da/d1c/d24/d29/f49 0 2024-02-16T22:18:53.371 INFO:tasks.workunit.client.0.smithi134.stdout:3/381: dread - da/d1c/d24/d29/d51/d5b/f44 zero size 2024-02-16T22:18:53.371 INFO:tasks.workunit.client.0.smithi134.stdout:1/349: symlink d5/d1a/d23/d61/l71 0 2024-02-16T22:18:53.374 INFO:tasks.workunit.client.0.smithi134.stdout:5/368: rmdir d2/d9/dc 39 2024-02-16T22:18:53.375 INFO:tasks.workunit.client.0.smithi134.stdout:0/335: dwrite d2/d20/d50/f51 [0,4194304] 0 2024-02-16T22:18:53.376 INFO:tasks.workunit.client.0.smithi134.stdout:8/317: symlink d2/df/d18/d2a/l69 0 2024-02-16T22:18:53.376 INFO:tasks.workunit.client.0.smithi134.stdout:8/318: chown d2/df/d18/d27/l46 4299024 1 2024-02-16T22:18:53.378 INFO:tasks.workunit.client.0.smithi134.stdout:1/350: mkdir d5/d1a/d23/d3c/d6a/d5c/d72 0 2024-02-16T22:18:53.380 INFO:tasks.workunit.client.0.smithi134.stdout:5/369: rename d2/d9/dc/f13 to d2/d35/d36/d3d/f78 0 2024-02-16T22:18:53.381 INFO:tasks.workunit.client.0.smithi134.stdout:3/382: dread da/d12/f42 [0,4194304] 0 2024-02-16T22:18:53.381 INFO:tasks.workunit.client.0.smithi134.stdout:3/383: write da/d1c/d24/f4a [3038549,73089] 0 2024-02-16T22:18:53.383 INFO:tasks.workunit.client.0.smithi134.stdout:3/384: dread da/d1c/d24/d2c/f58 [4194304,4194304] 0 2024-02-16T22:18:53.387 INFO:tasks.workunit.client.0.smithi134.stdout:0/336: creat d2/dc/d32/d3e/d5e/f6f x:0 0 0 2024-02-16T22:18:53.388 INFO:tasks.workunit.client.0.smithi134.stdout:8/319: truncate d2/df/f1c 2324014 0 2024-02-16T22:18:53.388 INFO:tasks.workunit.client.0.smithi134.stdout:8/320: creat d2/df/d18/d12/f6a x:0 0 0 2024-02-16T22:18:53.389 INFO:tasks.workunit.client.0.smithi134.stdout:1/351: rename d5/d1a/d23/d3c/d6a/l5d to d5/d1a/l73 0 2024-02-16T22:18:53.391 INFO:tasks.workunit.client.0.smithi134.stdout:5/370: mknod d2/d35/c79 0 2024-02-16T22:18:53.393 INFO:tasks.workunit.client.0.smithi134.stdout:0/337: symlink d2/d4b/d53/l70 0 2024-02-16T22:18:53.395 INFO:tasks.workunit.client.0.smithi134.stdout:8/321: symlink d2/df/d18/l6b 0 2024-02-16T22:18:53.397 INFO:tasks.workunit.client.0.smithi134.stdout:5/371: creat d2/d35/d72/f7a x:0 0 0 2024-02-16T22:18:53.397 INFO:tasks.workunit.client.0.smithi134.stdout:5/372: read f0 [2583662,105633] 0 2024-02-16T22:18:53.398 INFO:tasks.workunit.client.0.smithi134.stdout:8/322: link d2/df/d18/d27/l4c d2/df/d18/d2a/d41/l6c 0 2024-02-16T22:18:53.399 INFO:tasks.workunit.client.0.smithi134.stdout:1/352: mknod d5/da/d2d/c74 0 2024-02-16T22:18:53.400 INFO:tasks.workunit.client.0.smithi134.stdout:7/310: sync 2024-02-16T22:18:53.401 INFO:tasks.workunit.client.0.smithi134.stdout:5/373: creat d2/d35/d36/d46/d68/f7b x:0 0 0 2024-02-16T22:18:53.402 INFO:tasks.workunit.client.0.smithi134.stdout:1/353: truncate f3 520492 0 2024-02-16T22:18:53.409 INFO:tasks.workunit.client.0.smithi134.stdout:7/311: dread d2/d6/d17/f23 [0,4194304] 0 2024-02-16T22:18:53.410 INFO:tasks.workunit.client.0.smithi134.stdout:7/312: rmdir d2/d6 39 2024-02-16T22:18:53.413 INFO:tasks.workunit.client.0.smithi134.stdout:7/313: symlink d2/d6/d17/d25/l67 0 2024-02-16T22:18:53.417 INFO:tasks.workunit.client.0.smithi134.stdout:7/314: dread d2/d5/f10 [0,4194304] 0 2024-02-16T22:18:53.417 INFO:tasks.workunit.client.0.smithi134.stdout:7/315: fsync d2/d6/d17/d31/d28/f36 0 2024-02-16T22:18:53.418 INFO:tasks.workunit.client.0.smithi134.stdout:7/316: readlink d2/d6/d17/d31/d28/l34 0 2024-02-16T22:18:53.418 INFO:tasks.workunit.client.0.smithi134.stdout:7/317: symlink d2/d5/d22/d26/d48/l68 0 2024-02-16T22:18:53.419 INFO:tasks.workunit.client.0.smithi134.stdout:7/318: creat d2/d5/d22/d26/d48/f69 x:0 0 0 2024-02-16T22:18:53.420 INFO:tasks.workunit.client.0.smithi134.stdout:7/319: symlink d2/d7/l6a 0 2024-02-16T22:18:53.422 INFO:tasks.workunit.client.0.smithi134.stdout:7/320: link d2/d5/d4c/l64 d2/l6b 0 2024-02-16T22:18:53.427 INFO:tasks.workunit.client.0.smithi134.stdout:8/323: dwrite d2/f36 [0,4194304] 0 2024-02-16T22:18:53.428 INFO:tasks.workunit.client.0.smithi134.stdout:5/374: dwrite d2/d9/dc/d15/f31 [0,4194304] 0 2024-02-16T22:18:53.429 INFO:tasks.workunit.client.0.smithi134.stdout:8/324: mknod d2/df/d18/d2a/c6d 0 2024-02-16T22:18:53.429 INFO:tasks.workunit.client.0.smithi134.stdout:1/354: dwrite d5/da/d1c/f32 [0,4194304] 0 2024-02-16T22:18:53.431 INFO:tasks.workunit.client.0.smithi134.stdout:5/375: creat d2/d9/dc/d15/f7c x:0 0 0 2024-02-16T22:18:53.433 INFO:tasks.workunit.client.0.smithi134.stdout:8/325: dread d2/df/f1c [0,4194304] 0 2024-02-16T22:18:53.435 INFO:tasks.workunit.client.0.smithi134.stdout:1/355: mknod d5/da/d21/d45/c75 0 2024-02-16T22:18:53.436 INFO:tasks.workunit.client.0.smithi134.stdout:7/321: rmdir d2/d5 39 2024-02-16T22:18:53.438 INFO:tasks.workunit.client.0.smithi134.stdout:5/376: truncate d2/d35/d36/f64 3441030 0 2024-02-16T22:18:53.440 INFO:tasks.workunit.client.0.smithi134.stdout:8/326: write d2/df/d19/f51 [1358722,110621] 0 2024-02-16T22:18:53.440 INFO:tasks.workunit.client.0.smithi134.stdout:7/322: rename d2/d1e/d24/f3c to d2/d6/d17/d31/d28/f6c 0 2024-02-16T22:18:53.442 INFO:tasks.workunit.client.0.smithi134.stdout:5/377: creat d2/d9/dc/d27/d4b/f7d x:0 0 0 2024-02-16T22:18:53.446 INFO:tasks.workunit.client.0.smithi134.stdout:8/327: rename d2/df/f5b to d2/df/f6e 0 2024-02-16T22:18:53.446 INFO:tasks.workunit.client.0.smithi134.stdout:8/328: read - d2/df/d18/d12/f6a zero size 2024-02-16T22:18:53.447 INFO:tasks.workunit.client.0.smithi134.stdout:7/323: mknod d2/d5/c6d 0 2024-02-16T22:18:53.449 INFO:tasks.workunit.client.0.smithi134.stdout:8/329: rename d2/df/d18/d12/c43 to d2/df/d18/d2a/d41/c6f 0 2024-02-16T22:18:53.450 INFO:tasks.workunit.client.0.smithi134.stdout:7/324: creat d2/d5/d22/d26/d48/f6e x:0 0 0 2024-02-16T22:18:53.450 INFO:tasks.workunit.client.0.smithi134.stdout:7/325: truncate d2/d5/d22/d26/d48/f6e 814913 0 2024-02-16T22:18:53.451 INFO:tasks.workunit.client.0.smithi134.stdout:5/378: write d2/d9/dc/d32/f5a [4178237,13121] 0 2024-02-16T22:18:53.453 INFO:tasks.workunit.client.0.smithi134.stdout:1/356: dwrite d5/da/f15 [0,4194304] 0 2024-02-16T22:18:53.455 INFO:tasks.workunit.client.0.smithi134.stdout:7/326: fdatasync d2/d6/f21 0 2024-02-16T22:18:53.463 INFO:tasks.workunit.client.0.smithi134.stdout:8/330: getdents d2/df 0 2024-02-16T22:18:53.467 INFO:tasks.workunit.client.0.smithi134.stdout:7/327: dread d2/d5/d19/d4a/f58 [0,4194304] 0 2024-02-16T22:18:53.467 INFO:tasks.workunit.client.0.smithi134.stdout:7/328: write d2/d6/f16 [590982,70813] 0 2024-02-16T22:18:53.470 INFO:tasks.workunit.client.0.smithi134.stdout:5/379: dwrite d2/d9/dc/d27/f2c [0,4194304] 0 2024-02-16T22:18:53.470 INFO:tasks.workunit.client.0.smithi134.stdout:5/380: chown d2/d35/d36 104 1 2024-02-16T22:18:53.472 INFO:tasks.workunit.client.0.smithi134.stdout:7/329: creat d2/d6/d17/d31/f6f x:0 0 0 2024-02-16T22:18:53.475 INFO:tasks.workunit.client.0.smithi134.stdout:7/330: creat d2/d6/f70 x:0 0 0 2024-02-16T22:18:53.475 INFO:tasks.workunit.client.0.smithi134.stdout:7/331: read d2/d6/f16 [299250,114669] 0 2024-02-16T22:18:53.476 INFO:tasks.workunit.client.0.smithi134.stdout:7/332: symlink d2/d5/d22/l71 0 2024-02-16T22:18:53.478 INFO:tasks.workunit.client.0.smithi134.stdout:7/333: rename d2/d7/f3a to d2/d6/d17/d25/d63/f72 0 2024-02-16T22:18:53.479 INFO:tasks.workunit.client.0.smithi134.stdout:7/334: link d2/c45 d2/d5/d22/c73 0 2024-02-16T22:18:53.480 INFO:tasks.workunit.client.0.smithi134.stdout:7/335: write d2/d1e/f39 [730978,114509] 0 2024-02-16T22:18:53.484 INFO:tasks.workunit.client.0.smithi134.stdout:7/336: symlink d2/d5/d22/l74 0 2024-02-16T22:18:53.485 INFO:tasks.workunit.client.0.smithi134.stdout:7/337: stat d2/d5/d19/f1d 0 2024-02-16T22:18:53.485 INFO:tasks.workunit.client.0.smithi134.stdout:5/381: dread d2/fa [0,4194304] 0 2024-02-16T22:18:53.485 INFO:tasks.workunit.client.0.smithi134.stdout:7/338: unlink d2/d5/d4c/f5d 0 2024-02-16T22:18:53.485 INFO:tasks.workunit.client.0.smithi134.stdout:5/382: symlink d2/d35/d36/d3d/d63/l7e 0 2024-02-16T22:18:53.486 INFO:tasks.workunit.client.0.smithi134.stdout:5/383: rename d2/l1f to d2/d9/dc/d15/d2f/l7f 0 2024-02-16T22:18:53.486 INFO:tasks.workunit.client.0.smithi134.stdout:5/384: dread - d2/d35/d36/d3d/d63/f70 zero size 2024-02-16T22:18:53.488 INFO:tasks.workunit.client.0.smithi134.stdout:5/385: unlink d2/d9/dc/c49 0 2024-02-16T22:18:53.490 INFO:tasks.workunit.client.0.smithi134.stdout:9/417: sync 2024-02-16T22:18:53.490 INFO:tasks.workunit.client.0.smithi134.stdout:6/363: sync 2024-02-16T22:18:53.490 INFO:tasks.workunit.client.0.smithi134.stdout:2/305: sync 2024-02-16T22:18:53.490 INFO:tasks.workunit.client.0.smithi134.stdout:4/269: sync 2024-02-16T22:18:53.490 INFO:tasks.workunit.client.0.smithi134.stdout:2/306: creat df/d10/d30/d49/f57 x:0 0 0 2024-02-16T22:18:53.491 INFO:tasks.workunit.client.0.smithi134.stdout:1/357: dwrite d5/d1a/d23/f20 [4194304,4194304] 0 2024-02-16T22:18:53.491 INFO:tasks.workunit.client.0.smithi134.stdout:8/331: dwrite d2/df/f10 [0,4194304] 0 2024-02-16T22:18:53.491 INFO:tasks.workunit.client.0.smithi134.stdout:1/358: chown d5/d1a/f31 0 1 2024-02-16T22:18:53.491 INFO:tasks.workunit.client.0.smithi134.stdout:1/359: write d5/d1a/f62 [74355,27733] 0 2024-02-16T22:18:53.491 INFO:tasks.workunit.client.0.smithi134.stdout:8/332: write d2/f63 [354832,123271] 0 2024-02-16T22:18:53.494 INFO:tasks.workunit.client.0.smithi134.stdout:1/360: dread d5/d1a/d23/f27 [0,4194304] 0 2024-02-16T22:18:53.499 INFO:tasks.workunit.client.0.smithi134.stdout:7/339: write d2/fb [9619982,42110] 0 2024-02-16T22:18:53.500 INFO:tasks.workunit.client.0.smithi134.stdout:7/340: chown d2/c45 319968908 1 2024-02-16T22:18:53.500 INFO:tasks.workunit.client.0.smithi134.stdout:1/361: unlink d5/d1a/d23/d61/l6b 0 2024-02-16T22:18:53.502 INFO:tasks.workunit.client.0.smithi134.stdout:7/341: symlink d2/d6/l75 0 2024-02-16T22:18:53.502 INFO:tasks.workunit.client.0.smithi134.stdout:7/342: truncate d2/d1e/d24/f5a 738463 0 2024-02-16T22:18:53.507 INFO:tasks.workunit.client.0.smithi134.stdout:7/343: mknod d2/d7/c76 0 2024-02-16T22:18:53.507 INFO:tasks.workunit.client.0.smithi134.stdout:7/344: chown d2/d5/c6d 1 1 2024-02-16T22:18:53.507 INFO:tasks.workunit.client.0.smithi134.stdout:7/345: chown d2/d5/d22/d26/d48/f6e 59053054 1 2024-02-16T22:18:53.507 INFO:tasks.workunit.client.0.smithi134.stdout:7/346: chown d2/d6/d17/d31/l13 78810645 1 2024-02-16T22:18:53.508 INFO:tasks.workunit.client.0.smithi134.stdout:7/347: chown d2/d5/d4c 5807452 1 2024-02-16T22:18:53.508 INFO:tasks.workunit.client.0.smithi134.stdout:8/333: dread d2/df/d18/f6 [0,4194304] 0 2024-02-16T22:18:53.508 INFO:tasks.workunit.client.0.smithi134.stdout:6/364: write d17/f21 [3872430,112678] 0 2024-02-16T22:18:53.508 INFO:tasks.workunit.client.0.smithi134.stdout:6/365: stat d17/d27/d4f/d52/l65 0 2024-02-16T22:18:53.511 INFO:tasks.workunit.client.0.smithi134.stdout:6/366: symlink d17/d22/d28/d5b/l72 0 2024-02-16T22:18:53.513 INFO:tasks.workunit.client.0.smithi134.stdout:6/367: mkdir d17/d22/d73 0 2024-02-16T22:18:53.513 INFO:tasks.workunit.client.0.smithi134.stdout:6/368: truncate d17/d36/f6f 1100942 0 2024-02-16T22:18:53.515 INFO:tasks.workunit.client.0.smithi134.stdout:6/369: mknod d17/d22/d73/c74 0 2024-02-16T22:18:53.516 INFO:tasks.workunit.client.0.smithi134.stdout:6/370: dread d17/f51 [0,4194304] 0 2024-02-16T22:18:53.517 INFO:tasks.workunit.client.0.smithi134.stdout:7/348: write d2/f1a [922644,104551] 0 2024-02-16T22:18:53.519 INFO:tasks.workunit.client.0.smithi134.stdout:6/371: truncate d17/d36/f58 161264 0 2024-02-16T22:18:53.521 INFO:tasks.workunit.client.0.smithi134.stdout:7/349: link d2/d5/d22/d26/f5f d2/d5/d22/d26/d48/f77 0 2024-02-16T22:18:53.522 INFO:tasks.workunit.client.0.smithi134.stdout:7/350: truncate d2/d6/d17/d31/f6f 274567 0 2024-02-16T22:18:53.522 INFO:tasks.workunit.client.0.smithi134.stdout:7/351: readlink d2/d6/d17/d31/d28/l34 0 2024-02-16T22:18:53.522 INFO:tasks.workunit.client.0.smithi134.stdout:7/352: write d2/d5/d22/d26/f5f [695782,5441] 0 2024-02-16T22:18:53.522 INFO:tasks.workunit.client.0.smithi134.stdout:7/353: dread - d2/f62 zero size 2024-02-16T22:18:53.522 INFO:tasks.workunit.client.0.smithi134.stdout:7/354: symlink d2/d6/d17/d25/l78 0 2024-02-16T22:18:53.526 INFO:tasks.workunit.client.0.smithi134.stdout:8/334: dread d2/df/d18/d5a/f49 [0,4194304] 0 2024-02-16T22:18:53.526 INFO:tasks.workunit.client.0.smithi134.stdout:8/335: read d2/df/d18/d2a/f2b [3181559,1821] 0 2024-02-16T22:18:53.526 INFO:tasks.workunit.client.0.smithi134.stdout:8/336: write d2/df/d18/f6 [9272292,43109] 0 2024-02-16T22:18:53.526 INFO:tasks.workunit.client.0.smithi134.stdout:4/270: dwrite d0/d6/d8/f52 [0,4194304] 0 2024-02-16T22:18:53.529 INFO:tasks.workunit.client.0.smithi134.stdout:4/271: rename d0/d6/d22/d25/c3f to d0/d6/d1e/d39/d4e/c5c 0 2024-02-16T22:18:53.529 INFO:tasks.workunit.client.0.smithi134.stdout:4/272: fsync d0/d6/f24 0 2024-02-16T22:18:53.529 INFO:tasks.workunit.client.0.smithi134.stdout:4/273: dread - d0/d31/f4c zero size 2024-02-16T22:18:53.529 INFO:tasks.workunit.client.0.smithi134.stdout:4/274: readlink d0/d6/d16/d1a/l34 0 2024-02-16T22:18:53.533 INFO:tasks.workunit.client.0.smithi134.stdout:6/372: dread d17/f2d [0,4194304] 0 2024-02-16T22:18:53.533 INFO:tasks.workunit.client.0.smithi134.stdout:6/373: chown d17/d22/d70 7 1 2024-02-16T22:18:53.535 INFO:tasks.workunit.client.0.smithi134.stdout:5/386: dwrite d2/d9/dc/d32/f5a [4194304,4194304] 0 2024-02-16T22:18:53.535 INFO:tasks.workunit.client.0.smithi134.stdout:5/387: dread - d2/d9/f6f zero size 2024-02-16T22:18:53.535 INFO:tasks.workunit.client.0.smithi134.stdout:5/388: write d2/d35/f58 [1496681,46262] 0 2024-02-16T22:18:53.535 INFO:tasks.workunit.client.0.smithi134.stdout:2/307: dwrite df/d10/d15/f16 [0,4194304] 0 2024-02-16T22:18:53.535 INFO:tasks.workunit.client.0.smithi134.stdout:2/308: chown df/d10/d11/c24 4399634 1 2024-02-16T22:18:53.535 INFO:tasks.workunit.client.0.smithi134.stdout:2/309: write df/d10/d15/f1e [71014,59045] 0 2024-02-16T22:18:53.535 INFO:tasks.workunit.client.0.smithi134.stdout:9/418: dwrite db/dc/f12 [0,4194304] 0 2024-02-16T22:18:53.539 INFO:tasks.workunit.client.0.smithi134.stdout:5/389: mknod d2/d35/d36/d3d/c80 0 2024-02-16T22:18:53.539 INFO:tasks.workunit.client.0.smithi134.stdout:5/390: truncate d2/d35/d36/d3d/d63/f70 106021 0 2024-02-16T22:18:53.540 INFO:tasks.workunit.client.0.smithi134.stdout:8/337: write d2/df/f10 [3885955,75908] 0 2024-02-16T22:18:53.541 INFO:tasks.workunit.client.0.smithi134.stdout:6/374: read d17/d22/d44/f4a [3125697,1882] 0 2024-02-16T22:18:53.541 INFO:tasks.workunit.client.0.smithi134.stdout:6/375: creat d17/d22/d44/f75 x:0 0 0 2024-02-16T22:18:53.542 INFO:tasks.workunit.client.0.smithi134.stdout:6/376: dread d17/d27/d30/f33 [0,4194304] 0 2024-02-16T22:18:53.543 INFO:tasks.workunit.client.0.smithi134.stdout:7/355: dwrite d2/d1e/f61 [0,4194304] 0 2024-02-16T22:18:53.545 INFO:tasks.workunit.client.0.smithi134.stdout:6/377: dread d17/f21 [0,4194304] 0 2024-02-16T22:18:53.546 INFO:tasks.workunit.client.0.smithi134.stdout:2/310: rename df/d10/d15/l3d to df/d10/d15/l58 0 2024-02-16T22:18:53.549 INFO:tasks.workunit.client.0.smithi134.stdout:9/419: getdents db/d20/d22/d51 0 2024-02-16T22:18:53.549 INFO:tasks.workunit.client.0.smithi134.stdout:9/420: fdatasync db/d20/d22/d51/f5f 0 2024-02-16T22:18:53.551 INFO:tasks.workunit.client.0.smithi134.stdout:5/391: creat d2/d9/dc/f81 x:0 0 0 2024-02-16T22:18:53.552 INFO:tasks.workunit.client.0.smithi134.stdout:8/338: creat d2/df/d18/f70 x:0 0 0 2024-02-16T22:18:53.558 INFO:tasks.workunit.client.0.smithi134.stdout:7/356: link d2/c11 d2/d5/d22/d26/c79 0 2024-02-16T22:18:53.558 INFO:tasks.workunit.client.0.smithi134.stdout:6/378: write d17/d22/f24 [3303214,51022] 0 2024-02-16T22:18:53.558 INFO:tasks.workunit.client.0.smithi134.stdout:6/379: creat d17/f76 x:0 0 0 2024-02-16T22:18:53.559 INFO:tasks.workunit.client.0.smithi134.stdout:2/311: mknod df/d10/d11/c59 0 2024-02-16T22:18:53.560 INFO:tasks.workunit.client.0.smithi134.stdout:5/392: unlink d2/d35/d36/f64 0 2024-02-16T22:18:53.560 INFO:tasks.workunit.client.0.smithi134.stdout:5/393: dread - d2/d9/dc/d15/f4d zero size 2024-02-16T22:18:53.561 INFO:tasks.workunit.client.0.smithi134.stdout:8/339: symlink d2/df/d19/d40/d53/l71 0 2024-02-16T22:18:53.562 INFO:tasks.workunit.client.0.smithi134.stdout:7/357: symlink d2/d5/d19/l7a 0 2024-02-16T22:18:53.562 INFO:tasks.workunit.client.0.smithi134.stdout:7/358: chown d2/d5/d22/f66 12011 1 2024-02-16T22:18:53.562 INFO:tasks.workunit.client.0.smithi134.stdout:7/359: chown d2/d5/d19/d4a/f58 11423023 1 2024-02-16T22:18:53.562 INFO:tasks.workunit.client.0.smithi134.stdout:7/360: write d2/d6/f70 [340717,11927] 0 2024-02-16T22:18:53.564 INFO:tasks.workunit.client.0.smithi134.stdout:6/380: mkdir d17/d36/d77 0 2024-02-16T22:18:53.566 INFO:tasks.workunit.client.0.smithi134.stdout:8/340: mkdir d2/df/d19/d40/d53/d5e/d72 0 2024-02-16T22:18:53.567 INFO:tasks.workunit.client.0.smithi134.stdout:7/361: creat d2/d5/d19/d4a/f7b x:0 0 0 2024-02-16T22:18:53.567 INFO:tasks.workunit.client.0.smithi134.stdout:7/362: write d2/d6/d17/d31/d28/f36 [1067278,117763] 0 2024-02-16T22:18:53.568 INFO:tasks.workunit.client.0.smithi134.stdout:6/381: write d17/f3a [4912845,102143] 0 2024-02-16T22:18:53.568 INFO:tasks.workunit.client.0.smithi134.stdout:5/394: dread d2/f18 [0,4194304] 0 2024-02-16T22:18:53.568 INFO:tasks.workunit.client.0.smithi134.stdout:5/395: dread - d2/d35/d36/d46/d68/d74/f75 zero size 2024-02-16T22:18:53.568 INFO:tasks.workunit.client.0.smithi134.stdout:9/421: dwrite db/f57 [0,4194304] 0 2024-02-16T22:18:53.568 INFO:tasks.workunit.client.0.smithi134.stdout:9/422: write db/dc/f14 [4631328,809] 0 2024-02-16T22:18:53.571 INFO:tasks.workunit.client.0.smithi134.stdout:3/385: sync 2024-02-16T22:18:53.573 INFO:tasks.workunit.client.0.smithi134.stdout:8/341: mknod d2/df/d19/d40/d53/c73 0 2024-02-16T22:18:53.573 INFO:tasks.workunit.client.0.smithi134.stdout:8/342: write d2/df/f1c [2771707,42827] 0 2024-02-16T22:18:53.575 INFO:tasks.workunit.client.0.smithi134.stdout:6/382: write d17/d27/d4f/f50 [699597,35331] 0 2024-02-16T22:18:53.575 INFO:tasks.workunit.client.0.smithi134.stdout:6/383: creat d17/d27/d4f/f78 x:0 0 0 2024-02-16T22:18:53.575 INFO:tasks.workunit.client.0.smithi134.stdout:6/384: write d17/d27/d30/f35 [5364267,72977] 0 2024-02-16T22:18:53.575 INFO:tasks.workunit.client.0.smithi134.stdout:6/385: chown d17/d22 8848798 1 2024-02-16T22:18:53.577 INFO:tasks.workunit.client.0.smithi134.stdout:7/363: truncate d2/d5/d19/f2b 2618022 0 2024-02-16T22:18:53.582 INFO:tasks.workunit.client.0.smithi134.stdout:9/423: mkdir db/d20/d22/d64/d69/d89 0 2024-02-16T22:18:53.582 INFO:tasks.workunit.client.0.smithi134.stdout:3/386: symlink da/d1c/d24/d2c/l78 0 2024-02-16T22:18:53.582 INFO:tasks.workunit.client.0.smithi134.stdout:3/387: getdents da/d1c/d24/d29/d51/d5b/d6d 0 2024-02-16T22:18:53.582 INFO:tasks.workunit.client.0.smithi134.stdout:3/388: chown da/d12/d2a/d5c 215509 1 2024-02-16T22:18:53.589 INFO:tasks.workunit.client.0.smithi134.stdout:9/424: creat db/d20/d22/d46/f8a x:0 0 0 2024-02-16T22:18:53.590 INFO:tasks.workunit.client.0.smithi134.stdout:2/312: rename df/d10/d11 to df/d10/d15/d5a 0 2024-02-16T22:18:53.591 INFO:tasks.workunit.client.0.smithi134.stdout:2/313: write df/d10/d15/d5a/d17/d1b/f22 [638848,52896] 0 2024-02-16T22:18:53.592 INFO:tasks.workunit.client.0.smithi134.stdout:5/396: dwrite d2/f50 [0,4194304] 0 2024-02-16T22:18:53.594 INFO:tasks.workunit.client.0.smithi134.stdout:9/425: symlink db/d20/d22/d64/d69/d6e/l8b 0 2024-02-16T22:18:53.596 INFO:tasks.workunit.client.0.smithi134.stdout:2/314: unlink df/d10/l36 0 2024-02-16T22:18:53.597 INFO:tasks.workunit.client.0.smithi134.stdout:2/315: chown df/d10/d30/d49/f4f 1 1 2024-02-16T22:18:53.600 INFO:tasks.workunit.client.0.smithi134.stdout:5/397: symlink d2/l82 0 2024-02-16T22:18:53.600 INFO:tasks.workunit.client.0.smithi134.stdout:5/398: fsync d2/d9/dc/d27/f2c 0 2024-02-16T22:18:53.600 INFO:tasks.workunit.client.0.smithi134.stdout:5/399: readlink d2/l82 0 2024-02-16T22:18:53.601 INFO:tasks.workunit.client.0.smithi134.stdout:2/316: mknod df/d10/d15/d5a/d34/c5b 0 2024-02-16T22:18:53.601 INFO:tasks.workunit.client.0.smithi134.stdout:5/400: rmdir d2/d9/dc/d15/d2f 39 2024-02-16T22:18:53.601 INFO:tasks.workunit.client.0.smithi134.stdout:5/401: write d2/d9/dc/d27/d4b/f7d [689548,108478] 0 2024-02-16T22:18:53.601 INFO:tasks.workunit.client.0.smithi134.stdout:5/402: chown d2/d9/dc/d15/f41 0 1 2024-02-16T22:18:53.602 INFO:tasks.workunit.client.0.smithi134.stdout:2/317: mknod df/c5c 0 2024-02-16T22:18:53.602 INFO:tasks.workunit.client.0.smithi134.stdout:2/318: dread - df/d10/d30/d49/f54 zero size 2024-02-16T22:18:53.605 INFO:tasks.workunit.client.0.smithi134.stdout:9/426: dread db/f33 [0,4194304] 0 2024-02-16T22:18:53.622 INFO:tasks.workunit.client.0.smithi134.stdout:8/343: dwrite d2/df/d18/d2a/d41/f4d [0,4194304] 0 2024-02-16T22:18:53.622 INFO:tasks.workunit.client.0.smithi134.stdout:8/344: readlink d2/df/d18/d27/l4c 0 2024-02-16T22:18:53.622 INFO:tasks.workunit.client.0.smithi134.stdout:8/345: write d2/f65 [986912,27075] 0 2024-02-16T22:18:53.622 INFO:tasks.workunit.client.0.smithi134.stdout:8/346: write d2/f2c [6503705,98251] 0 2024-02-16T22:18:53.624 INFO:tasks.workunit.client.0.smithi134.stdout:7/364: dwrite d2/d5/d22/d26/f5f [0,4194304] 0 2024-02-16T22:18:53.624 INFO:tasks.workunit.client.0.smithi134.stdout:6/386: dwrite d17/f21 [0,4194304] 0 2024-02-16T22:18:53.624 INFO:tasks.workunit.client.0.smithi134.stdout:6/387: chown d17/f76 33 1 2024-02-16T22:18:53.625 INFO:tasks.workunit.client.0.smithi134.stdout:3/389: dwrite da/d1c/d24/f3d [0,4194304] 0 2024-02-16T22:18:53.625 INFO:tasks.workunit.client.0.smithi134.stdout:3/390: readlink da/l18 0 2024-02-16T22:18:53.625 INFO:tasks.workunit.client.0.smithi134.stdout:9/427: dwrite db/f43 [4194304,4194304] 0 2024-02-16T22:18:53.625 INFO:tasks.workunit.client.0.smithi134.stdout:9/428: getdents db/d20/d22/d64/d69/d6e/d81 0 2024-02-16T22:18:53.625 INFO:tasks.workunit.client.0.smithi134.stdout:9/429: truncate db/dc/f38 96889 0 2024-02-16T22:18:53.629 INFO:tasks.workunit.client.0.smithi134.stdout:7/365: dread d2/d6/f41 [0,4194304] 0 2024-02-16T22:18:53.633 INFO:tasks.workunit.client.0.smithi134.stdout:3/391: mkdir da/d1c/d24/d29/d51/d79 0 2024-02-16T22:18:53.634 INFO:tasks.workunit.client.0.smithi134.stdout:9/430: write db/d20/d22/f25 [2898843,13873] 0 2024-02-16T22:18:53.651 INFO:tasks.workunit.client.0.smithi134.stdout:3/392: dwrite da/d1c/d24/d29/d51/d5b/f3b [0,4194304] 0 2024-02-16T22:18:53.664 INFO:tasks.workunit.client.0.smithi134.stdout:7/366: symlink d2/d6/d17/d25/d63/l7c 0 2024-02-16T22:18:53.664 INFO:tasks.workunit.client.0.smithi134.stdout:7/367: write d2/d6/d17/d25/d63/f60 [724476,40920] 0 2024-02-16T22:18:53.666 INFO:tasks.workunit.client.0.smithi134.stdout:9/431: mkdir db/d20/d55/d8c 0 2024-02-16T22:18:53.666 INFO:tasks.workunit.client.0.smithi134.stdout:9/432: stat db/d20/d22/d64/d69/d6e/d81 0 2024-02-16T22:18:53.668 INFO:tasks.workunit.client.0.smithi134.stdout:6/388: rename d17/d22/d44 to d17/d27/d4f/d52/d79 0 2024-02-16T22:18:53.669 INFO:tasks.workunit.client.0.smithi134.stdout:9/433: getdents db/d20/d22/d64/d69/d6e 0 2024-02-16T22:18:53.671 INFO:tasks.workunit.client.0.smithi134.stdout:3/393: link da/d1c/d24/d29/d51/c57 da/d1c/d24/d29/c7a 0 2024-02-16T22:18:53.671 INFO:tasks.workunit.client.0.smithi134.stdout:3/394: write da/d1c/d24/d29/d51/f59 [1011262,113303] 0 2024-02-16T22:18:53.672 INFO:tasks.workunit.client.0.smithi134.stdout:7/368: mkdir d2/d6/d7d 0 2024-02-16T22:18:53.672 INFO:tasks.workunit.client.0.smithi134.stdout:7/369: write d2/d5/d4c/f4d [665295,52446] 0 2024-02-16T22:18:53.672 INFO:tasks.workunit.client.0.smithi134.stdout:7/370: write d2/fb [6861997,107481] 0 2024-02-16T22:18:53.676 INFO:tasks.workunit.client.0.smithi134.stdout:7/371: link d2/d5/d22/c46 d2/d6/d17/d25/d63/c7e 0 2024-02-16T22:18:53.677 INFO:tasks.workunit.client.0.smithi134.stdout:9/434: read db/d20/d22/d64/d69/d6e/f7f [3558575,31045] 0 2024-02-16T22:18:53.677 INFO:tasks.workunit.client.0.smithi134.stdout:0/338: sync 2024-02-16T22:18:53.677 INFO:tasks.workunit.client.0.smithi134.stdout:3/395: getdents da/d12 0 2024-02-16T22:18:53.680 INFO:tasks.workunit.client.0.smithi134.stdout:9/435: link db/dc/f62 db/d20/d22/d64/f8d 0 2024-02-16T22:18:53.681 INFO:tasks.workunit.client.0.smithi134.stdout:0/339: getdents d2/d4b/d5f/d65 0 2024-02-16T22:18:53.683 INFO:tasks.workunit.client.0.smithi134.stdout:9/436: creat db/d20/f8e x:0 0 0 2024-02-16T22:18:53.683 INFO:tasks.workunit.client.0.smithi134.stdout:9/437: truncate db/dc/f61 135390 0 2024-02-16T22:18:53.683 INFO:tasks.workunit.client.0.smithi134.stdout:0/340: symlink d2/d20/d50/l71 0 2024-02-16T22:18:53.685 INFO:tasks.workunit.client.0.smithi134.stdout:9/438: dread db/d20/d22/d64/d86/f83 [0,4194304] 0 2024-02-16T22:18:53.685 INFO:tasks.workunit.client.0.smithi134.stdout:9/439: write db/d20/d22/d64/d86/f83 [1194384,95786] 0 2024-02-16T22:18:53.685 INFO:tasks.workunit.client.0.smithi134.stdout:7/372: rename d2/d1e to d2/d5/d22/d26/d48/d7f 0 2024-02-16T22:18:53.685 INFO:tasks.workunit.client.0.smithi134.stdout:7/373: write d2/d5/f2d [962075,83185] 0 2024-02-16T22:18:53.689 INFO:tasks.workunit.client.0.smithi134.stdout:9/440: rename db/d20/d22/d64/d86 to db/d20/d22/d46/d8f 0 2024-02-16T22:18:53.689 INFO:tasks.workunit.client.0.smithi134.stdout:9/441: fdatasync db/f57 0 2024-02-16T22:18:53.690 INFO:tasks.workunit.client.0.smithi134.stdout:6/389: rmdir d17/d27/d4f 39 2024-02-16T22:18:53.690 INFO:tasks.workunit.client.0.smithi134.stdout:6/390: creat d17/d36/f7a x:0 0 0 2024-02-16T22:18:53.692 INFO:tasks.workunit.client.0.smithi134.stdout:7/374: unlink d2/d5/d19/c47 0 2024-02-16T22:18:53.692 INFO:tasks.workunit.client.0.smithi134.stdout:6/391: write f11 [2148584,119225] 0 2024-02-16T22:18:53.693 INFO:tasks.workunit.client.0.smithi134.stdout:6/392: truncate d17/f51 1433693 0 2024-02-16T22:18:53.693 INFO:tasks.workunit.client.0.smithi134.stdout:0/341: mknod d2/c72 0 2024-02-16T22:18:53.698 INFO:tasks.workunit.client.0.smithi134.stdout:7/375: symlink d2/d5/d22/d26/d48/d7f/d24/l80 0 2024-02-16T22:18:53.698 INFO:tasks.workunit.client.0.smithi134.stdout:7/376: write d2/d6/d17/d31/f6f [962702,115450] 0 2024-02-16T22:18:53.699 INFO:tasks.workunit.client.0.smithi134.stdout:0/342: mknod d2/d20/d50/c73 0 2024-02-16T22:18:53.700 INFO:tasks.workunit.client.0.smithi134.stdout:0/343: symlink d2/dc/d48/l74 0 2024-02-16T22:18:53.701 INFO:tasks.workunit.client.0.smithi134.stdout:0/344: write d2/d4b/d53/f6e [831085,110808] 0 2024-02-16T22:18:53.714 INFO:tasks.workunit.client.0.smithi134.stdout:0/345: dread d2/f12 [0,4194304] 0 2024-02-16T22:18:53.714 INFO:tasks.workunit.client.0.smithi134.stdout:0/346: truncate d2/dc/f25 527841 0 2024-02-16T22:18:53.717 INFO:tasks.workunit.client.0.smithi134.stdout:3/396: dwrite da/d12/d2a/d5c/f73 [0,4194304] 0 2024-02-16T22:18:53.720 INFO:tasks.workunit.client.0.smithi134.stdout:6/393: dwrite d17/f3a [0,4194304] 0 2024-02-16T22:18:53.720 INFO:tasks.workunit.client.0.smithi134.stdout:7/377: dwrite d2/d5/d19/f2f [4194304,4194304] 0 2024-02-16T22:18:53.722 INFO:tasks.workunit.client.0.smithi134.stdout:3/397: creat da/d12/f7b x:0 0 0 2024-02-16T22:18:53.724 INFO:tasks.workunit.client.0.smithi134.stdout:6/394: mknod d17/d36/c7b 0 2024-02-16T22:18:53.724 INFO:tasks.workunit.client.0.smithi134.stdout:6/395: read d17/d22/f2e [2270319,1510] 0 2024-02-16T22:18:53.726 INFO:tasks.workunit.client.0.smithi134.stdout:7/378: dread d2/d6/f16 [0,4194304] 0 2024-02-16T22:18:53.727 INFO:tasks.workunit.client.0.smithi134.stdout:7/379: read d2/d6/f70 [16733,58300] 0 2024-02-16T22:18:53.728 INFO:tasks.workunit.client.0.smithi134.stdout:3/398: rename da/d12/f25 to da/d12/d2a/f7c 0 2024-02-16T22:18:53.728 INFO:tasks.workunit.client.0.smithi134.stdout:3/399: write da/d12/d2a/f38 [7235897,37818] 0 2024-02-16T22:18:53.731 INFO:tasks.workunit.client.0.smithi134.stdout:6/396: unlink d17/d27/d30/c41 0 2024-02-16T22:18:53.733 INFO:tasks.workunit.client.0.smithi134.stdout:6/397: mknod d17/d36/d77/c7c 0 2024-02-16T22:18:53.733 INFO:tasks.workunit.client.0.smithi134.stdout:6/398: readlink d17/d27/d4f/d52/d79/l53 0 2024-02-16T22:18:53.733 INFO:tasks.workunit.client.0.smithi134.stdout:6/399: write d17/d27/d4f/d52/d79/f75 [821562,87130] 0 2024-02-16T22:18:53.736 INFO:tasks.workunit.client.0.smithi134.stdout:0/347: dwrite d2/f33 [0,4194304] 0 2024-02-16T22:18:53.736 INFO:tasks.workunit.client.0.smithi134.stdout:0/348: write d2/dc/ff [5589939,79] 0 2024-02-16T22:18:53.736 INFO:tasks.workunit.client.0.smithi134.stdout:6/400: creat d17/d22/d70/f7d x:0 0 0 2024-02-16T22:18:53.754 INFO:tasks.workunit.client.0.smithi134.stdout:7/380: dwrite d2/d5/d22/d26/d48/d7f/f61 [0,4194304] 0 2024-02-16T22:18:53.755 INFO:tasks.workunit.client.0.smithi134.stdout:3/400: dwrite da/d12/f42 [0,4194304] 0 2024-02-16T22:18:53.756 INFO:tasks.workunit.client.0.smithi134.stdout:0/349: getdents d2/d4b/d5f 0 2024-02-16T22:18:53.756 INFO:tasks.workunit.client.0.smithi134.stdout:0/350: chown d2/dc/d48/f4c 199 1 2024-02-16T22:18:53.758 INFO:tasks.workunit.client.0.smithi134.stdout:7/381: dread d2/d6/f70 [0,4194304] 0 2024-02-16T22:18:53.758 INFO:tasks.workunit.client.0.smithi134.stdout:7/382: chown d2/l6b 4592912 1 2024-02-16T22:18:53.758 INFO:tasks.workunit.client.0.smithi134.stdout:6/401: unlink f15 0 2024-02-16T22:18:53.760 INFO:tasks.workunit.client.0.smithi134.stdout:6/402: write d17/d36/f6f [277652,20818] 0 2024-02-16T22:18:53.760 INFO:tasks.workunit.client.0.smithi134.stdout:6/403: write d17/d22/d70/f7d [815142,109868] 0 2024-02-16T22:18:53.763 INFO:tasks.workunit.client.0.smithi134.stdout:1/362: sync 2024-02-16T22:18:53.783 INFO:tasks.workunit.client.0.smithi134.stdout:6/404: dwrite d17/f21 [4194304,4194304] 0 2024-02-16T22:18:53.784 INFO:tasks.workunit.client.0.smithi134.stdout:1/363: dwrite d5/da/d2d/f34 [4194304,4194304] 0 2024-02-16T22:18:53.784 INFO:tasks.workunit.client.0.smithi134.stdout:1/364: creat d5/d1a/d4d/f76 x:0 0 0 2024-02-16T22:18:53.785 INFO:tasks.workunit.client.0.smithi134.stdout:3/401: symlink da/d1c/d24/d29/d51/d79/l7d 0 2024-02-16T22:18:53.788 INFO:tasks.workunit.client.0.smithi134.stdout:0/351: creat d2/dc/d48/f75 x:0 0 0 2024-02-16T22:18:53.790 INFO:tasks.workunit.client.0.smithi134.stdout:7/383: symlink d2/d5/d4c/l81 0 2024-02-16T22:18:53.793 INFO:tasks.workunit.client.0.smithi134.stdout:6/405: creat d17/d22/f7e x:0 0 0 2024-02-16T22:18:53.793 INFO:tasks.workunit.client.0.smithi134.stdout:6/406: stat d17/d27/d4f/d52/d79/l66 0 2024-02-16T22:18:53.793 INFO:tasks.workunit.client.0.smithi134.stdout:6/407: chown d17/d36/c38 3 1 2024-02-16T22:18:53.793 INFO:tasks.workunit.client.0.smithi134.stdout:6/408: write f11 [3354540,106227] 0 2024-02-16T22:18:53.796 INFO:tasks.workunit.client.0.smithi134.stdout:0/352: dread d2/dc/f2b [0,4194304] 0 2024-02-16T22:18:53.804 INFO:tasks.workunit.client.0.smithi134.stdout:1/365: rename d5/da/d1c/f32 to d5/da/d21/d45/f77 0 2024-02-16T22:18:53.804 INFO:tasks.workunit.client.0.smithi134.stdout:0/353: write d2/dc/d2d/d34/f46 [2767209,37435] 0 2024-02-16T22:18:53.804 INFO:tasks.workunit.client.0.smithi134.stdout:0/354: creat d2/dc/d32/d3e/d5e/f76 x:0 0 0 2024-02-16T22:18:53.805 INFO:tasks.workunit.client.0.smithi134.stdout:3/402: mkdir da/d1c/d24/d29/d51/d7e 0 2024-02-16T22:18:53.807 INFO:tasks.workunit.client.0.smithi134.stdout:7/384: creat d2/d6/d17/f82 x:0 0 0 2024-02-16T22:18:53.809 INFO:tasks.workunit.client.0.smithi134.stdout:0/355: mkdir d2/d20/d77 0 2024-02-16T22:18:53.810 INFO:tasks.workunit.client.0.smithi134.stdout:3/403: creat da/d1c/d24/d29/d51/d7e/f7f x:0 0 0 2024-02-16T22:18:53.811 INFO:tasks.workunit.client.0.smithi134.stdout:7/385: mkdir d2/d5/d22/d83 0 2024-02-16T22:18:53.811 INFO:tasks.workunit.client.0.smithi134.stdout:6/409: dwrite d17/d36/f7a [0,4194304] 0 2024-02-16T22:18:53.812 INFO:tasks.workunit.client.0.smithi134.stdout:0/356: mkdir d2/d20/d77/d78 0 2024-02-16T22:18:53.814 INFO:tasks.workunit.client.0.smithi134.stdout:7/386: unlink d2/d5/f10 0 2024-02-16T22:18:53.814 INFO:tasks.workunit.client.0.smithi134.stdout:7/387: chown d2/d5/d19/d4a/f58 0 1 2024-02-16T22:18:53.816 INFO:tasks.workunit.client.0.smithi134.stdout:1/366: write d5/da/d21/d45/f4e [3648118,37393] 0 2024-02-16T22:18:53.818 INFO:tasks.workunit.client.0.smithi134.stdout:7/388: mkdir d2/d5/d19/d84 0 2024-02-16T22:18:53.819 INFO:tasks.workunit.client.0.smithi134.stdout:6/410: getdents d17/d27/d30 0 2024-02-16T22:18:53.820 INFO:tasks.workunit.client.0.smithi134.stdout:3/404: write da/d1c/d24/f3d [3604870,31161] 0 2024-02-16T22:18:53.821 INFO:tasks.workunit.client.0.smithi134.stdout:0/357: dread d2/dc/d2d/f54 [0,4194304] 0 2024-02-16T22:18:53.821 INFO:tasks.workunit.client.0.smithi134.stdout:0/358: readlink d2/d4b/l4d 0 2024-02-16T22:18:53.824 INFO:tasks.workunit.client.0.smithi134.stdout:1/367: rmdir d5/da/d21/d52/d5b/d6d 0 2024-02-16T22:18:53.828 INFO:tasks.workunit.client.0.smithi134.stdout:3/405: mkdir da/d1c/d24/d29/d51/d80 0 2024-02-16T22:18:53.829 INFO:tasks.workunit.client.0.smithi134.stdout:0/359: rmdir d2/d20/d77/d78 0 2024-02-16T22:18:53.832 INFO:tasks.workunit.client.0.smithi134.stdout:3/406: creat da/d1c/d24/d2c/d74/f81 x:0 0 0 2024-02-16T22:18:53.833 INFO:tasks.workunit.client.0.smithi134.stdout:0/360: creat d2/dc/d32/d45/f79 x:0 0 0 2024-02-16T22:18:53.834 INFO:tasks.workunit.client.0.smithi134.stdout:1/368: rmdir d5/da/d2d 39 2024-02-16T22:18:53.834 INFO:tasks.workunit.client.0.smithi134.stdout:0/361: dread d2/dc/d32/d3e/f47 [0,4194304] 0 2024-02-16T22:18:53.834 INFO:tasks.workunit.client.0.smithi134.stdout:0/362: write d2/f6c [871799,66647] 0 2024-02-16T22:18:53.835 INFO:tasks.workunit.client.0.smithi134.stdout:7/389: dwrite d2/d5/d22/d26/d48/d7f/f55 [0,4194304] 0 2024-02-16T22:18:53.836 INFO:tasks.workunit.client.0.smithi134.stdout:3/407: rename da/l18 to da/l82 0 2024-02-16T22:18:53.836 INFO:tasks.workunit.client.0.smithi134.stdout:5/403: sync 2024-02-16T22:18:53.837 INFO:tasks.workunit.client.0.smithi134.stdout:4/275: sync 2024-02-16T22:18:53.837 INFO:tasks.workunit.client.0.smithi134.stdout:8/347: sync 2024-02-16T22:18:53.837 INFO:tasks.workunit.client.0.smithi134.stdout:2/319: sync 2024-02-16T22:18:53.837 INFO:tasks.workunit.client.0.smithi134.stdout:2/320: chown df/d10/d15/d5a/d2d/c4e 400 1 2024-02-16T22:18:53.839 INFO:tasks.workunit.client.0.smithi134.stdout:5/404: dread d2/d9/dc/f38 [0,4194304] 0 2024-02-16T22:18:53.839 INFO:tasks.workunit.client.0.smithi134.stdout:0/363: write d2/f12 [745845,37795] 0 2024-02-16T22:18:53.839 INFO:tasks.workunit.client.0.smithi134.stdout:7/390: symlink d2/d6/d17/d25/d63/l85 0 2024-02-16T22:18:53.841 INFO:tasks.workunit.client.0.smithi134.stdout:3/408: rename da/d1c/f1e to da/d1c/d24/d29/d51/d79/f83 0 2024-02-16T22:18:53.843 INFO:tasks.workunit.client.0.smithi134.stdout:4/276: mkdir d0/d6/d5d 0 2024-02-16T22:18:53.844 INFO:tasks.workunit.client.0.smithi134.stdout:5/405: symlink d2/d9/dc/d27/d4b/l83 0 2024-02-16T22:18:53.848 INFO:tasks.workunit.client.0.smithi134.stdout:2/321: read df/d10/d15/f16 [3343087,52008] 0 2024-02-16T22:18:53.848 INFO:tasks.workunit.client.0.smithi134.stdout:2/322: chown df/l27 947 1 2024-02-16T22:18:53.849 INFO:tasks.workunit.client.0.smithi134.stdout:2/323: creat df/d10/f5d x:0 0 0 2024-02-16T22:18:53.849 INFO:tasks.workunit.client.0.smithi134.stdout:8/348: rename d2/df/l38 to d2/df/d18/d2a/d41/d61/l74 0 2024-02-16T22:18:53.849 INFO:tasks.workunit.client.0.smithi134.stdout:8/349: write d2/df/d18/f5 [2863398,23492] 0 2024-02-16T22:18:53.849 INFO:tasks.workunit.client.0.smithi134.stdout:8/350: fdatasync d2/df/d18/d5a/f49 0 2024-02-16T22:18:53.849 INFO:tasks.workunit.client.0.smithi134.stdout:8/351: fsync d2/df/d18/f6 0 2024-02-16T22:18:53.849 INFO:tasks.workunit.client.0.smithi134.stdout:9/442: sync 2024-02-16T22:18:53.849 INFO:tasks.workunit.client.0.smithi134.stdout:9/443: fsync db/dc/f15 0 2024-02-16T22:18:53.849 INFO:tasks.workunit.client.0.smithi134.stdout:9/444: chown db/d20/d32/c75 51471920 1 2024-02-16T22:18:53.849 INFO:tasks.workunit.client.0.smithi134.stdout:0/364: write d2/d20/d50/f51 [1488309,117801] 0 2024-02-16T22:18:53.849 INFO:tasks.workunit.client.0.smithi134.stdout:4/277: mkdir d0/d6/d8/d5e 0 2024-02-16T22:18:53.851 INFO:tasks.workunit.client.0.smithi134.stdout:5/406: mknod d2/d35/c84 0 2024-02-16T22:18:53.855 INFO:tasks.workunit.client.0.smithi134.stdout:3/409: rename da/d1c/d24/f27 to da/d1c/d24/d29/d51/d80/f84 0 2024-02-16T22:18:53.858 INFO:tasks.workunit.client.0.smithi134.stdout:8/352: mknod d2/df/d18/c75 0 2024-02-16T22:18:53.860 INFO:tasks.workunit.client.0.smithi134.stdout:0/365: getdents d2/d56 0 2024-02-16T22:18:53.860 INFO:tasks.workunit.client.0.smithi134.stdout:0/366: truncate d2/dc/d48/f75 569891 0 2024-02-16T22:18:53.860 INFO:tasks.workunit.client.0.smithi134.stdout:4/278: mknod d0/d6/d8/de/c5f 0 2024-02-16T22:18:53.861 INFO:tasks.workunit.client.0.smithi134.stdout:4/279: readlink d0/lb 0 2024-02-16T22:18:53.863 INFO:tasks.workunit.client.0.smithi134.stdout:5/407: creat d2/d9/dc/d27/f85 x:0 0 0 2024-02-16T22:18:53.863 INFO:tasks.workunit.client.0.smithi134.stdout:5/408: dread - d2/d35/d36/d46/f6a zero size 2024-02-16T22:18:53.863 INFO:tasks.workunit.client.0.smithi134.stdout:5/409: fsync d2/d9/dc/f38 0 2024-02-16T22:18:53.866 INFO:tasks.workunit.client.0.smithi134.stdout:2/324: rename df/d10/d15/d5a/d17/d1b/f23 to df/d41/f5e 0 2024-02-16T22:18:53.867 INFO:tasks.workunit.client.0.smithi134.stdout:3/410: creat da/d1c/d24/d29/d51/d80/f85 x:0 0 0 2024-02-16T22:18:53.869 INFO:tasks.workunit.client.0.smithi134.stdout:4/280: mknod d0/d6/d22/d25/c60 0 2024-02-16T22:18:53.870 INFO:tasks.workunit.client.0.smithi134.stdout:5/410: symlink d2/d35/d36/d3d/l86 0 2024-02-16T22:18:53.870 INFO:tasks.workunit.client.0.smithi134.stdout:5/411: write d2/d9/dc/d27/d4b/f7d [1381651,38412] 0 2024-02-16T22:18:53.872 INFO:tasks.workunit.client.0.smithi134.stdout:9/445: dwrite db/f29 [0,4194304] 0 2024-02-16T22:18:53.872 INFO:tasks.workunit.client.0.smithi134.stdout:8/353: dwrite d2/df/d18/d12/f4e [0,4194304] 0 2024-02-16T22:18:53.872 INFO:tasks.workunit.client.0.smithi134.stdout:0/367: rename d2/d4b/d5f to d2/d20/d7a 0 2024-02-16T22:18:53.875 INFO:tasks.workunit.client.0.smithi134.stdout:8/354: dread d2/df/d18/d27/f30 [0,4194304] 0 2024-02-16T22:18:53.939 INFO:tasks.workunit.client.0.smithi134.stdout:4/281: mknod d0/d6/d8/d32/c61 0 2024-02-16T22:18:53.939 INFO:tasks.workunit.client.0.smithi134.stdout:5/412: mknod d2/d35/d36/d3d/c87 0 2024-02-16T22:18:53.940 INFO:tasks.workunit.client.0.smithi134.stdout:2/325: rmdir df/d10/d30/d49 39 2024-02-16T22:18:53.941 INFO:tasks.workunit.client.0.smithi134.stdout:9/446: creat db/d20/d22/d64/f90 x:0 0 0 2024-02-16T22:18:53.941 INFO:tasks.workunit.client.0.smithi134.stdout:9/447: stat db/c76 0 2024-02-16T22:18:53.945 INFO:tasks.workunit.client.0.smithi134.stdout:3/411: rename da/d1c/d24/d2c/d74/l75 to da/d1c/l86 0 2024-02-16T22:18:53.948 INFO:tasks.workunit.client.0.smithi134.stdout:4/282: read d0/d6/d22/d25/d2a/f51 [2494627,89611] 0 2024-02-16T22:18:53.948 INFO:tasks.workunit.client.0.smithi134.stdout:0/368: mknod d2/d4b/c7b 0 2024-02-16T22:18:53.949 INFO:tasks.workunit.client.0.smithi134.stdout:8/355: mknod d2/df/d18/d2a/d41/c76 0 2024-02-16T22:18:53.949 INFO:tasks.workunit.client.0.smithi134.stdout:8/356: write d2/df/f1c [1777103,114990] 0 2024-02-16T22:18:53.949 INFO:tasks.workunit.client.0.smithi134.stdout:8/357: readlink d2/df/d18/d2a/d41/l60 0 2024-02-16T22:18:53.950 INFO:tasks.workunit.client.0.smithi134.stdout:5/413: write d2/d9/dc/d15/f31 [1844792,51864] 0 2024-02-16T22:18:53.950 INFO:tasks.workunit.client.0.smithi134.stdout:5/414: dread - d2/d35/d36/d46/f6a zero size 2024-02-16T22:18:53.955 INFO:tasks.workunit.client.0.smithi134.stdout:2/326: mknod df/d10/d15/c5f 0 2024-02-16T22:18:53.955 INFO:tasks.workunit.client.0.smithi134.stdout:2/327: dread - df/d10/d30/d4d/f52 zero size 2024-02-16T22:18:53.955 INFO:tasks.workunit.client.0.smithi134.stdout:4/283: mknod d0/d6/d5d/c62 0 2024-02-16T22:18:53.956 INFO:tasks.workunit.client.0.smithi134.stdout:4/284: write d0/d6/d8/d32/f38 [2208111,55332] 0 2024-02-16T22:18:53.956 INFO:tasks.workunit.client.0.smithi134.stdout:0/369: dread d2/dc/f1d [0,4194304] 0 2024-02-16T22:18:53.958 INFO:tasks.workunit.client.0.smithi134.stdout:8/358: creat d2/df/d19/d40/d53/d5e/f77 x:0 0 0 2024-02-16T22:18:53.959 INFO:tasks.workunit.client.0.smithi134.stdout:5/415: symlink d2/d35/d36/d46/d68/l88 0 2024-02-16T22:18:53.960 INFO:tasks.workunit.client.0.smithi134.stdout:4/285: dread d0/d6/d1e/f27 [0,4194304] 0 2024-02-16T22:18:53.961 INFO:tasks.workunit.client.0.smithi134.stdout:9/448: dwrite db/d20/d22/d64/d69/f7e [0,4194304] 0 2024-02-16T22:18:53.961 INFO:tasks.workunit.client.0.smithi134.stdout:2/328: rmdir df/d10/d15/d5a/d17/d1b 39 2024-02-16T22:18:53.962 INFO:tasks.workunit.client.0.smithi134.stdout:8/359: mknod d2/df/d18/c78 0 2024-02-16T22:18:53.965 INFO:tasks.workunit.client.0.smithi134.stdout:5/416: mkdir d2/d9/dc/d32/d89 0 2024-02-16T22:18:53.968 INFO:tasks.workunit.client.0.smithi134.stdout:3/412: dwrite da/d1c/d24/d2c/f4c [0,4194304] 0 2024-02-16T22:18:53.972 INFO:tasks.workunit.client.0.smithi134.stdout:2/329: link df/l12 df/d10/d15/d5a/d2d/l60 0 2024-02-16T22:18:53.972 INFO:tasks.workunit.client.0.smithi134.stdout:2/330: write df/d10/d15/f16 [4996654,63772] 0 2024-02-16T22:18:53.972 INFO:tasks.workunit.client.0.smithi134.stdout:2/331: truncate df/d10/d30/d49/f57 504263 0 2024-02-16T22:18:53.972 INFO:tasks.workunit.client.0.smithi134.stdout:2/332: write df/d10/d15/d5a/f48 [2526667,65497] 0 2024-02-16T22:18:53.972 INFO:tasks.workunit.client.0.smithi134.stdout:5/417: getdents d2/d35 0 2024-02-16T22:18:53.973 INFO:tasks.workunit.client.0.smithi134.stdout:5/418: dread d2/d9/dc/d32/f5b [0,4194304] 0 2024-02-16T22:18:53.976 INFO:tasks.workunit.client.0.smithi134.stdout:3/413: creat da/d1c/d24/d29/d51/f87 x:0 0 0 2024-02-16T22:18:53.976 INFO:tasks.workunit.client.0.smithi134.stdout:3/414: chown da/d6b 2583 1 2024-02-16T22:18:53.978 INFO:tasks.workunit.client.0.smithi134.stdout:9/449: mkdir db/d20/d22/d91 0 2024-02-16T22:18:53.979 INFO:tasks.workunit.client.0.smithi134.stdout:2/333: truncate df/d10/d15/f28 846463 0 2024-02-16T22:18:53.981 INFO:tasks.workunit.client.0.smithi134.stdout:5/419: unlink d2/d35/d36/d3d/f4c 0 2024-02-16T22:18:53.981 INFO:tasks.workunit.client.0.smithi134.stdout:5/420: fdatasync d2/f6 0 2024-02-16T22:18:53.981 INFO:tasks.workunit.client.0.smithi134.stdout:4/286: dwrite d0/d6/d1e/f27 [0,4194304] 0 2024-02-16T22:18:53.981 INFO:tasks.workunit.client.0.smithi134.stdout:4/287: fdatasync d0/d6/d22/d25/d2a/f51 0 2024-02-16T22:18:53.982 INFO:tasks.workunit.client.0.smithi134.stdout:3/415: symlink da/d1c/d24/d2c/d74/l88 0 2024-02-16T22:18:53.982 INFO:tasks.workunit.client.0.smithi134.stdout:9/450: creat db/d20/d22/d46/d8f/f92 x:0 0 0 2024-02-16T22:18:53.984 INFO:tasks.workunit.client.0.smithi134.stdout:7/391: sync 2024-02-16T22:18:53.984 INFO:tasks.workunit.client.0.smithi134.stdout:6/411: sync 2024-02-16T22:18:53.984 INFO:tasks.workunit.client.0.smithi134.stdout:1/369: sync 2024-02-16T22:18:53.984 INFO:tasks.workunit.client.0.smithi134.stdout:7/392: chown d2/d5/d22/l74 350273 1 2024-02-16T22:18:53.984 INFO:tasks.workunit.client.0.smithi134.stdout:6/412: creat d17/f7f x:0 0 0 2024-02-16T22:18:53.984 INFO:tasks.workunit.client.0.smithi134.stdout:6/413: truncate d17/d27/d4f/f68 901252 0 2024-02-16T22:18:53.984 INFO:tasks.workunit.client.0.smithi134.stdout:6/414: fdatasync d17/d27/d4f/f78 0 2024-02-16T22:18:53.984 INFO:tasks.workunit.client.0.smithi134.stdout:0/370: dwrite d2/dc/d2d/f54 [4194304,4194304] 0 2024-02-16T22:18:53.984 INFO:tasks.workunit.client.0.smithi134.stdout:0/371: stat d2/d20/d7a 0 2024-02-16T22:18:53.984 INFO:tasks.workunit.client.0.smithi134.stdout:0/372: creat d2/dc/f7c x:0 0 0 2024-02-16T22:18:53.985 INFO:tasks.workunit.client.0.smithi134.stdout:2/334: creat df/d10/d15/d5a/d2d/f61 x:0 0 0 2024-02-16T22:18:53.985 INFO:tasks.workunit.client.0.smithi134.stdout:5/421: rename d2/d9/dc/d32/f5b to d2/d35/d36/d46/d68/f8a 0 2024-02-16T22:18:53.986 INFO:tasks.workunit.client.0.smithi134.stdout:3/416: dread da/d1c/d24/d29/d51/d79/f83 [0,4194304] 0 2024-02-16T22:18:53.987 INFO:tasks.workunit.client.0.smithi134.stdout:4/288: mkdir d0/d6/d8/d32/d63 0 2024-02-16T22:18:53.988 INFO:tasks.workunit.client.0.smithi134.stdout:4/289: write d0/d6/d22/d25/d2a/f2e [9183868,36061] 0 2024-02-16T22:18:53.990 INFO:tasks.workunit.client.0.smithi134.stdout:9/451: creat db/d20/d22/d64/d69/d89/f93 x:0 0 0 2024-02-16T22:18:53.990 INFO:tasks.workunit.client.0.smithi134.stdout:8/360: dwrite d2/f2c [4194304,4194304] 0 2024-02-16T22:18:53.992 INFO:tasks.workunit.client.0.smithi134.stdout:7/393: mkdir d2/d5/d19/d84/d86 0 2024-02-16T22:18:53.993 INFO:tasks.workunit.client.0.smithi134.stdout:1/370: mknod d5/da/d21/d45/c78 0 2024-02-16T22:18:53.998 INFO:tasks.workunit.client.0.smithi134.stdout:2/335: dread df/d10/d15/d5a/f26 [4194304,4194304] 0 2024-02-16T22:18:53.998 INFO:tasks.workunit.client.0.smithi134.stdout:0/373: link d2/d20/l58 d2/d4b/d53/l7d 0 2024-02-16T22:18:54.001 INFO:tasks.workunit.client.0.smithi134.stdout:5/422: link d2/d9/dc/d15/f7c d2/d35/d36/d3d/f8b 0 2024-02-16T22:18:54.001 INFO:tasks.workunit.client.0.smithi134.stdout:4/290: mknod d0/d31/c64 0 2024-02-16T22:18:54.002 INFO:tasks.workunit.client.0.smithi134.stdout:4/291: chown d0/d6/d16/d1a/l34 409836645 1 2024-02-16T22:18:54.006 INFO:tasks.workunit.client.0.smithi134.stdout:8/361: truncate d2/df/d18/d2a/d41/d59/f56 2865997 0 2024-02-16T22:18:54.009 INFO:tasks.workunit.client.0.smithi134.stdout:4/292: dread d0/d6/d16/f28 [0,4194304] 0 2024-02-16T22:18:54.014 INFO:tasks.workunit.client.0.smithi134.stdout:1/371: dwrite d5/da/d21/f3b [0,4194304] 0 2024-02-16T22:18:54.014 INFO:tasks.workunit.client.0.smithi134.stdout:1/372: chown d5/da/d21/l28 35768 1 2024-02-16T22:18:54.015 INFO:tasks.workunit.client.0.smithi134.stdout:7/394: creat d2/d5/f87 x:0 0 0 2024-02-16T22:18:54.015 INFO:tasks.workunit.client.0.smithi134.stdout:6/415: getdents d17/d36 0 2024-02-16T22:18:54.017 INFO:tasks.workunit.client.0.smithi134.stdout:2/336: unlink df/d10/d15/f1e 0 2024-02-16T22:18:54.017 INFO:tasks.workunit.client.0.smithi134.stdout:2/337: truncate df/d10/d3a/f44 411929 0 2024-02-16T22:18:54.018 INFO:tasks.workunit.client.0.smithi134.stdout:0/374: stat d2/c49 0 2024-02-16T22:18:54.018 INFO:tasks.workunit.client.0.smithi134.stdout:0/375: chown d2/dc/d32/c3f 19 1 2024-02-16T22:18:54.018 INFO:tasks.workunit.client.0.smithi134.stdout:0/376: write d2/dc/f7c [735052,24258] 0 2024-02-16T22:18:54.019 INFO:tasks.workunit.client.0.smithi134.stdout:5/423: symlink d2/d9/dc/d32/d61/l8c 0 2024-02-16T22:18:54.019 INFO:tasks.workunit.client.0.smithi134.stdout:5/424: fsync d2/d35/d72/f7a 0 2024-02-16T22:18:54.019 INFO:tasks.workunit.client.0.smithi134.stdout:5/425: fdatasync d2/d9/dc/f81 0 2024-02-16T22:18:54.020 INFO:tasks.workunit.client.0.smithi134.stdout:6/416: read f6 [301245,23453] 0 2024-02-16T22:18:54.020 INFO:tasks.workunit.client.0.smithi134.stdout:9/452: rmdir db/dc 39 2024-02-16T22:18:54.022 INFO:tasks.workunit.client.0.smithi134.stdout:8/362: rename d2/df/d19/f4f to d2/df/d18/d5a/f79 0 2024-02-16T22:18:54.023 INFO:tasks.workunit.client.0.smithi134.stdout:1/373: dread d5/f7 [0,4194304] 0 2024-02-16T22:18:54.025 INFO:tasks.workunit.client.0.smithi134.stdout:4/293: creat d0/d6/d8/d32/d63/f65 x:0 0 0 2024-02-16T22:18:54.025 INFO:tasks.workunit.client.0.smithi134.stdout:4/294: creat d0/d6/d1e/d39/f66 x:0 0 0 2024-02-16T22:18:54.025 INFO:tasks.workunit.client.0.smithi134.stdout:4/295: write d0/d6/d16/f17 [2755815,90771] 0 2024-02-16T22:18:54.028 INFO:tasks.workunit.client.0.smithi134.stdout:2/338: symlink df/d10/d30/l62 0 2024-02-16T22:18:54.029 INFO:tasks.workunit.client.0.smithi134.stdout:0/377: mkdir d2/d20/d7a/d7e 0 2024-02-16T22:18:54.030 INFO:tasks.workunit.client.0.smithi134.stdout:8/363: dread d2/f2c [0,4194304] 0 2024-02-16T22:18:54.030 INFO:tasks.workunit.client.0.smithi134.stdout:9/453: symlink db/d20/d22/d64/d69/d6d/l94 0 2024-02-16T22:18:54.030 INFO:tasks.workunit.client.0.smithi134.stdout:9/454: write db/d20/f8e [363299,6606] 0 2024-02-16T22:18:54.033 INFO:tasks.workunit.client.0.smithi134.stdout:2/339: rmdir df/d10/d15 39 2024-02-16T22:18:54.034 INFO:tasks.workunit.client.0.smithi134.stdout:0/378: mknod d2/d20/d50/c7f 0 2024-02-16T22:18:54.036 INFO:tasks.workunit.client.0.smithi134.stdout:9/455: mknod db/d20/d22/d64/d69/d6e/d81/c95 0 2024-02-16T22:18:54.036 INFO:tasks.workunit.client.0.smithi134.stdout:9/456: chown db/d20/d22/d46/f8a 22077710 1 2024-02-16T22:18:54.036 INFO:tasks.workunit.client.0.smithi134.stdout:9/457: stat db/d20/d22 0 2024-02-16T22:18:54.036 INFO:tasks.workunit.client.0.smithi134.stdout:0/379: dread d2/dc/d48/f4c [0,4194304] 0 2024-02-16T22:18:54.036 INFO:tasks.workunit.client.0.smithi134.stdout:0/380: creat d2/dc/d32/d3e/f80 x:0 0 0 2024-02-16T22:18:54.037 INFO:tasks.workunit.client.0.smithi134.stdout:7/395: rename d2/d6/d17/d31/l5b to d2/d6/d17/d25/d63/l88 0 2024-02-16T22:18:54.038 INFO:tasks.workunit.client.0.smithi134.stdout:9/458: rename db/dc/l1b to db/dc/l96 0 2024-02-16T22:18:54.041 INFO:tasks.workunit.client.0.smithi134.stdout:0/381: dread d2/d20/d50/f51 [0,4194304] 0 2024-02-16T22:18:54.042 INFO:tasks.workunit.client.0.smithi134.stdout:1/374: rename d5/da/d21/f4a to d5/d1a/d23/d3c/d6a/d5c/d72/f79 0 2024-02-16T22:18:54.042 INFO:tasks.workunit.client.0.smithi134.stdout:1/375: chown d5/d1a 3321606 1 2024-02-16T22:18:54.043 INFO:tasks.workunit.client.0.smithi134.stdout:7/396: unlink d2/d7/c76 0 2024-02-16T22:18:54.043 INFO:tasks.workunit.client.0.smithi134.stdout:2/340: dread df/d10/d15/d5a/d17/d1b/f2f [0,4194304] 0 2024-02-16T22:18:54.044 INFO:tasks.workunit.client.0.smithi134.stdout:9/459: creat db/d20/d55/f97 x:0 0 0 2024-02-16T22:18:54.044 INFO:tasks.workunit.client.0.smithi134.stdout:9/460: creat db/d20/d22/d64/d69/f98 x:0 0 0 2024-02-16T22:18:54.045 INFO:tasks.workunit.client.0.smithi134.stdout:0/382: truncate d2/dc/f44 600232 0 2024-02-16T22:18:54.045 INFO:tasks.workunit.client.0.smithi134.stdout:0/383: dread - d2/dc/d32/d3e/f80 zero size 2024-02-16T22:18:54.045 INFO:tasks.workunit.client.0.smithi134.stdout:0/384: truncate d2/d20/d50/f63 212624 0 2024-02-16T22:18:54.046 INFO:tasks.workunit.client.0.smithi134.stdout:8/364: rename d2/df/d18/f70 to d2/df/d18/d2a/d5c/f7a 0 2024-02-16T22:18:54.047 INFO:tasks.workunit.client.0.smithi134.stdout:6/417: dwrite d17/d27/f34 [0,4194304] 0 2024-02-16T22:18:54.047 INFO:tasks.workunit.client.0.smithi134.stdout:1/376: creat d5/d1a/d53/f7a x:0 0 0 2024-02-16T22:18:54.047 INFO:tasks.workunit.client.0.smithi134.stdout:4/296: dwrite d0/d6/d8/d32/f38 [4194304,4194304] 0 2024-02-16T22:18:54.047 INFO:tasks.workunit.client.0.smithi134.stdout:4/297: chown d0/d6/d16/d46 360965467 1 2024-02-16T22:18:54.048 INFO:tasks.workunit.client.0.smithi134.stdout:7/397: mknod d2/d5/d19/d4a/c89 0 2024-02-16T22:18:54.051 INFO:tasks.workunit.client.0.smithi134.stdout:2/341: rmdir df/d10/d15/d5a 39 2024-02-16T22:18:54.051 INFO:tasks.workunit.client.0.smithi134.stdout:2/342: dread - df/d10/d15/d5a/d17/d1b/f56 zero size 2024-02-16T22:18:54.051 INFO:tasks.workunit.client.0.smithi134.stdout:5/426: dwrite d2/d9/dc/d15/f67 [0,4194304] 0 2024-02-16T22:18:54.051 INFO:tasks.workunit.client.0.smithi134.stdout:2/343: creat df/d10/d15/d5a/d2d/f63 x:0 0 0 2024-02-16T22:18:54.052 INFO:tasks.workunit.client.0.smithi134.stdout:9/461: mkdir db/d20/d22/d91/d99 0 2024-02-16T22:18:54.053 INFO:tasks.workunit.client.0.smithi134.stdout:0/385: symlink d2/dc/d48/d60/l81 0 2024-02-16T22:18:54.053 INFO:tasks.workunit.client.0.smithi134.stdout:0/386: creat d2/d20/d50/f82 x:0 0 0 2024-02-16T22:18:54.057 INFO:tasks.workunit.client.0.smithi134.stdout:6/418: truncate f14 7692438 0 2024-02-16T22:18:54.060 INFO:tasks.workunit.client.0.smithi134.stdout:4/298: creat d0/d6/d22/f67 x:0 0 0 2024-02-16T22:18:54.068 INFO:tasks.workunit.client.0.smithi134.stdout:9/462: mkdir db/d20/d9a 0 2024-02-16T22:18:54.072 INFO:tasks.workunit.client.0.smithi134.stdout:6/419: rename d17/d36/c6a to d17/d36/d77/c80 0 2024-02-16T22:18:54.072 INFO:tasks.workunit.client.0.smithi134.stdout:5/427: getdents d2/d9/dc/d15 0 2024-02-16T22:18:54.073 INFO:tasks.workunit.client.0.smithi134.stdout:0/387: getdents d2/dc/d48 0 2024-02-16T22:18:54.073 INFO:tasks.workunit.client.0.smithi134.stdout:0/388: fdatasync d2/f6c 0 2024-02-16T22:18:54.073 INFO:tasks.workunit.client.0.smithi134.stdout:0/389: dread - d2/dc/d32/d3e/d5e/f6f zero size 2024-02-16T22:18:54.074 INFO:tasks.workunit.client.0.smithi134.stdout:4/299: write d0/d6/d8/de/f3e [766371,77311] 0 2024-02-16T22:18:54.074 INFO:tasks.workunit.client.0.smithi134.stdout:6/420: creat d17/d22/d28/f81 x:0 0 0 2024-02-16T22:18:54.076 INFO:tasks.workunit.client.0.smithi134.stdout:8/365: dwrite d2/df/d18/d12/f6a [0,4194304] 0 2024-02-16T22:18:54.077 INFO:tasks.workunit.client.0.smithi134.stdout:8/366: chown d2/df/d18/d2a/d41/d61/l74 159 1 2024-02-16T22:18:54.078 INFO:tasks.workunit.client.0.smithi134.stdout:1/377: dwrite d5/d1a/d4d/f76 [0,4194304] 0 2024-02-16T22:18:54.080 INFO:tasks.workunit.client.0.smithi134.stdout:7/398: dwrite d2/d5/d22/d26/d48/d7f/f55 [0,4194304] 0 2024-02-16T22:18:54.084 INFO:tasks.workunit.client.0.smithi134.stdout:6/421: dread d17/d22/f24 [0,4194304] 0 2024-02-16T22:18:54.085 INFO:tasks.workunit.client.0.smithi134.stdout:1/378: creat d5/da/d21/d45/f7b x:0 0 0 2024-02-16T22:18:54.085 INFO:tasks.workunit.client.0.smithi134.stdout:8/367: write d2/df/d18/d2a/d41/f4d [3001620,65965] 0 2024-02-16T22:18:54.089 INFO:tasks.workunit.client.0.smithi134.stdout:4/300: dread d0/f11 [0,4194304] 0 2024-02-16T22:18:54.090 INFO:tasks.workunit.client.0.smithi134.stdout:7/399: rename d2 to d2/d6/d8a 22 2024-02-16T22:18:54.091 INFO:tasks.workunit.client.0.smithi134.stdout:1/379: mkdir d5/d1a/d53/d7c 0 2024-02-16T22:18:54.093 INFO:tasks.workunit.client.0.smithi134.stdout:8/368: rename d2/df/d18/d2a/f57 to d2/df/d18/d27/f7b 0 2024-02-16T22:18:54.094 INFO:tasks.workunit.client.0.smithi134.stdout:9/463: dwrite db/d20/f28 [0,4194304] 0 2024-02-16T22:18:54.094 INFO:tasks.workunit.client.0.smithi134.stdout:9/464: write db/d20/d55/f97 [981080,20487] 0 2024-02-16T22:18:54.094 INFO:tasks.workunit.client.0.smithi134.stdout:9/465: stat db/d20/d22/d64/d69/d6e/d81/c95 0 2024-02-16T22:18:54.097 INFO:tasks.workunit.client.0.smithi134.stdout:0/390: dwrite d2/f26 [0,4194304] 0 2024-02-16T22:18:54.098 INFO:tasks.workunit.client.0.smithi134.stdout:7/400: rename d2/d5/d22/d26/d48/f77 to d2/d5/f8b 0 2024-02-16T22:18:54.098 INFO:tasks.workunit.client.0.smithi134.stdout:7/401: fsync d2/d5/d22/d26/d48/f69 0 2024-02-16T22:18:54.098 INFO:tasks.workunit.client.0.smithi134.stdout:7/402: creat d2/f8c x:0 0 0 2024-02-16T22:18:54.099 INFO:tasks.workunit.client.0.smithi134.stdout:8/369: mkdir d2/df/d7c 0 2024-02-16T22:18:54.101 INFO:tasks.workunit.client.0.smithi134.stdout:0/391: symlink d2/dc/d48/d60/l83 0 2024-02-16T22:18:54.104 INFO:tasks.workunit.client.0.smithi134.stdout:7/403: rmdir d2/d5/d22 39 2024-02-16T22:18:54.104 INFO:tasks.workunit.client.0.smithi134.stdout:7/404: creat d2/f8d x:0 0 0 2024-02-16T22:18:54.108 INFO:tasks.workunit.client.0.smithi134.stdout:8/370: mkdir d2/df/d19/d40/d53/d5e/d72/d7d 0 2024-02-16T22:18:54.108 INFO:tasks.workunit.client.0.smithi134.stdout:6/422: dread f14 [4194304,4194304] 0 2024-02-16T22:18:54.108 INFO:tasks.workunit.client.0.smithi134.stdout:6/423: truncate d17/d36/f58 278324 0 2024-02-16T22:18:54.109 INFO:tasks.workunit.client.0.smithi134.stdout:0/392: symlink d2/d20/d50/l84 0 2024-02-16T22:18:54.113 INFO:tasks.workunit.client.0.smithi134.stdout:4/301: dwrite d0/d6/d22/f67 [0,4194304] 0 2024-02-16T22:18:54.117 INFO:tasks.workunit.client.0.smithi134.stdout:0/393: dread d2/dc/f44 [0,4194304] 0 2024-02-16T22:18:54.120 INFO:tasks.workunit.client.0.smithi134.stdout:0/394: rmdir d2/dc/d32/d3e/d5e 39 2024-02-16T22:18:54.120 INFO:tasks.workunit.client.0.smithi134.stdout:0/395: readlink d2/d4b/d53/l7d 0 2024-02-16T22:18:54.120 INFO:tasks.workunit.client.0.smithi134.stdout:0/396: write d2/f16 [1092608,97681] 0 2024-02-16T22:18:54.120 INFO:tasks.workunit.client.0.smithi134.stdout:0/397: dread - d2/dc/d32/d45/f79 zero size 2024-02-16T22:18:54.122 INFO:tasks.workunit.client.0.smithi134.stdout:8/371: getdents d2/df/d18/d2a 0 2024-02-16T22:18:54.124 INFO:tasks.workunit.client.0.smithi134.stdout:8/372: creat d2/df/d7c/f7e x:0 0 0 2024-02-16T22:18:54.130 INFO:tasks.workunit.client.0.smithi134.stdout:1/380: dwrite d5/da/f1d [0,4194304] 0 2024-02-16T22:18:54.131 INFO:tasks.workunit.client.0.smithi134.stdout:1/381: write d5/da/d1c/f49 [811049,106571] 0 2024-02-16T22:18:54.131 INFO:tasks.workunit.client.0.smithi134.stdout:1/382: mknod d5/d1a/d23/d3c/d6a/d5c/c7d 0 2024-02-16T22:18:54.132 INFO:tasks.workunit.client.0.smithi134.stdout:1/383: truncate d5/d1a/d23/d3c/d6a/d5c/d72/f79 529941 0 2024-02-16T22:18:54.138 INFO:tasks.workunit.client.0.smithi134.stdout:8/373: dread d2/df/d18/f6 [4194304,4194304] 0 2024-02-16T22:18:54.140 INFO:tasks.workunit.client.0.smithi134.stdout:8/374: link d2/df/d18/f6 d2/df/d18/d2a/d41/d61/f7f 0 2024-02-16T22:18:54.140 INFO:tasks.workunit.client.0.smithi134.stdout:8/375: write d2/f63 [918947,68394] 0 2024-02-16T22:18:54.140 INFO:tasks.workunit.client.0.smithi134.stdout:8/376: truncate d2/df/d18/d2a/d41/d59/f56 733782 0 2024-02-16T22:18:54.140 INFO:tasks.workunit.client.0.smithi134.stdout:8/377: chown d2/df/d18/l50 1178017723 1 2024-02-16T22:18:54.144 INFO:tasks.workunit.client.0.smithi134.stdout:1/384: write d5/f3f [3810214,60710] 0 2024-02-16T22:18:54.145 INFO:tasks.workunit.client.0.smithi134.stdout:1/385: mknod d5/d1a/c7e 0 2024-02-16T22:18:54.145 INFO:tasks.workunit.client.0.smithi134.stdout:1/386: getdents d5/d1a/d23/d3c/d6a/d5c/d72 0 2024-02-16T22:18:54.146 INFO:tasks.workunit.client.0.smithi134.stdout:1/387: mknod d5/c7f 0 2024-02-16T22:18:54.146 INFO:tasks.workunit.client.0.smithi134.stdout:1/388: stat d5/d1a/d23/c59 0 2024-02-16T22:18:54.148 INFO:tasks.workunit.client.0.smithi134.stdout:8/378: write d2/f24 [284424,117079] 0 2024-02-16T22:18:54.148 INFO:tasks.workunit.client.0.smithi134.stdout:8/379: truncate d2/df/d7c/f7e 495367 0 2024-02-16T22:18:54.149 INFO:tasks.workunit.client.0.smithi134.stdout:8/380: write d2/df/d18/d27/f30 [952954,96579] 0 2024-02-16T22:18:54.149 INFO:tasks.workunit.client.0.smithi134.stdout:9/466: dwrite db/d20/d22/d64/d69/f98 [0,4194304] 0 2024-02-16T22:18:54.149 INFO:tasks.workunit.client.0.smithi134.stdout:9/467: truncate db/d20/f8e 1089829 0 2024-02-16T22:18:54.150 INFO:tasks.workunit.client.0.smithi134.stdout:0/398: dwrite d2/d20/d50/f82 [0,4194304] 0 2024-02-16T22:18:54.150 INFO:tasks.workunit.client.0.smithi134.stdout:6/424: dwrite d17/d22/f3b [0,4194304] 0 2024-02-16T22:18:54.150 INFO:tasks.workunit.client.0.smithi134.stdout:4/302: dwrite d0/d6/d22/d25/f43 [0,4194304] 0 2024-02-16T22:18:54.151 INFO:tasks.workunit.client.0.smithi134.stdout:4/303: dread - d0/d6/d22/d25/f3d zero size 2024-02-16T22:18:54.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/405: dwrite d2/d5/d22/d26/f5f [4194304,4194304] 0 2024-02-16T22:18:54.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/406: dread - d2/f8c zero size 2024-02-16T22:18:54.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/407: readlink d2/d5/d22/d26/d48/d7f/l33 0 2024-02-16T22:18:54.152 INFO:tasks.workunit.client.0.smithi134.stdout:7/408: stat d2/d5/d22 0 2024-02-16T22:18:54.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/468: dread db/d20/d22/d46/f5c [0,4194304] 0 2024-02-16T22:18:54.155 INFO:tasks.workunit.client.0.smithi134.stdout:9/469: chown db/l82 3576707 1 2024-02-16T22:18:54.155 INFO:tasks.workunit.client.0.smithi134.stdout:8/381: write d2/df/d18/d2a/d41/d61/f7f [7771720,123045] 0 2024-02-16T22:18:54.155 INFO:tasks.workunit.client.0.smithi134.stdout:8/382: readlink d2/df/d18/d2a/d41/d59/l3f 0 2024-02-16T22:18:54.155 INFO:tasks.workunit.client.0.smithi134.stdout:8/383: fdatasync d2/df/d18/d27/f7b 0 2024-02-16T22:18:54.155 INFO:tasks.workunit.client.0.smithi134.stdout:1/389: dread d5/da/d1c/f49 [0,4194304] 0 2024-02-16T22:18:54.163 INFO:tasks.workunit.client.0.smithi134.stdout:4/304: dread d0/d6/d16/f17 [0,4194304] 0 2024-02-16T22:18:54.163 INFO:tasks.workunit.client.0.smithi134.stdout:4/305: readlink d0/d6/d16/d1a/l4f 0 2024-02-16T22:18:54.164 INFO:tasks.workunit.client.0.smithi134.stdout:0/399: mkdir d2/d20/d77/d85 0 2024-02-16T22:18:54.165 INFO:tasks.workunit.client.0.smithi134.stdout:0/400: fsync d2/dc/d2d/d34/f46 0 2024-02-16T22:18:54.169 INFO:tasks.workunit.client.0.smithi134.stdout:6/425: unlink d17/f21 0 2024-02-16T22:18:54.169 INFO:tasks.workunit.client.0.smithi134.stdout:6/426: truncate d17/d27/f62 591287 0 2024-02-16T22:18:54.174 INFO:tasks.workunit.client.0.smithi134.stdout:1/390: dwrite d5/d1a/d23/d3c/d6a/f51 [0,4194304] 0 2024-02-16T22:18:54.174 INFO:tasks.workunit.client.0.smithi134.stdout:1/391: fdatasync d5/da/d21/d52/d5b/f5e 0 2024-02-16T22:18:54.174 INFO:tasks.workunit.client.0.smithi134.stdout:1/392: write d5/da/d21/d52/d5b/f5e [61837,70187] 0 2024-02-16T22:18:54.174 INFO:tasks.workunit.client.0.smithi134.stdout:1/393: read d5/f8 [466569,97988] 0 2024-02-16T22:18:54.174 INFO:tasks.workunit.client.0.smithi134.stdout:1/394: write d5/da/d2d/f4f [609776,8365] 0 2024-02-16T22:18:54.175 INFO:tasks.workunit.client.0.smithi134.stdout:7/409: symlink d2/d6/d17/d25/d63/l8e 0 2024-02-16T22:18:54.175 INFO:tasks.workunit.client.0.smithi134.stdout:9/470: mkdir db/d20/d22/d51/d9b 0 2024-02-16T22:18:54.179 INFO:tasks.workunit.client.0.smithi134.stdout:8/384: unlink d2/df/d7c/f7e 0 2024-02-16T22:18:54.180 INFO:tasks.workunit.client.0.smithi134.stdout:6/427: creat d17/d63/f82 x:0 0 0 2024-02-16T22:18:54.180 INFO:tasks.workunit.client.0.smithi134.stdout:6/428: write d17/d36/f58 [386494,127233] 0 2024-02-16T22:18:54.180 INFO:tasks.workunit.client.0.smithi134.stdout:7/410: dread d2/d6/d17/f23 [0,4194304] 0 2024-02-16T22:18:54.184 INFO:tasks.workunit.client.0.smithi134.stdout:1/395: creat d5/da/d21/f80 x:0 0 0 2024-02-16T22:18:54.185 INFO:tasks.workunit.client.0.smithi134.stdout:9/471: symlink db/d20/d22/d64/d69/d6e/d81/l9c 0 2024-02-16T22:18:54.185 INFO:tasks.workunit.client.0.smithi134.stdout:8/385: mkdir d2/d80 0 2024-02-16T22:18:54.187 INFO:tasks.workunit.client.0.smithi134.stdout:1/396: mknod d5/d1a/d23/d3c/d6a/d5c/c81 0 2024-02-16T22:18:54.189 INFO:tasks.workunit.client.0.smithi134.stdout:9/472: symlink db/l9d 0 2024-02-16T22:18:54.191 INFO:tasks.workunit.client.0.smithi134.stdout:8/386: unlink d2/f65 0 2024-02-16T22:18:54.191 INFO:tasks.workunit.client.0.smithi134.stdout:7/411: dread d2/d5/d19/f2b [0,4194304] 0 2024-02-16T22:18:54.191 INFO:tasks.workunit.client.0.smithi134.stdout:1/397: read d5/d1a/d23/d3c/d6a/d5c/d72/f79 [2378,27922] 0 2024-02-16T22:18:54.192 INFO:tasks.workunit.client.0.smithi134.stdout:7/412: chown d2/d5/d19/f2f 15483 1 2024-02-16T22:18:54.193 INFO:tasks.workunit.client.0.smithi134.stdout:9/473: rename db/c72 to db/c9e 0 2024-02-16T22:18:54.193 INFO:tasks.workunit.client.0.smithi134.stdout:8/387: getdents d2/df/d18/d2a/d41/d59 0 2024-02-16T22:18:54.194 INFO:tasks.workunit.client.0.smithi134.stdout:8/388: fsync d2/df/d19/f51 0 2024-02-16T22:18:54.195 INFO:tasks.workunit.client.0.smithi134.stdout:1/398: dread d5/d1a/d23/f2b [0,4194304] 0 2024-02-16T22:18:54.195 INFO:tasks.workunit.client.0.smithi134.stdout:1/399: dread - d5/d1a/d63/f69 zero size 2024-02-16T22:18:54.196 INFO:tasks.workunit.client.0.smithi134.stdout:1/400: read d5/d1a/d23/f27 [266670,61593] 0 2024-02-16T22:18:54.196 INFO:tasks.workunit.client.0.smithi134.stdout:3/417: sync 2024-02-16T22:18:54.196 INFO:tasks.workunit.client.0.smithi134.stdout:2/344: sync 2024-02-16T22:18:54.197 INFO:tasks.workunit.client.0.smithi134.stdout:9/474: creat db/d20/f9f x:0 0 0 2024-02-16T22:18:54.199 INFO:tasks.workunit.client.0.smithi134.stdout:0/401: dwrite d2/dc/f1d [4194304,4194304] 0 2024-02-16T22:18:54.199 INFO:tasks.workunit.client.0.smithi134.stdout:4/306: dwrite d0/d6/d16/f20 [4194304,4194304] 0 2024-02-16T22:18:54.200 INFO:tasks.workunit.client.0.smithi134.stdout:4/307: readlink d0/d6/l57 0 2024-02-16T22:18:54.201 INFO:tasks.workunit.client.0.smithi134.stdout:6/429: dwrite f11 [0,4194304] 0 2024-02-16T22:18:54.203 INFO:tasks.workunit.client.0.smithi134.stdout:7/413: rmdir d2 39 2024-02-16T22:18:54.203 INFO:tasks.workunit.client.0.smithi134.stdout:8/389: write d2/df/d18/d5a/f49 [2641971,118139] 0 2024-02-16T22:18:54.204 INFO:tasks.workunit.client.0.smithi134.stdout:1/401: mkdir d5/d1a/d82 0 2024-02-16T22:18:54.206 INFO:tasks.workunit.client.0.smithi134.stdout:3/418: mkdir da/d1c/d24/d29/d51/d80/d89 0 2024-02-16T22:18:54.207 INFO:tasks.workunit.client.0.smithi134.stdout:3/419: write da/d1c/d24/f4a [2625949,29153] 0 2024-02-16T22:18:54.212 INFO:tasks.workunit.client.0.smithi134.stdout:5/428: sync 2024-02-16T22:18:54.212 INFO:tasks.workunit.client.0.smithi134.stdout:5/429: readlink d2/d9/dc/d27/d4b/l5e 0 2024-02-16T22:18:54.214 INFO:tasks.workunit.client.0.smithi134.stdout:6/430: mkdir d17/d22/d83 0 2024-02-16T22:18:54.214 INFO:tasks.workunit.client.0.smithi134.stdout:6/431: truncate d17/d27/d4f/f67 909150 0 2024-02-16T22:18:54.214 INFO:tasks.workunit.client.0.smithi134.stdout:7/414: truncate d2/d6/d17/d25/d63/f60 1603639 0 2024-02-16T22:18:54.216 INFO:tasks.workunit.client.0.smithi134.stdout:1/402: link d5/da/d1c/f29 d5/d1a/d23/d61/f83 0 2024-02-16T22:18:54.216 INFO:tasks.workunit.client.0.smithi134.stdout:1/403: fdatasync d5/da/d21/d45/f56 0 2024-02-16T22:18:54.216 INFO:tasks.workunit.client.0.smithi134.stdout:9/475: dread db/d20/f28 [0,4194304] 0 2024-02-16T22:18:54.218 INFO:tasks.workunit.client.0.smithi134.stdout:0/402: rmdir d2/d20/d50 39 2024-02-16T22:18:54.220 INFO:tasks.workunit.client.0.smithi134.stdout:6/432: creat d17/d27/d4f/d52/f84 x:0 0 0 2024-02-16T22:18:54.220 INFO:tasks.workunit.client.0.smithi134.stdout:7/415: getdents d2/d7/d40 0 2024-02-16T22:18:54.221 INFO:tasks.workunit.client.0.smithi134.stdout:7/416: fdatasync d2/d5/d19/f2b 0 2024-02-16T22:18:54.221 INFO:tasks.workunit.client.0.smithi134.stdout:7/417: stat d2/f8d 0 2024-02-16T22:18:54.221 INFO:tasks.workunit.client.0.smithi134.stdout:7/418: chown d2/d5/d22/d26/d48/d7f/f61 1602 1 2024-02-16T22:18:54.221 INFO:tasks.workunit.client.0.smithi134.stdout:7/419: getdents d2/d7/d40 0 2024-02-16T22:18:54.222 INFO:tasks.workunit.client.0.smithi134.stdout:1/404: creat d5/da/d2d/f84 x:0 0 0 2024-02-16T22:18:54.222 INFO:tasks.workunit.client.0.smithi134.stdout:9/476: symlink db/d20/d55/d8c/la0 0 2024-02-16T22:18:54.222 INFO:tasks.workunit.client.0.smithi134.stdout:9/477: dread - db/d20/d22/f50 zero size 2024-02-16T22:18:54.224 INFO:tasks.workunit.client.0.smithi134.stdout:1/405: mkdir d5/d1a/d23/d85 0 2024-02-16T22:18:54.225 INFO:tasks.workunit.client.0.smithi134.stdout:3/420: rename da/d12/d2a/d5c to da/d1c/d24/d29/d40/d8a 0 2024-02-16T22:18:54.226 INFO:tasks.workunit.client.0.smithi134.stdout:3/421: chown da/d12/f7b 0 1 2024-02-16T22:18:54.226 INFO:tasks.workunit.client.0.smithi134.stdout:1/406: truncate d5/da/d2d/f34 232874 0 2024-02-16T22:18:54.226 INFO:tasks.workunit.client.0.smithi134.stdout:9/478: rmdir db/d20/d32 39 2024-02-16T22:18:54.228 INFO:tasks.workunit.client.0.smithi134.stdout:3/422: mknod da/d1c/d24/d29/d51/d79/c8b 0 2024-02-16T22:18:54.228 INFO:tasks.workunit.client.0.smithi134.stdout:9/479: creat db/d20/d22/d64/d69/d6d/fa1 x:0 0 0 2024-02-16T22:18:54.230 INFO:tasks.workunit.client.0.smithi134.stdout:5/430: rename d2/d9/dc/d15/l44 to d2/d9/dc/l8d 0 2024-02-16T22:18:54.230 INFO:tasks.workunit.client.0.smithi134.stdout:6/433: dread d17/d27/d30/f35 [0,4194304] 0 2024-02-16T22:18:54.231 INFO:tasks.workunit.client.0.smithi134.stdout:3/423: unlink da/d1c/d24/d2c/f4c 0 2024-02-16T22:18:54.233 INFO:tasks.workunit.client.0.smithi134.stdout:9/480: unlink db/c10 0 2024-02-16T22:18:54.234 INFO:tasks.workunit.client.0.smithi134.stdout:0/403: dread d2/dc/d2d/d34/f37 [0,4194304] 0 2024-02-16T22:18:54.234 INFO:tasks.workunit.client.0.smithi134.stdout:5/431: mknod d2/d35/d36/d46/d68/d74/c8e 0 2024-02-16T22:18:54.235 INFO:tasks.workunit.client.0.smithi134.stdout:3/424: mknod da/d12/d2a/c8c 0 2024-02-16T22:18:54.235 INFO:tasks.workunit.client.0.smithi134.stdout:9/481: mkdir db/d20/d22/d51/da2 0 2024-02-16T22:18:54.236 INFO:tasks.workunit.client.0.smithi134.stdout:3/425: write da/f3a [940823,75095] 0 2024-02-16T22:18:54.237 INFO:tasks.workunit.client.0.smithi134.stdout:6/434: read d17/d22/f29 [328213,94068] 0 2024-02-16T22:18:54.237 INFO:tasks.workunit.client.0.smithi134.stdout:7/420: dread d2/d6/d17/f14 [0,4194304] 0 2024-02-16T22:18:54.237 INFO:tasks.workunit.client.0.smithi134.stdout:6/435: write d17/d27/d4f/d52/d79/f6b [916856,19658] 0 2024-02-16T22:18:54.237 INFO:tasks.workunit.client.0.smithi134.stdout:2/345: dwrite df/d10/d15/d5a/f26 [4194304,4194304] 0 2024-02-16T22:18:54.239 INFO:tasks.workunit.client.0.smithi134.stdout:3/426: unlink da/d1c/d24/d29/d51/d7e/f7f 0 2024-02-16T22:18:54.239 INFO:tasks.workunit.client.0.smithi134.stdout:7/421: rmdir d2 39 2024-02-16T22:18:54.240 INFO:tasks.workunit.client.0.smithi134.stdout:1/407: dread d5/d1a/d23/f20 [4194304,4194304] 0 2024-02-16T22:18:54.243 INFO:tasks.workunit.client.0.smithi134.stdout:4/308: dwrite d0/d6/d22/d25/d2a/f2e [0,4194304] 0 2024-02-16T22:18:54.243 INFO:tasks.workunit.client.0.smithi134.stdout:8/390: dwrite d2/df/d18/fc [0,4194304] 0 2024-02-16T22:18:54.243 INFO:tasks.workunit.client.0.smithi134.stdout:8/391: creat d2/df/d7c/f81 x:0 0 0 2024-02-16T22:18:54.243 INFO:tasks.workunit.client.0.smithi134.stdout:8/392: chown d2/f36 0 1 2024-02-16T22:18:54.243 INFO:tasks.workunit.client.0.smithi134.stdout:6/436: rename d17/d22/f47 to d17/d27/d4f/d52/f85 0 2024-02-16T22:18:54.244 INFO:tasks.workunit.client.0.smithi134.stdout:4/309: read d0/d6/d22/d25/f48 [19777,56792] 0 2024-02-16T22:18:54.244 INFO:tasks.workunit.client.0.smithi134.stdout:7/422: fdatasync d2/d6/d17/d31/d28/f36 0 2024-02-16T22:18:54.246 INFO:tasks.workunit.client.0.smithi134.stdout:1/408: mkdir d5/d1a/d53/d86 0 2024-02-16T22:18:54.255 INFO:tasks.workunit.client.0.smithi134.stdout:7/423: symlink d2/d5/d22/d26/l8f 0 2024-02-16T22:18:54.255 INFO:tasks.workunit.client.0.smithi134.stdout:4/310: write d0/d6/d16/d1a/f1b [48694,120704] 0 2024-02-16T22:18:54.255 INFO:tasks.workunit.client.0.smithi134.stdout:4/311: truncate d0/d6/d22/d40/f41 952871 0 2024-02-16T22:18:54.259 INFO:tasks.workunit.client.0.smithi134.stdout:3/427: write da/d1c/d24/d29/d40/d8a/f73 [467409,21712] 0 2024-02-16T22:18:54.259 INFO:tasks.workunit.client.0.smithi134.stdout:3/428: readlink da/d1c/d24/d29/l4d 0 2024-02-16T22:18:54.259 INFO:tasks.workunit.client.0.smithi134.stdout:4/312: mkdir d0/d6/d8/d32/d68 0 2024-02-16T22:18:54.260 INFO:tasks.workunit.client.0.smithi134.stdout:1/409: getdents d5/da/d21/d45 0 2024-02-16T22:18:54.261 INFO:tasks.workunit.client.0.smithi134.stdout:7/424: dread d2/d5/f2d [0,4194304] 0 2024-02-16T22:18:54.261 INFO:tasks.workunit.client.0.smithi134.stdout:7/425: write d2/d5/d19/f1d [3822002,109479] 0 2024-02-16T22:18:54.330 INFO:tasks.workunit.client.0.smithi134.stdout:0/404: dwrite d2/f6c [0,4194304] 0 2024-02-16T22:18:54.330 INFO:tasks.workunit.client.0.smithi134.stdout:2/346: dwrite df/d10/d15/f16 [0,4194304] 0 2024-02-16T22:18:54.330 INFO:tasks.workunit.client.0.smithi134.stdout:2/347: fsync df/d10/d15/f1d 0 2024-02-16T22:18:54.347 INFO:tasks.workunit.client.0.smithi134.stdout:4/313: dread d0/d6/d8/f52 [0,4194304] 0 2024-02-16T22:18:54.348 INFO:tasks.workunit.client.0.smithi134.stdout:0/405: read d2/dc/d32/d3e/f47 [456523,63344] 0 2024-02-16T22:18:54.348 INFO:tasks.workunit.client.0.smithi134.stdout:4/314: write d0/d6/d22/d25/f48 [405120,27774] 0 2024-02-16T22:18:54.348 INFO:tasks.workunit.client.0.smithi134.stdout:4/315: creat d0/d6/d22/d25/f69 x:0 0 0 2024-02-16T22:18:54.348 INFO:tasks.workunit.client.0.smithi134.stdout:6/437: rmdir d17/d27/d4f/d52 39 2024-02-16T22:18:54.350 INFO:tasks.workunit.client.0.smithi134.stdout:0/406: creat d2/d20/d7a/f86 x:0 0 0 2024-02-16T22:18:54.351 INFO:tasks.workunit.client.0.smithi134.stdout:8/393: dwrite d2/f35 [0,4194304] 0 2024-02-16T22:18:54.351 INFO:tasks.workunit.client.0.smithi134.stdout:8/394: write d2/df/d18/d2a/d41/d61/f7f [2750774,41807] 0 2024-02-16T22:18:54.351 INFO:tasks.workunit.client.0.smithi134.stdout:6/438: mkdir d17/d22/d70/d86 0 2024-02-16T22:18:54.352 INFO:tasks.workunit.client.0.smithi134.stdout:4/316: dread d0/f2 [0,4194304] 0 2024-02-16T22:18:54.353 INFO:tasks.workunit.client.0.smithi134.stdout:4/317: stat d0/d6/d1e 0 2024-02-16T22:18:54.353 INFO:tasks.workunit.client.0.smithi134.stdout:8/395: dread d2/df/f6e [0,4194304] 0 2024-02-16T22:18:54.353 INFO:tasks.workunit.client.0.smithi134.stdout:8/396: readlink d2/l4b 0 2024-02-16T22:18:54.353 INFO:tasks.workunit.client.0.smithi134.stdout:0/407: mkdir d2/dc/d2d/d34/d87 0 2024-02-16T22:18:54.353 INFO:tasks.workunit.client.0.smithi134.stdout:6/439: mkdir d17/d27/d4f/d52/d87 0 2024-02-16T22:18:54.353 INFO:tasks.workunit.client.0.smithi134.stdout:6/440: chown d17/f2d 47 1 2024-02-16T22:18:54.354 INFO:tasks.workunit.client.0.smithi134.stdout:8/397: rename d2/df/l44 to d2/df/d18/d2a/d5c/l82 0 2024-02-16T22:18:54.354 INFO:tasks.workunit.client.0.smithi134.stdout:8/398: chown d2/df/d19 0 1 2024-02-16T22:18:54.354 INFO:tasks.workunit.client.0.smithi134.stdout:8/399: stat d2/f67 0 2024-02-16T22:18:54.355 INFO:tasks.workunit.client.0.smithi134.stdout:0/408: rename d2/d20/c62 to d2/dc/d2d/d34/d87/c88 0 2024-02-16T22:18:54.355 INFO:tasks.workunit.client.0.smithi134.stdout:0/409: creat d2/dc/d48/d60/f89 x:0 0 0 2024-02-16T22:18:54.356 INFO:tasks.workunit.client.0.smithi134.stdout:8/400: mknod d2/df/d19/d40/c83 0 2024-02-16T22:18:54.357 INFO:tasks.workunit.client.0.smithi134.stdout:0/410: rmdir d2/d20/d77 39 2024-02-16T22:18:54.358 INFO:tasks.workunit.client.0.smithi134.stdout:0/411: symlink d2/d20/d7a/d65/l8a 0 2024-02-16T22:18:54.360 INFO:tasks.workunit.client.0.smithi134.stdout:0/412: link d2/f22 d2/d56/f8b 0 2024-02-16T22:18:54.360 INFO:tasks.workunit.client.0.smithi134.stdout:3/429: dwrite da/d12/f42 [0,4194304] 0 2024-02-16T22:18:54.360 INFO:tasks.workunit.client.0.smithi134.stdout:3/430: chown da/d1c/d24/d29/d51/d5b/d6d 16403 1 2024-02-16T22:18:54.360 INFO:tasks.workunit.client.0.smithi134.stdout:3/431: fsync da/d1c/d24/d29/d40/d8a/f73 0 2024-02-16T22:18:54.361 INFO:tasks.workunit.client.0.smithi134.stdout:0/413: symlink d2/d20/d77/l8c 0 2024-02-16T22:18:54.361 INFO:tasks.workunit.client.0.smithi134.stdout:0/414: fsync d2/f16 0 2024-02-16T22:18:54.366 INFO:tasks.workunit.client.0.smithi134.stdout:5/432: dwrite d2/d9/dc/d15/f41 [0,4194304] 0 2024-02-16T22:18:54.367 INFO:tasks.workunit.client.0.smithi134.stdout:5/433: mkdir d2/d8f 0 2024-02-16T22:18:54.367 INFO:tasks.workunit.client.0.smithi134.stdout:5/434: chown d2/l82 0 1 2024-02-16T22:18:54.367 INFO:tasks.workunit.client.0.smithi134.stdout:5/435: fsync d2/d35/d72/f7a 0 2024-02-16T22:18:54.370 INFO:tasks.workunit.client.0.smithi134.stdout:7/426: dwrite d2/d5/d4c/f4d [0,4194304] 0 2024-02-16T22:18:54.370 INFO:tasks.workunit.client.0.smithi134.stdout:7/427: truncate d2/d5/d22/f66 1044072 0 2024-02-16T22:18:54.370 INFO:tasks.workunit.client.0.smithi134.stdout:7/428: chown d2/d6/d17/d25 16 1 2024-02-16T22:18:54.370 INFO:tasks.workunit.client.0.smithi134.stdout:7/429: write d2/d5/d22/d26/d48/f69 [406427,130097] 0 2024-02-16T22:18:54.371 INFO:tasks.workunit.client.0.smithi134.stdout:7/430: write d2/f4 [7715749,68557] 0 2024-02-16T22:18:54.371 INFO:tasks.workunit.client.0.smithi134.stdout:7/431: write d2/ff [1330408,111512] 0 2024-02-16T22:18:54.372 INFO:tasks.workunit.client.0.smithi134.stdout:6/441: dread d17/f42 [0,4194304] 0 2024-02-16T22:18:54.372 INFO:tasks.workunit.client.0.smithi134.stdout:2/348: dwrite df/d10/d15/d5a/d34/f3e [0,4194304] 0 2024-02-16T22:18:54.374 INFO:tasks.workunit.client.0.smithi134.stdout:5/436: truncate d2/d9/dc/f26 235545 0 2024-02-16T22:18:54.374 INFO:tasks.workunit.client.0.smithi134.stdout:5/437: fsync d2/d35/d72/f7a 0 2024-02-16T22:18:54.374 INFO:tasks.workunit.client.0.smithi134.stdout:5/438: write d2/d35/d36/d46/d68/f8a [956056,25770] 0 2024-02-16T22:18:54.375 INFO:tasks.workunit.client.0.smithi134.stdout:7/432: rmdir d2/d5/d19 39 2024-02-16T22:18:54.377 INFO:tasks.workunit.client.0.smithi134.stdout:6/442: mkdir d17/d22/d28/d5b/d88 0 2024-02-16T22:18:54.378 INFO:tasks.workunit.client.0.smithi134.stdout:2/349: creat df/d10/d15/d5a/d17/d1b/f64 x:0 0 0 2024-02-16T22:18:54.380 INFO:tasks.workunit.client.0.smithi134.stdout:5/439: mkdir d2/d35/d36/d3d/d63/d90 0 2024-02-16T22:18:54.380 INFO:tasks.workunit.client.0.smithi134.stdout:6/443: write d17/d22/f3b [2699080,43488] 0 2024-02-16T22:18:54.381 INFO:tasks.workunit.client.0.smithi134.stdout:7/433: unlink d2/d5/d22/d26/d48/f69 0 2024-02-16T22:18:54.382 INFO:tasks.workunit.client.0.smithi134.stdout:2/350: creat df/d10/d15/d5a/f65 x:0 0 0 2024-02-16T22:18:54.382 INFO:tasks.workunit.client.0.smithi134.stdout:2/351: dread - df/d10/d15/d5a/f65 zero size 2024-02-16T22:18:54.382 INFO:tasks.workunit.client.0.smithi134.stdout:8/401: dwrite d2/df/f10 [4194304,4194304] 0 2024-02-16T22:18:54.384 INFO:tasks.workunit.client.0.smithi134.stdout:5/440: link d2/d35/d36/d46/d68/d74/c8e d2/d9/dc/d27/d4b/c91 0 2024-02-16T22:18:54.386 INFO:tasks.workunit.client.0.smithi134.stdout:5/441: symlink d2/d9/dc/d15/d2f/l92 0 2024-02-16T22:18:54.387 INFO:tasks.workunit.client.0.smithi134.stdout:5/442: truncate d2/d9/f53 265415 0 2024-02-16T22:18:54.395 INFO:tasks.workunit.client.0.smithi134.stdout:5/443: dread d2/f18 [0,4194304] 0 2024-02-16T22:18:54.397 INFO:tasks.workunit.client.0.smithi134.stdout:4/318: dwrite d0/d6/d22/d25/f2d [0,4194304] 0 2024-02-16T22:18:54.402 INFO:tasks.workunit.client.0.smithi134.stdout:8/402: read d2/df/d18/fc [944886,127233] 0 2024-02-16T22:18:54.402 INFO:tasks.workunit.client.0.smithi134.stdout:8/403: chown d2/df/d18/d2a/d5c 6 1 2024-02-16T22:18:54.403 INFO:tasks.workunit.client.0.smithi134.stdout:3/432: dwrite da/d1c/d24/d29/f45 [0,4194304] 0 2024-02-16T22:18:54.403 INFO:tasks.workunit.client.0.smithi134.stdout:3/433: fdatasync da/d12/f7b 0 2024-02-16T22:18:54.405 INFO:tasks.workunit.client.0.smithi134.stdout:0/415: dwrite d2/dc/d48/d60/f64 [0,4194304] 0 2024-02-16T22:18:54.408 INFO:tasks.workunit.client.0.smithi134.stdout:3/434: rename da/d1c/d24/d2c/f58 to da/d1c/d24/d29/d51/d5b/d5f/d62/f8d 0 2024-02-16T22:18:54.408 INFO:tasks.workunit.client.0.smithi134.stdout:5/444: read d2/d35/d36/f77 [513836,12863] 0 2024-02-16T22:18:54.408 INFO:tasks.workunit.client.0.smithi134.stdout:3/435: write da/d12/f76 [454307,48515] 0 2024-02-16T22:18:54.408 INFO:tasks.workunit.client.0.smithi134.stdout:3/436: chown da/l82 81 1 2024-02-16T22:18:54.412 INFO:tasks.workunit.client.0.smithi134.stdout:5/445: mknod d2/d35/d36/d3d/c93 0 2024-02-16T22:18:54.412 INFO:tasks.workunit.client.0.smithi134.stdout:5/446: chown d2/d35/d36/d46/c5f 25915674 1 2024-02-16T22:18:54.412 INFO:tasks.workunit.client.0.smithi134.stdout:5/447: chown d2/d9/dc/d27/l54 2 1 2024-02-16T22:18:54.418 INFO:tasks.workunit.client.0.smithi134.stdout:8/404: dread d2/df/d19/f51 [0,4194304] 0 2024-02-16T22:18:54.418 INFO:tasks.workunit.client.0.smithi134.stdout:6/444: dwrite d17/d22/f7e [0,4194304] 0 2024-02-16T22:18:54.418 INFO:tasks.workunit.client.0.smithi134.stdout:8/405: write d2/df/d18/d27/f7b [309618,118545] 0 2024-02-16T22:18:54.429 INFO:tasks.workunit.client.0.smithi134.stdout:8/406: write d2/f35 [3911559,51181] 0 2024-02-16T22:18:54.429 INFO:tasks.workunit.client.0.smithi134.stdout:2/352: dwrite df/d10/d15/d5a/d17/d1b/f22 [0,4194304] 0 2024-02-16T22:18:54.429 INFO:tasks.workunit.client.0.smithi134.stdout:8/407: write d2/f5f [1949633,55199] 0 2024-02-16T22:18:54.430 INFO:tasks.workunit.client.0.smithi134.stdout:5/448: read d2/f50 [574635,44943] 0 2024-02-16T22:18:54.430 INFO:tasks.workunit.client.0.smithi134.stdout:7/434: dwrite d2/d5/d19/f1d [0,4194304] 0 2024-02-16T22:18:54.430 INFO:tasks.workunit.client.0.smithi134.stdout:5/449: write d2/d9/dc/f1d [68667,130455] 0 2024-02-16T22:18:54.432 INFO:tasks.workunit.client.0.smithi134.stdout:2/353: creat df/d10/d15/f66 x:0 0 0 2024-02-16T22:18:54.432 INFO:tasks.workunit.client.0.smithi134.stdout:8/408: creat d2/df/d18/d2a/d41/d59/f84 x:0 0 0 2024-02-16T22:18:54.432 INFO:tasks.workunit.client.0.smithi134.stdout:8/409: read d2/df/d18/f6 [568372,32317] 0 2024-02-16T22:18:54.435 INFO:tasks.workunit.client.0.smithi134.stdout:4/319: dwrite d0/d6/d22/d25/f43 [0,4194304] 0 2024-02-16T22:18:54.435 INFO:tasks.workunit.client.0.smithi134.stdout:4/320: chown d0/d6/d1e/d39/d4e/c5c 6095570 1 2024-02-16T22:18:54.435 INFO:tasks.workunit.client.0.smithi134.stdout:4/321: dread - d0/d6/d8/d30/f42 zero size 2024-02-16T22:18:54.436 INFO:tasks.workunit.client.0.smithi134.stdout:0/416: dwrite d2/dc/d48/d60/f64 [0,4194304] 0 2024-02-16T22:18:54.437 INFO:tasks.workunit.client.0.smithi134.stdout:3/437: dwrite da/d12/f17 [4194304,4194304] 0 2024-02-16T22:18:54.437 INFO:tasks.workunit.client.0.smithi134.stdout:6/445: dwrite d17/d27/d4f/f59 [0,4194304] 0 2024-02-16T22:18:54.437 INFO:tasks.workunit.client.0.smithi134.stdout:6/446: chown d17/d36/l40 14512449 1 2024-02-16T22:18:54.446 INFO:tasks.workunit.client.0.smithi134.stdout:7/435: mknod d2/d5/d19/d84/d86/c90 0 2024-02-16T22:18:54.446 INFO:tasks.workunit.client.0.smithi134.stdout:7/436: chown d2/d5/d22/d26/f5f 257145769 1 2024-02-16T22:18:54.449 INFO:tasks.workunit.client.0.smithi134.stdout:2/354: mknod df/d10/d30/d4d/c67 0 2024-02-16T22:18:54.449 INFO:tasks.workunit.client.0.smithi134.stdout:4/322: symlink d0/d6/d5d/l6a 0 2024-02-16T22:18:54.449 INFO:tasks.workunit.client.0.smithi134.stdout:3/438: dread da/d12/d2a/f7c [0,4194304] 0 2024-02-16T22:18:54.449 INFO:tasks.workunit.client.0.smithi134.stdout:0/417: mknod d2/d56/c8d 0 2024-02-16T22:18:54.449 INFO:tasks.workunit.client.0.smithi134.stdout:8/410: truncate d2/df/d18/f6 5115293 0 2024-02-16T22:18:54.451 INFO:tasks.workunit.client.0.smithi134.stdout:2/355: creat df/d10/d15/d5a/d34/f68 x:0 0 0 2024-02-16T22:18:54.454 INFO:tasks.workunit.client.0.smithi134.stdout:8/411: unlink d2/df/d19/d40/d53/c73 0 2024-02-16T22:18:54.455 INFO:tasks.workunit.client.0.smithi134.stdout:2/356: symlink df/d10/d3a/l69 0 2024-02-16T22:18:54.456 INFO:tasks.workunit.client.0.smithi134.stdout:4/323: dread d0/f2 [0,4194304] 0 2024-02-16T22:18:54.456 INFO:tasks.workunit.client.0.smithi134.stdout:5/450: dwrite d2/d35/d36/d3d/f78 [4194304,4194304] 0 2024-02-16T22:18:54.456 INFO:tasks.workunit.client.0.smithi134.stdout:0/418: getdents d2/d4b 0 2024-02-16T22:18:54.456 INFO:tasks.workunit.client.0.smithi134.stdout:0/419: stat d2/d20/f29 0 2024-02-16T22:18:54.457 INFO:tasks.workunit.client.0.smithi134.stdout:0/420: chown d2/dc/d32/d3e/d5e/l67 20618829 1 2024-02-16T22:18:54.457 INFO:tasks.workunit.client.0.smithi134.stdout:0/421: fdatasync d2/dc/ff 0 2024-02-16T22:18:54.457 INFO:tasks.workunit.client.0.smithi134.stdout:2/357: creat df/d41/f6a x:0 0 0 2024-02-16T22:18:54.457 INFO:tasks.workunit.client.0.smithi134.stdout:2/358: chown df/d10/d15/d5a/d34 36039565 1 2024-02-16T22:18:54.461 INFO:tasks.workunit.client.0.smithi134.stdout:8/412: dread d2/df/d19/f51 [0,4194304] 0 2024-02-16T22:18:54.463 INFO:tasks.workunit.client.0.smithi134.stdout:4/324: symlink d0/d6/d8/d32/d68/l6b 0 2024-02-16T22:18:54.463 INFO:tasks.workunit.client.0.smithi134.stdout:4/325: chown d0/d6/d16/d46/l4b 1332806281 1 2024-02-16T22:18:54.463 INFO:tasks.workunit.client.0.smithi134.stdout:5/451: rmdir d2 39 2024-02-16T22:18:54.463 INFO:tasks.workunit.client.0.smithi134.stdout:5/452: fsync d2/d9/dc/f81 0 2024-02-16T22:18:54.464 INFO:tasks.workunit.client.0.smithi134.stdout:7/437: dwrite d2/d5/d22/d26/d48/f6e [0,4194304] 0 2024-02-16T22:18:54.464 INFO:tasks.workunit.client.0.smithi134.stdout:2/359: link df/d10/d15/d5a/c1c df/d10/d15/d5a/d2d/c6b 0 2024-02-16T22:18:54.465 INFO:tasks.workunit.client.0.smithi134.stdout:8/413: mkdir d2/df/d18/d27/d85 0 2024-02-16T22:18:54.466 INFO:tasks.workunit.client.0.smithi134.stdout:9/482: sync 2024-02-16T22:18:54.467 INFO:tasks.workunit.client.0.smithi134.stdout:1/410: sync 2024-02-16T22:18:54.467 INFO:tasks.workunit.client.0.smithi134.stdout:9/483: write db/d20/d22/f25 [4399887,66746] 0 2024-02-16T22:18:54.470 INFO:tasks.workunit.client.0.smithi134.stdout:3/439: dwrite da/d12/f17 [4194304,4194304] 0 2024-02-16T22:18:54.470 INFO:tasks.workunit.client.0.smithi134.stdout:2/360: creat df/d10/d30/f6c x:0 0 0 2024-02-16T22:18:54.470 INFO:tasks.workunit.client.0.smithi134.stdout:2/361: write df/d10/d15/d5a/d17/d1b/f56 [840316,85242] 0 2024-02-16T22:18:54.473 INFO:tasks.workunit.client.0.smithi134.stdout:1/411: symlink d5/da/d21/d52/l87 0 2024-02-16T22:18:54.473 INFO:tasks.workunit.client.0.smithi134.stdout:1/412: write d5/d1a/d23/d61/f83 [4087902,105399] 0 2024-02-16T22:18:54.474 INFO:tasks.workunit.client.0.smithi134.stdout:9/484: creat db/fa3 x:0 0 0 2024-02-16T22:18:54.475 INFO:tasks.workunit.client.0.smithi134.stdout:5/453: getdents d2/d9/dc/d27 0 2024-02-16T22:18:54.476 INFO:tasks.workunit.client.0.smithi134.stdout:7/438: mkdir d2/d6/d91 0 2024-02-16T22:18:54.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:53 smithi134 ceph-mon[28869]: pgmap v249: 65 pgs: 65 active+clean; 549 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 35 MiB/s rd, 56 MiB/s wr, 411 op/s 2024-02-16T22:18:54.478 INFO:tasks.workunit.client.0.smithi134.stdout:3/440: mkdir da/d1c/d24/d29/d51/d80/d89/d8e 0 2024-02-16T22:18:54.478 INFO:tasks.workunit.client.0.smithi134.stdout:3/441: write da/d1c/f5d [509187,43628] 0 2024-02-16T22:18:54.478 INFO:tasks.workunit.client.0.smithi134.stdout:3/442: dread - da/d12/f7b zero size 2024-02-16T22:18:54.478 INFO:tasks.workunit.client.0.smithi134.stdout:8/414: getdents d2/df/d18 0 2024-02-16T22:18:54.480 INFO:tasks.workunit.client.0.smithi134.stdout:4/326: rename d0/d6/d8/de to d0/d6/d8/d32/d63/d6c 0 2024-02-16T22:18:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:53 smithi173 ceph-mon[37280]: pgmap v249: 65 pgs: 65 active+clean; 549 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 35 MiB/s rd, 56 MiB/s wr, 411 op/s 2024-02-16T22:18:54.482 INFO:tasks.workunit.client.0.smithi134.stdout:1/413: unlink d5/d1a/d4d/f5a 0 2024-02-16T22:18:54.483 INFO:tasks.workunit.client.0.smithi134.stdout:9/485: mknod db/d20/d22/d51/da2/ca4 0 2024-02-16T22:18:54.483 INFO:tasks.workunit.client.0.smithi134.stdout:9/486: creat db/fa5 x:0 0 0 2024-02-16T22:18:54.484 INFO:tasks.workunit.client.0.smithi134.stdout:5/454: mknod d2/d35/d36/d3d/d63/d90/c94 0 2024-02-16T22:18:54.485 INFO:tasks.workunit.client.0.smithi134.stdout:7/439: truncate d2/d6/d17/f14 4072028 0 2024-02-16T22:18:54.485 INFO:tasks.workunit.client.0.smithi134.stdout:7/440: truncate d2/f62 17610 0 2024-02-16T22:18:54.487 INFO:tasks.workunit.client.0.smithi134.stdout:8/415: getdents d2/df/d19/d40/d53/d5e/d72 0 2024-02-16T22:18:54.488 INFO:tasks.workunit.client.0.smithi134.stdout:4/327: rename d0/d6/d16/d1a/l34 to d0/d6/d58/d59/l6d 0 2024-02-16T22:18:54.489 INFO:tasks.workunit.client.0.smithi134.stdout:4/328: write d0/d6/d22/d25/f48 [47632,62758] 0 2024-02-16T22:18:54.490 INFO:tasks.workunit.client.0.smithi134.stdout:9/487: truncate db/dc/f12 2017504 0 2024-02-16T22:18:54.491 INFO:tasks.workunit.client.0.smithi134.stdout:5/455: symlink d2/l95 0 2024-02-16T22:18:54.492 INFO:tasks.workunit.client.0.smithi134.stdout:5/456: chown d2/d9/dc/d15/d2f/l92 876262636 1 2024-02-16T22:18:54.492 INFO:tasks.workunit.client.0.smithi134.stdout:7/441: mkdir d2/d6/d7d/d92 0 2024-02-16T22:18:54.493 INFO:tasks.workunit.client.0.smithi134.stdout:8/416: mkdir d2/df/d19/d86 0 2024-02-16T22:18:54.493 INFO:tasks.workunit.client.0.smithi134.stdout:8/417: truncate d2/f67 171015 0 2024-02-16T22:18:54.493 INFO:tasks.workunit.client.0.smithi134.stdout:8/418: chown d2/df/d18/l58 65228529 1 2024-02-16T22:18:54.495 INFO:tasks.workunit.client.0.smithi134.stdout:2/362: rename df/d10/d15/f28 to df/d10/d15/d5a/d2d/f6d 0 2024-02-16T22:18:54.495 INFO:tasks.workunit.client.0.smithi134.stdout:2/363: readlink df/l27 0 2024-02-16T22:18:54.495 INFO:tasks.workunit.client.0.smithi134.stdout:4/329: rmdir d0/d6 39 2024-02-16T22:18:54.496 INFO:tasks.workunit.client.0.smithi134.stdout:4/330: write d0/d6/d22/d25/f48 [1142221,101126] 0 2024-02-16T22:18:54.497 INFO:tasks.workunit.client.0.smithi134.stdout:1/414: dread d5/d1a/d23/d3c/f41 [0,4194304] 0 2024-02-16T22:18:54.497 INFO:tasks.workunit.client.0.smithi134.stdout:9/488: mknod db/d20/d22/d64/d69/d6e/d81/ca6 0 2024-02-16T22:18:54.497 INFO:tasks.workunit.client.0.smithi134.stdout:9/489: stat f8 0 2024-02-16T22:18:54.500 INFO:tasks.workunit.client.0.smithi134.stdout:5/457: unlink d2/l5d 0 2024-02-16T22:18:54.502 INFO:tasks.workunit.client.0.smithi134.stdout:8/419: write d2/df/d18/d2a/d41/f42 [3318235,67532] 0 2024-02-16T22:18:54.502 INFO:tasks.workunit.client.0.smithi134.stdout:7/442: mkdir d2/d5/d19/d84/d86/d93 0 2024-02-16T22:18:54.502 INFO:tasks.workunit.client.0.smithi134.stdout:7/443: fsync d2/d5/d19/d4a/f58 0 2024-02-16T22:18:54.504 INFO:tasks.workunit.client.0.smithi134.stdout:3/443: rename da/d1c/d24/d29/d51/d5b to da/d1c/d24/d29/d40/d8a/d8f 0 2024-02-16T22:18:54.505 INFO:tasks.workunit.client.0.smithi134.stdout:3/444: fdatasync da/d1c/d24/d29/d40/d8a/d8f/d5f/d62/f8d 0 2024-02-16T22:18:54.506 INFO:tasks.workunit.client.0.smithi134.stdout:4/331: creat d0/d6/d8/d32/d68/f6e x:0 0 0 2024-02-16T22:18:54.508 INFO:tasks.workunit.client.0.smithi134.stdout:1/415: mknod d5/d1a/d23/d3c/d6a/c88 0 2024-02-16T22:18:54.509 INFO:tasks.workunit.client.0.smithi134.stdout:9/490: symlink db/d20/d9a/la7 0 2024-02-16T22:18:54.510 INFO:tasks.workunit.client.0.smithi134.stdout:3/445: dread da/d1c/d24/d29/d40/d8a/f73 [0,4194304] 0 2024-02-16T22:18:54.510 INFO:tasks.workunit.client.0.smithi134.stdout:5/458: creat d2/d35/f96 x:0 0 0 2024-02-16T22:18:54.511 INFO:tasks.workunit.client.0.smithi134.stdout:8/420: truncate d2/f2c 2851446 0 2024-02-16T22:18:54.513 INFO:tasks.workunit.client.0.smithi134.stdout:7/444: mknod d2/d5/d22/d26/d48/d7f/d24/c94 0 2024-02-16T22:18:54.513 INFO:tasks.workunit.client.0.smithi134.stdout:7/445: fsync d2/d6/d17/d31/d28/f36 0 2024-02-16T22:18:54.513 INFO:tasks.workunit.client.0.smithi134.stdout:7/446: fsync d2/d6/f16 0 2024-02-16T22:18:54.516 INFO:tasks.workunit.client.0.smithi134.stdout:8/421: read d2/df/d18/d2a/d41/d59/f56 [428783,2093] 0 2024-02-16T22:18:54.517 INFO:tasks.workunit.client.0.smithi134.stdout:2/364: dwrite df/d10/d30/d49/f57 [0,4194304] 0 2024-02-16T22:18:54.518 INFO:tasks.workunit.client.0.smithi134.stdout:4/332: unlink d0/d6/d58/d59/l6d 0 2024-02-16T22:18:54.519 INFO:tasks.workunit.client.0.smithi134.stdout:1/416: symlink d5/d1a/d53/d7c/l89 0 2024-02-16T22:18:54.521 INFO:tasks.workunit.client.0.smithi134.stdout:5/459: dread d2/d9/dc/f24 [0,4194304] 0 2024-02-16T22:18:54.522 INFO:tasks.workunit.client.0.smithi134.stdout:7/447: mknod d2/d5/d19/d4a/c95 0 2024-02-16T22:18:54.529 INFO:tasks.workunit.client.0.smithi134.stdout:1/417: write d5/da/f1d [4173861,13470] 0 2024-02-16T22:18:54.529 INFO:tasks.workunit.client.0.smithi134.stdout:1/418: chown d5/d1a/d23/c67 5 1 2024-02-16T22:18:54.530 INFO:tasks.workunit.client.0.smithi134.stdout:2/365: mknod df/d10/d15/c6e 0 2024-02-16T22:18:54.530 INFO:tasks.workunit.client.0.smithi134.stdout:2/366: chown cd 191418411 1 2024-02-16T22:18:54.534 INFO:tasks.workunit.client.0.smithi134.stdout:5/460: mknod d2/d35/d36/c97 0 2024-02-16T22:18:54.537 INFO:tasks.workunit.client.0.smithi134.stdout:9/491: dwrite db/dc/f14 [0,4194304] 0 2024-02-16T22:18:54.537 INFO:tasks.workunit.client.0.smithi134.stdout:9/492: stat db/c21 0 2024-02-16T22:18:54.537 INFO:tasks.workunit.client.0.smithi134.stdout:9/493: readlink db/l48 0 2024-02-16T22:18:54.540 INFO:tasks.workunit.client.0.smithi134.stdout:2/367: dread fb [0,4194304] 0 2024-02-16T22:18:54.545 INFO:tasks.workunit.client.0.smithi134.stdout:2/368: dread df/d10/d15/d5a/d17/d1b/f2f [4194304,4194304] 0 2024-02-16T22:18:54.598 INFO:tasks.workunit.client.0.smithi134.stdout:7/448: truncate d2/d6/f21 6011193 0 2024-02-16T22:18:54.598 INFO:tasks.workunit.client.0.smithi134.stdout:7/449: chown d2/d5/d22/d26/d48/l68 1 1 2024-02-16T22:18:54.603 INFO:tasks.workunit.client.0.smithi134.stdout:1/419: creat d5/da/d21/d45/f8a x:0 0 0 2024-02-16T22:18:54.604 INFO:tasks.workunit.client.0.smithi134.stdout:3/446: rename da/d1c/d24/d29/d51/d7e to da/d1c/d24/d29/d51/d80/d90 0 2024-02-16T22:18:54.604 INFO:tasks.workunit.client.0.smithi134.stdout:3/447: creat da/d12/f91 x:0 0 0 2024-02-16T22:18:54.609 INFO:tasks.workunit.client.0.smithi134.stdout:2/369: mkdir df/d6f 0 2024-02-16T22:18:54.612 INFO:tasks.workunit.client.0.smithi134.stdout:8/422: rename d2/df/d18/d2a/d5c to d2/df/d18/d2a/d41/d61/d87 0 2024-02-16T22:18:54.614 INFO:tasks.workunit.client.0.smithi134.stdout:3/448: unlink da/d1c/d24/c3e 0 2024-02-16T22:18:54.614 INFO:tasks.workunit.client.0.smithi134.stdout:3/449: read - da/d1c/d24/d29/d51/d80/f85 zero size 2024-02-16T22:18:54.616 INFO:tasks.workunit.client.0.smithi134.stdout:5/461: mkdir d2/d9/dc/d98 0 2024-02-16T22:18:54.616 INFO:tasks.workunit.client.0.smithi134.stdout:5/462: truncate d2/f4 4665933 0 2024-02-16T22:18:54.616 INFO:tasks.workunit.client.0.smithi134.stdout:5/463: fdatasync d2/f6d 0 2024-02-16T22:18:54.616 INFO:tasks.workunit.client.0.smithi134.stdout:3/450: dread da/d12/f76 [0,4194304] 0 2024-02-16T22:18:54.617 INFO:tasks.workunit.client.0.smithi134.stdout:2/370: symlink df/d6f/l70 0 2024-02-16T22:18:54.618 INFO:tasks.workunit.client.0.smithi134.stdout:7/450: mknod d2/d6/c96 0 2024-02-16T22:18:54.621 INFO:tasks.workunit.client.0.smithi134.stdout:4/333: rename d0/d6/d8/c23 to d0/d6/d1e/d3b/c6f 0 2024-02-16T22:18:54.622 INFO:tasks.workunit.client.0.smithi134.stdout:5/464: mkdir d2/d99 0 2024-02-16T22:18:54.624 INFO:tasks.workunit.client.0.smithi134.stdout:3/451: symlink da/d1c/d24/d29/d40/l92 0 2024-02-16T22:18:54.624 INFO:tasks.workunit.client.0.smithi134.stdout:3/452: chown da/d1c/l86 48980627 1 2024-02-16T22:18:54.625 INFO:tasks.workunit.client.0.smithi134.stdout:2/371: link df/d10/f47 df/d10/d3a/f71 0 2024-02-16T22:18:54.628 INFO:tasks.workunit.client.0.smithi134.stdout:7/451: link c1 d2/d5/d19/d84/d86/c97 0 2024-02-16T22:18:54.629 INFO:tasks.workunit.client.0.smithi134.stdout:6/447: sync 2024-02-16T22:18:54.629 INFO:tasks.workunit.client.0.smithi134.stdout:6/448: fdatasync d17/f42 0 2024-02-16T22:18:54.629 INFO:tasks.workunit.client.0.smithi134.stdout:6/449: chown d17/d27/f34 4319434 1 2024-02-16T22:18:54.629 INFO:tasks.workunit.client.0.smithi134.stdout:0/422: sync 2024-02-16T22:18:54.630 INFO:tasks.workunit.client.0.smithi134.stdout:9/494: rename db/d20/d22/f2f to db/d20/d9a/fa8 0 2024-02-16T22:18:54.630 INFO:tasks.workunit.client.0.smithi134.stdout:9/495: chown db/dc/c4e 392460 1 2024-02-16T22:18:54.630 INFO:tasks.workunit.client.0.smithi134.stdout:9/496: chown db/dc 516257 1 2024-02-16T22:18:54.630 INFO:tasks.workunit.client.0.smithi134.stdout:9/497: fdatasync db/f33 0 2024-02-16T22:18:54.630 INFO:tasks.workunit.client.0.smithi134.stdout:9/498: fdatasync db/d20/d22/d64/d69/f87 0 2024-02-16T22:18:54.630 INFO:tasks.workunit.client.0.smithi134.stdout:9/499: write db/dc/f15 [5484402,18011] 0 2024-02-16T22:18:54.631 INFO:tasks.workunit.client.0.smithi134.stdout:4/334: mknod d0/d6/d8/d32/c70 0 2024-02-16T22:18:54.631 INFO:tasks.workunit.client.0.smithi134.stdout:9/500: dread db/dc/f61 [0,4194304] 0 2024-02-16T22:18:54.633 INFO:tasks.workunit.client.0.smithi134.stdout:5/465: mknod d2/d35/d36/d3d/d63/c9a 0 2024-02-16T22:18:54.633 INFO:tasks.workunit.client.0.smithi134.stdout:5/466: stat d2/d9/dc/fe 0 2024-02-16T22:18:54.633 INFO:tasks.workunit.client.0.smithi134.stdout:5/467: creat d2/d35/d36/f9b x:0 0 0 2024-02-16T22:18:54.633 INFO:tasks.workunit.client.0.smithi134.stdout:5/468: chown d2/d9/dc/d15/d2f/c45 9 1 2024-02-16T22:18:54.633 INFO:tasks.workunit.client.0.smithi134.stdout:5/469: chown d2/d35/f96 124 1 2024-02-16T22:18:54.634 INFO:tasks.workunit.client.0.smithi134.stdout:3/453: mknod da/d1c/d24/d29/d51/d80/c93 0 2024-02-16T22:18:54.635 INFO:tasks.workunit.client.0.smithi134.stdout:6/450: rename d17/d22/d28/c71 to d17/d22/d28/c89 0 2024-02-16T22:18:54.638 INFO:tasks.workunit.client.0.smithi134.stdout:1/420: rename d5/f7 to d5/da/d21/d52/f8b 0 2024-02-16T22:18:54.645 INFO:tasks.workunit.client.0.smithi134.stdout:0/423: rename d2/dc/d48/d60/f64 to d2/dc/d32/d3e/d5e/f8e 0 2024-02-16T22:18:54.646 INFO:tasks.workunit.client.0.smithi134.stdout:7/452: dwrite d2/d5/d19/d4a/f7b [0,4194304] 0 2024-02-16T22:18:54.647 INFO:tasks.workunit.client.0.smithi134.stdout:4/335: getdents d0/d6/d1e/d39 0 2024-02-16T22:18:54.652 INFO:tasks.workunit.client.0.smithi134.stdout:0/424: stat d2/l24 0 2024-02-16T22:18:54.657 INFO:tasks.workunit.client.0.smithi134.stdout:5/470: rename d2/d9/dc/d27 to d2/d35/d36/d3d/d9c 0 2024-02-16T22:18:54.657 INFO:tasks.workunit.client.0.smithi134.stdout:5/471: readlink d2/d9/l23 0 2024-02-16T22:18:54.659 INFO:tasks.workunit.client.0.smithi134.stdout:0/425: link d2/dc/l1b d2/d20/d7a/l8f 0 2024-02-16T22:18:54.659 INFO:tasks.workunit.client.0.smithi134.stdout:0/426: fsync d2/f16 0 2024-02-16T22:18:54.662 INFO:tasks.workunit.client.0.smithi134.stdout:3/454: rename da/d1c/d24/d29/d40/d8a/d8f/c6f to da/d1c/d24/d29/d51/d80/c94 0 2024-02-16T22:18:54.663 INFO:tasks.workunit.client.0.smithi134.stdout:0/427: symlink d2/dc/d2d/d34/d87/l90 0 2024-02-16T22:18:54.666 INFO:tasks.workunit.client.0.smithi134.stdout:3/455: unlink da/d12/f91 0 2024-02-16T22:18:54.666 INFO:tasks.workunit.client.0.smithi134.stdout:3/456: write da/d12/d2a/f4f [320384,43525] 0 2024-02-16T22:18:54.668 INFO:tasks.workunit.client.0.smithi134.stdout:7/453: write d2/d5/d22/d26/d48/d7f/f55 [3161885,2574] 0 2024-02-16T22:18:54.668 INFO:tasks.workunit.client.0.smithi134.stdout:7/454: write d2/d5/d22/d26/d48/d7f/f54 [31525,46836] 0 2024-02-16T22:18:54.668 INFO:tasks.workunit.client.0.smithi134.stdout:3/457: link da/d1c/d24/d29/d40/d8a/d8f/f44 da/d1c/d24/d29/d51/f95 0 2024-02-16T22:18:54.669 INFO:tasks.workunit.client.0.smithi134.stdout:9/501: dwrite db/d20/d22/d51/f5f [4194304,4194304] 0 2024-02-16T22:18:54.670 INFO:tasks.workunit.client.0.smithi134.stdout:7/455: symlink d2/d6/d17/d25/d63/l98 0 2024-02-16T22:18:54.678 INFO:tasks.workunit.client.0.smithi134.stdout:7/456: read d2/d5/d19/f2f [30328,128718] 0 2024-02-16T22:18:54.678 INFO:tasks.workunit.client.0.smithi134.stdout:7/457: write d2/d6/d17/f82 [947484,21203] 0 2024-02-16T22:18:54.680 INFO:tasks.workunit.client.0.smithi134.stdout:7/458: fsync d2/d6/d17/d31/f6f 0 2024-02-16T22:18:54.680 INFO:tasks.workunit.client.0.smithi134.stdout:7/459: chown d2/d5/d22/d26/d48/d7f/f54 0 1 2024-02-16T22:18:54.684 INFO:tasks.workunit.client.0.smithi134.stdout:9/502: dread db/d20/d22/d64/f8d [0,4194304] 0 2024-02-16T22:18:54.684 INFO:tasks.workunit.client.0.smithi134.stdout:6/451: dwrite d17/d22/f4b [0,4194304] 0 2024-02-16T22:18:54.684 INFO:tasks.workunit.client.0.smithi134.stdout:9/503: chown db/d20/d22/d64/d69/d6e/f7f 15384465 1 2024-02-16T22:18:54.684 INFO:tasks.workunit.client.0.smithi134.stdout:9/504: readlink db/l48 0 2024-02-16T22:18:54.688 INFO:tasks.workunit.client.0.smithi134.stdout:6/452: rename d17/f4c to d17/d22/d70/d86/f8a 0 2024-02-16T22:18:54.688 INFO:tasks.workunit.client.0.smithi134.stdout:6/453: fdatasync d17/d36/f6f 0 2024-02-16T22:18:54.688 INFO:tasks.workunit.client.0.smithi134.stdout:6/454: readlink d17/d22/d28/l6c 0 2024-02-16T22:18:54.688 INFO:tasks.workunit.client.0.smithi134.stdout:6/455: chown d17/d22/d73/c74 2 1 2024-02-16T22:18:54.689 INFO:tasks.workunit.client.0.smithi134.stdout:6/456: mkdir d17/d27/d4f/d52/d79/d8b 0 2024-02-16T22:18:54.690 INFO:tasks.workunit.client.0.smithi134.stdout:7/460: dread d2/d5/d22/d26/d48/f6e [0,4194304] 0 2024-02-16T22:18:54.691 INFO:tasks.workunit.client.0.smithi134.stdout:6/457: rename d17/d22/f24 to d17/d27/d30/f8c 0 2024-02-16T22:18:54.697 INFO:tasks.workunit.client.0.smithi134.stdout:1/421: dwrite d5/da/d21/d45/f7b [0,4194304] 0 2024-02-16T22:18:54.697 INFO:tasks.workunit.client.0.smithi134.stdout:1/422: fsync d5/da/f25 0 2024-02-16T22:18:54.697 INFO:tasks.workunit.client.0.smithi134.stdout:4/336: dwrite d0/d6/d22/f67 [0,4194304] 0 2024-02-16T22:18:54.697 INFO:tasks.workunit.client.0.smithi134.stdout:4/337: write d0/d6/d8/d32/d68/f6e [7360,88530] 0 2024-02-16T22:18:54.697 INFO:tasks.workunit.client.0.smithi134.stdout:5/472: dwrite d2/d9/dc/d15/f3b [0,4194304] 0 2024-02-16T22:18:54.698 INFO:tasks.workunit.client.0.smithi134.stdout:7/461: dread d2/d6/d17/d31/d28/f36 [0,4194304] 0 2024-02-16T22:18:54.698 INFO:tasks.workunit.client.0.smithi134.stdout:7/462: fsync d2/d5/d4c/f4d 0 2024-02-16T22:18:54.699 INFO:tasks.workunit.client.0.smithi134.stdout:0/428: dwrite d2/dc/f15 [0,4194304] 0 2024-02-16T22:18:54.700 INFO:tasks.workunit.client.0.smithi134.stdout:5/473: truncate d2/d35/d36/f37 755330 0 2024-02-16T22:18:54.700 INFO:tasks.workunit.client.0.smithi134.stdout:7/463: stat d2/d6/d17/d31/c4b 0 2024-02-16T22:18:54.700 INFO:tasks.workunit.client.0.smithi134.stdout:7/464: readlink d2/d6/d17/d25/d63/l88 0 2024-02-16T22:18:54.701 INFO:tasks.workunit.client.0.smithi134.stdout:0/429: truncate d2/f6c 273569 0 2024-02-16T22:18:54.702 INFO:tasks.workunit.client.0.smithi134.stdout:5/474: truncate d2/f34 45802 0 2024-02-16T22:18:54.703 INFO:tasks.workunit.client.0.smithi134.stdout:7/465: mknod d2/d6/d91/c99 0 2024-02-16T22:18:54.704 INFO:tasks.workunit.client.0.smithi134.stdout:5/475: rmdir d2/d9/dc/d15 39 2024-02-16T22:18:54.704 INFO:tasks.workunit.client.0.smithi134.stdout:5/476: fdatasync d2/fa 0 2024-02-16T22:18:54.704 INFO:tasks.workunit.client.0.smithi134.stdout:5/477: write d2/d35/d36/d3d/d9c/f85 [113087,104446] 0 2024-02-16T22:18:54.705 INFO:tasks.workunit.client.0.smithi134.stdout:7/466: mknod d2/d6/d17/d25/c9a 0 2024-02-16T22:18:54.706 INFO:tasks.workunit.client.0.smithi134.stdout:5/478: chown d2/d9/dc/d15/f4d 249 1 2024-02-16T22:18:54.708 INFO:tasks.workunit.client.0.smithi134.stdout:3/458: dwrite da/d1c/f22 [4194304,4194304] 0 2024-02-16T22:18:54.708 INFO:tasks.workunit.client.0.smithi134.stdout:3/459: readlink da/d1c/d24/d29/d40/l60 0 2024-02-16T22:18:54.709 INFO:tasks.workunit.client.0.smithi134.stdout:3/460: readlink da/d12/d2a/l33 0 2024-02-16T22:18:54.709 INFO:tasks.workunit.client.0.smithi134.stdout:9/505: dwrite db/dc/f62 [0,4194304] 0 2024-02-16T22:18:54.709 INFO:tasks.workunit.client.0.smithi134.stdout:5/479: link d2/d35/d36/d3d/c62 d2/d9/c9d 0 2024-02-16T22:18:54.718 INFO:tasks.workunit.client.0.smithi134.stdout:3/461: link da/d12/d2a/f4f da/d1c/d24/d29/d40/d8a/d8f/d5f/d62/f96 0 2024-02-16T22:18:54.721 INFO:tasks.workunit.client.0.smithi134.stdout:5/480: creat d2/d99/f9e x:0 0 0 2024-02-16T22:18:54.721 INFO:tasks.workunit.client.0.smithi134.stdout:5/481: chown d2/d35/d36/d46/c5f 55163969 1 2024-02-16T22:18:54.722 INFO:tasks.workunit.client.0.smithi134.stdout:6/458: rename d17/d22/d70/d86/f8a to d17/d27/f8d 0 2024-02-16T22:18:54.724 INFO:tasks.workunit.client.0.smithi134.stdout:1/423: rename d5/d1a/d53/d7c to d5/d1a/d23/d8c 0 2024-02-16T22:18:54.727 INFO:tasks.workunit.client.0.smithi134.stdout:4/338: rename d0/d6/d16/d1a/f1b to d0/d6/d8/d30/f71 0 2024-02-16T22:18:54.727 INFO:tasks.workunit.client.0.smithi134.stdout:4/339: creat d0/d6/d22/d25/f72 x:0 0 0 2024-02-16T22:18:54.727 INFO:tasks.workunit.client.0.smithi134.stdout:4/340: creat d0/d6/d22/d25/f73 x:0 0 0 2024-02-16T22:18:54.729 INFO:tasks.workunit.client.0.smithi134.stdout:0/430: dwrite d2/dc/d48/f4c [0,4194304] 0 2024-02-16T22:18:54.730 INFO:tasks.workunit.client.0.smithi134.stdout:4/341: mknod d0/d6/d58/c74 0 2024-02-16T22:18:54.738 INFO:tasks.workunit.client.0.smithi134.stdout:7/467: getdents d2/d6/d91 0 2024-02-16T22:18:54.738 INFO:tasks.workunit.client.0.smithi134.stdout:7/468: write d2/f62 [526412,63713] 0 2024-02-16T22:18:54.739 INFO:tasks.workunit.client.0.smithi134.stdout:3/462: dread da/d12/f42 [0,4194304] 0 2024-02-16T22:18:54.739 INFO:tasks.workunit.client.0.smithi134.stdout:4/342: mkdir d0/d6/d16/d1a/d75 0 2024-02-16T22:18:54.739 INFO:tasks.workunit.client.0.smithi134.stdout:4/343: write d0/d6/d8/d32/f38 [2350159,42903] 0 2024-02-16T22:18:54.741 INFO:tasks.workunit.client.0.smithi134.stdout:4/344: mkdir d0/d6/d5d/d76 0 2024-02-16T22:18:54.743 INFO:tasks.workunit.client.0.smithi134.stdout:4/345: link d0/d6/d1e/d39/f66 d0/f77 0 2024-02-16T22:18:54.744 INFO:tasks.workunit.client.0.smithi134.stdout:4/346: mknod d0/d6/d1e/c78 0 2024-02-16T22:18:54.748 INFO:tasks.workunit.client.0.smithi134.stdout:6/459: dwrite d17/d36/f58 [0,4194304] 0 2024-02-16T22:18:54.749 INFO:tasks.workunit.client.0.smithi134.stdout:8/423: sync 2024-02-16T22:18:54.754 INFO:tasks.workunit.client.0.smithi134.stdout:8/424: symlink d2/df/d19/d40/d53/l88 0 2024-02-16T22:18:54.754 INFO:tasks.workunit.client.0.smithi134.stdout:8/425: write d2/df/d18/d2a/d41/d61/f7f [2986044,44421] 0 2024-02-16T22:18:54.763 INFO:tasks.workunit.client.0.smithi134.stdout:7/469: dwrite d2/d6/f16 [0,4194304] 0 2024-02-16T22:18:54.765 INFO:tasks.workunit.client.0.smithi134.stdout:1/424: dwrite d5/d1a/d23/f27 [0,4194304] 0 2024-02-16T22:18:54.765 INFO:tasks.workunit.client.0.smithi134.stdout:0/431: write d2/dc/f1d [4294195,81241] 0 2024-02-16T22:18:54.768 INFO:tasks.workunit.client.0.smithi134.stdout:1/425: unlink d5/da/d21/d45/c78 0 2024-02-16T22:18:54.768 INFO:tasks.workunit.client.0.smithi134.stdout:1/426: readlink d5/d1a/l22 0 2024-02-16T22:18:54.770 INFO:tasks.workunit.client.0.smithi134.stdout:1/427: rename d5/c9 to d5/d1a/d53/d86/c8d 0 2024-02-16T22:18:54.770 INFO:tasks.workunit.client.0.smithi134.stdout:1/428: fdatasync d5/da/d2d/f84 0 2024-02-16T22:18:54.770 INFO:tasks.workunit.client.0.smithi134.stdout:8/426: write d2/df/f33 [2156651,54641] 0 2024-02-16T22:18:54.770 INFO:tasks.workunit.client.0.smithi134.stdout:8/427: fsync d2/df/d19/f28 0 2024-02-16T22:18:54.772 INFO:tasks.workunit.client.0.smithi134.stdout:1/429: symlink d5/da/d2d/l8e 0 2024-02-16T22:18:54.776 INFO:tasks.workunit.client.0.smithi134.stdout:1/430: rename d5/da/d2d/f34 to d5/d1a/d23/d85/f8f 0 2024-02-16T22:18:54.776 INFO:tasks.workunit.client.0.smithi134.stdout:1/431: chown d5/d1a/d23/d85 1109 1 2024-02-16T22:18:54.776 INFO:tasks.workunit.client.0.smithi134.stdout:1/432: fsync d5/d1a/d63/f69 0 2024-02-16T22:18:54.776 INFO:tasks.workunit.client.0.smithi134.stdout:1/433: write d5/d1a/d23/f43 [939414,92282] 0 2024-02-16T22:18:54.781 INFO:tasks.workunit.client.0.smithi134.stdout:8/428: dread d2/df/d18/d2a/d41/f42 [0,4194304] 0 2024-02-16T22:18:54.781 INFO:tasks.workunit.client.0.smithi134.stdout:4/347: dwrite d0/d6/d16/f28 [0,4194304] 0 2024-02-16T22:18:54.783 INFO:tasks.workunit.client.0.smithi134.stdout:6/460: dwrite d17/d27/d4f/d52/d79/f64 [0,4194304] 0 2024-02-16T22:18:54.785 INFO:tasks.workunit.client.0.smithi134.stdout:6/461: mknod d17/d36/d77/c8e 0 2024-02-16T22:18:54.785 INFO:tasks.workunit.client.0.smithi134.stdout:6/462: chown f11 53326 1 2024-02-16T22:18:54.785 INFO:tasks.workunit.client.0.smithi134.stdout:6/463: write d17/d22/d28/f81 [376057,62304] 0 2024-02-16T22:18:54.786 INFO:tasks.workunit.client.0.smithi134.stdout:6/464: truncate d17/d22/f4b 3389051 0 2024-02-16T22:18:54.786 INFO:tasks.workunit.client.0.smithi134.stdout:6/465: write d17/d27/d30/f8c [1842520,59721] 0 2024-02-16T22:18:54.788 INFO:tasks.workunit.client.0.smithi134.stdout:6/466: mknod d17/d22/d83/c8f 0 2024-02-16T22:18:54.789 INFO:tasks.workunit.client.0.smithi134.stdout:6/467: mkdir d17/d22/d28/d5b/d88/d90 0 2024-02-16T22:18:54.793 INFO:tasks.workunit.client.0.smithi134.stdout:1/434: write d5/da/f35 [3585691,118466] 0 2024-02-16T22:18:54.795 INFO:tasks.workunit.client.0.smithi134.stdout:4/348: write d0/d6/d16/d1a/f1d [4043998,40342] 0 2024-02-16T22:18:54.795 INFO:tasks.workunit.client.0.smithi134.stdout:4/349: write d0/d6/d22/d25/f72 [701281,76948] 0 2024-02-16T22:18:54.796 INFO:tasks.workunit.client.0.smithi134.stdout:1/435: rename d5/d1a/d4d/f76 to d5/f90 0 2024-02-16T22:18:54.802 INFO:tasks.workunit.client.0.smithi134.stdout:7/470: dwrite d2/f62 [0,4194304] 0 2024-02-16T22:18:54.804 INFO:tasks.workunit.client.0.smithi134.stdout:8/429: dread d2/f36 [0,4194304] 0 2024-02-16T22:18:54.804 INFO:tasks.workunit.client.0.smithi134.stdout:8/430: chown d2/df/d18/d2a/c32 31890 1 2024-02-16T22:18:54.805 INFO:tasks.workunit.client.0.smithi134.stdout:0/432: dwrite d2/d20/d50/f82 [4194304,4194304] 0 2024-02-16T22:18:54.806 INFO:tasks.workunit.client.0.smithi134.stdout:0/433: read d2/d20/f23 [714293,106182] 0 2024-02-16T22:18:54.810 INFO:tasks.workunit.client.0.smithi134.stdout:7/471: unlink d2/d5/d22/c3f 0 2024-02-16T22:18:54.810 INFO:tasks.workunit.client.0.smithi134.stdout:4/350: read d0/d6/d22/d25/f2d [1160414,40086] 0 2024-02-16T22:18:54.812 INFO:tasks.workunit.client.0.smithi134.stdout:8/431: write d2/df/d18/d12/f4e [1747234,57697] 0 2024-02-16T22:18:54.815 INFO:tasks.workunit.client.0.smithi134.stdout:0/434: read d2/f4e [4048387,55703] 0 2024-02-16T22:18:54.816 INFO:tasks.workunit.client.0.smithi134.stdout:4/351: mknod d0/d6/d1e/d39/c79 0 2024-02-16T22:18:54.816 INFO:tasks.workunit.client.0.smithi134.stdout:4/352: chown d0/d6/d1e/d39 257502 1 2024-02-16T22:18:54.817 INFO:tasks.workunit.client.0.smithi134.stdout:1/436: dwrite d5/d1a/d23/d3c/d6a/f51 [0,4194304] 0 2024-02-16T22:18:54.817 INFO:tasks.workunit.client.0.smithi134.stdout:1/437: fsync d5/da/d21/d52/f8b 0 2024-02-16T22:18:54.817 INFO:tasks.workunit.client.0.smithi134.stdout:8/432: symlink d2/df/d18/d5a/l89 0 2024-02-16T22:18:54.819 INFO:tasks.workunit.client.0.smithi134.stdout:0/435: link d2/d20/d50/c73 d2/d20/d7a/d7e/c91 0 2024-02-16T22:18:54.819 INFO:tasks.workunit.client.0.smithi134.stdout:0/436: write d2/d20/d7a/f86 [232293,104411] 0 2024-02-16T22:18:54.819 INFO:tasks.workunit.client.0.smithi134.stdout:0/437: write d2/d20/f29 [52346,54136] 0 2024-02-16T22:18:54.819 INFO:tasks.workunit.client.0.smithi134.stdout:0/438: fdatasync d2/f22 0 2024-02-16T22:18:54.819 INFO:tasks.workunit.client.0.smithi134.stdout:0/439: chown d2/dc/d48/f4c 1748 1 2024-02-16T22:18:54.821 INFO:tasks.workunit.client.0.smithi134.stdout:4/353: read d0/f11 [2454762,126556] 0 2024-02-16T22:18:54.823 INFO:tasks.workunit.client.0.smithi134.stdout:7/472: link d2/d6/d17/d31/l42 d2/d5/d22/d83/l9b 0 2024-02-16T22:18:54.824 INFO:tasks.workunit.client.0.smithi134.stdout:1/438: mknod d5/d1a/d82/c91 0 2024-02-16T22:18:54.824 INFO:tasks.workunit.client.0.smithi134.stdout:1/439: dread - d5/da/d2d/f50 zero size 2024-02-16T22:18:54.824 INFO:tasks.workunit.client.0.smithi134.stdout:1/440: write d5/f46 [87917,117295] 0 2024-02-16T22:18:54.825 INFO:tasks.workunit.client.0.smithi134.stdout:8/433: symlink d2/df/d18/d2a/l8a 0 2024-02-16T22:18:54.825 INFO:tasks.workunit.client.0.smithi134.stdout:8/434: chown d2/df/d18/d2a/d41/f4d 765 1 2024-02-16T22:18:54.830 INFO:tasks.workunit.client.0.smithi134.stdout:0/440: rename d2/d20/d50/c73 to d2/dc/d32/d3e/c92 0 2024-02-16T22:18:54.832 INFO:tasks.workunit.client.0.smithi134.stdout:4/354: symlink d0/d6/d8/d30/l7a 0 2024-02-16T22:18:54.837 INFO:tasks.workunit.client.0.smithi134.stdout:7/473: rename d2/d5/d22/d26/d48/d7f/f55 to d2/d5/d22/d83/f9c 0 2024-02-16T22:18:54.839 INFO:tasks.workunit.client.0.smithi134.stdout:7/474: write d2/d6/d17/f82 [627602,108050] 0 2024-02-16T22:18:54.839 INFO:tasks.workunit.client.0.smithi134.stdout:7/475: truncate d2/f8c 212031 0 2024-02-16T22:18:54.839 INFO:tasks.workunit.client.0.smithi134.stdout:7/476: chown d2/c45 1028684 1 2024-02-16T22:18:54.839 INFO:tasks.workunit.client.0.smithi134.stdout:4/355: symlink d0/d6/d22/d25/d2a/l7b 0 2024-02-16T22:18:54.839 INFO:tasks.workunit.client.0.smithi134.stdout:4/356: readlink d0/d6/d8/l5a 0 2024-02-16T22:18:54.839 INFO:tasks.workunit.client.0.smithi134.stdout:0/441: symlink d2/dc/d32/l93 0 2024-02-16T22:18:54.844 INFO:tasks.workunit.client.0.smithi134.stdout:7/477: getdents d2/d6/d7d 0 2024-02-16T22:18:54.846 INFO:tasks.workunit.client.0.smithi134.stdout:4/357: mkdir d0/d6/d1e/d7c 0 2024-02-16T22:18:54.847 INFO:tasks.workunit.client.0.smithi134.stdout:1/441: dwrite d5/da/d2d/f4f [0,4194304] 0 2024-02-16T22:18:54.848 INFO:tasks.workunit.client.0.smithi134.stdout:2/372: sync 2024-02-16T22:18:54.848 INFO:tasks.workunit.client.0.smithi134.stdout:2/373: creat df/d10/d15/d5a/d2d/f72 x:0 0 0 2024-02-16T22:18:54.850 INFO:tasks.workunit.client.0.smithi134.stdout:8/435: dwrite d2/df/d18/d2a/d41/f4d [4194304,4194304] 0 2024-02-16T22:18:54.850 INFO:tasks.workunit.client.0.smithi134.stdout:1/442: rmdir d5/d1a/d23 39 2024-02-16T22:18:54.855 INFO:tasks.workunit.client.0.smithi134.stdout:8/436: creat d2/f8b x:0 0 0 2024-02-16T22:18:54.858 INFO:tasks.workunit.client.0.smithi134.stdout:7/478: read d2/d5/d19/f1d [3617498,18890] 0 2024-02-16T22:18:54.867 INFO:tasks.workunit.client.0.smithi134.stdout:1/443: stat d5/da/d2d/c2e 0 2024-02-16T22:18:54.867 INFO:tasks.workunit.client.0.smithi134.stdout:0/442: dwrite d2/dc/d32/d3e/d5e/f6f [0,4194304] 0 2024-02-16T22:18:54.869 INFO:tasks.workunit.client.0.smithi134.stdout:8/437: mkdir d2/df/d18/d27/d85/d8c 0 2024-02-16T22:18:54.869 INFO:tasks.workunit.client.0.smithi134.stdout:8/438: readlink d2/df/d19/d40/l48 0 2024-02-16T22:18:54.871 INFO:tasks.workunit.client.0.smithi134.stdout:1/444: link d5/da/d21/f80 d5/d1a/d63/f92 0 2024-02-16T22:18:54.873 INFO:tasks.workunit.client.0.smithi134.stdout:4/358: dwrite d0/d6/d8/d32/d63/f65 [0,4194304] 0 2024-02-16T22:18:54.873 INFO:tasks.workunit.client.0.smithi134.stdout:2/374: dwrite df/d10/d30/d49/f54 [0,4194304] 0 2024-02-16T22:18:54.875 INFO:tasks.workunit.client.0.smithi134.stdout:8/439: mkdir d2/df/d19/d8d 0 2024-02-16T22:18:54.876 INFO:tasks.workunit.client.0.smithi134.stdout:1/445: truncate f1 242115 0 2024-02-16T22:18:54.885 INFO:tasks.workunit.client.0.smithi134.stdout:4/359: creat d0/d6/d8/d5e/f7d x:0 0 0 2024-02-16T22:18:54.885 INFO:tasks.workunit.client.0.smithi134.stdout:4/360: creat d0/d6/d8/d30/f7e x:0 0 0 2024-02-16T22:18:54.885 INFO:tasks.workunit.client.0.smithi134.stdout:4/361: chown d0/f15 881183 1 2024-02-16T22:18:54.885 INFO:tasks.workunit.client.0.smithi134.stdout:0/443: dwrite d2/dc/d32/d3e/f69 [0,4194304] 0 2024-02-16T22:18:54.887 INFO:tasks.workunit.client.0.smithi134.stdout:2/375: mknod df/d10/d15/d5a/d17/c73 0 2024-02-16T22:18:54.887 INFO:tasks.workunit.client.0.smithi134.stdout:2/376: dread - df/d10/f47 zero size 2024-02-16T22:18:54.888 INFO:tasks.workunit.client.0.smithi134.stdout:8/440: creat d2/df/d19/d40/f8e x:0 0 0 2024-02-16T22:18:54.890 INFO:tasks.workunit.client.0.smithi134.stdout:4/362: symlink d0/d6/d5d/l7f 0 2024-02-16T22:18:54.891 INFO:tasks.workunit.client.0.smithi134.stdout:1/446: write d5/f24 [2930874,19842] 0 2024-02-16T22:18:54.893 INFO:tasks.workunit.client.0.smithi134.stdout:9/506: sync 2024-02-16T22:18:54.894 INFO:tasks.workunit.client.0.smithi134.stdout:2/377: rename cd to df/d10/d30/c74 0 2024-02-16T22:18:54.897 INFO:tasks.workunit.client.0.smithi134.stdout:9/507: truncate f2 195848 0 2024-02-16T22:18:54.899 INFO:tasks.workunit.client.0.smithi134.stdout:8/441: rename d2/df/f3b to d2/d80/f8f 0 2024-02-16T22:18:54.899 INFO:tasks.workunit.client.0.smithi134.stdout:8/442: fsync d2/df/d18/f6 0 2024-02-16T22:18:54.899 INFO:tasks.workunit.client.0.smithi134.stdout:8/443: chown d2/df/d18/d27/f30 0 1 2024-02-16T22:18:54.899 INFO:tasks.workunit.client.0.smithi134.stdout:8/444: fdatasync d2/f2c 0 2024-02-16T22:18:54.901 INFO:tasks.workunit.client.0.smithi134.stdout:8/445: mkdir d2/df/d18/d2a/d41/d61/d90 0 2024-02-16T22:18:54.901 INFO:tasks.workunit.client.0.smithi134.stdout:8/446: fdatasync d2/df/d19/f28 0 2024-02-16T22:18:54.905 INFO:tasks.workunit.client.0.smithi134.stdout:8/447: mkdir d2/df/d18/d91 0 2024-02-16T22:18:54.907 INFO:tasks.workunit.client.0.smithi134.stdout:2/378: dread df/f51 [0,4194304] 0 2024-02-16T22:18:54.911 INFO:tasks.workunit.client.0.smithi134.stdout:2/379: mknod df/d10/d30/c75 0 2024-02-16T22:18:54.923 INFO:tasks.workunit.client.0.smithi134.stdout:4/363: dwrite d0/d6/f24 [0,4194304] 0 2024-02-16T22:18:54.923 INFO:tasks.workunit.client.0.smithi134.stdout:4/364: readlink d0/lb 0 2024-02-16T22:18:54.925 INFO:tasks.workunit.client.0.smithi134.stdout:4/365: creat d0/d6/d5d/f80 x:0 0 0 2024-02-16T22:18:54.925 INFO:tasks.workunit.client.0.smithi134.stdout:4/366: truncate d0/f2 4265776 0 2024-02-16T22:18:54.926 INFO:tasks.workunit.client.0.smithi134.stdout:4/367: mknod d0/d6/d16/d46/c81 0 2024-02-16T22:18:54.932 INFO:tasks.workunit.client.0.smithi134.stdout:1/447: dwrite d5/d1a/d23/f20 [8388608,4194304] 0 2024-02-16T22:18:54.933 INFO:tasks.workunit.client.0.smithi134.stdout:0/444: dwrite d2/dc/f7c [0,4194304] 0 2024-02-16T22:18:54.933 INFO:tasks.workunit.client.0.smithi134.stdout:0/445: dread - d2/dc/d2d/d34/f61 zero size 2024-02-16T22:18:54.934 INFO:tasks.workunit.client.0.smithi134.stdout:0/446: write d2/dc/ff [4829919,127434] 0 2024-02-16T22:18:54.936 INFO:tasks.workunit.client.0.smithi134.stdout:8/448: dwrite d2/df/d19/f28 [0,4194304] 0 2024-02-16T22:18:54.937 INFO:tasks.workunit.client.0.smithi134.stdout:8/449: readlink d2/df/d19/d40/l48 0 2024-02-16T22:18:54.937 INFO:tasks.workunit.client.0.smithi134.stdout:8/450: chown d2/df/d18/d12/l52 324355 1 2024-02-16T22:18:54.938 INFO:tasks.workunit.client.0.smithi134.stdout:0/447: mkdir d2/d20/d77/d85/d94 0 2024-02-16T22:18:54.939 INFO:tasks.workunit.client.0.smithi134.stdout:0/448: symlink d2/d4b/d53/l95 0 2024-02-16T22:18:54.939 INFO:tasks.workunit.client.0.smithi134.stdout:1/448: dread d5/da/f1d [0,4194304] 0 2024-02-16T22:18:54.939 INFO:tasks.workunit.client.0.smithi134.stdout:1/449: readlink d5/d1a/l73 0 2024-02-16T22:18:54.940 INFO:tasks.workunit.client.0.smithi134.stdout:9/508: dwrite db/d20/d22/f35 [4194304,4194304] 0 2024-02-16T22:18:54.940 INFO:tasks.workunit.client.0.smithi134.stdout:0/449: mknod d2/d20/d7a/d65/c96 0 2024-02-16T22:18:54.949 INFO:tasks.workunit.client.0.smithi134.stdout:9/509: mkdir db/d20/d55/da9 0 2024-02-16T22:18:54.950 INFO:tasks.workunit.client.0.smithi134.stdout:2/380: dwrite df/d10/d3a/f50 [0,4194304] 0 2024-02-16T22:18:54.950 INFO:tasks.workunit.client.0.smithi134.stdout:2/381: write f2 [5089364,93343] 0 2024-02-16T22:18:54.950 INFO:tasks.workunit.client.0.smithi134.stdout:4/368: dwrite d0/d6/d1e/f27 [0,4194304] 0 2024-02-16T22:18:54.950 INFO:tasks.workunit.client.0.smithi134.stdout:4/369: stat d0/d6/d22/d25 0 2024-02-16T22:18:54.950 INFO:tasks.workunit.client.0.smithi134.stdout:4/370: write d0/d6/d1e/d39/f45 [14302,16503] 0 2024-02-16T22:18:54.951 INFO:tasks.workunit.client.0.smithi134.stdout:0/450: mkdir d2/dc/d97 0 2024-02-16T22:18:54.951 INFO:tasks.workunit.client.0.smithi134.stdout:0/451: chown d2/dc/d32/d45/l5a 685993 1 2024-02-16T22:18:54.953 INFO:tasks.workunit.client.0.smithi134.stdout:9/510: creat db/d20/d22/d91/d99/faa x:0 0 0 2024-02-16T22:18:54.956 INFO:tasks.workunit.client.0.smithi134.stdout:8/451: dwrite d2/df/d18/d2a/f2b [0,4194304] 0 2024-02-16T22:18:54.958 INFO:tasks.workunit.client.0.smithi134.stdout:2/382: symlink df/d10/d15/d5a/d2d/l76 0 2024-02-16T22:18:54.960 INFO:tasks.workunit.client.0.smithi134.stdout:4/371: creat d0/d6/d1e/d7c/f82 x:0 0 0 2024-02-16T22:18:54.961 INFO:tasks.workunit.client.0.smithi134.stdout:0/452: symlink d2/d20/d7a/d7e/l98 0 2024-02-16T22:18:54.962 INFO:tasks.workunit.client.0.smithi134.stdout:1/450: rename d5/da/d21/d52/d5b to d5/da/d21/d45/d93 0 2024-02-16T22:18:54.963 INFO:tasks.workunit.client.0.smithi134.stdout:9/511: mknod db/d20/d22/d64/d69/d6e/cab 0 2024-02-16T22:18:54.963 INFO:tasks.workunit.client.0.smithi134.stdout:8/452: rmdir d2/df/d18 39 2024-02-16T22:18:54.963 INFO:tasks.workunit.client.0.smithi134.stdout:8/453: creat d2/df/d18/d12/f92 x:0 0 0 2024-02-16T22:18:54.966 INFO:tasks.workunit.client.0.smithi134.stdout:4/372: link d0/d6/d5d/f80 d0/d6/d8/d32/d63/d6c/f83 0 2024-02-16T22:18:54.966 INFO:tasks.workunit.client.0.smithi134.stdout:4/373: chown d0/d6/d8/d32/d63/d6c/c12 1 1 2024-02-16T22:18:54.966 INFO:tasks.workunit.client.0.smithi134.stdout:4/374: chown d0/d6/d58/c74 701 1 2024-02-16T22:18:54.967 INFO:tasks.workunit.client.0.smithi134.stdout:1/451: creat d5/da/d1c/f94 x:0 0 0 2024-02-16T22:18:54.968 INFO:tasks.workunit.client.0.smithi134.stdout:0/453: dread d2/dc/d48/f57 [0,4194304] 0 2024-02-16T22:18:54.968 INFO:tasks.workunit.client.0.smithi134.stdout:0/454: chown d2/dc/d48/f75 388 1 2024-02-16T22:18:54.968 INFO:tasks.workunit.client.0.smithi134.stdout:0/455: stat d2/dc/ff 0 2024-02-16T22:18:54.969 INFO:tasks.workunit.client.0.smithi134.stdout:9/512: creat db/d20/d9a/fac x:0 0 0 2024-02-16T22:18:54.970 INFO:tasks.workunit.client.0.smithi134.stdout:2/383: getdents df/d10/d15/d5a 0 2024-02-16T22:18:54.971 INFO:tasks.workunit.client.0.smithi134.stdout:0/456: dread d2/dc/d48/f57 [0,4194304] 0 2024-02-16T22:18:54.972 INFO:tasks.workunit.client.0.smithi134.stdout:4/375: link d0/d6/d16/d1a/l4f d0/d6/d8/d5e/l84 0 2024-02-16T22:18:54.973 INFO:tasks.workunit.client.0.smithi134.stdout:8/454: write d2/df/d18/f6 [141456,95849] 0 2024-02-16T22:18:54.973 INFO:tasks.workunit.client.0.smithi134.stdout:8/455: write d2/f35 [2508008,37834] 0 2024-02-16T22:18:54.973 INFO:tasks.workunit.client.0.smithi134.stdout:8/456: creat d2/df/d19/f93 x:0 0 0 2024-02-16T22:18:54.973 INFO:tasks.workunit.client.0.smithi134.stdout:1/452: symlink d5/da/d1c/l95 0 2024-02-16T22:18:54.974 INFO:tasks.workunit.client.0.smithi134.stdout:9/513: creat db/d20/d22/d51/fad x:0 0 0 2024-02-16T22:18:54.975 INFO:tasks.workunit.client.0.smithi134.stdout:9/514: stat db/d20/d22/d51/fad 0 2024-02-16T22:18:54.975 INFO:tasks.workunit.client.0.smithi134.stdout:1/453: dread d5/d1a/d23/f2b [0,4194304] 0 2024-02-16T22:18:54.976 INFO:tasks.workunit.client.0.smithi134.stdout:1/454: write d5/d1a/d23/f39 [1542813,93384] 0 2024-02-16T22:18:54.976 INFO:tasks.workunit.client.0.smithi134.stdout:9/515: write db/dc/f54 [306664,91885] 0 2024-02-16T22:18:54.976 INFO:tasks.workunit.client.0.smithi134.stdout:0/457: creat d2/d20/d77/d85/f99 x:0 0 0 2024-02-16T22:18:54.977 INFO:tasks.workunit.client.0.smithi134.stdout:4/376: getdents d0/d6/d8/d32 0 2024-02-16T22:18:54.982 INFO:tasks.workunit.client.0.smithi134.stdout:2/384: dread df/d10/d3a/f50 [0,4194304] 0 2024-02-16T22:18:54.982 INFO:tasks.workunit.client.0.smithi134.stdout:2/385: fdatasync df/f3c 0 2024-02-16T22:18:54.982 INFO:tasks.workunit.client.0.smithi134.stdout:3/463: sync 2024-02-16T22:18:54.982 INFO:tasks.workunit.client.0.smithi134.stdout:7/479: sync 2024-02-16T22:18:54.982 INFO:tasks.workunit.client.0.smithi134.stdout:6/468: sync 2024-02-16T22:18:54.982 INFO:tasks.workunit.client.0.smithi134.stdout:5/482: sync 2024-02-16T22:18:54.983 INFO:tasks.workunit.client.0.smithi134.stdout:7/480: stat d2/d5/d22/d26/d48/d7f/l37 0 2024-02-16T22:18:54.983 INFO:tasks.workunit.client.0.smithi134.stdout:5/483: creat d2/d35/d36/d3d/f9f x:0 0 0 2024-02-16T22:18:54.983 INFO:tasks.workunit.client.0.smithi134.stdout:6/469: write d17/d27/d4f/f68 [1632164,115601] 0 2024-02-16T22:18:54.983 INFO:tasks.workunit.client.0.smithi134.stdout:0/458: creat d2/d20/d50/f9a x:0 0 0 2024-02-16T22:18:54.984 INFO:tasks.workunit.client.0.smithi134.stdout:4/377: creat d0/d6/d1e/d39/f85 x:0 0 0 2024-02-16T22:18:54.986 INFO:tasks.workunit.client.0.smithi134.stdout:2/386: link df/d10/d15/d5a/d2d/f72 df/d10/d30/f77 0 2024-02-16T22:18:54.987 INFO:tasks.workunit.client.0.smithi134.stdout:3/464: mkdir da/d1c/d24/d29/d40/d8a/d8f/d6d/d97 0 2024-02-16T22:18:54.987 INFO:tasks.workunit.client.0.smithi134.stdout:3/465: readlink da/d1c/d24/d29/d51/d79/l7d 0 2024-02-16T22:18:54.989 INFO:tasks.workunit.client.0.smithi134.stdout:0/459: read d2/f6c [213504,115694] 0 2024-02-16T22:18:54.989 INFO:tasks.workunit.client.0.smithi134.stdout:7/481: mkdir d2/d5/d19/d4a/d9d 0 2024-02-16T22:18:54.990 INFO:tasks.workunit.client.0.smithi134.stdout:5/484: mknod d2/d35/d36/d3d/ca0 0 2024-02-16T22:18:54.990 INFO:tasks.workunit.client.0.smithi134.stdout:5/485: fsync d2/d35/d36/d3d/d9c/f2c 0 2024-02-16T22:18:54.991 INFO:tasks.workunit.client.0.smithi134.stdout:5/486: chown d2/d35/d72 2 1 2024-02-16T22:18:54.991 INFO:tasks.workunit.client.0.smithi134.stdout:6/470: unlink d17/d36/d77/c8e 0 2024-02-16T22:18:54.991 INFO:tasks.workunit.client.0.smithi134.stdout:6/471: chown d17/d22/d28/c89 439499194 1 2024-02-16T22:18:54.992 INFO:tasks.workunit.client.0.smithi134.stdout:3/466: link c0 da/d1c/d24/d29/d51/d80/d90/c98 0 2024-02-16T22:18:54.992 INFO:tasks.workunit.client.0.smithi134.stdout:0/460: rmdir d2/d20/d77 39 2024-02-16T22:18:54.993 INFO:tasks.workunit.client.0.smithi134.stdout:7/482: dread d2/d6/f43 [0,4194304] 0 2024-02-16T22:18:54.994 INFO:tasks.workunit.client.0.smithi134.stdout:9/516: write db/d20/d22/f44 [2120135,120359] 0 2024-02-16T22:18:54.995 INFO:tasks.workunit.client.0.smithi134.stdout:4/378: read d0/d6/d8/d32/d63/d6c/f3e [8365894,20711] 0 2024-02-16T22:18:54.995 INFO:tasks.workunit.client.0.smithi134.stdout:4/379: chown d0/d6/d8/d32/d63/d6c/f83 62 1 2024-02-16T22:18:54.997 INFO:tasks.workunit.client.0.smithi134.stdout:1/455: dwrite d5/da/d21/d45/f7b [0,4194304] 0 2024-02-16T22:18:54.998 INFO:tasks.workunit.client.0.smithi134.stdout:8/457: dwrite d2/df/f6e [0,4194304] 0 2024-02-16T22:18:55.046 INFO:tasks.workunit.client.0.smithi134.stdout:6/472: link d17/d22/f29 d17/d22/d28/d5b/f91 0 2024-02-16T22:18:55.047 INFO:tasks.workunit.client.0.smithi134.stdout:0/461: link d2/d20/f29 d2/d20/d50/f9b 0 2024-02-16T22:18:55.047 INFO:tasks.workunit.client.0.smithi134.stdout:7/483: mkdir d2/d6/d7d/d9e 0 2024-02-16T22:18:55.049 INFO:tasks.workunit.client.0.smithi134.stdout:4/380: mkdir d0/d6/d16/d86 0 2024-02-16T22:18:55.049 INFO:tasks.workunit.client.0.smithi134.stdout:4/381: creat d0/d31/f87 x:0 0 0 2024-02-16T22:18:55.049 INFO:tasks.workunit.client.0.smithi134.stdout:9/517: write db/d20/d22/d64/f8d [1813472,116113] 0 2024-02-16T22:18:55.050 INFO:tasks.workunit.client.0.smithi134.stdout:1/456: creat d5/d1a/d23/d3c/d6a/d5c/d72/f96 x:0 0 0 2024-02-16T22:18:55.055 INFO:tasks.workunit.client.0.smithi134.stdout:5/487: rename d2/d9/dc/d32/d89 to d2/d35/d36/da1 0 2024-02-16T22:18:55.056 INFO:tasks.workunit.client.0.smithi134.stdout:8/458: rename d2/df/d19/d40 to d2/df/d19/d40/d94 22 2024-02-16T22:18:55.056 INFO:tasks.workunit.client.0.smithi134.stdout:5/488: readlink d2/d35/d36/d3d/d9c/d4b/l83 0 2024-02-16T22:18:55.056 INFO:tasks.workunit.client.0.smithi134.stdout:5/489: creat d2/d35/d36/d3d/d63/fa2 x:0 0 0 2024-02-16T22:18:55.056 INFO:tasks.workunit.client.0.smithi134.stdout:5/490: creat d2/d35/d36/d3d/fa3 x:0 0 0 2024-02-16T22:18:55.056 INFO:tasks.workunit.client.0.smithi134.stdout:5/491: chown d2/d35/d36/d46/c5f 2821069 1 2024-02-16T22:18:55.057 INFO:tasks.workunit.client.0.smithi134.stdout:6/473: mkdir d17/d27/d4f/d52/d79/d92 0 2024-02-16T22:18:55.059 INFO:tasks.workunit.client.0.smithi134.stdout:0/462: symlink d2/d20/d7a/l9c 0 2024-02-16T22:18:55.067 INFO:tasks.workunit.client.0.smithi134.stdout:9/518: mknod db/d20/d55/cae 0 2024-02-16T22:18:55.067 INFO:tasks.workunit.client.0.smithi134.stdout:0/463: dread d2/dc/ff [0,4194304] 0 2024-02-16T22:18:55.069 INFO:tasks.workunit.client.0.smithi134.stdout:8/459: mknod d2/df/d19/d40/d53/c95 0 2024-02-16T22:18:55.069 INFO:tasks.workunit.client.0.smithi134.stdout:8/460: write d2/f24 [3579728,16713] 0 2024-02-16T22:18:55.069 INFO:tasks.workunit.client.0.smithi134.stdout:8/461: write d2/df/d18/d2a/d41/d59/f84 [123823,126161] 0 2024-02-16T22:18:55.072 INFO:tasks.workunit.client.0.smithi134.stdout:6/474: mkdir d17/d27/d93 0 2024-02-16T22:18:55.073 INFO:tasks.workunit.client.0.smithi134.stdout:1/457: dwrite d5/da/d21/d45/f8a [0,4194304] 0 2024-02-16T22:18:55.073 INFO:tasks.workunit.client.0.smithi134.stdout:5/492: dwrite d2/f50 [0,4194304] 0 2024-02-16T22:18:55.074 INFO:tasks.workunit.client.0.smithi134.stdout:7/484: rmdir d2/d5/d22/d26/d48 39 2024-02-16T22:18:55.079 INFO:tasks.workunit.client.0.smithi134.stdout:4/382: unlink d0/d6/d16/d1a/l29 0 2024-02-16T22:18:55.079 INFO:tasks.workunit.client.0.smithi134.stdout:4/383: dread - d0/d6/d1e/d39/f66 zero size 2024-02-16T22:18:55.080 INFO:tasks.workunit.client.0.smithi134.stdout:9/519: chown ca 16260179 1 2024-02-16T22:18:55.082 INFO:tasks.workunit.client.0.smithi134.stdout:0/464: mknod d2/dc/c9d 0 2024-02-16T22:18:55.084 INFO:tasks.workunit.client.0.smithi134.stdout:8/462: unlink d2/df/d18/d2a/c6d 0 2024-02-16T22:18:55.085 INFO:tasks.workunit.client.0.smithi134.stdout:5/493: write d2/f50 [1474337,111461] 0 2024-02-16T22:18:55.086 INFO:tasks.workunit.client.0.smithi134.stdout:6/475: mknod d17/d27/d4f/c94 0 2024-02-16T22:18:55.086 INFO:tasks.workunit.client.0.smithi134.stdout:6/476: readlink d17/d22/d28/d5b/l72 0 2024-02-16T22:18:55.089 INFO:tasks.workunit.client.0.smithi134.stdout:1/458: dwrite d5/d1a/f62 [0,4194304] 0 2024-02-16T22:18:55.095 INFO:tasks.workunit.client.0.smithi134.stdout:7/485: creat d2/d5/d22/d26/d48/f9f x:0 0 0 2024-02-16T22:18:55.095 INFO:tasks.workunit.client.0.smithi134.stdout:7/486: write d2/d6/f16 [5141690,33234] 0 2024-02-16T22:18:55.096 INFO:tasks.workunit.client.0.smithi134.stdout:4/384: symlink d0/d6/d8/d32/d68/l88 0 2024-02-16T22:18:55.096 INFO:tasks.workunit.client.0.smithi134.stdout:7/487: dread d2/d5/d22/f66 [0,4194304] 0 2024-02-16T22:18:55.096 INFO:tasks.workunit.client.0.smithi134.stdout:7/488: write d2/d5/d22/d26/d48/f9f [241506,97152] 0 2024-02-16T22:18:55.098 INFO:tasks.workunit.client.0.smithi134.stdout:9/520: rename db/d20/d22/d64/d69/d6e/d81/c95 to db/d20/d22/d64/d69/caf 0 2024-02-16T22:18:55.098 INFO:tasks.workunit.client.0.smithi134.stdout:9/521: chown db/d20/d22/d51/f65 64886230 1 2024-02-16T22:18:55.099 INFO:tasks.workunit.client.0.smithi134.stdout:0/465: symlink d2/dc/d97/l9e 0 2024-02-16T22:18:55.100 INFO:tasks.workunit.client.0.smithi134.stdout:0/466: dread d2/dc/d48/f75 [0,4194304] 0 2024-02-16T22:18:55.101 INFO:tasks.workunit.client.0.smithi134.stdout:9/522: dread f2 [0,4194304] 0 2024-02-16T22:18:55.101 INFO:tasks.workunit.client.0.smithi134.stdout:9/523: fsync db/d20/d22/d51/f7b 0 2024-02-16T22:18:55.101 INFO:tasks.workunit.client.0.smithi134.stdout:8/463: link d2/f2c d2/df/d18/d27/d85/f96 0 2024-02-16T22:18:55.101 INFO:tasks.workunit.client.0.smithi134.stdout:5/494: creat d2/d8f/fa4 x:0 0 0 2024-02-16T22:18:55.103 INFO:tasks.workunit.client.0.smithi134.stdout:6/477: mknod d17/d27/d93/c95 0 2024-02-16T22:18:55.103 INFO:tasks.workunit.client.0.smithi134.stdout:1/459: dwrite d5/f46 [0,4194304] 0 2024-02-16T22:18:55.103 INFO:tasks.workunit.client.0.smithi134.stdout:1/460: fsync d5/da/d21/d45/d93/f5e 0 2024-02-16T22:18:55.103 INFO:tasks.workunit.client.0.smithi134.stdout:5/495: dread d2/d9/dc/f38 [0,4194304] 0 2024-02-16T22:18:55.106 INFO:tasks.workunit.client.0.smithi134.stdout:4/385: symlink d0/d6/d8/d5e/l89 0 2024-02-16T22:18:55.108 INFO:tasks.workunit.client.0.smithi134.stdout:7/489: creat d2/d5/d19/d84/d86/fa0 x:0 0 0 2024-02-16T22:18:55.108 INFO:tasks.workunit.client.0.smithi134.stdout:6/478: write d17/f42 [4044048,55090] 0 2024-02-16T22:18:55.108 INFO:tasks.workunit.client.0.smithi134.stdout:6/479: chown d17/d36/f7a 327 1 2024-02-16T22:18:55.108 INFO:tasks.workunit.client.0.smithi134.stdout:6/480: write d17/f1c [1482702,96668] 0 2024-02-16T22:18:55.108 INFO:tasks.workunit.client.0.smithi134.stdout:6/481: creat d17/d22/d28/f96 x:0 0 0 2024-02-16T22:18:55.109 INFO:tasks.workunit.client.0.smithi134.stdout:0/467: symlink d2/d20/d7a/l9f 0 2024-02-16T22:18:55.110 INFO:tasks.workunit.client.0.smithi134.stdout:0/468: chown d2/f1c 14495 1 2024-02-16T22:18:55.110 INFO:tasks.workunit.client.0.smithi134.stdout:7/490: dread d2/d6/f70 [0,4194304] 0 2024-02-16T22:18:55.110 INFO:tasks.workunit.client.0.smithi134.stdout:9/524: mkdir db/d20/d22/d64/db0 0 2024-02-16T22:18:55.111 INFO:tasks.workunit.client.0.smithi134.stdout:9/525: write db/f33 [1875103,104268] 0 2024-02-16T22:18:55.111 INFO:tasks.workunit.client.0.smithi134.stdout:9/526: dread - db/d20/d22/d51/f65 zero size 2024-02-16T22:18:55.113 INFO:tasks.workunit.client.0.smithi134.stdout:0/469: dread d2/f11 [0,4194304] 0 2024-02-16T22:18:55.113 INFO:tasks.workunit.client.0.smithi134.stdout:8/464: rename d2/df/d18/d27/l46 to d2/df/d19/d40/d53/d5e/l97 0 2024-02-16T22:18:55.113 INFO:tasks.workunit.client.0.smithi134.stdout:8/465: fsync d2/d80/f8f 0 2024-02-16T22:18:55.113 INFO:tasks.workunit.client.0.smithi134.stdout:8/466: write d2/df/d18/d2a/d41/d59/f84 [412133,127093] 0 2024-02-16T22:18:55.119 INFO:tasks.workunit.client.0.smithi134.stdout:6/482: write f11 [1603770,128948] 0 2024-02-16T22:18:55.119 INFO:tasks.workunit.client.0.smithi134.stdout:1/461: creat d5/d1a/d82/f97 x:0 0 0 2024-02-16T22:18:55.119 INFO:tasks.workunit.client.0.smithi134.stdout:6/483: chown d17/d27/d30/l5a 31432738 1 2024-02-16T22:18:55.121 INFO:tasks.workunit.client.0.smithi134.stdout:7/491: mknod d2/d6/d17/d25/ca1 0 2024-02-16T22:18:55.121 INFO:tasks.workunit.client.0.smithi134.stdout:7/492: chown d2/d6/f16 32095537 1 2024-02-16T22:18:55.122 INFO:tasks.workunit.client.0.smithi134.stdout:9/527: mknod db/d20/d22/d64/d69/cb1 0 2024-02-16T22:18:55.122 INFO:tasks.workunit.client.0.smithi134.stdout:9/528: readlink db/l82 0 2024-02-16T22:18:55.123 INFO:tasks.workunit.client.0.smithi134.stdout:9/529: truncate db/dc/f54 1834649 0 2024-02-16T22:18:55.123 INFO:tasks.workunit.client.0.smithi134.stdout:0/470: mkdir d2/dc/da0 0 2024-02-16T22:18:55.125 INFO:tasks.workunit.client.0.smithi134.stdout:5/496: rename d2/l1c to d2/d9/dc/d15/la5 0 2024-02-16T22:18:55.126 INFO:tasks.workunit.client.0.smithi134.stdout:5/497: chown d2/d35/d36/d3d/fa3 1186 1 2024-02-16T22:18:55.127 INFO:tasks.workunit.client.0.smithi134.stdout:1/462: mkdir d5/da/d21/d45/d93/d98 0 2024-02-16T22:18:55.128 INFO:tasks.workunit.client.0.smithi134.stdout:7/493: getdents d2/d6/d17/d25/d63 0 2024-02-16T22:18:55.128 INFO:tasks.workunit.client.0.smithi134.stdout:7/494: write d2/d6/d17/d25/d63/f60 [2087741,14562] 0 2024-02-16T22:18:55.130 INFO:tasks.workunit.client.0.smithi134.stdout:9/530: mknod db/d20/d22/d91/d99/cb2 0 2024-02-16T22:18:55.130 INFO:tasks.workunit.client.0.smithi134.stdout:9/531: chown db/d20/f9f 203220733 1 2024-02-16T22:18:55.130 INFO:tasks.workunit.client.0.smithi134.stdout:9/532: fsync db/d20/d22/d64/d69/f98 0 2024-02-16T22:18:55.130 INFO:tasks.workunit.client.0.smithi134.stdout:9/533: chown db/d20/d22/d51/fad 6220 1 2024-02-16T22:18:55.130 INFO:tasks.workunit.client.0.smithi134.stdout:9/534: creat db/d20/d22/d46/fb3 x:0 0 0 2024-02-16T22:18:55.131 INFO:tasks.workunit.client.0.smithi134.stdout:9/535: dread - db/fa3 zero size 2024-02-16T22:18:55.131 INFO:tasks.workunit.client.0.smithi134.stdout:6/484: dread d17/f2d [0,4194304] 0 2024-02-16T22:18:55.132 INFO:tasks.workunit.client.0.smithi134.stdout:5/498: creat d2/d35/d36/d3d/d63/d90/fa6 x:0 0 0 2024-02-16T22:18:55.132 INFO:tasks.workunit.client.0.smithi134.stdout:5/499: fdatasync d2/d9/dc/d15/f3b 0 2024-02-16T22:18:55.132 INFO:tasks.workunit.client.0.smithi134.stdout:5/500: dread - d2/d99/f9e zero size 2024-02-16T22:18:55.133 INFO:tasks.workunit.client.0.smithi134.stdout:8/467: dwrite d2/df/d18/d2a/d41/d61/d87/f7a [0,4194304] 0 2024-02-16T22:18:55.133 INFO:tasks.workunit.client.0.smithi134.stdout:8/468: fdatasync d2/f25 0 2024-02-16T22:18:55.133 INFO:tasks.workunit.client.0.smithi134.stdout:3/467: sync 2024-02-16T22:18:55.133 INFO:tasks.workunit.client.0.smithi134.stdout:2/387: sync 2024-02-16T22:18:55.136 INFO:tasks.workunit.client.0.smithi134.stdout:4/386: dwrite d0/d6/d5d/f80 [0,4194304] 0 2024-02-16T22:18:55.136 INFO:tasks.workunit.client.0.smithi134.stdout:4/387: dread - d0/d6/d8/d5e/f7d zero size 2024-02-16T22:18:55.136 INFO:tasks.workunit.client.0.smithi134.stdout:4/388: readlink d0/d6/d8/ld 0 2024-02-16T22:18:55.136 INFO:tasks.workunit.client.0.smithi134.stdout:4/389: write d0/d6/d8/d32/d63/d6c/f49 [134524,23388] 0 2024-02-16T22:18:55.138 INFO:tasks.workunit.client.0.smithi134.stdout:1/463: write d5/d1a/d23/f20 [9343039,120554] 0 2024-02-16T22:18:55.143 INFO:tasks.workunit.client.0.smithi134.stdout:9/536: write db/f57 [801387,100434] 0 2024-02-16T22:18:55.143 INFO:tasks.workunit.client.0.smithi134.stdout:2/388: mknod df/d10/c78 0 2024-02-16T22:18:55.143 INFO:tasks.workunit.client.0.smithi134.stdout:2/389: chown df/d10/d15/d5a/d34 2623266 1 2024-02-16T22:18:55.144 INFO:tasks.workunit.client.0.smithi134.stdout:6/485: dread d17/d27/d4f/f59 [0,4194304] 0 2024-02-16T22:18:55.144 INFO:tasks.workunit.client.0.smithi134.stdout:6/486: dread - d17/f7f zero size 2024-02-16T22:18:55.144 INFO:tasks.workunit.client.0.smithi134.stdout:6/487: readlink d17/d27/d4f/d52/d79/l53 0 2024-02-16T22:18:55.150 INFO:tasks.workunit.client.0.smithi134.stdout:7/495: dread d2/d5/d22/d26/d48/d7f/f61 [0,4194304] 0 2024-02-16T22:18:55.150 INFO:tasks.workunit.client.0.smithi134.stdout:7/496: read d2/d6/d17/d25/f2a [1532440,11840] 0 2024-02-16T22:18:55.150 INFO:tasks.workunit.client.0.smithi134.stdout:7/497: creat d2/d5/d22/d26/d48/fa2 x:0 0 0 2024-02-16T22:18:55.151 INFO:tasks.workunit.client.0.smithi134.stdout:1/464: mkdir d5/d1a/d4d/d99 0 2024-02-16T22:18:55.151 INFO:tasks.workunit.client.0.smithi134.stdout:1/465: fdatasync d5/d1a/d82/f97 0 2024-02-16T22:18:55.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/537: symlink db/d20/d22/d64/d69/lb4 0 2024-02-16T22:18:55.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/538: read db/dc/f16 [650483,66679] 0 2024-02-16T22:18:55.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/539: creat db/d20/d22/d51/fb5 x:0 0 0 2024-02-16T22:18:55.155 INFO:tasks.workunit.client.0.smithi134.stdout:6/488: mkdir d17/d27/d4f/d52/d97 0 2024-02-16T22:18:55.155 INFO:tasks.workunit.client.0.smithi134.stdout:4/390: dread d0/f11 [0,4194304] 0 2024-02-16T22:18:55.155 INFO:tasks.workunit.client.0.smithi134.stdout:4/391: write d0/d6/d22/d25/f3d [864635,51915] 0 2024-02-16T22:18:55.155 INFO:tasks.workunit.client.0.smithi134.stdout:4/392: fsync d0/d6/d22/d25/f2d 0 2024-02-16T22:18:55.158 INFO:tasks.workunit.client.0.smithi134.stdout:7/498: dread d2/d5/d4c/f4d [0,4194304] 0 2024-02-16T22:18:55.158 INFO:tasks.workunit.client.0.smithi134.stdout:7/499: readlink d2/d6/d17/d25/d63/l98 0 2024-02-16T22:18:55.159 INFO:tasks.workunit.client.0.smithi134.stdout:2/390: dread df/d10/d15/f16 [0,4194304] 0 2024-02-16T22:18:55.159 INFO:tasks.workunit.client.0.smithi134.stdout:2/391: read - df/d10/d30/f77 zero size 2024-02-16T22:18:55.159 INFO:tasks.workunit.client.0.smithi134.stdout:2/392: read df/d10/d15/f16 [4994665,15512] 0 2024-02-16T22:18:55.159 INFO:tasks.workunit.client.0.smithi134.stdout:2/393: chown df/d10/l31 318308 1 2024-02-16T22:18:55.160 INFO:tasks.workunit.client.0.smithi134.stdout:0/471: dwrite d2/d4b/d53/f6e [0,4194304] 0 2024-02-16T22:18:55.160 INFO:tasks.workunit.client.0.smithi134.stdout:3/468: dread da/d12/f42 [0,4194304] 0 2024-02-16T22:18:55.161 INFO:tasks.workunit.client.0.smithi134.stdout:3/469: chown da/d1c/f32 4286780 1 2024-02-16T22:18:55.164 INFO:tasks.workunit.client.0.smithi134.stdout:1/466: dread d5/da/d21/f3b [0,4194304] 0 2024-02-16T22:18:55.166 INFO:tasks.workunit.client.0.smithi134.stdout:4/393: dread d0/d6/d1e/f27 [0,4194304] 0 2024-02-16T22:18:55.166 INFO:tasks.workunit.client.0.smithi134.stdout:9/540: creat db/d20/d22/d51/d9b/fb6 x:0 0 0 2024-02-16T22:18:55.166 INFO:tasks.workunit.client.0.smithi134.stdout:9/541: fdatasync db/d20/d22/d64/d69/f7e 0 2024-02-16T22:18:55.166 INFO:tasks.workunit.client.0.smithi134.stdout:9/542: chown f2 2138832 1 2024-02-16T22:18:55.166 INFO:tasks.workunit.client.0.smithi134.stdout:9/543: fsync db/d20/d22/d64/f90 0 2024-02-16T22:18:55.166 INFO:tasks.workunit.client.0.smithi134.stdout:9/544: dread - db/dc/f24 zero size 2024-02-16T22:18:55.167 INFO:tasks.workunit.client.0.smithi134.stdout:6/489: creat d17/d22/d70/d86/f98 x:0 0 0 2024-02-16T22:18:55.167 INFO:tasks.workunit.client.0.smithi134.stdout:5/501: rmdir d2/d35/d36/d3d 39 2024-02-16T22:18:55.167 INFO:tasks.workunit.client.0.smithi134.stdout:5/502: write d2/f34 [542829,130708] 0 2024-02-16T22:18:55.167 INFO:tasks.workunit.client.0.smithi134.stdout:5/503: creat d2/d35/d36/d46/d68/d74/fa7 x:0 0 0 2024-02-16T22:18:55.167 INFO:tasks.workunit.client.0.smithi134.stdout:7/500: getdents d2/d5/d19/d4a 0 2024-02-16T22:18:55.167 INFO:tasks.workunit.client.0.smithi134.stdout:7/501: truncate d2/d5/d19/d84/d86/fa0 1037679 0 2024-02-16T22:18:55.169 INFO:tasks.workunit.client.0.smithi134.stdout:2/394: creat df/d10/d15/d5a/d17/f79 x:0 0 0 2024-02-16T22:18:55.169 INFO:tasks.workunit.client.0.smithi134.stdout:2/395: readlink df/d10/d15/d5a/l33 0 2024-02-16T22:18:55.176 INFO:tasks.workunit.client.0.smithi134.stdout:0/472: rename d2/dc/d32/d45/l5a to d2/dc/d97/la1 0 2024-02-16T22:18:55.177 INFO:tasks.workunit.client.0.smithi134.stdout:3/470: creat da/d1c/d24/d29/d51/d80/d90/f99 x:0 0 0 2024-02-16T22:18:55.177 INFO:tasks.workunit.client.0.smithi134.stdout:3/471: dread - da/d1c/d24/d29/d51/f87 zero size 2024-02-16T22:18:55.177 INFO:tasks.workunit.client.0.smithi134.stdout:3/472: write da/d1c/f67 [537674,10892] 0 2024-02-16T22:18:55.178 INFO:tasks.workunit.client.0.smithi134.stdout:1/467: creat d5/d1a/d53/d86/f9a x:0 0 0 2024-02-16T22:18:55.178 INFO:tasks.workunit.client.0.smithi134.stdout:4/394: symlink d0/d6/d22/l8a 0 2024-02-16T22:18:55.179 INFO:tasks.workunit.client.0.smithi134.stdout:6/490: creat d17/d27/d4f/d52/d79/d92/f99 x:0 0 0 2024-02-16T22:18:55.182 INFO:tasks.workunit.client.0.smithi134.stdout:7/502: mknod d2/ca3 0 2024-02-16T22:18:55.182 INFO:tasks.workunit.client.0.smithi134.stdout:7/503: truncate d2/d6/f41 853232 0 2024-02-16T22:18:55.183 INFO:tasks.workunit.client.0.smithi134.stdout:2/396: mkdir df/d10/d15/d5a/d17/d7a 0 2024-02-16T22:18:55.183 INFO:tasks.workunit.client.0.smithi134.stdout:2/397: write df/d10/d15/d5a/d2d/f63 [556868,99974] 0 2024-02-16T22:18:55.184 INFO:tasks.workunit.client.0.smithi134.stdout:0/473: mknod d2/dc/d48/d60/ca2 0 2024-02-16T22:18:55.185 INFO:tasks.workunit.client.0.smithi134.stdout:4/395: creat d0/d6/d16/f8b x:0 0 0 2024-02-16T22:18:55.186 INFO:tasks.workunit.client.0.smithi134.stdout:5/504: symlink d2/d9/dc/d32/d61/la8 0 2024-02-16T22:18:55.187 INFO:tasks.workunit.client.0.smithi134.stdout:2/398: dread df/d10/d15/d5a/d17/d1b/f22 [0,4194304] 0 2024-02-16T22:18:55.188 INFO:tasks.workunit.client.0.smithi134.stdout:0/474: mkdir d2/d20/da3 0 2024-02-16T22:18:55.188 INFO:tasks.workunit.client.0.smithi134.stdout:0/475: stat d2/d20/f23 0 2024-02-16T22:18:55.188 INFO:tasks.workunit.client.0.smithi134.stdout:9/545: dwrite db/d20/d22/d51/fb5 [0,4194304] 0 2024-02-16T22:18:55.189 INFO:tasks.workunit.client.0.smithi134.stdout:4/396: mknod d0/d6/d22/d40/c8c 0 2024-02-16T22:18:55.189 INFO:tasks.workunit.client.0.smithi134.stdout:4/397: write d0/d6/d16/f17 [5093255,44298] 0 2024-02-16T22:18:55.190 INFO:tasks.workunit.client.0.smithi134.stdout:0/476: unlink d2/d4b/c7b 0 2024-02-16T22:18:55.190 INFO:tasks.workunit.client.0.smithi134.stdout:0/477: chown d2/dc/d48/d60 2795 1 2024-02-16T22:18:55.191 INFO:tasks.workunit.client.0.smithi134.stdout:3/473: dread da/d1c/d24/f3d [0,4194304] 0 2024-02-16T22:18:55.192 INFO:tasks.workunit.client.0.smithi134.stdout:3/474: write da/d1c/d24/d29/d51/f87 [39505,49361] 0 2024-02-16T22:18:55.192 INFO:tasks.workunit.client.0.smithi134.stdout:3/475: chown da/d1c/d24/c53 1551712817 1 2024-02-16T22:18:55.192 INFO:tasks.workunit.client.0.smithi134.stdout:2/399: write df/d10/d15/d5a/d17/d1b/f2f [5248087,46948] 0 2024-02-16T22:18:55.192 INFO:tasks.workunit.client.0.smithi134.stdout:7/504: dread d2/d5/d22/d26/d48/d7f/f39 [0,4194304] 0 2024-02-16T22:18:55.192 INFO:tasks.workunit.client.0.smithi134.stdout:7/505: chown d2/d6/d17/d31/l42 2 1 2024-02-16T22:18:55.193 INFO:tasks.workunit.client.0.smithi134.stdout:4/398: link d0/d6/d58/c74 d0/d6/d16/d1a/d75/c8d 0 2024-02-16T22:18:55.193 INFO:tasks.workunit.client.0.smithi134.stdout:4/399: readlink d0/d6/d8/l1f 0 2024-02-16T22:18:55.193 INFO:tasks.workunit.client.0.smithi134.stdout:4/400: creat d0/d6/d22/d25/f8e x:0 0 0 2024-02-16T22:18:55.194 INFO:tasks.workunit.client.0.smithi134.stdout:4/401: write d0/d6/d22/d25/f72 [695298,98237] 0 2024-02-16T22:18:55.195 INFO:tasks.workunit.client.0.smithi134.stdout:4/402: creat d0/d6/d8/d30/f8f x:0 0 0 2024-02-16T22:18:55.195 INFO:tasks.workunit.client.0.smithi134.stdout:1/468: dread d5/d1a/f4c [0,4194304] 0 2024-02-16T22:18:55.195 INFO:tasks.workunit.client.0.smithi134.stdout:0/478: rename d2/dc/d48/d60/f89 to d2/d20/d7a/d7e/fa4 0 2024-02-16T22:18:55.195 INFO:tasks.workunit.client.0.smithi134.stdout:0/479: fsync d2/d20/d50/f63 0 2024-02-16T22:18:55.196 INFO:tasks.workunit.client.0.smithi134.stdout:3/476: readlink da/l37 0 2024-02-16T22:18:55.196 INFO:tasks.workunit.client.0.smithi134.stdout:3/477: write da/d12/f42 [4592184,64163] 0 2024-02-16T22:18:55.198 INFO:tasks.workunit.client.0.smithi134.stdout:9/546: getdents db/d20/d55 0 2024-02-16T22:18:55.198 INFO:tasks.workunit.client.0.smithi134.stdout:9/547: write db/d20/d22/d64/d69/f87 [342813,69866] 0 2024-02-16T22:18:55.199 INFO:tasks.workunit.client.0.smithi134.stdout:7/506: dread d2/d6/d17/d25/d63/f60 [0,4194304] 0 2024-02-16T22:18:55.201 INFO:tasks.workunit.client.0.smithi134.stdout:6/491: getdents d17/d27/d4f/d52/d79/d92 0 2024-02-16T22:18:55.201 INFO:tasks.workunit.client.0.smithi134.stdout:4/403: dread d0/d6/d22/d25/f2d [0,4194304] 0 2024-02-16T22:18:55.201 INFO:tasks.workunit.client.0.smithi134.stdout:4/404: creat d0/d6/d22/d25/f90 x:0 0 0 2024-02-16T22:18:55.201 INFO:tasks.workunit.client.0.smithi134.stdout:5/505: dread d2/f2b [0,4194304] 0 2024-02-16T22:18:55.203 INFO:tasks.workunit.client.0.smithi134.stdout:2/400: dread df/d10/d15/d5a/f26 [4194304,4194304] 0 2024-02-16T22:18:55.203 INFO:tasks.workunit.client.0.smithi134.stdout:1/469: rmdir d5/da/d21/d45/d93/d98 0 2024-02-16T22:18:55.203 INFO:tasks.workunit.client.0.smithi134.stdout:1/470: readlink d5/da/d21/d52/l87 0 2024-02-16T22:18:55.204 INFO:tasks.workunit.client.0.smithi134.stdout:0/480: symlink d2/dc/d32/d3e/d5e/la5 0 2024-02-16T22:18:55.204 INFO:tasks.workunit.client.0.smithi134.stdout:0/481: fdatasync d2/dc/d2d/d34/f37 0 2024-02-16T22:18:55.205 INFO:tasks.workunit.client.0.smithi134.stdout:3/478: mkdir da/d1c/d24/d9a 0 2024-02-16T22:18:55.208 INFO:tasks.workunit.client.0.smithi134.stdout:9/548: unlink db/d20/f39 0 2024-02-16T22:18:55.208 INFO:tasks.workunit.client.0.smithi134.stdout:4/405: dread d0/d6/d8/d32/d63/f65 [0,4194304] 0 2024-02-16T22:18:55.208 INFO:tasks.workunit.client.0.smithi134.stdout:4/406: write d0/d6/d8/d30/f8f [906595,74771] 0 2024-02-16T22:18:55.209 INFO:tasks.workunit.client.0.smithi134.stdout:7/507: creat d2/d6/fa4 x:0 0 0 2024-02-16T22:18:55.210 INFO:tasks.workunit.client.0.smithi134.stdout:5/506: read d2/d35/d36/d3d/f78 [5601545,82331] 0 2024-02-16T22:18:55.212 INFO:tasks.workunit.client.0.smithi134.stdout:0/482: read d2/dc/f1d [2981138,53034] 0 2024-02-16T22:18:55.212 INFO:tasks.workunit.client.0.smithi134.stdout:4/407: dread d0/d6/d22/d25/d2a/f2e [4194304,4194304] 0 2024-02-16T22:18:55.212 INFO:tasks.workunit.client.0.smithi134.stdout:5/507: write d2/d35/d36/d3d/d9c/d4b/f7d [297086,49490] 0 2024-02-16T22:18:55.212 INFO:tasks.workunit.client.0.smithi134.stdout:2/401: mkdir df/d10/d30/d49/d7b 0 2024-02-16T22:18:55.212 INFO:tasks.workunit.client.0.smithi134.stdout:2/402: dread - df/d10/d15/d5a/d2d/f4a zero size 2024-02-16T22:18:55.213 INFO:tasks.workunit.client.0.smithi134.stdout:1/471: mkdir d5/da/d21/d52/d9b 0 2024-02-16T22:18:55.214 INFO:tasks.workunit.client.0.smithi134.stdout:2/403: dread df/d10/d15/d5a/d17/d1b/f56 [0,4194304] 0 2024-02-16T22:18:55.214 INFO:tasks.workunit.client.0.smithi134.stdout:3/479: unlink da/d1c/d24/d29/d51/d79/f83 0 2024-02-16T22:18:55.220 INFO:tasks.workunit.client.0.smithi134.stdout:9/549: unlink db/l60 0 2024-02-16T22:18:55.227 INFO:tasks.workunit.client.0.smithi134.stdout:0/483: rmdir d2/dc/d2d/d34 39 2024-02-16T22:18:55.227 INFO:tasks.workunit.client.0.smithi134.stdout:0/484: stat d2/dc/ff 0 2024-02-16T22:18:55.229 INFO:tasks.workunit.client.0.smithi134.stdout:4/408: truncate d0/d6/d5d/f80 3977762 0 2024-02-16T22:18:55.230 INFO:tasks.workunit.client.0.smithi134.stdout:5/508: unlink d2/d35/d36/d3d/d63/l7e 0 2024-02-16T22:18:55.231 INFO:tasks.workunit.client.0.smithi134.stdout:1/472: mknod d5/d1a/d23/d85/c9c 0 2024-02-16T22:18:55.232 INFO:tasks.workunit.client.0.smithi134.stdout:1/473: stat d5/d1a/l22 0 2024-02-16T22:18:55.232 INFO:tasks.workunit.client.0.smithi134.stdout:1/474: readlink d5/d1a/l22 0 2024-02-16T22:18:55.232 INFO:tasks.workunit.client.0.smithi134.stdout:1/475: fsync d5/da/f25 0 2024-02-16T22:18:55.234 INFO:tasks.workunit.client.0.smithi134.stdout:2/404: dwrite df/d10/d15/d5a/d17/f20 [4194304,4194304] 0 2024-02-16T22:18:55.235 INFO:tasks.workunit.client.0.smithi134.stdout:9/550: rmdir db/d20/d55/d8c 39 2024-02-16T22:18:55.235 INFO:tasks.workunit.client.0.smithi134.stdout:9/551: fdatasync db/d20/d22/d91/d99/faa 0 2024-02-16T22:18:55.246 INFO:tasks.workunit.client.0.smithi134.stdout:6/492: rename d17/d22 to d17/d36/d77/d9a 0 2024-02-16T22:18:55.246 INFO:tasks.workunit.client.0.smithi134.stdout:6/493: chown d17/d27/d4f/d52/l65 3 1 2024-02-16T22:18:55.246 INFO:tasks.workunit.client.0.smithi134.stdout:6/494: write d17/d27/f8d [1986178,102479] 0 2024-02-16T22:18:55.246 INFO:tasks.workunit.client.0.smithi134.stdout:6/495: write d17/d27/d4f/f67 [1061093,103389] 0 2024-02-16T22:18:55.246 INFO:tasks.workunit.client.0.smithi134.stdout:6/496: readlink d17/l1e 0 2024-02-16T22:18:55.247 INFO:tasks.workunit.client.0.smithi134.stdout:4/409: symlink d0/d6/d1e/d3b/l91 0 2024-02-16T22:18:55.247 INFO:tasks.workunit.client.0.smithi134.stdout:4/410: truncate d0/f77 675531 0 2024-02-16T22:18:55.247 INFO:tasks.workunit.client.0.smithi134.stdout:4/411: chown d0/d6/d1e/d3b/f50 121040 1 2024-02-16T22:18:55.247 INFO:tasks.workunit.client.0.smithi134.stdout:4/412: fsync d0/d6/d22/d25/f73 0 2024-02-16T22:18:55.247 INFO:tasks.workunit.client.0.smithi134.stdout:4/413: dread - d0/d6/d1e/d3b/f50 zero size 2024-02-16T22:18:55.250 INFO:tasks.workunit.client.0.smithi134.stdout:7/508: rename d2/d6/d17/d25 to d2/d6/d7d/d92/da5 0 2024-02-16T22:18:55.252 INFO:tasks.workunit.client.0.smithi134.stdout:6/497: symlink d17/d27/d4f/l9b 0 2024-02-16T22:18:55.253 INFO:tasks.workunit.client.0.smithi134.stdout:4/414: creat d0/d6/d58/f92 x:0 0 0 2024-02-16T22:18:55.253 INFO:tasks.workunit.client.0.smithi134.stdout:1/476: rmdir d5/d1a/d23/d61 39 2024-02-16T22:18:55.254 INFO:tasks.workunit.client.0.smithi134.stdout:9/552: rename db/d20/d22/f44 to db/fb7 0 2024-02-16T22:18:55.255 INFO:tasks.workunit.client.0.smithi134.stdout:7/509: truncate d2/d6/d17/f23 3238708 0 2024-02-16T22:18:55.256 INFO:tasks.workunit.client.0.smithi134.stdout:6/498: mkdir d17/d27/d93/d9c 0 2024-02-16T22:18:55.257 INFO:tasks.workunit.client.0.smithi134.stdout:6/499: fsync d17/d36/d77/d9a/f4b 0 2024-02-16T22:18:55.258 INFO:tasks.workunit.client.0.smithi134.stdout:2/405: dwrite df/d10/d15/f3f [0,4194304] 0 2024-02-16T22:18:55.259 INFO:tasks.workunit.client.0.smithi134.stdout:5/509: dwrite d2/d9/dc/f3a [0,4194304] 0 2024-02-16T22:18:55.259 INFO:tasks.workunit.client.0.smithi134.stdout:5/510: chown d2/d9/dc/d15/d2f/l92 891806547 1 2024-02-16T22:18:55.259 INFO:tasks.workunit.client.0.smithi134.stdout:9/553: rmdir db/d20/d55/da9 0 2024-02-16T22:18:55.259 INFO:tasks.workunit.client.0.smithi134.stdout:9/554: fdatasync db/dc/f12 0 2024-02-16T22:18:55.259 INFO:tasks.workunit.client.0.smithi134.stdout:0/485: dwrite d2/dc/f4f [0,4194304] 0 2024-02-16T22:18:55.261 INFO:tasks.workunit.client.0.smithi134.stdout:7/510: unlink d2/d5/d22/d26/d48/l68 0 2024-02-16T22:18:55.262 INFO:tasks.workunit.client.0.smithi134.stdout:6/500: mknod d17/d27/d4f/d52/d97/c9d 0 2024-02-16T22:18:55.268 INFO:tasks.workunit.client.0.smithi134.stdout:5/511: mkdir d2/d35/d36/da9 0 2024-02-16T22:18:55.272 INFO:tasks.workunit.client.0.smithi134.stdout:9/555: creat db/d20/d22/d64/d69/d6e/fb8 x:0 0 0 2024-02-16T22:18:55.272 INFO:tasks.workunit.client.0.smithi134.stdout:0/486: dread d2/dc/f2b [0,4194304] 0 2024-02-16T22:18:55.273 INFO:tasks.workunit.client.0.smithi134.stdout:9/556: write db/d20/d22/d51/f74 [188566,75022] 0 2024-02-16T22:18:55.275 INFO:tasks.workunit.client.0.smithi134.stdout:7/511: dread d2/d6/f16 [0,4194304] 0 2024-02-16T22:18:55.276 INFO:tasks.workunit.client.0.smithi134.stdout:7/512: chown d2/d6/d17/d31/d28/f36 281 1 2024-02-16T22:18:55.276 INFO:tasks.workunit.client.0.smithi134.stdout:5/512: getdents d2/d9/dc/d15 0 2024-02-16T22:18:55.277 INFO:tasks.workunit.client.0.smithi134.stdout:9/557: mknod db/d20/d22/d51/da2/cb9 0 2024-02-16T22:18:55.279 INFO:tasks.workunit.client.0.smithi134.stdout:7/513: symlink d2/d5/d22/d26/d48/d7f/la6 0 2024-02-16T22:18:55.280 INFO:tasks.workunit.client.0.smithi134.stdout:9/558: mknod db/d20/d22/d91/d99/cba 0 2024-02-16T22:18:55.282 INFO:tasks.workunit.client.0.smithi134.stdout:9/559: mknod db/d20/cbb 0 2024-02-16T22:18:55.282 INFO:tasks.workunit.client.0.smithi134.stdout:9/560: fsync db/f33 0 2024-02-16T22:18:55.285 INFO:tasks.workunit.client.0.smithi134.stdout:9/561: rename db/d20/d32/c75 to db/d20/d22/d46/d8f/cbc 0 2024-02-16T22:18:55.286 INFO:tasks.workunit.client.0.smithi134.stdout:7/514: dread d2/d6/d7d/d92/da5/d63/f60 [0,4194304] 0 2024-02-16T22:18:55.287 INFO:tasks.workunit.client.0.smithi134.stdout:0/487: write d2/d4b/d53/f6e [543735,110857] 0 2024-02-16T22:18:55.291 INFO:tasks.workunit.client.0.smithi134.stdout:9/562: dread db/f33 [0,4194304] 0 2024-02-16T22:18:55.295 INFO:tasks.workunit.client.0.smithi134.stdout:9/563: rename db/d20/d22/d64/d69/d6d to db/d20/d22/d51/d9b/dbd 0 2024-02-16T22:18:55.295 INFO:tasks.workunit.client.0.smithi134.stdout:9/564: dread - db/dc/f24 zero size 2024-02-16T22:18:55.298 INFO:tasks.workunit.client.0.smithi134.stdout:4/415: dwrite d0/d6/d1e/f27 [0,4194304] 0 2024-02-16T22:18:55.299 INFO:tasks.workunit.client.0.smithi134.stdout:4/416: rename d0/d6/d8/d32/d63/d6c/c12 to d0/d6/d8/d30/c93 0 2024-02-16T22:18:55.300 INFO:tasks.workunit.client.0.smithi134.stdout:0/488: dread d2/dc/d32/d3e/d5e/f8e [0,4194304] 0 2024-02-16T22:18:55.310 INFO:tasks.workunit.client.0.smithi134.stdout:5/513: dwrite d2/d35/d36/f37 [0,4194304] 0 2024-02-16T22:18:55.354 INFO:tasks.workunit.client.0.smithi134.stdout:1/477: dwrite d5/d1a/d23/d61/f83 [0,4194304] 0 2024-02-16T22:18:55.355 INFO:tasks.workunit.client.0.smithi134.stdout:2/406: dwrite df/d10/d30/d49/f57 [4194304,4194304] 0 2024-02-16T22:18:55.355 INFO:tasks.workunit.client.0.smithi134.stdout:6/501: dwrite d17/d27/d4f/f50 [4194304,4194304] 0 2024-02-16T22:18:55.355 INFO:tasks.workunit.client.0.smithi134.stdout:6/502: chown d17/d27/d4f/d52/l60 29 1 2024-02-16T22:18:55.355 INFO:tasks.workunit.client.0.smithi134.stdout:0/489: creat d2/dc/d32/fa6 x:0 0 0 2024-02-16T22:18:55.356 INFO:tasks.workunit.client.0.smithi134.stdout:0/490: read d2/d20/d50/f63 [97182,126791] 0 2024-02-16T22:18:55.356 INFO:tasks.workunit.client.0.smithi134.stdout:0/491: truncate d2/dc/d2d/d34/f61 334842 0 2024-02-16T22:18:55.357 INFO:tasks.workunit.client.0.smithi134.stdout:5/514: symlink d2/d8f/laa 0 2024-02-16T22:18:55.359 INFO:tasks.workunit.client.0.smithi134.stdout:1/478: getdents d5/d1a/d23 0 2024-02-16T22:18:55.359 INFO:tasks.workunit.client.0.smithi134.stdout:1/479: fsync d5/f3f 0 2024-02-16T22:18:55.359 INFO:tasks.workunit.client.0.smithi134.stdout:1/480: creat d5/d1a/d53/d86/f9d x:0 0 0 2024-02-16T22:18:55.361 INFO:tasks.workunit.client.0.smithi134.stdout:2/407: symlink df/d10/d15/d5a/d2d/l7c 0 2024-02-16T22:18:55.364 INFO:tasks.workunit.client.0.smithi134.stdout:6/503: dread d17/d27/d4f/d52/d79/f4a [0,4194304] 0 2024-02-16T22:18:55.367 INFO:tasks.workunit.client.0.smithi134.stdout:7/515: dwrite d2/d5/d19/f1d [0,4194304] 0 2024-02-16T22:18:55.367 INFO:tasks.workunit.client.0.smithi134.stdout:7/516: readlink d2/d6/l75 0 2024-02-16T22:18:55.367 INFO:tasks.workunit.client.0.smithi134.stdout:7/517: chown d2/d5/d22/d83/f9c 256145 1 2024-02-16T22:18:55.368 INFO:tasks.workunit.client.0.smithi134.stdout:4/417: dread d0/d6/d16/f20 [4194304,4194304] 0 2024-02-16T22:18:55.375 INFO:tasks.workunit.client.0.smithi134.stdout:0/492: mkdir d2/dc/d32/d3e/da7 0 2024-02-16T22:18:55.378 INFO:tasks.workunit.client.0.smithi134.stdout:1/481: symlink d5/d1a/d4d/d99/l9e 0 2024-02-16T22:18:55.379 INFO:tasks.workunit.client.0.smithi134.stdout:7/518: creat d2/d7/d40/fa7 x:0 0 0 2024-02-16T22:18:55.379 INFO:tasks.workunit.client.0.smithi134.stdout:4/418: mknod d0/d6/d16/d46/c94 0 2024-02-16T22:18:55.380 INFO:tasks.workunit.client.0.smithi134.stdout:4/419: write d0/d6/d1e/d39/f45 [635707,6799] 0 2024-02-16T22:18:55.382 INFO:tasks.workunit.client.0.smithi134.stdout:0/493: creat d2/d20/d77/fa8 x:0 0 0 2024-02-16T22:18:55.382 INFO:tasks.workunit.client.0.smithi134.stdout:0/494: creat d2/d20/d7a/fa9 x:0 0 0 2024-02-16T22:18:55.383 INFO:tasks.workunit.client.0.smithi134.stdout:5/515: rmdir d2/d35/d36/d46/d68/d74 39 2024-02-16T22:18:55.383 INFO:tasks.workunit.client.0.smithi134.stdout:5/516: fdatasync d2/f2b 0 2024-02-16T22:18:55.383 INFO:tasks.workunit.client.0.smithi134.stdout:5/517: chown d2/d8f/fa4 0 1 2024-02-16T22:18:55.383 INFO:tasks.workunit.client.0.smithi134.stdout:5/518: chown d2/d35/d36/d46/l47 2335 1 2024-02-16T22:18:55.383 INFO:tasks.workunit.client.0.smithi134.stdout:5/519: write d2/d35/d36/f9b [127007,8384] 0 2024-02-16T22:18:55.383 INFO:tasks.workunit.client.0.smithi134.stdout:5/520: dread - d2/d35/d36/d3d/d63/d90/fa6 zero size 2024-02-16T22:18:55.383 INFO:tasks.workunit.client.0.smithi134.stdout:5/521: fsync d2/f6 0 2024-02-16T22:18:55.384 INFO:tasks.workunit.client.0.smithi134.stdout:1/482: mkdir d5/da/d21/d52/d9b/d9f 0 2024-02-16T22:18:55.384 INFO:tasks.workunit.client.0.smithi134.stdout:4/420: mknod d0/d31/c95 0 2024-02-16T22:18:55.385 INFO:tasks.workunit.client.0.smithi134.stdout:4/421: dread - d0/d6/d58/f92 zero size 2024-02-16T22:18:55.385 INFO:tasks.workunit.client.0.smithi134.stdout:4/422: read d0/d6/d22/d40/f41 [348365,100093] 0 2024-02-16T22:18:55.386 INFO:tasks.workunit.client.0.smithi134.stdout:5/522: symlink d2/lab 0 2024-02-16T22:18:55.388 INFO:tasks.workunit.client.0.smithi134.stdout:5/523: fsync d2/d35/d36/f9b 0 2024-02-16T22:18:55.388 INFO:tasks.workunit.client.0.smithi134.stdout:5/524: stat d2/d35/d36/d3d/d63/c9a 0 2024-02-16T22:18:55.388 INFO:tasks.workunit.client.0.smithi134.stdout:5/525: write d2/d35/d36/d3d/d63/fa2 [867356,43842] 0 2024-02-16T22:18:55.388 INFO:tasks.workunit.client.0.smithi134.stdout:5/526: truncate d2/d8f/fa4 725953 0 2024-02-16T22:18:55.388 INFO:tasks.workunit.client.0.smithi134.stdout:1/483: rename d5/da/d2d/c2e to d5/d1a/d53/ca0 0 2024-02-16T22:18:55.389 INFO:tasks.workunit.client.0.smithi134.stdout:9/565: dwrite db/d20/d22/d46/d8f/f83 [0,4194304] 0 2024-02-16T22:18:55.389 INFO:tasks.workunit.client.0.smithi134.stdout:9/566: chown db/d20/d32/c67 6704275 1 2024-02-16T22:18:55.389 INFO:tasks.workunit.client.0.smithi134.stdout:2/408: dwrite df/d10/d15/d5a/d34/f3e [4194304,4194304] 0 2024-02-16T22:18:55.389 INFO:tasks.workunit.client.0.smithi134.stdout:2/409: dread - df/d10/d15/d5a/d2d/f72 zero size 2024-02-16T22:18:55.391 INFO:tasks.workunit.client.0.smithi134.stdout:1/484: dread d5/f8 [0,4194304] 0 2024-02-16T22:18:55.392 INFO:tasks.workunit.client.0.smithi134.stdout:5/527: link d2/d35/d36/f77 d2/d35/d36/d3d/fac 0 2024-02-16T22:18:55.395 INFO:tasks.workunit.client.0.smithi134.stdout:9/567: mkdir db/d20/d22/d46/dbe 0 2024-02-16T22:18:55.395 INFO:tasks.workunit.client.0.smithi134.stdout:9/568: readlink db/l82 0 2024-02-16T22:18:55.397 INFO:tasks.workunit.client.0.smithi134.stdout:2/410: symlink df/d10/d30/l7d 0 2024-02-16T22:18:55.399 INFO:tasks.workunit.client.0.smithi134.stdout:5/528: rmdir d2/d35/d36/d3d/d9c/d4b 39 2024-02-16T22:18:55.399 INFO:tasks.workunit.client.0.smithi134.stdout:5/529: creat d2/d9/fad x:0 0 0 2024-02-16T22:18:55.399 INFO:tasks.workunit.client.0.smithi134.stdout:5/530: chown d2/d9/dc/d32/d61 109 1 2024-02-16T22:18:55.399 INFO:tasks.workunit.client.0.smithi134.stdout:5/531: getdents d2/d35/d36/da9 0 2024-02-16T22:18:55.399 INFO:tasks.workunit.client.0.smithi134.stdout:5/532: chown d2/d9/dc/c1b 871132 1 2024-02-16T22:18:55.399 INFO:tasks.workunit.client.0.smithi134.stdout:5/533: chown d2/d9/dc/d15/f31 1 1 2024-02-16T22:18:55.399 INFO:tasks.workunit.client.0.smithi134.stdout:7/519: dwrite d2/d5/d22/f66 [0,4194304] 0 2024-02-16T22:18:55.400 INFO:tasks.workunit.client.0.smithi134.stdout:2/411: mknod df/d10/d30/d4d/c7e 0 2024-02-16T22:18:55.401 INFO:tasks.workunit.client.0.smithi134.stdout:1/485: read d5/da/d21/f37 [4124306,62635] 0 2024-02-16T22:18:55.401 INFO:tasks.workunit.client.0.smithi134.stdout:1/486: fdatasync d5/da/d21/d45/f56 0 2024-02-16T22:18:55.401 INFO:tasks.workunit.client.0.smithi134.stdout:5/534: symlink d2/d35/d36/d3d/d63/d90/lae 0 2024-02-16T22:18:55.404 INFO:tasks.workunit.client.0.smithi134.stdout:1/487: dread d5/da/d1c/f49 [0,4194304] 0 2024-02-16T22:18:55.404 INFO:tasks.workunit.client.0.smithi134.stdout:3/480: sync 2024-02-16T22:18:55.404 INFO:tasks.workunit.client.0.smithi134.stdout:8/469: sync 2024-02-16T22:18:55.405 INFO:tasks.workunit.client.0.smithi134.stdout:7/520: getdents d2/d5/d4c 0 2024-02-16T22:18:55.406 INFO:tasks.workunit.client.0.smithi134.stdout:9/569: write db/d20/d22/d51/fb5 [3800467,28300] 0 2024-02-16T22:18:55.406 INFO:tasks.workunit.client.0.smithi134.stdout:9/570: creat db/d20/d22/d64/d69/d89/fbf x:0 0 0 2024-02-16T22:18:55.407 INFO:tasks.workunit.client.0.smithi134.stdout:1/488: truncate d5/d1a/d23/d3c/d6a/d5c/d72/f79 500319 0 2024-02-16T22:18:55.410 INFO:tasks.workunit.client.0.smithi134.stdout:5/535: dread d2/f50 [0,4194304] 0 2024-02-16T22:18:55.413 INFO:tasks.workunit.client.0.smithi134.stdout:3/481: write da/d1c/d24/f52 [578242,46928] 0 2024-02-16T22:18:55.413 INFO:tasks.workunit.client.0.smithi134.stdout:3/482: chown da/d1c/d24/d29/d40/d8a/d8f/d6d 1367 1 2024-02-16T22:18:55.413 INFO:tasks.workunit.client.0.smithi134.stdout:8/470: getdents d2/df/d18/d12 0 2024-02-16T22:18:55.421 INFO:tasks.workunit.client.0.smithi134.stdout:3/483: rename da/l82 to da/d1c/d24/d29/d40/d8a/l9b 0 2024-02-16T22:18:55.425 INFO:tasks.workunit.client.0.smithi134.stdout:2/412: dwrite df/d10/d15/d5a/d17/f20 [0,4194304] 0 2024-02-16T22:18:55.426 INFO:tasks.workunit.client.0.smithi134.stdout:1/489: dread d5/d1a/d23/d61/f83 [0,4194304] 0 2024-02-16T22:18:55.430 INFO:tasks.workunit.client.0.smithi134.stdout:1/490: creat d5/da/d21/d52/d9b/fa1 x:0 0 0 2024-02-16T22:18:55.430 INFO:tasks.workunit.client.0.smithi134.stdout:1/491: write f3 [264339,78492] 0 2024-02-16T22:18:55.433 INFO:tasks.workunit.client.0.smithi134.stdout:2/413: write df/d10/d15/f16 [2876999,87270] 0 2024-02-16T22:18:55.433 INFO:tasks.workunit.client.0.smithi134.stdout:2/414: write df/d10/d15/d5a/d2d/f6d [1449837,109923] 0 2024-02-16T22:18:55.434 INFO:tasks.workunit.client.0.smithi134.stdout:2/415: dread - df/d10/f47 zero size 2024-02-16T22:18:55.437 INFO:tasks.workunit.client.0.smithi134.stdout:2/416: unlink la 0 2024-02-16T22:18:55.437 INFO:tasks.workunit.client.0.smithi134.stdout:2/417: readlink df/d10/d30/l62 0 2024-02-16T22:18:55.437 INFO:tasks.workunit.client.0.smithi134.stdout:2/418: dread - df/d10/d15/d5a/d17/d1b/f64 zero size 2024-02-16T22:18:55.437 INFO:tasks.workunit.client.0.smithi134.stdout:2/419: chown df/d10/d15/d5a/d34/c35 202 1 2024-02-16T22:18:55.437 INFO:tasks.workunit.client.0.smithi134.stdout:2/420: stat df/d10/d30/f77 0 2024-02-16T22:18:55.438 INFO:tasks.workunit.client.0.smithi134.stdout:2/421: symlink df/d10/d15/d5a/d2d/l7f 0 2024-02-16T22:18:55.438 INFO:tasks.workunit.client.0.smithi134.stdout:7/521: dwrite d2/d6/f70 [0,4194304] 0 2024-02-16T22:18:55.444 INFO:tasks.workunit.client.0.smithi134.stdout:9/571: dwrite db/dc/f66 [0,4194304] 0 2024-02-16T22:18:55.445 INFO:tasks.workunit.client.0.smithi134.stdout:8/471: dwrite d2/df/d18/fc [0,4194304] 0 2024-02-16T22:18:55.445 INFO:tasks.workunit.client.0.smithi134.stdout:2/422: rmdir df/d10/d30 39 2024-02-16T22:18:55.446 INFO:tasks.workunit.client.0.smithi134.stdout:5/536: truncate d2/d35/d36/d3d/d63/fa2 181406 0 2024-02-16T22:18:55.448 INFO:tasks.workunit.client.0.smithi134.stdout:8/472: dread d2/df/d18/d27/f7b [0,4194304] 0 2024-02-16T22:18:55.448 INFO:tasks.workunit.client.0.smithi134.stdout:8/473: read d2/df/d18/d12/f4e [638637,26846] 0 2024-02-16T22:18:55.448 INFO:tasks.workunit.client.0.smithi134.stdout:8/474: creat d2/df/d18/d2a/d41/d59/f98 x:0 0 0 2024-02-16T22:18:55.449 INFO:tasks.workunit.client.0.smithi134.stdout:9/572: symlink db/d20/d22/d64/db0/lc0 0 2024-02-16T22:18:55.451 INFO:tasks.workunit.client.0.smithi134.stdout:9/573: dread db/f33 [0,4194304] 0 2024-02-16T22:18:55.454 INFO:tasks.workunit.client.0.smithi134.stdout:1/492: dwrite d5/da/d21/d45/f4e [0,4194304] 0 2024-02-16T22:18:55.454 INFO:tasks.workunit.client.0.smithi134.stdout:1/493: readlink d5/d1a/l73 0 2024-02-16T22:18:55.454 INFO:tasks.workunit.client.0.smithi134.stdout:1/494: chown d5/f3f 71707 1 2024-02-16T22:18:55.456 INFO:tasks.workunit.client.0.smithi134.stdout:8/475: rename d2/df/d18/l4a to d2/df/d19/d40/d53/d5e/d72/d7d/l99 0 2024-02-16T22:18:55.457 INFO:tasks.workunit.client.0.smithi134.stdout:2/423: getdents df 0 2024-02-16T22:18:55.457 INFO:tasks.workunit.client.0.smithi134.stdout:2/424: creat df/d41/f80 x:0 0 0 2024-02-16T22:18:55.458 INFO:tasks.workunit.client.0.smithi134.stdout:5/537: mkdir d2/d9/dc/daf 0 2024-02-16T22:18:55.459 INFO:tasks.workunit.client.0.smithi134.stdout:9/574: mknod db/d20/d22/d51/d9b/cc1 0 2024-02-16T22:18:55.459 INFO:tasks.workunit.client.0.smithi134.stdout:9/575: fsync db/d20/d22/d46/f5c 0 2024-02-16T22:18:55.459 INFO:tasks.workunit.client.0.smithi134.stdout:9/576: chown db/d20/d22/f25 3 1 2024-02-16T22:18:55.461 INFO:tasks.workunit.client.0.smithi134.stdout:8/476: symlink d2/df/d19/d8d/l9a 0 2024-02-16T22:18:55.462 INFO:tasks.workunit.client.0.smithi134.stdout:8/477: stat d2/df/d19/d40/d53/d5e/d72/d7d 0 2024-02-16T22:18:55.463 INFO:tasks.workunit.client.0.smithi134.stdout:2/425: mknod df/d10/d30/d4d/c81 0 2024-02-16T22:18:55.464 INFO:tasks.workunit.client.0.smithi134.stdout:5/538: link d2/d35/d36/d3d/d9c/f2c d2/d35/d36/d3d/fb0 0 2024-02-16T22:18:55.465 INFO:tasks.workunit.client.0.smithi134.stdout:9/577: mkdir db/d20/d22/d64/dc2 0 2024-02-16T22:18:55.467 INFO:tasks.workunit.client.0.smithi134.stdout:1/495: rename d5/da/d21/d45/f58 to d5/da/fa2 0 2024-02-16T22:18:55.469 INFO:tasks.workunit.client.0.smithi134.stdout:5/539: dread d2/d35/d36/d3d/f78 [4194304,4194304] 0 2024-02-16T22:18:55.469 INFO:tasks.workunit.client.0.smithi134.stdout:5/540: truncate d2/d35/d72/f7a 281559 0 2024-02-16T22:18:55.469 INFO:tasks.workunit.client.0.smithi134.stdout:5/541: write d2/d35/d36/d3d/fac [2787671,119919] 0 2024-02-16T22:18:55.470 INFO:tasks.workunit.client.0.smithi134.stdout:8/478: mknod d2/df/d19/d86/c9b 0 2024-02-16T22:18:55.470 INFO:tasks.workunit.client.0.smithi134.stdout:8/479: stat d2/df/d18/c64 0 2024-02-16T22:18:55.471 INFO:tasks.workunit.client.0.smithi134.stdout:2/426: truncate df/d10/d30/d49/f57 1528498 0 2024-02-16T22:18:55.472 INFO:tasks.workunit.client.0.smithi134.stdout:9/578: symlink db/d20/d22/d64/lc3 0 2024-02-16T22:18:55.473 INFO:tasks.workunit.client.0.smithi134.stdout:1/496: unlink d5/d1a/f4c 0 2024-02-16T22:18:55.475 INFO:tasks.workunit.client.0.smithi134.stdout:5/542: rename d2/d9/dc/d32/d61/la8 to d2/d9/dc/d32/d61/lb1 0 2024-02-16T22:18:55.475 INFO:tasks.workunit.client.0.smithi134.stdout:5/543: readlink d2/d35/d36/d3d/d63/l65 0 2024-02-16T22:18:55.477 INFO:tasks.workunit.client.0.smithi134.stdout:8/480: link d2/f63 d2/df/d18/d2a/f9c 0 2024-02-16T22:18:55.479 INFO:tasks.workunit.client.0.smithi134.stdout:9/579: mkdir db/d20/d22/d64/d69/d6e/d81/dc4 0 2024-02-16T22:18:55.481 INFO:tasks.workunit.client.0.smithi134.stdout:1/497: dread d5/da/d21/d45/f77 [0,4194304] 0 2024-02-16T22:18:55.482 INFO:tasks.workunit.client.0.smithi134.stdout:5/544: link d2/d35/d36/d46/d68/d74/f75 d2/d35/d36/da9/fb2 0 2024-02-16T22:18:55.482 INFO:tasks.workunit.client.0.smithi134.stdout:5/545: chown d2/d35/d36/d3d/c87 3 1 2024-02-16T22:18:55.483 INFO:tasks.workunit.client.0.smithi134.stdout:8/481: mknod d2/df/d18/d2a/d41/d61/d90/c9d 0 2024-02-16T22:18:55.484 INFO:tasks.workunit.client.0.smithi134.stdout:2/427: dwrite df/d10/d15/f66 [0,4194304] 0 2024-02-16T22:18:55.485 INFO:tasks.workunit.client.0.smithi134.stdout:9/580: symlink db/d20/d22/d64/lc5 0 2024-02-16T22:18:55.486 INFO:tasks.workunit.client.0.smithi134.stdout:9/581: truncate db/d20/d22/d46/fb3 1015538 0 2024-02-16T22:18:55.487 INFO:tasks.workunit.client.0.smithi134.stdout:1/498: creat d5/d1a/d23/d3c/d6a/d5c/fa3 x:0 0 0 2024-02-16T22:18:55.487 INFO:tasks.workunit.client.0.smithi134.stdout:1/499: chown d5/f46 31511259 1 2024-02-16T22:18:55.490 INFO:tasks.workunit.client.0.smithi134.stdout:8/482: creat d2/df/d18/d2a/f9e x:0 0 0 2024-02-16T22:18:55.490 INFO:tasks.workunit.client.0.smithi134.stdout:8/483: stat d2/df/d7c 0 2024-02-16T22:18:55.507 INFO:tasks.workunit.client.0.smithi134.stdout:5/546: rename d2/d99 to d2/d9/dc/d98/db3 0 2024-02-16T22:18:55.507 INFO:tasks.workunit.client.0.smithi134.stdout:5/547: chown d2/d9/dc/d15/d2f/l92 14 1 2024-02-16T22:18:55.507 INFO:tasks.workunit.client.0.smithi134.stdout:5/548: chown d2/d9/dc/f38 2318156 1 2024-02-16T22:18:55.509 INFO:tasks.workunit.client.0.smithi134.stdout:8/484: rename d2/df/d18/d27/d85/d8c to d2/df/d19/d9f 0 2024-02-16T22:18:55.510 INFO:tasks.workunit.client.0.smithi134.stdout:8/485: dread - d2/df/d19/d40/d53/d5e/f77 zero size 2024-02-16T22:18:55.511 INFO:tasks.workunit.client.0.smithi134.stdout:5/549: rename d2/d9/fad to d2/d35/d36/d46/d68/d74/fb4 0 2024-02-16T22:18:55.513 INFO:tasks.workunit.client.0.smithi134.stdout:1/500: dwrite d5/da/f35 [0,4194304] 0 2024-02-16T22:18:55.513 INFO:tasks.workunit.client.0.smithi134.stdout:1/501: creat d5/da/d21/d52/fa4 x:0 0 0 2024-02-16T22:18:55.513 INFO:tasks.workunit.client.0.smithi134.stdout:2/428: dwrite df/d10/d15/f16 [0,4194304] 0 2024-02-16T22:18:55.517 INFO:tasks.workunit.client.0.smithi134.stdout:1/502: link d5/f3f d5/d1a/d63/fa5 0 2024-02-16T22:18:55.519 INFO:tasks.workunit.client.0.smithi134.stdout:2/429: rmdir df/d10/d30 39 2024-02-16T22:18:55.523 INFO:tasks.workunit.client.0.smithi134.stdout:8/486: rename d2/df/d19 to d2/df/d18/d2a/d41/d59/da0 0 2024-02-16T22:18:55.524 INFO:tasks.workunit.client.0.smithi134.stdout:5/550: read d2/d9/dc/d15/f67 [463314,37240] 0 2024-02-16T22:18:55.524 INFO:tasks.workunit.client.0.smithi134.stdout:5/551: truncate d2/d9/dc/f81 21767 0 2024-02-16T22:18:55.524 INFO:tasks.workunit.client.0.smithi134.stdout:5/552: stat d2/d9/dc/d98/db3 0 2024-02-16T22:18:55.524 INFO:tasks.workunit.client.0.smithi134.stdout:5/553: readlink d2/d35/d36/d46/d68/l88 0 2024-02-16T22:18:55.526 INFO:tasks.workunit.client.0.smithi134.stdout:8/487: link d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/l62 d2/la1 0 2024-02-16T22:18:55.526 INFO:tasks.workunit.client.0.smithi134.stdout:8/488: chown d2/df/d18/l6b 1998371307 1 2024-02-16T22:18:55.529 INFO:tasks.workunit.client.0.smithi134.stdout:8/489: symlink d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/la2 0 2024-02-16T22:18:55.529 INFO:tasks.workunit.client.0.smithi134.stdout:8/490: chown d2/df/d18/d2a/d41/d59/f84 16 1 2024-02-16T22:18:55.531 INFO:tasks.workunit.client.0.smithi134.stdout:2/430: rename df/d10/d15/d5a/d17 to df/d10/d30/d49/d82 0 2024-02-16T22:18:55.532 INFO:tasks.workunit.client.0.smithi134.stdout:8/491: unlink d2/f25 0 2024-02-16T22:18:55.532 INFO:tasks.workunit.client.0.smithi134.stdout:2/431: stat df/d10/d15/d5a/c1c 0 2024-02-16T22:18:55.533 INFO:tasks.workunit.client.0.smithi134.stdout:2/432: stat df/d10/d30/d49 0 2024-02-16T22:18:55.533 INFO:tasks.workunit.client.0.smithi134.stdout:2/433: fdatasync df/d10/d15/d5a/d2d/f4a 0 2024-02-16T22:18:55.533 INFO:tasks.workunit.client.0.smithi134.stdout:2/434: mknod df/d10/d30/d49/c83 0 2024-02-16T22:18:55.533 INFO:tasks.workunit.client.0.smithi134.stdout:2/435: chown df/d41/f80 874954 1 2024-02-16T22:18:55.542 INFO:tasks.workunit.client.0.smithi134.stdout:8/492: dread d2/f36 [0,4194304] 0 2024-02-16T22:18:55.545 INFO:tasks.workunit.client.0.smithi134.stdout:2/436: write df/d10/d15/d5a/d34/f3e [7163779,79332] 0 2024-02-16T22:18:55.546 INFO:tasks.workunit.client.0.smithi134.stdout:2/437: rmdir df/d10/d30/d49 39 2024-02-16T22:18:55.546 INFO:tasks.workunit.client.0.smithi134.stdout:2/438: creat df/d10/d15/d5a/d2d/f84 x:0 0 0 2024-02-16T22:18:55.546 INFO:tasks.workunit.client.0.smithi134.stdout:2/439: fdatasync df/d10/d30/d49/f4f 0 2024-02-16T22:18:55.546 INFO:tasks.workunit.client.0.smithi134.stdout:6/504: sync 2024-02-16T22:18:55.548 INFO:tasks.workunit.client.0.smithi134.stdout:6/505: truncate d17/d36/d77/d9a/f5f 1373686 0 2024-02-16T22:18:55.548 INFO:tasks.workunit.client.0.smithi134.stdout:6/506: chown d17/d27/d30 21 1 2024-02-16T22:18:55.548 INFO:tasks.workunit.client.0.smithi134.stdout:6/507: chown d17/d27/d4f/f68 3 1 2024-02-16T22:18:55.550 INFO:tasks.workunit.client.0.smithi134.stdout:6/508: link d17/d63/f82 d17/d27/d93/f9e 0 2024-02-16T22:18:55.552 INFO:tasks.workunit.client.0.smithi134.stdout:6/509: mknod d17/d27/d30/c9f 0 2024-02-16T22:18:55.553 INFO:tasks.workunit.client.0.smithi134.stdout:2/440: write df/d10/d15/d5a/f26 [1123802,85866] 0 2024-02-16T22:18:55.553 INFO:tasks.workunit.client.0.smithi134.stdout:6/510: mknod d17/d63/ca0 0 2024-02-16T22:18:55.556 INFO:tasks.workunit.client.0.smithi134.stdout:2/441: mkdir df/d10/d30/d49/d85 0 2024-02-16T22:18:55.556 INFO:tasks.workunit.client.0.smithi134.stdout:2/442: chown df/d10/d15/d5a/f48 58 1 2024-02-16T22:18:55.556 INFO:tasks.workunit.client.0.smithi134.stdout:2/443: creat df/d10/f86 x:0 0 0 2024-02-16T22:18:55.557 INFO:tasks.workunit.client.0.smithi134.stdout:6/511: mknod d17/d27/d30/d32/ca1 0 2024-02-16T22:18:55.560 INFO:tasks.workunit.client.0.smithi134.stdout:2/444: rename df/d10/d3a/l69 to df/d10/d15/l87 0 2024-02-16T22:18:55.560 INFO:tasks.workunit.client.0.smithi134.stdout:8/493: dwrite d2/df/f6e [0,4194304] 0 2024-02-16T22:18:55.562 INFO:tasks.workunit.client.0.smithi134.stdout:6/512: creat d17/d36/d77/d9a/d28/fa2 x:0 0 0 2024-02-16T22:18:55.562 INFO:tasks.workunit.client.0.smithi134.stdout:6/513: chown d17/d27/d4f/d52/d97 47279579 1 2024-02-16T22:18:55.562 INFO:tasks.workunit.client.0.smithi134.stdout:2/445: rmdir df/d10/d15/d5a 39 2024-02-16T22:18:55.563 INFO:tasks.workunit.client.0.smithi134.stdout:2/446: chown df/d10/d30/d49/c83 3 1 2024-02-16T22:18:55.563 INFO:tasks.workunit.client.0.smithi134.stdout:2/447: chown df/c5c 961310086 1 2024-02-16T22:18:55.565 INFO:tasks.workunit.client.0.smithi134.stdout:6/514: write d17/d27/d4f/f68 [846655,95046] 0 2024-02-16T22:18:55.565 INFO:tasks.workunit.client.0.smithi134.stdout:8/494: mkdir d2/da3 0 2024-02-16T22:18:55.565 INFO:tasks.workunit.client.0.smithi134.stdout:6/515: chown f14 26940 1 2024-02-16T22:18:55.565 INFO:tasks.workunit.client.0.smithi134.stdout:6/516: creat d17/fa3 x:0 0 0 2024-02-16T22:18:55.566 INFO:tasks.workunit.client.0.smithi134.stdout:8/495: mkdir d2/df/d18/d27/d85/da4 0 2024-02-16T22:18:55.606 INFO:tasks.workunit.client.0.smithi134.stdout:6/517: dwrite d17/d27/f62 [0,4194304] 0 2024-02-16T22:18:55.609 INFO:tasks.workunit.client.0.smithi134.stdout:6/518: creat d17/d36/d77/d9a/d28/d5b/d88/fa4 x:0 0 0 2024-02-16T22:18:55.609 INFO:tasks.workunit.client.0.smithi134.stdout:6/519: fdatasync d17/d36/d77/d9a/d28/d5b/f6d 0 2024-02-16T22:18:55.609 INFO:tasks.workunit.client.0.smithi134.stdout:6/520: readlink d17/d36/d77/d9a/d28/d5b/l72 0 2024-02-16T22:18:55.609 INFO:tasks.workunit.client.0.smithi134.stdout:6/521: write f10 [8753,62126] 0 2024-02-16T22:18:55.609 INFO:tasks.workunit.client.0.smithi134.stdout:6/522: chown d17/d27/d4f/d52/d79/f6b 24712 1 2024-02-16T22:18:55.610 INFO:tasks.workunit.client.0.smithi134.stdout:6/523: chown d17/d27/d4f/d52/d79/f4a 1853791521 1 2024-02-16T22:18:55.610 INFO:tasks.workunit.client.0.smithi134.stdout:2/448: dwrite df/d10/d3a/f44 [0,4194304] 0 2024-02-16T22:18:55.610 INFO:tasks.workunit.client.0.smithi134.stdout:6/524: write f14 [55991,114814] 0 2024-02-16T22:18:55.610 INFO:tasks.workunit.client.0.smithi134.stdout:6/525: write d17/d36/d77/d9a/f4b [3616881,2199] 0 2024-02-16T22:18:55.610 INFO:tasks.workunit.client.0.smithi134.stdout:8/496: dwrite d2/df/d18/f6 [0,4194304] 0 2024-02-16T22:18:55.610 INFO:tasks.workunit.client.0.smithi134.stdout:8/497: chown d2/df/d18/d27/f7b 804 1 2024-02-16T22:18:55.610 INFO:tasks.workunit.client.0.smithi134.stdout:8/498: write d2/df/d18/d12/f92 [324709,10420] 0 2024-02-16T22:18:55.616 INFO:tasks.workunit.client.0.smithi134.stdout:6/526: mkdir d17/d36/d77/d9a/d28/d5b/d88/d90/da5 0 2024-02-16T22:18:55.616 INFO:tasks.workunit.client.0.smithi134.stdout:8/499: mkdir d2/df/d18/d27/d85/da4/da5 0 2024-02-16T22:18:55.623 INFO:tasks.workunit.client.0.smithi134.stdout:2/449: rmdir df/d10 39 2024-02-16T22:18:55.624 INFO:tasks.workunit.client.0.smithi134.stdout:8/500: mknod d2/df/d18/d2a/d41/d59/ca6 0 2024-02-16T22:18:55.626 INFO:tasks.workunit.client.0.smithi134.stdout:2/450: creat df/d10/d15/d5a/d34/f88 x:0 0 0 2024-02-16T22:18:55.626 INFO:tasks.workunit.client.0.smithi134.stdout:2/451: dread - df/d41/f80 zero size 2024-02-16T22:18:55.626 INFO:tasks.workunit.client.0.smithi134.stdout:2/452: readlink df/d10/d30/d49/d82/d1b/l37 0 2024-02-16T22:18:55.628 INFO:tasks.workunit.client.0.smithi134.stdout:2/453: rename df/d10/d15/c19 to df/d10/d30/d49/d82/c89 0 2024-02-16T22:18:55.628 INFO:tasks.workunit.client.0.smithi134.stdout:2/454: stat df/d10/d30/l62 0 2024-02-16T22:18:55.630 INFO:tasks.workunit.client.0.smithi134.stdout:0/495: sync 2024-02-16T22:18:55.630 INFO:tasks.workunit.client.0.smithi134.stdout:0/496: chown d2/d56/f8b 8532875 1 2024-02-16T22:18:55.654 INFO:tasks.workunit.client.0.smithi134.stdout:8/501: dwrite d2/df/d18/fc [0,4194304] 0 2024-02-16T22:18:55.656 INFO:tasks.workunit.client.0.smithi134.stdout:8/502: creat d2/df/d18/d2a/d41/d59/da0/d9f/fa7 x:0 0 0 2024-02-16T22:18:55.657 INFO:tasks.workunit.client.0.smithi134.stdout:2/455: dwrite df/d10/f4b [0,4194304] 0 2024-02-16T22:18:55.657 INFO:tasks.workunit.client.0.smithi134.stdout:2/456: dread - df/d10/d15/d5a/f65 zero size 2024-02-16T22:18:55.657 INFO:tasks.workunit.client.0.smithi134.stdout:0/497: dwrite d2/d4b/f5b [0,4194304] 0 2024-02-16T22:18:55.657 INFO:tasks.workunit.client.0.smithi134.stdout:0/498: write d2/dc/d32/d45/f79 [614409,62851] 0 2024-02-16T22:18:55.658 INFO:tasks.workunit.client.0.smithi134.stdout:2/457: rmdir df 39 2024-02-16T22:18:55.658 INFO:tasks.workunit.client.0.smithi134.stdout:0/499: fdatasync d2/dc/d32/d45/f79 0 2024-02-16T22:18:55.660 INFO:tasks.workunit.client.0.smithi134.stdout:2/458: mknod df/d10/d30/d49/d85/c8a 0 2024-02-16T22:18:55.665 INFO:tasks.workunit.client.0.smithi134.stdout:2/459: read df/d10/d30/d49/d82/d1b/f22 [3934436,21477] 0 2024-02-16T22:18:55.666 INFO:tasks.workunit.client.0.smithi134.stdout:2/460: creat df/d10/d30/d49/d82/d1b/f8b x:0 0 0 2024-02-16T22:18:55.666 INFO:tasks.workunit.client.0.smithi134.stdout:2/461: dread - df/d10/d15/d5a/f4c zero size 2024-02-16T22:18:55.672 INFO:tasks.workunit.client.0.smithi134.stdout:0/500: dwrite d2/dc/d2d/f54 [0,4194304] 0 2024-02-16T22:18:55.672 INFO:tasks.workunit.client.0.smithi134.stdout:0/501: stat d2/dc/f15 0 2024-02-16T22:18:55.672 INFO:tasks.workunit.client.0.smithi134.stdout:0/502: fsync d2/f5c 0 2024-02-16T22:18:55.672 INFO:tasks.workunit.client.0.smithi134.stdout:0/503: read d2/d20/d50/f51 [523823,89438] 0 2024-02-16T22:18:55.673 INFO:tasks.workunit.client.0.smithi134.stdout:0/504: fsync d2/d20/d50/f51 0 2024-02-16T22:18:55.673 INFO:tasks.workunit.client.0.smithi134.stdout:0/505: truncate d2/d20/d7a/d7e/fa4 156840 0 2024-02-16T22:18:55.673 INFO:tasks.workunit.client.0.smithi134.stdout:2/462: creat df/d10/d15/d5a/f8c x:0 0 0 2024-02-16T22:18:55.675 INFO:tasks.workunit.client.0.smithi134.stdout:0/506: truncate d2/dc/f7c 3831081 0 2024-02-16T22:18:55.676 INFO:tasks.workunit.client.0.smithi134.stdout:0/507: fsync d2/dc/d32/f42 0 2024-02-16T22:18:55.677 INFO:tasks.workunit.client.0.smithi134.stdout:2/463: link df/d10/d15/d5a/c1c df/d10/d30/d49/d82/d1b/c8d 0 2024-02-16T22:18:55.678 INFO:tasks.workunit.client.0.smithi134.stdout:2/464: fdatasync df/d10/d30/d49/d82/d1b/f2f 0 2024-02-16T22:18:55.678 INFO:tasks.workunit.client.0.smithi134.stdout:2/465: write df/d10/d30/f6c [324618,66879] 0 2024-02-16T22:18:55.679 INFO:tasks.workunit.client.0.smithi134.stdout:0/508: rename d2/dc/d2d/d34/d87/c88 to d2/d20/d77/d85/caa 0 2024-02-16T22:18:55.680 INFO:tasks.workunit.client.0.smithi134.stdout:0/509: symlink d2/dc/d2d/d34/lab 0 2024-02-16T22:18:55.682 INFO:tasks.workunit.client.0.smithi134.stdout:0/510: mknod d2/d56/cac 0 2024-02-16T22:18:55.682 INFO:tasks.workunit.client.0.smithi134.stdout:0/511: chown d2/dc/c21 113149898 1 2024-02-16T22:18:55.682 INFO:tasks.workunit.client.0.smithi134.stdout:0/512: readlink d2/d20/d7a/d65/l8a 0 2024-02-16T22:18:55.683 INFO:tasks.workunit.client.0.smithi134.stdout:0/513: creat d2/dc/d2d/d34/fad x:0 0 0 2024-02-16T22:18:55.683 INFO:tasks.workunit.client.0.smithi134.stdout:0/514: chown d2/c49 2598028 1 2024-02-16T22:18:55.684 INFO:tasks.workunit.client.0.smithi134.stdout:0/515: rename d2/dc/d97/la1 to d2/d56/lae 0 2024-02-16T22:18:55.684 INFO:tasks.workunit.client.0.smithi134.stdout:0/516: read d2/dc/d32/d45/f79 [671184,87434] 0 2024-02-16T22:18:55.685 INFO:tasks.workunit.client.0.smithi134.stdout:0/517: creat d2/d20/d77/d85/d94/faf x:0 0 0 2024-02-16T22:18:55.687 INFO:tasks.workunit.client.0.smithi134.stdout:0/518: symlink d2/dc/d2d/d34/d87/lb0 0 2024-02-16T22:18:55.687 INFO:tasks.workunit.client.0.smithi134.stdout:0/519: readlink d2/dc/d32/d3e/d5e/la5 0 2024-02-16T22:18:55.689 INFO:tasks.workunit.client.0.smithi134.stdout:4/423: sync 2024-02-16T22:18:55.689 INFO:tasks.workunit.client.0.smithi134.stdout:4/424: creat d0/d6/d8/d5e/f96 x:0 0 0 2024-02-16T22:18:55.689 INFO:tasks.workunit.client.0.smithi134.stdout:4/425: dread - d0/d6/d8/d5e/f96 zero size 2024-02-16T22:18:55.691 INFO:tasks.workunit.client.0.smithi134.stdout:2/466: dwrite df/d10/d30/d49/d82/d1b/f56 [0,4194304] 0 2024-02-16T22:18:55.691 INFO:tasks.workunit.client.0.smithi134.stdout:2/467: creat df/d41/f8e x:0 0 0 2024-02-16T22:18:55.691 INFO:tasks.workunit.client.0.smithi134.stdout:2/468: creat df/d10/d15/d5a/d34/f8f x:0 0 0 2024-02-16T22:18:55.697 INFO:tasks.workunit.client.0.smithi134.stdout:2/469: mkdir df/d10/d15/d90 0 2024-02-16T22:18:55.700 INFO:tasks.workunit.client.0.smithi134.stdout:2/470: creat df/d10/d15/f91 x:0 0 0 2024-02-16T22:18:55.702 INFO:tasks.workunit.client.0.smithi134.stdout:2/471: creat df/d10/d15/d90/f92 x:0 0 0 2024-02-16T22:18:55.704 INFO:tasks.workunit.client.0.smithi134.stdout:2/472: creat df/d10/d30/d4d/f93 x:0 0 0 2024-02-16T22:18:55.705 INFO:tasks.workunit.client.0.smithi134.stdout:2/473: mkdir df/d10/d30/d4d/d94 0 2024-02-16T22:18:55.708 INFO:tasks.workunit.client.0.smithi134.stdout:2/474: truncate df/d10/d15/d5a/f48 289152 0 2024-02-16T22:18:55.709 INFO:tasks.workunit.client.0.smithi134.stdout:2/475: symlink df/d10/d3a/l95 0 2024-02-16T22:18:55.709 INFO:tasks.workunit.client.0.smithi134.stdout:2/476: fdatasync df/d10/d30/d49/d82/d1b/f2f 0 2024-02-16T22:18:55.712 INFO:tasks.workunit.client.0.smithi134.stdout:0/520: dwrite d2/d20/d7a/fa9 [0,4194304] 0 2024-02-16T22:18:55.712 INFO:tasks.workunit.client.0.smithi134.stdout:0/521: chown d2/dc/l1b 1501 1 2024-02-16T22:18:55.712 INFO:tasks.workunit.client.0.smithi134.stdout:0/522: chown d2/dc/d32/fa6 14651 1 2024-02-16T22:18:55.714 INFO:tasks.workunit.client.0.smithi134.stdout:4/426: dwrite d0/d6/d16/f8b [0,4194304] 0 2024-02-16T22:18:55.721 INFO:tasks.workunit.client.0.smithi134.stdout:4/427: mkdir d0/d6/d22/d97 0 2024-02-16T22:18:55.721 INFO:tasks.workunit.client.0.smithi134.stdout:4/428: creat d0/d6/d22/d25/f98 x:0 0 0 2024-02-16T22:18:55.721 INFO:tasks.workunit.client.0.smithi134.stdout:4/429: dread - d0/d6/d8/d5e/f96 zero size 2024-02-16T22:18:55.772 INFO:tasks.workunit.client.0.smithi134.stdout:2/477: dwrite df/d10/d15/d5a/d34/f3e [4194304,4194304] 0 2024-02-16T22:18:55.772 INFO:tasks.workunit.client.0.smithi134.stdout:2/478: fsync df/d10/d15/d5a/d2d/f4a 0 2024-02-16T22:18:55.772 INFO:tasks.workunit.client.0.smithi134.stdout:2/479: truncate df/d10/d15/d5a/f8c 125941 0 2024-02-16T22:18:55.772 INFO:tasks.workunit.client.0.smithi134.stdout:2/480: write df/d10/d3a/f50 [4820732,44841] 0 2024-02-16T22:18:55.775 INFO:tasks.workunit.client.0.smithi134.stdout:2/481: unlink c3 0 2024-02-16T22:18:55.775 INFO:tasks.workunit.client.0.smithi134.stdout:2/482: write df/d10/d15/d90/f92 [92781,121489] 0 2024-02-16T22:18:55.776 INFO:tasks.workunit.client.0.smithi134.stdout:0/523: dwrite d2/d4b/f5b [0,4194304] 0 2024-02-16T22:18:55.776 INFO:tasks.workunit.client.0.smithi134.stdout:0/524: write d2/dc/d2d/d34/f46 [5212638,48730] 0 2024-02-16T22:18:55.776 INFO:tasks.workunit.client.0.smithi134.stdout:0/525: fdatasync d2/dc/d32/f42 0 2024-02-16T22:18:55.776 INFO:tasks.workunit.client.0.smithi134.stdout:0/526: chown d2/d4b/f5b 122 1 2024-02-16T22:18:55.783 INFO:tasks.workunit.client.0.smithi134.stdout:0/527: symlink d2/d20/d77/d85/d94/lb1 0 2024-02-16T22:18:55.796 INFO:tasks.workunit.client.0.smithi134.stdout:1/503: sync 2024-02-16T22:18:55.796 INFO:tasks.workunit.client.0.smithi134.stdout:5/554: sync 2024-02-16T22:18:55.796 INFO:tasks.workunit.client.0.smithi134.stdout:3/484: sync 2024-02-16T22:18:55.796 INFO:tasks.workunit.client.0.smithi134.stdout:9/582: sync 2024-02-16T22:18:55.796 INFO:tasks.workunit.client.0.smithi134.stdout:8/503: sync 2024-02-16T22:18:55.796 INFO:tasks.workunit.client.0.smithi134.stdout:7/522: sync 2024-02-16T22:18:55.796 INFO:tasks.workunit.client.0.smithi134.stdout:8/504: chown d2/df/d18/cb 24 1 2024-02-16T22:18:55.796 INFO:tasks.workunit.client.0.smithi134.stdout:6/527: sync 2024-02-16T22:18:55.796 INFO:tasks.workunit.client.0.smithi134.stdout:5/555: creat d2/d35/d72/fb5 x:0 0 0 2024-02-16T22:18:55.798 INFO:tasks.workunit.client.0.smithi134.stdout:1/504: creat d5/fa6 x:0 0 0 2024-02-16T22:18:55.798 INFO:tasks.workunit.client.0.smithi134.stdout:3/485: getdents da/d1c/d24/d29/d40/d8a 0 2024-02-16T22:18:55.798 INFO:tasks.workunit.client.0.smithi134.stdout:3/486: fdatasync da/f3a 0 2024-02-16T22:18:55.799 INFO:tasks.workunit.client.0.smithi134.stdout:3/487: chown da/d12/d2a/f3c 11597058 1 2024-02-16T22:18:55.800 INFO:tasks.workunit.client.0.smithi134.stdout:2/483: dwrite df/d10/d15/f1d [0,4194304] 0 2024-02-16T22:18:55.801 INFO:tasks.workunit.client.0.smithi134.stdout:2/484: write df/d10/f47 [117416,62904] 0 2024-02-16T22:18:55.801 INFO:tasks.workunit.client.0.smithi134.stdout:2/485: write df/d10/d15/d5a/d2d/f4a [299132,2063] 0 2024-02-16T22:18:55.803 INFO:tasks.workunit.client.0.smithi134.stdout:7/523: rename d2/d5/d22/l51 to d2/d6/d7d/d92/la8 0 2024-02-16T22:18:55.804 INFO:tasks.workunit.client.0.smithi134.stdout:6/528: unlink d17/d27/d4f/d52/d79/d92/f99 0 2024-02-16T22:18:55.804 INFO:tasks.workunit.client.0.smithi134.stdout:6/529: fdatasync d17/d27/d4f/f50 0 2024-02-16T22:18:55.806 INFO:tasks.workunit.client.0.smithi134.stdout:2/486: mkdir df/d10/d30/d49/d7b/d96 0 2024-02-16T22:18:55.806 INFO:tasks.workunit.client.0.smithi134.stdout:2/487: fdatasync df/d10/d15/d5a/f8c 0 2024-02-16T22:18:55.808 INFO:tasks.workunit.client.0.smithi134.stdout:6/530: creat d17/d36/d77/d9a/d28/d5b/fa6 x:0 0 0 2024-02-16T22:18:55.809 INFO:tasks.workunit.client.0.smithi134.stdout:1/505: mknod d5/da/d2d/ca7 0 2024-02-16T22:18:55.809 INFO:tasks.workunit.client.0.smithi134.stdout:1/506: write f3 [1012839,51607] 0 2024-02-16T22:18:55.810 INFO:tasks.workunit.client.0.smithi134.stdout:2/488: mkdir df/d41/d97 0 2024-02-16T22:18:55.811 INFO:tasks.workunit.client.0.smithi134.stdout:7/524: mknod d2/d6/d17/d31/ca9 0 2024-02-16T22:18:55.811 INFO:tasks.workunit.client.0.smithi134.stdout:0/528: dwrite d2/d4b/f5b [4194304,4194304] 0 2024-02-16T22:18:55.812 INFO:tasks.workunit.client.0.smithi134.stdout:0/529: creat d2/dc/d32/d45/fb2 x:0 0 0 2024-02-16T22:18:55.812 INFO:tasks.workunit.client.0.smithi134.stdout:6/531: mkdir d17/d27/d93/d9c/da7 0 2024-02-16T22:18:55.815 INFO:tasks.workunit.client.0.smithi134.stdout:1/507: creat d5/d1a/d23/d3c/fa8 x:0 0 0 2024-02-16T22:18:55.815 INFO:tasks.workunit.client.0.smithi134.stdout:1/508: fsync d5/da/d21/f37 0 2024-02-16T22:18:55.815 INFO:tasks.workunit.client.0.smithi134.stdout:7/525: mknod d2/d6/d7d/d92/da5/d63/caa 0 2024-02-16T22:18:55.816 INFO:tasks.workunit.client.0.smithi134.stdout:2/489: write df/d10/d15/d5a/d2d/f6d [1229517,79060] 0 2024-02-16T22:18:55.816 INFO:tasks.workunit.client.0.smithi134.stdout:2/490: write df/d10/f47 [231004,110272] 0 2024-02-16T22:18:55.816 INFO:tasks.workunit.client.0.smithi134.stdout:2/491: fsync df/d10/d15/d5a/d2d/f63 0 2024-02-16T22:18:55.817 INFO:tasks.workunit.client.0.smithi134.stdout:3/488: write da/d12/f17 [5927750,123143] 0 2024-02-16T22:18:55.818 INFO:tasks.workunit.client.0.smithi134.stdout:1/509: unlink d5/d1a/d23/d3c/d6a/d5c/d72/f96 0 2024-02-16T22:18:55.821 INFO:tasks.workunit.client.0.smithi134.stdout:2/492: unlink cc 0 2024-02-16T22:18:55.821 INFO:tasks.workunit.client.0.smithi134.stdout:2/493: dread - df/d10/d15/d5a/d34/f8f zero size 2024-02-16T22:18:55.821 INFO:tasks.workunit.client.0.smithi134.stdout:2/494: fdatasync df/d41/f5e 0 2024-02-16T22:18:55.825 INFO:tasks.workunit.client.0.smithi134.stdout:0/530: dread d2/dc/f15 [0,4194304] 0 2024-02-16T22:18:55.825 INFO:tasks.workunit.client.0.smithi134.stdout:5/556: dread f0 [4194304,4194304] 0 2024-02-16T22:18:55.825 INFO:tasks.workunit.client.0.smithi134.stdout:3/489: rename da/d1c/d24/d29/d40/d8a/d8f/d5f/d62/f96 to da/d12/f9c 0 2024-02-16T22:18:55.825 INFO:tasks.workunit.client.0.smithi134.stdout:0/531: creat d2/d20/d7a/fb3 x:0 0 0 2024-02-16T22:18:55.826 INFO:tasks.workunit.client.0.smithi134.stdout:1/510: symlink d5/d1a/d23/d8c/la9 0 2024-02-16T22:18:55.827 INFO:tasks.workunit.client.0.smithi134.stdout:1/511: dread - d5/d1a/d53/f7a zero size 2024-02-16T22:18:55.827 INFO:tasks.workunit.client.0.smithi134.stdout:1/512: dread - d5/da/d1c/f94 zero size 2024-02-16T22:18:55.827 INFO:tasks.workunit.client.0.smithi134.stdout:1/513: write d5/da/d21/d52/f6c [546537,9253] 0 2024-02-16T22:18:55.827 INFO:tasks.workunit.client.0.smithi134.stdout:1/514: read - d5/da/d2d/f84 zero size 2024-02-16T22:18:55.827 INFO:tasks.workunit.client.0.smithi134.stdout:1/515: creat d5/d1a/d53/d86/faa x:0 0 0 2024-02-16T22:18:55.830 INFO:tasks.workunit.client.0.smithi134.stdout:5/557: mknod d2/d35/d36/d46/d68/cb6 0 2024-02-16T22:18:55.830 INFO:tasks.workunit.client.0.smithi134.stdout:1/516: dread d5/d1a/d23/f2b [0,4194304] 0 2024-02-16T22:18:55.830 INFO:tasks.workunit.client.0.smithi134.stdout:1/517: dread - d5/d1a/d82/f97 zero size 2024-02-16T22:18:55.832 INFO:tasks.workunit.client.0.smithi134.stdout:0/532: rename d2/d20/d77/l8c to d2/d20/d77/d85/d94/lb4 0 2024-02-16T22:18:55.832 INFO:tasks.workunit.client.0.smithi134.stdout:3/490: dread da/f3a [0,4194304] 0 2024-02-16T22:18:55.833 INFO:tasks.workunit.client.0.smithi134.stdout:3/491: chown da/d1c/d24/d29/d51/d79 44040882 1 2024-02-16T22:18:55.833 INFO:tasks.workunit.client.0.smithi134.stdout:3/492: dread - da/d1c/d24/d29/d51/d80/d90/f99 zero size 2024-02-16T22:18:55.835 INFO:tasks.workunit.client.0.smithi134.stdout:1/518: unlink d5/d1a/d4d/c6e 0 2024-02-16T22:18:55.838 INFO:tasks.workunit.client.0.smithi134.stdout:3/493: rename da/d1c/d24/d29/d56/c6e to da/d1c/d24/d29/d40/d8a/d8f/c9d 0 2024-02-16T22:18:55.839 INFO:tasks.workunit.client.0.smithi134.stdout:1/519: symlink d5/d1a/d82/lab 0 2024-02-16T22:18:55.842 INFO:tasks.workunit.client.0.smithi134.stdout:1/520: mknod d5/d1a/d82/cac 0 2024-02-16T22:18:55.845 INFO:tasks.workunit.client.0.smithi134.stdout:1/521: unlink d5/da/d2d/ca7 0 2024-02-16T22:18:55.845 INFO:tasks.workunit.client.0.smithi134.stdout:1/522: creat d5/da/d21/d45/fad x:0 0 0 2024-02-16T22:18:55.845 INFO:tasks.workunit.client.0.smithi134.stdout:9/583: dwrite db/d20/d22/f50 [0,4194304] 0 2024-02-16T22:18:55.848 INFO:tasks.workunit.client.0.smithi134.stdout:9/584: truncate db/d20/d22/d46/f49 951126 0 2024-02-16T22:18:55.849 INFO:tasks.workunit.client.0.smithi134.stdout:9/585: mknod db/d20/d22/d51/cc6 0 2024-02-16T22:18:55.851 INFO:tasks.workunit.client.0.smithi134.stdout:8/505: dwrite d2/df/d7c/f81 [0,4194304] 0 2024-02-16T22:18:55.854 INFO:tasks.workunit.client.0.smithi134.stdout:7/526: dwrite d2/d6/d17/f82 [0,4194304] 0 2024-02-16T22:18:55.859 INFO:tasks.workunit.client.0.smithi134.stdout:5/558: dwrite d2/d9/dc/d98/db3/f9e [0,4194304] 0 2024-02-16T22:18:55.860 INFO:tasks.workunit.client.0.smithi134.stdout:1/523: write d5/da/d21/d45/f7b [3433877,11791] 0 2024-02-16T22:18:55.863 INFO:tasks.workunit.client.0.smithi134.stdout:5/559: symlink d2/d35/d36/d3d/d9c/d4b/lb7 0 2024-02-16T22:18:55.863 INFO:tasks.workunit.client.0.smithi134.stdout:5/560: readlink d2/d9/l66 0 2024-02-16T22:18:55.863 INFO:tasks.workunit.client.0.smithi134.stdout:0/533: dwrite d2/dc/d48/d60/f6d [0,4194304] 0 2024-02-16T22:18:55.866 INFO:tasks.workunit.client.0.smithi134.stdout:8/506: write d2/df/f10 [7102548,36199] 0 2024-02-16T22:18:55.866 INFO:tasks.workunit.client.0.smithi134.stdout:6/532: dwrite d17/f3a [0,4194304] 0 2024-02-16T22:18:55.866 INFO:tasks.workunit.client.0.smithi134.stdout:5/561: getdents d2/d9/dc/d98/db3 0 2024-02-16T22:18:55.867 INFO:tasks.workunit.client.0.smithi134.stdout:5/562: write d2/d9/f6f [565653,2458] 0 2024-02-16T22:18:55.868 INFO:tasks.workunit.client.0.smithi134.stdout:3/494: dread da/d12/f17 [4194304,4194304] 0 2024-02-16T22:18:55.868 INFO:tasks.workunit.client.0.smithi134.stdout:0/534: write d2/dc/d48/f75 [572695,26925] 0 2024-02-16T22:18:55.868 INFO:tasks.workunit.client.0.smithi134.stdout:3/495: chown da/d1c/f67 91 1 2024-02-16T22:18:55.878 INFO:tasks.workunit.client.0.smithi134.stdout:2/495: dwrite df/d10/d3a/f50 [4194304,4194304] 0 2024-02-16T22:18:55.879 INFO:tasks.workunit.client.0.smithi134.stdout:6/533: symlink d17/d36/d77/d9a/d28/la8 0 2024-02-16T22:18:55.881 INFO:tasks.workunit.client.0.smithi134.stdout:9/586: dwrite db/d20/d9a/fac [0,4194304] 0 2024-02-16T22:18:55.882 INFO:tasks.workunit.client.0.smithi134.stdout:5/563: unlink d2/d9/dc/d15/f67 0 2024-02-16T22:18:55.882 INFO:tasks.workunit.client.0.smithi134.stdout:5/564: stat d2/d35/d36/d3d/d63/d90/c94 0 2024-02-16T22:18:55.882 INFO:tasks.workunit.client.0.smithi134.stdout:5/565: write d2/d35/d36/d3d/d63/f70 [9804,45157] 0 2024-02-16T22:18:55.883 INFO:tasks.workunit.client.0.smithi134.stdout:3/496: truncate da/d1c/d24/f52 3870733 0 2024-02-16T22:18:55.883 INFO:tasks.workunit.client.0.smithi134.stdout:3/497: chown da/d1c/d24/d2c 13963 1 2024-02-16T22:18:55.883 INFO:tasks.workunit.client.0.smithi134.stdout:3/498: write da/d1c/d24/d29/d40/d8a/d8f/f3f [2462152,59065] 0 2024-02-16T22:18:55.891 INFO:tasks.workunit.client.0.smithi134.stdout:8/507: dread d2/f36 [0,4194304] 0 2024-02-16T22:18:55.891 INFO:tasks.workunit.client.0.smithi134.stdout:2/496: symlink df/d6f/l98 0 2024-02-16T22:18:55.892 INFO:tasks.workunit.client.0.smithi134.stdout:2/497: fdatasync df/d10/d15/d5a/d34/f3e 0 2024-02-16T22:18:55.892 INFO:tasks.workunit.client.0.smithi134.stdout:8/508: write d2/df/d18/d27/f7b [1381762,102122] 0 2024-02-16T22:18:55.893 INFO:tasks.workunit.client.0.smithi134.stdout:6/534: rename d17/d27/f62 to d17/d27/fa9 0 2024-02-16T22:18:55.895 INFO:tasks.workunit.client.0.smithi134.stdout:1/524: dwrite d5/d1a/d23/d3c/d6a/d5c/fa3 [0,4194304] 0 2024-02-16T22:18:55.895 INFO:tasks.workunit.client.0.smithi134.stdout:7/527: dwrite d2/d7/d40/fa7 [0,4194304] 0 2024-02-16T22:18:55.897 INFO:tasks.workunit.client.0.smithi134.stdout:7/528: dread d2/d5/d22/d26/d48/d7f/f39 [0,4194304] 0 2024-02-16T22:18:55.898 INFO:tasks.workunit.client.0.smithi134.stdout:9/587: mknod db/d20/d32/cc7 0 2024-02-16T22:18:55.900 INFO:tasks.workunit.client.0.smithi134.stdout:0/535: dwrite d2/d20/f23 [0,4194304] 0 2024-02-16T22:18:55.900 INFO:tasks.workunit.client.0.smithi134.stdout:0/536: fdatasync d2/d56/f8b 0 2024-02-16T22:18:55.900 INFO:tasks.workunit.client.0.smithi134.stdout:3/499: rename da/d1c/d24/d29/l63 to da/d1c/d24/d29/d40/d8a/d8f/d6d/l9e 0 2024-02-16T22:18:55.902 INFO:tasks.workunit.client.0.smithi134.stdout:4/430: sync 2024-02-16T22:18:55.902 INFO:tasks.workunit.client.0.smithi134.stdout:4/431: write d0/f77 [1145824,28946] 0 2024-02-16T22:18:55.905 INFO:tasks.workunit.client.0.smithi134.stdout:8/509: symlink d2/df/d18/d2a/la8 0 2024-02-16T22:18:55.905 INFO:tasks.workunit.client.0.smithi134.stdout:8/510: write d2/d80/f8f [5246465,41403] 0 2024-02-16T22:18:55.907 INFO:tasks.workunit.client.0.smithi134.stdout:6/535: mkdir d17/d36/d77/d9a/d70/d86/daa 0 2024-02-16T22:18:55.914 INFO:tasks.workunit.client.0.smithi134.stdout:1/525: symlink d5/d1a/d4d/lae 0 2024-02-16T22:18:55.914 INFO:tasks.workunit.client.0.smithi134.stdout:1/526: chown d5/f24 16 1 2024-02-16T22:18:55.929 INFO:tasks.workunit.client.0.smithi134.stdout:0/537: symlink d2/d4b/lb5 0 2024-02-16T22:18:55.932 INFO:tasks.workunit.client.0.smithi134.stdout:3/500: rmdir da/d1c/d24/d29/d51/d6a 0 2024-02-16T22:18:55.936 INFO:tasks.workunit.client.0.smithi134.stdout:4/432: link d0/d6/d22/d25/d2a/l36 d0/d6/d22/d25/l99 0 2024-02-16T22:18:55.938 INFO:tasks.workunit.client.0.smithi134.stdout:6/536: creat d17/d27/d4f/d52/d87/fab x:0 0 0 2024-02-16T22:18:55.938 INFO:tasks.workunit.client.0.smithi134.stdout:6/537: fsync d17/d27/d4f/d52/d79/f4a 0 2024-02-16T22:18:55.939 INFO:tasks.workunit.client.0.smithi134.stdout:6/538: dread - d17/fa3 zero size 2024-02-16T22:18:55.939 INFO:tasks.workunit.client.0.smithi134.stdout:6/539: chown d17/l20 8 1 2024-02-16T22:18:55.941 INFO:tasks.workunit.client.0.smithi134.stdout:7/529: rename d2/d7 to d2/d5/d19/d84/d86/d93/dab 0 2024-02-16T22:18:55.942 INFO:tasks.workunit.client.0.smithi134.stdout:3/501: truncate da/f3a 392294 0 2024-02-16T22:18:55.945 INFO:tasks.workunit.client.0.smithi134.stdout:4/433: unlink d0/d6/d8/d32/d63/f65 0 2024-02-16T22:18:55.945 INFO:tasks.workunit.client.0.smithi134.stdout:4/434: truncate d0/d31/f87 166353 0 2024-02-16T22:18:55.947 INFO:tasks.workunit.client.0.smithi134.stdout:9/588: rename db/d20/d22/d64/db0/lc0 to db/d20/d22/d51/lc8 0 2024-02-16T22:18:55.948 INFO:tasks.workunit.client.0.smithi134.stdout:7/530: mknod d2/d5/d19/d84/d86/cac 0 2024-02-16T22:18:55.950 INFO:tasks.workunit.client.0.smithi134.stdout:4/435: mkdir d0/d6/d1e/d9a 0 2024-02-16T22:18:55.951 INFO:tasks.workunit.client.0.smithi134.stdout:9/589: dread db/dc/f68 [0,4194304] 0 2024-02-16T22:18:55.952 INFO:tasks.workunit.client.0.smithi134.stdout:2/498: rename df/d10/d3a/l95 to df/d10/d30/d49/l99 0 2024-02-16T22:18:55.952 INFO:tasks.workunit.client.0.smithi134.stdout:6/540: dwrite d17/d36/d77/d9a/d28/f96 [0,4194304] 0 2024-02-16T22:18:55.954 INFO:tasks.workunit.client.0.smithi134.stdout:7/531: symlink d2/d6/d91/lad 0 2024-02-16T22:18:55.956 INFO:tasks.workunit.client.0.smithi134.stdout:8/511: rename d2/df/d18/d2a/f9e to d2/df/d18/fa9 0 2024-02-16T22:18:55.956 INFO:tasks.workunit.client.0.smithi134.stdout:8/512: stat d2/f5f 0 2024-02-16T22:18:55.960 INFO:tasks.workunit.client.0.smithi134.stdout:6/541: creat d17/d27/d93/d9c/da7/fac x:0 0 0 2024-02-16T22:18:55.962 INFO:tasks.workunit.client.0.smithi134.stdout:7/532: mkdir d2/d5/d19/dae 0 2024-02-16T22:18:55.964 INFO:tasks.workunit.client.0.smithi134.stdout:1/527: rename d5/f8 to d5/da/d21/d45/d93/faf 0 2024-02-16T22:18:55.965 INFO:tasks.workunit.client.0.smithi134.stdout:8/513: unlink d2/df/d18/d2a/d41/d61/d90/c9d 0 2024-02-16T22:18:55.967 INFO:tasks.workunit.client.0.smithi134.stdout:4/436: dread d0/d6/d22/d25/f43 [0,4194304] 0 2024-02-16T22:18:55.967 INFO:tasks.workunit.client.0.smithi134.stdout:4/437: dread - d0/d6/d22/d25/f90 zero size 2024-02-16T22:18:55.967 INFO:tasks.workunit.client.0.smithi134.stdout:4/438: chown d0/d6/d8/d30 92291 1 2024-02-16T22:18:55.967 INFO:tasks.workunit.client.0.smithi134.stdout:4/439: fsync d0/d6/d16/f8b 0 2024-02-16T22:18:55.967 INFO:tasks.workunit.client.0.smithi134.stdout:1/528: mknod d5/d1a/d82/cb0 0 2024-02-16T22:18:55.969 INFO:tasks.workunit.client.0.smithi134.stdout:8/514: mkdir d2/df/d18/d2a/d41/d59/da0/d40/d53/daa 0 2024-02-16T22:18:55.969 INFO:tasks.workunit.client.0.smithi134.stdout:8/515: stat d2/df/d7c 0 2024-02-16T22:18:55.969 INFO:tasks.workunit.client.0.smithi134.stdout:8/516: write d2/f8b [1100,122525] 0 2024-02-16T22:18:55.969 INFO:tasks.workunit.client.0.smithi134.stdout:8/517: stat d2/df/d18/d2a/d41/d59 0 2024-02-16T22:18:55.969 INFO:tasks.workunit.client.0.smithi134.stdout:8/518: chown d2/df/f33 8839422 1 2024-02-16T22:18:55.970 INFO:tasks.workunit.client.0.smithi134.stdout:1/529: rmdir d5/da 39 2024-02-16T22:18:55.972 INFO:tasks.workunit.client.0.smithi134.stdout:0/538: rename d2/dc/d48/d60 to d2/d20/d77/d85/db6 0 2024-02-16T22:18:55.972 INFO:tasks.workunit.client.0.smithi134.stdout:0/539: fsync d2/d20/f23 0 2024-02-16T22:18:55.975 INFO:tasks.workunit.client.0.smithi134.stdout:6/542: rename d17/d36/d77/d9a/d28/d5b/f91 to d17/d36/d77/d9a/d28/fad 0 2024-02-16T22:18:55.978 INFO:tasks.workunit.client.0.smithi134.stdout:4/440: dread d0/d6/d1e/f27 [0,4194304] 0 2024-02-16T22:18:55.979 INFO:tasks.workunit.client.0.smithi134.stdout:7/533: rename d2/d6/d7d/d92/da5/d63/l85 to d2/d5/d4c/laf 0 2024-02-16T22:18:55.979 INFO:tasks.workunit.client.0.smithi134.stdout:8/519: rename d2/df/d18/d27 to d2/df/d18/d27/d85/da4/da5/dab 22 2024-02-16T22:18:55.980 INFO:tasks.workunit.client.0.smithi134.stdout:8/520: dread - d2/df/d18/d2a/d41/d59/da0/d40/f8e zero size 2024-02-16T22:18:55.980 INFO:tasks.workunit.client.0.smithi134.stdout:7/534: write d2/d5/f87 [240458,2255] 0 2024-02-16T22:18:55.980 INFO:tasks.workunit.client.0.smithi134.stdout:6/543: rmdir d17/d27/d4f/d52/d79 39 2024-02-16T22:18:55.981 INFO:tasks.workunit.client.0.smithi134.stdout:8/521: getdents d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72 0 2024-02-16T22:18:55.981 INFO:tasks.workunit.client.0.smithi134.stdout:8/522: readlink d2/df/d18/d2a/l69 0 2024-02-16T22:18:55.981 INFO:tasks.workunit.client.0.smithi134.stdout:8/523: write d2/df/d18/d12/f4e [4591691,62085] 0 2024-02-16T22:18:55.981 INFO:tasks.workunit.client.0.smithi134.stdout:0/540: write d2/f26 [377164,5152] 0 2024-02-16T22:18:55.981 INFO:tasks.workunit.client.0.smithi134.stdout:7/535: creat d2/d6/d7d/d9e/fb0 x:0 0 0 2024-02-16T22:18:55.983 INFO:tasks.workunit.client.0.smithi134.stdout:8/524: mknod d2/d80/cac 0 2024-02-16T22:18:55.983 INFO:tasks.workunit.client.0.smithi134.stdout:1/530: rmdir d5/da/d21/d45 39 2024-02-16T22:18:55.984 INFO:tasks.workunit.client.0.smithi134.stdout:1/531: creat d5/da/d21/d52/d9b/fb1 x:0 0 0 2024-02-16T22:18:55.985 INFO:tasks.workunit.client.0.smithi134.stdout:7/536: creat d2/d5/d19/fb1 x:0 0 0 2024-02-16T22:18:55.985 INFO:tasks.workunit.client.0.smithi134.stdout:7/537: creat d2/d6/d7d/d9e/fb2 x:0 0 0 2024-02-16T22:18:55.986 INFO:tasks.workunit.client.0.smithi134.stdout:4/441: dread d0/d6/f24 [0,4194304] 0 2024-02-16T22:18:55.986 INFO:tasks.workunit.client.0.smithi134.stdout:4/442: fsync d0/d6/d22/d25/f69 0 2024-02-16T22:18:55.986 INFO:tasks.workunit.client.0.smithi134.stdout:8/525: mknod d2/df/d18/d12/cad 0 2024-02-16T22:18:55.991 INFO:tasks.workunit.client.0.smithi134.stdout:6/544: dread d17/d36/d77/d9a/d28/f96 [0,4194304] 0 2024-02-16T22:18:55.991 INFO:tasks.workunit.client.0.smithi134.stdout:6/545: stat d17/d36/d77/d9a/d70 0 2024-02-16T22:18:55.991 INFO:tasks.workunit.client.0.smithi134.stdout:6/546: fsync d17/f7f 0 2024-02-16T22:18:55.991 INFO:tasks.workunit.client.0.smithi134.stdout:6/547: creat d17/d36/d77/d9a/d28/fae x:0 0 0 2024-02-16T22:18:55.991 INFO:tasks.workunit.client.0.smithi134.stdout:0/541: rename d2/d20/d7a/d65 to d2/db7 0 2024-02-16T22:18:55.993 INFO:tasks.workunit.client.0.smithi134.stdout:7/538: mkdir d2/d6/d91/db3 0 2024-02-16T22:18:55.993 INFO:tasks.workunit.client.0.smithi134.stdout:7/539: write d2/d5/d19/d84/d86/fa0 [1037846,17475] 0 2024-02-16T22:18:55.994 INFO:tasks.workunit.client.0.smithi134.stdout:7/540: write d2/d6/fa4 [549149,51413] 0 2024-02-16T22:18:55.999 INFO:tasks.workunit.client.0.smithi134.stdout:1/532: rmdir d5/d1a/d23/d3c 39 2024-02-16T22:18:56.001 INFO:tasks.workunit.client.0.smithi134.stdout:6/548: mkdir d17/d36/d77/d9a/d28/d5b/d88/daf 0 2024-02-16T22:18:56.001 INFO:tasks.workunit.client.0.smithi134.stdout:4/443: rmdir d0/d6/d16/d1a 39 2024-02-16T22:18:56.002 INFO:tasks.workunit.client.0.smithi134.stdout:1/533: truncate d5/da/d1c/f29 3515255 0 2024-02-16T22:18:56.003 INFO:tasks.workunit.client.0.smithi134.stdout:6/549: mknod d17/cb0 0 2024-02-16T22:18:56.003 INFO:tasks.workunit.client.0.smithi134.stdout:4/444: symlink d0/d6/d8/d32/d63/l9b 0 2024-02-16T22:18:56.003 INFO:tasks.workunit.client.0.smithi134.stdout:4/445: creat d0/d6/d8/d32/d68/f9c x:0 0 0 2024-02-16T22:18:56.004 INFO:tasks.workunit.client.0.smithi134.stdout:4/446: chown d0/d6/d1e/d9a 188464 1 2024-02-16T22:18:56.004 INFO:tasks.workunit.client.0.smithi134.stdout:4/447: chown d0/d6/d16/d86 158 1 2024-02-16T22:18:56.004 INFO:tasks.workunit.client.0.smithi134.stdout:4/448: dread - d0/d6/d22/d25/f98 zero size 2024-02-16T22:18:56.004 INFO:tasks.workunit.client.0.smithi134.stdout:4/449: chown d0/d6/d22/d25/f8e 4070 1 2024-02-16T22:18:56.004 INFO:tasks.workunit.client.0.smithi134.stdout:1/534: unlink d5/d1a/d23/d61/l71 0 2024-02-16T22:18:56.005 INFO:tasks.workunit.client.0.smithi134.stdout:6/550: creat d17/d36/d77/d9a/d28/d5b/d88/d90/fb1 x:0 0 0 2024-02-16T22:18:56.005 INFO:tasks.workunit.client.0.smithi134.stdout:6/551: chown d17/d36/d77/d9a/f7e 1 1 2024-02-16T22:18:56.064 INFO:tasks.workunit.client.0.smithi134.stdout:6/552: getdents d17/d27/d4f/d52/d87 0 2024-02-16T22:18:56.064 INFO:tasks.workunit.client.0.smithi134.stdout:6/553: dread - d17/d36/d77/d9a/d28/d5b/f6d zero size 2024-02-16T22:18:56.064 INFO:tasks.workunit.client.0.smithi134.stdout:6/554: fdatasync d17/d27/f34 0 2024-02-16T22:18:56.064 INFO:tasks.workunit.client.0.smithi134.stdout:6/555: fsync d17/f76 0 2024-02-16T22:18:56.065 INFO:tasks.workunit.client.0.smithi134.stdout:0/542: write d2/f1c [11110963,119717] 0 2024-02-16T22:18:56.068 INFO:tasks.workunit.client.0.smithi134.stdout:4/450: read d0/d6/d22/f67 [3124107,117111] 0 2024-02-16T22:18:56.069 INFO:tasks.workunit.client.0.smithi134.stdout:4/451: creat d0/d6/d5d/f9d x:0 0 0 2024-02-16T22:18:56.070 INFO:tasks.workunit.client.0.smithi134.stdout:4/452: mkdir d0/d6/d1e/d3b/d9e 0 2024-02-16T22:18:56.072 INFO:tasks.workunit.client.0.smithi134.stdout:0/543: dread d2/dc/d32/d45/f79 [0,4194304] 0 2024-02-16T22:18:56.072 INFO:tasks.workunit.client.0.smithi134.stdout:0/544: creat d2/dc/d32/d45/fb8 x:0 0 0 2024-02-16T22:18:56.072 INFO:tasks.workunit.client.0.smithi134.stdout:0/545: write d2/dc/d32/d3e/d5e/f6f [4241424,71187] 0 2024-02-16T22:18:56.073 INFO:tasks.workunit.client.0.smithi134.stdout:4/453: rename d0/d6/d16/f20 to d0/d6/d16/d86/f9f 0 2024-02-16T22:18:56.073 INFO:tasks.workunit.client.0.smithi134.stdout:4/454: creat d0/d6/d1e/d7c/fa0 x:0 0 0 2024-02-16T22:18:56.073 INFO:tasks.workunit.client.0.smithi134.stdout:4/455: readlink d0/d6/d22/d25/l99 0 2024-02-16T22:18:56.075 INFO:tasks.workunit.client.0.smithi134.stdout:0/546: mkdir d2/d20/d77/db9 0 2024-02-16T22:18:56.076 INFO:tasks.workunit.client.0.smithi134.stdout:1/535: dwrite d5/da/f25 [0,4194304] 0 2024-02-16T22:18:56.076 INFO:tasks.workunit.client.0.smithi134.stdout:1/536: write d5/da/d21/d52/d9b/fa1 [794159,162] 0 2024-02-16T22:18:56.077 INFO:tasks.workunit.client.0.smithi134.stdout:0/547: rename d2/d56/lae to d2/d20/d77/db9/lba 0 2024-02-16T22:18:56.091 INFO:tasks.workunit.client.0.smithi134.stdout:3/502: dwrite da/d1c/d24/d29/d51/f95 [0,4194304] 0 2024-02-16T22:18:56.091 INFO:tasks.workunit.client.0.smithi134.stdout:9/590: dwrite db/d20/d22/d64/d69/d6e/f7f [0,4194304] 0 2024-02-16T22:18:56.092 INFO:tasks.workunit.client.0.smithi134.stdout:2/499: dwrite df/d10/d3a/f71 [0,4194304] 0 2024-02-16T22:18:56.092 INFO:tasks.workunit.client.0.smithi134.stdout:0/548: write d2/dc/d2d/d34/f37 [4138295,117571] 0 2024-02-16T22:18:56.092 INFO:tasks.workunit.client.0.smithi134.stdout:0/549: fsync d2/d20/d50/f82 0 2024-02-16T22:18:56.093 INFO:tasks.workunit.client.0.smithi134.stdout:3/503: mkdir da/d1c/d24/d29/d40/d8a/d8f/d9f 0 2024-02-16T22:18:56.096 INFO:tasks.workunit.client.0.smithi134.stdout:9/591: rename db/d20/d22/d46/f8a to db/d20/d22/d51/fc9 0 2024-02-16T22:18:56.098 INFO:tasks.workunit.client.0.smithi134.stdout:2/500: dread - df/d10/d30/d4d/f52 zero size 2024-02-16T22:18:56.099 INFO:tasks.workunit.client.0.smithi134.stdout:7/541: dwrite d2/d5/d22/f66 [0,4194304] 0 2024-02-16T22:18:56.100 INFO:tasks.workunit.client.0.smithi134.stdout:0/550: getdents d2/db7 0 2024-02-16T22:18:56.102 INFO:tasks.workunit.client.0.smithi134.stdout:6/556: dwrite d17/d36/d77/d9a/d28/d5b/d88/fa4 [0,4194304] 0 2024-02-16T22:18:56.102 INFO:tasks.workunit.client.0.smithi134.stdout:1/537: dwrite d5/d1a/d23/d61/f83 [0,4194304] 0 2024-02-16T22:18:56.103 INFO:tasks.workunit.client.0.smithi134.stdout:9/592: mknod db/d20/d22/d64/cca 0 2024-02-16T22:18:56.105 INFO:tasks.workunit.client.0.smithi134.stdout:4/456: dwrite d0/d6/d1e/d39/f85 [0,4194304] 0 2024-02-16T22:18:56.110 INFO:tasks.workunit.client.0.smithi134.stdout:1/538: link d5/d1a/d23/f43 d5/da/d21/d52/d9b/d9f/fb2 0 2024-02-16T22:18:56.110 INFO:tasks.workunit.client.0.smithi134.stdout:1/539: fdatasync d5/d1a/d53/d86/faa 0 2024-02-16T22:18:56.110 INFO:tasks.workunit.client.0.smithi134.stdout:1/540: dread - d5/da/d21/d52/d9b/fb1 zero size 2024-02-16T22:18:56.110 INFO:tasks.workunit.client.0.smithi134.stdout:1/541: chown d5/d1a/c7e 0 1 2024-02-16T22:18:56.112 INFO:tasks.workunit.client.0.smithi134.stdout:9/593: mkdir db/d20/d22/d64/dc2/dcb 0 2024-02-16T22:18:56.112 INFO:tasks.workunit.client.0.smithi134.stdout:9/594: write db/d20/f9f [983054,123467] 0 2024-02-16T22:18:56.117 INFO:tasks.workunit.client.0.smithi134.stdout:4/457: mkdir d0/da1 0 2024-02-16T22:18:56.119 INFO:tasks.workunit.client.0.smithi134.stdout:0/551: symlink d2/dc/d32/lbb 0 2024-02-16T22:18:56.120 INFO:tasks.workunit.client.0.smithi134.stdout:9/595: mkdir db/d20/d22/d91/d99/dcc 0 2024-02-16T22:18:56.124 INFO:tasks.workunit.client.0.smithi134.stdout:4/458: rename d0/d6/d5d to d0/d6/d8/da2 0 2024-02-16T22:18:56.126 INFO:tasks.workunit.client.0.smithi134.stdout:0/552: rename d2/d20/d50/f63 to d2/dc/d32/fbc 0 2024-02-16T22:18:56.126 INFO:tasks.workunit.client.0.smithi134.stdout:0/553: fdatasync d2/d20/d77/d85/d94/faf 0 2024-02-16T22:18:56.127 INFO:tasks.workunit.client.0.smithi134.stdout:3/504: dwrite da/f11 [4194304,4194304] 0 2024-02-16T22:18:56.127 INFO:tasks.workunit.client.0.smithi134.stdout:0/554: mkdir d2/d20/d77/dbd 0 2024-02-16T22:18:56.127 INFO:tasks.workunit.client.0.smithi134.stdout:0/555: dread - d2/dc/d32/fa6 zero size 2024-02-16T22:18:56.136 INFO:tasks.workunit.client.0.smithi134.stdout:7/542: dwrite d2/f8d [0,4194304] 0 2024-02-16T22:18:56.136 INFO:tasks.workunit.client.0.smithi134.stdout:5/566: sync 2024-02-16T22:18:56.137 INFO:tasks.workunit.client.0.smithi134.stdout:7/543: write d2/d5/d19/f2b [1422641,26018] 0 2024-02-16T22:18:56.138 INFO:tasks.workunit.client.0.smithi134.stdout:1/542: dwrite d5/f46 [0,4194304] 0 2024-02-16T22:18:56.138 INFO:tasks.workunit.client.0.smithi134.stdout:1/543: chown d5/d1a/d63/fa5 21066 1 2024-02-16T22:18:56.138 INFO:tasks.workunit.client.0.smithi134.stdout:2/501: dwrite df/d10/d15/d5a/f65 [0,4194304] 0 2024-02-16T22:18:56.138 INFO:tasks.workunit.client.0.smithi134.stdout:6/557: dwrite d17/d36/d77/d9a/f2e [0,4194304] 0 2024-02-16T22:18:56.138 INFO:tasks.workunit.client.0.smithi134.stdout:6/558: chown d17/d36/c38 819009 1 2024-02-16T22:18:56.141 INFO:tasks.workunit.client.0.smithi134.stdout:5/567: creat d2/d9/dc/daf/fb8 x:0 0 0 2024-02-16T22:18:56.145 INFO:tasks.workunit.client.0.smithi134.stdout:7/544: dread d2/d6/d17/f23 [0,4194304] 0 2024-02-16T22:18:56.145 INFO:tasks.workunit.client.0.smithi134.stdout:1/544: mkdir d5/da/d21/d52/d9b/db3 0 2024-02-16T22:18:56.149 INFO:tasks.workunit.client.0.smithi134.stdout:6/559: mknod d17/d36/d77/d9a/d28/d5b/d88/cb2 0 2024-02-16T22:18:56.149 INFO:tasks.workunit.client.0.smithi134.stdout:6/560: readlink d17/d36/d77/d9a/d28/l57 0 2024-02-16T22:18:56.151 INFO:tasks.workunit.client.0.smithi134.stdout:2/502: dread df/d10/d30/d49/f54 [0,4194304] 0 2024-02-16T22:18:56.151 INFO:tasks.workunit.client.0.smithi134.stdout:5/568: rename d2/f4 to d2/d35/d36/d46/d68/fb9 0 2024-02-16T22:18:56.151 INFO:tasks.workunit.client.0.smithi134.stdout:5/569: truncate d2/d35/d36/f77 4249389 0 2024-02-16T22:18:56.152 INFO:tasks.workunit.client.0.smithi134.stdout:1/545: mknod d5/da/d21/d45/d93/cb4 0 2024-02-16T22:18:56.152 INFO:tasks.workunit.client.0.smithi134.stdout:1/546: write d5/da/d21/d45/f56 [2026611,33692] 0 2024-02-16T22:18:56.152 INFO:tasks.workunit.client.0.smithi134.stdout:7/545: creat d2/d6/d91/db3/fb4 x:0 0 0 2024-02-16T22:18:56.153 INFO:tasks.workunit.client.0.smithi134.stdout:5/570: truncate d2/d9/dc/f3a 405650 0 2024-02-16T22:18:56.154 INFO:tasks.workunit.client.0.smithi134.stdout:1/547: unlink d5/d1a/d53/f7a 0 2024-02-16T22:18:56.155 INFO:tasks.workunit.client.0.smithi134.stdout:7/546: symlink d2/d5/d22/d83/lb5 0 2024-02-16T22:18:56.155 INFO:tasks.workunit.client.0.smithi134.stdout:1/548: creat d5/fb5 x:0 0 0 2024-02-16T22:18:56.156 INFO:tasks.workunit.client.0.smithi134.stdout:1/549: stat d5/d1a/d4d/d99 0 2024-02-16T22:18:56.157 INFO:tasks.workunit.client.0.smithi134.stdout:7/547: rename d2/d6/d17/f23 to d2/d5/d22/d26/d48/fb6 0 2024-02-16T22:18:56.157 INFO:tasks.workunit.client.0.smithi134.stdout:7/548: dread - d2/d6/d7d/d92/da5/d63/f72 zero size 2024-02-16T22:18:56.158 INFO:tasks.workunit.client.0.smithi134.stdout:1/550: unlink d5/f90 0 2024-02-16T22:18:56.159 INFO:tasks.workunit.client.0.smithi134.stdout:1/551: mkdir d5/da/d21/d52/d9b/db6 0 2024-02-16T22:18:56.165 INFO:tasks.workunit.client.0.smithi134.stdout:5/571: write d2/d35/d36/d3d/fb0 [2004904,857] 0 2024-02-16T22:18:56.165 INFO:tasks.workunit.client.0.smithi134.stdout:4/459: dwrite d0/d6/d22/d25/f43 [0,4194304] 0 2024-02-16T22:18:56.166 INFO:tasks.workunit.client.0.smithi134.stdout:4/460: chown d0/d6/d8/d30/l7a 59 1 2024-02-16T22:18:56.170 INFO:tasks.workunit.client.0.smithi134.stdout:5/572: rmdir d2/d8f 39 2024-02-16T22:18:56.170 INFO:tasks.workunit.client.0.smithi134.stdout:0/556: dwrite d2/dc/d32/d3e/f80 [0,4194304] 0 2024-02-16T22:18:56.170 INFO:tasks.workunit.client.0.smithi134.stdout:0/557: fsync d2/d20/d77/fa8 0 2024-02-16T22:18:56.171 INFO:tasks.workunit.client.0.smithi134.stdout:0/558: chown d2/d20/d77/dbd 30062546 1 2024-02-16T22:18:56.171 INFO:tasks.workunit.client.0.smithi134.stdout:9/596: dwrite db/d20/f9f [0,4194304] 0 2024-02-16T22:18:56.172 INFO:tasks.workunit.client.0.smithi134.stdout:5/573: symlink d2/d35/d36/d3d/lba 0 2024-02-16T22:18:56.174 INFO:tasks.workunit.client.0.smithi134.stdout:6/561: dread d17/d27/fa9 [0,4194304] 0 2024-02-16T22:18:56.174 INFO:tasks.workunit.client.0.smithi134.stdout:3/505: dwrite da/d12/d2a/f3c [0,4194304] 0 2024-02-16T22:18:56.175 INFO:tasks.workunit.client.0.smithi134.stdout:2/503: write df/d10/f47 [3001146,127563] 0 2024-02-16T22:18:56.175 INFO:tasks.workunit.client.0.smithi134.stdout:2/504: read - df/d10/d30/d49/d82/d1b/f64 zero size 2024-02-16T22:18:56.175 INFO:tasks.workunit.client.0.smithi134.stdout:3/506: write da/d12/f17 [1832550,34467] 0 2024-02-16T22:18:56.175 INFO:tasks.workunit.client.0.smithi134.stdout:2/505: write df/d10/f86 [1048527,109472] 0 2024-02-16T22:18:56.175 INFO:tasks.workunit.client.0.smithi134.stdout:2/506: readlink df/l2c 0 2024-02-16T22:18:56.175 INFO:tasks.workunit.client.0.smithi134.stdout:2/507: chown df/d10/d30 1548750 1 2024-02-16T22:18:56.175 INFO:tasks.workunit.client.0.smithi134.stdout:0/559: getdents d2/d56 0 2024-02-16T22:18:56.176 INFO:tasks.workunit.client.0.smithi134.stdout:0/560: chown d2/d20/d77/d85/caa 5 1 2024-02-16T22:18:56.179 INFO:tasks.workunit.client.0.smithi134.stdout:9/597: mknod db/d20/d22/d91/ccd 0 2024-02-16T22:18:56.181 INFO:tasks.workunit.client.0.smithi134.stdout:5/574: creat d2/d9/dc/d15/d2f/fbb x:0 0 0 2024-02-16T22:18:56.183 INFO:tasks.workunit.client.0.smithi134.stdout:7/549: dwrite d2/d5/d19/f1d [4194304,4194304] 0 2024-02-16T22:18:56.194 INFO:tasks.workunit.client.0.smithi134.stdout:3/507: creat da/d1c/d24/d29/d40/d8a/d8f/d6d/fa0 x:0 0 0 2024-02-16T22:18:56.194 INFO:tasks.workunit.client.0.smithi134.stdout:3/508: write da/d1c/f67 [649472,20311] 0 2024-02-16T22:18:56.194 INFO:tasks.workunit.client.0.smithi134.stdout:3/509: write da/d1c/d24/f52 [2237439,28556] 0 2024-02-16T22:18:56.197 INFO:tasks.workunit.client.0.smithi134.stdout:0/561: symlink d2/db7/lbe 0 2024-02-16T22:18:56.198 INFO:tasks.workunit.client.0.smithi134.stdout:9/598: mknod db/d20/d22/d64/d69/d89/cce 0 2024-02-16T22:18:56.199 INFO:tasks.workunit.client.0.smithi134.stdout:1/552: dwrite d5/d1a/d53/d86/f9d [0,4194304] 0 2024-02-16T22:18:56.199 INFO:tasks.workunit.client.0.smithi134.stdout:6/562: write d17/d36/d77/d9a/f25 [752233,128987] 0 2024-02-16T22:18:56.199 INFO:tasks.workunit.client.0.smithi134.stdout:1/553: dread - d5/d1a/d53/d86/faa zero size 2024-02-16T22:18:56.199 INFO:tasks.workunit.client.0.smithi134.stdout:6/563: creat d17/d63/fb3 x:0 0 0 2024-02-16T22:18:56.200 INFO:tasks.workunit.client.0.smithi134.stdout:6/564: stat d17/d27/d30/d32/l37 0 2024-02-16T22:18:56.200 INFO:tasks.workunit.client.0.smithi134.stdout:6/565: truncate d17/d36/d77/d9a/d28/fa2 517056 0 2024-02-16T22:18:56.200 INFO:tasks.workunit.client.0.smithi134.stdout:4/461: dwrite d0/f15 [0,4194304] 0 2024-02-16T22:18:56.201 INFO:tasks.workunit.client.0.smithi134.stdout:4/462: dread - d0/d6/d8/d30/f42 zero size 2024-02-16T22:18:56.201 INFO:tasks.workunit.client.0.smithi134.stdout:4/463: fdatasync d0/d6/d22/d25/f56 0 2024-02-16T22:18:56.201 INFO:tasks.workunit.client.0.smithi134.stdout:5/575: link d2/d35/d36/d3d/f78 d2/d35/d36/d3d/d63/d90/fbc 0 2024-02-16T22:18:56.207 INFO:tasks.workunit.client.0.smithi134.stdout:7/550: rename d2/d5/d19/d84/d86/c90 to d2/d5/cb7 0 2024-02-16T22:18:56.210 INFO:tasks.workunit.client.0.smithi134.stdout:5/576: dread d2/d8f/fa4 [0,4194304] 0 2024-02-16T22:18:56.210 INFO:tasks.workunit.client.0.smithi134.stdout:5/577: write d2/f34 [1310574,76689] 0 2024-02-16T22:18:56.210 INFO:tasks.workunit.client.0.smithi134.stdout:5/578: truncate d2/f18 4816750 0 2024-02-16T22:18:56.211 INFO:tasks.workunit.client.0.smithi134.stdout:5/579: truncate d2/d35/d36/d3d/d9c/f2c 4381465 0 2024-02-16T22:18:56.211 INFO:tasks.workunit.client.0.smithi134.stdout:5/580: fdatasync d2/d35/d36/d3d/fb0 0 2024-02-16T22:18:56.212 INFO:tasks.workunit.client.0.smithi134.stdout:3/510: mknod da/d1c/d24/d29/d51/d80/ca1 0 2024-02-16T22:18:56.212 INFO:tasks.workunit.client.0.smithi134.stdout:3/511: chown da/d1c/d24/d29/d51/d79/c8b 0 1 2024-02-16T22:18:56.213 INFO:tasks.workunit.client.0.smithi134.stdout:2/508: link df/d10/d30/d49/f4f df/d10/d30/f9a 0 2024-02-16T22:18:56.213 INFO:tasks.workunit.client.0.smithi134.stdout:2/509: truncate df/d10/f3b 457074 0 2024-02-16T22:18:56.213 INFO:tasks.workunit.client.0.smithi134.stdout:2/510: stat df/d10/d30/d4d/f52 0 2024-02-16T22:18:56.216 INFO:tasks.workunit.client.0.smithi134.stdout:9/599: link db/d20/d22/d64/d69/d89/fbf db/dc/fcf 0 2024-02-16T22:18:56.223 INFO:tasks.workunit.client.0.smithi134.stdout:5/581: mknod d2/d35/d36/d46/d68/d74/cbd 0 2024-02-16T22:18:56.225 INFO:tasks.workunit.client.0.smithi134.stdout:3/512: rmdir da/d1c/d24/d29/d40/d8a/d8f/d6d/d97 0 2024-02-16T22:18:56.226 INFO:tasks.workunit.client.0.smithi134.stdout:0/562: getdents d2/dc/d32 0 2024-02-16T22:18:56.229 INFO:tasks.workunit.client.0.smithi134.stdout:1/554: getdents d5/d1a 0 2024-02-16T22:18:56.229 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:55 smithi173 ceph-mon[37280]: pgmap v250: 65 pgs: 65 active+clean; 949 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 88 MiB/s rd, 122 MiB/s wr, 402 op/s 2024-02-16T22:18:56.231 INFO:tasks.workunit.client.0.smithi134.stdout:5/582: creat d2/d35/d36/d3d/d9c/d4b/fbe x:0 0 0 2024-02-16T22:18:56.231 INFO:tasks.workunit.client.0.smithi134.stdout:5/583: readlink d2/d9/l23 0 2024-02-16T22:18:56.231 INFO:tasks.workunit.client.0.smithi134.stdout:5/584: dread - d2/d35/d36/d46/d68/d74/fa7 zero size 2024-02-16T22:18:56.231 INFO:tasks.workunit.client.0.smithi134.stdout:8/526: sync 2024-02-16T22:18:56.231 INFO:tasks.workunit.client.0.smithi134.stdout:8/527: write d2/f5d [1142966,113372] 0 2024-02-16T22:18:56.231 INFO:tasks.workunit.client.0.smithi134.stdout:8/528: fdatasync d2/df/f6e 0 2024-02-16T22:18:56.232 INFO:tasks.workunit.client.0.smithi134.stdout:3/513: symlink da/d1c/d24/d29/d40/d8a/d8f/d5f/la2 0 2024-02-16T22:18:56.233 INFO:tasks.workunit.client.0.smithi134.stdout:1/555: unlink d5/d1a/d53/ca0 0 2024-02-16T22:18:56.235 INFO:tasks.workunit.client.0.smithi134.stdout:5/585: mkdir d2/d35/d36/da1/dbf 0 2024-02-16T22:18:56.237 INFO:tasks.workunit.client.0.smithi134.stdout:8/529: creat d2/df/d18/d91/fae x:0 0 0 2024-02-16T22:18:56.238 INFO:tasks.workunit.client.0.smithi134.stdout:3/514: symlink da/d1c/d24/d29/d40/d8a/d8f/d5f/d62/la3 0 2024-02-16T22:18:56.240 INFO:tasks.workunit.client.0.smithi134.stdout:1/556: symlink d5/da/d21/d45/d93/lb7 0 2024-02-16T22:18:56.240 INFO:tasks.workunit.client.0.smithi134.stdout:1/557: chown d5/da/d21/d52/l87 8333 1 2024-02-16T22:18:56.240 INFO:tasks.workunit.client.0.smithi134.stdout:5/586: write d2/d9/dc/d32/f5a [8489526,116460] 0 2024-02-16T22:18:56.241 INFO:tasks.workunit.client.0.smithi134.stdout:8/530: creat d2/df/d18/d2a/d41/d59/da0/d9f/faf x:0 0 0 2024-02-16T22:18:56.243 INFO:tasks.workunit.client.0.smithi134.stdout:1/558: unlink d5/d1a/d82/cac 0 2024-02-16T22:18:56.244 INFO:tasks.workunit.client.0.smithi134.stdout:5/587: creat d2/d9/dc/d15/fc0 x:0 0 0 2024-02-16T22:18:56.244 INFO:tasks.workunit.client.0.smithi134.stdout:8/531: truncate d2/df/d18/d12/f92 234516 0 2024-02-16T22:18:56.244 INFO:tasks.workunit.client.0.smithi134.stdout:8/532: fdatasync d2/df/d18/d12/f92 0 2024-02-16T22:18:56.246 INFO:tasks.workunit.client.0.smithi134.stdout:7/551: dwrite d2/d5/d22/d26/f5f [0,4194304] 0 2024-02-16T22:18:56.246 INFO:tasks.workunit.client.0.smithi134.stdout:7/552: fdatasync d2/d5/d19/d4a/f7b 0 2024-02-16T22:18:56.246 INFO:tasks.workunit.client.0.smithi134.stdout:8/533: mknod d2/df/d18/d27/cb0 0 2024-02-16T22:18:56.247 INFO:tasks.workunit.client.0.smithi134.stdout:6/566: dwrite d17/d27/f8d [0,4194304] 0 2024-02-16T22:18:56.247 INFO:tasks.workunit.client.0.smithi134.stdout:6/567: write d17/d27/d4f/f68 [128293,59250] 0 2024-02-16T22:18:56.248 INFO:tasks.workunit.client.0.smithi134.stdout:6/568: write d17/d36/d77/d9a/d28/d5b/fa6 [670350,28106] 0 2024-02-16T22:18:56.248 INFO:tasks.workunit.client.0.smithi134.stdout:6/569: chown d17/d27/d4f/f78 71 1 2024-02-16T22:18:56.248 INFO:tasks.workunit.client.0.smithi134.stdout:2/511: dwrite df/d10/d15/d5a/f13 [0,4194304] 0 2024-02-16T22:18:56.248 INFO:tasks.workunit.client.0.smithi134.stdout:0/563: dwrite d2/dc/d48/f57 [0,4194304] 0 2024-02-16T22:18:56.248 INFO:tasks.workunit.client.0.smithi134.stdout:0/564: write d2/f1c [9321012,32231] 0 2024-02-16T22:18:56.248 INFO:tasks.workunit.client.0.smithi134.stdout:0/565: chown d2/d20/d77/d85/d94 11 1 2024-02-16T22:18:56.249 INFO:tasks.workunit.client.0.smithi134.stdout:3/515: rmdir da/d1c/d24/d29/d56 0 2024-02-16T22:18:56.249 INFO:tasks.workunit.client.0.smithi134.stdout:1/559: mkdir d5/da/db8 0 2024-02-16T22:18:56.249 INFO:tasks.workunit.client.0.smithi134.stdout:1/560: read - d5/da/d2d/f84 zero size 2024-02-16T22:18:56.250 INFO:tasks.workunit.client.0.smithi134.stdout:7/553: creat d2/d5/d22/d26/d48/d7f/d24/fb8 x:0 0 0 2024-02-16T22:18:56.254 INFO:tasks.workunit.client.0.smithi134.stdout:5/588: dread d2/d35/d36/d46/d68/fb9 [0,4194304] 0 2024-02-16T22:18:56.254 INFO:tasks.workunit.client.0.smithi134.stdout:5/589: creat d2/d9/dc/d15/d2f/fc1 x:0 0 0 2024-02-16T22:18:56.255 INFO:tasks.workunit.client.0.smithi134.stdout:5/590: stat d2/d9/dc/d15/d2f/c45 0 2024-02-16T22:18:56.267 INFO:tasks.workunit.client.0.smithi134.stdout:2/512: truncate df/d10/d15/d5a/d34/f3e 6678018 0 2024-02-16T22:18:56.268 INFO:tasks.workunit.client.0.smithi134.stdout:0/566: rmdir d2/d20/d77/d85/db6 39 2024-02-16T22:18:56.268 INFO:tasks.workunit.client.0.smithi134.stdout:0/567: fdatasync d2/dc/d2d/f54 0 2024-02-16T22:18:56.268 INFO:tasks.workunit.client.0.smithi134.stdout:0/568: fdatasync d2/f26 0 2024-02-16T22:18:56.268 INFO:tasks.workunit.client.0.smithi134.stdout:0/569: write d2/f6c [512462,93405] 0 2024-02-16T22:18:56.269 INFO:tasks.workunit.client.0.smithi134.stdout:3/516: mkdir da/d12/d2a/da4 0 2024-02-16T22:18:56.271 INFO:tasks.workunit.client.0.smithi134.stdout:1/561: creat d5/d1a/d23/d3c/d6a/fb9 x:0 0 0 2024-02-16T22:18:56.271 INFO:tasks.workunit.client.0.smithi134.stdout:3/517: dread da/f3a [0,4194304] 0 2024-02-16T22:18:56.271 INFO:tasks.workunit.client.0.smithi134.stdout:1/562: read d5/da/d21/d45/d93/f5e [25385,123418] 0 2024-02-16T22:18:56.272 INFO:tasks.workunit.client.0.smithi134.stdout:8/534: rename d2/df/d18/d2a/d41/d61 to d2/df/d18/d2a/d41/d59/db1 0 2024-02-16T22:18:56.273 INFO:tasks.workunit.client.0.smithi134.stdout:2/513: mkdir df/d10/d30/d49/d85/d9b 0 2024-02-16T22:18:56.274 INFO:tasks.workunit.client.0.smithi134.stdout:0/570: rmdir d2/dc/d97 39 2024-02-16T22:18:56.275 INFO:tasks.workunit.client.0.smithi134.stdout:3/518: symlink da/d1c/d24/d29/d40/d8a/d8f/d9f/la5 0 2024-02-16T22:18:56.275 INFO:tasks.workunit.client.0.smithi134.stdout:1/563: symlink d5/d1a/d23/lba 0 2024-02-16T22:18:56.276 INFO:tasks.workunit.client.0.smithi134.stdout:2/514: mknod df/d10/d30/d49/d82/c9c 0 2024-02-16T22:18:56.279 INFO:tasks.workunit.client.0.smithi134.stdout:5/591: dwrite d2/d9/dc/d15/f41 [0,4194304] 0 2024-02-16T22:18:56.279 INFO:tasks.workunit.client.0.smithi134.stdout:6/570: dwrite d17/d36/f7a [0,4194304] 0 2024-02-16T22:18:56.279 INFO:tasks.workunit.client.0.smithi134.stdout:6/571: chown d17/f1c 31947 1 2024-02-16T22:18:56.279 INFO:tasks.workunit.client.0.smithi134.stdout:5/592: write d2/d9/dc/d15/f3b [4801490,5110] 0 2024-02-16T22:18:56.279 INFO:tasks.workunit.client.0.smithi134.stdout:7/554: dwrite d2/d6/fa4 [0,4194304] 0 2024-02-16T22:18:56.307 INFO:tasks.workunit.client.0.smithi134.stdout:0/571: unlink d2/d20/d7a/fa9 0 2024-02-16T22:18:56.309 INFO:tasks.workunit.client.0.smithi134.stdout:3/519: rename da/d1c/d24/d2c/l2d to da/d1c/d24/d29/d40/la6 0 2024-02-16T22:18:56.309 INFO:tasks.workunit.client.0.smithi134.stdout:3/520: fsync da/d1c/d24/d29/d51/d80/f84 0 2024-02-16T22:18:56.310 INFO:tasks.workunit.client.0.smithi134.stdout:8/535: dwrite d2/df/d18/d2a/d41/d59/da0/d40/f8e [0,4194304] 0 2024-02-16T22:18:56.318 INFO:tasks.workunit.client.0.smithi134.stdout:6/572: truncate d17/d36/d77/d9a/d28/f96 2855426 0 2024-02-16T22:18:56.318 INFO:tasks.workunit.client.0.smithi134.stdout:6/573: chown d17/d27/d30/f33 1328409 1 2024-02-16T22:18:56.318 INFO:tasks.workunit.client.0.smithi134.stdout:6/574: truncate d17/d27/d93/f9e 853800 0 2024-02-16T22:18:56.319 INFO:tasks.workunit.client.0.smithi134.stdout:5/593: mkdir d2/d35/d36/d3d/d9c/dc2 0 2024-02-16T22:18:56.320 INFO:tasks.workunit.client.0.smithi134.stdout:7/555: mknod d2/d6/d91/db3/cb9 0 2024-02-16T22:18:56.323 INFO:tasks.workunit.client.0.smithi134.stdout:5/594: dread d2/d35/d36/d3d/fb0 [0,4194304] 0 2024-02-16T22:18:56.324 INFO:tasks.workunit.client.0.smithi134.stdout:5/595: write d2/d9/dc/daf/fb8 [906129,90557] 0 2024-02-16T22:18:56.324 INFO:tasks.workunit.client.0.smithi134.stdout:5/596: write d2/d35/d36/d46/d68/d74/fb4 [866275,79792] 0 2024-02-16T22:18:56.324 INFO:tasks.workunit.client.0.smithi134.stdout:2/515: dwrite df/d10/d30/d4d/f52 [0,4194304] 0 2024-02-16T22:18:56.325 INFO:tasks.workunit.client.0.smithi134.stdout:0/572: mkdir d2/d20/d77/dbf 0 2024-02-16T22:18:56.326 INFO:tasks.workunit.client.0.smithi134.stdout:3/521: rmdir da/d1c/d24 39 2024-02-16T22:18:56.329 INFO:tasks.workunit.client.0.smithi134.stdout:6/575: mknod d17/d36/d77/d9a/d28/d5b/cb4 0 2024-02-16T22:18:56.330 INFO:tasks.workunit.client.0.smithi134.stdout:8/536: dwrite d2/df/d18/d2a/d41/d59/db1/f7f [0,4194304] 0 2024-02-16T22:18:56.332 INFO:tasks.workunit.client.0.smithi134.stdout:5/597: symlink d2/d35/d36/d46/lc3 0 2024-02-16T22:18:56.336 INFO:tasks.workunit.client.0.smithi134.stdout:2/516: truncate df/d10/d30/f77 979436 0 2024-02-16T22:18:56.336 INFO:tasks.workunit.client.0.smithi134.stdout:2/517: fsync df/d10/d15/d5a/d2d/f6d 0 2024-02-16T22:18:56.337 INFO:tasks.workunit.client.0.smithi134.stdout:3/522: rmdir da/d1c/d24/d29/d40/d8a 39 2024-02-16T22:18:56.339 INFO:tasks.workunit.client.0.smithi134.stdout:6/576: rename d17/f1c to d17/d27/fb5 0 2024-02-16T22:18:56.339 INFO:tasks.workunit.client.0.smithi134.stdout:6/577: read - d17/d36/d77/d9a/d28/fae zero size 2024-02-16T22:18:56.340 INFO:tasks.workunit.client.0.smithi134.stdout:8/537: link d2/df/d18/d2a/d41/d59/db1/l74 d2/lb2 0 2024-02-16T22:18:56.341 INFO:tasks.workunit.client.0.smithi134.stdout:7/556: symlink d2/d6/d17/d31/lba 0 2024-02-16T22:18:56.341 INFO:tasks.workunit.client.0.smithi134.stdout:7/557: chown d2/d6/l4f 3 1 2024-02-16T22:18:56.343 INFO:tasks.workunit.client.0.smithi134.stdout:5/598: mkdir d2/d35/d36/d46/d68/dc4 0 2024-02-16T22:18:56.345 INFO:tasks.workunit.client.0.smithi134.stdout:6/578: rename d17/d36/d77/d9a/d28/d5b/l72 to d17/d27/d4f/d52/d79/d8b/lb6 0 2024-02-16T22:18:56.346 INFO:tasks.workunit.client.0.smithi134.stdout:6/579: stat d17/d36/d77/d9a/d28/d5b/f6d 0 2024-02-16T22:18:56.347 INFO:tasks.workunit.client.0.smithi134.stdout:7/558: write d2/d5/d19/d84/d86/d93/dab/f3e [4219415,57955] 0 2024-02-16T22:18:56.347 INFO:tasks.workunit.client.0.smithi134.stdout:7/559: stat d2/d5/d22/d26/d48/d7f/d24/fb8 0 2024-02-16T22:18:56.347 INFO:tasks.workunit.client.0.smithi134.stdout:7/560: write d2/d5/d19/d84/d86/fa0 [382984,47436] 0 2024-02-16T22:18:56.347 INFO:tasks.workunit.client.0.smithi134.stdout:7/561: chown d2/d6/d91/db3/fb4 122104 1 2024-02-16T22:18:56.350 INFO:tasks.workunit.client.0.smithi134.stdout:2/518: dread df/d10/d30/d49/d82/f20 [4194304,4194304] 0 2024-02-16T22:18:56.351 INFO:tasks.workunit.client.0.smithi134.stdout:5/599: dread d2/d9/dc/d15/f41 [0,4194304] 0 2024-02-16T22:18:56.351 INFO:tasks.workunit.client.0.smithi134.stdout:7/562: rename d2/d5/d22/c46 to d2/d5/d19/d84/cbb 0 2024-02-16T22:18:56.351 INFO:tasks.workunit.client.0.smithi134.stdout:7/563: readlink d2/d5/d22/d83/l9b 0 2024-02-16T22:18:56.353 INFO:tasks.workunit.client.0.smithi134.stdout:2/519: stat df/d10/d30/l46 0 2024-02-16T22:18:56.353 INFO:tasks.workunit.client.0.smithi134.stdout:2/520: fsync df/d10/d15/f16 0 2024-02-16T22:18:56.353 INFO:tasks.workunit.client.0.smithi134.stdout:2/521: stat df/d10/d15/d5a/d2d/l7c 0 2024-02-16T22:18:56.353 INFO:tasks.workunit.client.0.smithi134.stdout:2/522: write df/d10/f47 [457743,124252] 0 2024-02-16T22:18:56.354 INFO:tasks.workunit.client.0.smithi134.stdout:7/564: symlink d2/d5/d19/d84/lbc 0 2024-02-16T22:18:56.356 INFO:tasks.workunit.client.0.smithi134.stdout:2/523: symlink df/d10/d30/d49/d82/d1b/l9d 0 2024-02-16T22:18:56.356 INFO:tasks.workunit.client.0.smithi134.stdout:3/523: dread da/d1c/d24/d29/d51/f95 [0,4194304] 0 2024-02-16T22:18:56.356 INFO:tasks.workunit.client.0.smithi134.stdout:0/573: dwrite d2/dc/d2d/f54 [8388608,4194304] 0 2024-02-16T22:18:56.356 INFO:tasks.workunit.client.0.smithi134.stdout:3/524: write da/d1c/d24/f52 [3201037,104231] 0 2024-02-16T22:18:56.357 INFO:tasks.workunit.client.0.smithi134.stdout:7/565: mkdir d2/d5/d19/d84/d86/d93/dbd 0 2024-02-16T22:18:56.359 INFO:tasks.workunit.client.0.smithi134.stdout:2/524: creat df/d10/f9e x:0 0 0 2024-02-16T22:18:56.359 INFO:tasks.workunit.client.0.smithi134.stdout:2/525: chown df/d10/d15/d5a/d34/c42 20812 1 2024-02-16T22:18:56.359 INFO:tasks.workunit.client.0.smithi134.stdout:2/526: chown df/d10 0 1 2024-02-16T22:18:56.359 INFO:tasks.workunit.client.0.smithi134.stdout:2/527: creat df/d10/d15/d90/f9f x:0 0 0 2024-02-16T22:18:56.359 INFO:tasks.workunit.client.0.smithi134.stdout:2/528: fdatasync df/d10/d30/d49/f54 0 2024-02-16T22:18:56.359 INFO:tasks.workunit.client.0.smithi134.stdout:2/529: write df/d10/d30/d49/f4f [636280,9808] 0 2024-02-16T22:18:56.359 INFO:tasks.workunit.client.0.smithi134.stdout:2/530: read - df/d10/f9e zero size 2024-02-16T22:18:56.360 INFO:tasks.workunit.client.0.smithi134.stdout:8/538: dread d2/df/f6e [0,4194304] 0 2024-02-16T22:18:56.360 INFO:tasks.workunit.client.0.smithi134.stdout:9/600: sync 2024-02-16T22:18:56.360 INFO:tasks.workunit.client.0.smithi134.stdout:4/464: sync 2024-02-16T22:18:56.361 INFO:tasks.workunit.client.0.smithi134.stdout:0/574: creat d2/fc0 x:0 0 0 2024-02-16T22:18:56.362 INFO:tasks.workunit.client.0.smithi134.stdout:5/600: write f0 [7104019,20343] 0 2024-02-16T22:18:56.363 INFO:tasks.workunit.client.0.smithi134.stdout:3/525: truncate da/f11 47154 0 2024-02-16T22:18:56.363 INFO:tasks.workunit.client.0.smithi134.stdout:8/539: write d2/df/d18/d5a/f79 [585113,9048] 0 2024-02-16T22:18:56.369 INFO:tasks.workunit.client.0.smithi134.stdout:9/601: rename db/d20/d22/d64/d69/d6e/f7f to db/dc/fd0 0 2024-02-16T22:18:56.369 INFO:tasks.workunit.client.0.smithi134.stdout:9/602: chown db/dc/f61 182500 1 2024-02-16T22:18:56.370 INFO:tasks.workunit.client.0.smithi134.stdout:0/575: mkdir d2/dc/d32/d3e/dc1 0 2024-02-16T22:18:56.379 INFO:tasks.workunit.client.0.smithi134.stdout:5/601: symlink d2/d9/lc5 0 2024-02-16T22:18:56.379 INFO:tasks.workunit.client.0.smithi134.stdout:7/566: dwrite d2/d5/d19/d4a/f58 [0,4194304] 0 2024-02-16T22:18:56.380 INFO:tasks.workunit.client.0.smithi134.stdout:4/465: dwrite d0/d6/d22/f67 [4194304,4194304] 0 2024-02-16T22:18:56.381 INFO:tasks.workunit.client.0.smithi134.stdout:3/526: creat da/d1c/d24/d29/d40/d8a/fa7 x:0 0 0 2024-02-16T22:18:56.381 INFO:tasks.workunit.client.0.smithi134.stdout:3/527: truncate da/f3a 1368197 0 2024-02-16T22:18:56.383 INFO:tasks.workunit.client.0.smithi134.stdout:8/540: getdents d2/df 0 2024-02-16T22:18:56.384 INFO:tasks.workunit.client.0.smithi134.stdout:8/541: write d2/f24 [1064005,73568] 0 2024-02-16T22:18:56.385 INFO:tasks.workunit.client.0.smithi134.stdout:9/603: mknod db/d20/d22/d51/da2/cd1 0 2024-02-16T22:18:56.385 INFO:tasks.workunit.client.0.smithi134.stdout:9/604: readlink db/l9d 0 2024-02-16T22:18:56.385 INFO:tasks.workunit.client.0.smithi134.stdout:9/605: creat db/d20/fd2 x:0 0 0 2024-02-16T22:18:56.386 INFO:tasks.workunit.client.0.smithi134.stdout:0/576: mkdir d2/dc/d32/d3e/da7/dc2 0 2024-02-16T22:18:56.388 INFO:tasks.workunit.client.0.smithi134.stdout:5/602: mkdir d2/d9/dc6 0 2024-02-16T22:18:56.388 INFO:tasks.workunit.client.0.smithi134.stdout:5/603: stat d2/d35/d36/d3d/d9c/d4b/f7d 0 2024-02-16T22:18:56.392 INFO:tasks.workunit.client.0.smithi134.stdout:7/567: link d2/d6/d7d/d92/da5/d63/l8e d2/d5/d19/d84/d86/lbe 0 2024-02-16T22:18:56.396 INFO:tasks.workunit.client.0.smithi134.stdout:4/466: link d0/d6/d16/d86/f9f d0/d6/d58/d59/fa3 0 2024-02-16T22:18:56.396 INFO:tasks.workunit.client.0.smithi134.stdout:4/467: truncate d0/d6/d22/d25/f69 545539 0 2024-02-16T22:18:56.398 INFO:tasks.workunit.client.0.smithi134.stdout:8/542: rename d2/df/d18/d2a/d41/d59/f56 to d2/df/d18/d2a/d41/d59/db1/d87/fb3 0 2024-02-16T22:18:56.398 INFO:tasks.workunit.client.0.smithi134.stdout:8/543: fdatasync d2/df/d18/d2a/f9c 0 2024-02-16T22:18:56.398 INFO:tasks.workunit.client.0.smithi134.stdout:8/544: write d2/df/d18/f6 [5438027,114217] 0 2024-02-16T22:18:56.401 INFO:tasks.workunit.client.0.smithi134.stdout:9/606: symlink db/d20/d22/d91/d99/ld3 0 2024-02-16T22:18:56.403 INFO:tasks.workunit.client.0.smithi134.stdout:4/468: creat d0/d6/fa4 x:0 0 0 2024-02-16T22:18:56.405 INFO:tasks.workunit.client.0.smithi134.stdout:8/545: creat d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/fb4 x:0 0 0 2024-02-16T22:18:56.408 INFO:tasks.workunit.client.0.smithi134.stdout:8/546: mkdir d2/df/d18/db5 0 2024-02-16T22:18:56.409 INFO:tasks.workunit.client.0.smithi134.stdout:9/607: read db/dc/f12 [707483,115673] 0 2024-02-16T22:18:56.412 INFO:tasks.workunit.client.0.smithi134.stdout:4/469: rmdir d0/d6/d22 39 2024-02-16T22:18:56.412 INFO:tasks.workunit.client.0.smithi134.stdout:4/470: chown d0/d6/d1e/d39/d4e/c5c 0 1 2024-02-16T22:18:56.412 INFO:tasks.workunit.client.0.smithi134.stdout:4/471: fsync d0/d6/d22/d25/f72 0 2024-02-16T22:18:56.413 INFO:tasks.workunit.client.0.smithi134.stdout:8/547: mknod d2/df/d18/db5/cb6 0 2024-02-16T22:18:56.413 INFO:tasks.workunit.client.0.smithi134.stdout:8/548: truncate d2/df/d18/d27/f30 2674350 0 2024-02-16T22:18:56.414 INFO:tasks.workunit.client.0.smithi134.stdout:8/549: readlink d2/df/d18/d12/l52 0 2024-02-16T22:18:56.414 INFO:tasks.workunit.client.0.smithi134.stdout:3/528: dwrite da/d12/f9c [0,4194304] 0 2024-02-16T22:18:56.414 INFO:tasks.workunit.client.0.smithi134.stdout:3/529: getdents da/d12/d2a/da4 0 2024-02-16T22:18:56.415 INFO:tasks.workunit.client.0.smithi134.stdout:5/604: dwrite d2/d35/d36/d46/d68/f8a [0,4194304] 0 2024-02-16T22:18:56.415 INFO:tasks.workunit.client.0.smithi134.stdout:5/605: chown d2/d9/l52 128349317 1 2024-02-16T22:18:56.415 INFO:tasks.workunit.client.0.smithi134.stdout:9/608: dread db/dc/f54 [0,4194304] 0 2024-02-16T22:18:56.415 INFO:tasks.workunit.client.0.smithi134.stdout:9/609: dread - db/d20/d22/d51/fad zero size 2024-02-16T22:18:56.416 INFO:tasks.workunit.client.0.smithi134.stdout:9/610: write db/d20/d22/d51/f7b [935188,50752] 0 2024-02-16T22:18:56.416 INFO:tasks.workunit.client.0.smithi134.stdout:9/611: stat db/d20/d22/d64/d69/d6e/fb8 0 2024-02-16T22:18:56.416 INFO:tasks.workunit.client.0.smithi134.stdout:9/612: read - db/d20/d22/f58 zero size 2024-02-16T22:18:56.416 INFO:tasks.workunit.client.0.smithi134.stdout:9/613: write db/d20/d22/d64/d69/f87 [1383984,21732] 0 2024-02-16T22:18:56.416 INFO:tasks.workunit.client.0.smithi134.stdout:0/577: dwrite d2/f26 [0,4194304] 0 2024-02-16T22:18:56.416 INFO:tasks.workunit.client.0.smithi134.stdout:8/550: rename d2/df/f1c to d2/df/d18/d91/fb7 0 2024-02-16T22:18:56.419 INFO:tasks.workunit.client.0.smithi134.stdout:1/564: sync 2024-02-16T22:18:56.422 INFO:tasks.workunit.client.0.smithi134.stdout:5/606: creat d2/d9/dc6/fc7 x:0 0 0 2024-02-16T22:18:56.428 INFO:tasks.workunit.client.0.smithi134.stdout:9/614: symlink db/d20/d55/ld4 0 2024-02-16T22:18:56.428 INFO:tasks.workunit.client.0.smithi134.stdout:9/615: readlink db/d20/d22/d51/d9b/dbd/l94 0 2024-02-16T22:18:56.429 INFO:tasks.workunit.client.0.smithi134.stdout:0/578: symlink d2/dc/da0/lc3 0 2024-02-16T22:18:56.430 INFO:tasks.workunit.client.0.smithi134.stdout:8/551: creat d2/df/d18/d5a/fb8 x:0 0 0 2024-02-16T22:18:56.431 INFO:tasks.workunit.client.0.smithi134.stdout:8/552: chown d2/df/d18/d2a/d41/d59/db1/d87/f7a 713109919 1 2024-02-16T22:18:56.431 INFO:tasks.workunit.client.0.smithi134.stdout:9/616: getdents db/d20/d22/d64/db0 0 2024-02-16T22:18:56.431 INFO:tasks.workunit.client.0.smithi134.stdout:9/617: write db/fa3 [960714,7875] 0 2024-02-16T22:18:56.432 INFO:tasks.workunit.client.0.smithi134.stdout:1/565: dread d5/da/d2d/f4f [0,4194304] 0 2024-02-16T22:18:56.433 INFO:tasks.workunit.client.0.smithi134.stdout:0/579: mkdir d2/dc/dc4 0 2024-02-16T22:18:56.433 INFO:tasks.workunit.client.0.smithi134.stdout:8/553: getdents d2/df/d18/d2a/d41/d59/da0/d86 0 2024-02-16T22:18:56.433 INFO:tasks.workunit.client.0.smithi134.stdout:8/554: write d2/df/f10 [2491337,95545] 0 2024-02-16T22:18:56.434 INFO:tasks.workunit.client.0.smithi134.stdout:8/555: chown d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e 298791776 1 2024-02-16T22:18:56.434 INFO:tasks.workunit.client.0.smithi134.stdout:8/556: chown d2/df/d18/d27/d85/f96 1554 1 2024-02-16T22:18:56.435 INFO:tasks.workunit.client.0.smithi134.stdout:8/557: creat d2/df/d18/d12/fb9 x:0 0 0 2024-02-16T22:18:56.435 INFO:tasks.workunit.client.0.smithi134.stdout:0/580: dread d2/dc/d48/f75 [0,4194304] 0 2024-02-16T22:18:56.438 INFO:tasks.workunit.client.0.smithi134.stdout:8/558: rename d2/df/d18/d2a/l69 to d2/df/d18/d27/d85/lba 0 2024-02-16T22:18:56.438 INFO:tasks.workunit.client.0.smithi134.stdout:8/559: write d2/f2c [3885490,93557] 0 2024-02-16T22:18:56.438 INFO:tasks.workunit.client.0.smithi134.stdout:8/560: dread - d2/df/d18/d12/fb9 zero size 2024-02-16T22:18:56.439 INFO:tasks.workunit.client.0.smithi134.stdout:0/581: rename d2/d20/l58 to d2/d20/lc5 0 2024-02-16T22:18:56.441 INFO:tasks.workunit.client.0.smithi134.stdout:0/582: unlink d2/f5c 0 2024-02-16T22:18:56.441 INFO:tasks.workunit.client.0.smithi134.stdout:8/561: dread d2/f5d [0,4194304] 0 2024-02-16T22:18:56.441 INFO:tasks.workunit.client.0.smithi134.stdout:8/562: stat d2/df/d18/d2a/f9c 0 2024-02-16T22:18:56.442 INFO:tasks.workunit.client.0.smithi134.stdout:0/583: truncate d2/dc/ff 4531289 0 2024-02-16T22:18:56.442 INFO:tasks.workunit.client.0.smithi134.stdout:0/584: creat d2/dc/d32/d45/fc6 x:0 0 0 2024-02-16T22:18:56.443 INFO:tasks.workunit.client.0.smithi134.stdout:8/563: symlink d2/df/d18/d27/lbb 0 2024-02-16T22:18:56.444 INFO:tasks.workunit.client.0.smithi134.stdout:3/530: dwrite da/d1c/d24/d29/d40/d8a/d8f/d6d/fa0 [0,4194304] 0 2024-02-16T22:18:56.446 INFO:tasks.workunit.client.0.smithi134.stdout:8/564: mkdir d2/df/d18/db5/dbc 0 2024-02-16T22:18:56.448 INFO:tasks.workunit.client.0.smithi134.stdout:5/607: dwrite d2/d35/d36/d3d/d9c/f85 [0,4194304] 0 2024-02-16T22:18:56.450 INFO:tasks.workunit.client.0.smithi134.stdout:8/565: truncate d2/df/d18/d5a/f79 80326 0 2024-02-16T22:18:56.456 INFO:tasks.workunit.client.0.smithi134.stdout:8/566: write d2/df/d18/fc [2494720,84407] 0 2024-02-16T22:18:56.457 INFO:tasks.workunit.client.0.smithi134.stdout:5/608: mkdir d2/d35/d36/d3d/d9c/dc2/dc8 0 2024-02-16T22:18:56.458 INFO:tasks.workunit.client.0.smithi134.stdout:3/531: rmdir da/d1c/d24/d29/d51/d80/d90 39 2024-02-16T22:18:56.459 INFO:tasks.workunit.client.0.smithi134.stdout:5/609: mkdir d2/dc9 0 2024-02-16T22:18:56.460 INFO:tasks.workunit.client.0.smithi134.stdout:3/532: creat da/d1c/d24/d29/d51/d80/d90/fa8 x:0 0 0 2024-02-16T22:18:56.461 INFO:tasks.workunit.client.0.smithi134.stdout:5/610: mkdir d2/d35/d36/d46/d68/dca 0 2024-02-16T22:18:56.461 INFO:tasks.workunit.client.0.smithi134.stdout:5/611: chown d2/d9/dc/d15/d2f/fbb 0 1 2024-02-16T22:18:56.463 INFO:tasks.workunit.client.0.smithi134.stdout:5/612: unlink d2/d35/d36/d3d/d9c/d4b/c91 0 2024-02-16T22:18:56.463 INFO:tasks.workunit.client.0.smithi134.stdout:5/613: dread - d2/d9/dc/d15/d2f/fbb zero size 2024-02-16T22:18:56.463 INFO:tasks.workunit.client.0.smithi134.stdout:5/614: write d2/d35/d36/d46/d68/d74/f75 [29273,52503] 0 2024-02-16T22:18:56.464 INFO:tasks.workunit.client.0.smithi134.stdout:5/615: rmdir d2/d35/d36/da1 39 2024-02-16T22:18:56.465 INFO:tasks.workunit.client.0.smithi134.stdout:9/618: dwrite db/d20/d22/d51/f74 [0,4194304] 0 2024-02-16T22:18:56.466 INFO:tasks.workunit.client.0.smithi134.stdout:0/585: dwrite d2/dc/f15 [0,4194304] 0 2024-02-16T22:18:56.467 INFO:tasks.workunit.client.0.smithi134.stdout:1/566: dwrite d5/da/d2d/f50 [0,4194304] 0 2024-02-16T22:18:56.467 INFO:tasks.workunit.client.0.smithi134.stdout:5/616: rename d2/d9/dc/d15/fc0 to d2/d9/dc/d98/fcb 0 2024-02-16T22:18:56.467 INFO:tasks.workunit.client.0.smithi134.stdout:1/567: creat d5/d1a/d23/d3c/d6a/fbb x:0 0 0 2024-02-16T22:18:56.467 INFO:tasks.workunit.client.0.smithi134.stdout:9/619: mknod db/d20/d55/d8c/cd5 0 2024-02-16T22:18:56.469 INFO:tasks.workunit.client.0.smithi134.stdout:8/567: dread d2/df/d18/d2a/d41/d59/da0/d40/f8e [0,4194304] 0 2024-02-16T22:18:56.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:55 smithi134 ceph-mon[28869]: pgmap v250: 65 pgs: 65 active+clean; 949 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 88 MiB/s rd, 122 MiB/s wr, 402 op/s 2024-02-16T22:18:56.478 INFO:tasks.workunit.client.0.smithi134.stdout:3/533: dwrite da/d12/f7b [0,4194304] 0 2024-02-16T22:18:56.478 INFO:tasks.workunit.client.0.smithi134.stdout:3/534: truncate da/f11 379985 0 2024-02-16T22:18:56.483 INFO:tasks.workunit.client.0.smithi134.stdout:6/580: sync 2024-02-16T22:18:56.483 INFO:tasks.workunit.client.0.smithi134.stdout:6/581: truncate d17/d36/d77/d9a/d28/d5b/fa6 745832 0 2024-02-16T22:18:56.484 INFO:tasks.workunit.client.0.smithi134.stdout:3/535: dread da/d1c/d24/d29/d40/d8a/d8f/f3f [0,4194304] 0 2024-02-16T22:18:56.484 INFO:tasks.workunit.client.0.smithi134.stdout:3/536: chown da/d1c/d24/d29/d40/d8a/d8f/d5f/d62/f6c 459752 1 2024-02-16T22:18:56.485 INFO:tasks.workunit.client.0.smithi134.stdout:8/568: link d2/df/d18/d27/d85/f96 d2/fbd 0 2024-02-16T22:18:56.492 INFO:tasks.workunit.client.0.smithi134.stdout:5/617: link d2/d9/dc/c1b d2/d9/dc/ccc 0 2024-02-16T22:18:56.493 INFO:tasks.workunit.client.0.smithi134.stdout:6/582: getdents d17/d27/d4f/d52/d79/d8b 0 2024-02-16T22:18:56.495 INFO:tasks.workunit.client.0.smithi134.stdout:3/537: creat da/d1c/d24/d29/d40/d8a/d8f/d5f/d62/fa9 x:0 0 0 2024-02-16T22:18:56.500 INFO:tasks.workunit.client.0.smithi134.stdout:6/583: mknod d17/d27/d4f/d52/d97/cb7 0 2024-02-16T22:18:56.501 INFO:tasks.workunit.client.0.smithi134.stdout:3/538: dread da/d1c/d24/d29/d40/d8a/d8f/f44 [0,4194304] 0 2024-02-16T22:18:56.501 INFO:tasks.workunit.client.0.smithi134.stdout:3/539: stat da/d1c/d24/d29/d40 0 2024-02-16T22:18:56.501 INFO:tasks.workunit.client.0.smithi134.stdout:8/569: rmdir d2/df/d7c 39 2024-02-16T22:18:56.501 INFO:tasks.workunit.client.0.smithi134.stdout:8/570: fdatasync d2/df/d18/d2a/d41/d59/da0/d40/f8e 0 2024-02-16T22:18:56.501 INFO:tasks.workunit.client.0.smithi134.stdout:8/571: fdatasync d2/df/d18/d2a/d41/d59/f84 0 2024-02-16T22:18:56.502 INFO:tasks.workunit.client.0.smithi134.stdout:3/540: rename da/d1c/d24/d29/d51/d80/d90/fa8 to da/d1c/d24/d29/d51/d79/faa 0 2024-02-16T22:18:56.503 INFO:tasks.workunit.client.0.smithi134.stdout:3/541: mkdir da/d1c/d24/d29/d51/d80/d89/d8e/dab 0 2024-02-16T22:18:56.503 INFO:tasks.workunit.client.0.smithi134.stdout:3/542: readlink da/l37 0 2024-02-16T22:18:56.503 INFO:tasks.workunit.client.0.smithi134.stdout:3/543: write da/d12/d2a/f3c [4975502,59466] 0 2024-02-16T22:18:56.504 INFO:tasks.workunit.client.0.smithi134.stdout:3/544: readlink da/d1c/d24/d2c/d74/l88 0 2024-02-16T22:18:56.504 INFO:tasks.workunit.client.0.smithi134.stdout:3/545: truncate da/d1c/d24/d29/d40/d8a/d8f/f3f 1025702 0 2024-02-16T22:18:56.505 INFO:tasks.workunit.client.0.smithi134.stdout:2/531: sync 2024-02-16T22:18:56.505 INFO:tasks.workunit.client.0.smithi134.stdout:7/568: sync 2024-02-16T22:18:56.506 INFO:tasks.workunit.client.0.smithi134.stdout:7/569: chown d2/d5/f8b 21224122 1 2024-02-16T22:18:56.506 INFO:tasks.workunit.client.0.smithi134.stdout:3/546: symlink da/d1c/d24/d29/d51/d80/d89/d8e/dab/lac 0 2024-02-16T22:18:56.507 INFO:tasks.workunit.client.0.smithi134.stdout:1/568: dwrite d5/da/d21/d45/f56 [0,4194304] 0 2024-02-16T22:18:56.507 INFO:tasks.workunit.client.0.smithi134.stdout:0/586: dwrite d2/dc/d32/d3e/d5e/f8e [4194304,4194304] 0 2024-02-16T22:18:56.507 INFO:tasks.workunit.client.0.smithi134.stdout:0/587: stat d2/d20/d50/c7f 0 2024-02-16T22:18:56.508 INFO:tasks.workunit.client.0.smithi134.stdout:3/547: mknod da/d1c/d24/d29/d51/d80/d89/d8e/dab/cad 0 2024-02-16T22:18:56.508 INFO:tasks.workunit.client.0.smithi134.stdout:3/548: chown da/d1c/d24/d29/d51/c57 3822 1 2024-02-16T22:18:56.508 INFO:tasks.workunit.client.0.smithi134.stdout:6/584: dread d17/d27/fb5 [0,4194304] 0 2024-02-16T22:18:56.512 INFO:tasks.workunit.client.0.smithi134.stdout:8/572: write d2/df/d18/d2a/d41/d59/da0/f28 [603132,126950] 0 2024-02-16T22:18:56.516 INFO:tasks.workunit.client.0.smithi134.stdout:0/588: mknod d2/d4b/d53/cc7 0 2024-02-16T22:18:56.516 INFO:tasks.workunit.client.0.smithi134.stdout:0/589: dread - d2/fc0 zero size 2024-02-16T22:18:56.518 INFO:tasks.workunit.client.0.smithi134.stdout:2/532: link df/d10/d15/d5a/d34/c5b df/d10/d30/ca0 0 2024-02-16T22:18:56.518 INFO:tasks.workunit.client.0.smithi134.stdout:2/533: fsync df/d10/d15/d5a/d2d/f6d 0 2024-02-16T22:18:56.518 INFO:tasks.workunit.client.0.smithi134.stdout:2/534: write df/d10/d3a/f71 [1733484,31795] 0 2024-02-16T22:18:56.519 INFO:tasks.workunit.client.0.smithi134.stdout:7/570: dread d2/d6/f70 [0,4194304] 0 2024-02-16T22:18:56.519 INFO:tasks.workunit.client.0.smithi134.stdout:7/571: fsync d2/d6/d7d/d9e/fb2 0 2024-02-16T22:18:56.519 INFO:tasks.workunit.client.0.smithi134.stdout:9/620: dwrite db/d20/d22/d64/d69/d6e/fb8 [0,4194304] 0 2024-02-16T22:18:56.519 INFO:tasks.workunit.client.0.smithi134.stdout:9/621: fdatasync db/f29 0 2024-02-16T22:18:56.522 INFO:tasks.workunit.client.0.smithi134.stdout:1/569: dread d5/d1a/d23/d61/f83 [0,4194304] 0 2024-02-16T22:18:56.524 INFO:tasks.workunit.client.0.smithi134.stdout:6/585: symlink d17/d36/d77/d9a/d70/d86/lb8 0 2024-02-16T22:18:56.525 INFO:tasks.workunit.client.0.smithi134.stdout:8/573: mkdir d2/df/d18/d2a/d41/d59/da0/d40/d53/dbe 0 2024-02-16T22:18:56.525 INFO:tasks.workunit.client.0.smithi134.stdout:8/574: fdatasync d2/df/f10 0 2024-02-16T22:18:56.527 INFO:tasks.workunit.client.0.smithi134.stdout:2/535: rmdir df/d10/d30 39 2024-02-16T22:18:56.530 INFO:tasks.workunit.client.0.smithi134.stdout:9/622: truncate db/d20/d9a/fac 4083608 0 2024-02-16T22:18:56.532 INFO:tasks.workunit.client.0.smithi134.stdout:1/570: creat d5/d1a/d23/fbc x:0 0 0 2024-02-16T22:18:56.533 INFO:tasks.workunit.client.0.smithi134.stdout:6/586: mknod d17/d36/d77/d9a/cb9 0 2024-02-16T22:18:56.533 INFO:tasks.workunit.client.0.smithi134.stdout:6/587: read - d17/d27/d4f/d52/f84 zero size 2024-02-16T22:18:56.533 INFO:tasks.workunit.client.0.smithi134.stdout:8/575: link d2/f63 d2/df/d18/d27/fbf 0 2024-02-16T22:18:56.533 INFO:tasks.workunit.client.0.smithi134.stdout:8/576: fsync d2/df/d18/d2a/d41/d59/da0/d9f/fa7 0 2024-02-16T22:18:56.534 INFO:tasks.workunit.client.0.smithi134.stdout:2/536: rmdir df/d10/d30/d49/d7b/d96 0 2024-02-16T22:18:56.536 INFO:tasks.workunit.client.0.smithi134.stdout:6/588: rename d17/fa3 to d17/d27/d4f/d52/fba 0 2024-02-16T22:18:56.537 INFO:tasks.workunit.client.0.smithi134.stdout:6/589: symlink d17/d27/d30/d32/lbb 0 2024-02-16T22:18:56.540 INFO:tasks.workunit.client.0.smithi134.stdout:8/577: dread d2/df/d18/d2a/d41/d59/da0/d40/f8e [0,4194304] 0 2024-02-16T22:18:56.541 INFO:tasks.workunit.client.0.smithi134.stdout:7/572: dwrite d2/d6/f41 [0,4194304] 0 2024-02-16T22:18:56.543 INFO:tasks.workunit.client.0.smithi134.stdout:8/578: symlink d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/lc0 0 2024-02-16T22:18:56.543 INFO:tasks.workunit.client.0.smithi134.stdout:8/579: dread - d2/df/d18/d91/fae zero size 2024-02-16T22:18:56.546 INFO:tasks.workunit.client.0.smithi134.stdout:8/580: truncate d2/df/f6e 192846 0 2024-02-16T22:18:56.549 INFO:tasks.workunit.client.0.smithi134.stdout:8/581: creat d2/df/d18/d2a/d41/d59/db1/fc1 x:0 0 0 2024-02-16T22:18:56.554 INFO:tasks.workunit.client.0.smithi134.stdout:6/590: read d17/d36/d77/d9a/f4b [112526,108163] 0 2024-02-16T22:18:56.555 INFO:tasks.workunit.client.0.smithi134.stdout:6/591: mkdir d17/d36/d77/d9a/d83/dbc 0 2024-02-16T22:18:56.555 INFO:tasks.workunit.client.0.smithi134.stdout:7/573: dread d2/d5/d19/f1d [4194304,4194304] 0 2024-02-16T22:18:56.556 INFO:tasks.workunit.client.0.smithi134.stdout:4/472: sync 2024-02-16T22:18:56.557 INFO:tasks.workunit.client.0.smithi134.stdout:4/473: dread d0/d31/f87 [0,4194304] 0 2024-02-16T22:18:56.567 INFO:tasks.workunit.client.0.smithi134.stdout:0/590: dwrite d2/d20/f23 [0,4194304] 0 2024-02-16T22:18:56.568 INFO:tasks.workunit.client.0.smithi134.stdout:3/549: dwrite da/d1c/d24/d29/d40/d8a/d8f/f44 [4194304,4194304] 0 2024-02-16T22:18:56.568 INFO:tasks.workunit.client.0.smithi134.stdout:2/537: dwrite df/d10/f86 [0,4194304] 0 2024-02-16T22:18:56.568 INFO:tasks.workunit.client.0.smithi134.stdout:0/591: mknod d2/d4b/cc8 0 2024-02-16T22:18:56.570 INFO:tasks.workunit.client.0.smithi134.stdout:7/574: write d2/d5/d19/f2f [5415564,112367] 0 2024-02-16T22:18:56.570 INFO:tasks.workunit.client.0.smithi134.stdout:7/575: write d2/d5/d22/d83/f9c [1138179,13978] 0 2024-02-16T22:18:56.570 INFO:tasks.workunit.client.0.smithi134.stdout:7/576: write d2/d6/d7d/d9e/fb2 [659663,57767] 0 2024-02-16T22:18:56.571 INFO:tasks.workunit.client.0.smithi134.stdout:9/623: dwrite db/f33 [0,4194304] 0 2024-02-16T22:18:56.571 INFO:tasks.workunit.client.0.smithi134.stdout:1/571: dwrite d5/da/d2d/f84 [0,4194304] 0 2024-02-16T22:18:56.577 INFO:tasks.workunit.client.0.smithi134.stdout:9/624: symlink db/d20/d55/d8c/ld6 0 2024-02-16T22:18:56.580 INFO:tasks.workunit.client.0.smithi134.stdout:7/577: dread d2/d6/d17/f82 [0,4194304] 0 2024-02-16T22:18:56.580 INFO:tasks.workunit.client.0.smithi134.stdout:6/592: dwrite d17/d63/fb3 [0,4194304] 0 2024-02-16T22:18:56.582 INFO:tasks.workunit.client.0.smithi134.stdout:2/538: rmdir df/d10/d15/d5a/d34 39 2024-02-16T22:18:56.583 INFO:tasks.workunit.client.0.smithi134.stdout:9/625: rename db/d20/d22/f35 to db/d20/d22/d51/fd7 0 2024-02-16T22:18:56.585 INFO:tasks.workunit.client.0.smithi134.stdout:6/593: unlink d17/c26 0 2024-02-16T22:18:56.586 INFO:tasks.workunit.client.0.smithi134.stdout:9/626: mkdir db/d20/d32/dd8 0 2024-02-16T22:18:56.586 INFO:tasks.workunit.client.0.smithi134.stdout:9/627: dread - db/dc/f24 zero size 2024-02-16T22:18:56.588 INFO:tasks.workunit.client.0.smithi134.stdout:7/578: write d2/d6/d17/d31/d28/f6c [4409752,21498] 0 2024-02-16T22:18:56.589 INFO:tasks.workunit.client.0.smithi134.stdout:7/579: symlink d2/d5/d19/d84/d86/d93/dab/d40/lbf 0 2024-02-16T22:18:56.591 INFO:tasks.workunit.client.0.smithi134.stdout:6/594: dread f10 [0,4194304] 0 2024-02-16T22:18:56.592 INFO:tasks.workunit.client.0.smithi134.stdout:7/580: rename d2/d6/d7d/d92/la8 to d2/d5/d19/d4a/lc0 0 2024-02-16T22:18:56.594 INFO:tasks.workunit.client.0.smithi134.stdout:6/595: rename d17/f42 to d17/d36/d77/d9a/d83/dbc/fbd 0 2024-02-16T22:18:56.594 INFO:tasks.workunit.client.0.smithi134.stdout:6/596: write d17/d36/d77/d9a/f29 [494179,91654] 0 2024-02-16T22:18:56.595 INFO:tasks.workunit.client.0.smithi134.stdout:4/474: dwrite d0/d6/d1e/d3b/f50 [0,4194304] 0 2024-02-16T22:18:56.595 INFO:tasks.workunit.client.0.smithi134.stdout:4/475: chown d0/d6/d8/da2 414790793 1 2024-02-16T22:18:56.596 INFO:tasks.workunit.client.0.smithi134.stdout:7/581: mknod d2/d6/d17/cc1 0 2024-02-16T22:18:56.599 INFO:tasks.workunit.client.0.smithi134.stdout:0/592: dwrite d2/f26 [0,4194304] 0 2024-02-16T22:18:56.599 INFO:tasks.workunit.client.0.smithi134.stdout:1/572: write d5/da/f15 [2185640,18035] 0 2024-02-16T22:18:56.602 INFO:tasks.workunit.client.0.smithi134.stdout:7/582: unlink d2/d5/d22/d26/d48/d7f/l37 0 2024-02-16T22:18:56.603 INFO:tasks.workunit.client.0.smithi134.stdout:2/539: dread df/d10/d15/f3f [0,4194304] 0 2024-02-16T22:18:56.607 INFO:tasks.workunit.client.0.smithi134.stdout:4/476: read d0/d6/d1e/d39/f66 [553803,54967] 0 2024-02-16T22:18:56.612 INFO:tasks.workunit.client.0.smithi134.stdout:7/583: mkdir d2/d6/d7d/d92/da5/d63/dc2 0 2024-02-16T22:18:56.612 INFO:tasks.workunit.client.0.smithi134.stdout:3/550: truncate da/d1c/d24/d29/d40/d8a/d8f/f44 8191492 0 2024-02-16T22:18:56.613 INFO:tasks.workunit.client.0.smithi134.stdout:4/477: mknod d0/d6/d1e/d3b/d9e/ca5 0 2024-02-16T22:18:56.632 INFO:tasks.workunit.client.0.smithi134.stdout:9/628: dwrite db/f57 [4194304,4194304] 0 2024-02-16T22:18:56.675 INFO:tasks.workunit.client.0.smithi134.stdout:7/584: unlink d2/f62 0 2024-02-16T22:18:56.675 INFO:tasks.workunit.client.0.smithi134.stdout:6/597: dwrite d17/d36/d77/d9a/d28/f81 [0,4194304] 0 2024-02-16T22:18:56.680 INFO:tasks.workunit.client.0.smithi134.stdout:7/585: read d2/d6/d7d/d9e/fb2 [629630,66074] 0 2024-02-16T22:18:56.680 INFO:tasks.workunit.client.0.smithi134.stdout:4/478: symlink d0/d6/d8/d32/d68/la6 0 2024-02-16T22:18:56.680 INFO:tasks.workunit.client.0.smithi134.stdout:4/479: truncate d0/d6/d58/f92 281639 0 2024-02-16T22:18:56.680 INFO:tasks.workunit.client.0.smithi134.stdout:4/480: fdatasync d0/d6/d16/f17 0 2024-02-16T22:18:56.682 INFO:tasks.workunit.client.0.smithi134.stdout:9/629: creat db/d20/d55/fd9 x:0 0 0 2024-02-16T22:18:56.687 INFO:tasks.workunit.client.0.smithi134.stdout:6/598: link d17/d27/d4f/d52/l65 d17/d36/d77/d9a/d70/d86/daa/lbe 0 2024-02-16T22:18:56.691 INFO:tasks.workunit.client.0.smithi134.stdout:9/630: rmdir db/d20/d22 39 2024-02-16T22:18:56.691 INFO:tasks.workunit.client.0.smithi134.stdout:9/631: fdatasync db/d20/d22/d51/f74 0 2024-02-16T22:18:56.692 INFO:tasks.workunit.client.0.smithi134.stdout:9/632: write db/d20/d22/d64/d69/f7e [4335470,129403] 0 2024-02-16T22:18:56.693 INFO:tasks.workunit.client.0.smithi134.stdout:6/599: mkdir d17/d36/d77/d9a/d83/dbf 0 2024-02-16T22:18:56.693 INFO:tasks.workunit.client.0.smithi134.stdout:6/600: write d17/d27/d4f/d52/d79/f6b [1138120,13025] 0 2024-02-16T22:18:56.695 INFO:tasks.workunit.client.0.smithi134.stdout:7/586: rmdir d2/d5/d22/d26/d48 39 2024-02-16T22:18:56.696 INFO:tasks.workunit.client.0.smithi134.stdout:9/633: creat db/d20/d32/dd8/fda x:0 0 0 2024-02-16T22:18:56.697 INFO:tasks.workunit.client.0.smithi134.stdout:7/587: mknod d2/d5/d19/d4a/d9d/cc3 0 2024-02-16T22:18:56.698 INFO:tasks.workunit.client.0.smithi134.stdout:6/601: getdents d17/d36/d77 0 2024-02-16T22:18:56.698 INFO:tasks.workunit.client.0.smithi134.stdout:6/602: readlink d17/d36/d77/d9a/d28/l6c 0 2024-02-16T22:18:56.699 INFO:tasks.workunit.client.0.smithi134.stdout:7/588: mknod d2/d5/d22/d26/cc4 0 2024-02-16T22:18:56.699 INFO:tasks.workunit.client.0.smithi134.stdout:7/589: stat d2/d5/d22/d83/f9c 0 2024-02-16T22:18:56.699 INFO:tasks.workunit.client.0.smithi134.stdout:6/603: mknod d17/d63/cc0 0 2024-02-16T22:18:56.700 INFO:tasks.workunit.client.0.smithi134.stdout:7/590: rename d2/d5/d22/d26/d48/d7f/f39 to d2/d6/d7d/d92/da5/d63/fc5 0 2024-02-16T22:18:56.701 INFO:tasks.workunit.client.0.smithi134.stdout:7/591: read d2/d6/d7d/d9e/fb2 [590629,42838] 0 2024-02-16T22:18:56.701 INFO:tasks.workunit.client.0.smithi134.stdout:7/592: rmdir d2/d5 39 2024-02-16T22:18:56.701 INFO:tasks.workunit.client.0.smithi134.stdout:7/593: write d2/d6/d91/db3/fb4 [885343,19098] 0 2024-02-16T22:18:56.702 INFO:tasks.workunit.client.0.smithi134.stdout:6/604: getdents d17/d27/d4f/d52/d79/d92 0 2024-02-16T22:18:56.702 INFO:tasks.workunit.client.0.smithi134.stdout:6/605: write d17/d27/d4f/f55 [801102,3862] 0 2024-02-16T22:18:56.703 INFO:tasks.workunit.client.0.smithi134.stdout:7/594: rename d2/d5/d4c/l81 to d2/d5/d19/lc6 0 2024-02-16T22:18:56.703 INFO:tasks.workunit.client.0.smithi134.stdout:7/595: write d2/d6/d17/f14 [4848229,12139] 0 2024-02-16T22:18:56.703 INFO:tasks.workunit.client.0.smithi134.stdout:7/596: write d2/d6/f41 [4953373,65241] 0 2024-02-16T22:18:56.704 INFO:tasks.workunit.client.0.smithi134.stdout:6/606: link d17/d27/d30/f35 d17/d27/d93/fc1 0 2024-02-16T22:18:56.706 INFO:tasks.workunit.client.0.smithi134.stdout:6/607: symlink d17/d36/d77/d9a/lc2 0 2024-02-16T22:18:56.706 INFO:tasks.workunit.client.0.smithi134.stdout:6/608: chown d17/d36/l40 159739 1 2024-02-16T22:18:56.706 INFO:tasks.workunit.client.0.smithi134.stdout:6/609: chown d17/d27/d30/f8c 481031089 1 2024-02-16T22:18:56.706 INFO:tasks.workunit.client.0.smithi134.stdout:6/610: write d17/f76 [224547,107506] 0 2024-02-16T22:18:56.706 INFO:tasks.workunit.client.0.smithi134.stdout:6/611: read d17/f76 [217805,80988] 0 2024-02-16T22:18:56.712 INFO:tasks.workunit.client.0.smithi134.stdout:8/582: dwrite d2/df/f6e [0,4194304] 0 2024-02-16T22:18:56.714 INFO:tasks.workunit.client.0.smithi134.stdout:9/634: dread db/dc/f14 [0,4194304] 0 2024-02-16T22:18:56.716 INFO:tasks.workunit.client.0.smithi134.stdout:3/551: dwrite da/d12/d2a/f7c [4194304,4194304] 0 2024-02-16T22:18:56.716 INFO:tasks.workunit.client.0.smithi134.stdout:1/573: dwrite d5/d1a/d23/d3c/fa8 [0,4194304] 0 2024-02-16T22:18:56.716 INFO:tasks.workunit.client.0.smithi134.stdout:3/552: chown da/d1c/d24/d2c/c34 132450424 1 2024-02-16T22:18:56.716 INFO:tasks.workunit.client.0.smithi134.stdout:1/574: dread - d5/da/d21/d45/fad zero size 2024-02-16T22:18:56.716 INFO:tasks.workunit.client.0.smithi134.stdout:2/540: dwrite df/d10/f86 [0,4194304] 0 2024-02-16T22:18:56.716 INFO:tasks.workunit.client.0.smithi134.stdout:9/635: mkdir db/d20/d22/d64/dc2/ddb 0 2024-02-16T22:18:56.720 INFO:tasks.workunit.client.0.smithi134.stdout:4/481: dwrite d0/f2 [0,4194304] 0 2024-02-16T22:18:56.720 INFO:tasks.workunit.client.0.smithi134.stdout:6/612: dread d17/d27/d4f/d52/d79/f64 [0,4194304] 0 2024-02-16T22:18:56.720 INFO:tasks.workunit.client.0.smithi134.stdout:3/553: getdents da/d1c/d24/d29 0 2024-02-16T22:18:56.720 INFO:tasks.workunit.client.0.smithi134.stdout:6/613: dread - d17/d27/d93/d9c/da7/fac zero size 2024-02-16T22:18:56.721 INFO:tasks.workunit.client.0.smithi134.stdout:1/575: mknod d5/d1a/d4d/d99/cbd 0 2024-02-16T22:18:56.722 INFO:tasks.workunit.client.0.smithi134.stdout:5/618: sync 2024-02-16T22:18:56.724 INFO:tasks.workunit.client.0.smithi134.stdout:2/541: creat df/d10/d30/d4d/d94/fa1 x:0 0 0 2024-02-16T22:18:56.724 INFO:tasks.workunit.client.0.smithi134.stdout:7/597: dwrite d2/d6/d7d/d9e/fb2 [0,4194304] 0 2024-02-16T22:18:56.725 INFO:tasks.workunit.client.0.smithi134.stdout:4/482: unlink d0/lb 0 2024-02-16T22:18:56.727 INFO:tasks.workunit.client.0.smithi134.stdout:6/614: creat d17/d27/d4f/d52/fc3 x:0 0 0 2024-02-16T22:18:56.727 INFO:tasks.workunit.client.0.smithi134.stdout:6/615: chown d17/d36/d77/d9a/d70 64784 1 2024-02-16T22:18:56.728 INFO:tasks.workunit.client.0.smithi134.stdout:6/616: stat d17/d36/f58 0 2024-02-16T22:18:56.728 INFO:tasks.workunit.client.0.smithi134.stdout:9/636: dread db/fb7 [0,4194304] 0 2024-02-16T22:18:56.732 INFO:tasks.workunit.client.0.smithi134.stdout:1/576: rename d5/d1a/d23/c59 to d5/d1a/d23/d3c/d6a/d5c/cbe 0 2024-02-16T22:18:56.736 INFO:tasks.workunit.client.0.smithi134.stdout:5/619: unlink d2/d9/dc/d98/db3/f9e 0 2024-02-16T22:18:56.744 INFO:tasks.workunit.client.0.smithi134.stdout:1/577: write d5/d1a/d23/f2b [139146,97463] 0 2024-02-16T22:18:56.750 INFO:tasks.workunit.client.0.smithi134.stdout:5/620: mknod d2/d35/d36/ccd 0 2024-02-16T22:18:56.753 INFO:tasks.workunit.client.0.smithi134.stdout:2/542: mkdir df/d10/d30/da2 0 2024-02-16T22:18:56.762 INFO:tasks.workunit.client.0.smithi134.stdout:6/617: dwrite d17/d36/d77/d9a/d28/d5b/f6d [0,4194304] 0 2024-02-16T22:18:56.765 INFO:tasks.workunit.client.0.smithi134.stdout:6/618: symlink d17/d36/d77/d9a/d28/d5b/d88/d90/da5/lc4 0 2024-02-16T22:18:56.765 INFO:tasks.workunit.client.0.smithi134.stdout:3/554: dwrite da/d1c/d24/d29/d40/d8a/d8f/d5f/d62/fa9 [0,4194304] 0 2024-02-16T22:18:56.766 INFO:tasks.workunit.client.0.smithi134.stdout:6/619: mknod d17/d36/d77/d9a/d83/cc5 0 2024-02-16T22:18:56.766 INFO:tasks.workunit.client.0.smithi134.stdout:6/620: chown d17/d36/d77/d9a/d28/l6c 1321 1 2024-02-16T22:18:56.768 INFO:tasks.workunit.client.0.smithi134.stdout:3/555: mkdir da/d1c/d24/dae 0 2024-02-16T22:18:56.780 INFO:tasks.workunit.client.0.smithi134.stdout:3/556: write da/d1c/d24/d29/f45 [3096977,43349] 0 2024-02-16T22:18:56.801 INFO:tasks.workunit.client.0.smithi134.stdout:7/598: dwrite d2/d5/d19/f2b [0,4194304] 0 2024-02-16T22:18:56.801 INFO:tasks.workunit.client.0.smithi134.stdout:7/599: write d2/d5/f2d [1558558,64259] 0 2024-02-16T22:18:56.803 INFO:tasks.workunit.client.0.smithi134.stdout:4/483: dwrite d0/d6/d16/d86/f9f [0,4194304] 0 2024-02-16T22:18:56.803 INFO:tasks.workunit.client.0.smithi134.stdout:7/600: unlink d2/d5/d22/d26/f5f 0 2024-02-16T22:18:56.803 INFO:tasks.workunit.client.0.smithi134.stdout:7/601: dread - d2/d5/d19/fb1 zero size 2024-02-16T22:18:56.804 INFO:tasks.workunit.client.0.smithi134.stdout:7/602: chown d2/d5/d19/d84/d86/d93/dab/l6a 10997 1 2024-02-16T22:18:56.804 INFO:tasks.workunit.client.0.smithi134.stdout:9/637: dwrite db/d20/d22/d51/fc9 [0,4194304] 0 2024-02-16T22:18:56.804 INFO:tasks.workunit.client.0.smithi134.stdout:6/621: dwrite d17/d27/d4f/f67 [0,4194304] 0 2024-02-16T22:18:56.804 INFO:tasks.workunit.client.0.smithi134.stdout:1/578: dwrite d5/da/d21/d52/fa4 [0,4194304] 0 2024-02-16T22:18:56.804 INFO:tasks.workunit.client.0.smithi134.stdout:6/622: write d17/d36/d77/d9a/f4b [1226923,33818] 0 2024-02-16T22:18:56.805 INFO:tasks.workunit.client.0.smithi134.stdout:1/579: readlink d5/da/d2d/l8e 0 2024-02-16T22:18:56.805 INFO:tasks.workunit.client.0.smithi134.stdout:5/621: dwrite d2/d9/dc/f38 [0,4194304] 0 2024-02-16T22:18:56.805 INFO:tasks.workunit.client.0.smithi134.stdout:2/543: dwrite df/d41/f8e [0,4194304] 0 2024-02-16T22:18:56.805 INFO:tasks.workunit.client.0.smithi134.stdout:4/484: mknod d0/d6/d16/d86/ca7 0 2024-02-16T22:18:56.807 INFO:tasks.workunit.client.0.smithi134.stdout:7/603: getdents d2/d5/d19/d84/d86/d93 0 2024-02-16T22:18:56.807 INFO:tasks.workunit.client.0.smithi134.stdout:7/604: readlink d2/d5/d19/l7a 0 2024-02-16T22:18:56.809 INFO:tasks.workunit.client.0.smithi134.stdout:9/638: mknod db/cdc 0 2024-02-16T22:18:56.809 INFO:tasks.workunit.client.0.smithi134.stdout:9/639: creat db/d20/d22/d51/d9b/fdd x:0 0 0 2024-02-16T22:18:56.809 INFO:tasks.workunit.client.0.smithi134.stdout:9/640: fdatasync db/d20/d22/f50 0 2024-02-16T22:18:56.814 INFO:tasks.workunit.client.0.smithi134.stdout:4/485: dread d0/d6/d1e/d39/f66 [0,4194304] 0 2024-02-16T22:18:56.815 INFO:tasks.workunit.client.0.smithi134.stdout:7/605: dread d2/d6/d91/db3/fb4 [0,4194304] 0 2024-02-16T22:18:56.817 INFO:tasks.workunit.client.0.smithi134.stdout:1/580: mknod d5/da/d21/cbf 0 2024-02-16T22:18:56.818 INFO:tasks.workunit.client.0.smithi134.stdout:6/623: mknod d17/d36/d77/d9a/d70/cc6 0 2024-02-16T22:18:56.820 INFO:tasks.workunit.client.0.smithi134.stdout:0/593: sync 2024-02-16T22:18:56.823 INFO:tasks.workunit.client.0.smithi134.stdout:2/544: rename df/d10/d15/d5a/d2d to df/d10/d30/d4d/d94/da3 0 2024-02-16T22:18:56.823 INFO:tasks.workunit.client.0.smithi134.stdout:2/545: chown df/d10/f3b 0 1 2024-02-16T22:18:56.824 INFO:tasks.workunit.client.0.smithi134.stdout:5/622: dwrite d2/d35/d36/d3d/d63/fa2 [0,4194304] 0 2024-02-16T22:18:56.825 INFO:tasks.workunit.client.0.smithi134.stdout:5/623: read d2/d9/dc/f81 [12235,7234] 0 2024-02-16T22:18:56.825 INFO:tasks.workunit.client.0.smithi134.stdout:5/624: stat d2/d35/c84 0 2024-02-16T22:18:56.829 INFO:tasks.workunit.client.0.smithi134.stdout:4/486: mknod d0/d6/d16/ca8 0 2024-02-16T22:18:56.831 INFO:tasks.workunit.client.0.smithi134.stdout:1/581: symlink d5/da/d1c/lc0 0 2024-02-16T22:18:56.832 INFO:tasks.workunit.client.0.smithi134.stdout:0/594: fdatasync d2/dc/d48/f57 0 2024-02-16T22:18:56.836 INFO:tasks.workunit.client.0.smithi134.stdout:1/582: creat d5/d1a/d23/d3c/d6a/d5c/fc1 x:0 0 0 2024-02-16T22:18:56.839 INFO:tasks.workunit.client.0.smithi134.stdout:5/625: mkdir d2/d9/dc/d32/dce 0 2024-02-16T22:18:56.839 INFO:tasks.workunit.client.0.smithi134.stdout:1/583: mknod d5/d1a/d23/d3c/d6a/cc2 0 2024-02-16T22:18:56.839 INFO:tasks.workunit.client.0.smithi134.stdout:1/584: fsync d5/da/d21/d52/d9b/fa1 0 2024-02-16T22:18:56.841 INFO:tasks.workunit.client.0.smithi134.stdout:5/626: unlink d2/d9/dc/d15/la5 0 2024-02-16T22:18:56.841 INFO:tasks.workunit.client.0.smithi134.stdout:5/627: fsync d2/d9/dc/f26 0 2024-02-16T22:18:56.846 INFO:tasks.workunit.client.0.smithi134.stdout:7/606: dwrite d2/d5/d19/d4a/f58 [0,4194304] 0 2024-02-16T22:18:56.846 INFO:tasks.workunit.client.0.smithi134.stdout:2/546: dwrite fb [0,4194304] 0 2024-02-16T22:18:56.846 INFO:tasks.workunit.client.0.smithi134.stdout:6/624: dwrite d17/d36/f6f [0,4194304] 0 2024-02-16T22:18:56.849 INFO:tasks.workunit.client.0.smithi134.stdout:5/628: mknod d2/d9/dc/d32/ccf 0 2024-02-16T22:18:56.849 INFO:tasks.workunit.client.0.smithi134.stdout:5/629: creat d2/d9/dc/daf/fd0 x:0 0 0 2024-02-16T22:18:56.850 INFO:tasks.workunit.client.0.smithi134.stdout:7/607: creat d2/d6/d17/d31/d28/fc7 x:0 0 0 2024-02-16T22:18:56.853 INFO:tasks.workunit.client.0.smithi134.stdout:2/547: mkdir df/d10/d15/da4 0 2024-02-16T22:18:56.853 INFO:tasks.workunit.client.0.smithi134.stdout:2/548: dread - df/d10/d30/d4d/f93 zero size 2024-02-16T22:18:56.853 INFO:tasks.workunit.client.0.smithi134.stdout:2/549: chown df/d10/d15/f91 52749 1 2024-02-16T22:18:56.853 INFO:tasks.workunit.client.0.smithi134.stdout:2/550: fdatasync df/d10/d15/d5a/f48 0 2024-02-16T22:18:56.855 INFO:tasks.workunit.client.0.smithi134.stdout:6/625: rmdir d17/d36/d77 39 2024-02-16T22:18:56.856 INFO:tasks.workunit.client.0.smithi134.stdout:5/630: mknod d2/d35/d36/d3d/d9c/dc2/cd1 0 2024-02-16T22:18:56.861 INFO:tasks.workunit.client.0.smithi134.stdout:0/595: dwrite d2/dc/d32/fa6 [0,4194304] 0 2024-02-16T22:18:56.862 INFO:tasks.workunit.client.0.smithi134.stdout:5/631: dread d2/d9/dc/daf/fb8 [0,4194304] 0 2024-02-16T22:18:56.862 INFO:tasks.workunit.client.0.smithi134.stdout:1/585: dwrite d5/da/d21/d52/f8b [0,4194304] 0 2024-02-16T22:18:56.862 INFO:tasks.workunit.client.0.smithi134.stdout:5/632: chown d2/d9/l23 432372 1 2024-02-16T22:18:56.867 INFO:tasks.workunit.client.0.smithi134.stdout:0/596: creat d2/d20/d77/d85/db6/fc9 x:0 0 0 2024-02-16T22:18:56.867 INFO:tasks.workunit.client.0.smithi134.stdout:0/597: dread - d2/dc/d32/d45/fb2 zero size 2024-02-16T22:18:56.868 INFO:tasks.workunit.client.0.smithi134.stdout:0/598: write d2/dc/d32/f42 [1787729,129969] 0 2024-02-16T22:18:56.870 INFO:tasks.workunit.client.0.smithi134.stdout:8/583: sync 2024-02-16T22:18:56.871 INFO:tasks.workunit.client.0.smithi134.stdout:1/586: getdents d5/da/d1c 0 2024-02-16T22:18:56.872 INFO:tasks.workunit.client.0.smithi134.stdout:5/633: mknod d2/d9/dc/cd2 0 2024-02-16T22:18:56.873 INFO:tasks.workunit.client.0.smithi134.stdout:1/587: truncate d5/d1a/d23/f20 3284249 0 2024-02-16T22:18:56.874 INFO:tasks.workunit.client.0.smithi134.stdout:5/634: mkdir d2/d9/dc/d32/dd3 0 2024-02-16T22:18:56.874 INFO:tasks.workunit.client.0.smithi134.stdout:5/635: readlink d2/d35/d36/d3d/d9c/d4b/l60 0 2024-02-16T22:18:56.874 INFO:tasks.workunit.client.0.smithi134.stdout:5/636: chown d2/d9/dc/f3a 20 1 2024-02-16T22:18:56.875 INFO:tasks.workunit.client.0.smithi134.stdout:1/588: unlink d5/da/d21/l28 0 2024-02-16T22:18:56.875 INFO:tasks.workunit.client.0.smithi134.stdout:1/589: write d5/fb5 [23739,4148] 0 2024-02-16T22:18:56.876 INFO:tasks.workunit.client.0.smithi134.stdout:1/590: symlink d5/da/d21/d52/d9b/d9f/lc3 0 2024-02-16T22:18:56.878 INFO:tasks.workunit.client.0.smithi134.stdout:1/591: mknod d5/d1a/d23/d61/cc4 0 2024-02-16T22:18:56.878 INFO:tasks.workunit.client.0.smithi134.stdout:1/592: stat d5/f3f 0 2024-02-16T22:18:56.878 INFO:tasks.workunit.client.0.smithi134.stdout:6/626: dwrite d17/d27/d30/f35 [0,4194304] 0 2024-02-16T22:18:56.879 INFO:tasks.workunit.client.0.smithi134.stdout:6/627: write d17/d36/d77/d9a/d28/fae [832866,95849] 0 2024-02-16T22:18:56.879 INFO:tasks.workunit.client.0.smithi134.stdout:6/628: truncate d17/d27/d4f/d52/fba 1004387 0 2024-02-16T22:18:56.879 INFO:tasks.workunit.client.0.smithi134.stdout:6/629: creat d17/d36/d77/d9a/d28/fc7 x:0 0 0 2024-02-16T22:18:56.879 INFO:tasks.workunit.client.0.smithi134.stdout:8/584: dread d2/df/d18/d91/fb7 [0,4194304] 0 2024-02-16T22:18:56.879 INFO:tasks.workunit.client.0.smithi134.stdout:7/608: dwrite d2/d5/d19/f2f [4194304,4194304] 0 2024-02-16T22:18:56.881 INFO:tasks.workunit.client.0.smithi134.stdout:1/593: creat d5/da/d21/d52/d9b/d9f/fc5 x:0 0 0 2024-02-16T22:18:56.886 INFO:tasks.workunit.client.0.smithi134.stdout:8/585: dread d2/df/d18/d27/f7b [0,4194304] 0 2024-02-16T22:18:56.886 INFO:tasks.workunit.client.0.smithi134.stdout:8/586: truncate d2/df/d18/d27/fbf 1501359 0 2024-02-16T22:18:56.886 INFO:tasks.workunit.client.0.smithi134.stdout:8/587: write d2/df/d18/f45 [675597,102679] 0 2024-02-16T22:18:56.889 INFO:tasks.workunit.client.0.smithi134.stdout:1/594: symlink d5/d1a/d82/lc6 0 2024-02-16T22:18:56.889 INFO:tasks.workunit.client.0.smithi134.stdout:0/599: dread d2/dc/f7c [0,4194304] 0 2024-02-16T22:18:56.892 INFO:tasks.workunit.client.0.smithi134.stdout:8/588: unlink d2/df/d18/d12/f4e 0 2024-02-16T22:18:56.893 INFO:tasks.workunit.client.0.smithi134.stdout:1/595: creat d5/d1a/d23/d8c/fc7 x:0 0 0 2024-02-16T22:18:56.893 INFO:tasks.workunit.client.0.smithi134.stdout:0/600: rmdir d2/dc 39 2024-02-16T22:18:56.894 INFO:tasks.workunit.client.0.smithi134.stdout:8/589: creat d2/df/d7c/fc2 x:0 0 0 2024-02-16T22:18:56.896 INFO:tasks.workunit.client.0.smithi134.stdout:0/601: mknod d2/dc/d97/cca 0 2024-02-16T22:18:56.898 INFO:tasks.workunit.client.0.smithi134.stdout:0/602: truncate d2/dc/d32/d3e/d5e/f6f 3174205 0 2024-02-16T22:18:56.898 INFO:tasks.workunit.client.0.smithi134.stdout:6/630: read d17/d27/d4f/f67 [209353,24723] 0 2024-02-16T22:18:56.900 INFO:tasks.workunit.client.0.smithi134.stdout:0/603: unlink d2/dc/d2d/d34/f46 0 2024-02-16T22:18:56.900 INFO:tasks.workunit.client.0.smithi134.stdout:0/604: creat d2/d4b/d53/fcb x:0 0 0 2024-02-16T22:18:56.903 INFO:tasks.workunit.client.0.smithi134.stdout:5/637: dwrite d2/d9/dc/daf/fd0 [0,4194304] 0 2024-02-16T22:18:56.903 INFO:tasks.workunit.client.0.smithi134.stdout:5/638: dread - d2/d9/dc/d98/fcb zero size 2024-02-16T22:18:56.903 INFO:tasks.workunit.client.0.smithi134.stdout:5/639: chown d2/d9/c9d 154 1 2024-02-16T22:18:56.903 INFO:tasks.workunit.client.0.smithi134.stdout:7/609: dwrite d2/d5/d19/d4a/f58 [0,4194304] 0 2024-02-16T22:18:56.906 INFO:tasks.workunit.client.0.smithi134.stdout:1/596: read d5/d1a/f31 [4008663,10939] 0 2024-02-16T22:18:56.920 INFO:tasks.workunit.client.0.smithi134.stdout:7/610: creat d2/d6/d7d/d92/fc8 x:0 0 0 2024-02-16T22:18:56.920 INFO:tasks.workunit.client.0.smithi134.stdout:7/611: creat d2/d6/d7d/d9e/fc9 x:0 0 0 2024-02-16T22:18:56.920 INFO:tasks.workunit.client.0.smithi134.stdout:7/612: creat d2/d6/d7d/d92/fca x:0 0 0 2024-02-16T22:18:56.938 INFO:tasks.workunit.client.0.smithi134.stdout:8/590: dwrite d2/df/d18/d2a/d41/d59/db1/f7f [0,4194304] 0 2024-02-16T22:18:56.939 INFO:tasks.workunit.client.0.smithi134.stdout:5/640: dwrite d2/d35/d36/d3d/d63/fa2 [0,4194304] 0 2024-02-16T22:18:56.939 INFO:tasks.workunit.client.0.smithi134.stdout:0/605: dwrite d2/dc/d48/f4c [0,4194304] 0 2024-02-16T22:18:56.939 INFO:tasks.workunit.client.0.smithi134.stdout:5/641: fdatasync d2/d35/d36/d3d/d9c/f85 0 2024-02-16T22:18:56.940 INFO:tasks.workunit.client.0.smithi134.stdout:1/597: dwrite d5/da/f25 [0,4194304] 0 2024-02-16T22:18:56.944 INFO:tasks.workunit.client.0.smithi134.stdout:1/598: symlink d5/d1a/d23/d85/lc8 0 2024-02-16T22:18:56.945 INFO:tasks.workunit.client.0.smithi134.stdout:1/599: creat d5/da/d21/d52/d9b/d9f/fc9 x:0 0 0 2024-02-16T22:18:56.945 INFO:tasks.workunit.client.0.smithi134.stdout:1/600: fsync d5/d1a/d23/d3c/d6a/d5c/fa3 0 2024-02-16T22:18:56.946 INFO:tasks.workunit.client.0.smithi134.stdout:3/557: sync 2024-02-16T22:18:56.947 INFO:tasks.workunit.client.0.smithi134.stdout:1/601: mkdir d5/da/d2d/dca 0 2024-02-16T22:18:56.947 INFO:tasks.workunit.client.0.smithi134.stdout:1/602: chown d5/d1a/d23/d3c/d6a/fb9 26213457 1 2024-02-16T22:18:56.948 INFO:tasks.workunit.client.0.smithi134.stdout:0/606: dread d2/f12 [0,4194304] 0 2024-02-16T22:18:56.951 INFO:tasks.workunit.client.0.smithi134.stdout:0/607: write d2/dc/d32/d45/fc6 [698747,28857] 0 2024-02-16T22:18:56.951 INFO:tasks.workunit.client.0.smithi134.stdout:3/558: creat da/d1c/d24/d29/faf x:0 0 0 2024-02-16T22:18:56.951 INFO:tasks.workunit.client.0.smithi134.stdout:3/559: fsync da/f3a 0 2024-02-16T22:18:56.952 INFO:tasks.workunit.client.0.smithi134.stdout:0/608: fsync d2/dc/f1d 0 2024-02-16T22:18:56.953 INFO:tasks.workunit.client.0.smithi134.stdout:3/560: rename da/d1c/d24/d29/d51/d80/f84 to da/fb0 0 2024-02-16T22:18:56.954 INFO:tasks.workunit.client.0.smithi134.stdout:3/561: write da/d12/f76 [847909,126882] 0 2024-02-16T22:18:56.957 INFO:tasks.workunit.client.0.smithi134.stdout:1/603: dread d5/d1a/d23/f27 [0,4194304] 0 2024-02-16T22:18:56.968 INFO:tasks.workunit.client.0.smithi134.stdout:3/562: dread da/d1c/d24/d29/d40/d8a/d8f/d5f/d62/fa9 [0,4194304] 0 2024-02-16T22:18:56.968 INFO:tasks.workunit.client.0.smithi134.stdout:3/563: write da/fb0 [4508432,108265] 0 2024-02-16T22:18:56.969 INFO:tasks.workunit.client.0.smithi134.stdout:3/564: chown da/d12/d2a/f38 99915 1 2024-02-16T22:18:56.970 INFO:tasks.workunit.client.0.smithi134.stdout:0/609: dwrite d2/dc/f25 [0,4194304] 0 2024-02-16T22:18:56.970 INFO:tasks.workunit.client.0.smithi134.stdout:0/610: fdatasync d2/f11 0 2024-02-16T22:18:56.971 INFO:tasks.workunit.client.0.smithi134.stdout:0/611: chown d2/d20 1273 1 2024-02-16T22:18:56.971 INFO:tasks.workunit.client.0.smithi134.stdout:0/612: read d2/d20/f29 [57200,34276] 0 2024-02-16T22:18:56.972 INFO:tasks.workunit.client.0.smithi134.stdout:5/642: dwrite d2/d35/d36/d46/f6b [0,4194304] 0 2024-02-16T22:18:56.972 INFO:tasks.workunit.client.0.smithi134.stdout:1/604: write d5/da/d21/d45/f56 [3857353,20193] 0 2024-02-16T22:18:56.972 INFO:tasks.workunit.client.0.smithi134.stdout:1/605: dread - d5/d1a/d53/d86/f9a zero size 2024-02-16T22:18:56.975 INFO:tasks.workunit.client.0.smithi134.stdout:0/613: symlink d2/d20/d77/db9/lcc 0 2024-02-16T22:18:56.975 INFO:tasks.workunit.client.0.smithi134.stdout:0/614: chown d2/d4b/d53/l7d 862 1 2024-02-16T22:18:56.979 INFO:tasks.workunit.client.0.smithi134.stdout:1/606: read d5/da/f35 [44000,66227] 0 2024-02-16T22:18:56.979 INFO:tasks.workunit.client.0.smithi134.stdout:1/607: chown d5/da/d21/d45/f7b 55 1 2024-02-16T22:18:56.981 INFO:tasks.workunit.client.0.smithi134.stdout:1/608: creat d5/d1a/d4d/d99/fcb x:0 0 0 2024-02-16T22:18:56.981 INFO:tasks.workunit.client.0.smithi134.stdout:1/609: write d5/d1a/d63/f69 [471382,41760] 0 2024-02-16T22:18:56.981 INFO:tasks.workunit.client.0.smithi134.stdout:1/610: fsync d5/da/d21/d52/f6c 0 2024-02-16T22:18:56.983 INFO:tasks.workunit.client.0.smithi134.stdout:1/611: creat d5/da/d21/d45/fcc x:0 0 0 2024-02-16T22:18:56.983 INFO:tasks.workunit.client.0.smithi134.stdout:1/612: fdatasync d5/d1a/d53/d86/faa 0 2024-02-16T22:18:56.984 INFO:tasks.workunit.client.0.smithi134.stdout:1/613: creat d5/da/d21/d45/d93/fcd x:0 0 0 2024-02-16T22:18:56.992 INFO:tasks.workunit.client.0.smithi134.stdout:9/641: sync 2024-02-16T22:18:56.992 INFO:tasks.workunit.client.0.smithi134.stdout:3/565: dwrite da/d1c/d24/d29/d51/f70 [0,4194304] 0 2024-02-16T22:18:56.993 INFO:tasks.workunit.client.0.smithi134.stdout:9/642: creat db/d20/d22/fde x:0 0 0 2024-02-16T22:18:56.995 INFO:tasks.workunit.client.0.smithi134.stdout:3/566: symlink da/d1c/d24/d29/d51/d80/d89/d8e/dab/lb1 0 2024-02-16T22:18:56.996 INFO:tasks.workunit.client.0.smithi134.stdout:9/643: symlink db/d20/d55/d8c/ldf 0 2024-02-16T22:18:56.996 INFO:tasks.workunit.client.0.smithi134.stdout:9/644: chown c6 2207468 1 2024-02-16T22:18:56.997 INFO:tasks.workunit.client.0.smithi134.stdout:3/567: mkdir da/d12/d2a/da4/db2 0 2024-02-16T22:18:56.998 INFO:tasks.workunit.client.0.smithi134.stdout:3/568: creat da/d1c/d24/d29/d40/fb3 x:0 0 0 2024-02-16T22:18:56.999 INFO:tasks.workunit.client.0.smithi134.stdout:9/645: rmdir db/d20/d22/d64/d69/d6e 39 2024-02-16T22:18:57.002 INFO:tasks.workunit.client.0.smithi134.stdout:9/646: rename db/d20/d22/d91/d99/dcc to db/de0 0 2024-02-16T22:18:57.002 INFO:tasks.workunit.client.0.smithi134.stdout:9/647: truncate db/d20/d22/f58 444456 0 2024-02-16T22:18:57.003 INFO:tasks.workunit.client.0.smithi134.stdout:9/648: creat db/d20/d22/d64/dc2/fe1 x:0 0 0 2024-02-16T22:18:57.003 INFO:tasks.workunit.client.0.smithi134.stdout:3/569: dread da/d1c/d24/d29/d40/d8a/d8f/d5f/d62/fa9 [0,4194304] 0 2024-02-16T22:18:57.004 INFO:tasks.workunit.client.0.smithi134.stdout:3/570: rmdir da/d1c/d24/d29/d51/d80/d89/d8e 39 2024-02-16T22:18:57.005 INFO:tasks.workunit.client.0.smithi134.stdout:5/643: dwrite d2/d35/d36/d3d/d9c/f85 [0,4194304] 0 2024-02-16T22:18:57.006 INFO:tasks.workunit.client.0.smithi134.stdout:3/571: rename da/d1c/f22 to da/d1c/d24/d29/d51/fb4 0 2024-02-16T22:18:57.006 INFO:tasks.workunit.client.0.smithi134.stdout:3/572: read - da/d1c/d24/d29/d40/fb3 zero size 2024-02-16T22:18:57.007 INFO:tasks.workunit.client.0.smithi134.stdout:1/614: dwrite d5/da/d21/d52/d9b/d9f/fc5 [0,4194304] 0 2024-02-16T22:18:57.007 INFO:tasks.workunit.client.0.smithi134.stdout:0/615: dwrite d2/f16 [0,4194304] 0 2024-02-16T22:18:57.007 INFO:tasks.workunit.client.0.smithi134.stdout:0/616: readlink d2/d20/d7a/l9c 0 2024-02-16T22:18:57.017 INFO:tasks.workunit.client.0.smithi134.stdout:5/644: read d2/d9/dc/d15/f41 [480772,84534] 0 2024-02-16T22:18:57.033 INFO:tasks.workunit.client.0.smithi134.stdout:9/649: dwrite db/fa3 [0,4194304] 0 2024-02-16T22:18:57.033 INFO:tasks.workunit.client.0.smithi134.stdout:9/650: fsync db/f57 0 2024-02-16T22:18:57.034 INFO:tasks.workunit.client.0.smithi134.stdout:9/651: chown db/dc/f16 2925992 1 2024-02-16T22:18:57.090 INFO:tasks.workunit.client.0.smithi134.stdout:0/617: mkdir d2/d20/d7a/d7e/dcd 0 2024-02-16T22:18:57.093 INFO:tasks.workunit.client.0.smithi134.stdout:3/573: dwrite da/d1c/d24/d2c/d74/f81 [0,4194304] 0 2024-02-16T22:18:57.093 INFO:tasks.workunit.client.0.smithi134.stdout:1/615: dwrite d5/da/d21/d45/d93/faf [0,4194304] 0 2024-02-16T22:18:57.093 INFO:tasks.workunit.client.0.smithi134.stdout:1/616: chown d5/d1a/d23/d3c/d6a/d5c 2734636 1 2024-02-16T22:18:57.111 INFO:tasks.workunit.client.0.smithi134.stdout:3/574: dwrite da/d1c/d24/d29/d51/d79/faa [0,4194304] 0 2024-02-16T22:18:57.112 INFO:tasks.workunit.client.0.smithi134.stdout:9/652: mkdir db/d20/d22/d64/d69/d89/de2 0 2024-02-16T22:18:57.114 INFO:tasks.workunit.client.0.smithi134.stdout:0/618: truncate d2/dc/d32/f42 717328 0 2024-02-16T22:18:57.114 INFO:tasks.workunit.client.0.smithi134.stdout:0/619: dread - d2/d20/d77/fa8 zero size 2024-02-16T22:18:57.114 INFO:tasks.workunit.client.0.smithi134.stdout:2/551: sync 2024-02-16T22:18:57.114 INFO:tasks.workunit.client.0.smithi134.stdout:4/487: sync 2024-02-16T22:18:57.114 INFO:tasks.workunit.client.0.smithi134.stdout:6/631: sync 2024-02-16T22:18:57.115 INFO:tasks.workunit.client.0.smithi134.stdout:5/645: mkdir d2/d9/dc/d32/dd4 0 2024-02-16T22:18:57.120 INFO:tasks.workunit.client.0.smithi134.stdout:1/617: rename d5/da/d1c/f29 to d5/d1a/d53/fce 0 2024-02-16T22:18:57.124 INFO:tasks.workunit.client.0.smithi134.stdout:3/575: mknod da/d12/d2a/da4/db2/cb5 0 2024-02-16T22:18:57.124 INFO:tasks.workunit.client.0.smithi134.stdout:4/488: dread d0/f15 [0,4194304] 0 2024-02-16T22:18:57.126 INFO:tasks.workunit.client.0.smithi134.stdout:9/653: mknod db/d20/d22/d46/ce3 0 2024-02-16T22:18:57.126 INFO:tasks.workunit.client.0.smithi134.stdout:9/654: fdatasync db/f57 0 2024-02-16T22:18:57.128 INFO:tasks.workunit.client.0.smithi134.stdout:0/620: unlink d2/d20/d7a/l8f 0 2024-02-16T22:18:57.129 INFO:tasks.workunit.client.0.smithi134.stdout:6/632: creat d17/d27/d4f/d52/d97/fc8 x:0 0 0 2024-02-16T22:18:57.131 INFO:tasks.workunit.client.0.smithi134.stdout:5/646: unlink d2/d35/d36/d3d/d9c/f85 0 2024-02-16T22:18:57.131 INFO:tasks.workunit.client.0.smithi134.stdout:8/591: sync 2024-02-16T22:18:57.131 INFO:tasks.workunit.client.0.smithi134.stdout:7/613: sync 2024-02-16T22:18:57.131 INFO:tasks.workunit.client.0.smithi134.stdout:8/592: chown d2/df/d18/d5a/f79 867128 1 2024-02-16T22:18:57.131 INFO:tasks.workunit.client.0.smithi134.stdout:8/593: dread - d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/fb4 zero size 2024-02-16T22:18:57.131 INFO:tasks.workunit.client.0.smithi134.stdout:8/594: truncate d2/f35 4675514 0 2024-02-16T22:18:57.131 INFO:tasks.workunit.client.0.smithi134.stdout:1/618: symlink d5/d1a/d23/d85/lcf 0 2024-02-16T22:18:57.131 INFO:tasks.workunit.client.0.smithi134.stdout:1/619: fdatasync d5/d1a/d23/d3c/fa8 0 2024-02-16T22:18:57.132 INFO:tasks.workunit.client.0.smithi134.stdout:3/576: mknod da/d1c/d24/d29/d40/d8a/d8f/cb6 0 2024-02-16T22:18:57.132 INFO:tasks.workunit.client.0.smithi134.stdout:4/489: dread d0/d6/d16/f8b [0,4194304] 0 2024-02-16T22:18:57.133 INFO:tasks.workunit.client.0.smithi134.stdout:9/655: truncate db/d20/d22/d51/fc9 2849744 0 2024-02-16T22:18:57.133 INFO:tasks.workunit.client.0.smithi134.stdout:9/656: creat db/d20/d22/d51/d9b/fe4 x:0 0 0 2024-02-16T22:18:57.133 INFO:tasks.workunit.client.0.smithi134.stdout:9/657: fdatasync db/d20/d22/d51/f74 0 2024-02-16T22:18:57.133 INFO:tasks.workunit.client.0.smithi134.stdout:9/658: stat db 0 2024-02-16T22:18:57.135 INFO:tasks.workunit.client.0.smithi134.stdout:0/621: mknod d2/d20/d7a/d7e/cce 0 2024-02-16T22:18:57.136 INFO:tasks.workunit.client.0.smithi134.stdout:1/620: read d5/d1a/d53/fce [3787494,114337] 0 2024-02-16T22:18:57.137 INFO:tasks.workunit.client.0.smithi134.stdout:1/621: chown d5/d1a/d53/d86/c8d 320717 1 2024-02-16T22:18:57.137 INFO:tasks.workunit.client.0.smithi134.stdout:6/633: creat d17/d27/d93/fc9 x:0 0 0 2024-02-16T22:18:57.138 INFO:tasks.workunit.client.0.smithi134.stdout:5/647: creat d2/d35/d36/d3d/d63/d90/fd5 x:0 0 0 2024-02-16T22:18:57.141 INFO:tasks.workunit.client.0.smithi134.stdout:7/614: rename d2/ca3 to d2/d6/d7d/d92/ccb 0 2024-02-16T22:18:57.141 INFO:tasks.workunit.client.0.smithi134.stdout:7/615: truncate d2/d6/d7d/d9e/fb0 359425 0 2024-02-16T22:18:57.141 INFO:tasks.workunit.client.0.smithi134.stdout:7/616: write d2/d5/d19/fb1 [228116,102655] 0 2024-02-16T22:18:57.141 INFO:tasks.workunit.client.0.smithi134.stdout:7/617: write d2/d6/d7d/d92/da5/d63/f72 [482535,64690] 0 2024-02-16T22:18:57.143 INFO:tasks.workunit.client.0.smithi134.stdout:8/595: mknod d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/d7d/cc3 0 2024-02-16T22:18:57.144 INFO:tasks.workunit.client.0.smithi134.stdout:4/490: mkdir d0/d6/d44/da9 0 2024-02-16T22:18:57.144 INFO:tasks.workunit.client.0.smithi134.stdout:4/491: chown d0/d6/d1e/c78 98400104 1 2024-02-16T22:18:57.145 INFO:tasks.workunit.client.0.smithi134.stdout:2/552: dwrite df/d10/d30/d49/d82/d1b/f2f [4194304,4194304] 0 2024-02-16T22:18:57.145 INFO:tasks.workunit.client.0.smithi134.stdout:2/553: creat df/d10/d15/d5a/fa5 x:0 0 0 2024-02-16T22:18:57.148 INFO:tasks.workunit.client.0.smithi134.stdout:0/622: dread d2/d4b/f5b [0,4194304] 0 2024-02-16T22:18:57.148 INFO:tasks.workunit.client.0.smithi134.stdout:9/659: link db/l4b db/d20/d22/d46/dbe/le5 0 2024-02-16T22:18:57.148 INFO:tasks.workunit.client.0.smithi134.stdout:1/622: creat d5/fd0 x:0 0 0 2024-02-16T22:18:57.149 INFO:tasks.workunit.client.0.smithi134.stdout:6/634: creat d17/d36/d77/d9a/d73/fca x:0 0 0 2024-02-16T22:18:57.151 INFO:tasks.workunit.client.0.smithi134.stdout:5/648: unlink d2/d8f/laa 0 2024-02-16T22:18:57.152 INFO:tasks.workunit.client.0.smithi134.stdout:8/596: rename d2/df/d18/d27/d85/da4/da5 to d2/df/d18/d27/dc4 0 2024-02-16T22:18:57.152 INFO:tasks.workunit.client.0.smithi134.stdout:8/597: read d2/df/d18/d2a/d41/f4d [2631320,76000] 0 2024-02-16T22:18:57.154 INFO:tasks.workunit.client.0.smithi134.stdout:4/492: truncate d0/d6/d22/d25/d2a/f51 114934 0 2024-02-16T22:18:57.155 INFO:tasks.workunit.client.0.smithi134.stdout:5/649: dread d2/d9/dc/f3a [0,4194304] 0 2024-02-16T22:18:57.156 INFO:tasks.workunit.client.0.smithi134.stdout:2/554: mkdir df/d10/da6 0 2024-02-16T22:18:57.157 INFO:tasks.workunit.client.0.smithi134.stdout:9/660: creat db/d20/d22/d64/d69/d6e/fe6 x:0 0 0 2024-02-16T22:18:57.157 INFO:tasks.workunit.client.0.smithi134.stdout:1/623: symlink d5/d1a/d63/ld1 0 2024-02-16T22:18:57.158 INFO:tasks.workunit.client.0.smithi134.stdout:0/623: rename d2/dc/d97/l9e to d2/d20/d77/d85/d94/lcf 0 2024-02-16T22:18:57.159 INFO:tasks.workunit.client.0.smithi134.stdout:6/635: write d17/d36/d77/d9a/d28/f96 [2024278,47038] 0 2024-02-16T22:18:57.159 INFO:tasks.workunit.client.0.smithi134.stdout:8/598: mkdir d2/df/d18/dc5 0 2024-02-16T22:18:57.160 INFO:tasks.workunit.client.0.smithi134.stdout:2/555: mknod df/d6f/ca7 0 2024-02-16T22:18:57.161 INFO:tasks.workunit.client.0.smithi134.stdout:3/577: dwrite da/d12/d2a/f3c [0,4194304] 0 2024-02-16T22:18:57.161 INFO:tasks.workunit.client.0.smithi134.stdout:9/661: mknod db/d20/d22/d91/ce7 0 2024-02-16T22:18:57.161 INFO:tasks.workunit.client.0.smithi134.stdout:9/662: dread - db/d20/d22/d51/fad zero size 2024-02-16T22:18:57.161 INFO:tasks.workunit.client.0.smithi134.stdout:7/618: dwrite d2/f8d [4194304,4194304] 0 2024-02-16T22:18:57.163 INFO:tasks.workunit.client.0.smithi134.stdout:1/624: creat d5/da/d21/d52/d9b/db3/fd2 x:0 0 0 2024-02-16T22:18:57.163 INFO:tasks.workunit.client.0.smithi134.stdout:1/625: write d5/d1a/d23/d3c/d6a/fb9 [39324,109292] 0 2024-02-16T22:18:57.163 INFO:tasks.workunit.client.0.smithi134.stdout:1/626: write d5/d1a/d23/f39 [1624444,90126] 0 2024-02-16T22:18:57.163 INFO:tasks.workunit.client.0.smithi134.stdout:1/627: write d5/da/d1c/f49 [1920308,130336] 0 2024-02-16T22:18:57.164 INFO:tasks.workunit.client.0.smithi134.stdout:5/650: rename d2/lab to d2/d35/d36/d3d/d9c/dc2/dc8/ld6 0 2024-02-16T22:18:57.164 INFO:tasks.workunit.client.0.smithi134.stdout:5/651: chown d2/d9/dc/fe 13043591 1 2024-02-16T22:18:57.166 INFO:tasks.workunit.client.0.smithi134.stdout:6/636: mkdir d17/d27/d4f/dcb 0 2024-02-16T22:18:57.166 INFO:tasks.workunit.client.0.smithi134.stdout:6/637: write d17/d63/fb3 [5073944,84552] 0 2024-02-16T22:18:57.168 INFO:tasks.workunit.client.0.smithi134.stdout:8/599: unlink d2/df/d18/d2a/d41/d59/db1/fc1 0 2024-02-16T22:18:57.168 INFO:tasks.workunit.client.0.smithi134.stdout:8/600: dread - d2/df/d18/d91/fae zero size 2024-02-16T22:18:57.168 INFO:tasks.workunit.client.0.smithi134.stdout:8/601: stat d2/df/d18/d2a/d41/d59/da0/d40/d53/l88 0 2024-02-16T22:18:57.169 INFO:tasks.workunit.client.0.smithi134.stdout:2/556: creat df/d10/d15/d5a/d34/fa8 x:0 0 0 2024-02-16T22:18:57.171 INFO:tasks.workunit.client.0.smithi134.stdout:9/663: unlink db/c1d 0 2024-02-16T22:18:57.171 INFO:tasks.workunit.client.0.smithi134.stdout:9/664: write db/d20/d22/d51/f65 [1034689,119903] 0 2024-02-16T22:18:57.176 INFO:tasks.workunit.client.0.smithi134.stdout:0/624: rmdir d2/dc/da0 39 2024-02-16T22:18:57.176 INFO:tasks.workunit.client.0.smithi134.stdout:0/625: chown d2/d20/d77/d85/d94/lcf 27701057 1 2024-02-16T22:18:57.176 INFO:tasks.workunit.client.0.smithi134.stdout:0/626: fdatasync d2/dc/d32/d3e/d5e/f6f 0 2024-02-16T22:18:57.182 INFO:tasks.workunit.client.0.smithi134.stdout:6/638: truncate d17/d36/d77/d9a/f4b 985111 0 2024-02-16T22:18:57.182 INFO:tasks.workunit.client.0.smithi134.stdout:6/639: write d17/d27/d4f/d52/fba [1097918,54020] 0 2024-02-16T22:18:57.185 INFO:tasks.workunit.client.0.smithi134.stdout:8/602: link d2/df/d18/c78 d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/d7d/cc6 0 2024-02-16T22:18:57.186 INFO:tasks.workunit.client.0.smithi134.stdout:2/557: mkdir df/d10/d3a/da9 0 2024-02-16T22:18:57.188 INFO:tasks.workunit.client.0.smithi134.stdout:9/665: mknod db/d20/d22/d51/d9b/ce8 0 2024-02-16T22:18:57.190 INFO:tasks.workunit.client.0.smithi134.stdout:0/627: rename d2/db7/l68 to d2/d20/d77/d85/ld0 0 2024-02-16T22:18:57.192 INFO:tasks.workunit.client.0.smithi134.stdout:8/603: link d2/df/d18/d2a/d41/d59/da0/d86/c9b d2/df/d18/d27/d85/cc7 0 2024-02-16T22:18:57.192 INFO:tasks.workunit.client.0.smithi134.stdout:8/604: chown d2/df/d18/d27/dc4 46414443 1 2024-02-16T22:18:57.193 INFO:tasks.workunit.client.0.smithi134.stdout:2/558: mknod df/caa 0 2024-02-16T22:18:57.193 INFO:tasks.workunit.client.0.smithi134.stdout:0/628: truncate d2/f40 2478100 0 2024-02-16T22:18:57.202 INFO:tasks.workunit.client.0.smithi134.stdout:2/559: write f2 [1555113,69302] 0 2024-02-16T22:18:57.202 INFO:tasks.workunit.client.0.smithi134.stdout:2/560: fdatasync df/f3c 0 2024-02-16T22:18:57.202 INFO:tasks.workunit.client.0.smithi134.stdout:2/561: readlink df/d10/d30/d4d/d94/da3/l7f 0 2024-02-16T22:18:57.202 INFO:tasks.workunit.client.0.smithi134.stdout:2/562: fsync df/d10/d30/d49/d82/d1b/f64 0 2024-02-16T22:18:57.202 INFO:tasks.workunit.client.0.smithi134.stdout:9/666: write db/d20/d22/d51/fd7 [4117761,81811] 0 2024-02-16T22:18:57.204 INFO:tasks.workunit.client.0.smithi134.stdout:9/667: mkdir db/d20/d22/d51/d9b/dbd/de9 0 2024-02-16T22:18:57.206 INFO:tasks.workunit.client.0.smithi134.stdout:9/668: creat db/dc/fea x:0 0 0 2024-02-16T22:18:57.206 INFO:tasks.workunit.client.0.smithi134.stdout:9/669: dread - db/d20/d22/d51/d9b/fb6 zero size 2024-02-16T22:18:57.206 INFO:tasks.workunit.client.0.smithi134.stdout:9/670: creat db/d20/d22/d64/dc2/ddb/feb x:0 0 0 2024-02-16T22:18:57.207 INFO:tasks.workunit.client.0.smithi134.stdout:9/671: truncate db/f43 5945578 0 2024-02-16T22:18:57.217 INFO:tasks.workunit.client.0.smithi134.stdout:9/672: dread db/f33 [0,4194304] 0 2024-02-16T22:18:57.219 INFO:tasks.workunit.client.0.smithi134.stdout:8/605: dread d2/df/d18/d2a/f2b [0,4194304] 0 2024-02-16T22:18:57.219 INFO:tasks.workunit.client.0.smithi134.stdout:8/606: chown d2/df/d18/d2a/f2b 3984 1 2024-02-16T22:18:57.219 INFO:tasks.workunit.client.0.smithi134.stdout:8/607: write d2/f8b [975714,43012] 0 2024-02-16T22:18:57.238 INFO:tasks.workunit.client.0.smithi134.stdout:7/619: dwrite d2/d5/d19/d4a/f7b [0,4194304] 0 2024-02-16T22:18:57.240 INFO:tasks.workunit.client.0.smithi134.stdout:7/620: mkdir d2/d6/dcc 0 2024-02-16T22:18:57.250 INFO:tasks.workunit.client.0.smithi134.stdout:4/493: dwrite d0/d6/fa4 [0,4194304] 0 2024-02-16T22:18:57.250 INFO:tasks.workunit.client.0.smithi134.stdout:4/494: chown d0/d6/d22/d25/f48 34755 1 2024-02-16T22:18:57.250 INFO:tasks.workunit.client.0.smithi134.stdout:3/578: dwrite da/d1c/d24/d29/d51/f59 [0,4194304] 0 2024-02-16T22:18:57.251 INFO:tasks.workunit.client.0.smithi134.stdout:5/652: dwrite d2/d9/dc/d15/f31 [0,4194304] 0 2024-02-16T22:18:57.251 INFO:tasks.workunit.client.0.smithi134.stdout:6/640: dwrite d17/d27/d4f/d52/d97/fc8 [0,4194304] 0 2024-02-16T22:18:57.251 INFO:tasks.workunit.client.0.smithi134.stdout:6/641: dread - d17/d27/d4f/f78 zero size 2024-02-16T22:18:57.251 INFO:tasks.workunit.client.0.smithi134.stdout:6/642: readlink d17/d36/d77/d9a/d28/l6c 0 2024-02-16T22:18:57.252 INFO:tasks.workunit.client.0.smithi134.stdout:6/643: chown d17/d27/d30/f8c 95 1 2024-02-16T22:18:57.252 INFO:tasks.workunit.client.0.smithi134.stdout:6/644: chown d17/d36/d77/d9a/lc2 790 1 2024-02-16T22:18:57.252 INFO:tasks.workunit.client.0.smithi134.stdout:2/563: dwrite df/d10/d30/d4d/d94/da3/f72 [0,4194304] 0 2024-02-16T22:18:57.252 INFO:tasks.workunit.client.0.smithi134.stdout:2/564: truncate df/d10/d30/d4d/d94/da3/f61 1021026 0 2024-02-16T22:18:57.252 INFO:tasks.workunit.client.0.smithi134.stdout:2/565: write df/d10/d15/d5a/d34/f8f [12881,62138] 0 2024-02-16T22:18:57.252 INFO:tasks.workunit.client.0.smithi134.stdout:2/566: stat df/d41/f5e 0 2024-02-16T22:18:57.252 INFO:tasks.workunit.client.0.smithi134.stdout:0/629: dwrite d2/d20/d7a/fb3 [0,4194304] 0 2024-02-16T22:18:57.253 INFO:tasks.workunit.client.0.smithi134.stdout:0/630: chown d2/d20/d77/d85/db6/l66 11583 1 2024-02-16T22:18:57.253 INFO:tasks.workunit.client.0.smithi134.stdout:0/631: truncate d2/d20/d77/d85/f99 645550 0 2024-02-16T22:18:57.253 INFO:tasks.workunit.client.0.smithi134.stdout:0/632: readlink d2/d20/d77/d85/d94/lcf 0 2024-02-16T22:18:57.253 INFO:tasks.workunit.client.0.smithi134.stdout:9/673: dwrite db/dc/f54 [0,4194304] 0 2024-02-16T22:18:57.256 INFO:tasks.workunit.client.0.smithi134.stdout:5/653: dread d2/d9/dc/d15/f41 [0,4194304] 0 2024-02-16T22:18:57.259 INFO:tasks.workunit.client.0.smithi134.stdout:1/628: rmdir d5/da/d21/d52/d9b 39 2024-02-16T22:18:57.262 INFO:tasks.workunit.client.0.smithi134.stdout:7/621: dwrite d2/d5/d19/f1d [4194304,4194304] 0 2024-02-16T22:18:57.264 INFO:tasks.workunit.client.0.smithi134.stdout:3/579: write da/d1c/d24/d29/d51/f70 [1808074,109041] 0 2024-02-16T22:18:57.267 INFO:tasks.workunit.client.0.smithi134.stdout:6/645: write d17/d27/d4f/d52/d97/fc8 [3947371,92477] 0 2024-02-16T22:18:57.267 INFO:tasks.workunit.client.0.smithi134.stdout:6/646: fsync d17/d36/f58 0 2024-02-16T22:18:57.271 INFO:tasks.workunit.client.0.smithi134.stdout:2/567: truncate df/d10/d30/d49/d82/f20 1701974 0 2024-02-16T22:18:57.271 INFO:tasks.workunit.client.0.smithi134.stdout:2/568: truncate df/f3c 4251475 0 2024-02-16T22:18:57.271 INFO:tasks.workunit.client.0.smithi134.stdout:2/569: chown df/d10/f86 24737030 1 2024-02-16T22:18:57.271 INFO:tasks.workunit.client.0.smithi134.stdout:2/570: chown f2 33946 1 2024-02-16T22:18:57.271 INFO:tasks.workunit.client.0.smithi134.stdout:2/571: truncate df/d10/d15/d5a/f4c 607122 0 2024-02-16T22:18:57.274 INFO:tasks.workunit.client.0.smithi134.stdout:0/633: symlink d2/dc/d32/d3e/da7/ld1 0 2024-02-16T22:18:57.275 INFO:tasks.workunit.client.0.smithi134.stdout:6/647: dread d17/d36/d77/d9a/d28/fae [0,4194304] 0 2024-02-16T22:18:57.275 INFO:tasks.workunit.client.0.smithi134.stdout:6/648: chown d17/d27/d30/d32/c4e 195933043 1 2024-02-16T22:18:57.276 INFO:tasks.workunit.client.0.smithi134.stdout:6/649: creat d17/d63/fcc x:0 0 0 2024-02-16T22:18:57.276 INFO:tasks.workunit.client.0.smithi134.stdout:6/650: fdatasync d17/d36/d77/d9a/d28/f96 0 2024-02-16T22:18:57.279 INFO:tasks.workunit.client.0.smithi134.stdout:4/495: dwrite d0/d6/d22/d25/f3d [0,4194304] 0 2024-02-16T22:18:57.280 INFO:tasks.workunit.client.0.smithi134.stdout:4/496: write d0/d6/d1e/d39/f45 [289799,52523] 0 2024-02-16T22:18:57.282 INFO:tasks.workunit.client.0.smithi134.stdout:9/674: dwrite db/d20/d22/d51/d9b/dbd/fa1 [0,4194304] 0 2024-02-16T22:18:57.285 INFO:tasks.workunit.client.0.smithi134.stdout:3/580: dwrite da/d12/d2a/f3c [0,4194304] 0 2024-02-16T22:18:57.285 INFO:tasks.workunit.client.0.smithi134.stdout:3/581: fdatasync da/d1c/d24/d29/d51/d80/f85 0 2024-02-16T22:18:57.285 INFO:tasks.workunit.client.0.smithi134.stdout:3/582: stat da/d1c/d24/d29/d51/f95 0 2024-02-16T22:18:57.286 INFO:tasks.workunit.client.0.smithi134.stdout:3/583: fdatasync da/f19 0 2024-02-16T22:18:57.287 INFO:tasks.workunit.client.0.smithi134.stdout:5/654: mknod d2/d9/dc/d15/d2f/cd7 0 2024-02-16T22:18:57.289 INFO:tasks.workunit.client.0.smithi134.stdout:1/629: mknod d5/d1a/d23/d3c/cd3 0 2024-02-16T22:18:57.289 INFO:tasks.workunit.client.0.smithi134.stdout:1/630: chown d5/d1a/d23/d61 0 1 2024-02-16T22:18:57.289 INFO:tasks.workunit.client.0.smithi134.stdout:1/631: chown d5/da/d1c/lc0 260628 1 2024-02-16T22:18:57.289 INFO:tasks.workunit.client.0.smithi134.stdout:1/632: write d5/d1a/d23/fbc [958265,105802] 0 2024-02-16T22:18:57.292 INFO:tasks.workunit.client.0.smithi134.stdout:2/572: rename df/d10/d15/l58 to df/d10/d30/d4d/d94/da3/lab 0 2024-02-16T22:18:57.292 INFO:tasks.workunit.client.0.smithi134.stdout:2/573: fdatasync fb 0 2024-02-16T22:18:57.294 INFO:tasks.workunit.client.0.smithi134.stdout:6/651: creat d17/d27/d4f/d52/d79/d8b/fcd x:0 0 0 2024-02-16T22:18:57.297 INFO:tasks.workunit.client.0.smithi134.stdout:4/497: symlink d0/d6/d1e/d9a/laa 0 2024-02-16T22:18:57.300 INFO:tasks.workunit.client.0.smithi134.stdout:9/675: mkdir db/d20/d22/d64/d69/d6e/d81/dc4/dec 0 2024-02-16T22:18:57.306 INFO:tasks.workunit.client.0.smithi134.stdout:3/584: mknod da/d12/cb7 0 2024-02-16T22:18:57.307 INFO:tasks.workunit.client.0.smithi134.stdout:5/655: symlink d2/d9/dc/d98/db3/ld8 0 2024-02-16T22:18:57.308 INFO:tasks.workunit.client.0.smithi134.stdout:1/633: getdents d5/da 0 2024-02-16T22:18:57.310 INFO:tasks.workunit.client.0.smithi134.stdout:7/622: rename d2/d5/d22/d26/d48 to d2/d6/d7d/d92/dcd 0 2024-02-16T22:18:57.311 INFO:tasks.workunit.client.0.smithi134.stdout:6/652: creat d17/d36/d77/d9a/d83/dbc/fce x:0 0 0 2024-02-16T22:18:57.312 INFO:tasks.workunit.client.0.smithi134.stdout:6/653: write d17/d36/d77/d9a/d28/fa2 [196176,57193] 0 2024-02-16T22:18:57.312 INFO:tasks.workunit.client.0.smithi134.stdout:4/498: symlink d0/d6/d16/d86/lab 0 2024-02-16T22:18:57.313 INFO:tasks.workunit.client.0.smithi134.stdout:4/499: write d0/d6/d16/d86/f9f [9213880,112717] 0 2024-02-16T22:18:57.313 INFO:tasks.workunit.client.0.smithi134.stdout:4/500: readlink d0/d6/d8/d5e/l89 0 2024-02-16T22:18:57.313 INFO:tasks.workunit.client.0.smithi134.stdout:4/501: creat d0/d6/d1e/d3b/fac x:0 0 0 2024-02-16T22:18:57.313 INFO:tasks.workunit.client.0.smithi134.stdout:9/676: symlink db/d20/led 0 2024-02-16T22:18:57.315 INFO:tasks.workunit.client.0.smithi134.stdout:5/656: unlink d2/d35/d36/d3d/d63/l65 0 2024-02-16T22:18:57.315 INFO:tasks.workunit.client.0.smithi134.stdout:5/657: creat d2/d9/dc6/fd9 x:0 0 0 2024-02-16T22:18:57.316 INFO:tasks.workunit.client.0.smithi134.stdout:1/634: link d5/da/c1f d5/da/d21/d52/cd4 0 2024-02-16T22:18:57.317 INFO:tasks.workunit.client.0.smithi134.stdout:5/658: dread d2/d9/f6f [0,4194304] 0 2024-02-16T22:18:57.317 INFO:tasks.workunit.client.0.smithi134.stdout:7/623: mkdir d2/d5/d22/d83/dce 0 2024-02-16T22:18:57.321 INFO:tasks.workunit.client.0.smithi134.stdout:4/502: creat d0/d6/d22/d25/fad x:0 0 0 2024-02-16T22:18:57.323 INFO:tasks.workunit.client.0.smithi134.stdout:9/677: unlink db/d20/d22/d91/d99/ld3 0 2024-02-16T22:18:57.324 INFO:tasks.workunit.client.0.smithi134.stdout:3/585: rmdir da/d1c/d24/d29/d40/d8a/d8f/d6d 39 2024-02-16T22:18:57.324 INFO:tasks.workunit.client.0.smithi134.stdout:3/586: creat da/d1c/d24/d29/d40/d8a/fb8 x:0 0 0 2024-02-16T22:18:57.327 INFO:tasks.workunit.client.0.smithi134.stdout:1/635: mkdir d5/da/db8/dd5 0 2024-02-16T22:18:57.327 INFO:tasks.workunit.client.0.smithi134.stdout:5/659: getdents d2/d35/d36/da9 0 2024-02-16T22:18:57.327 INFO:tasks.workunit.client.0.smithi134.stdout:5/660: stat d2/d9/l66 0 2024-02-16T22:18:57.328 INFO:tasks.workunit.client.0.smithi134.stdout:5/661: readlink d2/d9/dc/d32/d61/lb1 0 2024-02-16T22:18:57.329 INFO:tasks.workunit.client.0.smithi134.stdout:7/624: mknod d2/d6/d7d/d92/ccf 0 2024-02-16T22:18:57.329 INFO:tasks.workunit.client.0.smithi134.stdout:7/625: fsync d2/f8c 0 2024-02-16T22:18:57.329 INFO:tasks.workunit.client.0.smithi134.stdout:6/654: getdents d17/d27/d93/d9c/da7 0 2024-02-16T22:18:57.331 INFO:tasks.workunit.client.0.smithi134.stdout:9/678: unlink db/dc/f16 0 2024-02-16T22:18:57.333 INFO:tasks.workunit.client.0.smithi134.stdout:3/587: unlink da/d1c/f67 0 2024-02-16T22:18:57.334 INFO:tasks.workunit.client.0.smithi134.stdout:1/636: mkdir d5/da/dd6 0 2024-02-16T22:18:57.335 INFO:tasks.workunit.client.0.smithi134.stdout:5/662: readlink d2/d9/dc/d32/l51 0 2024-02-16T22:18:57.335 INFO:tasks.workunit.client.0.smithi134.stdout:5/663: chown d2/d9/dc/daf/fd0 2625090 1 2024-02-16T22:18:57.337 INFO:tasks.workunit.client.0.smithi134.stdout:5/664: getdents d2 0 2024-02-16T22:18:57.337 INFO:tasks.workunit.client.0.smithi134.stdout:5/665: truncate d2/d35/d36/d3d/fac 4867167 0 2024-02-16T22:18:57.339 INFO:tasks.workunit.client.0.smithi134.stdout:8/608: sync 2024-02-16T22:18:57.342 INFO:tasks.workunit.client.0.smithi134.stdout:8/609: rmdir d2/df/d7c 39 2024-02-16T22:18:57.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/503: dwrite d0/d6/d22/d25/f3d [0,4194304] 0 2024-02-16T22:18:57.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/504: chown d0/d6/d8/d30/f71 546007418 1 2024-02-16T22:18:57.343 INFO:tasks.workunit.client.0.smithi134.stdout:3/588: dread da/d12/d2a/f7c [4194304,4194304] 0 2024-02-16T22:18:57.343 INFO:tasks.workunit.client.0.smithi134.stdout:6/655: fsync d17/d36/d77/d9a/d83/dbc/fce 0 2024-02-16T22:18:57.344 INFO:tasks.workunit.client.0.smithi134.stdout:8/610: mknod d2/df/d18/d2a/d41/d59/db1/d90/cc8 0 2024-02-16T22:18:57.349 INFO:tasks.workunit.client.0.smithi134.stdout:8/611: creat d2/da3/fc9 x:0 0 0 2024-02-16T22:18:57.351 INFO:tasks.workunit.client.0.smithi134.stdout:8/612: creat d2/df/d18/d27/d85/da4/fca x:0 0 0 2024-02-16T22:18:57.354 INFO:tasks.workunit.client.0.smithi134.stdout:1/637: dread d5/d1a/d23/d61/f83 [0,4194304] 0 2024-02-16T22:18:57.354 INFO:tasks.workunit.client.0.smithi134.stdout:1/638: dread - d5/d1a/d53/d86/faa zero size 2024-02-16T22:18:57.354 INFO:tasks.workunit.client.0.smithi134.stdout:1/639: dread - d5/d1a/d53/d86/faa zero size 2024-02-16T22:18:57.354 INFO:tasks.workunit.client.0.smithi134.stdout:4/505: dread d0/f4 [0,4194304] 0 2024-02-16T22:18:57.355 INFO:tasks.workunit.client.0.smithi134.stdout:8/613: dread d2/df/d18/d2a/d41/d59/f84 [0,4194304] 0 2024-02-16T22:18:57.355 INFO:tasks.workunit.client.0.smithi134.stdout:8/614: write d2/df/d18/d2a/d41/f4d [1031536,77797] 0 2024-02-16T22:18:57.355 INFO:tasks.workunit.client.0.smithi134.stdout:8/615: creat d2/df/d18/d2a/d41/d59/db1/fcb x:0 0 0 2024-02-16T22:18:57.356 INFO:tasks.workunit.client.0.smithi134.stdout:8/616: stat d2/fbd 0 2024-02-16T22:18:57.356 INFO:tasks.workunit.client.0.smithi134.stdout:8/617: chown d2/df/d18/d2a/d41/d59/da0/d8d 40 1 2024-02-16T22:18:57.356 INFO:tasks.workunit.client.0.smithi134.stdout:8/618: chown d2/df/d18/d2a/d41/d59/ca6 213364940 1 2024-02-16T22:18:57.356 INFO:tasks.workunit.client.0.smithi134.stdout:1/640: rename d5/l66 to d5/d1a/d53/d86/ld7 0 2024-02-16T22:18:57.356 INFO:tasks.workunit.client.0.smithi134.stdout:4/506: symlink d0/d6/lae 0 2024-02-16T22:18:57.358 INFO:tasks.workunit.client.0.smithi134.stdout:8/619: unlink d2/df/d18/d5a/f49 0 2024-02-16T22:18:57.358 INFO:tasks.workunit.client.0.smithi134.stdout:8/620: chown d2/df/d18/d2a/d41/d59/da0/d40/f8e 0 1 2024-02-16T22:18:57.358 INFO:tasks.workunit.client.0.smithi134.stdout:8/621: write d2/df/d18/d2a/d41/d59/da0/f28 [2930501,122220] 0 2024-02-16T22:18:57.358 INFO:tasks.workunit.client.0.smithi134.stdout:8/622: creat d2/df/d18/d27/d85/da4/fcc x:0 0 0 2024-02-16T22:18:57.359 INFO:tasks.workunit.client.0.smithi134.stdout:1/641: creat d5/d1a/d23/d3c/fd8 x:0 0 0 2024-02-16T22:18:57.359 INFO:tasks.workunit.client.0.smithi134.stdout:4/507: mkdir d0/d6/d22/d97/daf 0 2024-02-16T22:18:57.360 INFO:tasks.workunit.client.0.smithi134.stdout:8/623: creat d2/df/d18/d27/dc4/fcd x:0 0 0 2024-02-16T22:18:57.361 INFO:tasks.workunit.client.0.smithi134.stdout:1/642: creat d5/da/d21/d52/d9b/db6/fd9 x:0 0 0 2024-02-16T22:18:57.361 INFO:tasks.workunit.client.0.smithi134.stdout:8/624: mkdir d2/df/d18/db5/dce 0 2024-02-16T22:18:57.363 INFO:tasks.workunit.client.0.smithi134.stdout:8/625: rename d2/df/f33 to d2/df/d18/d2a/d41/d59/da0/d9f/fcf 0 2024-02-16T22:18:57.383 INFO:tasks.workunit.client.0.smithi134.stdout:7/626: dwrite d2/d6/f16 [4194304,4194304] 0 2024-02-16T22:18:57.384 INFO:tasks.workunit.client.0.smithi134.stdout:8/626: dwrite d2/df/d18/d2a/d41/d59/db1/d87/f7a [0,4194304] 0 2024-02-16T22:18:57.389 INFO:tasks.workunit.client.0.smithi134.stdout:7/627: creat d2/d5/d22/d83/dce/fd0 x:0 0 0 2024-02-16T22:18:57.389 INFO:tasks.workunit.client.0.smithi134.stdout:7/628: write d2/d6/d7d/d92/da5/f2a [2514150,9919] 0 2024-02-16T22:18:57.392 INFO:tasks.workunit.client.0.smithi134.stdout:8/627: rmdir d2/df/d18 39 2024-02-16T22:18:57.392 INFO:tasks.workunit.client.0.smithi134.stdout:8/628: chown d2/df/d18/d27/cb0 111281 1 2024-02-16T22:18:57.392 INFO:tasks.workunit.client.0.smithi134.stdout:8/629: read d2/f24 [1382172,16543] 0 2024-02-16T22:18:57.393 INFO:tasks.workunit.client.0.smithi134.stdout:7/629: chown d2/d6/c1f 1368076 1 2024-02-16T22:18:57.393 INFO:tasks.workunit.client.0.smithi134.stdout:4/508: write d0/d6/d16/f28 [1631593,60574] 0 2024-02-16T22:18:57.393 INFO:tasks.workunit.client.0.smithi134.stdout:4/509: readlink d0/d6/d8/d32/d68/la6 0 2024-02-16T22:18:57.393 INFO:tasks.workunit.client.0.smithi134.stdout:4/510: chown d0/d6/d8/da2 32739376 1 2024-02-16T22:18:57.395 INFO:tasks.workunit.client.0.smithi134.stdout:8/630: unlink d2/df/d18/d2a/d41/d59/db1/d87/fb3 0 2024-02-16T22:18:57.395 INFO:tasks.workunit.client.0.smithi134.stdout:7/630: mkdir d2/d6/d7d/d92/da5/d63/dc2/dd1 0 2024-02-16T22:18:57.398 INFO:tasks.workunit.client.0.smithi134.stdout:4/511: rmdir d0/d6/d8/d32/d68 39 2024-02-16T22:18:57.398 INFO:tasks.workunit.client.0.smithi134.stdout:7/631: rmdir d2/d6/d17/d31/d28 39 2024-02-16T22:18:57.400 INFO:tasks.workunit.client.0.smithi134.stdout:4/512: mkdir d0/d6/d44/db0 0 2024-02-16T22:18:57.401 INFO:tasks.workunit.client.0.smithi134.stdout:7/632: rename d2/d5/d19/d4a/c95 to d2/d6/d7d/cd2 0 2024-02-16T22:18:57.402 INFO:tasks.workunit.client.0.smithi134.stdout:7/633: getdents d2/d5/d19/d84/d86 0 2024-02-16T22:18:57.406 INFO:tasks.workunit.client.0.smithi134.stdout:3/589: dwrite da/d1c/d24/d29/d40/d8a/d8f/f4e [0,4194304] 0 2024-02-16T22:18:57.406 INFO:tasks.workunit.client.0.smithi134.stdout:6/656: dwrite d17/d36/d77/d9a/f7e [4194304,4194304] 0 2024-02-16T22:18:57.406 INFO:tasks.workunit.client.0.smithi134.stdout:3/590: chown da/f3a 12969949 1 2024-02-16T22:18:57.407 INFO:tasks.workunit.client.0.smithi134.stdout:1/643: dwrite d5/d1a/d53/fce [0,4194304] 0 2024-02-16T22:18:57.407 INFO:tasks.workunit.client.0.smithi134.stdout:5/666: dwrite d2/d9/dc/d15/d2f/fbb [0,4194304] 0 2024-02-16T22:18:57.407 INFO:tasks.workunit.client.0.smithi134.stdout:5/667: fdatasync d2/d35/d72/f7a 0 2024-02-16T22:18:57.407 INFO:tasks.workunit.client.0.smithi134.stdout:5/668: chown d2/d35/d36/d3d/d63/d90/fd5 3529232 1 2024-02-16T22:18:57.407 INFO:tasks.workunit.client.0.smithi134.stdout:5/669: write d2/d35/d36/d46/f6b [5104720,21403] 0 2024-02-16T22:18:57.407 INFO:tasks.workunit.client.0.smithi134.stdout:5/670: fsync d2/d35/d36/d3d/fa3 0 2024-02-16T22:18:57.408 INFO:tasks.workunit.client.0.smithi134.stdout:6/657: creat d17/d27/d4f/fcf x:0 0 0 2024-02-16T22:18:57.409 INFO:tasks.workunit.client.0.smithi134.stdout:4/513: dread d0/d6/f24 [0,4194304] 0 2024-02-16T22:18:57.409 INFO:tasks.workunit.client.0.smithi134.stdout:1/644: unlink d5/d1a/l73 0 2024-02-16T22:18:57.410 INFO:tasks.workunit.client.0.smithi134.stdout:3/591: write da/d12/f76 [248846,35100] 0 2024-02-16T22:18:57.411 INFO:tasks.workunit.client.0.smithi134.stdout:5/671: mkdir d2/d9/dc/daf/dda 0 2024-02-16T22:18:57.412 INFO:tasks.workunit.client.0.smithi134.stdout:6/658: truncate d17/d27/d4f/f68 221200 0 2024-02-16T22:18:57.413 INFO:tasks.workunit.client.0.smithi134.stdout:4/514: creat d0/d6/d22/fb1 x:0 0 0 2024-02-16T22:18:57.413 INFO:tasks.workunit.client.0.smithi134.stdout:4/515: chown d0/d6/d22/d25/f56 1 1 2024-02-16T22:18:57.414 INFO:tasks.workunit.client.0.smithi134.stdout:7/634: write d2/d6/f41 [4172837,51097] 0 2024-02-16T22:18:57.414 INFO:tasks.workunit.client.0.smithi134.stdout:7/635: fdatasync d2/d6/d7d/d92/da5/d63/f72 0 2024-02-16T22:18:57.414 INFO:tasks.workunit.client.0.smithi134.stdout:1/645: creat d5/d1a/d23/d3c/d6a/d5c/d72/fda x:0 0 0 2024-02-16T22:18:57.415 INFO:tasks.workunit.client.0.smithi134.stdout:1/646: fdatasync d5/d1a/d23/d85/f8f 0 2024-02-16T22:18:57.416 INFO:tasks.workunit.client.0.smithi134.stdout:8/631: dwrite d2/df/d18/d2a/d41/d59/db1/d87/f7a [0,4194304] 0 2024-02-16T22:18:57.416 INFO:tasks.workunit.client.0.smithi134.stdout:8/632: fdatasync d2/df/d18/f5 0 2024-02-16T22:18:57.416 INFO:tasks.workunit.client.0.smithi134.stdout:8/633: fsync d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/f77 0 2024-02-16T22:18:57.416 INFO:tasks.workunit.client.0.smithi134.stdout:3/592: unlink da/d1c/d24/d29/d40/fb3 0 2024-02-16T22:18:57.416 INFO:tasks.workunit.client.0.smithi134.stdout:3/593: rename da/d1c to da/d1c/d24/d29/d51/d80/d90/db9 22 2024-02-16T22:18:57.418 INFO:tasks.workunit.client.0.smithi134.stdout:5/672: creat d2/d9/dc/fdb x:0 0 0 2024-02-16T22:18:57.418 INFO:tasks.workunit.client.0.smithi134.stdout:6/659: dread d17/d27/d4f/f67 [0,4194304] 0 2024-02-16T22:18:57.418 INFO:tasks.workunit.client.0.smithi134.stdout:4/516: mknod d0/d6/d16/cb2 0 2024-02-16T22:18:57.418 INFO:tasks.workunit.client.0.smithi134.stdout:4/517: fdatasync d0/d6/d22/d25/f73 0 2024-02-16T22:18:57.421 INFO:tasks.workunit.client.0.smithi134.stdout:7/636: creat d2/d5/d19/d4a/fd3 x:0 0 0 2024-02-16T22:18:57.421 INFO:tasks.workunit.client.0.smithi134.stdout:7/637: dread - d2/d6/d7d/d92/dcd/fa2 zero size 2024-02-16T22:18:57.422 INFO:tasks.workunit.client.0.smithi134.stdout:1/647: mknod d5/da/d21/d52/d9b/cdb 0 2024-02-16T22:18:57.435 INFO:tasks.workunit.client.0.smithi134.stdout:8/634: symlink d2/df/d18/d2a/d41/d59/da0/d40/d53/dbe/ld0 0 2024-02-16T22:18:57.435 INFO:tasks.workunit.client.0.smithi134.stdout:5/673: mknod d2/d9/dc/d32/dd3/cdc 0 2024-02-16T22:18:57.437 INFO:tasks.workunit.client.0.smithi134.stdout:6/660: rename d17/d36/d77/d9a/d70/d86 to d17/d36/dd0 0 2024-02-16T22:18:57.437 INFO:tasks.workunit.client.0.smithi134.stdout:6/661: fdatasync d17/d36/d77/d9a/d28/f96 0 2024-02-16T22:18:57.438 INFO:tasks.workunit.client.0.smithi134.stdout:8/635: rename d2/la1 to d2/ld1 0 2024-02-16T22:18:57.440 INFO:tasks.workunit.client.0.smithi134.stdout:1/648: rename d5/da/d21/cbf to d5/da/d21/d52/d9b/cdc 0 2024-02-16T22:18:57.440 INFO:tasks.workunit.client.0.smithi134.stdout:5/674: rename d2/d35/d36 to d2/d35/d36/d3d/ddd 22 2024-02-16T22:18:57.440 INFO:tasks.workunit.client.0.smithi134.stdout:5/675: dread - d2/d35/d36/d46/d68/d74/fa7 zero size 2024-02-16T22:18:57.441 INFO:tasks.workunit.client.0.smithi134.stdout:6/662: mkdir d17/d36/d77/d9a/d28/d5b/d88/daf/dd1 0 2024-02-16T22:18:57.443 INFO:tasks.workunit.client.0.smithi134.stdout:8/636: link d2/df/d18/cb d2/da3/cd2 0 2024-02-16T22:18:57.443 INFO:tasks.workunit.client.0.smithi134.stdout:8/637: write d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/fb4 [963430,75997] 0 2024-02-16T22:18:57.443 INFO:tasks.workunit.client.0.smithi134.stdout:3/594: dwrite da/f11 [0,4194304] 0 2024-02-16T22:18:57.443 INFO:tasks.workunit.client.0.smithi134.stdout:7/638: dwrite d2/d5/d19/f44 [8388608,4194304] 0 2024-02-16T22:18:57.444 INFO:tasks.workunit.client.0.smithi134.stdout:4/518: dwrite d0/f15 [0,4194304] 0 2024-02-16T22:18:57.444 INFO:tasks.workunit.client.0.smithi134.stdout:5/676: rename d2/d35/d36/d46/d68/d74/f75 to d2/d9/dc/daf/dda/fde 0 2024-02-16T22:18:57.445 INFO:tasks.workunit.client.0.smithi134.stdout:6/663: link d17/d36/d77/d9a/d28/c2c d17/d27/d4f/d52/d79/cd2 0 2024-02-16T22:18:57.448 INFO:tasks.workunit.client.0.smithi134.stdout:8/638: mkdir d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/dd3 0 2024-02-16T22:18:57.451 INFO:tasks.workunit.client.0.smithi134.stdout:3/595: link da/d1c/d24/d29/d51/d80/d90/c98 da/d12/d2a/cba 0 2024-02-16T22:18:57.452 INFO:tasks.workunit.client.0.smithi134.stdout:7/639: mknod d2/d5/d19/d4a/d9d/cd4 0 2024-02-16T22:18:57.455 INFO:tasks.workunit.client.0.smithi134.stdout:4/519: rename d0/lc to d0/d6/d22/d40/lb3 0 2024-02-16T22:18:57.455 INFO:tasks.workunit.client.0.smithi134.stdout:6/664: write d17/d36/d77/d9a/d28/f81 [3182562,78227] 0 2024-02-16T22:18:57.455 INFO:tasks.workunit.client.0.smithi134.stdout:1/649: dwrite d5/d1a/d23/f43 [0,4194304] 0 2024-02-16T22:18:57.455 INFO:tasks.workunit.client.0.smithi134.stdout:1/650: stat d5/d1a/d23/d61 0 2024-02-16T22:18:57.456 INFO:tasks.workunit.client.0.smithi134.stdout:3/596: symlink da/d1c/d24/d29/d51/d80/d89/d8e/dab/lbb 0 2024-02-16T22:18:57.458 INFO:tasks.workunit.client.0.smithi134.stdout:3/597: dread da/f3a [0,4194304] 0 2024-02-16T22:18:57.458 INFO:tasks.workunit.client.0.smithi134.stdout:8/639: rename d2/d80/f8f to d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/fd4 0 2024-02-16T22:18:57.463 INFO:tasks.workunit.client.0.smithi134.stdout:6/665: mkdir d17/d27/d30/dd3 0 2024-02-16T22:18:57.466 INFO:tasks.workunit.client.0.smithi134.stdout:1/651: unlink d5/da/d1c/f94 0 2024-02-16T22:18:57.468 INFO:tasks.workunit.client.0.smithi134.stdout:3/598: dread da/f11 [0,4194304] 0 2024-02-16T22:18:57.469 INFO:tasks.workunit.client.0.smithi134.stdout:7/640: rename d2/d5/d19/d84/d86/d93/dbd to d2/d6/d7d/d92/dd5 0 2024-02-16T22:18:57.469 INFO:tasks.workunit.client.0.smithi134.stdout:4/520: getdents d0/d6/d8/d5e 0 2024-02-16T22:18:57.471 INFO:tasks.workunit.client.0.smithi134.stdout:9/679: sync 2024-02-16T22:18:57.471 INFO:tasks.workunit.client.0.smithi134.stdout:0/634: sync 2024-02-16T22:18:57.472 INFO:tasks.workunit.client.0.smithi134.stdout:2/574: sync 2024-02-16T22:18:57.472 INFO:tasks.workunit.client.0.smithi134.stdout:2/575: chown df/d10/d3a/f50 841 1 2024-02-16T22:18:57.472 INFO:tasks.workunit.client.0.smithi134.stdout:0/635: write d2/dc/d32/fbc [1194476,126348] 0 2024-02-16T22:18:57.474 INFO:tasks.workunit.client.0.smithi134.stdout:1/652: rename d5/d1a/d82/lab to d5/da/dd6/ldd 0 2024-02-16T22:18:57.474 INFO:tasks.workunit.client.0.smithi134.stdout:1/653: write d5/da/d2d/f54 [1015904,51855] 0 2024-02-16T22:18:57.475 INFO:tasks.workunit.client.0.smithi134.stdout:9/680: write db/f33 [644265,72349] 0 2024-02-16T22:18:57.478 INFO:tasks.workunit.client.0.smithi134.stdout:4/521: truncate d0/d6/d8/d32/d63/d6c/f83 2364401 0 2024-02-16T22:18:57.478 INFO:tasks.workunit.client.0.smithi134.stdout:1/654: write d5/d1a/d23/fbc [94273,40383] 0 2024-02-16T22:18:57.478 INFO:tasks.workunit.client.0.smithi134.stdout:1/655: chown d5/da/fa2 11796003 1 2024-02-16T22:18:57.480 INFO:tasks.workunit.client.0.smithi134.stdout:0/636: symlink d2/dc/d32/d3e/d5e/ld2 0 2024-02-16T22:18:57.480 INFO:tasks.workunit.client.0.smithi134.stdout:6/666: dwrite d17/d63/fb3 [4194304,4194304] 0 2024-02-16T22:18:57.487 INFO:tasks.workunit.client.0.smithi134.stdout:7/641: rename d2/d5/d4c/laf to d2/d6/d17/d31/d28/ld6 0 2024-02-16T22:18:57.491 INFO:tasks.workunit.client.0.smithi134.stdout:5/677: unlink d2/d9/dc/daf/dda/fde 0 2024-02-16T22:18:57.493 INFO:tasks.workunit.client.0.smithi134.stdout:4/522: mkdir d0/d6/d22/d25/d2a/db4 0 2024-02-16T22:18:57.498 INFO:tasks.workunit.client.0.smithi134.stdout:0/637: creat d2/d20/d77/db9/fd3 x:0 0 0 2024-02-16T22:18:57.498 INFO:tasks.workunit.client.0.smithi134.stdout:0/638: chown d2/dc/d32/lbb 49 1 2024-02-16T22:18:57.499 INFO:tasks.workunit.client.0.smithi134.stdout:6/667: mkdir d17/d27/d4f/dd4 0 2024-02-16T22:18:57.499 INFO:tasks.workunit.client.0.smithi134.stdout:6/668: read d17/d36/d77/d9a/f25 [2100502,23368] 0 2024-02-16T22:18:57.503 INFO:tasks.workunit.client.0.smithi134.stdout:6/669: mknod d17/d36/d77/d9a/d83/dbc/cd5 0 2024-02-16T22:18:57.503 INFO:tasks.workunit.client.0.smithi134.stdout:3/599: dwrite da/f11 [4194304,4194304] 0 2024-02-16T22:18:57.505 INFO:tasks.workunit.client.0.smithi134.stdout:4/523: write d0/d6/d22/d25/f3d [1070612,87591] 0 2024-02-16T22:18:57.508 INFO:tasks.workunit.client.0.smithi134.stdout:4/524: creat d0/d6/d16/d1a/fb5 x:0 0 0 2024-02-16T22:18:57.508 INFO:tasks.workunit.client.0.smithi134.stdout:0/639: dread d2/f1c [8388608,4194304] 0 2024-02-16T22:18:57.508 INFO:tasks.workunit.client.0.smithi134.stdout:0/640: dread - d2/dc/d2d/d34/fad zero size 2024-02-16T22:18:57.509 INFO:tasks.workunit.client.0.smithi134.stdout:4/525: symlink d0/d6/d22/d97/lb6 0 2024-02-16T22:18:57.518 INFO:tasks.workunit.client.0.smithi134.stdout:2/576: dwrite df/d10/d15/d5a/f4c [0,4194304] 0 2024-02-16T22:18:57.519 INFO:tasks.workunit.client.0.smithi134.stdout:3/600: read da/d1c/d24/d29/d40/d8a/d8f/f4e [2275256,122916] 0 2024-02-16T22:18:57.520 INFO:tasks.workunit.client.0.smithi134.stdout:2/577: creat df/d10/d30/fac x:0 0 0 2024-02-16T22:18:57.522 INFO:tasks.workunit.client.0.smithi134.stdout:5/678: dwrite d2/d9/dc/d15/f3b [0,4194304] 0 2024-02-16T22:18:57.523 INFO:tasks.workunit.client.0.smithi134.stdout:5/679: dread - d2/d9/dc/d15/d2f/fc1 zero size 2024-02-16T22:18:57.523 INFO:tasks.workunit.client.0.smithi134.stdout:5/680: dread - d2/d9/dc/d15/f4d zero size 2024-02-16T22:18:57.523 INFO:tasks.workunit.client.0.smithi134.stdout:5/681: chown d2/d9/dc/d15/d2f/l7f 58099 1 2024-02-16T22:18:57.523 INFO:tasks.workunit.client.0.smithi134.stdout:6/670: dwrite d17/d36/d77/d9a/d28/d5b/d88/fa4 [4194304,4194304] 0 2024-02-16T22:18:57.523 INFO:tasks.workunit.client.0.smithi134.stdout:6/671: chown d17/d27/d30/d32/l6e 416975059 1 2024-02-16T22:18:57.523 INFO:tasks.workunit.client.0.smithi134.stdout:3/601: rename da/d12/d2a/da4/db2 to da/d1c/d24/d29/d51/d80/d89/d8e/dbc 0 2024-02-16T22:18:57.525 INFO:tasks.workunit.client.0.smithi134.stdout:9/681: dwrite db/dc/f15 [4194304,4194304] 0 2024-02-16T22:18:57.525 INFO:tasks.workunit.client.0.smithi134.stdout:0/641: read d2/d20/d7a/fb3 [1389194,65402] 0 2024-02-16T22:18:57.525 INFO:tasks.workunit.client.0.smithi134.stdout:9/682: dread - db/d20/d22/d46/d8f/f92 zero size 2024-02-16T22:18:57.526 INFO:tasks.workunit.client.0.smithi134.stdout:9/683: chown db/d20/d22/d51/f5f 266797 1 2024-02-16T22:18:57.526 INFO:tasks.workunit.client.0.smithi134.stdout:9/684: stat db/dc/f38 0 2024-02-16T22:18:57.526 INFO:tasks.workunit.client.0.smithi134.stdout:9/685: truncate db/d20/d22/d64/dc2/fe1 100599 0 2024-02-16T22:18:57.526 INFO:tasks.workunit.client.0.smithi134.stdout:5/682: truncate f0 5592888 0 2024-02-16T22:18:57.527 INFO:tasks.workunit.client.0.smithi134.stdout:7/642: dwrite d2/d6/d7d/d92/da5/f2a [4194304,4194304] 0 2024-02-16T22:18:57.527 INFO:tasks.workunit.client.0.smithi134.stdout:4/526: write d0/f4 [165766,110477] 0 2024-02-16T22:18:57.527 INFO:tasks.workunit.client.0.smithi134.stdout:4/527: fsync d0/d6/d16/d1a/f1d 0 2024-02-16T22:18:57.528 INFO:tasks.workunit.client.0.smithi134.stdout:3/602: truncate da/d12/f21 1327188 0 2024-02-16T22:18:57.531 INFO:tasks.workunit.client.0.smithi134.stdout:9/686: link db/d20/d22/d51/c52 db/d20/d22/d51/cee 0 2024-02-16T22:18:57.531 INFO:tasks.workunit.client.0.smithi134.stdout:9/687: chown db 0 1 2024-02-16T22:18:57.533 INFO:tasks.workunit.client.0.smithi134.stdout:2/578: dread df/d10/f86 [0,4194304] 0 2024-02-16T22:18:57.536 INFO:tasks.workunit.client.0.smithi134.stdout:7/643: link d2/d6/d17/d31/d28/f36 d2/d5/d19/d84/d86/fd7 0 2024-02-16T22:18:57.536 INFO:tasks.workunit.client.0.smithi134.stdout:7/644: chown d2/d5/d19/fb1 34 1 2024-02-16T22:18:57.537 INFO:tasks.workunit.client.0.smithi134.stdout:4/528: link d0/d6/d1e/l37 d0/d6/d58/lb7 0 2024-02-16T22:18:57.542 INFO:tasks.workunit.client.0.smithi134.stdout:0/642: truncate d2/dc/f44 281693 0 2024-02-16T22:18:57.542 INFO:tasks.workunit.client.0.smithi134.stdout:0/643: truncate d2/d56/f8b 2788646 0 2024-02-16T22:18:57.542 INFO:tasks.workunit.client.0.smithi134.stdout:9/688: mkdir db/de0/def 0 2024-02-16T22:18:57.543 INFO:tasks.workunit.client.0.smithi134.stdout:5/683: getdents d2/d35/d36/d3d/d9c/d4b 0 2024-02-16T22:18:57.543 INFO:tasks.workunit.client.0.smithi134.stdout:0/644: dread d2/d20/d50/f9b [0,4194304] 0 2024-02-16T22:18:57.544 INFO:tasks.workunit.client.0.smithi134.stdout:2/579: stat df/d10/d30/d4d/d94/da3/l60 0 2024-02-16T22:18:57.544 INFO:tasks.workunit.client.0.smithi134.stdout:2/580: readlink df/d10/d15/l87 0 2024-02-16T22:18:57.547 INFO:tasks.workunit.client.0.smithi134.stdout:7/645: truncate d2/d5/f2d 2470846 0 2024-02-16T22:18:57.550 INFO:tasks.workunit.client.0.smithi134.stdout:6/672: rename d17/d27/d4f/d52/d97 to d17/d36/d77/d9a/d73/dd6 0 2024-02-16T22:18:57.552 INFO:tasks.workunit.client.0.smithi134.stdout:9/689: mkdir db/d20/d22/d64/dc2/dcb/df0 0 2024-02-16T22:18:57.555 INFO:tasks.workunit.client.0.smithi134.stdout:5/684: unlink d2/d35/d36/d3d/d9c/dc2/cd1 0 2024-02-16T22:18:57.556 INFO:tasks.workunit.client.0.smithi134.stdout:0/645: symlink d2/d4b/d53/ld4 0 2024-02-16T22:18:57.556 INFO:tasks.workunit.client.0.smithi134.stdout:0/646: write d2/dc/d2d/d34/f61 [1209188,80086] 0 2024-02-16T22:18:57.557 INFO:tasks.workunit.client.0.smithi134.stdout:4/529: truncate d0/d6/d22/d25/f3d 2110285 0 2024-02-16T22:18:57.557 INFO:tasks.workunit.client.0.smithi134.stdout:4/530: write d0/d6/d8/d30/f7e [166459,38731] 0 2024-02-16T22:18:57.558 INFO:tasks.workunit.client.0.smithi134.stdout:7/646: dread d2/d6/fa4 [0,4194304] 0 2024-02-16T22:18:57.559 INFO:tasks.workunit.client.0.smithi134.stdout:3/603: rename da/d1c/d24/d29/l61 to da/d1c/lbd 0 2024-02-16T22:18:57.559 INFO:tasks.workunit.client.0.smithi134.stdout:3/604: dread - da/d1c/d24/d29/d40/d8a/fb8 zero size 2024-02-16T22:18:57.559 INFO:tasks.workunit.client.0.smithi134.stdout:3/605: write da/d1c/d24/d29/d51/f87 [474849,70085] 0 2024-02-16T22:18:57.560 INFO:tasks.workunit.client.0.smithi134.stdout:6/673: creat d17/d27/d4f/dd4/fd7 x:0 0 0 2024-02-16T22:18:57.562 INFO:tasks.workunit.client.0.smithi134.stdout:9/690: creat db/d20/d22/d46/dbe/ff1 x:0 0 0 2024-02-16T22:18:57.562 INFO:tasks.workunit.client.0.smithi134.stdout:9/691: read - db/d20/d22/d64/d69/d89/fbf zero size 2024-02-16T22:18:57.562 INFO:tasks.workunit.client.0.smithi134.stdout:9/692: chown db/fb7 264732345 1 2024-02-16T22:18:57.563 INFO:tasks.workunit.client.0.smithi134.stdout:5/685: mkdir d2/d9/dc/d15/d2f/ddf 0 2024-02-16T22:18:57.563 INFO:tasks.workunit.client.0.smithi134.stdout:5/686: write d2/d35/d36/d3d/d63/d90/fa6 [299557,69972] 0 2024-02-16T22:18:57.563 INFO:tasks.workunit.client.0.smithi134.stdout:5/687: stat d2/d9/dc/d98/fcb 0 2024-02-16T22:18:57.563 INFO:tasks.workunit.client.0.smithi134.stdout:5/688: dread - d2/d9/dc/d15/d2f/fc1 zero size 2024-02-16T22:18:57.564 INFO:tasks.workunit.client.0.smithi134.stdout:0/647: mkdir d2/d20/d77/d85/db6/dd5 0 2024-02-16T22:18:57.565 INFO:tasks.workunit.client.0.smithi134.stdout:3/606: symlink da/d12/d2a/da4/lbe 0 2024-02-16T22:18:57.565 INFO:tasks.workunit.client.0.smithi134.stdout:3/607: write da/d12/f42 [5417801,106448] 0 2024-02-16T22:18:57.565 INFO:tasks.workunit.client.0.smithi134.stdout:4/531: dread d0/d6/d16/f28 [0,4194304] 0 2024-02-16T22:18:57.566 INFO:tasks.workunit.client.0.smithi134.stdout:6/674: mkdir d17/d36/d77/d9a/d28/d5b/d88/dd8 0 2024-02-16T22:18:57.567 INFO:tasks.workunit.client.0.smithi134.stdout:7/647: dread d2/f1a [0,4194304] 0 2024-02-16T22:18:57.567 INFO:tasks.workunit.client.0.smithi134.stdout:7/648: write d2/d6/f41 [789173,88068] 0 2024-02-16T22:18:57.567 INFO:tasks.workunit.client.0.smithi134.stdout:7/649: readlink d2/d5/d4c/l64 0 2024-02-16T22:18:57.567 INFO:tasks.workunit.client.0.smithi134.stdout:2/581: dwrite df/d10/d15/d90/f92 [0,4194304] 0 2024-02-16T22:18:57.569 INFO:tasks.workunit.client.0.smithi134.stdout:0/648: dread d2/f22 [0,4194304] 0 2024-02-16T22:18:57.569 INFO:tasks.workunit.client.0.smithi134.stdout:9/693: rmdir db/d20/d55/d8c 39 2024-02-16T22:18:57.570 INFO:tasks.workunit.client.0.smithi134.stdout:5/689: unlink d2/d9/dc/fdb 0 2024-02-16T22:18:57.570 INFO:tasks.workunit.client.0.smithi134.stdout:7/650: dread d2/f1a [0,4194304] 0 2024-02-16T22:18:57.573 INFO:tasks.workunit.client.0.smithi134.stdout:3/608: creat da/d12/d2a/fbf x:0 0 0 2024-02-16T22:18:57.575 INFO:tasks.workunit.client.0.smithi134.stdout:5/690: fsync d2/d35/d36/d3d/d63/d90/fa6 0 2024-02-16T22:18:57.576 INFO:tasks.workunit.client.0.smithi134.stdout:6/675: mknod d17/d27/d30/dd3/cd9 0 2024-02-16T22:18:57.583 INFO:tasks.workunit.client.0.smithi134.stdout:0/649: read d2/dc/d32/d3e/f69 [4096065,86747] 0 2024-02-16T22:18:57.588 INFO:tasks.workunit.client.0.smithi134.stdout:4/532: dwrite d0/d6/d22/d25/d2a/f2e [0,4194304] 0 2024-02-16T22:18:57.588 INFO:tasks.workunit.client.0.smithi134.stdout:4/533: stat d0/d6/d22/d25/f98 0 2024-02-16T22:18:57.589 INFO:tasks.workunit.client.0.smithi134.stdout:2/582: mknod df/d10/d30/d49/d7b/cad 0 2024-02-16T22:18:57.592 INFO:tasks.workunit.client.0.smithi134.stdout:9/694: creat db/de0/def/ff2 x:0 0 0 2024-02-16T22:18:57.594 INFO:tasks.workunit.client.0.smithi134.stdout:7/651: mkdir d2/d5/d22/d26/dd8 0 2024-02-16T22:18:57.595 INFO:tasks.workunit.client.0.smithi134.stdout:7/652: dread d2/d6/d7d/d92/dcd/d7f/d24/f5a [0,4194304] 0 2024-02-16T22:18:57.597 INFO:tasks.workunit.client.0.smithi134.stdout:0/650: dread d2/dc/d32/d3e/f47 [0,4194304] 0 2024-02-16T22:18:57.597 INFO:tasks.workunit.client.0.smithi134.stdout:5/691: dwrite d2/d35/d36/f37 [4194304,4194304] 0 2024-02-16T22:18:57.597 INFO:tasks.workunit.client.0.smithi134.stdout:5/692: write d2/d9/f6f [1436269,107897] 0 2024-02-16T22:18:57.597 INFO:tasks.workunit.client.0.smithi134.stdout:2/583: mkdir df/d10/d3a/da9/dae 0 2024-02-16T22:18:57.598 INFO:tasks.workunit.client.0.smithi134.stdout:9/695: mkdir db/d20/d22/d64/d69/d89/de2/df3 0 2024-02-16T22:18:57.681 INFO:tasks.workunit.client.0.smithi134.stdout:7/653: rename d2/d6/d7d/d92/da5/d63/f60 to d2/d6/d7d/d92/da5/d63/fd9 0 2024-02-16T22:18:57.681 INFO:tasks.workunit.client.0.smithi134.stdout:7/654: chown d2/d5/d19/d4a/d9d 3396 1 2024-02-16T22:18:57.681 INFO:tasks.workunit.client.0.smithi134.stdout:7/655: write d2/d5/d22/d83/f9c [2382119,69150] 0 2024-02-16T22:18:57.681 INFO:tasks.workunit.client.0.smithi134.stdout:7/656: chown d2/d6/f41 710 1 2024-02-16T22:18:57.682 INFO:tasks.workunit.client.0.smithi134.stdout:0/651: symlink d2/d20/d77/ld6 0 2024-02-16T22:18:57.684 INFO:tasks.workunit.client.0.smithi134.stdout:5/693: link d2/d9/dc/d15/d2f/l7f d2/d9/dc/d98/le0 0 2024-02-16T22:18:57.685 INFO:tasks.workunit.client.0.smithi134.stdout:8/640: sync 2024-02-16T22:18:57.686 INFO:tasks.workunit.client.0.smithi134.stdout:5/694: dread d2/d9/dc/daf/fb8 [0,4194304] 0 2024-02-16T22:18:57.686 INFO:tasks.workunit.client.0.smithi134.stdout:5/695: getdents d2/d9/dc/d15/d2f/ddf 0 2024-02-16T22:18:57.686 INFO:tasks.workunit.client.0.smithi134.stdout:2/584: creat df/d10/d30/d4d/d94/da3/faf x:0 0 0 2024-02-16T22:18:57.686 INFO:tasks.workunit.client.0.smithi134.stdout:9/696: mknod db/de0/cf4 0 2024-02-16T22:18:57.688 INFO:tasks.workunit.client.0.smithi134.stdout:3/609: rename da/d1c/d24/d29/d40 to da/d1c/d24/d9a/dc0 0 2024-02-16T22:18:57.692 INFO:tasks.workunit.client.0.smithi134.stdout:0/652: creat d2/dc/d2d/d34/d87/fd7 x:0 0 0 2024-02-16T22:18:57.693 INFO:tasks.workunit.client.0.smithi134.stdout:8/641: creat d2/df/d18/d2a/d41/d59/db1/d87/fd5 x:0 0 0 2024-02-16T22:18:57.695 INFO:tasks.workunit.client.0.smithi134.stdout:2/585: unlink f2 0 2024-02-16T22:18:57.697 INFO:tasks.workunit.client.0.smithi134.stdout:9/697: mkdir db/d20/d32/dd8/df5 0 2024-02-16T22:18:57.697 INFO:tasks.workunit.client.0.smithi134.stdout:9/698: creat db/d20/d22/d64/dc2/ff6 x:0 0 0 2024-02-16T22:18:57.697 INFO:tasks.workunit.client.0.smithi134.stdout:1/656: sync 2024-02-16T22:18:57.699 INFO:tasks.workunit.client.0.smithi134.stdout:6/676: rename d17/d27/d4f/d52/f85 to d17/d36/d77/d9a/d28/d5b/d88/dd8/fda 0 2024-02-16T22:18:57.699 INFO:tasks.workunit.client.0.smithi134.stdout:6/677: truncate d17/d36/d77/d9a/d28/d5b/d88/d90/fb1 646412 0 2024-02-16T22:18:57.699 INFO:tasks.workunit.client.0.smithi134.stdout:0/653: symlink d2/dc/d32/d3e/dc1/ld8 0 2024-02-16T22:18:57.701 INFO:tasks.workunit.client.0.smithi134.stdout:5/696: mknod d2/d9/dc/d32/ce1 0 2024-02-16T22:18:57.701 INFO:tasks.workunit.client.0.smithi134.stdout:5/697: chown d2/d9/dc/c57 100772068 1 2024-02-16T22:18:57.701 INFO:tasks.workunit.client.0.smithi134.stdout:4/534: sync 2024-02-16T22:18:57.701 INFO:tasks.workunit.client.0.smithi134.stdout:4/535: write d0/d6/d16/f28 [2148410,25957] 0 2024-02-16T22:18:57.701 INFO:tasks.workunit.client.0.smithi134.stdout:4/536: write d0/d6/d8/d32/d63/d6c/f83 [3179848,32975] 0 2024-02-16T22:18:57.701 INFO:tasks.workunit.client.0.smithi134.stdout:4/537: getdents d0/d6/d8/d5e 0 2024-02-16T22:18:57.703 INFO:tasks.workunit.client.0.smithi134.stdout:3/610: getdents da/d12 0 2024-02-16T22:18:57.704 INFO:tasks.workunit.client.0.smithi134.stdout:1/657: symlink d5/da/db8/lde 0 2024-02-16T22:18:57.706 INFO:tasks.workunit.client.0.smithi134.stdout:7/657: rename d2/d6/d7d/d92/dcd/d7f/d24/c94 to d2/d6/d7d/d92/da5/d63/cda 0 2024-02-16T22:18:57.706 INFO:tasks.workunit.client.0.smithi134.stdout:6/678: truncate d17/d36/d77/d9a/d28/f96 416773 0 2024-02-16T22:18:57.707 INFO:tasks.workunit.client.0.smithi134.stdout:0/654: mkdir d2/d20/d77/dbd/dd9 0 2024-02-16T22:18:57.707 INFO:tasks.workunit.client.0.smithi134.stdout:0/655: readlink d2/dc/d32/d3e/d5e/la5 0 2024-02-16T22:18:57.707 INFO:tasks.workunit.client.0.smithi134.stdout:5/698: stat d2/d35/d36/d3d/c62 0 2024-02-16T22:18:57.710 INFO:tasks.workunit.client.0.smithi134.stdout:3/611: unlink da/d1c/d24/d29/l4d 0 2024-02-16T22:18:57.711 INFO:tasks.workunit.client.0.smithi134.stdout:1/658: creat d5/da/d2d/fdf x:0 0 0 2024-02-16T22:18:57.713 INFO:tasks.workunit.client.0.smithi134.stdout:8/642: rename d2/df/d18/d27/lbb to d2/df/d18/d2a/ld6 0 2024-02-16T22:18:57.713 INFO:tasks.workunit.client.0.smithi134.stdout:8/643: chown d2/l4b 1149388733 1 2024-02-16T22:18:57.713 INFO:tasks.workunit.client.0.smithi134.stdout:8/644: chown d2/df/d18/d2a/d41/d59/da0/d86/c9b 523726294 1 2024-02-16T22:18:57.714 INFO:tasks.workunit.client.0.smithi134.stdout:7/658: mknod d2/d5/d22/cdb 0 2024-02-16T22:18:57.714 INFO:tasks.workunit.client.0.smithi134.stdout:7/659: truncate d2/d6/d7d/d92/dcd/fa2 107351 0 2024-02-16T22:18:57.715 INFO:tasks.workunit.client.0.smithi134.stdout:6/679: mkdir d17/d27/d93/d9c/ddb 0 2024-02-16T22:18:57.717 INFO:tasks.workunit.client.0.smithi134.stdout:5/699: creat d2/d35/d36/d3d/fe2 x:0 0 0 2024-02-16T22:18:57.718 INFO:tasks.workunit.client.0.smithi134.stdout:9/699: rmdir db/d20/d22/d64/db0 0 2024-02-16T22:18:57.720 INFO:tasks.workunit.client.0.smithi134.stdout:3/612: unlink da/d12/f42 0 2024-02-16T22:18:57.720 INFO:tasks.workunit.client.0.smithi134.stdout:3/613: chown da/d1c/d24/d9a/dc0/d8a/d8f/d9f/la5 0 1 2024-02-16T22:18:57.722 INFO:tasks.workunit.client.0.smithi134.stdout:2/586: rename df/d10/d15/d5a/d34/c40 to df/d41/cb0 0 2024-02-16T22:18:57.723 INFO:tasks.workunit.client.0.smithi134.stdout:8/645: creat d2/df/d18/db5/fd7 x:0 0 0 2024-02-16T22:18:57.723 INFO:tasks.workunit.client.0.smithi134.stdout:7/660: truncate d2/d6/f70 2827268 0 2024-02-16T22:18:57.725 INFO:tasks.workunit.client.0.smithi134.stdout:6/680: mkdir d17/d27/d4f/dcb/ddc 0 2024-02-16T22:18:57.725 INFO:tasks.workunit.client.0.smithi134.stdout:6/681: truncate d17/d27/d30/f33 1464440 0 2024-02-16T22:18:57.726 INFO:tasks.workunit.client.0.smithi134.stdout:0/656: symlink d2/dc/lda 0 2024-02-16T22:18:57.726 INFO:tasks.workunit.client.0.smithi134.stdout:0/657: chown d2/dc/d2d/d34/f61 7368 1 2024-02-16T22:18:57.726 INFO:tasks.workunit.client.0.smithi134.stdout:0/658: getdents d2/d20/d77/d85/db6/dd5 0 2024-02-16T22:18:57.727 INFO:tasks.workunit.client.0.smithi134.stdout:5/700: creat d2/d35/d36/d3d/d9c/fe3 x:0 0 0 2024-02-16T22:18:57.728 INFO:tasks.workunit.client.0.smithi134.stdout:1/659: dwrite d5/da/d21/d52/d9b/fa1 [0,4194304] 0 2024-02-16T22:18:57.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:57 smithi173 ceph-mon[37280]: pgmap v251: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 126 MiB/s rd, 168 MiB/s wr, 442 op/s 2024-02-16T22:18:57.731 INFO:tasks.workunit.client.0.smithi134.stdout:2/587: stat df/d10/d30/ca0 0 2024-02-16T22:18:57.732 INFO:tasks.workunit.client.0.smithi134.stdout:6/682: getdents d17/d36 0 2024-02-16T22:18:57.733 INFO:tasks.workunit.client.0.smithi134.stdout:6/683: write d17/d27/d4f/d52/d79/f75 [1835584,61320] 0 2024-02-16T22:18:57.733 INFO:tasks.workunit.client.0.smithi134.stdout:6/684: creat d17/d27/d4f/d52/d79/d8b/fdd x:0 0 0 2024-02-16T22:18:57.734 INFO:tasks.workunit.client.0.smithi134.stdout:7/661: dread d2/d6/d7d/d92/da5/d63/fd9 [0,4194304] 0 2024-02-16T22:18:57.734 INFO:tasks.workunit.client.0.smithi134.stdout:7/662: write d2/d6/d7d/d92/dcd/fb6 [146310,107311] 0 2024-02-16T22:18:57.735 INFO:tasks.workunit.client.0.smithi134.stdout:7/663: dread d2/d6/d7d/d92/dcd/fa2 [0,4194304] 0 2024-02-16T22:18:57.735 INFO:tasks.workunit.client.0.smithi134.stdout:0/659: creat d2/db7/fdb x:0 0 0 2024-02-16T22:18:57.735 INFO:tasks.workunit.client.0.smithi134.stdout:0/660: chown d2/d20/d77/db9/fd3 1727138 1 2024-02-16T22:18:57.736 INFO:tasks.workunit.client.0.smithi134.stdout:5/701: link d2/d9/dc/d15/f31 d2/d35/d36/d46/d68/d74/fe4 0 2024-02-16T22:18:57.739 INFO:tasks.workunit.client.0.smithi134.stdout:1/660: unlink d5/da/d21/d52/cd4 0 2024-02-16T22:18:57.742 INFO:tasks.workunit.client.0.smithi134.stdout:9/700: getdents db 0 2024-02-16T22:18:57.742 INFO:tasks.workunit.client.0.smithi134.stdout:9/701: chown db/d20/d22/d51/d9b 9191 1 2024-02-16T22:18:57.742 INFO:tasks.workunit.client.0.smithi134.stdout:9/702: chown db/d20/d22/d51/fc9 7 1 2024-02-16T22:18:57.742 INFO:tasks.workunit.client.0.smithi134.stdout:3/614: dwrite da/d12/d2a/f7c [0,4194304] 0 2024-02-16T22:18:57.745 INFO:tasks.workunit.client.0.smithi134.stdout:2/588: write df/d10/d15/f16 [1940786,3740] 0 2024-02-16T22:18:57.748 INFO:tasks.workunit.client.0.smithi134.stdout:8/646: dwrite d2/df/d18/f45 [0,4194304] 0 2024-02-16T22:18:57.753 INFO:tasks.workunit.client.0.smithi134.stdout:5/702: creat d2/d35/d36/da9/fe5 x:0 0 0 2024-02-16T22:18:57.756 INFO:tasks.workunit.client.0.smithi134.stdout:3/615: write da/d1c/f5d [67340,101136] 0 2024-02-16T22:18:57.756 INFO:tasks.workunit.client.0.smithi134.stdout:3/616: fsync da/d12/d2a/f3c 0 2024-02-16T22:18:57.758 INFO:tasks.workunit.client.0.smithi134.stdout:4/538: rename d0/d6/d16 to d0/d31/db8 0 2024-02-16T22:18:57.758 INFO:tasks.workunit.client.0.smithi134.stdout:4/539: truncate d0/d6/d22/d25/f90 516910 0 2024-02-16T22:18:57.758 INFO:tasks.workunit.client.0.smithi134.stdout:4/540: write d0/d6/d1e/d3b/fac [207420,77462] 0 2024-02-16T22:18:57.758 INFO:tasks.workunit.client.0.smithi134.stdout:4/541: write d0/d31/db8/d1a/fb5 [132429,92259] 0 2024-02-16T22:18:57.761 INFO:tasks.workunit.client.0.smithi134.stdout:7/664: dwrite d2/d5/d22/f66 [4194304,4194304] 0 2024-02-16T22:18:57.762 INFO:tasks.workunit.client.0.smithi134.stdout:0/661: mkdir d2/dc/dc4/ddc 0 2024-02-16T22:18:57.763 INFO:tasks.workunit.client.0.smithi134.stdout:3/617: mkdir da/d6b/dc1 0 2024-02-16T22:18:57.765 INFO:tasks.workunit.client.0.smithi134.stdout:6/685: rename d17/d36/c38 to d17/d27/d30/dd3/cde 0 2024-02-16T22:18:57.766 INFO:tasks.workunit.client.0.smithi134.stdout:6/686: chown d17/d36/d77/d9a/c2f 16 1 2024-02-16T22:18:57.767 INFO:tasks.workunit.client.0.smithi134.stdout:2/589: rename df/d10/d15/d5a/c55 to df/d10/d3a/cb1 0 2024-02-16T22:18:57.769 INFO:tasks.workunit.client.0.smithi134.stdout:4/542: rename d0/f15 to d0/d6/d8/d32/d68/fb9 0 2024-02-16T22:18:57.771 INFO:tasks.workunit.client.0.smithi134.stdout:4/543: dread d0/d6/d8/d30/f7e [0,4194304] 0 2024-02-16T22:18:57.774 INFO:tasks.workunit.client.0.smithi134.stdout:1/661: dwrite d5/d1a/d23/d3c/d6a/fbb [0,4194304] 0 2024-02-16T22:18:57.777 INFO:tasks.workunit.client.0.smithi134.stdout:4/544: symlink d0/d6/d8/da2/d76/lba 0 2024-02-16T22:18:57.777 INFO:tasks.workunit.client.0.smithi134.stdout:3/618: write da/d1c/d24/d9a/dc0/d8a/d8f/f44 [4787617,38742] 0 2024-02-16T22:18:57.777 INFO:tasks.workunit.client.0.smithi134.stdout:3/619: chown da/d12/f9c 405454 1 2024-02-16T22:18:57.780 INFO:tasks.workunit.client.0.smithi134.stdout:1/662: rmdir d5/da/d21/d52/d9b 39 2024-02-16T22:18:57.781 INFO:tasks.workunit.client.0.smithi134.stdout:1/663: readlink d5/da/l33 0 2024-02-16T22:18:57.781 INFO:tasks.workunit.client.0.smithi134.stdout:4/545: getdents d0/d6/d22/d97 0 2024-02-16T22:18:57.783 INFO:tasks.workunit.client.0.smithi134.stdout:8/647: dwrite d2/df/d18/d91/fb7 [0,4194304] 0 2024-02-16T22:18:57.783 INFO:tasks.workunit.client.0.smithi134.stdout:2/590: dread df/d10/d15/d5a/f26 [4194304,4194304] 0 2024-02-16T22:18:57.783 INFO:tasks.workunit.client.0.smithi134.stdout:8/648: stat d2/df/d18/d2a/c68 0 2024-02-16T22:18:57.783 INFO:tasks.workunit.client.0.smithi134.stdout:8/649: chown d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/d7d/cc6 6286030 1 2024-02-16T22:18:57.783 INFO:tasks.workunit.client.0.smithi134.stdout:3/620: stat da/d1c/d24/d9a/dc0/l60 0 2024-02-16T22:18:57.783 INFO:tasks.workunit.client.0.smithi134.stdout:3/621: chown da/d12/d2a/f7c 18 1 2024-02-16T22:18:57.785 INFO:tasks.workunit.client.0.smithi134.stdout:4/546: link d0/d31/f87 d0/d31/db8/d46/fbb 0 2024-02-16T22:18:57.785 INFO:tasks.workunit.client.0.smithi134.stdout:4/547: stat d0/d6/d22/d40 0 2024-02-16T22:18:57.785 INFO:tasks.workunit.client.0.smithi134.stdout:2/591: mknod df/d10/d3a/da9/dae/cb2 0 2024-02-16T22:18:57.786 INFO:tasks.workunit.client.0.smithi134.stdout:3/622: rmdir da/d1c/d24/d9a/dc0/d8a/d8f/d6d 39 2024-02-16T22:18:57.786 INFO:tasks.workunit.client.0.smithi134.stdout:3/623: chown da/d1c/d24/d29/d51/d80/c94 2662243 1 2024-02-16T22:18:57.787 INFO:tasks.workunit.client.0.smithi134.stdout:1/664: mkdir d5/da/d2d/de0 0 2024-02-16T22:18:57.787 INFO:tasks.workunit.client.0.smithi134.stdout:4/548: rmdir d0/d6/d8/d32/d63/d6c 39 2024-02-16T22:18:57.790 INFO:tasks.workunit.client.0.smithi134.stdout:6/687: dwrite d17/d63/f82 [0,4194304] 0 2024-02-16T22:18:57.790 INFO:tasks.workunit.client.0.smithi134.stdout:3/624: mkdir da/d1c/dc2 0 2024-02-16T22:18:57.790 INFO:tasks.workunit.client.0.smithi134.stdout:7/665: dwrite d2/d5/d19/f2f [4194304,4194304] 0 2024-02-16T22:18:57.792 INFO:tasks.workunit.client.0.smithi134.stdout:1/665: mknod d5/d1a/d23/d61/ce1 0 2024-02-16T22:18:57.794 INFO:tasks.workunit.client.0.smithi134.stdout:8/650: dread d2/f36 [0,4194304] 0 2024-02-16T22:18:57.797 INFO:tasks.workunit.client.0.smithi134.stdout:6/688: symlink d17/d36/dd0/ldf 0 2024-02-16T22:18:57.799 INFO:tasks.workunit.client.0.smithi134.stdout:3/625: truncate da/d1c/d24/d9a/dc0/d8a/f73 2010900 0 2024-02-16T22:18:57.800 INFO:tasks.workunit.client.0.smithi134.stdout:1/666: mknod d5/da/d21/d52/ce2 0 2024-02-16T22:18:57.801 INFO:tasks.workunit.client.0.smithi134.stdout:2/592: dwrite df/d10/d15/d90/f9f [0,4194304] 0 2024-02-16T22:18:57.802 INFO:tasks.workunit.client.0.smithi134.stdout:8/651: mknod d2/df/d18/db5/dce/cd8 0 2024-02-16T22:18:57.802 INFO:tasks.workunit.client.0.smithi134.stdout:8/652: creat d2/df/d18/d91/fd9 x:0 0 0 2024-02-16T22:18:57.803 INFO:tasks.workunit.client.0.smithi134.stdout:6/689: symlink d17/d36/d77/d9a/d28/d5b/le0 0 2024-02-16T22:18:57.804 INFO:tasks.workunit.client.0.smithi134.stdout:7/666: dread d2/d5/d19/f2b [0,4194304] 0 2024-02-16T22:18:57.804 INFO:tasks.workunit.client.0.smithi134.stdout:3/626: truncate da/d1c/d24/d9a/dc0/d8a/d8f/d6d/fa0 883308 0 2024-02-16T22:18:57.805 INFO:tasks.workunit.client.0.smithi134.stdout:4/549: dread d0/d31/db8/d86/f9f [0,4194304] 0 2024-02-16T22:18:57.805 INFO:tasks.workunit.client.0.smithi134.stdout:4/550: fdatasync d0/d31/db8/f28 0 2024-02-16T22:18:57.806 INFO:tasks.workunit.client.0.smithi134.stdout:4/551: write d0/d31/db8/d46/fbb [882593,59001] 0 2024-02-16T22:18:57.809 INFO:tasks.workunit.client.0.smithi134.stdout:8/653: symlink d2/df/d18/d91/lda 0 2024-02-16T22:18:57.810 INFO:tasks.workunit.client.0.smithi134.stdout:3/627: truncate da/d12/d2a/f7c 3325036 0 2024-02-16T22:18:57.811 INFO:tasks.workunit.client.0.smithi134.stdout:3/628: fdatasync da/d1c/d24/d29/d51/f87 0 2024-02-16T22:18:57.811 INFO:tasks.workunit.client.0.smithi134.stdout:4/552: dread d0/f4 [0,4194304] 0 2024-02-16T22:18:57.812 INFO:tasks.workunit.client.0.smithi134.stdout:4/553: truncate d0/d6/d8/d32/d68/f6e 875210 0 2024-02-16T22:18:57.813 INFO:tasks.workunit.client.0.smithi134.stdout:7/667: write d2/d5/d19/d84/d86/fd7 [264775,99508] 0 2024-02-16T22:18:57.813 INFO:tasks.workunit.client.0.smithi134.stdout:4/554: rmdir d0/d31/db8/d86 39 2024-02-16T22:18:57.813 INFO:tasks.workunit.client.0.smithi134.stdout:4/555: write d0/d6/d1e/d39/f45 [250462,81782] 0 2024-02-16T22:18:57.813 INFO:tasks.workunit.client.0.smithi134.stdout:4/556: chown d0/d6/d8/d32/d68/f6e 39470941 1 2024-02-16T22:18:57.817 INFO:tasks.workunit.client.0.smithi134.stdout:7/668: unlink d2/d5/d19/d84/d86/fa0 0 2024-02-16T22:18:57.822 INFO:tasks.workunit.client.0.smithi134.stdout:4/557: rename d0/d6/d22/d25/l99 to d0/d6/d22/d97/daf/lbc 0 2024-02-16T22:18:57.822 INFO:tasks.workunit.client.0.smithi134.stdout:4/558: chown d0/d6/d8/d30/f71 11 1 2024-02-16T22:18:57.824 INFO:tasks.workunit.client.0.smithi134.stdout:7/669: creat d2/d6/d7d/d92/dcd/d7f/fdc x:0 0 0 2024-02-16T22:18:57.824 INFO:tasks.workunit.client.0.smithi134.stdout:7/670: write d2/d6/f41 [1024990,13357] 0 2024-02-16T22:18:57.824 INFO:tasks.workunit.client.0.smithi134.stdout:7/671: fdatasync d2/d5/d19/f1d 0 2024-02-16T22:18:57.827 INFO:tasks.workunit.client.0.smithi134.stdout:7/672: readlink d2/d6/d17/d31/l13 0 2024-02-16T22:18:57.827 INFO:tasks.workunit.client.0.smithi134.stdout:7/673: truncate d2/d6/d17/d31/d28/fc7 1958 0 2024-02-16T22:18:57.828 INFO:tasks.workunit.client.0.smithi134.stdout:7/674: dread d2/d6/d7d/d92/dcd/d7f/d24/f5a [0,4194304] 0 2024-02-16T22:18:57.829 INFO:tasks.workunit.client.0.smithi134.stdout:7/675: write d2/d6/d7d/d92/dcd/f9f [984856,62285] 0 2024-02-16T22:18:57.841 INFO:tasks.workunit.client.0.smithi134.stdout:7/676: write d2/d5/d19/d84/d86/d93/dab/f3e [2734907,41405] 0 2024-02-16T22:18:57.843 INFO:tasks.workunit.client.0.smithi134.stdout:1/667: dwrite d5/d1a/d23/d3c/f41 [0,4194304] 0 2024-02-16T22:18:57.843 INFO:tasks.workunit.client.0.smithi134.stdout:1/668: stat d5/d1a/d23/d3c/d6a/c88 0 2024-02-16T22:18:57.843 INFO:tasks.workunit.client.0.smithi134.stdout:2/593: dwrite df/d10/d30/d4d/d94/da3/faf [0,4194304] 0 2024-02-16T22:18:57.843 INFO:tasks.workunit.client.0.smithi134.stdout:2/594: chown df/d10/f86 27033 1 2024-02-16T22:18:57.844 INFO:tasks.workunit.client.0.smithi134.stdout:6/690: dwrite d17/d27/d4f/f68 [0,4194304] 0 2024-02-16T22:18:57.844 INFO:tasks.workunit.client.0.smithi134.stdout:6/691: fdatasync d17/d36/d77/d9a/d83/dbc/fbd 0 2024-02-16T22:18:57.845 INFO:tasks.workunit.client.0.smithi134.stdout:8/654: dwrite d2/df/d18/d5a/fb8 [0,4194304] 0 2024-02-16T22:18:57.856 INFO:tasks.workunit.client.0.smithi134.stdout:3/629: dread da/d1c/d24/d9a/dc0/d8a/d8f/f44 [0,4194304] 0 2024-02-16T22:18:57.862 INFO:tasks.workunit.client.0.smithi134.stdout:3/630: rename da/d1c/d24/d29/d51/d80/d90 to da/dc3 0 2024-02-16T22:18:57.864 INFO:tasks.workunit.client.0.smithi134.stdout:7/677: dwrite d2/d6/d7d/d9e/fb2 [0,4194304] 0 2024-02-16T22:18:57.864 INFO:tasks.workunit.client.0.smithi134.stdout:7/678: stat d2/d5/d19/d4a 0 2024-02-16T22:18:57.866 INFO:tasks.workunit.client.0.smithi134.stdout:9/703: sync 2024-02-16T22:18:57.866 INFO:tasks.workunit.client.0.smithi134.stdout:9/704: fdatasync db/dc/f54 0 2024-02-16T22:18:57.867 INFO:tasks.workunit.client.0.smithi134.stdout:7/679: creat d2/fdd x:0 0 0 2024-02-16T22:18:57.870 INFO:tasks.workunit.client.0.smithi134.stdout:9/705: rename db/f43 to db/d20/d22/d46/ff7 0 2024-02-16T22:18:57.870 INFO:tasks.workunit.client.0.smithi134.stdout:9/706: creat db/d20/ff8 x:0 0 0 2024-02-16T22:18:57.871 INFO:tasks.workunit.client.0.smithi134.stdout:7/680: truncate d2/d6/d17/f82 1734316 0 2024-02-16T22:18:57.872 INFO:tasks.workunit.client.0.smithi134.stdout:5/703: sync 2024-02-16T22:18:57.872 INFO:tasks.workunit.client.0.smithi134.stdout:0/662: sync 2024-02-16T22:18:57.873 INFO:tasks.workunit.client.0.smithi134.stdout:7/681: symlink d2/d5/d4c/lde 0 2024-02-16T22:18:57.873 INFO:tasks.workunit.client.0.smithi134.stdout:0/663: chown d2/dc/ff 175 1 2024-02-16T22:18:57.874 INFO:tasks.workunit.client.0.smithi134.stdout:5/704: symlink d2/d35/d36/d3d/d9c/d4b/le6 0 2024-02-16T22:18:57.875 INFO:tasks.workunit.client.0.smithi134.stdout:7/682: symlink d2/d5/d19/d84/d86/d93/dab/d40/ldf 0 2024-02-16T22:18:57.875 INFO:tasks.workunit.client.0.smithi134.stdout:0/664: mkdir d2/dc/d32/d45/ddd 0 2024-02-16T22:18:57.875 INFO:tasks.workunit.client.0.smithi134.stdout:3/631: read da/d12/f7b [2451890,42336] 0 2024-02-16T22:18:57.876 INFO:tasks.workunit.client.0.smithi134.stdout:5/705: truncate d2/d35/f58 3002646 0 2024-02-16T22:18:57.876 INFO:tasks.workunit.client.0.smithi134.stdout:7/683: fdatasync d2/d5/f8b 0 2024-02-16T22:18:57.877 INFO:tasks.workunit.client.0.smithi134.stdout:0/665: symlink d2/d20/d77/dbd/dd9/lde 0 2024-02-16T22:18:57.878 INFO:tasks.workunit.client.0.smithi134.stdout:3/632: creat da/d1c/d24/d9a/dc0/d8a/fc4 x:0 0 0 2024-02-16T22:18:57.880 INFO:tasks.workunit.client.0.smithi134.stdout:5/706: creat d2/d9/dc/d32/d61/fe7 x:0 0 0 2024-02-16T22:18:57.880 INFO:tasks.workunit.client.0.smithi134.stdout:5/707: truncate d2/d9/dc/d15/f4d 950285 0 2024-02-16T22:18:57.888 INFO:tasks.workunit.client.0.smithi134.stdout:6/692: dwrite d17/d36/d77/d9a/f2e [0,4194304] 0 2024-02-16T22:18:57.888 INFO:tasks.workunit.client.0.smithi134.stdout:6/693: fdatasync d17/d36/f7a 0 2024-02-16T22:18:57.888 INFO:tasks.workunit.client.0.smithi134.stdout:6/694: dread - d17/d36/d77/d9a/d83/dbc/fce zero size 2024-02-16T22:18:57.891 INFO:tasks.workunit.client.0.smithi134.stdout:9/707: read db/f57 [5966167,108215] 0 2024-02-16T22:18:57.891 INFO:tasks.workunit.client.0.smithi134.stdout:2/595: dwrite df/d10/d30/d4d/d94/da3/f84 [0,4194304] 0 2024-02-16T22:18:57.891 INFO:tasks.workunit.client.0.smithi134.stdout:1/669: dwrite d5/d1a/d23/d3c/d6a/fb9 [0,4194304] 0 2024-02-16T22:18:57.891 INFO:tasks.workunit.client.0.smithi134.stdout:1/670: write d5/da/d21/d45/fad [567509,8572] 0 2024-02-16T22:18:57.902 INFO:tasks.workunit.client.0.smithi134.stdout:9/708: mknod db/d20/d9a/cf9 0 2024-02-16T22:18:57.902 INFO:tasks.workunit.client.0.smithi134.stdout:9/709: stat db/d20/c2c 0 2024-02-16T22:18:57.903 INFO:tasks.workunit.client.0.smithi134.stdout:9/710: dread db/dc/f61 [0,4194304] 0 2024-02-16T22:18:57.904 INFO:tasks.workunit.client.0.smithi134.stdout:1/671: unlink d5/d1a/d53/d86/ld7 0 2024-02-16T22:18:57.905 INFO:tasks.workunit.client.0.smithi134.stdout:9/711: symlink db/d20/d22/d46/lfa 0 2024-02-16T22:18:57.905 INFO:tasks.workunit.client.0.smithi134.stdout:9/712: chown db/f57 408 1 2024-02-16T22:18:57.908 INFO:tasks.workunit.client.0.smithi134.stdout:9/713: rename db/fb7 to db/d20/d22/d64/d69/d6e/d81/dc4/dec/ffb 0 2024-02-16T22:18:57.909 INFO:tasks.workunit.client.0.smithi134.stdout:2/596: dread df/d10/d15/d5a/f65 [0,4194304] 0 2024-02-16T22:18:57.909 INFO:tasks.workunit.client.0.smithi134.stdout:2/597: chown df/d10/d15/f3f 657 1 2024-02-16T22:18:57.909 INFO:tasks.workunit.client.0.smithi134.stdout:9/714: symlink db/d20/d55/d8c/lfc 0 2024-02-16T22:18:57.910 INFO:tasks.workunit.client.0.smithi134.stdout:9/715: creat db/d20/d22/d51/d9b/ffd x:0 0 0 2024-02-16T22:18:57.910 INFO:tasks.workunit.client.0.smithi134.stdout:2/598: truncate df/d10/d15/f3f 108125 0 2024-02-16T22:18:57.912 INFO:tasks.workunit.client.0.smithi134.stdout:9/716: mknod db/d20/d22/d46/d8f/cfe 0 2024-02-16T22:18:57.912 INFO:tasks.workunit.client.0.smithi134.stdout:9/717: fsync db/d20/d22/f58 0 2024-02-16T22:18:57.912 INFO:tasks.workunit.client.0.smithi134.stdout:9/718: write db/d20/d22/d51/f65 [1229882,127741] 0 2024-02-16T22:18:57.913 INFO:tasks.workunit.client.0.smithi134.stdout:2/599: symlink df/d10/d15/d5a/lb3 0 2024-02-16T22:18:57.914 INFO:tasks.workunit.client.0.smithi134.stdout:1/672: write d5/da/d21/d45/f77 [4051301,104893] 0 2024-02-16T22:18:57.914 INFO:tasks.workunit.client.0.smithi134.stdout:1/673: chown d5/d1a/d4d/d99 46657 1 2024-02-16T22:18:57.914 INFO:tasks.workunit.client.0.smithi134.stdout:9/719: creat db/d20/d22/d64/d69/d6e/d81/dc4/fff x:0 0 0 2024-02-16T22:18:57.916 INFO:tasks.workunit.client.0.smithi134.stdout:9/720: rename db/l9d to db/d20/d22/d64/d69/d6e/l100 0 2024-02-16T22:18:57.916 INFO:tasks.workunit.client.0.smithi134.stdout:9/721: chown db/c23 0 1 2024-02-16T22:18:57.916 INFO:tasks.workunit.client.0.smithi134.stdout:9/722: truncate db/f33 964813 0 2024-02-16T22:18:57.918 INFO:tasks.workunit.client.0.smithi134.stdout:9/723: symlink db/d20/d22/d46/dbe/l101 0 2024-02-16T22:18:57.919 INFO:tasks.workunit.client.0.smithi134.stdout:9/724: truncate db/d20/d22/d64/d69/f7e 2763384 0 2024-02-16T22:18:57.921 INFO:tasks.workunit.client.0.smithi134.stdout:3/633: dwrite da/f11 [4194304,4194304] 0 2024-02-16T22:18:57.922 INFO:tasks.workunit.client.0.smithi134.stdout:9/725: link db/d20/d22/d51/l5b db/d20/d22/d51/d9b/dbd/l102 0 2024-02-16T22:18:57.922 INFO:tasks.workunit.client.0.smithi134.stdout:9/726: readlink db/d20/d22/d46/l4f 0 2024-02-16T22:18:57.923 INFO:tasks.workunit.client.0.smithi134.stdout:3/634: rename da/d12/d2a/c64 to da/d1c/d24/d29/d51/cc5 0 2024-02-16T22:18:57.925 INFO:tasks.workunit.client.0.smithi134.stdout:9/727: symlink db/d20/d22/d64/dc2/l103 0 2024-02-16T22:18:57.925 INFO:tasks.workunit.client.0.smithi134.stdout:0/666: dwrite d2/dc/d48/f4c [0,4194304] 0 2024-02-16T22:18:57.926 INFO:tasks.workunit.client.0.smithi134.stdout:9/728: creat db/d20/d22/d64/d69/d6e/d81/dc4/dec/f104 x:0 0 0 2024-02-16T22:18:57.927 INFO:tasks.workunit.client.0.smithi134.stdout:8/655: dwrite d2/fbd [0,4194304] 0 2024-02-16T22:18:57.927 INFO:tasks.workunit.client.0.smithi134.stdout:5/708: dwrite d2/d9/f53 [0,4194304] 0 2024-02-16T22:18:57.927 INFO:tasks.workunit.client.0.smithi134.stdout:1/674: dread d5/f46 [0,4194304] 0 2024-02-16T22:18:57.928 INFO:tasks.workunit.client.0.smithi134.stdout:0/667: mkdir d2/dc/d97/ddf 0 2024-02-16T22:18:57.928 INFO:tasks.workunit.client.0.smithi134.stdout:6/695: dwrite d17/d36/f7a [0,4194304] 0 2024-02-16T22:18:57.932 INFO:tasks.workunit.client.0.smithi134.stdout:9/729: rmdir db/d20/d32/dd8/df5 0 2024-02-16T22:18:57.932 INFO:tasks.workunit.client.0.smithi134.stdout:9/730: fdatasync db/d20/d22/d46/ff7 0 2024-02-16T22:18:57.932 INFO:tasks.workunit.client.0.smithi134.stdout:9/731: write db/d20/d55/fd9 [414314,127740] 0 2024-02-16T22:18:57.933 INFO:tasks.workunit.client.0.smithi134.stdout:8/656: symlink d2/df/d18/d2a/d41/d59/ldb 0 2024-02-16T22:18:57.935 INFO:tasks.workunit.client.0.smithi134.stdout:1/675: mkdir d5/d1a/d23/d3c/d6a/de3 0 2024-02-16T22:18:57.940 INFO:tasks.workunit.client.0.smithi134.stdout:8/657: dread d2/df/d18/fc [0,4194304] 0 2024-02-16T22:18:57.946 INFO:tasks.workunit.client.0.smithi134.stdout:9/732: creat db/d20/d22/d64/d69/d89/de2/f105 x:0 0 0 2024-02-16T22:18:57.948 INFO:tasks.workunit.client.0.smithi134.stdout:1/676: creat d5/da/db8/fe4 x:0 0 0 2024-02-16T22:18:57.948 INFO:tasks.workunit.client.0.smithi134.stdout:1/677: chown d5/da/d21/d45/f4e 29859008 1 2024-02-16T22:18:57.949 INFO:tasks.workunit.client.0.smithi134.stdout:1/678: write d5/d1a/d63/f69 [1379462,105502] 0 2024-02-16T22:18:57.951 INFO:tasks.workunit.client.0.smithi134.stdout:1/679: mkdir d5/d1a/d23/d85/de5 0 2024-02-16T22:18:57.951 INFO:tasks.workunit.client.0.smithi134.stdout:1/680: stat d5/d1a/d23/d61/cc4 0 2024-02-16T22:18:57.951 INFO:tasks.workunit.client.0.smithi134.stdout:1/681: creat d5/d1a/d23/d3c/d6a/d5c/fe6 x:0 0 0 2024-02-16T22:18:57.953 INFO:tasks.workunit.client.0.smithi134.stdout:1/682: mknod d5/d1a/d23/d3c/ce7 0 2024-02-16T22:18:57.958 INFO:tasks.workunit.client.0.smithi134.stdout:9/733: write db/dc/f66 [3803916,791] 0 2024-02-16T22:18:57.964 INFO:tasks.workunit.client.0.smithi134.stdout:2/600: dwrite df/d10/d15/f16 [0,4194304] 0 2024-02-16T22:18:57.966 INFO:tasks.workunit.client.0.smithi134.stdout:9/734: dread db/d20/d22/d46/ff7 [4194304,4194304] 0 2024-02-16T22:18:57.967 INFO:tasks.workunit.client.0.smithi134.stdout:1/683: dread d5/da/d21/d45/d93/faf [0,4194304] 0 2024-02-16T22:18:57.968 INFO:tasks.workunit.client.0.smithi134.stdout:9/735: rename db/d20/d32/cc7 to db/d20/d22/d51/c106 0 2024-02-16T22:18:57.968 INFO:tasks.workunit.client.0.smithi134.stdout:9/736: chown db/d20/f28 37696 1 2024-02-16T22:18:57.969 INFO:tasks.workunit.client.0.smithi134.stdout:3/635: dwrite da/d12/d2a/fbf [0,4194304] 0 2024-02-16T22:18:57.970 INFO:tasks.workunit.client.0.smithi134.stdout:0/668: dwrite d2/dc/f44 [0,4194304] 0 2024-02-16T22:18:57.970 INFO:tasks.workunit.client.0.smithi134.stdout:0/669: getdents d2/dc/d97/ddf 0 2024-02-16T22:18:57.970 INFO:tasks.workunit.client.0.smithi134.stdout:8/658: dwrite d2/f8b [0,4194304] 0 2024-02-16T22:18:57.971 INFO:tasks.workunit.client.0.smithi134.stdout:6/696: dwrite d17/d27/f34 [0,4194304] 0 2024-02-16T22:18:57.972 INFO:tasks.workunit.client.0.smithi134.stdout:2/601: dread df/d10/d3a/f71 [0,4194304] 0 2024-02-16T22:18:57.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:57 smithi134 ceph-mon[28869]: pgmap v251: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 126 MiB/s rd, 168 MiB/s wr, 442 op/s 2024-02-16T22:18:57.981 INFO:tasks.workunit.client.0.smithi134.stdout:1/684: write d5/d1a/d53/d86/f9d [2895085,82146] 0 2024-02-16T22:18:57.981 INFO:tasks.workunit.client.0.smithi134.stdout:1/685: chown d5/da/fb 1 1 2024-02-16T22:18:57.981 INFO:tasks.workunit.client.0.smithi134.stdout:1/686: fsync d5/d1a/d23/d3c/d6a/d5c/fa3 0 2024-02-16T22:18:57.982 INFO:tasks.workunit.client.0.smithi134.stdout:0/670: getdents d2/dc/d97 0 2024-02-16T22:18:57.982 INFO:tasks.workunit.client.0.smithi134.stdout:0/671: fsync d2/d4b/d53/fcb 0 2024-02-16T22:18:57.982 INFO:tasks.workunit.client.0.smithi134.stdout:9/737: write db/d20/d22/d64/d69/d6e/fb8 [2519733,18354] 0 2024-02-16T22:18:57.982 INFO:tasks.workunit.client.0.smithi134.stdout:0/672: write d2/dc/f1d [1914272,116192] 0 2024-02-16T22:18:57.983 INFO:tasks.workunit.client.0.smithi134.stdout:9/738: dread db/d20/d22/d46/f49 [0,4194304] 0 2024-02-16T22:18:57.984 INFO:tasks.workunit.client.0.smithi134.stdout:8/659: rename d2/df/d18/c78 to d2/df/d18/d2a/d41/d59/cdc 0 2024-02-16T22:18:57.988 INFO:tasks.workunit.client.0.smithi134.stdout:2/602: symlink df/d10/d3a/da9/lb4 0 2024-02-16T22:18:57.988 INFO:tasks.workunit.client.0.smithi134.stdout:2/603: fsync df/d10/d15/d5a/f48 0 2024-02-16T22:18:57.990 INFO:tasks.workunit.client.0.smithi134.stdout:1/687: link d5/d1a/d23/f2b d5/d1a/d23/d3c/d6a/d5c/fe8 0 2024-02-16T22:18:57.991 INFO:tasks.workunit.client.0.smithi134.stdout:0/673: getdents d2/dc/d32/d3e/da7 0 2024-02-16T22:18:57.993 INFO:tasks.workunit.client.0.smithi134.stdout:9/739: mkdir db/d20/d55/d107 0 2024-02-16T22:18:57.993 INFO:tasks.workunit.client.0.smithi134.stdout:9/740: write db/d20/d22/d51/f65 [2152078,62840] 0 2024-02-16T22:18:57.993 INFO:tasks.workunit.client.0.smithi134.stdout:9/741: truncate f8 1892265 0 2024-02-16T22:18:57.993 INFO:tasks.workunit.client.0.smithi134.stdout:9/742: chown db/d20/d22/d51/f74 1 1 2024-02-16T22:18:57.993 INFO:tasks.workunit.client.0.smithi134.stdout:9/743: write db/d20/d22/d46/dbe/ff1 [747684,112661] 0 2024-02-16T22:18:57.994 INFO:tasks.workunit.client.0.smithi134.stdout:6/697: rename d17/d27/d30/d32/c3f to d17/d27/d4f/ce1 0 2024-02-16T22:18:57.996 INFO:tasks.workunit.client.0.smithi134.stdout:8/660: mkdir d2/df/d18/d2a/d41/d59/da0/d40/d53/daa/ddd 0 2024-02-16T22:18:57.997 INFO:tasks.workunit.client.0.smithi134.stdout:1/688: truncate d5/da/d21/d45/f7b 1377718 0 2024-02-16T22:18:57.997 INFO:tasks.workunit.client.0.smithi134.stdout:3/636: dwrite da/f11 [4194304,4194304] 0 2024-02-16T22:18:57.997 INFO:tasks.workunit.client.0.smithi134.stdout:2/604: dread df/d10/d15/d5a/f26 [4194304,4194304] 0 2024-02-16T22:18:57.997 INFO:tasks.workunit.client.0.smithi134.stdout:0/674: write d2/dc/f2b [4891138,117963] 0 2024-02-16T22:18:57.999 INFO:tasks.workunit.client.0.smithi134.stdout:9/744: mkdir db/d20/d22/d64/dc2/dcb/d108 0 2024-02-16T22:18:57.999 INFO:tasks.workunit.client.0.smithi134.stdout:9/745: fdatasync db/d20/d9a/fac 0 2024-02-16T22:18:58.000 INFO:tasks.workunit.client.0.smithi134.stdout:6/698: mkdir d17/d36/d77/d9a/d83/de2 0 2024-02-16T22:18:58.000 INFO:tasks.workunit.client.0.smithi134.stdout:6/699: write d17/d27/d4f/f67 [4949405,43619] 0 2024-02-16T22:18:58.000 INFO:tasks.workunit.client.0.smithi134.stdout:6/700: truncate d17/d27/d4f/d52/d79/d8b/fdd 114148 0 2024-02-16T22:18:58.002 INFO:tasks.workunit.client.0.smithi134.stdout:8/661: rename d2/df/d18/d27/d85/lba to d2/df/d18/db5/dbc/lde 0 2024-02-16T22:18:58.002 INFO:tasks.workunit.client.0.smithi134.stdout:8/662: write d2/df/d18/d91/fae [900752,52784] 0 2024-02-16T22:18:58.005 INFO:tasks.workunit.client.0.smithi134.stdout:6/701: dread d17/d27/d30/f33 [0,4194304] 0 2024-02-16T22:18:58.005 INFO:tasks.workunit.client.0.smithi134.stdout:6/702: stat d17/d63 0 2024-02-16T22:18:58.005 INFO:tasks.workunit.client.0.smithi134.stdout:6/703: creat d17/d36/d77/d9a/d28/d5b/fe3 x:0 0 0 2024-02-16T22:18:58.005 INFO:tasks.workunit.client.0.smithi134.stdout:6/704: rename d17/d27/d30 to d17/d27/d30/d32/de4 22 2024-02-16T22:18:58.008 INFO:tasks.workunit.client.0.smithi134.stdout:2/605: mknod df/d10/cb5 0 2024-02-16T22:18:58.009 INFO:tasks.workunit.client.0.smithi134.stdout:2/606: readlink df/d10/d15/d5a/lb3 0 2024-02-16T22:18:58.011 INFO:tasks.workunit.client.0.smithi134.stdout:0/675: truncate d2/dc/d2d/f54 8147568 0 2024-02-16T22:18:58.012 INFO:tasks.workunit.client.0.smithi134.stdout:9/746: symlink db/d20/d22/d51/d9b/l109 0 2024-02-16T22:18:58.016 INFO:tasks.workunit.client.0.smithi134.stdout:6/705: symlink d17/d36/d77/d9a/d83/le5 0 2024-02-16T22:18:58.016 INFO:tasks.workunit.client.0.smithi134.stdout:6/706: fsync d17/d27/fa9 0 2024-02-16T22:18:58.016 INFO:tasks.workunit.client.0.smithi134.stdout:1/689: dwrite f3 [0,4194304] 0 2024-02-16T22:18:58.018 INFO:tasks.workunit.client.0.smithi134.stdout:2/607: mknod df/d41/d97/cb6 0 2024-02-16T22:18:58.018 INFO:tasks.workunit.client.0.smithi134.stdout:2/608: chown df/d10/d30/d4d/d94/da3/f61 293531966 1 2024-02-16T22:18:58.018 INFO:tasks.workunit.client.0.smithi134.stdout:3/637: dwrite da/d12/d2a/f7c [0,4194304] 0 2024-02-16T22:18:58.018 INFO:tasks.workunit.client.0.smithi134.stdout:1/690: dread d5/da/fa2 [0,4194304] 0 2024-02-16T22:18:58.018 INFO:tasks.workunit.client.0.smithi134.stdout:0/676: symlink d2/d4b/d53/le0 0 2024-02-16T22:18:58.019 INFO:tasks.workunit.client.0.smithi134.stdout:9/747: mkdir db/d20/d32/dd8/d10a 0 2024-02-16T22:18:58.019 INFO:tasks.workunit.client.0.smithi134.stdout:9/748: dread - db/d20/d22/d91/d99/faa zero size 2024-02-16T22:18:58.019 INFO:tasks.workunit.client.0.smithi134.stdout:9/749: stat db/d20/d22/f58 0 2024-02-16T22:18:58.020 INFO:tasks.workunit.client.0.smithi134.stdout:8/663: rmdir d2/df/d18/d2a/d41/d59/db1/d87 39 2024-02-16T22:18:58.023 INFO:tasks.workunit.client.0.smithi134.stdout:6/707: mkdir d17/d27/d4f/d52/d79/d92/de6 0 2024-02-16T22:18:58.023 INFO:tasks.workunit.client.0.smithi134.stdout:6/708: fsync d17/f76 0 2024-02-16T22:18:58.023 INFO:tasks.workunit.client.0.smithi134.stdout:6/709: fsync d17/d36/f6f 0 2024-02-16T22:18:58.027 INFO:tasks.workunit.client.0.smithi134.stdout:3/638: dread da/d1c/d24/d29/f45 [0,4194304] 0 2024-02-16T22:18:58.027 INFO:tasks.workunit.client.0.smithi134.stdout:3/639: readlink da/d1c/d24/d9a/dc0/d8a/d8f/l71 0 2024-02-16T22:18:58.090 INFO:tasks.workunit.client.0.smithi134.stdout:0/677: mknod d2/dc/d32/d3e/ce1 0 2024-02-16T22:18:58.093 INFO:tasks.workunit.client.0.smithi134.stdout:9/750: mknod db/d20/d22/d64/d69/d6e/d81/dc4/c10b 0 2024-02-16T22:18:58.094 INFO:tasks.workunit.client.0.smithi134.stdout:1/691: dread d5/d1a/f62 [0,4194304] 0 2024-02-16T22:18:58.094 INFO:tasks.workunit.client.0.smithi134.stdout:2/609: rename df/d10/d30/c75 to df/d10/d30/d49/d82/d1b/cb7 0 2024-02-16T22:18:58.095 INFO:tasks.workunit.client.0.smithi134.stdout:0/678: mkdir d2/d20/d77/d85/de2 0 2024-02-16T22:18:58.095 INFO:tasks.workunit.client.0.smithi134.stdout:0/679: chown d2/d4b/lb5 594 1 2024-02-16T22:18:58.097 INFO:tasks.workunit.client.0.smithi134.stdout:9/751: mkdir db/d20/d22/d64/dc2/dcb/d108/d10c 0 2024-02-16T22:18:58.097 INFO:tasks.workunit.client.0.smithi134.stdout:9/752: chown db/de0/def/ff2 10 1 2024-02-16T22:18:58.097 INFO:tasks.workunit.client.0.smithi134.stdout:7/684: sync 2024-02-16T22:18:58.097 INFO:tasks.workunit.client.0.smithi134.stdout:5/709: sync 2024-02-16T22:18:58.097 INFO:tasks.workunit.client.0.smithi134.stdout:9/753: rename db/d20/d22/d64 to db/d20/d22/d64/d69/d6e/d81/d10d 22 2024-02-16T22:18:58.097 INFO:tasks.workunit.client.0.smithi134.stdout:7/685: fdatasync d2/f8d 0 2024-02-16T22:18:58.097 INFO:tasks.workunit.client.0.smithi134.stdout:4/559: sync 2024-02-16T22:18:58.099 INFO:tasks.workunit.client.0.smithi134.stdout:6/710: write d17/d36/f6f [2611826,4660] 0 2024-02-16T22:18:58.099 INFO:tasks.workunit.client.0.smithi134.stdout:6/711: fsync d17/d36/d77/d9a/d28/d5b/d88/dd8/fda 0 2024-02-16T22:18:58.101 INFO:tasks.workunit.client.0.smithi134.stdout:2/610: mknod df/d10/d30/d49/d85/d9b/cb8 0 2024-02-16T22:18:58.102 INFO:tasks.workunit.client.0.smithi134.stdout:9/754: mknod db/d20/d32/dd8/c10e 0 2024-02-16T22:18:58.103 INFO:tasks.workunit.client.0.smithi134.stdout:5/710: symlink d2/d35/d36/d3d/d9c/le8 0 2024-02-16T22:18:58.105 INFO:tasks.workunit.client.0.smithi134.stdout:7/686: mkdir d2/d6/d91/db3/de0 0 2024-02-16T22:18:58.107 INFO:tasks.workunit.client.0.smithi134.stdout:5/711: truncate d2/d35/d36/d3d/d9c/d4b/f7d 299937 0 2024-02-16T22:18:58.107 INFO:tasks.workunit.client.0.smithi134.stdout:5/712: dread - d2/d35/d36/d46/f6a zero size 2024-02-16T22:18:58.109 INFO:tasks.workunit.client.0.smithi134.stdout:5/713: creat d2/d9/dc/d98/fe9 x:0 0 0 2024-02-16T22:18:58.109 INFO:tasks.workunit.client.0.smithi134.stdout:5/714: truncate d2/d35/d36/da9/fe5 674246 0 2024-02-16T22:18:58.110 INFO:tasks.workunit.client.0.smithi134.stdout:5/715: write d2/d35/d36/d3d/d63/d90/fa6 [1156956,39698] 0 2024-02-16T22:18:58.110 INFO:tasks.workunit.client.0.smithi134.stdout:7/687: mkdir d2/d5/d19/d84/d86/d93/dab/de1 0 2024-02-16T22:18:58.110 INFO:tasks.workunit.client.0.smithi134.stdout:6/712: dread d17/d36/d77/d9a/f25 [0,4194304] 0 2024-02-16T22:18:58.111 INFO:tasks.workunit.client.0.smithi134.stdout:7/688: mknod d2/d5/d22/d83/ce2 0 2024-02-16T22:18:58.112 INFO:tasks.workunit.client.0.smithi134.stdout:6/713: mkdir d17/d27/d93/d9c/de7 0 2024-02-16T22:18:58.112 INFO:tasks.workunit.client.0.smithi134.stdout:7/689: dread d2/d6/d7d/d9e/fb0 [0,4194304] 0 2024-02-16T22:18:58.113 INFO:tasks.workunit.client.0.smithi134.stdout:5/716: link d2/d35/d36/d46/d68/l88 d2/d9/dc/lea 0 2024-02-16T22:18:58.114 INFO:tasks.workunit.client.0.smithi134.stdout:6/714: rename d17/d27/d30/dd3 to d17/d36/d77/d9a/d28/d5b/de8 0 2024-02-16T22:18:58.114 INFO:tasks.workunit.client.0.smithi134.stdout:6/715: chown d17/d36/d77/d9a/d28/d5b/d88/d90/da5/lc4 19 1 2024-02-16T22:18:58.115 INFO:tasks.workunit.client.0.smithi134.stdout:2/611: dread df/d10/f4b [0,4194304] 0 2024-02-16T22:18:58.115 INFO:tasks.workunit.client.0.smithi134.stdout:5/717: mknod d2/d9/dc/daf/ceb 0 2024-02-16T22:18:58.115 INFO:tasks.workunit.client.0.smithi134.stdout:5/718: read - d2/d9/dc/d15/d2f/fc1 zero size 2024-02-16T22:18:58.115 INFO:tasks.workunit.client.0.smithi134.stdout:5/719: fdatasync d2/d35/d36/d3d/d9c/f2c 0 2024-02-16T22:18:58.116 INFO:tasks.workunit.client.0.smithi134.stdout:6/716: link d17/d63/fb3 d17/d27/d4f/dcb/ddc/fe9 0 2024-02-16T22:18:58.116 INFO:tasks.workunit.client.0.smithi134.stdout:6/717: write f14 [692011,114239] 0 2024-02-16T22:18:58.118 INFO:tasks.workunit.client.0.smithi134.stdout:6/718: rename d17/d36/d77/d9a/d28/d5b/d88/cb2 to d17/d36/d77/d9a/d28/d5b/d88/cea 0 2024-02-16T22:18:58.120 INFO:tasks.workunit.client.0.smithi134.stdout:7/690: link d2/d5/d19/d84/d86/d93/dab/l52 d2/d6/le3 0 2024-02-16T22:18:58.121 INFO:tasks.workunit.client.0.smithi134.stdout:5/720: getdents d2/d9/dc/d15/d2f 0 2024-02-16T22:18:58.123 INFO:tasks.workunit.client.0.smithi134.stdout:6/719: mkdir d17/d27/d30/d32/deb 0 2024-02-16T22:18:58.124 INFO:tasks.workunit.client.0.smithi134.stdout:7/691: mknod d2/d6/d7d/d92/da5/d63/dc2/ce4 0 2024-02-16T22:18:58.124 INFO:tasks.workunit.client.0.smithi134.stdout:9/755: write db/d20/f9f [1404529,66817] 0 2024-02-16T22:18:58.126 INFO:tasks.workunit.client.0.smithi134.stdout:7/692: mknod d2/d6/d17/ce5 0 2024-02-16T22:18:58.128 INFO:tasks.workunit.client.0.smithi134.stdout:9/756: symlink db/d20/d22/d64/d69/d89/de2/df3/l10f 0 2024-02-16T22:18:58.128 INFO:tasks.workunit.client.0.smithi134.stdout:9/757: chown db/d20/d22/d64/d69/f98 1173357 1 2024-02-16T22:18:58.128 INFO:tasks.workunit.client.0.smithi134.stdout:3/640: dwrite da/d1c/d24/f4a [0,4194304] 0 2024-02-16T22:18:58.128 INFO:tasks.workunit.client.0.smithi134.stdout:1/692: dwrite d5/d1a/d23/d3c/d6a/d5c/d72/fda [0,4194304] 0 2024-02-16T22:18:58.128 INFO:tasks.workunit.client.0.smithi134.stdout:1/693: chown d5/d1a/d23/d3c/ce7 410486 1 2024-02-16T22:18:58.129 INFO:tasks.workunit.client.0.smithi134.stdout:0/680: dwrite d2/fc0 [0,4194304] 0 2024-02-16T22:18:58.132 INFO:tasks.workunit.client.0.smithi134.stdout:7/693: creat d2/d5/d19/d84/d86/d93/dab/d40/fe6 x:0 0 0 2024-02-16T22:18:58.133 INFO:tasks.workunit.client.0.smithi134.stdout:9/758: mkdir db/d20/d22/d64/d69/d6e/d110 0 2024-02-16T22:18:58.133 INFO:tasks.workunit.client.0.smithi134.stdout:9/759: dread - db/d20/d22/d64/d69/d89/f93 zero size 2024-02-16T22:18:58.134 INFO:tasks.workunit.client.0.smithi134.stdout:3/641: symlink da/d1c/d24/d9a/dc0/d8a/d8f/d6d/lc6 0 2024-02-16T22:18:58.134 INFO:tasks.workunit.client.0.smithi134.stdout:3/642: read - da/d1c/d24/d29/faf zero size 2024-02-16T22:18:58.134 INFO:tasks.workunit.client.0.smithi134.stdout:3/643: fsync da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/fa9 0 2024-02-16T22:18:58.134 INFO:tasks.workunit.client.0.smithi134.stdout:3/644: fsync da/d1c/d24/d29/f45 0 2024-02-16T22:18:58.135 INFO:tasks.workunit.client.0.smithi134.stdout:2/612: dwrite df/d10/d30/d49/f4f [0,4194304] 0 2024-02-16T22:18:58.143 INFO:tasks.workunit.client.0.smithi134.stdout:3/645: dread da/d1c/d24/d9a/dc0/d8a/f73 [0,4194304] 0 2024-02-16T22:18:58.143 INFO:tasks.workunit.client.0.smithi134.stdout:1/694: dread d5/da/f15 [0,4194304] 0 2024-02-16T22:18:58.147 INFO:tasks.workunit.client.0.smithi134.stdout:0/681: dwrite d2/f40 [0,4194304] 0 2024-02-16T22:18:58.147 INFO:tasks.workunit.client.0.smithi134.stdout:2/613: creat df/d10/d3a/fb9 x:0 0 0 2024-02-16T22:18:58.148 INFO:tasks.workunit.client.0.smithi134.stdout:3/646: mknod da/d1c/d24/d29/d51/d80/d89/cc7 0 2024-02-16T22:18:58.149 INFO:tasks.workunit.client.0.smithi134.stdout:7/694: rmdir d2/d6/d91/db3 39 2024-02-16T22:18:58.150 INFO:tasks.workunit.client.0.smithi134.stdout:9/760: rmdir db/d20/d22/d64/d69/d6e/d81/dc4 39 2024-02-16T22:18:58.153 INFO:tasks.workunit.client.0.smithi134.stdout:2/614: mknod df/d6f/cba 0 2024-02-16T22:18:58.155 INFO:tasks.workunit.client.0.smithi134.stdout:2/615: mknod df/d10/d30/da2/cbb 0 2024-02-16T22:18:58.156 INFO:tasks.workunit.client.0.smithi134.stdout:0/682: dread d2/dc/d32/d3e/f69 [0,4194304] 0 2024-02-16T22:18:58.158 INFO:tasks.workunit.client.0.smithi134.stdout:1/695: dwrite d5/da/d21/d52/f8b [4194304,4194304] 0 2024-02-16T22:18:58.158 INFO:tasks.workunit.client.0.smithi134.stdout:1/696: readlink d5/d1a/l22 0 2024-02-16T22:18:58.159 INFO:tasks.workunit.client.0.smithi134.stdout:0/683: symlink d2/dc/dc4/le3 0 2024-02-16T22:18:58.160 INFO:tasks.workunit.client.0.smithi134.stdout:1/697: truncate d5/d1a/d63/fa5 2504142 0 2024-02-16T22:18:58.161 INFO:tasks.workunit.client.0.smithi134.stdout:5/721: getdents d2/d9/dc/daf 0 2024-02-16T22:18:58.163 INFO:tasks.workunit.client.0.smithi134.stdout:5/722: symlink d2/d35/d36/d3d/lec 0 2024-02-16T22:18:58.164 INFO:tasks.workunit.client.0.smithi134.stdout:6/720: rename d17/d27/d4f to d17/d27/d93/d9c/dec 0 2024-02-16T22:18:58.165 INFO:tasks.workunit.client.0.smithi134.stdout:2/616: write df/d10/d15/d5a/f13 [1761587,59601] 0 2024-02-16T22:18:58.165 INFO:tasks.workunit.client.0.smithi134.stdout:2/617: fsync df/d10/d30/fac 0 2024-02-16T22:18:58.165 INFO:tasks.workunit.client.0.smithi134.stdout:6/721: write d17/d36/d77/d9a/d28/fc7 [943607,73255] 0 2024-02-16T22:18:58.169 INFO:tasks.workunit.client.0.smithi134.stdout:3/647: rename da/d1c/f32 to da/d1c/d24/d29/fc8 0 2024-02-16T22:18:58.169 INFO:tasks.workunit.client.0.smithi134.stdout:3/648: readlink da/d12/d2a/l35 0 2024-02-16T22:18:58.169 INFO:tasks.workunit.client.0.smithi134.stdout:3/649: readlink da/d1c/d24/d9a/dc0/d8a/d8f/l71 0 2024-02-16T22:18:58.171 INFO:tasks.workunit.client.0.smithi134.stdout:6/722: creat d17/d27/d93/d9c/dec/dcb/ddc/fed x:0 0 0 2024-02-16T22:18:58.171 INFO:tasks.workunit.client.0.smithi134.stdout:9/761: dwrite db/de0/def/ff2 [0,4194304] 0 2024-02-16T22:18:58.171 INFO:tasks.workunit.client.0.smithi134.stdout:6/723: write d17/d36/d77/d9a/d28/d5b/d88/d90/fb1 [1664985,94740] 0 2024-02-16T22:18:58.171 INFO:tasks.workunit.client.0.smithi134.stdout:6/724: chown d17/d36/d77/d9a/f54 186 1 2024-02-16T22:18:58.173 INFO:tasks.workunit.client.0.smithi134.stdout:2/618: rename df/d10/d30/l46 to df/d10/d15/d5a/lbc 0 2024-02-16T22:18:58.174 INFO:tasks.workunit.client.0.smithi134.stdout:0/684: write d2/f40 [2619327,61025] 0 2024-02-16T22:18:58.174 INFO:tasks.workunit.client.0.smithi134.stdout:0/685: write d2/dc/d32/f42 [1582715,116965] 0 2024-02-16T22:18:58.174 INFO:tasks.workunit.client.0.smithi134.stdout:0/686: stat d2/dc/d32/d3e/f47 0 2024-02-16T22:18:58.177 INFO:tasks.workunit.client.0.smithi134.stdout:9/762: unlink db/c9e 0 2024-02-16T22:18:58.177 INFO:tasks.workunit.client.0.smithi134.stdout:1/698: dread d5/d1a/f62 [0,4194304] 0 2024-02-16T22:18:58.177 INFO:tasks.workunit.client.0.smithi134.stdout:1/699: chown d5/f24 54 1 2024-02-16T22:18:58.180 INFO:tasks.workunit.client.0.smithi134.stdout:6/725: truncate d17/d27/d30/f8c 920566 0 2024-02-16T22:18:58.184 INFO:tasks.workunit.client.0.smithi134.stdout:0/687: creat d2/dc/d32/d3e/dc1/fe4 x:0 0 0 2024-02-16T22:18:58.185 INFO:tasks.workunit.client.0.smithi134.stdout:6/726: mknod d17/d36/dd0/daa/cee 0 2024-02-16T22:18:58.186 INFO:tasks.workunit.client.0.smithi134.stdout:0/688: creat d2/dc/d32/d3e/da7/dc2/fe5 x:0 0 0 2024-02-16T22:18:58.188 INFO:tasks.workunit.client.0.smithi134.stdout:5/723: dwrite d2/d9/dc/d32/f5a [4194304,4194304] 0 2024-02-16T22:18:58.190 INFO:tasks.workunit.client.0.smithi134.stdout:6/727: symlink d17/d36/d77/d9a/d28/d5b/d88/d90/lef 0 2024-02-16T22:18:58.193 INFO:tasks.workunit.client.0.smithi134.stdout:3/650: dwrite da/d1c/d24/d29/d51/f87 [0,4194304] 0 2024-02-16T22:18:58.195 INFO:tasks.workunit.client.0.smithi134.stdout:6/728: mknod d17/d36/d77/d9a/d28/d5b/d88/d90/cf0 0 2024-02-16T22:18:58.198 INFO:tasks.workunit.client.0.smithi134.stdout:5/724: rmdir d2/d35/d36/d3d/d63 39 2024-02-16T22:18:58.199 INFO:tasks.workunit.client.0.smithi134.stdout:6/729: creat d17/d36/d77/d9a/ff1 x:0 0 0 2024-02-16T22:18:58.200 INFO:tasks.workunit.client.0.smithi134.stdout:6/730: chown d17/d36/d77/d9a/d83/dbc/fce 15764802 1 2024-02-16T22:18:58.200 INFO:tasks.workunit.client.0.smithi134.stdout:6/731: fdatasync d17/d36/d77/d9a/f54 0 2024-02-16T22:18:58.200 INFO:tasks.workunit.client.0.smithi134.stdout:6/732: write d17/d36/d77/d9a/d83/dbc/fbd [4180061,99342] 0 2024-02-16T22:18:58.200 INFO:tasks.workunit.client.0.smithi134.stdout:5/725: creat d2/d35/d36/da1/fed x:0 0 0 2024-02-16T22:18:58.203 INFO:tasks.workunit.client.0.smithi134.stdout:5/726: creat d2/d35/d36/d3d/d9c/d4b/fee x:0 0 0 2024-02-16T22:18:58.203 INFO:tasks.workunit.client.0.smithi134.stdout:5/727: chown d2/d35/d36/d46/f6b 277781 1 2024-02-16T22:18:58.203 INFO:tasks.workunit.client.0.smithi134.stdout:5/728: chown d2/d35/d72 235952 1 2024-02-16T22:18:58.203 INFO:tasks.workunit.client.0.smithi134.stdout:5/729: truncate d2/d35/d36/d3d/d63/f70 669867 0 2024-02-16T22:18:58.203 INFO:tasks.workunit.client.0.smithi134.stdout:2/619: dwrite df/d10/f5d [0,4194304] 0 2024-02-16T22:18:58.203 INFO:tasks.workunit.client.0.smithi134.stdout:2/620: chown df/d10/l31 224662 1 2024-02-16T22:18:58.204 INFO:tasks.workunit.client.0.smithi134.stdout:5/730: mknod d2/d35/d72/cef 0 2024-02-16T22:18:58.208 INFO:tasks.workunit.client.0.smithi134.stdout:3/651: write da/d12/d2a/f7c [2230367,5964] 0 2024-02-16T22:18:58.208 INFO:tasks.workunit.client.0.smithi134.stdout:3/652: chown da/d1c/d24/d2c/d74/f81 437946 1 2024-02-16T22:18:58.208 INFO:tasks.workunit.client.0.smithi134.stdout:3/653: fsync da/d1c/d24/d29/f45 0 2024-02-16T22:18:58.209 INFO:tasks.workunit.client.0.smithi134.stdout:5/731: link d2/f6 d2/d9/dc/d98/ff0 0 2024-02-16T22:18:58.211 INFO:tasks.workunit.client.0.smithi134.stdout:3/654: creat da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/fc9 x:0 0 0 2024-02-16T22:18:58.215 INFO:tasks.workunit.client.0.smithi134.stdout:8/664: sync 2024-02-16T22:18:58.215 INFO:tasks.workunit.client.0.smithi134.stdout:8/665: getdents d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/d7d 0 2024-02-16T22:18:58.216 INFO:tasks.workunit.client.0.smithi134.stdout:3/655: dread da/d1c/d24/d9a/dc0/d8a/d8f/f44 [0,4194304] 0 2024-02-16T22:18:58.217 INFO:tasks.workunit.client.0.smithi134.stdout:0/689: dwrite d2/dc/d32/d45/fb8 [0,4194304] 0 2024-02-16T22:18:58.217 INFO:tasks.workunit.client.0.smithi134.stdout:8/666: truncate d2/fbd 1734568 0 2024-02-16T22:18:58.218 INFO:tasks.workunit.client.0.smithi134.stdout:2/621: dread df/d10/d30/d49/f54 [0,4194304] 0 2024-02-16T22:18:58.226 INFO:tasks.workunit.client.0.smithi134.stdout:5/732: write d2/d9/dc/fe [1115240,21879] 0 2024-02-16T22:18:58.226 INFO:tasks.workunit.client.0.smithi134.stdout:3/656: read da/d1c/d24/f4a [3927659,100188] 0 2024-02-16T22:18:58.228 INFO:tasks.workunit.client.0.smithi134.stdout:5/733: creat d2/d9/dc/d15/d2f/ddf/ff1 x:0 0 0 2024-02-16T22:18:58.228 INFO:tasks.workunit.client.0.smithi134.stdout:5/734: fsync d2/d9/dc/f26 0 2024-02-16T22:18:58.228 INFO:tasks.workunit.client.0.smithi134.stdout:3/657: symlink da/d6b/dc1/lca 0 2024-02-16T22:18:58.229 INFO:tasks.workunit.client.0.smithi134.stdout:3/658: truncate da/dc3/f99 149486 0 2024-02-16T22:18:58.229 INFO:tasks.workunit.client.0.smithi134.stdout:5/735: link d2/d35/d36/d46/d68/d74/cbd d2/d9/dc/d15/cf2 0 2024-02-16T22:18:58.229 INFO:tasks.workunit.client.0.smithi134.stdout:5/736: readlink d2/d9/l23 0 2024-02-16T22:18:58.229 INFO:tasks.workunit.client.0.smithi134.stdout:5/737: write d2/d9/dc/d15/f4d [1604863,124880] 0 2024-02-16T22:18:58.230 INFO:tasks.workunit.client.0.smithi134.stdout:2/622: write df/d10/d15/d5a/d34/f3e [3465255,36927] 0 2024-02-16T22:18:58.230 INFO:tasks.workunit.client.0.smithi134.stdout:2/623: chown df/f3c 25356995 1 2024-02-16T22:18:58.230 INFO:tasks.workunit.client.0.smithi134.stdout:2/624: write df/d41/f6a [628381,36066] 0 2024-02-16T22:18:58.230 INFO:tasks.workunit.client.0.smithi134.stdout:3/659: rename da/d1c/d24/d9a/dc0/l92 to da/d1c/d24/d29/lcb 0 2024-02-16T22:18:58.231 INFO:tasks.workunit.client.0.smithi134.stdout:3/660: chown da/d1c/d24/d29/d51/fb4 59034302 1 2024-02-16T22:18:58.231 INFO:tasks.workunit.client.0.smithi134.stdout:0/690: write d2/fc0 [4154148,19859] 0 2024-02-16T22:18:58.232 INFO:tasks.workunit.client.0.smithi134.stdout:9/763: dwrite db/d20/d55/fd9 [0,4194304] 0 2024-02-16T22:18:58.232 INFO:tasks.workunit.client.0.smithi134.stdout:9/764: write db/d20/d22/d51/fd7 [3130803,43264] 0 2024-02-16T22:18:58.233 INFO:tasks.workunit.client.0.smithi134.stdout:3/661: unlink da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/fa9 0 2024-02-16T22:18:58.233 INFO:tasks.workunit.client.0.smithi134.stdout:8/667: dread d2/df/d18/d2a/d41/d59/db1/d87/f7a [0,4194304] 0 2024-02-16T22:18:58.233 INFO:tasks.workunit.client.0.smithi134.stdout:6/733: dwrite d17/d36/d77/d9a/d28/d5b/d88/d90/fb1 [0,4194304] 0 2024-02-16T22:18:58.233 INFO:tasks.workunit.client.0.smithi134.stdout:6/734: chown d17/d27/d30/f8c 258 1 2024-02-16T22:18:58.233 INFO:tasks.workunit.client.0.smithi134.stdout:5/738: getdents d2/d9/dc/daf/dda 0 2024-02-16T22:18:58.235 INFO:tasks.workunit.client.0.smithi134.stdout:0/691: unlink d2/d20/d7a/d7e/fa4 0 2024-02-16T22:18:58.235 INFO:tasks.workunit.client.0.smithi134.stdout:0/692: chown d2/d4b/d53/f6e 0 1 2024-02-16T22:18:58.237 INFO:tasks.workunit.client.0.smithi134.stdout:9/765: rmdir db/d20/d22/d64/dc2/dcb/d108 39 2024-02-16T22:18:58.238 INFO:tasks.workunit.client.0.smithi134.stdout:9/766: stat db/d20/d22/d46/d8f 0 2024-02-16T22:18:58.238 INFO:tasks.workunit.client.0.smithi134.stdout:6/735: dread d17/d36/f6f [0,4194304] 0 2024-02-16T22:18:58.238 INFO:tasks.workunit.client.0.smithi134.stdout:6/736: chown d17/d36/d77/d9a/ff1 5551 1 2024-02-16T22:18:58.238 INFO:tasks.workunit.client.0.smithi134.stdout:3/662: symlink da/d1c/d24/lcc 0 2024-02-16T22:18:58.238 INFO:tasks.workunit.client.0.smithi134.stdout:3/663: readlink da/d1c/d24/d29/d51/d80/d89/d8e/dab/lbb 0 2024-02-16T22:18:58.240 INFO:tasks.workunit.client.0.smithi134.stdout:8/668: mkdir d2/df/d18/d2a/d41/d59/da0/d40/d53/dbe/ddf 0 2024-02-16T22:18:58.240 INFO:tasks.workunit.client.0.smithi134.stdout:8/669: chown d2/df/c2e 13333 1 2024-02-16T22:18:58.242 INFO:tasks.workunit.client.0.smithi134.stdout:5/739: getdents d2/d35/d36/d46/d68/d74 0 2024-02-16T22:18:58.242 INFO:tasks.workunit.client.0.smithi134.stdout:5/740: creat d2/d35/d36/d3d/d9c/ff3 x:0 0 0 2024-02-16T22:18:58.242 INFO:tasks.workunit.client.0.smithi134.stdout:2/625: dread df/f51 [0,4194304] 0 2024-02-16T22:18:58.244 INFO:tasks.workunit.client.0.smithi134.stdout:0/693: unlink d2/dc/d48/l74 0 2024-02-16T22:18:58.244 INFO:tasks.workunit.client.0.smithi134.stdout:0/694: truncate d2/dc/d2d/d34/f61 1379485 0 2024-02-16T22:18:58.246 INFO:tasks.workunit.client.0.smithi134.stdout:8/670: creat d2/df/d18/d2a/d41/d59/da0/d8d/fe0 x:0 0 0 2024-02-16T22:18:58.247 INFO:tasks.workunit.client.0.smithi134.stdout:6/737: dread d17/d36/d77/d9a/d28/d5b/d88/fa4 [0,4194304] 0 2024-02-16T22:18:58.249 INFO:tasks.workunit.client.0.smithi134.stdout:0/695: creat d2/dc/da0/fe6 x:0 0 0 2024-02-16T22:18:58.252 INFO:tasks.workunit.client.0.smithi134.stdout:9/767: rename db/d20/cbb to db/d20/d22/c111 0 2024-02-16T22:18:58.252 INFO:tasks.workunit.client.0.smithi134.stdout:9/768: chown db/d20/d22/d51/d9b/dbd/l94 446 1 2024-02-16T22:18:58.252 INFO:tasks.workunit.client.0.smithi134.stdout:9/769: chown db/d20/d32/c3b 0 1 2024-02-16T22:18:58.253 INFO:tasks.workunit.client.0.smithi134.stdout:8/671: mknod d2/df/ce1 0 2024-02-16T22:18:58.253 INFO:tasks.workunit.client.0.smithi134.stdout:8/672: write d2/df/d7c/fc2 [287651,9088] 0 2024-02-16T22:18:58.253 INFO:tasks.workunit.client.0.smithi134.stdout:8/673: write d2/df/d18/db5/fd7 [924971,63529] 0 2024-02-16T22:18:58.253 INFO:tasks.workunit.client.0.smithi134.stdout:2/626: write df/f3c [3460214,12390] 0 2024-02-16T22:18:58.253 INFO:tasks.workunit.client.0.smithi134.stdout:5/741: write d2/d35/d36/d3d/d63/d90/fbc [3799080,59702] 0 2024-02-16T22:18:58.254 INFO:tasks.workunit.client.0.smithi134.stdout:6/738: creat d17/d27/d30/d32/deb/ff2 x:0 0 0 2024-02-16T22:18:58.256 INFO:tasks.workunit.client.0.smithi134.stdout:0/696: rename d2/dc/d32/d3e/ce1 to d2/dc/d48/ce7 0 2024-02-16T22:18:58.257 INFO:tasks.workunit.client.0.smithi134.stdout:9/770: mkdir db/d20/d22/d51/d112 0 2024-02-16T22:18:58.259 INFO:tasks.workunit.client.0.smithi134.stdout:8/674: symlink d2/df/d18/d27/d85/le2 0 2024-02-16T22:18:58.259 INFO:tasks.workunit.client.0.smithi134.stdout:8/675: creat d2/df/d18/d2a/fe3 x:0 0 0 2024-02-16T22:18:58.260 INFO:tasks.workunit.client.0.smithi134.stdout:9/771: mkdir db/d20/d55/d107/d113 0 2024-02-16T22:18:58.260 INFO:tasks.workunit.client.0.smithi134.stdout:9/772: chown db/d20/d32/c6a 1984296 1 2024-02-16T22:18:58.260 INFO:tasks.workunit.client.0.smithi134.stdout:3/664: dwrite da/d1c/d24/d29/d51/f70 [0,4194304] 0 2024-02-16T22:18:58.264 INFO:tasks.workunit.client.0.smithi134.stdout:8/676: symlink d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/le4 0 2024-02-16T22:18:58.266 INFO:tasks.workunit.client.0.smithi134.stdout:2/627: write fb [1201561,69875] 0 2024-02-16T22:18:58.266 INFO:tasks.workunit.client.0.smithi134.stdout:2/628: read - df/d10/d30/d4d/f93 zero size 2024-02-16T22:18:58.267 INFO:tasks.workunit.client.0.smithi134.stdout:9/773: symlink db/d20/d9a/l114 0 2024-02-16T22:18:58.275 INFO:tasks.workunit.client.0.smithi134.stdout:3/665: mkdir da/d12/d2a/da4/dcd 0 2024-02-16T22:18:58.275 INFO:tasks.workunit.client.0.smithi134.stdout:8/677: rmdir d2/df/d18/d2a/d41/d59/da0 39 2024-02-16T22:18:58.275 INFO:tasks.workunit.client.0.smithi134.stdout:8/678: fdatasync d2/df/d18/d27/fbf 0 2024-02-16T22:18:58.276 INFO:tasks.workunit.client.0.smithi134.stdout:6/739: dwrite d17/d36/d77/d9a/d73/dd6/fc8 [0,4194304] 0 2024-02-16T22:18:58.276 INFO:tasks.workunit.client.0.smithi134.stdout:5/742: dwrite d2/f2b [0,4194304] 0 2024-02-16T22:18:58.279 INFO:tasks.workunit.client.0.smithi134.stdout:9/774: rename db/d20/d22/d64/d69/d6e/d81/dc4 to db/d20/d22/d46/d115 0 2024-02-16T22:18:58.279 INFO:tasks.workunit.client.0.smithi134.stdout:9/775: truncate db/d20/d22/d64/d69/d6e/fe6 64805 0 2024-02-16T22:18:58.279 INFO:tasks.workunit.client.0.smithi134.stdout:6/740: rmdir d17/d27/d93/d9c/dec 39 2024-02-16T22:18:58.280 INFO:tasks.workunit.client.0.smithi134.stdout:3/666: dread da/d1c/d24/d9a/dc0/d8a/d8f/f4e [0,4194304] 0 2024-02-16T22:18:58.281 INFO:tasks.workunit.client.0.smithi134.stdout:8/679: dread d2/f5d [0,4194304] 0 2024-02-16T22:18:58.282 INFO:tasks.workunit.client.0.smithi134.stdout:9/776: symlink db/d20/d32/dd8/d10a/l116 0 2024-02-16T22:18:58.284 INFO:tasks.workunit.client.0.smithi134.stdout:3/667: creat da/d1c/d24/d9a/dc0/fce x:0 0 0 2024-02-16T22:18:58.284 INFO:tasks.workunit.client.0.smithi134.stdout:3/668: dread - da/d1c/d24/d9a/dc0/d8a/fa7 zero size 2024-02-16T22:18:58.286 INFO:tasks.workunit.client.0.smithi134.stdout:8/680: rename d2/df/d18/d2a/f2b to d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/fe5 0 2024-02-16T22:18:58.287 INFO:tasks.workunit.client.0.smithi134.stdout:3/669: symlink da/dc3/lcf 0 2024-02-16T22:18:58.290 INFO:tasks.workunit.client.0.smithi134.stdout:8/681: mknod d2/df/d18/d5a/ce6 0 2024-02-16T22:18:58.292 INFO:tasks.workunit.client.0.smithi134.stdout:3/670: unlink da/d12/l4b 0 2024-02-16T22:18:58.294 INFO:tasks.workunit.client.0.smithi134.stdout:8/682: creat d2/df/fe7 x:0 0 0 2024-02-16T22:18:58.295 INFO:tasks.workunit.client.0.smithi134.stdout:3/671: mknod da/d1c/d24/cd0 0 2024-02-16T22:18:58.295 INFO:tasks.workunit.client.0.smithi134.stdout:3/672: creat da/d1c/d24/d9a/dc0/d8a/fd1 x:0 0 0 2024-02-16T22:18:58.297 INFO:tasks.workunit.client.0.smithi134.stdout:3/673: mkdir da/d12/dd2 0 2024-02-16T22:18:58.298 INFO:tasks.workunit.client.0.smithi134.stdout:3/674: creat da/d1c/d24/d2c/d74/fd3 x:0 0 0 2024-02-16T22:18:58.298 INFO:tasks.workunit.client.0.smithi134.stdout:3/675: dread - da/d1c/d24/d9a/dc0/d8a/fa7 zero size 2024-02-16T22:18:58.298 INFO:tasks.workunit.client.0.smithi134.stdout:3/676: rename da/d1c to da/d1c/d24/d29/d51/d80/d89/d8e/dab/dd4 22 2024-02-16T22:18:58.301 INFO:tasks.workunit.client.0.smithi134.stdout:3/677: mkdir da/d1c/d24/dd5 0 2024-02-16T22:18:58.301 INFO:tasks.workunit.client.0.smithi134.stdout:3/678: write da/d1c/d24/d29/faf [850982,123209] 0 2024-02-16T22:18:58.303 INFO:tasks.workunit.client.0.smithi134.stdout:9/777: dread db/d20/d22/d64/d69/f98 [0,4194304] 0 2024-02-16T22:18:58.304 INFO:tasks.workunit.client.0.smithi134.stdout:9/778: truncate db/f33 1268409 0 2024-02-16T22:18:58.304 INFO:tasks.workunit.client.0.smithi134.stdout:2/629: truncate fb 3996482 0 2024-02-16T22:18:58.308 INFO:tasks.workunit.client.0.smithi134.stdout:4/560: sync 2024-02-16T22:18:58.313 INFO:tasks.workunit.client.0.smithi134.stdout:3/679: dread da/d12/d2a/fbf [0,4194304] 0 2024-02-16T22:18:58.313 INFO:tasks.workunit.client.0.smithi134.stdout:3/680: write da/f19 [827177,32566] 0 2024-02-16T22:18:58.313 INFO:tasks.workunit.client.0.smithi134.stdout:3/681: write da/d1c/f5d [1153749,117427] 0 2024-02-16T22:18:58.317 INFO:tasks.workunit.client.0.smithi134.stdout:3/682: rename da/d1c/d24/d29/d51/d79/faa to da/d1c/fd6 0 2024-02-16T22:18:58.317 INFO:tasks.workunit.client.0.smithi134.stdout:3/683: chown da/d1c/d24/d9a/dc0/d8a/d8f/l71 21797933 1 2024-02-16T22:18:58.317 INFO:tasks.workunit.client.0.smithi134.stdout:3/684: dread - da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/fc9 zero size 2024-02-16T22:18:58.317 INFO:tasks.workunit.client.0.smithi134.stdout:5/743: dwrite d2/f2b [4194304,4194304] 0 2024-02-16T22:18:58.317 INFO:tasks.workunit.client.0.smithi134.stdout:6/741: dwrite d17/d27/f56 [0,4194304] 0 2024-02-16T22:18:58.318 INFO:tasks.workunit.client.0.smithi134.stdout:8/683: dwrite d2/df/d18/d2a/d41/d59/da0/d40/f8e [4194304,4194304] 0 2024-02-16T22:18:58.318 INFO:tasks.workunit.client.0.smithi134.stdout:8/684: stat d2/df/d18/f45 0 2024-02-16T22:18:58.318 INFO:tasks.workunit.client.0.smithi134.stdout:8/685: chown d2/fbd 17 1 2024-02-16T22:18:58.318 INFO:tasks.workunit.client.0.smithi134.stdout:3/685: unlink da/d1c/d24/d2c/c34 0 2024-02-16T22:18:58.318 INFO:tasks.workunit.client.0.smithi134.stdout:3/686: write da/d12/f76 [190677,73526] 0 2024-02-16T22:18:58.320 INFO:tasks.workunit.client.0.smithi134.stdout:5/744: symlink d2/d9/dc/daf/lf4 0 2024-02-16T22:18:58.320 INFO:tasks.workunit.client.0.smithi134.stdout:5/745: fdatasync d2/d35/d36/d3d/d9c/f2c 0 2024-02-16T22:18:58.320 INFO:tasks.workunit.client.0.smithi134.stdout:5/746: write d2/d9/dc/d15/d2f/fc1 [342974,66773] 0 2024-02-16T22:18:58.320 INFO:tasks.workunit.client.0.smithi134.stdout:5/747: stat d2/d35/d36/f77 0 2024-02-16T22:18:58.322 INFO:tasks.workunit.client.0.smithi134.stdout:4/561: dread d0/f4 [0,4194304] 0 2024-02-16T22:18:58.323 INFO:tasks.workunit.client.0.smithi134.stdout:6/742: symlink d17/d27/d93/d9c/dec/d52/d79/d92/lf3 0 2024-02-16T22:18:58.325 INFO:tasks.workunit.client.0.smithi134.stdout:8/686: symlink d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/le8 0 2024-02-16T22:18:58.327 INFO:tasks.workunit.client.0.smithi134.stdout:3/687: symlink da/d12/d2a/da4/ld7 0 2024-02-16T22:18:58.327 INFO:tasks.workunit.client.0.smithi134.stdout:3/688: dread - da/d1c/d24/d9a/dc0/d8a/fd1 zero size 2024-02-16T22:18:58.327 INFO:tasks.workunit.client.0.smithi134.stdout:3/689: fdatasync da/d1c/d24/f3d 0 2024-02-16T22:18:58.328 INFO:tasks.workunit.client.0.smithi134.stdout:2/630: dwrite df/d10/d30/d49/d82/d1b/f8b [0,4194304] 0 2024-02-16T22:18:58.328 INFO:tasks.workunit.client.0.smithi134.stdout:5/748: mknod d2/d35/d36/da1/cf5 0 2024-02-16T22:18:58.330 INFO:tasks.workunit.client.0.smithi134.stdout:9/779: dwrite db/d20/f8e [0,4194304] 0 2024-02-16T22:18:58.330 INFO:tasks.workunit.client.0.smithi134.stdout:9/780: creat db/d20/d22/d64/f117 x:0 0 0 2024-02-16T22:18:58.330 INFO:tasks.workunit.client.0.smithi134.stdout:9/781: fsync db/dc/f14 0 2024-02-16T22:18:58.330 INFO:tasks.workunit.client.0.smithi134.stdout:4/562: truncate d0/d6/d8/d30/f71 562490 0 2024-02-16T22:18:58.330 INFO:tasks.workunit.client.0.smithi134.stdout:9/782: chown db/d20/d22/d64/dc2/ddb 173700627 1 2024-02-16T22:18:58.330 INFO:tasks.workunit.client.0.smithi134.stdout:9/783: stat db/d20/d22/d46/ff7 0 2024-02-16T22:18:58.330 INFO:tasks.workunit.client.0.smithi134.stdout:4/563: write d0/d6/d22/d25/d2a/f51 [68004,43203] 0 2024-02-16T22:18:58.332 INFO:tasks.workunit.client.0.smithi134.stdout:6/743: rmdir d17/d36/d77/d9a/d73/dd6 39 2024-02-16T22:18:58.332 INFO:tasks.workunit.client.0.smithi134.stdout:3/690: creat da/dc3/fd8 x:0 0 0 2024-02-16T22:18:58.332 INFO:tasks.workunit.client.0.smithi134.stdout:3/691: read - da/f72 zero size 2024-02-16T22:18:58.338 INFO:tasks.workunit.client.0.smithi134.stdout:2/631: rename df/d10/d30/d49/d82/c9c to df/d41/cbd 0 2024-02-16T22:18:58.339 INFO:tasks.workunit.client.0.smithi134.stdout:6/744: write d17/d27/fa9 [2166182,92902] 0 2024-02-16T22:18:58.341 INFO:tasks.workunit.client.0.smithi134.stdout:9/784: dread db/f3d [0,4194304] 0 2024-02-16T22:18:58.352 INFO:tasks.workunit.client.0.smithi134.stdout:2/632: write df/d10/d30/d4d/d94/da3/f72 [346273,114857] 0 2024-02-16T22:18:58.352 INFO:tasks.workunit.client.0.smithi134.stdout:2/633: chown df/d10/d30/d49/d82/d1b/l9d 3 1 2024-02-16T22:18:58.352 INFO:tasks.workunit.client.0.smithi134.stdout:6/745: dread d17/d27/d93/d9c/dec/dcb/ddc/fe9 [4194304,4194304] 0 2024-02-16T22:18:58.352 INFO:tasks.workunit.client.0.smithi134.stdout:8/687: dwrite d2/df/d18/d2a/d41/d59/da0/f28 [0,4194304] 0 2024-02-16T22:18:58.352 INFO:tasks.workunit.client.0.smithi134.stdout:8/688: creat d2/df/d18/d2a/d41/d59/fe9 x:0 0 0 2024-02-16T22:18:58.353 INFO:tasks.workunit.client.0.smithi134.stdout:2/634: dread df/d10/f3b [0,4194304] 0 2024-02-16T22:18:58.353 INFO:tasks.workunit.client.0.smithi134.stdout:5/749: dwrite d2/d35/d36/d46/d68/fb9 [4194304,4194304] 0 2024-02-16T22:18:58.353 INFO:tasks.workunit.client.0.smithi134.stdout:5/750: readlink d2/d9/lc5 0 2024-02-16T22:18:58.353 INFO:tasks.workunit.client.0.smithi134.stdout:5/751: write d2/d35/d36/d46/d68/d74/fb4 [1639886,125873] 0 2024-02-16T22:18:58.355 INFO:tasks.workunit.client.0.smithi134.stdout:4/564: creat d0/d6/d8/d5e/fbd x:0 0 0 2024-02-16T22:18:58.356 INFO:tasks.workunit.client.0.smithi134.stdout:4/565: creat d0/d6/d8/d30/fbe x:0 0 0 2024-02-16T22:18:58.356 INFO:tasks.workunit.client.0.smithi134.stdout:4/566: write d0/d6/d8/d30/fbe [357213,34635] 0 2024-02-16T22:18:58.358 INFO:tasks.workunit.client.0.smithi134.stdout:3/692: unlink c0 0 2024-02-16T22:18:58.358 INFO:tasks.workunit.client.0.smithi134.stdout:3/693: dread da/dc3/f99 [0,4194304] 0 2024-02-16T22:18:58.360 INFO:tasks.workunit.client.0.smithi134.stdout:6/746: creat d17/d27/d30/ff4 x:0 0 0 2024-02-16T22:18:58.363 INFO:tasks.workunit.client.0.smithi134.stdout:9/785: dwrite db/dc/f14 [4194304,4194304] 0 2024-02-16T22:18:58.364 INFO:tasks.workunit.client.0.smithi134.stdout:8/689: creat d2/df/d18/d2a/d41/d59/db1/d87/fea x:0 0 0 2024-02-16T22:18:58.364 INFO:tasks.workunit.client.0.smithi134.stdout:2/635: dread df/d10/d3a/f71 [0,4194304] 0 2024-02-16T22:18:58.364 INFO:tasks.workunit.client.0.smithi134.stdout:2/636: read df/d10/d30/f77 [3634218,55003] 0 2024-02-16T22:18:58.365 INFO:tasks.workunit.client.0.smithi134.stdout:4/567: truncate d0/d6/d22/d25/f43 3167104 0 2024-02-16T22:18:58.368 INFO:tasks.workunit.client.0.smithi134.stdout:3/694: creat da/d1c/d24/d9a/dc0/d8a/d8f/d6d/fd9 x:0 0 0 2024-02-16T22:18:58.368 INFO:tasks.workunit.client.0.smithi134.stdout:3/695: fdatasync da/d1c/d24/d9a/dc0/d8a/d8f/f3f 0 2024-02-16T22:18:58.370 INFO:tasks.workunit.client.0.smithi134.stdout:7/695: sync 2024-02-16T22:18:58.370 INFO:tasks.workunit.client.0.smithi134.stdout:0/697: sync 2024-02-16T22:18:58.370 INFO:tasks.workunit.client.0.smithi134.stdout:1/700: sync 2024-02-16T22:18:58.371 INFO:tasks.workunit.client.0.smithi134.stdout:7/696: creat d2/d6/d7d/d9e/fe7 x:0 0 0 2024-02-16T22:18:58.371 INFO:tasks.workunit.client.0.smithi134.stdout:1/701: creat d5/da/db8/fe9 x:0 0 0 2024-02-16T22:18:58.375 INFO:tasks.workunit.client.0.smithi134.stdout:8/690: unlink d2/c3a 0 2024-02-16T22:18:58.375 INFO:tasks.workunit.client.0.smithi134.stdout:8/691: truncate d2/f1b 1994293 0 2024-02-16T22:18:58.381 INFO:tasks.workunit.client.0.smithi134.stdout:4/568: stat d0/d6/d58/c74 0 2024-02-16T22:18:58.381 INFO:tasks.workunit.client.0.smithi134.stdout:3/696: symlink da/d1c/d24/d2c/lda 0 2024-02-16T22:18:58.382 INFO:tasks.workunit.client.0.smithi134.stdout:3/697: chown da/d1c/d24/d9a/dc0/l50 4756 1 2024-02-16T22:18:58.382 INFO:tasks.workunit.client.0.smithi134.stdout:3/698: creat da/d1c/d24/d29/d51/fdb x:0 0 0 2024-02-16T22:18:58.386 INFO:tasks.workunit.client.0.smithi134.stdout:9/786: rmdir db/d20/d22/d46/dbe 39 2024-02-16T22:18:58.386 INFO:tasks.workunit.client.0.smithi134.stdout:6/747: dwrite d17/d36/d77/d9a/f4b [0,4194304] 0 2024-02-16T22:18:58.395 INFO:tasks.workunit.client.0.smithi134.stdout:9/787: rmdir db/d20/d22/d51/d9b/dbd 39 2024-02-16T22:18:58.397 INFO:tasks.workunit.client.0.smithi134.stdout:9/788: mkdir db/d20/d22/d46/d118 0 2024-02-16T22:18:58.419 INFO:tasks.workunit.client.0.smithi134.stdout:1/702: dwrite d5/da/fa2 [0,4194304] 0 2024-02-16T22:18:58.419 INFO:tasks.workunit.client.0.smithi134.stdout:1/703: readlink d5/d1a/d4d/l6f 0 2024-02-16T22:18:58.437 INFO:tasks.workunit.client.0.smithi134.stdout:0/698: dwrite d2/d20/d77/d85/f99 [0,4194304] 0 2024-02-16T22:18:58.437 INFO:tasks.workunit.client.0.smithi134.stdout:2/637: dwrite df/d10/d15/d90/f92 [4194304,4194304] 0 2024-02-16T22:18:58.437 INFO:tasks.workunit.client.0.smithi134.stdout:7/697: dwrite d2/d6/d17/d31/d28/fc7 [0,4194304] 0 2024-02-16T22:18:58.437 INFO:tasks.workunit.client.0.smithi134.stdout:7/698: readlink d2/d5/d19/d84/d86/d93/dab/l6a 0 2024-02-16T22:18:58.441 INFO:tasks.workunit.client.0.smithi134.stdout:7/699: mkdir d2/d5/d19/d84/d86/d93/de8 0 2024-02-16T22:18:58.445 INFO:tasks.workunit.client.0.smithi134.stdout:2/638: dread df/d10/d30/d4d/d94/da3/f84 [0,4194304] 0 2024-02-16T22:18:58.448 INFO:tasks.workunit.client.0.smithi134.stdout:6/748: dwrite f6 [0,4194304] 0 2024-02-16T22:18:58.448 INFO:tasks.workunit.client.0.smithi134.stdout:6/749: chown d17/d36/d77/d9a/d70/cc6 106 1 2024-02-16T22:18:58.448 INFO:tasks.workunit.client.0.smithi134.stdout:9/789: dwrite db/d20/f28 [0,4194304] 0 2024-02-16T22:18:58.448 INFO:tasks.workunit.client.0.smithi134.stdout:9/790: chown db/d20/d22/l53 7581 1 2024-02-16T22:18:58.448 INFO:tasks.workunit.client.0.smithi134.stdout:8/692: dwrite d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/fe5 [4194304,4194304] 0 2024-02-16T22:18:58.448 INFO:tasks.workunit.client.0.smithi134.stdout:8/693: truncate d2/df/d18/d2a/d41/d59/f84 834576 0 2024-02-16T22:18:58.448 INFO:tasks.workunit.client.0.smithi134.stdout:4/569: dwrite d0/f77 [0,4194304] 0 2024-02-16T22:18:58.449 INFO:tasks.workunit.client.0.smithi134.stdout:3/699: dwrite da/d1c/d24/d29/d51/d80/f85 [0,4194304] 0 2024-02-16T22:18:58.449 INFO:tasks.workunit.client.0.smithi134.stdout:1/704: dwrite d5/d1a/d82/f97 [0,4194304] 0 2024-02-16T22:18:58.449 INFO:tasks.workunit.client.0.smithi134.stdout:1/705: write d5/da/d21/d45/f77 [1643757,114426] 0 2024-02-16T22:18:58.449 INFO:tasks.workunit.client.0.smithi134.stdout:3/700: read da/d1c/d24/d29/faf [610059,40569] 0 2024-02-16T22:18:58.454 INFO:tasks.workunit.client.0.smithi134.stdout:7/700: write d2/d6/d7d/d92/dcd/f6e [2280126,46072] 0 2024-02-16T22:18:58.460 INFO:tasks.workunit.client.0.smithi134.stdout:1/706: dread d5/d1a/d23/d3c/f41 [0,4194304] 0 2024-02-16T22:18:58.552 INFO:tasks.workunit.client.0.smithi134.stdout:2/639: mknod df/d10/d30/d4d/d94/da3/cbe 0 2024-02-16T22:18:58.552 INFO:tasks.workunit.client.0.smithi134.stdout:2/640: dread - df/d10/d30/d49/d82/d1b/f64 zero size 2024-02-16T22:18:58.557 INFO:tasks.workunit.client.0.smithi134.stdout:6/750: dwrite d17/d36/d77/d9a/f29 [0,4194304] 0 2024-02-16T22:18:58.558 INFO:tasks.workunit.client.0.smithi134.stdout:9/791: creat db/d20/d32/dd8/d10a/f119 x:0 0 0 2024-02-16T22:18:58.559 INFO:tasks.workunit.client.0.smithi134.stdout:8/694: creat d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/d7d/feb x:0 0 0 2024-02-16T22:18:58.562 INFO:tasks.workunit.client.0.smithi134.stdout:4/570: rename d0/d6/d8/d5e/f7d to d0/d31/db8/d46/fbf 0 2024-02-16T22:18:58.562 INFO:tasks.workunit.client.0.smithi134.stdout:4/571: creat d0/d6/d1e/d7c/fc0 x:0 0 0 2024-02-16T22:18:58.569 INFO:tasks.workunit.client.0.smithi134.stdout:7/701: creat d2/d6/d91/db3/fe9 x:0 0 0 2024-02-16T22:18:58.570 INFO:tasks.workunit.client.0.smithi134.stdout:1/707: symlink d5/da/d21/d52/d9b/d9f/lea 0 2024-02-16T22:18:58.571 INFO:tasks.workunit.client.0.smithi134.stdout:2/641: creat df/d10/d15/da4/fbf x:0 0 0 2024-02-16T22:18:58.572 INFO:tasks.workunit.client.0.smithi134.stdout:4/572: write d0/d6/d1e/d3b/f50 [2938120,118615] 0 2024-02-16T22:18:58.577 INFO:tasks.workunit.client.0.smithi134.stdout:5/752: sync 2024-02-16T22:18:58.577 INFO:tasks.workunit.client.0.smithi134.stdout:5/753: write d2/d35/d36/f77 [3280865,14762] 0 2024-02-16T22:18:58.577 INFO:tasks.workunit.client.0.smithi134.stdout:5/754: fdatasync d2/d35/d36/da9/fe5 0 2024-02-16T22:18:58.577 INFO:tasks.workunit.client.0.smithi134.stdout:9/792: getdents db/d20/d22/d51/da2 0 2024-02-16T22:18:58.579 INFO:tasks.workunit.client.0.smithi134.stdout:8/695: getdents d2/df/d18/db5/dce 0 2024-02-16T22:18:58.580 INFO:tasks.workunit.client.0.smithi134.stdout:6/751: rename d17/d36/d77/d9a/cb9 to d17/d36/d77/d9a/d28/d5b/d88/daf/dd1/cf5 0 2024-02-16T22:18:58.581 INFO:tasks.workunit.client.0.smithi134.stdout:7/702: dread d2/d5/d19/f1d [4194304,4194304] 0 2024-02-16T22:18:58.581 INFO:tasks.workunit.client.0.smithi134.stdout:7/703: fdatasync d2/d6/d91/db3/fb4 0 2024-02-16T22:18:58.583 INFO:tasks.workunit.client.0.smithi134.stdout:5/755: mknod d2/d35/d36/d3d/d63/d90/cf6 0 2024-02-16T22:18:58.583 INFO:tasks.workunit.client.0.smithi134.stdout:5/756: chown d2/l6e 806 1 2024-02-16T22:18:58.584 INFO:tasks.workunit.client.0.smithi134.stdout:9/793: mkdir db/d20/d22/d64/d69/d89/d11a 0 2024-02-16T22:18:58.586 INFO:tasks.workunit.client.0.smithi134.stdout:8/696: creat d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/fec x:0 0 0 2024-02-16T22:18:58.586 INFO:tasks.workunit.client.0.smithi134.stdout:8/697: dread - d2/df/d18/d2a/d41/d59/db1/d87/fd5 zero size 2024-02-16T22:18:58.586 INFO:tasks.workunit.client.0.smithi134.stdout:8/698: chown d2/df/d18/d2a/la8 271782660 1 2024-02-16T22:18:58.586 INFO:tasks.workunit.client.0.smithi134.stdout:8/699: creat d2/df/d18/d2a/d41/d59/fed x:0 0 0 2024-02-16T22:18:58.587 INFO:tasks.workunit.client.0.smithi134.stdout:8/700: fdatasync d2/f36 0 2024-02-16T22:18:58.589 INFO:tasks.workunit.client.0.smithi134.stdout:1/708: rename d5/d1a/d4d/d99/fcb to d5/d1a/d23/d3c/d6a/de3/feb 0 2024-02-16T22:18:58.589 INFO:tasks.workunit.client.0.smithi134.stdout:1/709: creat d5/d1a/d23/fec x:0 0 0 2024-02-16T22:18:58.589 INFO:tasks.workunit.client.0.smithi134.stdout:0/699: sync 2024-02-16T22:18:58.589 INFO:tasks.workunit.client.0.smithi134.stdout:0/700: creat d2/dc/d32/d3e/dc1/fe8 x:0 0 0 2024-02-16T22:18:58.590 INFO:tasks.workunit.client.0.smithi134.stdout:7/704: stat d2/d5/d22/c73 0 2024-02-16T22:18:58.590 INFO:tasks.workunit.client.0.smithi134.stdout:7/705: creat d2/d6/d91/db3/fea x:0 0 0 2024-02-16T22:18:58.591 INFO:tasks.workunit.client.0.smithi134.stdout:4/573: link d0/d6/d1e/d7c/fc0 d0/d6/d58/fc1 0 2024-02-16T22:18:58.597 INFO:tasks.workunit.client.0.smithi134.stdout:1/710: mknod d5/da/d2d/dca/ced 0 2024-02-16T22:18:58.597 INFO:tasks.workunit.client.0.smithi134.stdout:1/711: dread - d5/d1a/d53/d86/faa zero size 2024-02-16T22:18:58.599 INFO:tasks.workunit.client.0.smithi134.stdout:6/752: dwrite d17/d27/d93/d9c/dec/d52/f84 [0,4194304] 0 2024-02-16T22:18:58.599 INFO:tasks.workunit.client.0.smithi134.stdout:6/753: stat d17/d27/d93/d9c/dec/d52/d87 0 2024-02-16T22:18:58.600 INFO:tasks.workunit.client.0.smithi134.stdout:6/754: chown d17/d27/d30/d32/l37 387 1 2024-02-16T22:18:58.601 INFO:tasks.workunit.client.0.smithi134.stdout:4/574: mknod d0/d6/d1e/d3b/cc2 0 2024-02-16T22:18:58.601 INFO:tasks.workunit.client.0.smithi134.stdout:4/575: read - d0/d6/d22/d25/fad zero size 2024-02-16T22:18:58.601 INFO:tasks.workunit.client.0.smithi134.stdout:4/576: fsync d0/d6/d1e/d3b/f50 0 2024-02-16T22:18:58.602 INFO:tasks.workunit.client.0.smithi134.stdout:9/794: read db/d20/d22/f50 [3669737,17018] 0 2024-02-16T22:18:58.603 INFO:tasks.workunit.client.0.smithi134.stdout:7/706: dread d2/d6/d17/d31/d28/f6c [4194304,4194304] 0 2024-02-16T22:18:58.605 INFO:tasks.workunit.client.0.smithi134.stdout:4/577: creat d0/d6/d44/db0/fc3 x:0 0 0 2024-02-16T22:18:58.607 INFO:tasks.workunit.client.0.smithi134.stdout:9/795: link db/dc/f38 db/d20/d22/d64/d69/d89/de2/f11b 0 2024-02-16T22:18:58.607 INFO:tasks.workunit.client.0.smithi134.stdout:9/796: truncate db/dc/f61 252473 0 2024-02-16T22:18:58.608 INFO:tasks.workunit.client.0.smithi134.stdout:8/701: dread d2/df/d18/d2a/d41/d59/da0/d9f/fcf [0,4194304] 0 2024-02-16T22:18:58.608 INFO:tasks.workunit.client.0.smithi134.stdout:3/701: dwrite da/d12/d2a/f4f [0,4194304] 0 2024-02-16T22:18:58.608 INFO:tasks.workunit.client.0.smithi134.stdout:8/702: stat d2/df/d18/d2a/c3c 0 2024-02-16T22:18:58.608 INFO:tasks.workunit.client.0.smithi134.stdout:7/707: truncate d2/d6/d17/d31/d28/fc7 269963 0 2024-02-16T22:18:58.610 INFO:tasks.workunit.client.0.smithi134.stdout:4/578: unlink d0/d31/f87 0 2024-02-16T22:18:58.611 INFO:tasks.workunit.client.0.smithi134.stdout:7/708: write d2/d6/d17/f82 [1657075,6111] 0 2024-02-16T22:18:58.611 INFO:tasks.workunit.client.0.smithi134.stdout:5/757: dread d2/d9/dc/daf/fd0 [0,4194304] 0 2024-02-16T22:18:58.611 INFO:tasks.workunit.client.0.smithi134.stdout:9/797: unlink db/d20/d22/d46/d115/dec/f104 0 2024-02-16T22:18:58.612 INFO:tasks.workunit.client.0.smithi134.stdout:1/712: write d5/d1a/d23/d3c/d6a/f51 [1393578,102312] 0 2024-02-16T22:18:58.612 INFO:tasks.workunit.client.0.smithi134.stdout:3/702: write da/d12/d2a/f3c [5190782,96524] 0 2024-02-16T22:18:58.612 INFO:tasks.workunit.client.0.smithi134.stdout:3/703: chown da/d1c/d24/d29/f49 31 1 2024-02-16T22:18:58.613 INFO:tasks.workunit.client.0.smithi134.stdout:8/703: mknod d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/cee 0 2024-02-16T22:18:58.613 INFO:tasks.workunit.client.0.smithi134.stdout:8/704: truncate d2/fbd 2873435 0 2024-02-16T22:18:58.614 INFO:tasks.workunit.client.0.smithi134.stdout:8/705: fsync d2/df/d18/d2a/d41/d59/da0/d8d/fe0 0 2024-02-16T22:18:58.615 INFO:tasks.workunit.client.0.smithi134.stdout:4/579: mkdir d0/d6/d44/da9/dc4 0 2024-02-16T22:18:58.618 INFO:tasks.workunit.client.0.smithi134.stdout:0/701: dwrite d2/dc/d32/d3e/f47 [0,4194304] 0 2024-02-16T22:18:58.618 INFO:tasks.workunit.client.0.smithi134.stdout:0/702: chown d2/d20/d77/d85/d94 5121 1 2024-02-16T22:18:58.618 INFO:tasks.workunit.client.0.smithi134.stdout:0/703: dread - d2/dc/d32/d3e/d5e/f76 zero size 2024-02-16T22:18:58.618 INFO:tasks.workunit.client.0.smithi134.stdout:0/704: read d2/fc0 [536026,124295] 0 2024-02-16T22:18:58.618 INFO:tasks.workunit.client.0.smithi134.stdout:0/705: chown d2/d20/d77/d85/f99 638 1 2024-02-16T22:18:58.618 INFO:tasks.workunit.client.0.smithi134.stdout:7/709: truncate d2/d6/d7d/d92/dcd/d7f/f61 4053442 0 2024-02-16T22:18:58.620 INFO:tasks.workunit.client.0.smithi134.stdout:5/758: truncate d2/d9/dc/d15/f31 1378749 0 2024-02-16T22:18:58.621 INFO:tasks.workunit.client.0.smithi134.stdout:9/798: mknod db/de0/def/c11c 0 2024-02-16T22:18:58.624 INFO:tasks.workunit.client.0.smithi134.stdout:3/704: rename da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/fc9 to da/d1c/d24/dae/fdc 0 2024-02-16T22:18:58.624 INFO:tasks.workunit.client.0.smithi134.stdout:3/705: write da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/f6c [970406,25956] 0 2024-02-16T22:18:58.627 INFO:tasks.workunit.client.0.smithi134.stdout:0/706: symlink d2/d20/le9 0 2024-02-16T22:18:58.630 INFO:tasks.workunit.client.0.smithi134.stdout:9/799: getdents db/d20/d22/d64/dc2/dcb/d108 0 2024-02-16T22:18:58.630 INFO:tasks.workunit.client.0.smithi134.stdout:9/800: fsync db/dc/f24 0 2024-02-16T22:18:58.631 INFO:tasks.workunit.client.0.smithi134.stdout:7/710: write d2/f4 [3959976,101181] 0 2024-02-16T22:18:58.631 INFO:tasks.workunit.client.0.smithi134.stdout:3/706: link da/d1c/d24/d9a/dc0/la6 da/d1c/d24/d29/d51/d80/d89/d8e/ldd 0 2024-02-16T22:18:58.632 INFO:tasks.workunit.client.0.smithi134.stdout:8/706: rmdir d2/da3 39 2024-02-16T22:18:58.632 INFO:tasks.workunit.client.0.smithi134.stdout:0/707: creat d2/dc/d32/d3e/d5e/fea x:0 0 0 2024-02-16T22:18:58.633 INFO:tasks.workunit.client.0.smithi134.stdout:5/759: mkdir d2/d9/dc/df7 0 2024-02-16T22:18:58.635 INFO:tasks.workunit.client.0.smithi134.stdout:9/801: rmdir db/d20/d22/d64/dc2/dcb/d108/d10c 0 2024-02-16T22:18:58.635 INFO:tasks.workunit.client.0.smithi134.stdout:9/802: getdents db/d20/d55/d107/d113 0 2024-02-16T22:18:58.635 INFO:tasks.workunit.client.0.smithi134.stdout:9/803: fdatasync db/fa5 0 2024-02-16T22:18:58.635 INFO:tasks.workunit.client.0.smithi134.stdout:9/804: chown c6 15792163 1 2024-02-16T22:18:58.635 INFO:tasks.workunit.client.0.smithi134.stdout:9/805: chown db/f33 824652 1 2024-02-16T22:18:58.637 INFO:tasks.workunit.client.0.smithi134.stdout:7/711: symlink d2/d6/d7d/d92/da5/leb 0 2024-02-16T22:18:58.637 INFO:tasks.workunit.client.0.smithi134.stdout:6/755: dwrite d17/d63/f82 [0,4194304] 0 2024-02-16T22:18:58.637 INFO:tasks.workunit.client.0.smithi134.stdout:6/756: stat d17/d36/d77/d9a/f4b 0 2024-02-16T22:18:58.639 INFO:tasks.workunit.client.0.smithi134.stdout:8/707: rename d2/f5f to d2/df/d18/d12/fef 0 2024-02-16T22:18:58.639 INFO:tasks.workunit.client.0.smithi134.stdout:8/708: chown d2/df/d18/d2a/d41/d59/da0/d86/c9b 216774629 1 2024-02-16T22:18:58.640 INFO:tasks.workunit.client.0.smithi134.stdout:0/708: symlink d2/d4b/leb 0 2024-02-16T22:18:58.641 INFO:tasks.workunit.client.0.smithi134.stdout:9/806: mknod db/d20/d32/c11d 0 2024-02-16T22:18:58.642 INFO:tasks.workunit.client.0.smithi134.stdout:6/757: symlink d17/d27/d93/d9c/dec/dcb/lf6 0 2024-02-16T22:18:58.643 INFO:tasks.workunit.client.0.smithi134.stdout:1/713: dwrite d5/da/f35 [0,4194304] 0 2024-02-16T22:18:58.644 INFO:tasks.workunit.client.0.smithi134.stdout:7/712: creat d2/d5/d4c/fec x:0 0 0 2024-02-16T22:18:58.647 INFO:tasks.workunit.client.0.smithi134.stdout:4/580: dwrite d0/d6/d58/fc1 [0,4194304] 0 2024-02-16T22:18:58.647 INFO:tasks.workunit.client.0.smithi134.stdout:8/709: rename d2/df/d18/d2a/c68 to d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/dd3/cf0 0 2024-02-16T22:18:58.648 INFO:tasks.workunit.client.0.smithi134.stdout:0/709: creat d2/dc/d2d/fec x:0 0 0 2024-02-16T22:18:58.652 INFO:tasks.workunit.client.0.smithi134.stdout:7/713: mknod d2/d5/d22/d26/ced 0 2024-02-16T22:18:58.655 INFO:tasks.workunit.client.0.smithi134.stdout:3/707: dwrite da/d1c/d24/d29/d51/f70 [4194304,4194304] 0 2024-02-16T22:18:58.655 INFO:tasks.workunit.client.0.smithi134.stdout:3/708: write da/d12/f76 [1800423,40079] 0 2024-02-16T22:18:58.655 INFO:tasks.workunit.client.0.smithi134.stdout:3/709: write da/d1c/d24/d9a/dc0/d8a/fd1 [595324,42457] 0 2024-02-16T22:18:58.658 INFO:tasks.workunit.client.0.smithi134.stdout:1/714: write d5/f46 [2851673,76677] 0 2024-02-16T22:18:58.658 INFO:tasks.workunit.client.0.smithi134.stdout:4/581: mknod d0/d6/d22/d40/cc5 0 2024-02-16T22:18:58.659 INFO:tasks.workunit.client.0.smithi134.stdout:8/710: mkdir d2/df/d18/d2a/d41/d59/da0/d40/d53/daa/df1 0 2024-02-16T22:18:58.662 INFO:tasks.workunit.client.0.smithi134.stdout:9/807: rmdir db/d20/d22/d64/d69 39 2024-02-16T22:18:58.664 INFO:tasks.workunit.client.0.smithi134.stdout:3/710: creat da/fde x:0 0 0 2024-02-16T22:18:58.665 INFO:tasks.workunit.client.0.smithi134.stdout:4/582: dread - d0/d31/db8/d46/fbf zero size 2024-02-16T22:18:58.665 INFO:tasks.workunit.client.0.smithi134.stdout:4/583: chown d0/d6/d1e/d3b/c55 1012 1 2024-02-16T22:18:58.665 INFO:tasks.workunit.client.0.smithi134.stdout:4/584: chown d0/d6/d8/fa 87986656 1 2024-02-16T22:18:58.666 INFO:tasks.workunit.client.0.smithi134.stdout:8/711: mkdir d2/df/d18/d2a/d41/d59/db1/d87/df2 0 2024-02-16T22:18:58.666 INFO:tasks.workunit.client.0.smithi134.stdout:8/712: chown d2/df/d18/c64 17 1 2024-02-16T22:18:58.667 INFO:tasks.workunit.client.0.smithi134.stdout:9/808: creat db/d20/d22/d46/d115/dec/f11e x:0 0 0 2024-02-16T22:18:58.667 INFO:tasks.workunit.client.0.smithi134.stdout:1/715: getdents d5/d1a/d23/d3c/d6a/d5c/d72 0 2024-02-16T22:18:58.668 INFO:tasks.workunit.client.0.smithi134.stdout:4/585: rmdir d0/d6/d1e 39 2024-02-16T22:18:58.669 INFO:tasks.workunit.client.0.smithi134.stdout:9/809: getdents db/d20/d22/d64/dc2/dcb 0 2024-02-16T22:18:58.669 INFO:tasks.workunit.client.0.smithi134.stdout:4/586: symlink d0/d6/d1e/d9a/lc6 0 2024-02-16T22:18:58.673 INFO:tasks.workunit.client.0.smithi134.stdout:4/587: creat d0/d6/d22/d97/daf/fc7 x:0 0 0 2024-02-16T22:18:58.673 INFO:tasks.workunit.client.0.smithi134.stdout:4/588: chown d0/d6/d44 139641 1 2024-02-16T22:18:58.673 INFO:tasks.workunit.client.0.smithi134.stdout:4/589: write d0/d6/d8/d32/d68/f9c [374731,53485] 0 2024-02-16T22:18:58.673 INFO:tasks.workunit.client.0.smithi134.stdout:4/590: fsync d0/f2 0 2024-02-16T22:18:58.675 INFO:tasks.workunit.client.0.smithi134.stdout:4/591: mkdir d0/d31/db8/d1a/d75/dc8 0 2024-02-16T22:18:58.679 INFO:tasks.workunit.client.0.smithi134.stdout:0/710: dwrite d2/dc/d2d/d34/f61 [0,4194304] 0 2024-02-16T22:18:58.679 INFO:tasks.workunit.client.0.smithi134.stdout:8/713: dread d2/df/d18/d91/fb7 [0,4194304] 0 2024-02-16T22:18:58.679 INFO:tasks.workunit.client.0.smithi134.stdout:5/760: dwrite d2/d9/f6f [0,4194304] 0 2024-02-16T22:18:58.679 INFO:tasks.workunit.client.0.smithi134.stdout:5/761: write d2/d35/d36/d3d/d9c/d4b/f7d [816328,45979] 0 2024-02-16T22:18:58.682 INFO:tasks.workunit.client.0.smithi134.stdout:6/758: dwrite f11 [4194304,4194304] 0 2024-02-16T22:18:58.682 INFO:tasks.workunit.client.0.smithi134.stdout:1/716: dread d5/da/d21/d52/f8b [0,4194304] 0 2024-02-16T22:18:58.682 INFO:tasks.workunit.client.0.smithi134.stdout:1/717: fdatasync d5/d1a/d82/f97 0 2024-02-16T22:18:58.682 INFO:tasks.workunit.client.0.smithi134.stdout:6/759: creat d17/d63/ff7 x:0 0 0 2024-02-16T22:18:58.682 INFO:tasks.workunit.client.0.smithi134.stdout:1/718: stat d5/da/d21/d52/l87 0 2024-02-16T22:18:58.682 INFO:tasks.workunit.client.0.smithi134.stdout:6/760: chown d17/d36/d77/d9a/f25 1 1 2024-02-16T22:18:58.682 INFO:tasks.workunit.client.0.smithi134.stdout:1/719: chown d5/da/d2d/f54 627 1 2024-02-16T22:18:58.682 INFO:tasks.workunit.client.0.smithi134.stdout:0/711: creat d2/dc/d32/fed x:0 0 0 2024-02-16T22:18:58.688 INFO:tasks.workunit.client.0.smithi134.stdout:8/714: symlink d2/df/d18/d2a/d41/d59/da0/d40/d53/dbe/lf3 0 2024-02-16T22:18:58.689 INFO:tasks.workunit.client.0.smithi134.stdout:5/762: mknod d2/d9/dc/d32/dd3/cf8 0 2024-02-16T22:18:58.691 INFO:tasks.workunit.client.0.smithi134.stdout:3/711: dwrite da/f11 [0,4194304] 0 2024-02-16T22:18:58.694 INFO:tasks.workunit.client.0.smithi134.stdout:9/810: dwrite db/d20/f8e [0,4194304] 0 2024-02-16T22:18:58.697 INFO:tasks.workunit.client.0.smithi134.stdout:6/761: mknod d17/d36/d77/d9a/d28/cf8 0 2024-02-16T22:18:58.697 INFO:tasks.workunit.client.0.smithi134.stdout:1/720: creat d5/da/d21/d52/d9b/db3/fee x:0 0 0 2024-02-16T22:18:58.697 INFO:tasks.workunit.client.0.smithi134.stdout:1/721: truncate d5/d1a/d23/d3c/d6a/d5c/d72/f79 532027 0 2024-02-16T22:18:58.699 INFO:tasks.workunit.client.0.smithi134.stdout:8/715: rename d2/df/d18/d2a/d41/d59/da0/l3e to d2/df/d7c/lf4 0 2024-02-16T22:18:58.700 INFO:tasks.workunit.client.0.smithi134.stdout:5/763: creat d2/d9/dc/d32/ff9 x:0 0 0 2024-02-16T22:18:58.702 INFO:tasks.workunit.client.0.smithi134.stdout:4/592: dwrite d0/f77 [4194304,4194304] 0 2024-02-16T22:18:58.705 INFO:tasks.workunit.client.0.smithi134.stdout:8/716: creat d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/dd3/ff5 x:0 0 0 2024-02-16T22:18:58.706 INFO:tasks.workunit.client.0.smithi134.stdout:8/717: chown d2/df 74811941 1 2024-02-16T22:18:58.706 INFO:tasks.workunit.client.0.smithi134.stdout:5/764: creat d2/d9/dc/d32/dd4/ffa x:0 0 0 2024-02-16T22:18:58.707 INFO:tasks.workunit.client.0.smithi134.stdout:8/718: symlink d2/df/d18/d2a/d41/d59/da0/d40/d53/daa/df1/lf6 0 2024-02-16T22:18:58.707 INFO:tasks.workunit.client.0.smithi134.stdout:8/719: creat d2/df/d18/d2a/d41/d59/db1/ff7 x:0 0 0 2024-02-16T22:18:58.707 INFO:tasks.workunit.client.0.smithi134.stdout:8/720: write d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/fb4 [1936639,14264] 0 2024-02-16T22:18:58.707 INFO:tasks.workunit.client.0.smithi134.stdout:8/721: write d2/df/d18/d2a/d41/d59/da0/f93 [576660,114629] 0 2024-02-16T22:18:58.707 INFO:tasks.workunit.client.0.smithi134.stdout:8/722: write d2/df/d18/d2a/d41/d59/da0/d9f/faf [383482,73257] 0 2024-02-16T22:18:58.710 INFO:tasks.workunit.client.0.smithi134.stdout:5/765: creat d2/d35/d36/da1/dbf/ffb x:0 0 0 2024-02-16T22:18:58.712 INFO:tasks.workunit.client.0.smithi134.stdout:8/723: mknod d2/cf8 0 2024-02-16T22:18:58.713 INFO:tasks.workunit.client.0.smithi134.stdout:8/724: dread - d2/df/d18/d27/d85/da4/fcc zero size 2024-02-16T22:18:58.714 INFO:tasks.workunit.client.0.smithi134.stdout:5/766: mkdir d2/d9/dc/d32/d61/dfc 0 2024-02-16T22:18:58.714 INFO:tasks.workunit.client.0.smithi134.stdout:5/767: write d2/d9/dc/f1d [1320955,93961] 0 2024-02-16T22:18:58.714 INFO:tasks.workunit.client.0.smithi134.stdout:5/768: truncate d2/d9/dc/d32/dd4/ffa 146104 0 2024-02-16T22:18:58.715 INFO:tasks.workunit.client.0.smithi134.stdout:5/769: fsync d2/d35/d36/d3d/d9c/d4b/fee 0 2024-02-16T22:18:58.716 INFO:tasks.workunit.client.0.smithi134.stdout:8/725: creat d2/df/d18/d2a/d41/d59/da0/d86/ff9 x:0 0 0 2024-02-16T22:18:58.716 INFO:tasks.workunit.client.0.smithi134.stdout:8/726: write d2/f35 [800481,109757] 0 2024-02-16T22:18:58.718 INFO:tasks.workunit.client.0.smithi134.stdout:5/770: dread d2/d9/dc/d15/f31 [0,4194304] 0 2024-02-16T22:18:58.728 INFO:tasks.workunit.client.0.smithi134.stdout:8/727: dread d2/df/d18/f5 [0,4194304] 0 2024-02-16T22:18:58.729 INFO:tasks.workunit.client.0.smithi134.stdout:8/728: read - d2/df/d18/d12/fb9 zero size 2024-02-16T22:18:58.730 INFO:tasks.workunit.client.0.smithi134.stdout:5/771: write d2/f2b [5693021,26813] 0 2024-02-16T22:18:58.731 INFO:tasks.workunit.client.0.smithi134.stdout:0/712: dwrite d2/d20/d50/f9a [0,4194304] 0 2024-02-16T22:18:58.731 INFO:tasks.workunit.client.0.smithi134.stdout:3/712: dwrite da/d1c/d24/d29/d51/fb4 [0,4194304] 0 2024-02-16T22:18:58.731 INFO:tasks.workunit.client.0.smithi134.stdout:8/729: rename d2/df/d18/d27/f30 to d2/df/d18/d2a/d41/d59/da0/d86/ffa 0 2024-02-16T22:18:58.732 INFO:tasks.workunit.client.0.smithi134.stdout:6/762: dwrite d17/f3a [0,4194304] 0 2024-02-16T22:18:58.734 INFO:tasks.workunit.client.0.smithi134.stdout:0/713: symlink d2/d20/d77/db9/lee 0 2024-02-16T22:18:58.736 INFO:tasks.workunit.client.0.smithi134.stdout:3/713: mknod da/d1c/d24/d2c/cdf 0 2024-02-16T22:18:58.743 INFO:tasks.workunit.client.0.smithi134.stdout:9/811: dwrite db/d20/d22/f25 [0,4194304] 0 2024-02-16T22:18:58.743 INFO:tasks.workunit.client.0.smithi134.stdout:9/812: truncate db/d20/d22/d64/dc2/ff6 623656 0 2024-02-16T22:18:58.743 INFO:tasks.workunit.client.0.smithi134.stdout:9/813: truncate db/d20/d22/d64/dc2/fe1 945084 0 2024-02-16T22:18:58.744 INFO:tasks.workunit.client.0.smithi134.stdout:4/593: dwrite d0/d6/d8/d30/f8f [0,4194304] 0 2024-02-16T22:18:58.762 INFO:tasks.workunit.client.0.smithi134.stdout:8/730: mknod d2/df/d18/d5a/cfb 0 2024-02-16T22:18:58.762 INFO:tasks.workunit.client.0.smithi134.stdout:8/731: creat d2/df/d18/d27/d85/da4/ffc x:0 0 0 2024-02-16T22:18:58.765 INFO:tasks.workunit.client.0.smithi134.stdout:5/772: dwrite d2/d35/d36/da1/dbf/ffb [0,4194304] 0 2024-02-16T22:18:58.766 INFO:tasks.workunit.client.0.smithi134.stdout:3/714: dwrite da/d1c/d24/d9a/dc0/d8a/fa7 [0,4194304] 0 2024-02-16T22:18:58.767 INFO:tasks.workunit.client.0.smithi134.stdout:6/763: mknod d17/d27/d93/d9c/dec/dcb/ddc/cf9 0 2024-02-16T22:18:58.768 INFO:tasks.workunit.client.0.smithi134.stdout:6/764: dread - d17/d27/d93/d9c/dec/dcb/ddc/fed zero size 2024-02-16T22:18:58.769 INFO:tasks.workunit.client.0.smithi134.stdout:9/814: unlink db/d20/d55/d8c/ldf 0 2024-02-16T22:18:58.771 INFO:tasks.workunit.client.0.smithi134.stdout:9/815: dread db/d20/d22/d64/d69/d89/de2/f11b [0,4194304] 0 2024-02-16T22:18:58.772 INFO:tasks.workunit.client.0.smithi134.stdout:6/765: read d17/d63/fb3 [5436281,52948] 0 2024-02-16T22:18:58.773 INFO:tasks.workunit.client.0.smithi134.stdout:6/766: fdatasync f14 0 2024-02-16T22:18:58.774 INFO:tasks.workunit.client.0.smithi134.stdout:4/594: symlink d0/d6/d8/d5e/lc9 0 2024-02-16T22:18:58.777 INFO:tasks.workunit.client.0.smithi134.stdout:4/595: dread d0/d6/d8/d32/d63/d6c/f3e [8388608,4194304] 0 2024-02-16T22:18:58.777 INFO:tasks.workunit.client.0.smithi134.stdout:4/596: getdents d0/d31/db8/d1a/d75/dc8 0 2024-02-16T22:18:58.779 INFO:tasks.workunit.client.0.smithi134.stdout:3/715: dwrite da/d1c/d24/d9a/dc0/d8a/d8f/f3f [0,4194304] 0 2024-02-16T22:18:58.785 INFO:tasks.workunit.client.0.smithi134.stdout:3/716: dread da/d12/f21 [0,4194304] 0 2024-02-16T22:18:58.940 INFO:tasks.workunit.client.0.smithi134.stdout:5/773: rename d2 to d2/d35/d36/da9/dfd 22 2024-02-16T22:18:58.957 INFO:tasks.workunit.client.0.smithi134.stdout:9/816: mkdir db/d20/d55/d107/d11f 0 2024-02-16T22:18:58.958 INFO:tasks.workunit.client.0.smithi134.stdout:6/767: symlink d17/d36/d77/d9a/d28/d5b/de8/lfa 0 2024-02-16T22:18:58.958 INFO:tasks.workunit.client.0.smithi134.stdout:6/768: fsync f14 0 2024-02-16T22:18:58.958 INFO:tasks.workunit.client.0.smithi134.stdout:6/769: chown d17/d36/d77/d9a/d28/d5b/d88/d90/cf0 1052284 1 2024-02-16T22:18:58.964 INFO:tasks.workunit.client.0.smithi134.stdout:9/817: dread db/d20/d22/d46/ff7 [0,4194304] 0 2024-02-16T22:18:58.964 INFO:tasks.workunit.client.0.smithi134.stdout:9/818: chown db/d20/d22/d64/d69/d89/de2/df3 62890552 1 2024-02-16T22:18:58.974 INFO:tasks.workunit.client.0.smithi134.stdout:5/774: unlink d2/d9/l66 0 2024-02-16T22:18:58.975 INFO:tasks.workunit.client.0.smithi134.stdout:6/770: mkdir d17/d27/d93/d9c/ddb/dfb 0 2024-02-16T22:18:58.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:58 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:18:58.977 INFO:tasks.workunit.client.0.smithi134.stdout:3/717: symlink da/d12/d2a/da4/le0 0 2024-02-16T22:18:58.977 INFO:tasks.workunit.client.0.smithi134.stdout:3/718: dread - da/f72 zero size 2024-02-16T22:18:58.977 INFO:tasks.workunit.client.0.smithi134.stdout:9/819: link db/d20/d22/d64/f8d db/d20/d22/d46/f120 0 2024-02-16T22:18:58.979 INFO:tasks.workunit.client.0.smithi134.stdout:5/775: unlink d2/d9/dc/f26 0 2024-02-16T22:18:58.980 INFO:tasks.workunit.client.0.smithi134.stdout:6/771: rmdir d17/d36/d77/d9a/d28/d5b/d88/daf 39 2024-02-16T22:18:58.980 INFO:tasks.workunit.client.0.smithi134.stdout:6/772: creat d17/d27/d30/d32/deb/ffc x:0 0 0 2024-02-16T22:18:58.980 INFO:tasks.workunit.client.0.smithi134.stdout:6/773: readlink d17/d27/d93/d9c/dec/d52/l60 0 2024-02-16T22:18:58.980 INFO:tasks.workunit.client.0.smithi134.stdout:5/776: dread d2/d9/dc/d32/dd4/ffa [0,4194304] 0 2024-02-16T22:18:58.980 INFO:tasks.workunit.client.0.smithi134.stdout:5/777: read - d2/d9/dc6/fc7 zero size 2024-02-16T22:18:58.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:58 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:18:58.981 INFO:tasks.workunit.client.0.smithi134.stdout:9/820: mknod db/d20/d22/d64/d69/d89/de2/c121 0 2024-02-16T22:18:58.984 INFO:tasks.workunit.client.0.smithi134.stdout:9/821: link db/d20/led db/d20/d22/d46/dbe/l122 0 2024-02-16T22:18:58.984 INFO:tasks.workunit.client.0.smithi134.stdout:9/822: stat db/d20/d22/d64/d69/d89/de2/df3/l10f 0 2024-02-16T22:18:58.984 INFO:tasks.workunit.client.0.smithi134.stdout:9/823: chown db/d20/d22/d51/fd7 9 1 2024-02-16T22:18:58.986 INFO:tasks.workunit.client.0.smithi134.stdout:3/719: creat da/d1c/fe1 x:0 0 0 2024-02-16T22:18:58.988 INFO:tasks.workunit.client.0.smithi134.stdout:3/720: rmdir da/d6b 39 2024-02-16T22:18:58.989 INFO:tasks.workunit.client.0.smithi134.stdout:3/721: truncate da/d1c/d24/d29/faf 653976 0 2024-02-16T22:18:58.989 INFO:tasks.workunit.client.0.smithi134.stdout:3/722: dread - da/d1c/d24/d9a/dc0/fce zero size 2024-02-16T22:18:58.989 INFO:tasks.workunit.client.0.smithi134.stdout:3/723: creat da/d1c/fe2 x:0 0 0 2024-02-16T22:18:58.990 INFO:tasks.workunit.client.0.smithi134.stdout:8/732: rmdir d2 39 2024-02-16T22:18:58.990 INFO:tasks.workunit.client.0.smithi134.stdout:8/733: stat d2/df/d18/d12/fef 0 2024-02-16T22:18:58.992 INFO:tasks.workunit.client.0.smithi134.stdout:3/724: mkdir da/d1c/d24/dd5/de3 0 2024-02-16T22:18:58.993 INFO:tasks.workunit.client.0.smithi134.stdout:3/725: fsync da/d1c/d24/f3d 0 2024-02-16T22:18:58.993 INFO:tasks.workunit.client.0.smithi134.stdout:3/726: chown da/d1c/d24/d9a/dc0/d8a/d8f/c2e 369 1 2024-02-16T22:18:58.994 INFO:tasks.workunit.client.0.smithi134.stdout:6/774: rename d17/d36/d77/d9a/d83 to d17/dfd 0 2024-02-16T22:18:58.994 INFO:tasks.workunit.client.0.smithi134.stdout:6/775: dread - d17/d27/d30/ff4 zero size 2024-02-16T22:18:58.994 INFO:tasks.workunit.client.0.smithi134.stdout:6/776: write d17/d27/d93/d9c/dec/f67 [4995547,20991] 0 2024-02-16T22:18:58.995 INFO:tasks.workunit.client.0.smithi134.stdout:3/727: creat da/d12/fe4 x:0 0 0 2024-02-16T22:18:58.995 INFO:tasks.workunit.client.0.smithi134.stdout:3/728: read - da/d12/fe4 zero size 2024-02-16T22:18:58.996 INFO:tasks.workunit.client.0.smithi134.stdout:9/824: rename db/d20/d22/d64/d69/d89/fbf to db/d20/d32/dd8/f123 0 2024-02-16T22:18:58.996 INFO:tasks.workunit.client.0.smithi134.stdout:9/825: getdents db/d20/d22/d51/da2 0 2024-02-16T22:18:58.997 INFO:tasks.workunit.client.0.smithi134.stdout:9/826: write db/d20/d22/d46/d115/dec/ffb [1382972,10351] 0 2024-02-16T22:18:58.997 INFO:tasks.workunit.client.0.smithi134.stdout:9/827: stat db/d20/d22/d51/cc6 0 2024-02-16T22:18:58.998 INFO:tasks.workunit.client.0.smithi134.stdout:6/777: symlink d17/d36/d77/d9a/d28/d5b/d88/d90/lfe 0 2024-02-16T22:18:59.001 INFO:tasks.workunit.client.0.smithi134.stdout:6/778: rmdir d17/d27/d93/d9c/dec/dd4 39 2024-02-16T22:18:59.001 INFO:tasks.workunit.client.0.smithi134.stdout:6/779: chown d17/d27/d93/d9c/de7 24652846 1 2024-02-16T22:18:59.001 INFO:tasks.workunit.client.0.smithi134.stdout:6/780: write d17/dfd/dbc/fbd [1721562,63757] 0 2024-02-16T22:18:59.001 INFO:tasks.workunit.client.0.smithi134.stdout:9/828: dread db/dc/f66 [0,4194304] 0 2024-02-16T22:18:59.002 INFO:tasks.workunit.client.0.smithi134.stdout:9/829: dread - db/d20/d32/dd8/f123 zero size 2024-02-16T22:18:59.002 INFO:tasks.workunit.client.0.smithi134.stdout:6/781: rmdir d17/d27/d30 39 2024-02-16T22:18:59.003 INFO:tasks.workunit.client.0.smithi134.stdout:6/782: symlink d17/d36/d77/d9a/d28/d5b/de8/lff 0 2024-02-16T22:18:59.005 INFO:tasks.workunit.client.0.smithi134.stdout:2/642: sync 2024-02-16T22:18:59.007 INFO:tasks.workunit.client.0.smithi134.stdout:2/643: unlink df/d10/c78 0 2024-02-16T22:18:59.010 INFO:tasks.workunit.client.0.smithi134.stdout:0/714: sync 2024-02-16T22:18:59.010 INFO:tasks.workunit.client.0.smithi134.stdout:4/597: sync 2024-02-16T22:18:59.010 INFO:tasks.workunit.client.0.smithi134.stdout:7/714: sync 2024-02-16T22:18:59.010 INFO:tasks.workunit.client.0.smithi134.stdout:1/722: sync 2024-02-16T22:18:59.010 INFO:tasks.workunit.client.0.smithi134.stdout:1/723: chown d5/d1a/d23/d3c/d6a 282839768 1 2024-02-16T22:18:59.010 INFO:tasks.workunit.client.0.smithi134.stdout:4/598: rename d0 to d0/d6/d8/dca 22 2024-02-16T22:18:59.011 INFO:tasks.workunit.client.0.smithi134.stdout:3/729: symlink da/d1c/d24/d29/le5 0 2024-02-16T22:18:59.012 INFO:tasks.workunit.client.0.smithi134.stdout:9/830: dread db/d20/d22/d51/f74 [0,4194304] 0 2024-02-16T22:18:59.012 INFO:tasks.workunit.client.0.smithi134.stdout:9/831: write db/d20/d32/dd8/fda [515043,84832] 0 2024-02-16T22:18:59.012 INFO:tasks.workunit.client.0.smithi134.stdout:9/832: fdatasync db/dc/f61 0 2024-02-16T22:18:59.012 INFO:tasks.workunit.client.0.smithi134.stdout:9/833: chown db/d20/d22/d51/d9b/fb6 221 1 2024-02-16T22:18:59.012 INFO:tasks.workunit.client.0.smithi134.stdout:9/834: write db/d20/d22/d64/d69/d89/de2/f11b [497268,68423] 0 2024-02-16T22:18:59.012 INFO:tasks.workunit.client.0.smithi134.stdout:9/835: write db/d20/d22/d46/f120 [3119194,64287] 0 2024-02-16T22:18:59.012 INFO:tasks.workunit.client.0.smithi134.stdout:9/836: fsync db/de0/def/ff2 0 2024-02-16T22:18:59.012 INFO:tasks.workunit.client.0.smithi134.stdout:7/715: truncate d2/d5/d19/f44 2761648 0 2024-02-16T22:18:59.013 INFO:tasks.workunit.client.0.smithi134.stdout:0/715: mkdir d2/dc/d32/d3e/da7/dc2/def 0 2024-02-16T22:18:59.018 INFO:tasks.workunit.client.0.smithi134.stdout:4/599: rename d0/d6/d8/l5a to d0/d6/d22/d25/lcb 0 2024-02-16T22:18:59.019 INFO:tasks.workunit.client.0.smithi134.stdout:3/730: mkdir da/d6b/dc1/de6 0 2024-02-16T22:18:59.022 INFO:tasks.workunit.client.0.smithi134.stdout:9/837: mkdir db/d20/d55/d107/d124 0 2024-02-16T22:18:59.024 INFO:tasks.workunit.client.0.smithi134.stdout:7/716: mknod d2/d5/d19/d84/cee 0 2024-02-16T22:18:59.024 INFO:tasks.workunit.client.0.smithi134.stdout:7/717: dread - d2/d6/d7d/d9e/fc9 zero size 2024-02-16T22:18:59.025 INFO:tasks.workunit.client.0.smithi134.stdout:0/716: rmdir d2/d4b 39 2024-02-16T22:18:59.026 INFO:tasks.workunit.client.0.smithi134.stdout:4/600: truncate d0/d6/d1e/d39/f45 251767 0 2024-02-16T22:18:59.029 INFO:tasks.workunit.client.0.smithi134.stdout:9/838: creat db/d20/d22/d64/d69/d6e/d81/f125 x:0 0 0 2024-02-16T22:18:59.031 INFO:tasks.workunit.client.0.smithi134.stdout:6/783: dwrite d17/f51 [0,4194304] 0 2024-02-16T22:18:59.033 INFO:tasks.workunit.client.0.smithi134.stdout:4/601: rename d0/d6/d22/d25/d2a/l7b to d0/d6/d8/lcc 0 2024-02-16T22:18:59.034 INFO:tasks.workunit.client.0.smithi134.stdout:3/731: rmdir da/d1c/d24/d2c/d74 39 2024-02-16T22:18:59.034 INFO:tasks.workunit.client.0.smithi134.stdout:9/839: creat db/d20/d22/f126 x:0 0 0 2024-02-16T22:18:59.034 INFO:tasks.workunit.client.0.smithi134.stdout:9/840: write db/d20/fd2 [1012768,76721] 0 2024-02-16T22:18:59.035 INFO:tasks.workunit.client.0.smithi134.stdout:2/644: dwrite df/d10/d30/f6c [0,4194304] 0 2024-02-16T22:18:59.038 INFO:tasks.workunit.client.0.smithi134.stdout:4/602: dread d0/d6/d22/d25/f3d [0,4194304] 0 2024-02-16T22:18:59.047 INFO:tasks.workunit.client.0.smithi134.stdout:1/724: dwrite d5/da/d21/d52/d9b/db3/fee [0,4194304] 0 2024-02-16T22:18:59.050 INFO:tasks.workunit.client.0.smithi134.stdout:2/645: dread df/d10/d30/d49/f54 [0,4194304] 0 2024-02-16T22:18:59.050 INFO:tasks.workunit.client.0.smithi134.stdout:2/646: fdatasync df/d10/d30/d4d/d94/da3/f72 0 2024-02-16T22:18:59.050 INFO:tasks.workunit.client.0.smithi134.stdout:2/647: truncate df/d10/d30/fac 735161 0 2024-02-16T22:18:59.051 INFO:tasks.workunit.client.0.smithi134.stdout:2/648: unlink df/d6f/l98 0 2024-02-16T22:18:59.053 INFO:tasks.workunit.client.0.smithi134.stdout:2/649: unlink df/d10/d15/d5a/c2a 0 2024-02-16T22:18:59.053 INFO:tasks.workunit.client.0.smithi134.stdout:2/650: chown df/d10/d30/d49/d82/d1b/f22 29755790 1 2024-02-16T22:18:59.053 INFO:tasks.workunit.client.0.smithi134.stdout:2/651: chown df/d10/f9e 15329811 1 2024-02-16T22:18:59.054 INFO:tasks.workunit.client.0.smithi134.stdout:2/652: creat df/d10/d15/d5a/d34/fc0 x:0 0 0 2024-02-16T22:18:59.054 INFO:tasks.workunit.client.0.smithi134.stdout:3/732: write da/d1c/d24/d9a/dc0/d8a/fa7 [4113782,89429] 0 2024-02-16T22:18:59.056 INFO:tasks.workunit.client.0.smithi134.stdout:3/733: rmdir da/d1c/d24/d29/d51/d80/d89/d8e/dbc 39 2024-02-16T22:18:59.057 INFO:tasks.workunit.client.0.smithi134.stdout:3/734: mkdir da/d1c/d24/d29/d51/d80/d89/d8e/de7 0 2024-02-16T22:18:59.058 INFO:tasks.workunit.client.0.smithi134.stdout:3/735: mknod da/d1c/d24/ce8 0 2024-02-16T22:18:59.058 INFO:tasks.workunit.client.0.smithi134.stdout:3/736: chown da/d1c/fe1 303732352 1 2024-02-16T22:18:59.058 INFO:tasks.workunit.client.0.smithi134.stdout:3/737: fdatasync da/d12/d2a/fbf 0 2024-02-16T22:18:59.059 INFO:tasks.workunit.client.0.smithi134.stdout:3/738: creat da/d6b/dc1/fe9 x:0 0 0 2024-02-16T22:18:59.060 INFO:tasks.workunit.client.0.smithi134.stdout:3/739: chown da/d12/d2a/l69 356 1 2024-02-16T22:18:59.060 INFO:tasks.workunit.client.0.smithi134.stdout:2/653: dread df/d10/d30/d49/d82/d1b/f22 [0,4194304] 0 2024-02-16T22:18:59.060 INFO:tasks.workunit.client.0.smithi134.stdout:2/654: chown df/d10/d30/f77 195705153 1 2024-02-16T22:18:59.064 INFO:tasks.workunit.client.0.smithi134.stdout:0/717: dwrite d2/dc/d48/f75 [0,4194304] 0 2024-02-16T22:18:59.064 INFO:tasks.workunit.client.0.smithi134.stdout:6/784: dwrite d17/d36/d77/d9a/d28/fae [0,4194304] 0 2024-02-16T22:18:59.064 INFO:tasks.workunit.client.0.smithi134.stdout:7/718: dwrite d2/d5/d19/d4a/fd3 [0,4194304] 0 2024-02-16T22:18:59.067 INFO:tasks.workunit.client.0.smithi134.stdout:9/841: dwrite db/dc/fcf [0,4194304] 0 2024-02-16T22:18:59.071 INFO:tasks.workunit.client.0.smithi134.stdout:0/718: rename d2/dc/da0/fe6 to d2/d20/ff0 0 2024-02-16T22:18:59.077 INFO:tasks.workunit.client.0.smithi134.stdout:6/785: creat d17/dfd/de2/f100 x:0 0 0 2024-02-16T22:18:59.077 INFO:tasks.workunit.client.0.smithi134.stdout:6/786: chown d17/d36/d77/d9a/d28/la8 110 1 2024-02-16T22:18:59.078 INFO:tasks.workunit.client.0.smithi134.stdout:7/719: mknod d2/d5/d22/d83/dce/cef 0 2024-02-16T22:18:59.082 INFO:tasks.workunit.client.0.smithi134.stdout:9/842: link db/d20/d32/dd8/d10a/f119 db/d20/d22/d64/d69/d89/f127 0 2024-02-16T22:18:59.083 INFO:tasks.workunit.client.0.smithi134.stdout:2/655: dwrite df/d10/d30/d49/f54 [0,4194304] 0 2024-02-16T22:18:59.083 INFO:tasks.workunit.client.0.smithi134.stdout:3/740: dwrite da/d1c/d24/f52 [0,4194304] 0 2024-02-16T22:18:59.084 INFO:tasks.workunit.client.0.smithi134.stdout:0/719: link d2/dc/d48/f75 d2/d20/d7a/ff1 0 2024-02-16T22:18:59.086 INFO:tasks.workunit.client.0.smithi134.stdout:6/787: creat d17/d27/d93/d9c/dec/d52/d87/f101 x:0 0 0 2024-02-16T22:18:59.088 INFO:tasks.workunit.client.0.smithi134.stdout:9/843: creat db/d20/d55/d107/d11f/f128 x:0 0 0 2024-02-16T22:18:59.091 INFO:tasks.workunit.client.0.smithi134.stdout:2/656: creat df/d10/d30/d49/d85/d9b/fc1 x:0 0 0 2024-02-16T22:18:59.095 INFO:tasks.workunit.client.0.smithi134.stdout:3/741: creat da/d1c/d24/d29/d51/d80/d89/d8e/fea x:0 0 0 2024-02-16T22:18:59.098 INFO:tasks.workunit.client.0.smithi134.stdout:7/720: dwrite d2/d5/d19/f1d [0,4194304] 0 2024-02-16T22:18:59.098 INFO:tasks.workunit.client.0.smithi134.stdout:6/788: rename d17/d36/f6f to d17/d36/dd0/f102 0 2024-02-16T22:18:59.100 INFO:tasks.workunit.client.0.smithi134.stdout:3/742: mkdir da/d6b/deb 0 2024-02-16T22:18:59.100 INFO:tasks.workunit.client.0.smithi134.stdout:3/743: stat da/d1c/d24/d9a/dc0/d8a/d8f/c2e 0 2024-02-16T22:18:59.100 INFO:tasks.workunit.client.0.smithi134.stdout:3/744: write da/d1c/d24/d9a/dc0/fce [653966,22405] 0 2024-02-16T22:18:59.169 INFO:tasks.workunit.client.0.smithi134.stdout:7/721: symlink d2/d6/d91/db3/lf0 0 2024-02-16T22:18:59.170 INFO:tasks.workunit.client.0.smithi134.stdout:9/844: dwrite f2 [0,4194304] 0 2024-02-16T22:18:59.171 INFO:tasks.workunit.client.0.smithi134.stdout:2/657: link df/d10/d15/d5a/d34/fc0 df/d10/d30/d49/d82/fc2 0 2024-02-16T22:18:59.171 INFO:tasks.workunit.client.0.smithi134.stdout:2/658: chown df/d41/f80 4 1 2024-02-16T22:18:59.172 INFO:tasks.workunit.client.0.smithi134.stdout:9/845: dread db/d20/d32/dd8/fda [0,4194304] 0 2024-02-16T22:18:59.172 INFO:tasks.workunit.client.0.smithi134.stdout:0/720: dwrite d2/dc/f1d [4194304,4194304] 0 2024-02-16T22:18:59.172 INFO:tasks.workunit.client.0.smithi134.stdout:3/745: mknod da/d1c/d24/d29/d51/d80/cec 0 2024-02-16T22:18:59.175 INFO:tasks.workunit.client.0.smithi134.stdout:9/846: mknod db/d20/d22/d51/d9b/dbd/c129 0 2024-02-16T22:18:59.176 INFO:tasks.workunit.client.0.smithi134.stdout:6/789: dwrite d17/d36/f7a [0,4194304] 0 2024-02-16T22:18:59.177 INFO:tasks.workunit.client.0.smithi134.stdout:0/721: unlink d2/dc/d32/d3e/c92 0 2024-02-16T22:18:59.177 INFO:tasks.workunit.client.0.smithi134.stdout:0/722: chown d2/dc/f44 23 1 2024-02-16T22:18:59.179 INFO:tasks.workunit.client.0.smithi134.stdout:3/746: mknod da/d1c/d24/d29/d51/d79/ced 0 2024-02-16T22:18:59.180 INFO:tasks.workunit.client.0.smithi134.stdout:9/847: symlink db/d20/d32/l12a 0 2024-02-16T22:18:59.181 INFO:tasks.workunit.client.0.smithi134.stdout:2/659: dread df/d10/d30/d49/d82/d1b/f8b [0,4194304] 0 2024-02-16T22:18:59.185 INFO:tasks.workunit.client.0.smithi134.stdout:6/790: mkdir d17/d36/d77/d9a/d28/d5b/d103 0 2024-02-16T22:18:59.185 INFO:tasks.workunit.client.0.smithi134.stdout:2/660: dread df/d10/d30/d49/d82/d1b/f22 [0,4194304] 0 2024-02-16T22:18:59.185 INFO:tasks.workunit.client.0.smithi134.stdout:2/661: creat df/d10/d30/d49/d82/d1b/fc3 x:0 0 0 2024-02-16T22:18:59.187 INFO:tasks.workunit.client.0.smithi134.stdout:0/723: link d2/dc/d32/d3e/f69 d2/d20/d77/db9/ff2 0 2024-02-16T22:18:59.189 INFO:tasks.workunit.client.0.smithi134.stdout:3/747: symlink da/d1c/d24/dd5/de3/lee 0 2024-02-16T22:18:59.190 INFO:tasks.workunit.client.0.smithi134.stdout:9/848: creat db/d20/d55/d107/d124/f12b x:0 0 0 2024-02-16T22:18:59.191 INFO:tasks.workunit.client.0.smithi134.stdout:9/849: creat db/d20/d22/d46/d115/dec/f12c x:0 0 0 2024-02-16T22:18:59.194 INFO:tasks.workunit.client.0.smithi134.stdout:2/662: mknod df/d10/d30/da2/cc4 0 2024-02-16T22:18:59.194 INFO:tasks.workunit.client.0.smithi134.stdout:0/724: dread d2/f4e [0,4194304] 0 2024-02-16T22:18:59.196 INFO:tasks.workunit.client.0.smithi134.stdout:3/748: truncate da/d1c/d24/f4a 4182106 0 2024-02-16T22:18:59.196 INFO:tasks.workunit.client.0.smithi134.stdout:3/749: creat da/d1c/d24/d9a/dc0/d8a/fef x:0 0 0 2024-02-16T22:18:59.199 INFO:tasks.workunit.client.0.smithi134.stdout:9/850: mknod db/d20/d55/d107/d113/c12d 0 2024-02-16T22:18:59.199 INFO:tasks.workunit.client.0.smithi134.stdout:9/851: readlink db/d20/d22/d64/d69/lb4 0 2024-02-16T22:18:59.203 INFO:tasks.workunit.client.0.smithi134.stdout:9/852: mkdir db/de0/d12e 0 2024-02-16T22:18:59.207 INFO:tasks.workunit.client.0.smithi134.stdout:9/853: rmdir db/d20/d22/d64/d69/d6e/d110 0 2024-02-16T22:18:59.211 INFO:tasks.workunit.client.0.smithi134.stdout:6/791: dwrite d17/d36/d77/d9a/f7e [4194304,4194304] 0 2024-02-16T22:18:59.212 INFO:tasks.workunit.client.0.smithi134.stdout:6/792: read d17/d36/d77/d9a/d70/f7d [782344,22182] 0 2024-02-16T22:18:59.213 INFO:tasks.workunit.client.0.smithi134.stdout:9/854: dread db/d20/d22/f50 [0,4194304] 0 2024-02-16T22:18:59.213 INFO:tasks.workunit.client.0.smithi134.stdout:9/855: write db/d20/d22/d46/fb3 [253787,38212] 0 2024-02-16T22:18:59.214 INFO:tasks.workunit.client.0.smithi134.stdout:9/856: chown db/d20/d55/c71 61 1 2024-02-16T22:18:59.215 INFO:tasks.workunit.client.0.smithi134.stdout:6/793: mkdir d17/d27/d93/d9c/de7/d104 0 2024-02-16T22:18:59.216 INFO:tasks.workunit.client.0.smithi134.stdout:2/663: dwrite df/f51 [4194304,4194304] 0 2024-02-16T22:18:59.217 INFO:tasks.workunit.client.0.smithi134.stdout:2/664: dread - df/d41/f80 zero size 2024-02-16T22:18:59.217 INFO:tasks.workunit.client.0.smithi134.stdout:9/857: mkdir db/d20/d22/d64/dc2/d12f 0 2024-02-16T22:18:59.217 INFO:tasks.workunit.client.0.smithi134.stdout:9/858: creat db/d20/f130 x:0 0 0 2024-02-16T22:18:59.219 INFO:tasks.workunit.client.0.smithi134.stdout:0/725: dwrite d2/dc/d2d/f54 [4194304,4194304] 0 2024-02-16T22:18:59.219 INFO:tasks.workunit.client.0.smithi134.stdout:0/726: readlink d2/d20/lc5 0 2024-02-16T22:18:59.221 INFO:tasks.workunit.client.0.smithi134.stdout:2/665: rename df/d10/d15/d90/f9f to df/d10/d3a/fc5 0 2024-02-16T22:18:59.223 INFO:tasks.workunit.client.0.smithi134.stdout:9/859: symlink db/d20/d22/d46/d118/l131 0 2024-02-16T22:18:59.225 INFO:tasks.workunit.client.0.smithi134.stdout:2/666: truncate df/d10/d30/d49/f57 575863 0 2024-02-16T22:18:59.226 INFO:tasks.workunit.client.0.smithi134.stdout:6/794: write d17/d27/d93/f9e [2670377,52485] 0 2024-02-16T22:18:59.226 INFO:tasks.workunit.client.0.smithi134.stdout:6/795: chown d17/d27/d93/d9c/dec/f59 878394 1 2024-02-16T22:18:59.226 INFO:tasks.workunit.client.0.smithi134.stdout:6/796: truncate d17/d27/d30/d32/deb/ffc 357728 0 2024-02-16T22:18:59.227 INFO:tasks.workunit.client.0.smithi134.stdout:9/860: mknod db/d20/d9a/c132 0 2024-02-16T22:18:59.227 INFO:tasks.workunit.client.0.smithi134.stdout:0/727: getdents d2/dc/da0 0 2024-02-16T22:18:59.227 INFO:tasks.workunit.client.0.smithi134.stdout:0/728: stat d2/dc/d97/cca 0 2024-02-16T22:18:59.227 INFO:tasks.workunit.client.0.smithi134.stdout:0/729: fsync d2/dc/d2d/d34/d87/fd7 0 2024-02-16T22:18:59.228 INFO:tasks.workunit.client.0.smithi134.stdout:6/797: creat d17/d27/d93/d9c/dec/dd4/f105 x:0 0 0 2024-02-16T22:18:59.229 INFO:tasks.workunit.client.0.smithi134.stdout:0/730: mkdir d2/dc/d97/df3 0 2024-02-16T22:18:59.229 INFO:tasks.workunit.client.0.smithi134.stdout:0/731: truncate d2/d20/d50/f9a 5109408 0 2024-02-16T22:18:59.229 INFO:tasks.workunit.client.0.smithi134.stdout:0/732: fdatasync d2/d20/d7a/ff1 0 2024-02-16T22:18:59.230 INFO:tasks.workunit.client.0.smithi134.stdout:0/733: chown d2/d20/d7a/l9f 691128 1 2024-02-16T22:18:59.230 INFO:tasks.workunit.client.0.smithi134.stdout:3/750: write da/d12/f21 [511092,115043] 0 2024-02-16T22:18:59.231 INFO:tasks.workunit.client.0.smithi134.stdout:0/734: creat d2/dc/d32/d3e/da7/ff4 x:0 0 0 2024-02-16T22:18:59.232 INFO:tasks.workunit.client.0.smithi134.stdout:0/735: creat d2/dc/ff5 x:0 0 0 2024-02-16T22:18:59.232 INFO:tasks.workunit.client.0.smithi134.stdout:0/736: stat d2/d20/d7a/f86 0 2024-02-16T22:18:59.236 INFO:tasks.workunit.client.0.smithi134.stdout:2/667: write df/d10/d15/f16 [1831080,50595] 0 2024-02-16T22:18:59.236 INFO:tasks.workunit.client.0.smithi134.stdout:0/737: mknod d2/dc/da0/cf6 0 2024-02-16T22:18:59.239 INFO:tasks.workunit.client.0.smithi134.stdout:2/668: link df/d10/d30/fac df/d10/da6/fc6 0 2024-02-16T22:18:59.241 INFO:tasks.workunit.client.0.smithi134.stdout:0/738: creat d2/d20/d7a/d7e/ff7 x:0 0 0 2024-02-16T22:18:59.241 INFO:tasks.workunit.client.0.smithi134.stdout:0/739: readlink d2/dc/d32/d3e/d5e/la5 0 2024-02-16T22:18:59.241 INFO:tasks.workunit.client.0.smithi134.stdout:0/740: fsync d2/dc/d32/d3e/f47 0 2024-02-16T22:18:59.244 INFO:tasks.workunit.client.0.smithi134.stdout:2/669: rename df/d10/d15/f16 to df/d10/d30/d49/d82/d7a/fc7 0 2024-02-16T22:18:59.245 INFO:tasks.workunit.client.0.smithi134.stdout:0/741: creat d2/dc/ff8 x:0 0 0 2024-02-16T22:18:59.245 INFO:tasks.workunit.client.0.smithi134.stdout:0/742: chown d2/dc/d32/d3e/f80 211135 1 2024-02-16T22:18:59.245 INFO:tasks.workunit.client.0.smithi134.stdout:3/751: dread da/d1c/d24/f4a [0,4194304] 0 2024-02-16T22:18:59.247 INFO:tasks.workunit.client.0.smithi134.stdout:2/670: truncate df/d10/f5d 1342812 0 2024-02-16T22:18:59.249 INFO:tasks.workunit.client.0.smithi134.stdout:0/743: creat d2/dc/d32/d45/ddd/ff9 x:0 0 0 2024-02-16T22:18:59.252 INFO:tasks.workunit.client.0.smithi134.stdout:0/744: unlink d2/dc/c9d 0 2024-02-16T22:18:59.252 INFO:tasks.workunit.client.0.smithi134.stdout:6/798: dwrite d17/d27/d30/d32/deb/ff2 [0,4194304] 0 2024-02-16T22:18:59.253 INFO:tasks.workunit.client.0.smithi134.stdout:9/861: dwrite db/d20/f8e [0,4194304] 0 2024-02-16T22:18:59.253 INFO:tasks.workunit.client.0.smithi134.stdout:9/862: fsync db/d20/d22/d51/fc9 0 2024-02-16T22:18:59.254 INFO:tasks.workunit.client.0.smithi134.stdout:6/799: creat d17/dfd/dbc/f106 x:0 0 0 2024-02-16T22:18:59.259 INFO:tasks.workunit.client.0.smithi134.stdout:9/863: mknod db/d20/d22/d64/c133 0 2024-02-16T22:18:59.259 INFO:tasks.workunit.client.0.smithi134.stdout:9/864: chown db/d20/led 365239337 1 2024-02-16T22:18:59.261 INFO:tasks.workunit.client.0.smithi134.stdout:6/800: symlink d17/d27/d93/d9c/ddb/l107 0 2024-02-16T22:18:59.265 INFO:tasks.workunit.client.0.smithi134.stdout:2/671: dwrite df/d10/d30/d49/d82/d1b/f2f [0,4194304] 0 2024-02-16T22:18:59.265 INFO:tasks.workunit.client.0.smithi134.stdout:2/672: creat df/d41/fc8 x:0 0 0 2024-02-16T22:18:59.266 INFO:tasks.workunit.client.0.smithi134.stdout:2/673: read df/d10/d30/d4d/d94/da3/f63 [129361,118774] 0 2024-02-16T22:18:59.266 INFO:tasks.workunit.client.0.smithi134.stdout:2/674: stat df/d10/d15/d5a/f8c 0 2024-02-16T22:18:59.277 INFO:tasks.workunit.client.0.smithi134.stdout:6/801: write d17/d36/d77/d9a/f29 [2089345,89052] 0 2024-02-16T22:18:59.278 INFO:tasks.workunit.client.0.smithi134.stdout:6/802: stat d17/d36/l40 0 2024-02-16T22:18:59.278 INFO:tasks.workunit.client.0.smithi134.stdout:9/865: dwrite db/d20/d22/d64/dc2/fe1 [0,4194304] 0 2024-02-16T22:18:59.278 INFO:tasks.workunit.client.0.smithi134.stdout:6/803: chown d17/d27/d30/d32 1820144269 1 2024-02-16T22:18:59.278 INFO:tasks.workunit.client.0.smithi134.stdout:9/866: chown db/d20/d22/l53 1492 1 2024-02-16T22:18:59.278 INFO:tasks.workunit.client.0.smithi134.stdout:9/867: truncate db/d20/d22/d46/f5c 1966770 0 2024-02-16T22:18:59.278 INFO:tasks.workunit.client.0.smithi134.stdout:6/804: creat d17/d36/d77/d9a/d73/f108 x:0 0 0 2024-02-16T22:18:59.280 INFO:tasks.workunit.client.0.smithi134.stdout:9/868: mknod db/d20/d55/d107/c134 0 2024-02-16T22:18:59.281 INFO:tasks.workunit.client.0.smithi134.stdout:6/805: mknod d17/d27/d93/d9c/dec/c109 0 2024-02-16T22:18:59.282 INFO:tasks.workunit.client.0.smithi134.stdout:9/869: mknod db/de0/d12e/c135 0 2024-02-16T22:18:59.282 INFO:tasks.workunit.client.0.smithi134.stdout:9/870: chown db/d20/d55/d8c 431676 1 2024-02-16T22:18:59.283 INFO:tasks.workunit.client.0.smithi134.stdout:9/871: chown db/d20/d22/d46/f49 129 1 2024-02-16T22:18:59.283 INFO:tasks.workunit.client.0.smithi134.stdout:9/872: read db/d20/d22/d46/f120 [137344,94890] 0 2024-02-16T22:18:59.283 INFO:tasks.workunit.client.0.smithi134.stdout:9/873: dread - db/dc/f24 zero size 2024-02-16T22:18:59.283 INFO:tasks.workunit.client.0.smithi134.stdout:9/874: dread - db/d20/d22/d46/d115/dec/f12c zero size 2024-02-16T22:18:59.283 INFO:tasks.workunit.client.0.smithi134.stdout:9/875: fsync db/d20/d22/d46/d115/dec/f11e 0 2024-02-16T22:18:59.283 INFO:tasks.workunit.client.0.smithi134.stdout:9/876: dread - db/d20/d22/d51/fad zero size 2024-02-16T22:18:59.283 INFO:tasks.workunit.client.0.smithi134.stdout:6/806: unlink d17/d36/d77/d9a/d28/fad 0 2024-02-16T22:18:59.284 INFO:tasks.workunit.client.0.smithi134.stdout:9/877: creat db/d20/d22/d64/d69/d6e/f136 x:0 0 0 2024-02-16T22:18:59.294 INFO:tasks.workunit.client.0.smithi134.stdout:6/807: write d17/d36/d77/d9a/f7e [6065351,98516] 0 2024-02-16T22:18:59.294 INFO:tasks.workunit.client.0.smithi134.stdout:6/808: chown d17/d27/d93/d9c/dec/dd4/f105 24055 1 2024-02-16T22:18:59.294 INFO:tasks.workunit.client.0.smithi134.stdout:6/809: fdatasync d17/d36/d77/d9a/d28/f96 0 2024-02-16T22:18:59.294 INFO:tasks.workunit.client.0.smithi134.stdout:4/603: sync 2024-02-16T22:18:59.294 INFO:tasks.workunit.client.0.smithi134.stdout:5/778: sync 2024-02-16T22:18:59.294 INFO:tasks.workunit.client.0.smithi134.stdout:8/734: sync 2024-02-16T22:18:59.295 INFO:tasks.workunit.client.0.smithi134.stdout:1/725: sync 2024-02-16T22:18:59.295 INFO:tasks.workunit.client.0.smithi134.stdout:1/726: write d5/d1a/d23/d8c/fc7 [952801,8228] 0 2024-02-16T22:18:59.295 INFO:tasks.workunit.client.0.smithi134.stdout:4/604: write d0/d6/d8/d30/fbe [762890,38459] 0 2024-02-16T22:18:59.295 INFO:tasks.workunit.client.0.smithi134.stdout:5/779: write d2/d35/d36/d3d/d9c/fe3 [253029,110525] 0 2024-02-16T22:18:59.295 INFO:tasks.workunit.client.0.smithi134.stdout:1/727: write d5/d1a/d53/d86/f9a [136935,43313] 0 2024-02-16T22:18:59.295 INFO:tasks.workunit.client.0.smithi134.stdout:1/728: write d5/da/db8/fe9 [796206,29501] 0 2024-02-16T22:18:59.295 INFO:tasks.workunit.client.0.smithi134.stdout:1/729: chown d5/d1a/d23/d3c/d6a/d5c/fa3 36559 1 2024-02-16T22:18:59.296 INFO:tasks.workunit.client.0.smithi134.stdout:6/810: mknod d17/d36/c10a 0 2024-02-16T22:18:59.297 INFO:tasks.workunit.client.0.smithi134.stdout:8/735: creat d2/df/d18/d91/ffd x:0 0 0 2024-02-16T22:18:59.298 INFO:tasks.workunit.client.0.smithi134.stdout:6/811: mkdir d17/d36/d77/d9a/d28/d5b/d88/daf/d10b 0 2024-02-16T22:18:59.299 INFO:tasks.workunit.client.0.smithi134.stdout:8/736: symlink d2/df/d18/d2a/d41/lfe 0 2024-02-16T22:18:59.300 INFO:tasks.workunit.client.0.smithi134.stdout:6/812: creat d17/d27/d93/d9c/dec/dcb/f10c x:0 0 0 2024-02-16T22:18:59.300 INFO:tasks.workunit.client.0.smithi134.stdout:6/813: getdents d17/d36/d77/d9a 0 2024-02-16T22:18:59.303 INFO:tasks.workunit.client.0.smithi134.stdout:1/730: fsync d5/d1a/d53/d86/f9a 0 2024-02-16T22:18:59.303 INFO:tasks.workunit.client.0.smithi134.stdout:6/814: creat d17/d36/f10d x:0 0 0 2024-02-16T22:18:59.305 INFO:tasks.workunit.client.0.smithi134.stdout:9/878: dwrite db/dc/fcf [4194304,4194304] 0 2024-02-16T22:18:59.305 INFO:tasks.workunit.client.0.smithi134.stdout:9/879: chown db/d20/d22/d51/fc9 58760 1 2024-02-16T22:18:59.305 INFO:tasks.workunit.client.0.smithi134.stdout:1/731: truncate f3 2817445 0 2024-02-16T22:18:59.306 INFO:tasks.workunit.client.0.smithi134.stdout:6/815: mkdir d17/d27/d93/d9c/dec/d52/d79/d92/de6/d10e 0 2024-02-16T22:18:59.306 INFO:tasks.workunit.client.0.smithi134.stdout:6/816: write d17/d36/d77/d9a/d28/d5b/d88/dd8/fda [4362207,127901] 0 2024-02-16T22:18:59.309 INFO:tasks.workunit.client.0.smithi134.stdout:9/880: mknod db/d20/d22/d51/d9b/c137 0 2024-02-16T22:18:59.313 INFO:tasks.workunit.client.0.smithi134.stdout:6/817: rename d17/l1e to d17/d36/dd0/l10f 0 2024-02-16T22:18:59.314 INFO:tasks.workunit.client.0.smithi134.stdout:9/881: symlink db/d20/d22/d64/d69/d6e/l138 0 2024-02-16T22:18:59.314 INFO:tasks.workunit.client.0.smithi134.stdout:9/882: creat db/d20/d22/d46/d8f/f139 x:0 0 0 2024-02-16T22:18:59.318 INFO:tasks.workunit.client.0.smithi134.stdout:9/883: dread db/d20/d22/d51/f65 [0,4194304] 0 2024-02-16T22:18:59.321 INFO:tasks.workunit.client.0.smithi134.stdout:9/884: link db/d20/d32/c3b db/d20/d22/d51/da2/c13a 0 2024-02-16T22:18:59.329 INFO:tasks.workunit.client.0.smithi134.stdout:6/818: dwrite d17/f76 [0,4194304] 0 2024-02-16T22:18:59.332 INFO:tasks.workunit.client.0.smithi134.stdout:5/780: dwrite d2/d9/dc/d32/d61/fe7 [0,4194304] 0 2024-02-16T22:18:59.338 INFO:tasks.workunit.client.0.smithi134.stdout:5/781: mkdir d2/dfe 0 2024-02-16T22:18:59.338 INFO:tasks.workunit.client.0.smithi134.stdout:5/782: fsync d2/d35/d36/d3d/d9c/d4b/fee 0 2024-02-16T22:18:59.338 INFO:tasks.workunit.client.0.smithi134.stdout:5/783: chown d2/d9/dc/daf/fd0 379548 1 2024-02-16T22:18:59.339 INFO:tasks.workunit.client.0.smithi134.stdout:9/885: rename db/d20/d22/d64/d69/d6e to db/d20/d22/d51/d9b/dbd/de9/d13b 0 2024-02-16T22:18:59.342 INFO:tasks.workunit.client.0.smithi134.stdout:9/886: unlink db/d20/d22/d64/f117 0 2024-02-16T22:18:59.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/784: rename d2/d9/dc/d32/dd4 to d2/d9/dc/df7/dff 0 2024-02-16T22:18:59.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/785: write d2/d35/d36/d3d/d63/f70 [1206025,80198] 0 2024-02-16T22:18:59.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/786: write d2/d9/dc/d15/d2f/fbb [4439222,126409] 0 2024-02-16T22:18:59.345 INFO:tasks.workunit.client.0.smithi134.stdout:5/787: unlink d2/d35/d36/d3d/f8b 0 2024-02-16T22:18:59.345 INFO:tasks.workunit.client.0.smithi134.stdout:9/887: dread db/d20/d55/f97 [0,4194304] 0 2024-02-16T22:18:59.346 INFO:tasks.workunit.client.0.smithi134.stdout:9/888: mknod db/d20/d55/d8c/c13c 0 2024-02-16T22:18:59.347 INFO:tasks.workunit.client.0.smithi134.stdout:9/889: symlink db/d20/d22/d64/dc2/dcb/l13d 0 2024-02-16T22:18:59.348 INFO:tasks.workunit.client.0.smithi134.stdout:9/890: read - db/d20/d22/d91/d99/faa zero size 2024-02-16T22:18:59.348 INFO:tasks.workunit.client.0.smithi134.stdout:9/891: write db/dc/f68 [847574,22019] 0 2024-02-16T22:18:59.348 INFO:tasks.workunit.client.0.smithi134.stdout:9/892: stat db/dc/l85 0 2024-02-16T22:18:59.348 INFO:tasks.workunit.client.0.smithi134.stdout:9/893: write db/dc/f68 [1650754,82554] 0 2024-02-16T22:18:59.348 INFO:tasks.workunit.client.0.smithi134.stdout:9/894: fsync db/d20/d55/d107/d11f/f128 0 2024-02-16T22:18:59.348 INFO:tasks.workunit.client.0.smithi134.stdout:6/819: dwrite d17/d36/d77/d9a/f4b [0,4194304] 0 2024-02-16T22:18:59.348 INFO:tasks.workunit.client.0.smithi134.stdout:9/895: creat db/d20/d22/d51/d9b/dbd/de9/f13e x:0 0 0 2024-02-16T22:18:59.351 INFO:tasks.workunit.client.0.smithi134.stdout:7/722: sync 2024-02-16T22:18:59.353 INFO:tasks.workunit.client.0.smithi134.stdout:7/723: mkdir d2/d5/d19/d84/d86/d93/dab/d40/df1 0 2024-02-16T22:18:59.353 INFO:tasks.workunit.client.0.smithi134.stdout:7/724: symlink d2/d6/d7d/d92/dcd/d7f/lf2 0 2024-02-16T22:18:59.355 INFO:tasks.workunit.client.0.smithi134.stdout:5/788: dread d2/d9/dc/d15/f41 [0,4194304] 0 2024-02-16T22:18:59.380 INFO:tasks.workunit.client.0.smithi134.stdout:6/820: dwrite d17/d27/d93/d9c/dec/d52/d87/fab [0,4194304] 0 2024-02-16T22:18:59.380 INFO:tasks.workunit.client.0.smithi134.stdout:6/821: chown d17/d27/d93/d9c/dec/d52/fc3 103468416 1 2024-02-16T22:18:59.380 INFO:tasks.workunit.client.0.smithi134.stdout:9/896: dwrite db/dc/f15 [4194304,4194304] 0 2024-02-16T22:18:59.380 INFO:tasks.workunit.client.0.smithi134.stdout:9/897: fsync db/d20/d55/d107/d124/f12b 0 2024-02-16T22:18:59.381 INFO:tasks.workunit.client.0.smithi134.stdout:7/725: dwrite d2/d5/d22/d83/f9c [0,4194304] 0 2024-02-16T22:18:59.381 INFO:tasks.workunit.client.0.smithi134.stdout:7/726: fdatasync d2/d6/d7d/d92/da5/f53 0 2024-02-16T22:18:59.382 INFO:tasks.workunit.client.0.smithi134.stdout:7/727: write d2/d6/d7d/d92/dcd/fb6 [2009975,6813] 0 2024-02-16T22:18:59.382 INFO:tasks.workunit.client.0.smithi134.stdout:7/728: chown d2/d6/d17/d31/l42 497893 1 2024-02-16T22:18:59.382 INFO:tasks.workunit.client.0.smithi134.stdout:7/729: stat d2/d5/d19/d84/d86/d93/dab/d40/fe6 0 2024-02-16T22:18:59.383 INFO:tasks.workunit.client.0.smithi134.stdout:7/730: mkdir d2/d6/d91/db3/de0/df3 0 2024-02-16T22:18:59.383 INFO:tasks.workunit.client.0.smithi134.stdout:7/731: stat d2/d6/d7d 0 2024-02-16T22:18:59.384 INFO:tasks.workunit.client.0.smithi134.stdout:6/822: dread f10 [0,4194304] 0 2024-02-16T22:18:59.384 INFO:tasks.workunit.client.0.smithi134.stdout:7/732: symlink d2/d5/d19/d4a/d9d/lf4 0 2024-02-16T22:18:59.384 INFO:tasks.workunit.client.0.smithi134.stdout:7/733: write d2/d6/d7d/d92/da5/d63/f72 [915230,108669] 0 2024-02-16T22:18:59.384 INFO:tasks.workunit.client.0.smithi134.stdout:7/734: write d2/d6/d7d/d92/dcd/d7f/d24/fb8 [323431,80768] 0 2024-02-16T22:18:59.384 INFO:tasks.workunit.client.0.smithi134.stdout:7/735: stat d2/d5/d19/d84/d86/c97 0 2024-02-16T22:18:59.385 INFO:tasks.workunit.client.0.smithi134.stdout:6/823: rename d17/d27/d93/d9c/dec/d52/d79/cd2 to d17/d27/d93/d9c/dec/d52/d79/d8b/c110 0 2024-02-16T22:18:59.385 INFO:tasks.workunit.client.0.smithi134.stdout:6/824: readlink d17/d27/d93/d9c/dec/d52/d79/d92/lf3 0 2024-02-16T22:18:59.391 INFO:tasks.workunit.client.0.smithi134.stdout:9/898: write db/de0/def/ff2 [1117036,111666] 0 2024-02-16T22:18:59.432 INFO:tasks.workunit.client.0.smithi134.stdout:7/736: rename d2/d6/d91/db3/de0/df3 to d2/d5/d4c/df5 0 2024-02-16T22:18:59.432 INFO:tasks.workunit.client.0.smithi134.stdout:7/737: chown d2/d6/d17/f14 189713 1 2024-02-16T22:18:59.439 INFO:tasks.workunit.client.0.smithi134.stdout:6/825: rename d17/f76 to d17/d27/d93/d9c/dec/d52/d87/f111 0 2024-02-16T22:18:59.439 INFO:tasks.workunit.client.0.smithi134.stdout:6/826: getdents d17/d36/d77 0 2024-02-16T22:18:59.439 INFO:tasks.workunit.client.0.smithi134.stdout:6/827: fsync d17/d27/d93/d9c/dec/dcb/f10c 0 2024-02-16T22:18:59.440 INFO:tasks.workunit.client.0.smithi134.stdout:9/899: symlink db/d20/d22/d64/dc2/dcb/d108/l13f 0 2024-02-16T22:18:59.440 INFO:tasks.workunit.client.0.smithi134.stdout:9/900: fsync db/d20/d55/d107/d11f/f128 0 2024-02-16T22:18:59.440 INFO:tasks.workunit.client.0.smithi134.stdout:9/901: stat db/d20/d22/d64/f8d 0 2024-02-16T22:18:59.441 INFO:tasks.workunit.client.0.smithi134.stdout:6/828: creat d17/d36/dd0/daa/f112 x:0 0 0 2024-02-16T22:18:59.441 INFO:tasks.workunit.client.0.smithi134.stdout:6/829: creat d17/d36/f113 x:0 0 0 2024-02-16T22:18:59.441 INFO:tasks.workunit.client.0.smithi134.stdout:6/830: write d17/d36/d77/d9a/d28/fa2 [652878,10068] 0 2024-02-16T22:18:59.441 INFO:tasks.workunit.client.0.smithi134.stdout:6/831: chown d17/d27/fb5 123804154 1 2024-02-16T22:18:59.442 INFO:tasks.workunit.client.0.smithi134.stdout:6/832: chown d17/d27/d93/d9c/da7 1172975376 1 2024-02-16T22:18:59.442 INFO:tasks.workunit.client.0.smithi134.stdout:9/902: mkdir db/d20/d22/d51/d140 0 2024-02-16T22:18:59.445 INFO:tasks.workunit.client.0.smithi134.stdout:9/903: dread db/d20/d22/d64/d69/f87 [0,4194304] 0 2024-02-16T22:18:59.447 INFO:tasks.workunit.client.0.smithi134.stdout:9/904: mknod db/d20/d22/d64/dc2/d12f/c141 0 2024-02-16T22:18:59.447 INFO:tasks.workunit.client.0.smithi134.stdout:9/905: write db/d20/d22/d51/d9b/dbd/de9/d13b/fb8 [1540676,7148] 0 2024-02-16T22:18:59.449 INFO:tasks.workunit.client.0.smithi134.stdout:9/906: mknod db/d20/d22/d46/d115/dec/c142 0 2024-02-16T22:18:59.449 INFO:tasks.workunit.client.0.smithi134.stdout:7/738: dwrite d2/d5/d19/d84/d86/fd7 [0,4194304] 0 2024-02-16T22:18:59.451 INFO:tasks.workunit.client.0.smithi134.stdout:0/745: sync 2024-02-16T22:18:59.451 INFO:tasks.workunit.client.0.smithi134.stdout:2/675: sync 2024-02-16T22:18:59.451 INFO:tasks.workunit.client.0.smithi134.stdout:3/752: sync 2024-02-16T22:18:59.455 INFO:tasks.workunit.client.0.smithi134.stdout:2/676: link df/d10/d30/f77 df/d10/d30/d49/d85/d9b/fc9 0 2024-02-16T22:18:59.455 INFO:tasks.workunit.client.0.smithi134.stdout:2/677: fdatasync df/d10/da6/fc6 0 2024-02-16T22:18:59.455 INFO:tasks.workunit.client.0.smithi134.stdout:0/746: rmdir d2/d20/d7a/d7e 39 2024-02-16T22:18:59.458 INFO:tasks.workunit.client.0.smithi134.stdout:0/747: creat d2/d20/d7a/ffa x:0 0 0 2024-02-16T22:18:59.460 INFO:tasks.workunit.client.0.smithi134.stdout:9/907: dread db/f3d [0,4194304] 0 2024-02-16T22:18:59.466 INFO:tasks.workunit.client.0.smithi134.stdout:6/833: dwrite d17/d27/d93/d9c/dec/d52/d87/f111 [0,4194304] 0 2024-02-16T22:18:59.466 INFO:tasks.workunit.client.0.smithi134.stdout:6/834: write d17/d63/fb3 [6061169,27080] 0 2024-02-16T22:18:59.466 INFO:tasks.workunit.client.0.smithi134.stdout:6/835: write d17/d36/d77/d9a/d70/f7d [648482,76562] 0 2024-02-16T22:18:59.467 INFO:tasks.workunit.client.0.smithi134.stdout:6/836: write d17/d36/d77/d9a/d28/fc7 [1568411,48250] 0 2024-02-16T22:18:59.467 INFO:tasks.workunit.client.0.smithi134.stdout:6/837: readlink d17/d36/d77/d9a/l5c 0 2024-02-16T22:18:59.467 INFO:tasks.workunit.client.0.smithi134.stdout:9/908: dread f8 [0,4194304] 0 2024-02-16T22:18:59.477 INFO:tasks.workunit.client.0.smithi134.stdout:6/838: creat d17/d27/d93/d9c/dec/d52/d79/f114 x:0 0 0 2024-02-16T22:18:59.477 INFO:tasks.workunit.client.0.smithi134.stdout:6/839: chown d17/d27/d30/d32/c4d 321 1 2024-02-16T22:18:59.477 INFO:tasks.workunit.client.0.smithi134.stdout:6/840: write d17/d27/d93/f9e [3330450,35737] 0 2024-02-16T22:18:59.477 INFO:tasks.workunit.client.0.smithi134.stdout:6/841: write d17/d27/f8d [4656716,89155] 0 2024-02-16T22:18:59.477 INFO:tasks.workunit.client.0.smithi134.stdout:9/909: mkdir db/d20/d22/d64/d69/d143 0 2024-02-16T22:18:59.478 INFO:tasks.workunit.client.0.smithi134.stdout:6/842: mknod d17/d36/d77/d9a/d28/d5b/d88/daf/d10b/c115 0 2024-02-16T22:18:59.479 INFO:tasks.workunit.client.0.smithi134.stdout:6/843: creat d17/dfd/de2/f116 x:0 0 0 2024-02-16T22:18:59.479 INFO:tasks.workunit.client.0.smithi134.stdout:6/844: fdatasync d17/d36/d77/d9a/d73/dd6/fc8 0 2024-02-16T22:18:59.480 INFO:tasks.workunit.client.0.smithi134.stdout:9/910: rename db/d20/d22/d51/d9b/dbd/l102 to db/d20/d55/d107/d124/l144 0 2024-02-16T22:18:59.480 INFO:tasks.workunit.client.0.smithi134.stdout:9/911: creat db/d20/d22/d51/d9b/f145 x:0 0 0 2024-02-16T22:18:59.480 INFO:tasks.workunit.client.0.smithi134.stdout:9/912: stat db/d20/d55/d107/d124/f12b 0 2024-02-16T22:18:59.480 INFO:tasks.workunit.client.0.smithi134.stdout:6/845: mkdir d17/d27/d93/d9c/dec/d52/d117 0 2024-02-16T22:18:59.482 INFO:tasks.workunit.client.0.smithi134.stdout:6/846: truncate f6 3376879 0 2024-02-16T22:18:59.488 INFO:tasks.workunit.client.0.smithi134.stdout:9/913: dread db/d20/f9f [0,4194304] 0 2024-02-16T22:18:59.490 INFO:tasks.workunit.client.0.smithi134.stdout:9/914: unlink db/d20/d22/d46/d8f/cfe 0 2024-02-16T22:18:59.497 INFO:tasks.workunit.client.0.smithi134.stdout:3/753: dwrite da/d12/f21 [0,4194304] 0 2024-02-16T22:18:59.497 INFO:tasks.workunit.client.0.smithi134.stdout:3/754: fsync da/d1c/d24/d9a/dc0/fce 0 2024-02-16T22:18:59.498 INFO:tasks.workunit.client.0.smithi134.stdout:7/739: dwrite d2/d6/d7d/d92/da5/d63/f72 [0,4194304] 0 2024-02-16T22:18:59.498 INFO:tasks.workunit.client.0.smithi134.stdout:7/740: dread - d2/d6/d91/db3/fea zero size 2024-02-16T22:18:59.498 INFO:tasks.workunit.client.0.smithi134.stdout:7/741: fdatasync d2/d6/d7d/d9e/fb0 0 2024-02-16T22:18:59.502 INFO:tasks.workunit.client.0.smithi134.stdout:2/678: dwrite df/d10/d30/d4d/d94/da3/f6d [0,4194304] 0 2024-02-16T22:18:59.503 INFO:tasks.workunit.client.0.smithi134.stdout:9/915: write db/d20/d22/d64/d69/f98 [1815560,14194] 0 2024-02-16T22:18:59.503 INFO:tasks.workunit.client.0.smithi134.stdout:0/748: dwrite d2/dc/d48/f57 [4194304,4194304] 0 2024-02-16T22:18:59.503 INFO:tasks.workunit.client.0.smithi134.stdout:9/916: creat db/dc/f146 x:0 0 0 2024-02-16T22:18:59.503 INFO:tasks.workunit.client.0.smithi134.stdout:9/917: truncate db/d20/d22/d64/d69/d89/f93 104719 0 2024-02-16T22:18:59.503 INFO:tasks.workunit.client.0.smithi134.stdout:6/847: dwrite d17/d27/d93/d9c/dec/d52/d79/f75 [0,4194304] 0 2024-02-16T22:18:59.505 INFO:tasks.workunit.client.0.smithi134.stdout:5/789: sync 2024-02-16T22:18:59.505 INFO:tasks.workunit.client.0.smithi134.stdout:1/732: sync 2024-02-16T22:18:59.506 INFO:tasks.workunit.client.0.smithi134.stdout:8/737: sync 2024-02-16T22:18:59.506 INFO:tasks.workunit.client.0.smithi134.stdout:4/605: sync 2024-02-16T22:18:59.506 INFO:tasks.workunit.client.0.smithi134.stdout:5/790: readlink d2/d35/d36/d46/l47 0 2024-02-16T22:18:59.506 INFO:tasks.workunit.client.0.smithi134.stdout:2/679: rmdir df/d10/d30/da2 39 2024-02-16T22:18:59.509 INFO:tasks.workunit.client.0.smithi134.stdout:0/749: symlink d2/dc/d32/d3e/dc1/lfb 0 2024-02-16T22:18:59.511 INFO:tasks.workunit.client.0.smithi134.stdout:4/606: dread d0/d6/d22/d25/f72 [0,4194304] 0 2024-02-16T22:18:59.511 INFO:tasks.workunit.client.0.smithi134.stdout:4/607: truncate d0/d6/d1e/d7c/f82 163876 0 2024-02-16T22:18:59.511 INFO:tasks.workunit.client.0.smithi134.stdout:4/608: chown d0/d31/db8/d46/fbf 697 1 2024-02-16T22:18:59.511 INFO:tasks.workunit.client.0.smithi134.stdout:7/742: read d2/d6/f16 [3783375,28472] 0 2024-02-16T22:18:59.511 INFO:tasks.workunit.client.0.smithi134.stdout:7/743: write d2/d5/d19/fb1 [682505,111246] 0 2024-02-16T22:18:59.514 INFO:tasks.workunit.client.0.smithi134.stdout:6/848: rename d17/d27/d93/d9c/dec/dcb/lf6 to d17/d27/d93/d9c/dec/d52/d79/d92/de6/d10e/l118 0 2024-02-16T22:18:59.515 INFO:tasks.workunit.client.0.smithi134.stdout:6/849: fsync d17/d36/d77/d9a/d28/d5b/f6d 0 2024-02-16T22:18:59.516 INFO:tasks.workunit.client.0.smithi134.stdout:8/738: unlink d2/df/c2e 0 2024-02-16T22:18:59.516 INFO:tasks.workunit.client.0.smithi134.stdout:8/739: rename d2/df/d18/d2a to d2/df/d18/d2a/d41/d59/da0/d40/dff 22 2024-02-16T22:18:59.519 INFO:tasks.workunit.client.0.smithi134.stdout:1/733: mknod d5/d1a/d23/d3c/d6a/cef 0 2024-02-16T22:18:59.519 INFO:tasks.workunit.client.0.smithi134.stdout:1/734: chown d5/da/d21/d52/d9b/d9f 1864009877 1 2024-02-16T22:18:59.520 INFO:tasks.workunit.client.0.smithi134.stdout:4/609: mknod d0/d6/d22/d40/ccd 0 2024-02-16T22:18:59.521 INFO:tasks.workunit.client.0.smithi134.stdout:4/610: dread - d0/d31/db8/d46/fbf zero size 2024-02-16T22:18:59.521 INFO:tasks.workunit.client.0.smithi134.stdout:3/755: dwrite da/d1c/d24/d9a/dc0/d8a/fef [0,4194304] 0 2024-02-16T22:18:59.522 INFO:tasks.workunit.client.0.smithi134.stdout:3/756: write da/d1c/d24/f52 [4367666,100206] 0 2024-02-16T22:18:59.523 INFO:tasks.workunit.client.0.smithi134.stdout:6/850: mkdir d17/d27/d93/d9c/dec/d52/d119 0 2024-02-16T22:18:59.524 INFO:tasks.workunit.client.0.smithi134.stdout:6/851: chown d17/d36/d77/d9a/d28 7104805 1 2024-02-16T22:18:59.525 INFO:tasks.workunit.client.0.smithi134.stdout:0/750: dread d2/dc/f1d [4194304,4194304] 0 2024-02-16T22:18:59.525 INFO:tasks.workunit.client.0.smithi134.stdout:0/751: getdents d2/dc/d97/ddf 0 2024-02-16T22:18:59.525 INFO:tasks.workunit.client.0.smithi134.stdout:8/740: symlink d2/df/d18/d2a/d41/d59/da0/d40/d53/l100 0 2024-02-16T22:18:59.527 INFO:tasks.workunit.client.0.smithi134.stdout:1/735: mknod d5/da/d2d/dca/cf0 0 2024-02-16T22:18:59.527 INFO:tasks.workunit.client.0.smithi134.stdout:1/736: creat d5/da/d21/d52/d9b/db6/ff1 x:0 0 0 2024-02-16T22:18:59.528 INFO:tasks.workunit.client.0.smithi134.stdout:4/611: mknod d0/d31/db8/d86/cce 0 2024-02-16T22:18:59.534 INFO:tasks.workunit.client.0.smithi134.stdout:6/852: creat d17/d27/d93/d9c/dec/f11a x:0 0 0 2024-02-16T22:18:59.535 INFO:tasks.workunit.client.0.smithi134.stdout:0/752: mknod d2/dc/d48/cfc 0 2024-02-16T22:18:59.538 INFO:tasks.workunit.client.0.smithi134.stdout:8/741: unlink d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/la2 0 2024-02-16T22:18:59.538 INFO:tasks.workunit.client.0.smithi134.stdout:8/742: chown d2/df/d18/d27/d85/f96 1 1 2024-02-16T22:18:59.538 INFO:tasks.workunit.client.0.smithi134.stdout:8/743: truncate d2/df/fe7 236569 0 2024-02-16T22:18:59.538 INFO:tasks.workunit.client.0.smithi134.stdout:8/744: stat d2/df/d18/d12/fb9 0 2024-02-16T22:18:59.538 INFO:tasks.workunit.client.0.smithi134.stdout:8/745: write d2/df/d18/d27/dc4/fcd [777917,17969] 0 2024-02-16T22:18:59.538 INFO:tasks.workunit.client.0.smithi134.stdout:3/757: dread da/d12/f21 [0,4194304] 0 2024-02-16T22:18:59.539 INFO:tasks.workunit.client.0.smithi134.stdout:9/918: dwrite db/d20/f8e [0,4194304] 0 2024-02-16T22:18:59.540 INFO:tasks.workunit.client.0.smithi134.stdout:2/680: dwrite fb [0,4194304] 0 2024-02-16T22:18:59.541 INFO:tasks.workunit.client.0.smithi134.stdout:1/737: creat d5/da/d21/d52/ff2 x:0 0 0 2024-02-16T22:18:59.541 INFO:tasks.workunit.client.0.smithi134.stdout:1/738: truncate d5/d1a/d53/d86/faa 262406 0 2024-02-16T22:18:59.543 INFO:tasks.workunit.client.0.smithi134.stdout:6/853: link d17/d36/d77/d9a/l5c d17/d36/d77/d9a/d28/d5b/d88/d90/da5/l11b 0 2024-02-16T22:18:59.545 INFO:tasks.workunit.client.0.smithi134.stdout:0/753: rename d2/d4b/d53/cc7 to d2/dc/d2d/d34/d87/cfd 0 2024-02-16T22:18:59.546 INFO:tasks.workunit.client.0.smithi134.stdout:3/758: symlink da/d1c/d24/d29/d51/lf0 0 2024-02-16T22:18:59.547 INFO:tasks.workunit.client.0.smithi134.stdout:9/919: rmdir db/de0 39 2024-02-16T22:18:59.548 INFO:tasks.workunit.client.0.smithi134.stdout:7/744: dwrite d2/d5/d4c/fec [0,4194304] 0 2024-02-16T22:18:59.548 INFO:tasks.workunit.client.0.smithi134.stdout:7/745: fsync d2/d5/d19/f44 0 2024-02-16T22:18:59.551 INFO:tasks.workunit.client.0.smithi134.stdout:0/754: dread d2/dc/d32/d45/fc6 [0,4194304] 0 2024-02-16T22:18:59.551 INFO:tasks.workunit.client.0.smithi134.stdout:8/746: rename d2/df/d18/d27/d85/da4/ffc to d2/df/d18/d2a/d41/d59/da0/d40/d53/daa/f101 0 2024-02-16T22:18:59.552 INFO:tasks.workunit.client.0.smithi134.stdout:5/791: dwrite d2/d35/d72/fb5 [0,4194304] 0 2024-02-16T22:18:59.554 INFO:tasks.workunit.client.0.smithi134.stdout:3/759: rmdir da/d6b/dc1 39 2024-02-16T22:18:59.554 INFO:tasks.workunit.client.0.smithi134.stdout:3/760: creat da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/ff1 x:0 0 0 2024-02-16T22:18:59.558 INFO:tasks.workunit.client.0.smithi134.stdout:5/792: truncate d2/d9/dc/d98/ff0 7969588 0 2024-02-16T22:18:59.558 INFO:tasks.workunit.client.0.smithi134.stdout:2/681: dread df/d10/d30/f9a [0,4194304] 0 2024-02-16T22:18:59.576 INFO:tasks.workunit.client.0.smithi134.stdout:1/739: dwrite f1 [0,4194304] 0 2024-02-16T22:18:59.582 INFO:tasks.workunit.client.0.smithi134.stdout:4/612: dwrite d0/d6/d22/d25/f73 [0,4194304] 0 2024-02-16T22:18:59.587 INFO:tasks.workunit.client.0.smithi134.stdout:4/613: mknod d0/d31/db8/d1a/d75/dc8/ccf 0 2024-02-16T22:18:59.587 INFO:tasks.workunit.client.0.smithi134.stdout:4/614: write d0/d6/d22/d25/d2a/f51 [9460,117577] 0 2024-02-16T22:18:59.592 INFO:tasks.workunit.client.0.smithi134.stdout:4/615: rename d0/d6/d1e/d3b/l91 to d0/d31/db8/ld0 0 2024-02-16T22:18:59.592 INFO:tasks.workunit.client.0.smithi134.stdout:4/616: fsync d0/f4 0 2024-02-16T22:18:59.594 INFO:tasks.workunit.client.0.smithi134.stdout:4/617: symlink d0/d6/d22/d25/ld1 0 2024-02-16T22:18:59.600 INFO:tasks.workunit.client.0.smithi134.stdout:9/920: dwrite db/d20/d22/d64/d69/f7e [0,4194304] 0 2024-02-16T22:18:59.600 INFO:tasks.workunit.client.0.smithi134.stdout:9/921: fdatasync f8 0 2024-02-16T22:18:59.601 INFO:tasks.workunit.client.0.smithi134.stdout:9/922: creat db/d20/d22/d46/f147 x:0 0 0 2024-02-16T22:18:59.606 INFO:tasks.workunit.client.0.smithi134.stdout:9/923: rename db/d20/d22/d64/d69/cb1 to db/d20/d22/d91/c148 0 2024-02-16T22:18:59.606 INFO:tasks.workunit.client.0.smithi134.stdout:9/924: dread - db/d20/d22/d46/d8f/f92 zero size 2024-02-16T22:18:59.621 INFO:tasks.workunit.client.0.smithi134.stdout:8/747: dwrite d2/df/d18/d12/fb9 [0,4194304] 0 2024-02-16T22:18:59.623 INFO:tasks.workunit.client.0.smithi134.stdout:8/748: rmdir d2/df/d18/d2a/d41/d59/db1/d87 39 2024-02-16T22:18:59.623 INFO:tasks.workunit.client.0.smithi134.stdout:8/749: rmdir d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/d7d 39 2024-02-16T22:18:59.624 INFO:tasks.workunit.client.0.smithi134.stdout:8/750: rmdir d2 39 2024-02-16T22:18:59.624 INFO:tasks.workunit.client.0.smithi134.stdout:8/751: chown d2/df/d18/d2a/d41/d59/da0/f28 125711 1 2024-02-16T22:18:59.628 INFO:tasks.workunit.client.0.smithi134.stdout:0/755: dwrite d2/d20/d7a/fb3 [4194304,4194304] 0 2024-02-16T22:18:59.628 INFO:tasks.workunit.client.0.smithi134.stdout:6/854: dwrite d17/d27/d30/d32/deb/ffc [0,4194304] 0 2024-02-16T22:18:59.630 INFO:tasks.workunit.client.0.smithi134.stdout:8/752: dread d2/df/d18/d2a/f9c [0,4194304] 0 2024-02-16T22:18:59.630 INFO:tasks.workunit.client.0.smithi134.stdout:1/740: dwrite d5/da/d21/d52/d9b/d9f/fc5 [0,4194304] 0 2024-02-16T22:18:59.630 INFO:tasks.workunit.client.0.smithi134.stdout:1/741: chown d5/da/d21/d45 1044266 1 2024-02-16T22:18:59.630 INFO:tasks.workunit.client.0.smithi134.stdout:0/756: stat d2/d20/d7a/d7e/cce 0 2024-02-16T22:18:59.631 INFO:tasks.workunit.client.0.smithi134.stdout:4/618: dwrite d0/d6/d22/d25/f43 [0,4194304] 0 2024-02-16T22:18:59.631 INFO:tasks.workunit.client.0.smithi134.stdout:7/746: dwrite d2/d5/f87 [0,4194304] 0 2024-02-16T22:18:59.631 INFO:tasks.workunit.client.0.smithi134.stdout:7/747: fdatasync d2/d5/d19/d4a/f58 0 2024-02-16T22:18:59.631 INFO:tasks.workunit.client.0.smithi134.stdout:3/761: dwrite da/d1c/d24/d9a/dc0/d8a/d8f/f3b [0,4194304] 0 2024-02-16T22:18:59.632 INFO:tasks.workunit.client.0.smithi134.stdout:2/682: dwrite df/d10/d30/d49/d85/d9b/fc9 [0,4194304] 0 2024-02-16T22:18:59.639 INFO:tasks.workunit.client.0.smithi134.stdout:8/753: creat d2/df/d18/d2a/d41/d59/da0/d40/f102 x:0 0 0 2024-02-16T22:18:59.646 INFO:tasks.workunit.client.0.smithi134.stdout:8/754: dread d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/fb4 [0,4194304] 0 2024-02-16T22:18:59.646 INFO:tasks.workunit.client.0.smithi134.stdout:4/619: creat d0/d6/d22/d25/d2a/db4/fd2 x:0 0 0 2024-02-16T22:18:59.646 INFO:tasks.workunit.client.0.smithi134.stdout:7/748: rmdir d2/d5/d19/d84 39 2024-02-16T22:18:59.648 INFO:tasks.workunit.client.0.smithi134.stdout:3/762: unlink da/d1c/d24/d29/fc8 0 2024-02-16T22:18:59.650 INFO:tasks.workunit.client.0.smithi134.stdout:6/855: dwrite d17/d27/d93/d9c/dec/d52/d87/fab [0,4194304] 0 2024-02-16T22:18:59.651 INFO:tasks.workunit.client.0.smithi134.stdout:2/683: dwrite df/d10/d30/fac [0,4194304] 0 2024-02-16T22:18:59.661 INFO:tasks.workunit.client.0.smithi134.stdout:0/757: rename d2/d20/d7a/d7e/c91 to d2/dc/d97/ddf/cfe 0 2024-02-16T22:18:59.661 INFO:tasks.workunit.client.0.smithi134.stdout:4/620: getdents d0/d6/d1e/d9a 0 2024-02-16T22:18:59.661 INFO:tasks.workunit.client.0.smithi134.stdout:4/621: fdatasync d0/d6/d22/d25/f90 0 2024-02-16T22:18:59.662 INFO:tasks.workunit.client.0.smithi134.stdout:8/755: dwrite d2/df/d18/d5a/f79 [0,4194304] 0 2024-02-16T22:18:59.662 INFO:tasks.workunit.client.0.smithi134.stdout:8/756: readlink d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/lc0 0 2024-02-16T22:18:59.662 INFO:tasks.workunit.client.0.smithi134.stdout:8/757: stat d2/df/d18/d2a/d41/d59/da0/d40/d53/daa/f101 0 2024-02-16T22:18:59.663 INFO:tasks.workunit.client.0.smithi134.stdout:7/749: link d2/d6/d7d/d92/da5/l67 d2/d6/d7d/lf6 0 2024-02-16T22:18:59.663 INFO:tasks.workunit.client.0.smithi134.stdout:7/750: read - d2/d6/d91/db3/fe9 zero size 2024-02-16T22:18:59.664 INFO:tasks.workunit.client.0.smithi134.stdout:3/763: creat da/d1c/d24/d29/d51/ff2 x:0 0 0 2024-02-16T22:18:59.664 INFO:tasks.workunit.client.0.smithi134.stdout:3/764: stat da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/f8d 0 2024-02-16T22:18:59.666 INFO:tasks.workunit.client.0.smithi134.stdout:6/856: mkdir d17/d36/d77/d9a/d73/d11c 0 2024-02-16T22:18:59.669 INFO:tasks.workunit.client.0.smithi134.stdout:0/758: write d2/dc/f44 [616935,17052] 0 2024-02-16T22:18:59.670 INFO:tasks.workunit.client.0.smithi134.stdout:2/684: truncate df/d10/d30/d49/f4f 1047995 0 2024-02-16T22:18:59.673 INFO:tasks.workunit.client.0.smithi134.stdout:4/622: creat d0/d6/d44/fd3 x:0 0 0 2024-02-16T22:18:59.674 INFO:tasks.workunit.client.0.smithi134.stdout:3/765: dread da/fb0 [0,4194304] 0 2024-02-16T22:18:59.674 INFO:tasks.workunit.client.0.smithi134.stdout:3/766: chown da/d12/fe4 13799 1 2024-02-16T22:18:59.677 INFO:tasks.workunit.client.0.smithi134.stdout:8/758: creat d2/df/d18/d2a/d41/f103 x:0 0 0 2024-02-16T22:18:59.677 INFO:tasks.workunit.client.0.smithi134.stdout:7/751: mkdir d2/d6/dcc/df7 0 2024-02-16T22:18:59.680 INFO:tasks.workunit.client.0.smithi134.stdout:0/759: mkdir d2/dc/d32/d3e/d5e/dff 0 2024-02-16T22:18:59.683 INFO:tasks.workunit.client.0.smithi134.stdout:7/752: write d2/d5/d19/f2b [1926064,37913] 0 2024-02-16T22:18:59.683 INFO:tasks.workunit.client.0.smithi134.stdout:7/753: chown d2/d5/d22/d26/dd8 0 1 2024-02-16T22:18:59.683 INFO:tasks.workunit.client.0.smithi134.stdout:7/754: fsync d2/d5/d19/f2f 0 2024-02-16T22:18:59.683 INFO:tasks.workunit.client.0.smithi134.stdout:2/685: mkdir df/d10/d30/da2/dca 0 2024-02-16T22:18:59.683 INFO:tasks.workunit.client.0.smithi134.stdout:4/623: symlink d0/d6/d22/d97/ld4 0 2024-02-16T22:18:59.686 INFO:tasks.workunit.client.0.smithi134.stdout:8/759: mknod d2/df/d18/d2a/d41/d59/da0/c104 0 2024-02-16T22:18:59.688 INFO:tasks.workunit.client.0.smithi134.stdout:7/755: creat d2/d6/d17/ff8 x:0 0 0 2024-02-16T22:18:59.690 INFO:tasks.workunit.client.0.smithi134.stdout:3/767: rename da/d1c/d24/dd5/de3/lee to da/d12/d2a/lf3 0 2024-02-16T22:18:59.690 INFO:tasks.workunit.client.0.smithi134.stdout:2/686: dread df/d10/d15/d5a/f13 [0,4194304] 0 2024-02-16T22:18:59.692 INFO:tasks.workunit.client.0.smithi134.stdout:7/756: symlink d2/d6/dcc/df7/lf9 0 2024-02-16T22:18:59.692 INFO:tasks.workunit.client.0.smithi134.stdout:7/757: write d2/ff [1030268,118875] 0 2024-02-16T22:18:59.693 INFO:tasks.workunit.client.0.smithi134.stdout:8/760: rename d2/df/d18/d5a to d2/df/d18/d2a/d41/d59/da0/d40/d53/daa/d105 0 2024-02-16T22:18:59.695 INFO:tasks.workunit.client.0.smithi134.stdout:3/768: creat da/d6b/dc1/ff4 x:0 0 0 2024-02-16T22:18:59.697 INFO:tasks.workunit.client.0.smithi134.stdout:7/758: symlink d2/d5/d19/lfa 0 2024-02-16T22:18:59.697 INFO:tasks.workunit.client.0.smithi134.stdout:7/759: dread - d2/d6/d7d/d92/da5/f53 zero size 2024-02-16T22:18:59.698 INFO:tasks.workunit.client.0.smithi134.stdout:7/760: read - d2/d5/d22/d83/dce/fd0 zero size 2024-02-16T22:18:59.699 INFO:tasks.workunit.client.0.smithi134.stdout:6/857: dwrite d17/d36/dd0/daa/f112 [0,4194304] 0 2024-02-16T22:18:59.699 INFO:tasks.workunit.client.0.smithi134.stdout:6/858: creat d17/d36/dd0/daa/f11d x:0 0 0 2024-02-16T22:18:59.699 INFO:tasks.workunit.client.0.smithi134.stdout:6/859: truncate d17/dfd/de2/f100 197548 0 2024-02-16T22:18:59.699 INFO:tasks.workunit.client.0.smithi134.stdout:8/761: mknod d2/df/d18/d2a/d41/d59/db1/d87/df2/c106 0 2024-02-16T22:18:59.699 INFO:tasks.workunit.client.0.smithi134.stdout:8/762: fdatasync d2/df/d18/d2a/d41/d59/fed 0 2024-02-16T22:18:59.701 INFO:tasks.workunit.client.0.smithi134.stdout:3/769: mkdir da/d6b/dc1/de6/df5 0 2024-02-16T22:18:59.706 INFO:tasks.workunit.client.0.smithi134.stdout:6/860: getdents d17/d27/d93/d9c/dec/dcb/ddc 0 2024-02-16T22:18:59.706 INFO:tasks.workunit.client.0.smithi134.stdout:6/861: truncate d17/d36/d77/d9a/d28/f81 5134689 0 2024-02-16T22:18:59.708 INFO:tasks.workunit.client.0.smithi134.stdout:6/862: rename d17/d36/l40 to d17/d27/l11e 0 2024-02-16T22:18:59.708 INFO:tasks.workunit.client.0.smithi134.stdout:6/863: mknod d17/d27/d93/d9c/dec/d52/d117/c11f 0 2024-02-16T22:18:59.728 INFO:tasks.workunit.client.0.smithi134.stdout:4/624: dwrite d0/d6/d1e/d7c/fc0 [4194304,4194304] 0 2024-02-16T22:18:59.729 INFO:tasks.workunit.client.0.smithi134.stdout:2/687: dwrite df/d10/d3a/fc5 [0,4194304] 0 2024-02-16T22:18:59.730 INFO:tasks.workunit.client.0.smithi134.stdout:4/625: creat d0/d6/d22/d40/fd5 x:0 0 0 2024-02-16T22:18:59.731 INFO:tasks.workunit.client.0.smithi134.stdout:4/626: unlink d0/d6/fa4 0 2024-02-16T22:18:59.740 INFO:tasks.workunit.client.0.smithi134.stdout:2/688: write df/d10/d30/d4d/f52 [2740203,97904] 0 2024-02-16T22:18:59.742 INFO:tasks.workunit.client.0.smithi134.stdout:0/760: dwrite d2/f26 [4194304,4194304] 0 2024-02-16T22:18:59.752 INFO:tasks.workunit.client.0.smithi134.stdout:9/925: sync 2024-02-16T22:18:59.752 INFO:tasks.workunit.client.0.smithi134.stdout:5/793: sync 2024-02-16T22:18:59.752 INFO:tasks.workunit.client.0.smithi134.stdout:1/742: sync 2024-02-16T22:18:59.754 INFO:tasks.workunit.client.0.smithi134.stdout:9/926: rename db/d20/d22/d46/dbe/ff1 to db/d20/d22/d64/d69/d89/d11a/f149 0 2024-02-16T22:18:59.754 INFO:tasks.workunit.client.0.smithi134.stdout:9/927: truncate db/dc/f24 154750 0 2024-02-16T22:18:59.755 INFO:tasks.workunit.client.0.smithi134.stdout:2/689: dread df/d10/d30/d4d/d94/da3/f72 [0,4194304] 0 2024-02-16T22:18:59.757 INFO:tasks.workunit.client.0.smithi134.stdout:5/794: creat d2/d35/d36/d46/d68/f100 x:0 0 0 2024-02-16T22:18:59.757 INFO:tasks.workunit.client.0.smithi134.stdout:5/795: fdatasync d2/d35/d36/d3d/d63/fa2 0 2024-02-16T22:18:59.758 INFO:tasks.workunit.client.0.smithi134.stdout:9/928: write db/d20/d22/d46/ff7 [4647705,1859] 0 2024-02-16T22:18:59.758 INFO:tasks.workunit.client.0.smithi134.stdout:9/929: write db/d20/d22/d46/d115/fff [984110,21800] 0 2024-02-16T22:18:59.759 INFO:tasks.workunit.client.0.smithi134.stdout:1/743: rename d5/d1a/d23/d3c/d6a/d5c/fe6 to d5/da/d21/d45/ff3 0 2024-02-16T22:18:59.759 INFO:tasks.workunit.client.0.smithi134.stdout:1/744: fsync d5/d1a/d23/d3c/d6a/fb9 0 2024-02-16T22:18:59.773 INFO:tasks.workunit.client.0.smithi134.stdout:9/930: read db/d20/d55/fd9 [4126026,110270] 0 2024-02-16T22:18:59.774 INFO:tasks.workunit.client.0.smithi134.stdout:9/931: mknod db/d20/d22/d64/d69/d143/c14a 0 2024-02-16T22:18:59.774 INFO:tasks.workunit.client.0.smithi134.stdout:9/932: chown db/de0/def 10 1 2024-02-16T22:18:59.774 INFO:tasks.workunit.client.0.smithi134.stdout:9/933: dread - db/d20/d55/d107/d124/f12b zero size 2024-02-16T22:18:59.774 INFO:tasks.workunit.client.0.smithi134.stdout:7/761: dwrite d2/d5/d19/d4a/f7b [0,4194304] 0 2024-02-16T22:18:59.775 INFO:tasks.workunit.client.0.smithi134.stdout:9/934: getdents db/d20/d22/d64/d69/d89/de2 0 2024-02-16T22:18:59.776 INFO:tasks.workunit.client.0.smithi134.stdout:7/762: truncate d2/d6/d91/db3/fb4 291351 0 2024-02-16T22:18:59.777 INFO:tasks.workunit.client.0.smithi134.stdout:9/935: mkdir db/d20/d22/d64/dc2/ddb/d14b 0 2024-02-16T22:18:59.780 INFO:tasks.workunit.client.0.smithi134.stdout:9/936: rename db/d20/d55/d107/d11f to db/d20/d22/d64/dc2/d12f/d14c 0 2024-02-16T22:18:59.780 INFO:tasks.workunit.client.0.smithi134.stdout:9/937: creat db/d20/d32/dd8/d10a/f14d x:0 0 0 2024-02-16T22:18:59.780 INFO:tasks.workunit.client.0.smithi134.stdout:9/938: creat db/d20/d22/d64/dc2/ddb/f14e x:0 0 0 2024-02-16T22:18:59.788 INFO:tasks.workunit.client.0.smithi134.stdout:0/761: dwrite d2/dc/d32/d3e/da7/ff4 [0,4194304] 0 2024-02-16T22:18:59.788 INFO:tasks.workunit.client.0.smithi134.stdout:4/627: dwrite d0/d6/d8/d32/f38 [4194304,4194304] 0 2024-02-16T22:18:59.790 INFO:tasks.workunit.client.0.smithi134.stdout:3/770: dwrite da/d12/d2a/f3c [0,4194304] 0 2024-02-16T22:18:59.791 INFO:tasks.workunit.client.0.smithi134.stdout:3/771: rmdir da/d1c/d24/d29/d51/d80/d89/d8e/dab 39 2024-02-16T22:18:59.791 INFO:tasks.workunit.client.0.smithi134.stdout:6/864: dwrite d17/d27/d30/d32/deb/ffc [0,4194304] 0 2024-02-16T22:18:59.792 INFO:tasks.workunit.client.0.smithi134.stdout:6/865: creat d17/d27/d93/d9c/dec/dd4/f120 x:0 0 0 2024-02-16T22:18:59.792 INFO:tasks.workunit.client.0.smithi134.stdout:6/866: stat d17/d27/d93/d9c/dec/d52/d87 0 2024-02-16T22:18:59.793 INFO:tasks.workunit.client.0.smithi134.stdout:3/772: creat da/d1c/d24/dd5/ff6 x:0 0 0 2024-02-16T22:18:59.793 INFO:tasks.workunit.client.0.smithi134.stdout:3/773: fsync da/d1c/f5d 0 2024-02-16T22:18:59.793 INFO:tasks.workunit.client.0.smithi134.stdout:3/774: readlink da/d6b/dc1/lca 0 2024-02-16T22:18:59.795 INFO:tasks.workunit.client.0.smithi134.stdout:6/867: truncate d17/d36/d77/d9a/d28/d5b/fa6 406012 0 2024-02-16T22:18:59.798 INFO:tasks.workunit.client.0.smithi134.stdout:6/868: unlink d17/d36/f7a 0 2024-02-16T22:18:59.799 INFO:tasks.workunit.client.0.smithi134.stdout:5/796: dwrite d2/d9/dc/d98/fe9 [0,4194304] 0 2024-02-16T22:18:59.799 INFO:tasks.workunit.client.0.smithi134.stdout:2/690: dwrite df/d10/d30/d49/d82/f79 [0,4194304] 0 2024-02-16T22:18:59.799 INFO:tasks.workunit.client.0.smithi134.stdout:2/691: fsync df/d10/d30/d49/d82/fc2 0 2024-02-16T22:18:59.799 INFO:tasks.workunit.client.0.smithi134.stdout:7/763: dwrite d2/d6/d17/f56 [0,4194304] 0 2024-02-16T22:18:59.803 INFO:tasks.workunit.client.0.smithi134.stdout:9/939: dwrite db/d20/d22/d64/d69/d89/d11a/f149 [0,4194304] 0 2024-02-16T22:18:59.803 INFO:tasks.workunit.client.0.smithi134.stdout:9/940: stat db/d20/d55/f97 0 2024-02-16T22:18:59.804 INFO:tasks.workunit.client.0.smithi134.stdout:9/941: stat c7 0 2024-02-16T22:18:59.804 INFO:tasks.workunit.client.0.smithi134.stdout:9/942: stat db/dc/l79 0 2024-02-16T22:18:59.804 INFO:tasks.workunit.client.0.smithi134.stdout:4/628: dwrite d0/d6/d8/d30/f7e [0,4194304] 0 2024-02-16T22:18:59.805 INFO:tasks.workunit.client.0.smithi134.stdout:5/797: mknod d2/d35/d36/d46/d68/d74/c101 0 2024-02-16T22:18:59.806 INFO:tasks.workunit.client.0.smithi134.stdout:1/745: getdents d5/d1a/d23/d3c/d6a/d5c 0 2024-02-16T22:18:59.806 INFO:tasks.workunit.client.0.smithi134.stdout:1/746: write d5/da/db8/fe4 [625258,25457] 0 2024-02-16T22:18:59.807 INFO:tasks.workunit.client.0.smithi134.stdout:0/762: dread d2/f33 [0,4194304] 0 2024-02-16T22:18:59.807 INFO:tasks.workunit.client.0.smithi134.stdout:0/763: write d2/d20/d77/d85/f99 [4556723,91446] 0 2024-02-16T22:18:59.808 INFO:tasks.workunit.client.0.smithi134.stdout:3/775: write da/d12/f9c [3335406,65802] 0 2024-02-16T22:18:59.808 INFO:tasks.workunit.client.0.smithi134.stdout:3/776: fsync da/d1c/fe2 0 2024-02-16T22:18:59.808 INFO:tasks.workunit.client.0.smithi134.stdout:3/777: fdatasync da/d1c/d24/f4a 0 2024-02-16T22:18:59.808 INFO:tasks.workunit.client.0.smithi134.stdout:3/778: truncate da/d1c/d24/d29/d51/fdb 290403 0 2024-02-16T22:18:59.809 INFO:tasks.workunit.client.0.smithi134.stdout:9/943: read db/d20/d22/d46/d115/fff [412109,125250] 0 2024-02-16T22:18:59.822 INFO:tasks.workunit.client.0.smithi134.stdout:4/629: creat d0/d6/d8/da2/fd6 x:0 0 0 2024-02-16T22:18:59.822 INFO:tasks.workunit.client.0.smithi134.stdout:5/798: chown d2/d9/dc/d32/c48 3002539 1 2024-02-16T22:18:59.823 INFO:tasks.workunit.client.0.smithi134.stdout:2/692: dwrite df/d10/f9e [0,4194304] 0 2024-02-16T22:18:59.823 INFO:tasks.workunit.client.0.smithi134.stdout:2/693: chown df/d41/fc8 0 1 2024-02-16T22:18:59.823 INFO:tasks.workunit.client.0.smithi134.stdout:2/694: read - df/d10/d15/d5a/d34/fc0 zero size 2024-02-16T22:18:59.824 INFO:tasks.workunit.client.0.smithi134.stdout:1/747: mknod d5/da/d21/d45/cf4 0 2024-02-16T22:18:59.829 INFO:tasks.workunit.client.0.smithi134.stdout:9/944: truncate db/dc/f66 3439540 0 2024-02-16T22:18:59.831 INFO:tasks.workunit.client.0.smithi134.stdout:4/630: rename d0/d6/d8/d32/l4d to d0/d6/d8/d32/ld7 0 2024-02-16T22:18:59.831 INFO:tasks.workunit.client.0.smithi134.stdout:4/631: chown d0/d6/d8/lcc 58238 1 2024-02-16T22:18:59.832 INFO:tasks.workunit.client.0.smithi134.stdout:5/799: rename d2/d9/c9d to d2/d35/d36/d3d/d9c/dc2/c102 0 2024-02-16T22:18:59.832 INFO:tasks.workunit.client.0.smithi134.stdout:5/800: chown d2/d35/d36/d3d/d9c/f2c 7055 1 2024-02-16T22:18:59.833 INFO:tasks.workunit.client.0.smithi134.stdout:5/801: dread d2/d35/d72/f7a [0,4194304] 0 2024-02-16T22:18:59.835 INFO:tasks.workunit.client.0.smithi134.stdout:2/695: symlink df/d10/d15/da4/lcb 0 2024-02-16T22:18:59.836 INFO:tasks.workunit.client.0.smithi134.stdout:3/779: creat da/d1c/d24/d9a/dc0/d8a/d8f/d5f/ff7 x:0 0 0 2024-02-16T22:18:59.837 INFO:tasks.workunit.client.0.smithi134.stdout:3/780: write da/d1c/f5d [873934,85835] 0 2024-02-16T22:18:59.837 INFO:tasks.workunit.client.0.smithi134.stdout:9/945: symlink db/l14f 0 2024-02-16T22:18:59.838 INFO:tasks.workunit.client.0.smithi134.stdout:9/946: dread - db/d20/d22/d64/dc2/ddb/feb zero size 2024-02-16T22:18:59.838 INFO:tasks.workunit.client.0.smithi134.stdout:9/947: write db/d20/d22/d46/d115/dec/f12c [353859,48079] 0 2024-02-16T22:18:59.838 INFO:tasks.workunit.client.0.smithi134.stdout:9/948: chown db/d20/d22/d51/d9b/dbd/c70 166768 1 2024-02-16T22:18:59.838 INFO:tasks.workunit.client.0.smithi134.stdout:2/696: rename df/d10/d30/d49/d82/c43 to df/d10/d30/d49/ccc 0 2024-02-16T22:18:59.840 INFO:tasks.workunit.client.0.smithi134.stdout:3/781: creat da/d1c/d24/d2c/ff8 x:0 0 0 2024-02-16T22:18:59.842 INFO:tasks.workunit.client.0.smithi134.stdout:9/949: mkdir db/d20/d22/d64/dc2/dcb/d150 0 2024-02-16T22:18:59.842 INFO:tasks.workunit.client.0.smithi134.stdout:9/950: creat db/d20/d22/d51/d9b/dbd/de9/f151 x:0 0 0 2024-02-16T22:18:59.842 INFO:tasks.workunit.client.0.smithi134.stdout:4/632: dread d0/d6/d8/d32/f38 [4194304,4194304] 0 2024-02-16T22:18:59.843 INFO:tasks.workunit.client.0.smithi134.stdout:5/802: write d2/d9/dc/f38 [4137236,59911] 0 2024-02-16T22:18:59.843 INFO:tasks.workunit.client.0.smithi134.stdout:2/697: rename df/d10/d30/d4d/d94/da3/cbe to df/d10/d30/da2/ccd 0 2024-02-16T22:18:59.844 INFO:tasks.workunit.client.0.smithi134.stdout:4/633: dread d0/d6/d8/d30/f71 [0,4194304] 0 2024-02-16T22:18:59.845 INFO:tasks.workunit.client.0.smithi134.stdout:8/763: sync 2024-02-16T22:18:59.846 INFO:tasks.workunit.client.0.smithi134.stdout:8/764: chown d2/df/d18/d12/fb9 1070905059 1 2024-02-16T22:18:59.847 INFO:tasks.workunit.client.0.smithi134.stdout:0/764: dwrite d2/dc/d2d/d34/f37 [0,4194304] 0 2024-02-16T22:18:59.847 INFO:tasks.workunit.client.0.smithi134.stdout:0/765: readlink d2/dc/da0/lc3 0 2024-02-16T22:18:59.847 INFO:tasks.workunit.client.0.smithi134.stdout:0/766: readlink d2/d20/d77/db9/lee 0 2024-02-16T22:18:59.847 INFO:tasks.workunit.client.0.smithi134.stdout:0/767: read - d2/d4b/d53/fcb zero size 2024-02-16T22:18:59.847 INFO:tasks.workunit.client.0.smithi134.stdout:0/768: fsync d2/dc/d2d/d34/d87/fd7 0 2024-02-16T22:18:59.847 INFO:tasks.workunit.client.0.smithi134.stdout:0/769: truncate d2/d20/d77/fa8 377479 0 2024-02-16T22:18:59.847 INFO:tasks.workunit.client.0.smithi134.stdout:0/770: getdents d2/d20/d77/d85/db6/dd5 0 2024-02-16T22:18:59.847 INFO:tasks.workunit.client.0.smithi134.stdout:9/951: truncate db/d20/d9a/fac 2902011 0 2024-02-16T22:18:59.847 INFO:tasks.workunit.client.0.smithi134.stdout:9/952: fdatasync db/d20/d22/d46/d115/dec/ffb 0 2024-02-16T22:18:59.848 INFO:tasks.workunit.client.0.smithi134.stdout:1/748: dwrite d5/d1a/f31 [0,4194304] 0 2024-02-16T22:18:59.850 INFO:tasks.workunit.client.0.smithi134.stdout:3/782: rename da/d1c/d24/d29/c68 to da/d1c/d24/d29/d51/cf9 0 2024-02-16T22:18:59.851 INFO:tasks.workunit.client.0.smithi134.stdout:4/634: link d0/d6/d8/lcc d0/d6/d22/ld8 0 2024-02-16T22:18:59.852 INFO:tasks.workunit.client.0.smithi134.stdout:8/765: getdents d2/df/d18/d2a/d41/d59/da0/d8d 0 2024-02-16T22:18:59.852 INFO:tasks.workunit.client.0.smithi134.stdout:8/766: creat d2/df/d18/d91/f107 x:0 0 0 2024-02-16T22:18:59.855 INFO:tasks.workunit.client.0.smithi134.stdout:0/771: unlink d2/d4b/d53/l70 0 2024-02-16T22:18:59.858 INFO:tasks.workunit.client.0.smithi134.stdout:9/953: creat db/d20/d22/d64/dc2/d12f/d14c/f152 x:0 0 0 2024-02-16T22:18:59.858 INFO:tasks.workunit.client.0.smithi134.stdout:9/954: chown db/d20/d22/d64/d69/c78 653988 1 2024-02-16T22:18:59.858 INFO:tasks.workunit.client.0.smithi134.stdout:9/955: write db/d20/d22/d51/d9b/dbd/de9/f13e [964986,110639] 0 2024-02-16T22:18:59.858 INFO:tasks.workunit.client.0.smithi134.stdout:9/956: creat db/d20/d55/f153 x:0 0 0 2024-02-16T22:18:59.858 INFO:tasks.workunit.client.0.smithi134.stdout:9/957: chown db/d20/ff8 2925 1 2024-02-16T22:18:59.861 INFO:tasks.workunit.client.0.smithi134.stdout:1/749: mkdir d5/d1a/d23/d3c/d6a/df5 0 2024-02-16T22:18:59.864 INFO:tasks.workunit.client.0.smithi134.stdout:3/783: symlink da/d1c/d24/d29/d51/d80/d89/d8e/lfa 0 2024-02-16T22:18:59.864 INFO:tasks.workunit.client.0.smithi134.stdout:3/784: chown da/fde 368001 1 2024-02-16T22:18:59.864 INFO:tasks.workunit.client.0.smithi134.stdout:3/785: fdatasync da/d1c/d24/d29/d51/d80/d89/d8e/fea 0 2024-02-16T22:18:59.864 INFO:tasks.workunit.client.0.smithi134.stdout:3/786: readlink da/d1c/l86 0 2024-02-16T22:18:59.865 INFO:tasks.workunit.client.0.smithi134.stdout:4/635: link d0/d6/d1e/d3b/d9e/ca5 d0/cd9 0 2024-02-16T22:18:59.865 INFO:tasks.workunit.client.0.smithi134.stdout:4/636: fsync d0/d6/d22/fb1 0 2024-02-16T22:18:59.865 INFO:tasks.workunit.client.0.smithi134.stdout:4/637: creat d0/d6/d8/d30/fda x:0 0 0 2024-02-16T22:18:59.867 INFO:tasks.workunit.client.0.smithi134.stdout:0/772: symlink d2/dc/d32/d3e/l100 0 2024-02-16T22:18:59.870 INFO:tasks.workunit.client.0.smithi134.stdout:9/958: mkdir db/d20/d22/d64/d69/d89/d11a/d154 0 2024-02-16T22:18:59.871 INFO:tasks.workunit.client.0.smithi134.stdout:3/787: symlink da/d1c/d24/d9a/lfb 0 2024-02-16T22:18:59.874 INFO:tasks.workunit.client.0.smithi134.stdout:4/638: mkdir d0/d6/d8/da2/d76/ddb 0 2024-02-16T22:18:59.874 INFO:tasks.workunit.client.0.smithi134.stdout:4/639: fdatasync d0/d31/db8/d86/f9f 0 2024-02-16T22:18:59.876 INFO:tasks.workunit.client.0.smithi134.stdout:2/698: dwrite df/d10/d15/d90/f92 [0,4194304] 0 2024-02-16T22:18:59.876 INFO:tasks.workunit.client.0.smithi134.stdout:2/699: write df/d10/d30/d49/d85/d9b/fc1 [517409,88265] 0 2024-02-16T22:18:59.878 INFO:tasks.workunit.client.0.smithi134.stdout:0/773: read d2/dc/d32/d45/fb8 [2177377,93013] 0 2024-02-16T22:18:59.879 INFO:tasks.workunit.client.0.smithi134.stdout:9/959: getdents db/d20/d22/d51 0 2024-02-16T22:18:59.881 INFO:tasks.workunit.client.0.smithi134.stdout:8/767: dwrite d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/f77 [0,4194304] 0 2024-02-16T22:18:59.882 INFO:tasks.workunit.client.0.smithi134.stdout:9/960: rename db/d20/d22/d64/dc2/ff6 to db/d20/d22/d64/dc2/ddb/f155 0 2024-02-16T22:18:59.883 INFO:tasks.workunit.client.0.smithi134.stdout:0/774: getdents d2/dc/d32/d3e/da7/dc2 0 2024-02-16T22:18:59.887 INFO:tasks.workunit.client.0.smithi134.stdout:1/750: dwrite d5/d1a/d53/fce [0,4194304] 0 2024-02-16T22:18:59.890 INFO:tasks.workunit.client.0.smithi134.stdout:8/768: rename d2/df/d18/d2a/d41/c76 to d2/df/d18/d2a/d41/d59/da0/d40/d53/dbe/c108 0 2024-02-16T22:18:59.891 INFO:tasks.workunit.client.0.smithi134.stdout:9/961: mkdir db/d20/d22/d51/d9b/dbd/de9/d156 0 2024-02-16T22:18:59.892 INFO:tasks.workunit.client.0.smithi134.stdout:0/775: creat d2/dc/f101 x:0 0 0 2024-02-16T22:18:59.894 INFO:tasks.workunit.client.0.smithi134.stdout:9/962: symlink db/d20/d22/d51/d9b/dbd/de9/d156/l157 0 2024-02-16T22:18:59.899 INFO:tasks.workunit.client.0.smithi134.stdout:4/640: dwrite d0/d6/d1e/d3b/fac [0,4194304] 0 2024-02-16T22:18:59.899 INFO:tasks.workunit.client.0.smithi134.stdout:0/776: rename d2/l24 to d2/d20/d77/db9/l102 0 2024-02-16T22:18:59.899 INFO:tasks.workunit.client.0.smithi134.stdout:0/777: chown d2/d20/d7a/d7e/cce 975363 1 2024-02-16T22:18:59.899 INFO:tasks.workunit.client.0.smithi134.stdout:0/778: chown d2/d20/d77/d85/db6/f6d 390365 1 2024-02-16T22:18:59.899 INFO:tasks.workunit.client.0.smithi134.stdout:3/788: dwrite da/d1c/d24/d9a/dc0/d8a/d8f/f3f [4194304,4194304] 0 2024-02-16T22:18:59.901 INFO:tasks.workunit.client.0.smithi134.stdout:9/963: creat db/d20/d55/d107/f158 x:0 0 0 2024-02-16T22:18:59.901 INFO:tasks.workunit.client.0.smithi134.stdout:9/964: fsync db/dc/f68 0 2024-02-16T22:18:59.905 INFO:tasks.workunit.client.0.smithi134.stdout:4/641: mknod d0/d6/d8/d32/d63/d6c/cdc 0 2024-02-16T22:18:59.905 INFO:tasks.workunit.client.0.smithi134.stdout:4/642: fsync d0/d6/d1e/f27 0 2024-02-16T22:18:59.908 INFO:tasks.workunit.client.0.smithi134.stdout:9/965: link db/d20/d22/d51/d9b/dbd/de9/d156/l157 db/d20/d55/d107/d124/l159 0 2024-02-16T22:18:59.910 INFO:tasks.workunit.client.0.smithi134.stdout:4/643: creat d0/d6/d1e/fdd x:0 0 0 2024-02-16T22:18:59.910 INFO:tasks.workunit.client.0.smithi134.stdout:1/751: dwrite d5/d1a/d82/f97 [0,4194304] 0 2024-02-16T22:18:59.912 INFO:tasks.workunit.client.0.smithi134.stdout:4/644: creat d0/d6/d8/da2/d76/fde x:0 0 0 2024-02-16T22:18:59.915 INFO:tasks.workunit.client.0.smithi134.stdout:1/752: symlink d5/da/d21/d52/lf6 0 2024-02-16T22:18:59.918 INFO:tasks.workunit.client.0.smithi134.stdout:9/966: dread db/d20/d22/d51/fb5 [0,4194304] 0 2024-02-16T22:18:59.918 INFO:tasks.workunit.client.0.smithi134.stdout:9/967: creat db/d20/d22/d64/dc2/ddb/f15a x:0 0 0 2024-02-16T22:18:59.919 INFO:tasks.workunit.client.0.smithi134.stdout:9/968: read db/d20/d22/d64/d69/d89/f93 [15725,124902] 0 2024-02-16T22:18:59.919 INFO:tasks.workunit.client.0.smithi134.stdout:1/753: dread d5/da/db8/fe4 [0,4194304] 0 2024-02-16T22:18:59.919 INFO:tasks.workunit.client.0.smithi134.stdout:1/754: chown d5/d1a/d23/d3c/fd8 3904806 1 2024-02-16T22:18:59.920 INFO:tasks.workunit.client.0.smithi134.stdout:9/969: write db/d20/d22/d51/d9b/dbd/de9/f13e [794022,97146] 0 2024-02-16T22:18:59.920 INFO:tasks.workunit.client.0.smithi134.stdout:9/970: read db/d20/d22/d51/fb5 [380104,124564] 0 2024-02-16T22:18:59.920 INFO:tasks.workunit.client.0.smithi134.stdout:9/971: dread - db/d20/d22/d46/f147 zero size 2024-02-16T22:18:59.920 INFO:tasks.workunit.client.0.smithi134.stdout:9/972: write db/d20/d22/d51/d9b/dbd/de9/f151 [526753,87435] 0 2024-02-16T22:18:59.920 INFO:tasks.workunit.client.0.smithi134.stdout:9/973: creat db/d20/f15b x:0 0 0 2024-02-16T22:18:59.922 INFO:tasks.workunit.client.0.smithi134.stdout:8/769: dwrite d2/f63 [0,4194304] 0 2024-02-16T22:18:59.923 INFO:tasks.workunit.client.0.smithi134.stdout:9/974: creat db/d20/d22/d64/dc2/dcb/f15c x:0 0 0 2024-02-16T22:18:59.923 INFO:tasks.workunit.client.0.smithi134.stdout:9/975: read db/d20/d22/d64/d69/f98 [3691106,86203] 0 2024-02-16T22:18:59.923 INFO:tasks.workunit.client.0.smithi134.stdout:8/770: dread d2/df/d18/d27/dc4/fcd [0,4194304] 0 2024-02-16T22:18:59.927 INFO:tasks.workunit.client.0.smithi134.stdout:9/976: rename db/d20/d22/d51/d9b/ffd to db/d20/d22/f15d 0 2024-02-16T22:18:59.928 INFO:tasks.workunit.client.0.smithi134.stdout:8/771: rename d2/df/d18/d2a/d41/d59/db1/d87/df2/c106 to d2/df/d18/d12/c109 0 2024-02-16T22:18:59.928 INFO:tasks.workunit.client.0.smithi134.stdout:8/772: dread - d2/df/d18/d2a/d41/d59/db1/d87/fea zero size 2024-02-16T22:18:59.930 INFO:tasks.workunit.client.0.smithi134.stdout:4/645: dread d0/d31/db8/f17 [0,4194304] 0 2024-02-16T22:18:59.930 INFO:tasks.workunit.client.0.smithi134.stdout:8/773: symlink d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/l10a 0 2024-02-16T22:18:59.931 INFO:tasks.workunit.client.0.smithi134.stdout:0/779: dwrite d2/dc/d32/fa6 [0,4194304] 0 2024-02-16T22:18:59.931 INFO:tasks.workunit.client.0.smithi134.stdout:3/789: dwrite da/d12/f76 [0,4194304] 0 2024-02-16T22:18:59.934 INFO:tasks.workunit.client.0.smithi134.stdout:1/755: read d5/da/d21/d45/f4e [536526,123947] 0 2024-02-16T22:18:59.935 INFO:tasks.workunit.client.0.smithi134.stdout:1/756: stat d5/d1a/d23/d3c/ce7 0 2024-02-16T22:18:59.940 INFO:tasks.workunit.client.0.smithi134.stdout:8/774: rmdir d2/df/d18/d91 39 2024-02-16T22:18:59.942 INFO:tasks.workunit.client.0.smithi134.stdout:0/780: unlink d2/dc/l1b 0 2024-02-16T22:18:59.942 INFO:tasks.workunit.client.0.smithi134.stdout:0/781: write d2/f6c [190503,5784] 0 2024-02-16T22:18:59.945 INFO:tasks.workunit.client.0.smithi134.stdout:3/790: getdents da/d1c/d24/d9a/dc0/d8a/d8f/d6d 0 2024-02-16T22:18:59.945 INFO:tasks.workunit.client.0.smithi134.stdout:3/791: readlink da/d1c/d24/d29/lcb 0 2024-02-16T22:18:59.948 INFO:tasks.workunit.client.0.smithi134.stdout:3/792: rename da/d1c/d24/d9a/dc0/d8a/d8f/d6d/fa0 to da/d6b/dc1/de6/df5/ffc 0 2024-02-16T22:18:59.948 INFO:tasks.workunit.client.0.smithi134.stdout:1/757: write d5/da/fa2 [3225590,56160] 0 2024-02-16T22:18:59.948 INFO:tasks.workunit.client.0.smithi134.stdout:1/758: fdatasync d5/d1a/d53/fce 0 2024-02-16T22:18:59.948 INFO:tasks.workunit.client.0.smithi134.stdout:1/759: dread - d5/da/d21/f80 zero size 2024-02-16T22:18:59.949 INFO:tasks.workunit.client.0.smithi134.stdout:0/782: dread d2/dc/d32/d45/fb8 [0,4194304] 0 2024-02-16T22:18:59.949 INFO:tasks.workunit.client.0.smithi134.stdout:3/793: creat da/ffd x:0 0 0 2024-02-16T22:18:59.951 INFO:tasks.workunit.client.0.smithi134.stdout:1/760: symlink d5/d1a/d23/d8c/lf7 0 2024-02-16T22:18:59.951 INFO:tasks.workunit.client.0.smithi134.stdout:1/761: dread - d5/da/d21/d52/d9b/db6/ff1 zero size 2024-02-16T22:18:59.952 INFO:tasks.workunit.client.0.smithi134.stdout:0/783: symlink d2/d56/l103 0 2024-02-16T22:18:59.953 INFO:tasks.workunit.client.0.smithi134.stdout:3/794: symlink da/d1c/d24/d29/lfe 0 2024-02-16T22:18:59.953 INFO:tasks.workunit.client.0.smithi134.stdout:3/795: readlink da/d1c/d24/d29/d51/lf0 0 2024-02-16T22:18:59.954 INFO:tasks.workunit.client.0.smithi134.stdout:1/762: mknod d5/d1a/d53/d86/cf8 0 2024-02-16T22:18:59.954 INFO:tasks.workunit.client.0.smithi134.stdout:1/763: write d5/da/d21/d45/fcc [1027426,78624] 0 2024-02-16T22:18:59.955 INFO:tasks.workunit.client.0.smithi134.stdout:7/764: sync 2024-02-16T22:18:59.955 INFO:tasks.workunit.client.0.smithi134.stdout:6/869: sync 2024-02-16T22:18:59.955 INFO:tasks.workunit.client.0.smithi134.stdout:3/796: mkdir da/d1c/d24/dd5/de3/dff 0 2024-02-16T22:18:59.955 INFO:tasks.workunit.client.0.smithi134.stdout:3/797: write da/d6b/dc1/ff4 [1033549,128874] 0 2024-02-16T22:18:59.956 INFO:tasks.workunit.client.0.smithi134.stdout:3/798: chown da/d1c/c5a 29 1 2024-02-16T22:18:59.956 INFO:tasks.workunit.client.0.smithi134.stdout:3/799: write da/d1c/d24/d9a/dc0/d8a/d8f/d6d/fd9 [985861,2455] 0 2024-02-16T22:18:59.956 INFO:tasks.workunit.client.0.smithi134.stdout:0/784: getdents d2/d20/d77 0 2024-02-16T22:18:59.956 INFO:tasks.workunit.client.0.smithi134.stdout:9/977: dwrite db/d20/d22/d51/d9b/dbd/de9/d13b/fe6 [0,4194304] 0 2024-02-16T22:18:59.958 INFO:tasks.workunit.client.0.smithi134.stdout:7/765: mkdir d2/d5/d19/d4a/dfb 0 2024-02-16T22:18:59.959 INFO:tasks.workunit.client.0.smithi134.stdout:3/800: mkdir da/d1c/d24/d29/d51/d80/d89/d8e/dbc/d100 0 2024-02-16T22:18:59.960 INFO:tasks.workunit.client.0.smithi134.stdout:0/785: unlink d2/f11 0 2024-02-16T22:18:59.964 INFO:tasks.workunit.client.0.smithi134.stdout:4/646: dwrite d0/d6/d8/d32/d63/d6c/f83 [0,4194304] 0 2024-02-16T22:18:59.964 INFO:tasks.workunit.client.0.smithi134.stdout:4/647: chown d0/c4a 7 1 2024-02-16T22:18:59.964 INFO:tasks.workunit.client.0.smithi134.stdout:9/978: rename db/d20/d22/d51/fb5 to db/de0/d12e/f15e 0 2024-02-16T22:18:59.966 INFO:tasks.workunit.client.0.smithi134.stdout:3/801: creat da/d1c/d24/dd5/de3/f101 x:0 0 0 2024-02-16T22:18:59.966 INFO:tasks.workunit.client.0.smithi134.stdout:3/802: write da/f3a [2151865,71760] 0 2024-02-16T22:18:59.968 INFO:tasks.workunit.client.0.smithi134.stdout:8/775: dwrite d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/d7d/feb [0,4194304] 0 2024-02-16T22:18:59.968 INFO:tasks.workunit.client.0.smithi134.stdout:7/766: symlink d2/d6/lfc 0 2024-02-16T22:18:59.973 INFO:tasks.workunit.client.0.smithi134.stdout:9/979: write db/dc/f54 [1040679,58389] 0 2024-02-16T22:18:59.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:18:59 smithi134 ceph-mon[28869]: pgmap v252: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 163 MiB/s rd, 209 MiB/s wr, 407 op/s 2024-02-16T22:18:59.977 INFO:tasks.workunit.client.0.smithi134.stdout:8/776: rename d2/df/d18/d2a/d41/d59/da0/d40/d53/c55 to d2/df/d18/d2a/d41/d59/db1/d87/df2/c10b 0 2024-02-16T22:18:59.977 INFO:tasks.workunit.client.0.smithi134.stdout:8/777: chown d2/df/d18/c64 7546771 1 2024-02-16T22:18:59.977 INFO:tasks.workunit.client.0.smithi134.stdout:7/767: symlink d2/d6/d7d/d92/dcd/d7f/lfd 0 2024-02-16T22:18:59.980 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:18:59 smithi173 ceph-mon[37280]: pgmap v252: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 163 MiB/s rd, 209 MiB/s wr, 407 op/s 2024-02-16T22:18:59.981 INFO:tasks.workunit.client.0.smithi134.stdout:9/980: symlink db/d20/d22/d64/dc2/ddb/l15f 0 2024-02-16T22:18:59.981 INFO:tasks.workunit.client.0.smithi134.stdout:4/648: dwrite d0/d6/d58/f92 [0,4194304] 0 2024-02-16T22:18:59.982 INFO:tasks.workunit.client.0.smithi134.stdout:4/649: truncate d0/d6/d22/d97/daf/fc7 270136 0 2024-02-16T22:18:59.982 INFO:tasks.workunit.client.0.smithi134.stdout:4/650: creat d0/d6/d8/da2/d76/fdf x:0 0 0 2024-02-16T22:18:59.983 INFO:tasks.workunit.client.0.smithi134.stdout:3/803: dread da/d1c/d24/d9a/dc0/d8a/fef [0,4194304] 0 2024-02-16T22:18:59.983 INFO:tasks.workunit.client.0.smithi134.stdout:3/804: write da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/ff1 [118880,96102] 0 2024-02-16T22:18:59.983 INFO:tasks.workunit.client.0.smithi134.stdout:3/805: readlink da/d6b/dc1/lca 0 2024-02-16T22:18:59.983 INFO:tasks.workunit.client.0.smithi134.stdout:3/806: truncate da/d1c/d24/dd5/ff6 295948 0 2024-02-16T22:18:59.983 INFO:tasks.workunit.client.0.smithi134.stdout:8/778: creat d2/df/d18/d91/f10c x:0 0 0 2024-02-16T22:18:59.983 INFO:tasks.workunit.client.0.smithi134.stdout:8/779: fdatasync d2/df/d18/f45 0 2024-02-16T22:18:59.984 INFO:tasks.workunit.client.0.smithi134.stdout:7/768: mkdir d2/d5/d22/d26/dfe 0 2024-02-16T22:18:59.984 INFO:tasks.workunit.client.0.smithi134.stdout:7/769: readlink d2/d5/d19/d84/d86/d93/dab/l6a 0 2024-02-16T22:18:59.985 INFO:tasks.workunit.client.0.smithi134.stdout:9/981: unlink db/d20/d22/d64/d69/c78 0 2024-02-16T22:18:59.988 INFO:tasks.workunit.client.0.smithi134.stdout:5/803: sync 2024-02-16T22:18:59.988 INFO:tasks.workunit.client.0.smithi134.stdout:5/804: chown d2/d35/d36/d3d/d63/c59 40768122 1 2024-02-16T22:18:59.988 INFO:tasks.workunit.client.0.smithi134.stdout:5/805: fsync d2/d9/dc/daf/fd0 0 2024-02-16T22:18:59.989 INFO:tasks.workunit.client.0.smithi134.stdout:4/651: creat d0/d6/d1e/d39/fe0 x:0 0 0 2024-02-16T22:18:59.989 INFO:tasks.workunit.client.0.smithi134.stdout:4/652: creat d0/d6/d1e/d3b/fe1 x:0 0 0 2024-02-16T22:18:59.989 INFO:tasks.workunit.client.0.smithi134.stdout:4/653: stat d0/d31/c64 0 2024-02-16T22:18:59.989 INFO:tasks.workunit.client.0.smithi134.stdout:8/780: symlink d2/df/d18/l10d 0 2024-02-16T22:18:59.990 INFO:tasks.workunit.client.0.smithi134.stdout:8/781: chown d2/df/d18/d27/fbf 1679706 1 2024-02-16T22:18:59.990 INFO:tasks.workunit.client.0.smithi134.stdout:7/770: symlink d2/d5/d19/d84/d86/lff 0 2024-02-16T22:18:59.992 INFO:tasks.workunit.client.0.smithi134.stdout:9/982: creat db/d20/d22/d51/da2/f160 x:0 0 0 2024-02-16T22:18:59.993 INFO:tasks.workunit.client.0.smithi134.stdout:5/806: mkdir d2/d9/dc/d32/dd3/d103 0 2024-02-16T22:18:59.994 INFO:tasks.workunit.client.0.smithi134.stdout:1/764: dread d5/da/d21/d45/d93/faf [0,4194304] 0 2024-02-16T22:18:59.995 INFO:tasks.workunit.client.0.smithi134.stdout:4/654: creat d0/d6/d8/d32/d63/d6c/fe2 x:0 0 0 2024-02-16T22:18:59.995 INFO:tasks.workunit.client.0.smithi134.stdout:4/655: write d0/d6/d8/da2/d76/fdf [95467,128627] 0 2024-02-16T22:18:59.996 INFO:tasks.workunit.client.0.smithi134.stdout:4/656: chown d0/d6/d8/ld 60817247 1 2024-02-16T22:18:59.996 INFO:tasks.workunit.client.0.smithi134.stdout:0/786: dwrite d2/d20/d50/f9b [0,4194304] 0 2024-02-16T22:18:59.996 INFO:tasks.workunit.client.0.smithi134.stdout:9/983: mkdir db/d20/d22/d51/d9b/dbd/de9/d13b/d81/d161 0 2024-02-16T22:18:59.996 INFO:tasks.workunit.client.0.smithi134.stdout:9/984: readlink db/l48 0 2024-02-16T22:18:59.997 INFO:tasks.workunit.client.0.smithi134.stdout:9/985: creat db/d20/f162 x:0 0 0 2024-02-16T22:18:59.997 INFO:tasks.workunit.client.0.smithi134.stdout:9/986: chown db/d20/d22/d64/d69/f87 638841 1 2024-02-16T22:18:59.998 INFO:tasks.workunit.client.0.smithi134.stdout:5/807: rename d2/d35/d36/d3d/c93 to d2/d9/dc/d98/c104 0 2024-02-16T22:18:59.998 INFO:tasks.workunit.client.0.smithi134.stdout:5/808: chown d2/d9/f53 63 1 2024-02-16T22:19:00.000 INFO:tasks.workunit.client.0.smithi134.stdout:1/765: unlink d5/da/d21/d45/f8a 0 2024-02-16T22:19:00.004 INFO:tasks.workunit.client.0.smithi134.stdout:0/787: dread d2/f1c [8388608,4194304] 0 2024-02-16T22:19:00.005 INFO:tasks.workunit.client.0.smithi134.stdout:9/987: symlink db/d20/d22/d46/d115/dec/l163 0 2024-02-16T22:19:00.007 INFO:tasks.workunit.client.0.smithi134.stdout:5/809: unlink d2/d35/d36/f9b 0 2024-02-16T22:19:00.007 INFO:tasks.workunit.client.0.smithi134.stdout:1/766: mknod d5/d1a/d82/cf9 0 2024-02-16T22:19:00.007 INFO:tasks.workunit.client.0.smithi134.stdout:1/767: fdatasync d5/d1a/d23/d3c/d6a/fbb 0 2024-02-16T22:19:00.008 INFO:tasks.workunit.client.0.smithi134.stdout:0/788: symlink d2/dc/d97/l104 0 2024-02-16T22:19:00.018 INFO:tasks.workunit.client.0.smithi134.stdout:5/810: dwrite d2/d35/d36/d3d/d9c/d4b/fee [0,4194304] 0 2024-02-16T22:19:00.052 INFO:tasks.workunit.client.0.smithi134.stdout:9/988: unlink db/d20/d22/d51/c106 0 2024-02-16T22:19:00.053 INFO:tasks.workunit.client.0.smithi134.stdout:4/657: rename d0/d6/d8/da2/d76/ddb to d0/d31/db8/d1a/de3 0 2024-02-16T22:19:00.054 INFO:tasks.workunit.client.0.smithi134.stdout:1/768: creat d5/da/d21/d52/d9b/d9f/ffa x:0 0 0 2024-02-16T22:19:00.054 INFO:tasks.workunit.client.0.smithi134.stdout:1/769: stat d5/d1a/d4d/l6f 0 2024-02-16T22:19:00.096 INFO:tasks.workunit.client.0.smithi134.stdout:0/789: truncate d2/dc/d32/f42 200138 0 2024-02-16T22:19:00.100 INFO:tasks.workunit.client.0.smithi134.stdout:5/811: mkdir d2/d9/dc/df7/d105 0 2024-02-16T22:19:00.100 INFO:tasks.workunit.client.0.smithi134.stdout:5/812: chown d2/d9/f6f 23377278 1 2024-02-16T22:19:00.102 INFO:tasks.workunit.client.0.smithi134.stdout:2/700: sync 2024-02-16T22:19:00.102 INFO:tasks.workunit.client.0.smithi134.stdout:2/701: fsync df/d10/d3a/fb9 0 2024-02-16T22:19:00.102 INFO:tasks.workunit.client.0.smithi134.stdout:2/702: fdatasync df/d10/d15/d5a/f26 0 2024-02-16T22:19:00.102 INFO:tasks.workunit.client.0.smithi134.stdout:2/703: write df/d10/d15/d5a/d34/f68 [238230,111884] 0 2024-02-16T22:19:00.102 INFO:tasks.workunit.client.0.smithi134.stdout:2/704: creat df/d10/d30/d4d/d94/da3/fce x:0 0 0 2024-02-16T22:19:00.102 INFO:tasks.workunit.client.0.smithi134.stdout:9/989: mknod db/d20/d22/d64/dc2/d12f/c164 0 2024-02-16T22:19:00.104 INFO:tasks.workunit.client.0.smithi134.stdout:4/658: stat d0/d6/d1e/l37 0 2024-02-16T22:19:00.104 INFO:tasks.workunit.client.0.smithi134.stdout:4/659: chown d0/d6/d44/fd3 127581423 1 2024-02-16T22:19:00.105 INFO:tasks.workunit.client.0.smithi134.stdout:1/770: rmdir d5/da/d21 39 2024-02-16T22:19:00.107 INFO:tasks.workunit.client.0.smithi134.stdout:9/990: rename db/d20/d22/l27 to db/de0/def/l165 0 2024-02-16T22:19:00.108 INFO:tasks.workunit.client.0.smithi134.stdout:9/991: chown db/c5e 34387 1 2024-02-16T22:19:00.112 INFO:tasks.workunit.client.0.smithi134.stdout:9/992: creat db/d20/d22/d64/d69/d89/d11a/f166 x:0 0 0 2024-02-16T22:19:00.113 INFO:tasks.workunit.client.0.smithi134.stdout:5/813: write d2/d35/d36/d3d/d63/fa2 [2279955,128326] 0 2024-02-16T22:19:00.115 INFO:tasks.workunit.client.0.smithi134.stdout:7/771: sync 2024-02-16T22:19:00.115 INFO:tasks.workunit.client.0.smithi134.stdout:8/782: sync 2024-02-16T22:19:00.115 INFO:tasks.workunit.client.0.smithi134.stdout:3/807: sync 2024-02-16T22:19:00.115 INFO:tasks.workunit.client.0.smithi134.stdout:6/870: sync 2024-02-16T22:19:00.115 INFO:tasks.workunit.client.0.smithi134.stdout:3/808: creat da/d1c/d24/dd5/de3/f102 x:0 0 0 2024-02-16T22:19:00.115 INFO:tasks.workunit.client.0.smithi134.stdout:3/809: chown da/d1c/d24/d29/d51/d80/d89/d8e/de7 1699 1 2024-02-16T22:19:00.115 INFO:tasks.workunit.client.0.smithi134.stdout:7/772: write d2/d6/d7d/d92/dcd/f9f [1671583,91253] 0 2024-02-16T22:19:00.119 INFO:tasks.workunit.client.0.smithi134.stdout:1/771: dread d5/d1a/d23/d3c/d6a/fb9 [0,4194304] 0 2024-02-16T22:19:00.119 INFO:tasks.workunit.client.0.smithi134.stdout:1/772: chown d5/da/d21/d52/d9b/db6/fd9 2680 1 2024-02-16T22:19:00.119 INFO:tasks.workunit.client.0.smithi134.stdout:2/705: write df/d10/d30/d49/d82/d1b/f2f [4720015,69258] 0 2024-02-16T22:19:00.126 INFO:tasks.workunit.client.0.smithi134.stdout:4/660: rmdir d0/d6 39 2024-02-16T22:19:00.128 INFO:tasks.workunit.client.0.smithi134.stdout:9/993: truncate db/dc/f38 82669 0 2024-02-16T22:19:00.129 INFO:tasks.workunit.client.0.smithi134.stdout:5/814: mknod d2/d35/d36/d3d/c106 0 2024-02-16T22:19:00.132 INFO:tasks.workunit.client.0.smithi134.stdout:6/871: rename d17/d36/d77/d9a/d70 to d17/d36/d77/d121 0 2024-02-16T22:19:00.132 INFO:tasks.workunit.client.0.smithi134.stdout:1/773: mknod d5/da/d21/d52/cfb 0 2024-02-16T22:19:00.132 INFO:tasks.workunit.client.0.smithi134.stdout:1/774: fdatasync d5/da/d21/d52/d9b/db3/fd2 0 2024-02-16T22:19:00.132 INFO:tasks.workunit.client.0.smithi134.stdout:1/775: dread - d5/da/d21/d45/d93/fcd zero size 2024-02-16T22:19:00.137 INFO:tasks.workunit.client.0.smithi134.stdout:3/810: rename da/d1c/d24/d29/f49 to da/d1c/d24/dd5/f103 0 2024-02-16T22:19:00.137 INFO:tasks.workunit.client.0.smithi134.stdout:1/776: creat d5/da/dd6/ffc x:0 0 0 2024-02-16T22:19:00.139 INFO:tasks.workunit.client.0.smithi134.stdout:3/811: creat da/d1c/d24/d29/d51/d80/d89/d8e/dab/f104 x:0 0 0 2024-02-16T22:19:00.139 INFO:tasks.workunit.client.0.smithi134.stdout:3/812: write da/fb0 [3389725,64594] 0 2024-02-16T22:19:00.141 INFO:tasks.workunit.client.0.smithi134.stdout:1/777: rename d5/da/d21/d52/lf6 to d5/da/d2d/dca/lfd 0 2024-02-16T22:19:00.142 INFO:tasks.workunit.client.0.smithi134.stdout:1/778: creat d5/d1a/d4d/ffe x:0 0 0 2024-02-16T22:19:00.142 INFO:tasks.workunit.client.0.smithi134.stdout:1/779: chown d5/da/d21/d52/d9b/d9f/lc3 456806 1 2024-02-16T22:19:00.143 INFO:tasks.workunit.client.0.smithi134.stdout:3/813: creat da/d12/dd2/f105 x:0 0 0 2024-02-16T22:19:00.144 INFO:tasks.workunit.client.0.smithi134.stdout:6/872: dread f14 [4194304,4194304] 0 2024-02-16T22:19:00.145 INFO:tasks.workunit.client.0.smithi134.stdout:3/814: write da/d1c/d24/d9a/dc0/d8a/fd1 [191272,121475] 0 2024-02-16T22:19:00.145 INFO:tasks.workunit.client.0.smithi134.stdout:3/815: chown da/d1c/d24/d29/d51/f59 1788241 1 2024-02-16T22:19:00.145 INFO:tasks.workunit.client.0.smithi134.stdout:1/780: mknod d5/d1a/d4d/cff 0 2024-02-16T22:19:00.146 INFO:tasks.workunit.client.0.smithi134.stdout:6/873: mkdir d17/d27/d93/d9c/dec/d52/d119/d122 0 2024-02-16T22:19:00.147 INFO:tasks.workunit.client.0.smithi134.stdout:8/783: dwrite d2/df/d18/d2a/d41/d59/da0/d86/ffa [0,4194304] 0 2024-02-16T22:19:00.148 INFO:tasks.workunit.client.0.smithi134.stdout:3/816: mknod da/d1c/d24/d29/d51/d80/c106 0 2024-02-16T22:19:00.148 INFO:tasks.workunit.client.0.smithi134.stdout:5/815: write d2/d9/dc/d32/d61/fe7 [3434472,16492] 0 2024-02-16T22:19:00.148 INFO:tasks.workunit.client.0.smithi134.stdout:5/816: fdatasync d2/d35/d36/d3d/fe2 0 2024-02-16T22:19:00.148 INFO:tasks.workunit.client.0.smithi134.stdout:1/781: truncate d5/d1a/f31 1041189 0 2024-02-16T22:19:00.150 INFO:tasks.workunit.client.0.smithi134.stdout:6/874: symlink d17/d36/d77/d9a/d28/d5b/d88/d90/l123 0 2024-02-16T22:19:00.152 INFO:tasks.workunit.client.0.smithi134.stdout:8/784: creat d2/df/d18/d2a/d41/d59/da0/d40/d53/f10e x:0 0 0 2024-02-16T22:19:00.152 INFO:tasks.workunit.client.0.smithi134.stdout:8/785: creat d2/df/d18/d2a/d41/d59/da0/d40/f10f x:0 0 0 2024-02-16T22:19:00.152 INFO:tasks.workunit.client.0.smithi134.stdout:4/661: dwrite d0/d6/d1e/d3b/fe1 [0,4194304] 0 2024-02-16T22:19:00.153 INFO:tasks.workunit.client.0.smithi134.stdout:4/662: stat d0/d6/d1e/fdd 0 2024-02-16T22:19:00.154 INFO:tasks.workunit.client.0.smithi134.stdout:3/817: rename da/f11 to da/d1c/d24/dae/f107 0 2024-02-16T22:19:00.154 INFO:tasks.workunit.client.0.smithi134.stdout:1/782: write d5/d1a/d23/d3c/d6a/fb9 [301386,118019] 0 2024-02-16T22:19:00.154 INFO:tasks.workunit.client.0.smithi134.stdout:7/773: dwrite d2/d6/d7d/d9e/fe7 [0,4194304] 0 2024-02-16T22:19:00.154 INFO:tasks.workunit.client.0.smithi134.stdout:7/774: truncate d2/d6/d17/ff8 573973 0 2024-02-16T22:19:00.155 INFO:tasks.workunit.client.0.smithi134.stdout:5/817: mknod d2/d9/dc/d32/dce/c107 0 2024-02-16T22:19:00.157 INFO:tasks.workunit.client.0.smithi134.stdout:6/875: mkdir d17/d36/d77/d9a/d28/d5b/d124 0 2024-02-16T22:19:00.157 INFO:tasks.workunit.client.0.smithi134.stdout:6/876: creat d17/d27/d93/d9c/dec/dcb/f125 x:0 0 0 2024-02-16T22:19:00.160 INFO:tasks.workunit.client.0.smithi134.stdout:8/786: mkdir d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/d7d/d110 0 2024-02-16T22:19:00.160 INFO:tasks.workunit.client.0.smithi134.stdout:8/787: truncate d2/df/d7c/fc2 723178 0 2024-02-16T22:19:00.166 INFO:tasks.workunit.client.0.smithi134.stdout:3/818: mkdir da/d1c/d24/dd5/de3/dff/d108 0 2024-02-16T22:19:00.166 INFO:tasks.workunit.client.0.smithi134.stdout:3/819: write da/d1c/d24/d29/f45 [1441572,115294] 0 2024-02-16T22:19:00.173 INFO:tasks.workunit.client.0.smithi134.stdout:7/775: symlink d2/d5/d19/d84/d86/d93/dab/d40/l100 0 2024-02-16T22:19:00.173 INFO:tasks.workunit.client.0.smithi134.stdout:7/776: write d2/d5/d22/d83/dce/fd0 [11022,20257] 0 2024-02-16T22:19:00.174 INFO:tasks.workunit.client.0.smithi134.stdout:6/877: write d17/d36/d77/d9a/f7e [3961991,111310] 0 2024-02-16T22:19:00.174 INFO:tasks.workunit.client.0.smithi134.stdout:6/878: readlink d17/d27/d93/d9c/dec/d52/d79/d8b/lb6 0 2024-02-16T22:19:00.178 INFO:tasks.workunit.client.0.smithi134.stdout:7/777: mkdir d2/d5/d22/d83/d101 0 2024-02-16T22:19:00.179 INFO:tasks.workunit.client.0.smithi134.stdout:6/879: symlink d17/d27/d93/d9c/dec/d52/d79/d92/de6/d10e/l126 0 2024-02-16T22:19:00.180 INFO:tasks.workunit.client.0.smithi134.stdout:8/788: link d2/f36 d2/df/d18/dc5/f111 0 2024-02-16T22:19:00.186 INFO:tasks.workunit.client.0.smithi134.stdout:4/663: truncate d0/d6/d1e/d3b/fe1 1763120 0 2024-02-16T22:19:00.187 INFO:tasks.workunit.client.0.smithi134.stdout:4/664: dread - d0/d6/d44/db0/fc3 zero size 2024-02-16T22:19:00.192 INFO:tasks.workunit.client.0.smithi134.stdout:7/778: dread d2/d5/d22/f66 [4194304,4194304] 0 2024-02-16T22:19:00.197 INFO:tasks.workunit.client.0.smithi134.stdout:1/783: dwrite d5/d1a/d53/d86/f9d [0,4194304] 0 2024-02-16T22:19:00.200 INFO:tasks.workunit.client.0.smithi134.stdout:7/779: creat d2/f102 x:0 0 0 2024-02-16T22:19:00.200 INFO:tasks.workunit.client.0.smithi134.stdout:7/780: fsync d2/f4 0 2024-02-16T22:19:00.201 INFO:tasks.workunit.client.0.smithi134.stdout:7/781: chown d2/d5/f2d 2 1 2024-02-16T22:19:00.201 INFO:tasks.workunit.client.0.smithi134.stdout:7/782: chown d2/d5/d19/f2f 18 1 2024-02-16T22:19:00.202 INFO:tasks.workunit.client.0.smithi134.stdout:3/820: dwrite da/d1c/d24/d29/d51/f70 [4194304,4194304] 0 2024-02-16T22:19:00.204 INFO:tasks.workunit.client.0.smithi134.stdout:5/818: dwrite d2/f6 [4194304,4194304] 0 2024-02-16T22:19:00.204 INFO:tasks.workunit.client.0.smithi134.stdout:6/880: dwrite d17/dfd/de2/f100 [0,4194304] 0 2024-02-16T22:19:00.204 INFO:tasks.workunit.client.0.smithi134.stdout:6/881: readlink d17/d27/d93/d9c/dec/d52/d79/d92/lf3 0 2024-02-16T22:19:00.209 INFO:tasks.workunit.client.0.smithi134.stdout:1/784: dread d5/f46 [0,4194304] 0 2024-02-16T22:19:00.211 INFO:tasks.workunit.client.0.smithi134.stdout:1/785: truncate d5/d1a/d23/d3c/d6a/d5c/d72/f79 403536 0 2024-02-16T22:19:00.212 INFO:tasks.workunit.client.0.smithi134.stdout:1/786: creat d5/da/d2d/de0/f100 x:0 0 0 2024-02-16T22:19:00.216 INFO:tasks.workunit.client.0.smithi134.stdout:5/819: write d2/fa [5644376,49097] 0 2024-02-16T22:19:00.221 INFO:tasks.workunit.client.0.smithi134.stdout:1/787: dread d5/da/d2d/f50 [0,4194304] 0 2024-02-16T22:19:00.221 INFO:tasks.workunit.client.0.smithi134.stdout:1/788: write d5/d1a/d23/d3c/d6a/f51 [1251514,76249] 0 2024-02-16T22:19:00.222 INFO:tasks.workunit.client.0.smithi134.stdout:1/789: mknod d5/c101 0 2024-02-16T22:19:00.223 INFO:tasks.workunit.client.0.smithi134.stdout:1/790: write d5/da/d21/d52/d9b/fb1 [713065,16324] 0 2024-02-16T22:19:00.223 INFO:tasks.workunit.client.0.smithi134.stdout:1/791: mkdir d5/da/d102 0 2024-02-16T22:19:00.223 INFO:tasks.workunit.client.0.smithi134.stdout:1/792: write d5/da/db8/fe4 [731800,97759] 0 2024-02-16T22:19:00.225 INFO:tasks.workunit.client.0.smithi134.stdout:1/793: rename d5/da/db8/fe4 to d5/d1a/d23/d85/f103 0 2024-02-16T22:19:00.225 INFO:tasks.workunit.client.0.smithi134.stdout:1/794: chown d5/d1a/d23/d85/lc8 4 1 2024-02-16T22:19:00.226 INFO:tasks.workunit.client.0.smithi134.stdout:1/795: symlink d5/da/db8/dd5/l104 0 2024-02-16T22:19:00.228 INFO:tasks.workunit.client.0.smithi134.stdout:4/665: dwrite d0/d6/d58/fc1 [0,4194304] 0 2024-02-16T22:19:00.228 INFO:tasks.workunit.client.0.smithi134.stdout:4/666: read - d0/d6/d22/d40/fd5 zero size 2024-02-16T22:19:00.228 INFO:tasks.workunit.client.0.smithi134.stdout:4/667: chown d0/d6/d22/d25/d2a/db4/fd2 1 1 2024-02-16T22:19:00.228 INFO:tasks.workunit.client.0.smithi134.stdout:4/668: truncate d0/d6/d8/d5e/fbd 553194 0 2024-02-16T22:19:00.228 INFO:tasks.workunit.client.0.smithi134.stdout:8/789: dwrite d2/df/d18/d2a/d41/d59/da0/f93 [0,4194304] 0 2024-02-16T22:19:00.228 INFO:tasks.workunit.client.0.smithi134.stdout:1/796: mknod d5/d1a/d23/d3c/d6a/d5c/d72/c105 0 2024-02-16T22:19:00.228 INFO:tasks.workunit.client.0.smithi134.stdout:1/797: creat d5/d1a/d82/f106 x:0 0 0 2024-02-16T22:19:00.229 INFO:tasks.workunit.client.0.smithi134.stdout:3/821: dwrite da/d1c/d24/d29/faf [0,4194304] 0 2024-02-16T22:19:00.229 INFO:tasks.workunit.client.0.smithi134.stdout:4/669: rmdir d0/d6/d8/d5e 39 2024-02-16T22:19:00.231 INFO:tasks.workunit.client.0.smithi134.stdout:5/820: read d2/d9/dc/d15/d2f/fbb [873427,28472] 0 2024-02-16T22:19:00.231 INFO:tasks.workunit.client.0.smithi134.stdout:5/821: chown d2/d35/d36 0 1 2024-02-16T22:19:00.234 INFO:tasks.workunit.client.0.smithi134.stdout:8/790: unlink d2/df/d18/d12/f6a 0 2024-02-16T22:19:00.238 INFO:tasks.workunit.client.0.smithi134.stdout:3/822: rename da/d12/d2a/da4 to da/d1c/d24/d29/d51/d79/d109 0 2024-02-16T22:19:00.238 INFO:tasks.workunit.client.0.smithi134.stdout:3/823: write da/d12/dd2/f105 [51241,54799] 0 2024-02-16T22:19:00.239 INFO:tasks.workunit.client.0.smithi134.stdout:4/670: getdents d0 0 2024-02-16T22:19:00.239 INFO:tasks.workunit.client.0.smithi134.stdout:4/671: write d0/d6/d22/d25/f90 [1169136,113520] 0 2024-02-16T22:19:00.240 INFO:tasks.workunit.client.0.smithi134.stdout:5/822: rmdir d2/d35/d36/d3d/d9c/dc2/dc8 39 2024-02-16T22:19:00.240 INFO:tasks.workunit.client.0.smithi134.stdout:5/823: fdatasync d2/d9/dc/daf/fd0 0 2024-02-16T22:19:00.240 INFO:tasks.workunit.client.0.smithi134.stdout:5/824: creat d2/d35/d36/d3d/d9c/d4b/f108 x:0 0 0 2024-02-16T22:19:00.259 INFO:tasks.workunit.client.0.smithi134.stdout:4/672: dwrite d0/d6/d22/d25/f3d [0,4194304] 0 2024-02-16T22:19:00.357 INFO:tasks.workunit.client.0.smithi134.stdout:3/824: dwrite da/d1c/d24/d29/d51/f87 [0,4194304] 0 2024-02-16T22:19:00.381 INFO:tasks.workunit.client.0.smithi134.stdout:3/825: dread - da/d1c/d24/dd5/de3/f101 zero size 2024-02-16T22:19:00.383 INFO:tasks.workunit.client.0.smithi134.stdout:8/791: write d2/f2c [3881365,7559] 0 2024-02-16T22:19:00.383 INFO:tasks.workunit.client.0.smithi134.stdout:5/825: creat d2/d9/dc/d32/dce/f109 x:0 0 0 2024-02-16T22:19:00.383 INFO:tasks.workunit.client.0.smithi134.stdout:4/673: symlink d0/d6/d44/le4 0 2024-02-16T22:19:00.383 INFO:tasks.workunit.client.0.smithi134.stdout:3/826: rename da/d1c/d24/d29/d51/d79/d109/dcd to da/dc3/d10a 0 2024-02-16T22:19:00.383 INFO:tasks.workunit.client.0.smithi134.stdout:3/827: dread - da/d12/fe4 zero size 2024-02-16T22:19:00.384 INFO:tasks.workunit.client.0.smithi134.stdout:8/792: dread d2/df/d18/d2a/d41/d59/da0/d40/d53/daa/d105/fb8 [0,4194304] 0 2024-02-16T22:19:00.384 INFO:tasks.workunit.client.0.smithi134.stdout:8/793: dread - d2/df/d18/d2a/d41/d59/da0/d86/ff9 zero size 2024-02-16T22:19:00.384 INFO:tasks.workunit.client.0.smithi134.stdout:4/674: rename d0/d31/db8/ld0 to d0/d6/d8/d30/le5 0 2024-02-16T22:19:00.384 INFO:tasks.workunit.client.0.smithi134.stdout:8/794: getdents d2/df/d18/d2a/d41/d59/da0/d40/d53/daa/df1 0 2024-02-16T22:19:00.384 INFO:tasks.workunit.client.0.smithi134.stdout:5/826: rmdir d2/d35/d36 39 2024-02-16T22:19:00.384 INFO:tasks.workunit.client.0.smithi134.stdout:4/675: creat d0/d6/d22/d25/d2a/fe6 x:0 0 0 2024-02-16T22:19:00.384 INFO:tasks.workunit.client.0.smithi134.stdout:4/676: read d0/d31/db8/f28 [989574,55590] 0 2024-02-16T22:19:00.384 INFO:tasks.workunit.client.0.smithi134.stdout:4/677: write d0/d6/d8/d32/d63/d6c/fe2 [864934,101122] 0 2024-02-16T22:19:00.384 INFO:tasks.workunit.client.0.smithi134.stdout:0/790: sync 2024-02-16T22:19:00.384 INFO:tasks.workunit.client.0.smithi134.stdout:9/994: sync 2024-02-16T22:19:00.384 INFO:tasks.workunit.client.0.smithi134.stdout:2/706: sync 2024-02-16T22:19:00.384 INFO:tasks.workunit.client.0.smithi134.stdout:0/791: readlink d2/dc/da0/lc3 0 2024-02-16T22:19:00.384 INFO:tasks.workunit.client.0.smithi134.stdout:5/827: mknod d2/d35/d36/d3d/c10a 0 2024-02-16T22:19:00.385 INFO:tasks.workunit.client.0.smithi134.stdout:6/882: sync 2024-02-16T22:19:00.385 INFO:tasks.workunit.client.0.smithi134.stdout:7/783: sync 2024-02-16T22:19:00.385 INFO:tasks.workunit.client.0.smithi134.stdout:4/678: creat d0/d6/d44/da9/fe7 x:0 0 0 2024-02-16T22:19:00.385 INFO:tasks.workunit.client.0.smithi134.stdout:5/828: write d2/d9/dc/daf/fb8 [387136,37057] 0 2024-02-16T22:19:00.386 INFO:tasks.workunit.client.0.smithi134.stdout:8/795: unlink d2/l4b 0 2024-02-16T22:19:00.386 INFO:tasks.workunit.client.0.smithi134.stdout:0/792: truncate d2/dc/d32/d3e/f80 3785300 0 2024-02-16T22:19:00.386 INFO:tasks.workunit.client.0.smithi134.stdout:0/793: write d2/dc/d32/d3e/dc1/fe8 [138923,123523] 0 2024-02-16T22:19:00.386 INFO:tasks.workunit.client.0.smithi134.stdout:0/794: write d2/dc/d32/d45/fc6 [1561342,118532] 0 2024-02-16T22:19:00.386 INFO:tasks.workunit.client.0.smithi134.stdout:6/883: mkdir d17/d27/d93/d9c/dec/d127 0 2024-02-16T22:19:00.387 INFO:tasks.workunit.client.0.smithi134.stdout:7/784: rename d2/d5/d19/d4a/lc0 to d2/d6/dcc/l103 0 2024-02-16T22:19:00.389 INFO:tasks.workunit.client.0.smithi134.stdout:4/679: unlink d0/d6/d8/da2/d76/lba 0 2024-02-16T22:19:00.389 INFO:tasks.workunit.client.0.smithi134.stdout:4/680: stat d0/d6/d22/fb1 0 2024-02-16T22:19:00.389 INFO:tasks.workunit.client.0.smithi134.stdout:4/681: stat d0/d6/d8/da2 0 2024-02-16T22:19:00.390 INFO:tasks.workunit.client.0.smithi134.stdout:5/829: link d2/d35/d36/d3d/d9c/d4b/l5e d2/d9/l10b 0 2024-02-16T22:19:00.392 INFO:tasks.workunit.client.0.smithi134.stdout:8/796: mknod d2/df/d18/d2a/d41/d59/da0/c112 0 2024-02-16T22:19:00.392 INFO:tasks.workunit.client.0.smithi134.stdout:6/884: symlink d17/d27/d93/d9c/de7/l128 0 2024-02-16T22:19:00.395 INFO:tasks.workunit.client.0.smithi134.stdout:0/795: rename d2/dc/ff8 to d2/dc/dc4/ddc/f105 0 2024-02-16T22:19:00.395 INFO:tasks.workunit.client.0.smithi134.stdout:0/796: dread - d2/dc/d2d/d34/fad zero size 2024-02-16T22:19:00.395 INFO:tasks.workunit.client.0.smithi134.stdout:0/797: readlink d2/d4b/d53/le0 0 2024-02-16T22:19:00.395 INFO:tasks.workunit.client.0.smithi134.stdout:2/707: write df/d10/d30/d49/d82/f79 [1847410,22402] 0 2024-02-16T22:19:00.395 INFO:tasks.workunit.client.0.smithi134.stdout:2/708: chown df 185686219 1 2024-02-16T22:19:00.395 INFO:tasks.workunit.client.0.smithi134.stdout:2/709: dread - df/d10/d30/d49/d82/d1b/fc3 zero size 2024-02-16T22:19:00.395 INFO:tasks.workunit.client.0.smithi134.stdout:2/710: fsync df/d10/d15/d5a/f4c 0 2024-02-16T22:19:00.395 INFO:tasks.workunit.client.0.smithi134.stdout:5/830: dread d2/d8f/fa4 [0,4194304] 0 2024-02-16T22:19:00.397 INFO:tasks.workunit.client.0.smithi134.stdout:6/885: dread d17/d36/d77/d9a/f5f [0,4194304] 0 2024-02-16T22:19:00.397 INFO:tasks.workunit.client.0.smithi134.stdout:6/886: creat d17/d36/d77/d9a/d73/f129 x:0 0 0 2024-02-16T22:19:00.399 INFO:tasks.workunit.client.0.smithi134.stdout:5/831: creat d2/d9/dc/daf/f10c x:0 0 0 2024-02-16T22:19:00.399 INFO:tasks.workunit.client.0.smithi134.stdout:5/832: fsync d2/d35/d36/d3d/fa3 0 2024-02-16T22:19:00.402 INFO:tasks.workunit.client.0.smithi134.stdout:8/797: rename d2/d80/cac to d2/df/d18/d2a/d41/c113 0 2024-02-16T22:19:00.402 INFO:tasks.workunit.client.0.smithi134.stdout:8/798: truncate d2/df/d18/d2a/d41/d59/da0/d40/d53/f10e 636224 0 2024-02-16T22:19:00.402 INFO:tasks.workunit.client.0.smithi134.stdout:8/799: truncate d2/df/d18/d27/dc4/fcd 1375798 0 2024-02-16T22:19:00.402 INFO:tasks.workunit.client.0.smithi134.stdout:8/800: fdatasync d2/df/d18/d2a/d41/d59/db1/d87/fea 0 2024-02-16T22:19:00.402 INFO:tasks.workunit.client.0.smithi134.stdout:8/801: read - d2/df/d18/d2a/d41/d59/fed zero size 2024-02-16T22:19:00.402 INFO:tasks.workunit.client.0.smithi134.stdout:8/802: write d2/df/d18/d27/d85/da4/fca [27862,92452] 0 2024-02-16T22:19:00.402 INFO:tasks.workunit.client.0.smithi134.stdout:8/803: chown d2/df/d18/d2a/d41/d59/da0/d40/d53/daa/df1 301053704 1 2024-02-16T22:19:00.403 INFO:tasks.workunit.client.0.smithi134.stdout:5/833: dread d2/d9/dc/d15/d2f/fc1 [0,4194304] 0 2024-02-16T22:19:00.403 INFO:tasks.workunit.client.0.smithi134.stdout:2/711: mknod df/d10/d30/ccf 0 2024-02-16T22:19:00.404 INFO:tasks.workunit.client.0.smithi134.stdout:8/804: unlink d2/df/d18/d2a/d41/d59/db1/d87/fd5 0 2024-02-16T22:19:00.405 INFO:tasks.workunit.client.0.smithi134.stdout:2/712: creat df/d10/d30/d49/d85/fd0 x:0 0 0 2024-02-16T22:19:00.405 INFO:tasks.workunit.client.0.smithi134.stdout:2/713: write df/d10/d15/d5a/f48 [679547,45174] 0 2024-02-16T22:19:00.406 INFO:tasks.workunit.client.0.smithi134.stdout:8/805: rmdir d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/d7d 39 2024-02-16T22:19:00.408 INFO:tasks.workunit.client.0.smithi134.stdout:2/714: rename df/d10/d30/d4d/f93 to df/d10/d15/d5a/fd1 0 2024-02-16T22:19:00.410 INFO:tasks.workunit.client.0.smithi134.stdout:8/806: rename d2/df/d18/d2a/d41/d59/db1/d87/fea to d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/dd3/f114 0 2024-02-16T22:19:00.410 INFO:tasks.workunit.client.0.smithi134.stdout:8/807: chown d2/df/ce1 147 1 2024-02-16T22:19:00.411 INFO:tasks.workunit.client.0.smithi134.stdout:6/887: dread d17/d27/f8d [0,4194304] 0 2024-02-16T22:19:00.412 INFO:tasks.workunit.client.0.smithi134.stdout:8/808: symlink d2/df/d18/db5/l115 0 2024-02-16T22:19:00.412 INFO:tasks.workunit.client.0.smithi134.stdout:3/828: dwrite da/d12/d2a/f38 [4194304,4194304] 0 2024-02-16T22:19:00.412 INFO:tasks.workunit.client.0.smithi134.stdout:0/798: dread d2/d20/d50/f51 [0,4194304] 0 2024-02-16T22:19:00.413 INFO:tasks.workunit.client.0.smithi134.stdout:3/829: link da/d12/f7b da/d12/f10b 0 2024-02-16T22:19:00.417 INFO:tasks.workunit.client.0.smithi134.stdout:3/830: getdents da/d12/dd2 0 2024-02-16T22:19:00.424 INFO:tasks.workunit.client.0.smithi134.stdout:3/831: rename da/d12/d2a/l33 to da/d1c/d24/dae/l10c 0 2024-02-16T22:19:00.426 INFO:tasks.workunit.client.0.smithi134.stdout:3/832: creat da/d1c/d24/d29/d51/d79/d109/f10d x:0 0 0 2024-02-16T22:19:00.426 INFO:tasks.workunit.client.0.smithi134.stdout:3/833: truncate da/d1c/d24/d29/d51/d80/d89/d8e/dab/f104 173461 0 2024-02-16T22:19:00.427 INFO:tasks.workunit.client.0.smithi134.stdout:0/799: dread d2/d20/d7a/fb3 [0,4194304] 0 2024-02-16T22:19:00.429 INFO:tasks.workunit.client.0.smithi134.stdout:0/800: link d2/db7/c96 d2/dc/d32/d3e/d5e/dff/c106 0 2024-02-16T22:19:00.429 INFO:tasks.workunit.client.0.smithi134.stdout:0/801: truncate d2/dc/d32/d3e/d5e/fea 49761 0 2024-02-16T22:19:00.437 INFO:tasks.workunit.client.0.smithi134.stdout:1/798: sync 2024-02-16T22:19:00.438 INFO:tasks.workunit.client.0.smithi134.stdout:1/799: readlink d5/d1a/d23/d85/lc8 0 2024-02-16T22:19:00.439 INFO:tasks.workunit.client.0.smithi134.stdout:1/800: rmdir d5/d1a/d23/d3c/d6a/df5 0 2024-02-16T22:19:00.444 INFO:tasks.workunit.client.0.smithi134.stdout:4/682: dwrite d0/d6/d8/d32/d63/d6c/fe2 [0,4194304] 0 2024-02-16T22:19:00.445 INFO:tasks.workunit.client.0.smithi134.stdout:7/785: dwrite d2/d6/d7d/d92/dcd/d7f/d24/f5a [0,4194304] 0 2024-02-16T22:19:00.446 INFO:tasks.workunit.client.0.smithi134.stdout:1/801: dread d5/d1a/f31 [0,4194304] 0 2024-02-16T22:19:00.448 INFO:tasks.workunit.client.0.smithi134.stdout:4/683: dread d0/d6/d22/d40/f41 [0,4194304] 0 2024-02-16T22:19:00.448 INFO:tasks.workunit.client.0.smithi134.stdout:7/786: mkdir d2/d5/d19/d84/d86/d93/dab/d40/df1/d104 0 2024-02-16T22:19:00.451 INFO:tasks.workunit.client.0.smithi134.stdout:1/802: mkdir d5/d1a/d23/d85/d107 0 2024-02-16T22:19:00.451 INFO:tasks.workunit.client.0.smithi134.stdout:1/803: chown d5/da/d21/d52/d9b/db6/fd9 2971 1 2024-02-16T22:19:00.453 INFO:tasks.workunit.client.0.smithi134.stdout:1/804: unlink d5/da/d2d/fdf 0 2024-02-16T22:19:00.453 INFO:tasks.workunit.client.0.smithi134.stdout:1/805: write d5/da/d2d/f50 [4250916,124802] 0 2024-02-16T22:19:00.461 INFO:tasks.workunit.client.0.smithi134.stdout:2/715: dwrite df/d10/da6/fc6 [0,4194304] 0 2024-02-16T22:19:00.461 INFO:tasks.workunit.client.0.smithi134.stdout:6/888: dwrite d17/dfd/de2/f100 [0,4194304] 0 2024-02-16T22:19:00.461 INFO:tasks.workunit.client.0.smithi134.stdout:5/834: dwrite d2/f6d [0,4194304] 0 2024-02-16T22:19:00.465 INFO:tasks.workunit.client.0.smithi134.stdout:5/835: rmdir d2/d9/dc/df7 39 2024-02-16T22:19:00.465 INFO:tasks.workunit.client.0.smithi134.stdout:5/836: chown f0 930800 1 2024-02-16T22:19:00.465 INFO:tasks.workunit.client.0.smithi134.stdout:5/837: readlink d2/d9/dc/d98/db3/ld8 0 2024-02-16T22:19:00.472 INFO:tasks.workunit.client.0.smithi134.stdout:2/716: read df/d10/d30/fac [2062328,34481] 0 2024-02-16T22:19:00.475 INFO:tasks.workunit.client.0.smithi134.stdout:8/809: dwrite d2/df/d18/d2a/d41/d59/da0/f51 [0,4194304] 0 2024-02-16T22:19:00.475 INFO:tasks.workunit.client.0.smithi134.stdout:0/802: dwrite d2/dc/d2d/d34/fad [0,4194304] 0 2024-02-16T22:19:00.476 INFO:tasks.workunit.client.0.smithi134.stdout:3/834: dwrite da/d12/d2a/f38 [4194304,4194304] 0 2024-02-16T22:19:00.478 INFO:tasks.workunit.client.0.smithi134.stdout:0/803: mknod d2/dc/d32/d3e/d5e/dff/c107 0 2024-02-16T22:19:00.478 INFO:tasks.workunit.client.0.smithi134.stdout:0/804: dread - d2/dc/d2d/d34/d87/fd7 zero size 2024-02-16T22:19:00.478 INFO:tasks.workunit.client.0.smithi134.stdout:3/835: creat da/d1c/d24/d29/d51/d80/d89/d8e/de7/f10e x:0 0 0 2024-02-16T22:19:00.480 INFO:tasks.workunit.client.0.smithi134.stdout:0/805: rename d2/d20/da3 to d2/d20/d77/d85/db6/d108 0 2024-02-16T22:19:00.480 INFO:tasks.workunit.client.0.smithi134.stdout:0/806: write d2/d4b/d53/fcb [557865,123336] 0 2024-02-16T22:19:00.486 INFO:tasks.workunit.client.0.smithi134.stdout:7/787: dwrite d2/d5/d19/d84/d86/d93/dab/d40/fe6 [0,4194304] 0 2024-02-16T22:19:00.486 INFO:tasks.workunit.client.0.smithi134.stdout:1/806: dwrite d5/f3f [0,4194304] 0 2024-02-16T22:19:00.492 INFO:tasks.workunit.client.0.smithi134.stdout:1/807: mknod d5/da/d2d/de0/c108 0 2024-02-16T22:19:00.492 INFO:tasks.workunit.client.0.smithi134.stdout:2/717: dread df/d41/f8e [0,4194304] 0 2024-02-16T22:19:00.492 INFO:tasks.workunit.client.0.smithi134.stdout:4/684: dwrite d0/d6/d22/fb1 [0,4194304] 0 2024-02-16T22:19:00.498 INFO:tasks.workunit.client.0.smithi134.stdout:8/810: write d2/df/d18/d2a/d41/d59/da0/f51 [14148,85732] 0 2024-02-16T22:19:00.499 INFO:tasks.workunit.client.0.smithi134.stdout:6/889: dwrite d17/d27/d93/d9c/dec/f55 [0,4194304] 0 2024-02-16T22:19:00.499 INFO:tasks.workunit.client.0.smithi134.stdout:3/836: dread da/fb0 [0,4194304] 0 2024-02-16T22:19:00.510 INFO:tasks.workunit.client.0.smithi134.stdout:6/890: rmdir d17/d27 39 2024-02-16T22:19:00.511 INFO:tasks.workunit.client.0.smithi134.stdout:4/685: symlink d0/d31/db8/d46/le8 0 2024-02-16T22:19:00.512 INFO:tasks.workunit.client.0.smithi134.stdout:4/686: stat d0/d6/d8/d30/c3c 0 2024-02-16T22:19:00.519 INFO:tasks.workunit.client.0.smithi134.stdout:0/807: dwrite d2/d20/d7a/d7e/ff7 [0,4194304] 0 2024-02-16T22:19:00.524 INFO:tasks.workunit.client.0.smithi134.stdout:0/808: rename d2/d4b/d53/fcb to d2/d20/d77/d85/de2/f109 0 2024-02-16T22:19:00.526 INFO:tasks.workunit.client.0.smithi134.stdout:6/891: write d17/d27/d93/d9c/dec/f68 [1257388,80360] 0 2024-02-16T22:19:00.527 INFO:tasks.workunit.client.0.smithi134.stdout:6/892: write d17/d36/dd0/f98 [333039,107772] 0 2024-02-16T22:19:00.527 INFO:tasks.workunit.client.0.smithi134.stdout:6/893: rmdir d17 39 2024-02-16T22:19:00.530 INFO:tasks.workunit.client.0.smithi134.stdout:6/894: dread d17/d36/d77/d121/f7d [0,4194304] 0 2024-02-16T22:19:00.531 INFO:tasks.workunit.client.0.smithi134.stdout:6/895: getdents d17/d27/d30 0 2024-02-16T22:19:00.533 INFO:tasks.workunit.client.0.smithi134.stdout:9/995: sync 2024-02-16T22:19:00.537 INFO:tasks.workunit.client.0.smithi134.stdout:1/808: dwrite d5/da/d2d/f84 [0,4194304] 0 2024-02-16T22:19:00.537 INFO:tasks.workunit.client.0.smithi134.stdout:1/809: stat d5/d1a/d4d/lae 0 2024-02-16T22:19:00.538 INFO:tasks.workunit.client.0.smithi134.stdout:1/810: write d5/d1a/d63/f92 [976136,95077] 0 2024-02-16T22:19:00.538 INFO:tasks.workunit.client.0.smithi134.stdout:1/811: chown d5/fd0 4041750 1 2024-02-16T22:19:00.540 INFO:tasks.workunit.client.0.smithi134.stdout:7/788: dwrite d2/d5/d19/f1d [0,4194304] 0 2024-02-16T22:19:00.541 INFO:tasks.workunit.client.0.smithi134.stdout:7/789: fsync d2/d5/f8b 0 2024-02-16T22:19:00.541 INFO:tasks.workunit.client.0.smithi134.stdout:4/687: dwrite d0/d6/d22/d25/f73 [0,4194304] 0 2024-02-16T22:19:00.541 INFO:tasks.workunit.client.0.smithi134.stdout:4/688: chown d0/d6/d8/d32/d63/d6c/f83 4 1 2024-02-16T22:19:00.546 INFO:tasks.workunit.client.0.smithi134.stdout:2/718: dwrite df/d10/d30/f9a [0,4194304] 0 2024-02-16T22:19:00.548 INFO:tasks.workunit.client.0.smithi134.stdout:2/719: mkdir df/d6f/dd2 0 2024-02-16T22:19:00.548 INFO:tasks.workunit.client.0.smithi134.stdout:8/811: dwrite d2/f1b [0,4194304] 0 2024-02-16T22:19:00.550 INFO:tasks.workunit.client.0.smithi134.stdout:1/812: dread d5/d1a/d23/d3c/f41 [0,4194304] 0 2024-02-16T22:19:00.551 INFO:tasks.workunit.client.0.smithi134.stdout:2/720: symlink df/d10/d30/d49/d85/d9b/ld3 0 2024-02-16T22:19:00.552 INFO:tasks.workunit.client.0.smithi134.stdout:8/812: creat d2/df/d18/db5/dce/f116 x:0 0 0 2024-02-16T22:19:00.554 INFO:tasks.workunit.client.0.smithi134.stdout:1/813: rename d5/d1a/d23/d85/d107 to d5/d1a/d23/d8c/d109 0 2024-02-16T22:19:00.557 INFO:tasks.workunit.client.0.smithi134.stdout:1/814: write d5/da/d21/d45/fad [255912,112952] 0 2024-02-16T22:19:00.558 INFO:tasks.workunit.client.0.smithi134.stdout:1/815: getdents d5/da/d21/d52/d9b/db6 0 2024-02-16T22:19:00.559 INFO:tasks.workunit.client.0.smithi134.stdout:1/816: stat d5/da/d21/d52/l87 0 2024-02-16T22:19:00.567 INFO:tasks.workunit.client.0.smithi134.stdout:0/809: dwrite d2/dc/d48/f4c [0,4194304] 0 2024-02-16T22:19:00.579 INFO:tasks.workunit.client.0.smithi134.stdout:6/896: dwrite d17/d36/d77/d9a/f54 [4194304,4194304] 0 2024-02-16T22:19:00.579 INFO:tasks.workunit.client.0.smithi134.stdout:6/897: write d17/dfd/dbc/fbd [2541071,11206] 0 2024-02-16T22:19:00.579 INFO:tasks.workunit.client.0.smithi134.stdout:6/898: truncate d17/d27/f8d 5219687 0 2024-02-16T22:19:00.580 INFO:tasks.workunit.client.0.smithi134.stdout:6/899: symlink d17/d36/d77/d9a/d73/l12a 0 2024-02-16T22:19:00.580 INFO:tasks.workunit.client.0.smithi134.stdout:6/900: fsync d17/d27/d93/d9c/dec/f11a 0 2024-02-16T22:19:00.580 INFO:tasks.workunit.client.0.smithi134.stdout:6/901: creat d17/d36/dd0/daa/f12b x:0 0 0 2024-02-16T22:19:00.580 INFO:tasks.workunit.client.0.smithi134.stdout:6/902: write d17/d36/d77/d9a/ff1 [969039,119470] 0 2024-02-16T22:19:00.643 INFO:tasks.workunit.client.0.smithi134.stdout:7/790: dwrite d2/d6/d17/d31/d28/f6c [0,4194304] 0 2024-02-16T22:19:00.644 INFO:tasks.workunit.client.0.smithi134.stdout:4/689: dwrite d0/f11 [0,4194304] 0 2024-02-16T22:19:00.644 INFO:tasks.workunit.client.0.smithi134.stdout:9/996: dwrite db/d20/d22/d51/f74 [4194304,4194304] 0 2024-02-16T22:19:00.647 INFO:tasks.workunit.client.0.smithi134.stdout:7/791: dread d2/d6/d7d/d92/dcd/f9f [0,4194304] 0 2024-02-16T22:19:00.647 INFO:tasks.workunit.client.0.smithi134.stdout:7/792: chown d2/d5/d4c/l64 228317417 1 2024-02-16T22:19:00.647 INFO:tasks.workunit.client.0.smithi134.stdout:7/793: chown d2/d6/d7d/d92/da5/d63/l98 1632665 1 2024-02-16T22:19:00.647 INFO:tasks.workunit.client.0.smithi134.stdout:7/794: chown d2/d5/d22/c73 2 1 2024-02-16T22:19:00.647 INFO:tasks.workunit.client.0.smithi134.stdout:7/795: chown d2/d6/d17/d31/f6f 6244794 1 2024-02-16T22:19:00.647 INFO:tasks.workunit.client.0.smithi134.stdout:7/796: write d2/d5/d19/d84/d86/d93/dab/f3e [2081720,45451] 0 2024-02-16T22:19:00.648 INFO:tasks.workunit.client.0.smithi134.stdout:7/797: write d2/d5/f2d [1968864,10763] 0 2024-02-16T22:19:00.648 INFO:tasks.workunit.client.0.smithi134.stdout:2/721: dwrite df/d10/d15/d5a/f13 [0,4194304] 0 2024-02-16T22:19:00.654 INFO:tasks.workunit.client.0.smithi134.stdout:1/817: dwrite d5/da/d21/d52/f8b [4194304,4194304] 0 2024-02-16T22:19:00.654 INFO:tasks.workunit.client.0.smithi134.stdout:8/813: dwrite d2/fbd [0,4194304] 0 2024-02-16T22:19:00.654 INFO:tasks.workunit.client.0.smithi134.stdout:1/818: read - d5/da/dd6/ffc zero size 2024-02-16T22:19:00.655 INFO:tasks.workunit.client.0.smithi134.stdout:0/810: dwrite d2/dc/f44 [0,4194304] 0 2024-02-16T22:19:00.668 INFO:tasks.workunit.client.0.smithi134.stdout:4/690: symlink d0/d6/d22/d25/d2a/db4/le9 0 2024-02-16T22:19:00.670 INFO:tasks.workunit.client.0.smithi134.stdout:9/997: dwrite db/d20/d22/d51/da2/f160 [0,4194304] 0 2024-02-16T22:19:00.670 INFO:tasks.workunit.client.0.smithi134.stdout:9/998: readlink db/dc/l4a 0 2024-02-16T22:19:00.670 INFO:tasks.workunit.client.0.smithi134.stdout:7/798: dwrite d2/fdd [0,4194304] 0 2024-02-16T22:19:00.671 INFO:tasks.workunit.client.0.smithi134.stdout:2/722: symlink df/d10/d30/d4d/d94/da3/ld4 0 2024-02-16T22:19:00.676 INFO:tasks.workunit.client.0.smithi134.stdout:8/814: creat d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/dd3/f117 x:0 0 0 2024-02-16T22:19:00.678 INFO:tasks.workunit.client.0.smithi134.stdout:0/811: link d2/dc/d2d/d34/fad d2/dc/d32/d45/f10a 0 2024-02-16T22:19:00.680 INFO:tasks.workunit.client.0.smithi134.stdout:4/691: mknod d0/d6/d58/cea 0 2024-02-16T22:19:00.681 INFO:tasks.workunit.client.0.smithi134.stdout:1/819: dwrite d5/da/d21/d45/fad [0,4194304] 0 2024-02-16T22:19:00.684 INFO:tasks.workunit.client.0.smithi134.stdout:9/999: creat db/d20/d22/d51/f167 x:0 0 0 2024-02-16T22:19:00.689 INFO:tasks.workunit.client.0.smithi134.stdout:7/799: symlink d2/d5/d19/d4a/dfb/l105 0 2024-02-16T22:19:00.693 INFO:tasks.workunit.client.0.smithi134.stdout:4/692: creat d0/da1/feb x:0 0 0 2024-02-16T22:19:00.695 INFO:tasks.workunit.client.0.smithi134.stdout:1/820: creat d5/d1a/d23/d8c/d109/f10a x:0 0 0 2024-02-16T22:19:00.696 INFO:tasks.workunit.client.0.smithi134.stdout:7/800: mknod d2/d5/d19/d84/d86/d93/dab/d40/c106 0 2024-02-16T22:19:00.697 INFO:tasks.workunit.client.0.smithi134.stdout:2/723: getdents df/d10/d30/d49/d85 0 2024-02-16T22:19:00.698 INFO:tasks.workunit.client.0.smithi134.stdout:0/812: rmdir d2/d20/d7a 39 2024-02-16T22:19:00.699 INFO:tasks.workunit.client.0.smithi134.stdout:4/693: getdents d0/d6/d1e/d3b/d9e 0 2024-02-16T22:19:00.699 INFO:tasks.workunit.client.0.smithi134.stdout:4/694: fdatasync d0/d6/d1e/d7c/f82 0 2024-02-16T22:19:00.699 INFO:tasks.workunit.client.0.smithi134.stdout:4/695: truncate d0/d6/d1e/d39/f45 271242 0 2024-02-16T22:19:00.700 INFO:tasks.workunit.client.0.smithi134.stdout:1/821: rmdir d5/d1a/d23/d85 39 2024-02-16T22:19:00.700 INFO:tasks.workunit.client.0.smithi134.stdout:1/822: write d5/da/d21/d52/d9b/db6/ff1 [641598,94161] 0 2024-02-16T22:19:00.700 INFO:tasks.workunit.client.0.smithi134.stdout:1/823: write d5/da/d21/d52/d9b/d9f/ffa [671750,106796] 0 2024-02-16T22:19:00.700 INFO:tasks.workunit.client.0.smithi134.stdout:1/824: readlink d5/da/d21/d52/l87 0 2024-02-16T22:19:00.700 INFO:tasks.workunit.client.0.smithi134.stdout:5/838: sync 2024-02-16T22:19:00.701 INFO:tasks.workunit.client.0.smithi134.stdout:0/813: link d2/dc/ff d2/dc/dc4/f10b 0 2024-02-16T22:19:00.701 INFO:tasks.workunit.client.0.smithi134.stdout:0/814: creat d2/dc/d32/d45/f10c x:0 0 0 2024-02-16T22:19:00.701 INFO:tasks.workunit.client.0.smithi134.stdout:0/815: fdatasync d2/dc/d32/fa6 0 2024-02-16T22:19:00.702 INFO:tasks.workunit.client.0.smithi134.stdout:1/825: getdents d5/da/db8/dd5 0 2024-02-16T22:19:00.702 INFO:tasks.workunit.client.0.smithi134.stdout:1/826: fdatasync d5/d1a/d63/f92 0 2024-02-16T22:19:00.702 INFO:tasks.workunit.client.0.smithi134.stdout:1/827: write d5/d1a/d23/d85/f8f [1164335,42457] 0 2024-02-16T22:19:00.703 INFO:tasks.workunit.client.0.smithi134.stdout:1/828: write d5/da/d21/d52/d9b/fb1 [1330933,115787] 0 2024-02-16T22:19:00.703 INFO:tasks.workunit.client.0.smithi134.stdout:1/829: chown d5/da/d2d/dca/lfd 1369 1 2024-02-16T22:19:00.703 INFO:tasks.workunit.client.0.smithi134.stdout:1/830: stat d5/da/d21/d45/cf4 0 2024-02-16T22:19:00.703 INFO:tasks.workunit.client.0.smithi134.stdout:1/831: chown d5/d1a/d63/fa5 421390590 1 2024-02-16T22:19:00.704 INFO:tasks.workunit.client.0.smithi134.stdout:3/837: sync 2024-02-16T22:19:00.705 INFO:tasks.workunit.client.0.smithi134.stdout:3/838: write da/d12/f17 [143640,103160] 0 2024-02-16T22:19:00.706 INFO:tasks.workunit.client.0.smithi134.stdout:0/816: mkdir d2/dc/d2d/d34/d87/d10d 0 2024-02-16T22:19:00.709 INFO:tasks.workunit.client.0.smithi134.stdout:5/839: write d2/d35/d36/d46/d68/d74/fb4 [52531,70080] 0 2024-02-16T22:19:00.709 INFO:tasks.workunit.client.0.smithi134.stdout:5/840: write d2/d35/d36/d3d/d9c/ff3 [71402,66791] 0 2024-02-16T22:19:00.709 INFO:tasks.workunit.client.0.smithi134.stdout:5/841: chown d2/f34 8275945 1 2024-02-16T22:19:00.712 INFO:tasks.workunit.client.0.smithi134.stdout:3/839: rename da/d12/fe4 to da/d1c/d24/d9a/dc0/d8a/f10f 0 2024-02-16T22:19:00.712 INFO:tasks.workunit.client.0.smithi134.stdout:3/840: chown da/d1c/f5d 1 1 2024-02-16T22:19:00.712 INFO:tasks.workunit.client.0.smithi134.stdout:3/841: truncate da/d1c/d24/d29/d51/d79/d109/f10d 868001 0 2024-02-16T22:19:00.713 INFO:tasks.workunit.client.0.smithi134.stdout:0/817: truncate d2/dc/d32/d3e/f69 117663 0 2024-02-16T22:19:00.714 INFO:tasks.workunit.client.0.smithi134.stdout:1/832: read d5/da/d21/d52/d9b/d9f/ffa [239025,36166] 0 2024-02-16T22:19:00.714 INFO:tasks.workunit.client.0.smithi134.stdout:8/815: dwrite d2/f8b [0,4194304] 0 2024-02-16T22:19:00.716 INFO:tasks.workunit.client.0.smithi134.stdout:3/842: mknod da/d1c/c110 0 2024-02-16T22:19:00.718 INFO:tasks.workunit.client.0.smithi134.stdout:8/816: mknod d2/df/d18/d2a/d41/d59/da0/d40/d53/daa/d105/c118 0 2024-02-16T22:19:00.719 INFO:tasks.workunit.client.0.smithi134.stdout:3/843: rename da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/la3 to da/d1c/d24/d29/d51/l111 0 2024-02-16T22:19:00.720 INFO:tasks.workunit.client.0.smithi134.stdout:1/833: mknod d5/da/d2d/c10b 0 2024-02-16T22:19:00.721 INFO:tasks.workunit.client.0.smithi134.stdout:8/817: mknod d2/df/d18/d2a/d41/d59/da0/d8d/c119 0 2024-02-16T22:19:00.722 INFO:tasks.workunit.client.0.smithi134.stdout:0/818: dread d2/dc/ff [0,4194304] 0 2024-02-16T22:19:00.725 INFO:tasks.workunit.client.0.smithi134.stdout:1/834: rename d5/da/dd6 to d5/da/d21/d45/d93/d10c 0 2024-02-16T22:19:00.725 INFO:tasks.workunit.client.0.smithi134.stdout:1/835: creat d5/da/d21/d45/f10d x:0 0 0 2024-02-16T22:19:00.726 INFO:tasks.workunit.client.0.smithi134.stdout:5/842: dread d2/d35/d36/d3d/f78 [4194304,4194304] 0 2024-02-16T22:19:00.726 INFO:tasks.workunit.client.0.smithi134.stdout:5/843: truncate d2/d9/dc/d15/d2f/fbb 4833144 0 2024-02-16T22:19:00.727 INFO:tasks.workunit.client.0.smithi134.stdout:1/836: rename d5/da/d21/d45/c68 to d5/da/d21/d45/d93/d10c/c10e 0 2024-02-16T22:19:00.730 INFO:tasks.workunit.client.0.smithi134.stdout:5/844: mknod d2/d9/dc/d15/c10d 0 2024-02-16T22:19:00.730 INFO:tasks.workunit.client.0.smithi134.stdout:5/845: chown d2/d9/cb 377 1 2024-02-16T22:19:00.730 INFO:tasks.workunit.client.0.smithi134.stdout:5/846: readlink d2/d35/d36/d3d/d9c/d4b/l5e 0 2024-02-16T22:19:00.730 INFO:tasks.workunit.client.0.smithi134.stdout:5/847: chown d2/d35/d36/d3d/d9c/d4b/l5e 25 1 2024-02-16T22:19:00.730 INFO:tasks.workunit.client.0.smithi134.stdout:5/848: fdatasync d2/d35/f58 0 2024-02-16T22:19:00.730 INFO:tasks.workunit.client.0.smithi134.stdout:7/801: dwrite d2/f1a [4194304,4194304] 0 2024-02-16T22:19:00.730 INFO:tasks.workunit.client.0.smithi134.stdout:5/849: read - d2/d35/d36/d46/f6a zero size 2024-02-16T22:19:00.730 INFO:tasks.workunit.client.0.smithi134.stdout:6/903: sync 2024-02-16T22:19:00.731 INFO:tasks.workunit.client.0.smithi134.stdout:1/837: write d5/d1a/d53/d86/faa [122893,109774] 0 2024-02-16T22:19:00.731 INFO:tasks.workunit.client.0.smithi134.stdout:1/838: creat d5/da/db8/f10f x:0 0 0 2024-02-16T22:19:00.731 INFO:tasks.workunit.client.0.smithi134.stdout:1/839: creat d5/da/d2d/de0/f110 x:0 0 0 2024-02-16T22:19:00.731 INFO:tasks.workunit.client.0.smithi134.stdout:1/840: write d5/da/d21/d52/d9b/db6/fd9 [825828,118897] 0 2024-02-16T22:19:00.731 INFO:tasks.workunit.client.0.smithi134.stdout:3/844: dread da/fb0 [0,4194304] 0 2024-02-16T22:19:00.731 INFO:tasks.workunit.client.0.smithi134.stdout:6/904: truncate d17/d27/d93/d9c/dec/dcb/ddc/fe9 7163989 0 2024-02-16T22:19:00.735 INFO:tasks.workunit.client.0.smithi134.stdout:1/841: getdents d5/da/d21/d52/d9b 0 2024-02-16T22:19:00.735 INFO:tasks.workunit.client.0.smithi134.stdout:1/842: chown d5/da/d21/d45 11379146 1 2024-02-16T22:19:00.737 INFO:tasks.workunit.client.0.smithi134.stdout:1/843: mknod d5/d1a/d63/c111 0 2024-02-16T22:19:00.739 INFO:tasks.workunit.client.0.smithi134.stdout:7/802: read d2/d6/f70 [798700,104245] 0 2024-02-16T22:19:00.741 INFO:tasks.workunit.client.0.smithi134.stdout:7/803: mkdir d2/d5/d19/d84/d86/d107 0 2024-02-16T22:19:00.741 INFO:tasks.workunit.client.0.smithi134.stdout:7/804: chown d2/d5/d22/cdb 7 1 2024-02-16T22:19:00.743 INFO:tasks.workunit.client.0.smithi134.stdout:7/805: creat d2/d5/d19/f108 x:0 0 0 2024-02-16T22:19:00.744 INFO:tasks.workunit.client.0.smithi134.stdout:3/845: dread da/d1c/d24/d9a/dc0/d8a/d8f/f3f [0,4194304] 0 2024-02-16T22:19:00.748 INFO:tasks.workunit.client.0.smithi134.stdout:3/846: symlink da/d1c/d24/d29/d51/d79/l112 0 2024-02-16T22:19:00.751 INFO:tasks.workunit.client.0.smithi134.stdout:3/847: unlink da/d1c/d24/d29/d51/d80/d89/d8e/dab/lac 0 2024-02-16T22:19:00.751 INFO:tasks.workunit.client.0.smithi134.stdout:3/848: stat da/d1c/d24/d29/d51/d80/d89/d8e/dbc 0 2024-02-16T22:19:00.753 INFO:tasks.workunit.client.0.smithi134.stdout:3/849: mknod da/d1c/d24/dd5/de3/c113 0 2024-02-16T22:19:00.753 INFO:tasks.workunit.client.0.smithi134.stdout:4/696: dwrite d0/d6/d1e/d39/f66 [0,4194304] 0 2024-02-16T22:19:00.753 INFO:tasks.workunit.client.0.smithi134.stdout:1/844: dread d5/da/d21/d52/fa4 [0,4194304] 0 2024-02-16T22:19:00.758 INFO:tasks.workunit.client.0.smithi134.stdout:0/819: dwrite d2/dc/d32/d45/f10a [0,4194304] 0 2024-02-16T22:19:00.761 INFO:tasks.workunit.client.0.smithi134.stdout:8/818: dwrite d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/f77 [0,4194304] 0 2024-02-16T22:19:00.761 INFO:tasks.workunit.client.0.smithi134.stdout:6/905: dwrite d17/d36/d77/d9a/d73/f129 [0,4194304] 0 2024-02-16T22:19:00.761 INFO:tasks.workunit.client.0.smithi134.stdout:6/906: chown d17/d36/d77/d9a/d28/d5b/d88/dd8/fda 96545 1 2024-02-16T22:19:00.761 INFO:tasks.workunit.client.0.smithi134.stdout:5/850: dwrite d2/d35/d36/d3d/f9f [0,4194304] 0 2024-02-16T22:19:00.762 INFO:tasks.workunit.client.0.smithi134.stdout:5/851: readlink d2/d9/dc/d15/d2f/l7f 0 2024-02-16T22:19:00.762 INFO:tasks.workunit.client.0.smithi134.stdout:5/852: chown d2/d9/cb 7 1 2024-02-16T22:19:00.762 INFO:tasks.workunit.client.0.smithi134.stdout:5/853: stat d2/d9/dc6 0 2024-02-16T22:19:00.766 INFO:tasks.workunit.client.0.smithi134.stdout:3/850: dread da/d1c/d24/d9a/dc0/d8a/d8f/f4e [0,4194304] 0 2024-02-16T22:19:00.766 INFO:tasks.workunit.client.0.smithi134.stdout:3/851: fsync da/d1c/d24/d29/f45 0 2024-02-16T22:19:00.767 INFO:tasks.workunit.client.0.smithi134.stdout:3/852: dread - da/d1c/d24/d2c/d74/fd3 zero size 2024-02-16T22:19:00.767 INFO:tasks.workunit.client.0.smithi134.stdout:3/853: chown da/d6b/dc1/de6 851157911 1 2024-02-16T22:19:00.772 INFO:tasks.workunit.client.0.smithi134.stdout:4/697: symlink d0/d6/d8/da2/d76/lec 0 2024-02-16T22:19:00.772 INFO:tasks.workunit.client.0.smithi134.stdout:4/698: fsync d0/d6/d22/d25/f8e 0 2024-02-16T22:19:00.777 INFO:tasks.workunit.client.0.smithi134.stdout:5/854: dread d2/f2b [4194304,4194304] 0 2024-02-16T22:19:00.778 INFO:tasks.workunit.client.0.smithi134.stdout:3/854: dread da/d12/f10b [0,4194304] 0 2024-02-16T22:19:00.787 INFO:tasks.workunit.client.0.smithi134.stdout:4/699: dread d0/d6/d8/d32/d68/fb9 [0,4194304] 0 2024-02-16T22:19:00.790 INFO:tasks.workunit.client.0.smithi134.stdout:1/845: dwrite d5/da/d21/d52/d9b/db3/fd2 [0,4194304] 0 2024-02-16T22:19:00.791 INFO:tasks.workunit.client.0.smithi134.stdout:5/855: dread d2/d35/d36/d46/f6b [0,4194304] 0 2024-02-16T22:19:00.791 INFO:tasks.workunit.client.0.smithi134.stdout:0/820: dwrite d2/dc/d32/d45/fc6 [0,4194304] 0 2024-02-16T22:19:00.791 INFO:tasks.workunit.client.0.smithi134.stdout:6/907: dwrite d17/d27/fb5 [0,4194304] 0 2024-02-16T22:19:00.797 INFO:tasks.workunit.client.0.smithi134.stdout:1/846: dread d5/f46 [0,4194304] 0 2024-02-16T22:19:00.799 INFO:tasks.workunit.client.0.smithi134.stdout:5/856: symlink d2/dc9/l10e 0 2024-02-16T22:19:00.799 INFO:tasks.workunit.client.0.smithi134.stdout:5/857: fdatasync d2/d9/dc/fe 0 2024-02-16T22:19:00.799 INFO:tasks.workunit.client.0.smithi134.stdout:5/858: chown d2/d9/dc/d15/f3b 1 1 2024-02-16T22:19:00.801 INFO:tasks.workunit.client.0.smithi134.stdout:0/821: creat d2/dc/dc4/f10e x:0 0 0 2024-02-16T22:19:00.802 INFO:tasks.workunit.client.0.smithi134.stdout:5/859: getdents d2/d35/d36/da1/dbf 0 2024-02-16T22:19:00.804 INFO:tasks.workunit.client.0.smithi134.stdout:0/822: creat d2/dc/d32/d3e/da7/dc2/f10f x:0 0 0 2024-02-16T22:19:00.806 INFO:tasks.workunit.client.0.smithi134.stdout:5/860: mkdir d2/d8f/d10f 0 2024-02-16T22:19:00.815 INFO:tasks.workunit.client.0.smithi134.stdout:4/700: dwrite d0/d6/d8/d5e/f96 [0,4194304] 0 2024-02-16T22:19:00.815 INFO:tasks.workunit.client.0.smithi134.stdout:4/701: truncate d0/d6/d22/d25/f3d 4670190 0 2024-02-16T22:19:00.815 INFO:tasks.workunit.client.0.smithi134.stdout:4/702: write d0/d6/d8/d30/fbe [1792649,12025] 0 2024-02-16T22:19:00.817 INFO:tasks.workunit.client.0.smithi134.stdout:6/908: dwrite d17/d27/d93/d9c/dec/d52/fba [0,4194304] 0 2024-02-16T22:19:00.818 INFO:tasks.workunit.client.0.smithi134.stdout:4/703: symlink d0/d6/d8/da2/d76/led 0 2024-02-16T22:19:00.819 INFO:tasks.workunit.client.0.smithi134.stdout:6/909: mknod d17/d27/d30/c12c 0 2024-02-16T22:19:00.821 INFO:tasks.workunit.client.0.smithi134.stdout:5/861: dwrite d2/d35/d36/d3d/d63/fa2 [4194304,4194304] 0 2024-02-16T22:19:00.822 INFO:tasks.workunit.client.0.smithi134.stdout:4/704: truncate d0/d6/d8/d32/d63/d6c/f3e 6428464 0 2024-02-16T22:19:00.822 INFO:tasks.workunit.client.0.smithi134.stdout:4/705: chown d0/d6/d8/d32/d68/f9c 22796997 1 2024-02-16T22:19:00.823 INFO:tasks.workunit.client.0.smithi134.stdout:5/862: getdents d2/d35/d36 0 2024-02-16T22:19:00.827 INFO:tasks.workunit.client.0.smithi134.stdout:5/863: mknod d2/d9/dc/d15/c110 0 2024-02-16T22:19:00.827 INFO:tasks.workunit.client.0.smithi134.stdout:5/864: write d2/d35/d36/d46/d68/d74/fb4 [427762,9937] 0 2024-02-16T22:19:00.828 INFO:tasks.workunit.client.0.smithi134.stdout:4/706: link d0/d6/d22/d25/f56 d0/d31/db8/d1a/fee 0 2024-02-16T22:19:00.835 INFO:tasks.workunit.client.0.smithi134.stdout:6/910: dwrite d17/d27/d30/f33 [0,4194304] 0 2024-02-16T22:19:00.839 INFO:tasks.workunit.client.0.smithi134.stdout:6/911: creat d17/f12d x:0 0 0 2024-02-16T22:19:00.848 INFO:tasks.workunit.client.0.smithi134.stdout:6/912: dread d17/d27/f34 [0,4194304] 0 2024-02-16T22:19:00.849 INFO:tasks.workunit.client.0.smithi134.stdout:6/913: dread d17/d27/d93/d9c/dec/d52/d79/d8b/fdd [0,4194304] 0 2024-02-16T22:19:00.849 INFO:tasks.workunit.client.0.smithi134.stdout:6/914: creat d17/d36/d77/d9a/d28/d5b/f12e x:0 0 0 2024-02-16T22:19:00.849 INFO:tasks.workunit.client.0.smithi134.stdout:6/915: stat d17/dfd/le5 0 2024-02-16T22:19:00.855 INFO:tasks.workunit.client.0.smithi134.stdout:5/865: dwrite d2/d35/d36/d3d/f9f [0,4194304] 0 2024-02-16T22:19:00.855 INFO:tasks.workunit.client.0.smithi134.stdout:4/707: dwrite d0/d6/d22/d25/f8e [0,4194304] 0 2024-02-16T22:19:00.855 INFO:tasks.workunit.client.0.smithi134.stdout:4/708: creat d0/d31/fef x:0 0 0 2024-02-16T22:19:00.855 INFO:tasks.workunit.client.0.smithi134.stdout:4/709: write d0/d6/d22/d25/f48 [1500042,3616] 0 2024-02-16T22:19:00.860 INFO:tasks.workunit.client.0.smithi134.stdout:6/916: write d17/f51 [2358545,66421] 0 2024-02-16T22:19:00.868 INFO:tasks.workunit.client.0.smithi134.stdout:6/917: unlink d17/d27/fb5 0 2024-02-16T22:19:00.874 INFO:tasks.workunit.client.0.smithi134.stdout:4/710: dwrite d0/d6/d44/da9/fe7 [0,4194304] 0 2024-02-16T22:19:00.880 INFO:tasks.workunit.client.0.smithi134.stdout:6/918: dread d17/d27/d93/d9c/dec/f55 [0,4194304] 0 2024-02-16T22:19:00.881 INFO:tasks.workunit.client.0.smithi134.stdout:6/919: symlink d17/d36/d77/l12f 0 2024-02-16T22:19:00.882 INFO:tasks.workunit.client.0.smithi134.stdout:6/920: truncate d17/d36/d77/d9a/d28/f81 4664402 0 2024-02-16T22:19:00.884 INFO:tasks.workunit.client.0.smithi134.stdout:6/921: getdents d17/d27/d93 0 2024-02-16T22:19:00.884 INFO:tasks.workunit.client.0.smithi134.stdout:6/922: chown d17/d36/d77/d9a/d28/f96 1015 1 2024-02-16T22:19:00.884 INFO:tasks.workunit.client.0.smithi134.stdout:6/923: dread - d17/d36/d77/d9a/d28/d5b/f12e zero size 2024-02-16T22:19:00.884 INFO:tasks.workunit.client.0.smithi134.stdout:6/924: rmdir d17/d36/d77/d9a/d28 39 2024-02-16T22:19:00.884 INFO:tasks.workunit.client.0.smithi134.stdout:6/925: read d17/d27/d93/d9c/dec/f50 [848944,76713] 0 2024-02-16T22:19:00.887 INFO:tasks.workunit.client.0.smithi134.stdout:4/711: dread d0/f11 [0,4194304] 0 2024-02-16T22:19:00.887 INFO:tasks.workunit.client.0.smithi134.stdout:4/712: chown d0/d6/d58/lb7 118 1 2024-02-16T22:19:00.889 INFO:tasks.workunit.client.0.smithi134.stdout:4/713: rename d0/d31/db8/d1a/d75 to d0/d6/d8/da2/d76/df0 0 2024-02-16T22:19:00.893 INFO:tasks.workunit.client.0.smithi134.stdout:6/926: write d17/d27/d93/d9c/dec/f59 [996782,74449] 0 2024-02-16T22:19:00.895 INFO:tasks.workunit.client.0.smithi134.stdout:6/927: mknod d17/d27/d93/d9c/dec/d52/d79/c130 0 2024-02-16T22:19:00.895 INFO:tasks.workunit.client.0.smithi134.stdout:6/928: chown d17/d36/dd0/l10f 13 1 2024-02-16T22:19:00.896 INFO:tasks.workunit.client.0.smithi134.stdout:6/929: write d17/d36/d77/d9a/d28/f96 [901706,80604] 0 2024-02-16T22:19:00.905 INFO:tasks.workunit.client.0.smithi134.stdout:6/930: dread d17/d27/d30/d32/deb/ffc [0,4194304] 0 2024-02-16T22:19:00.905 INFO:tasks.workunit.client.0.smithi134.stdout:6/931: fsync d17/d36/d77/d9a/d28/f49 0 2024-02-16T22:19:00.906 INFO:tasks.workunit.client.0.smithi134.stdout:6/932: creat d17/d36/d77/d9a/d73/dd6/f131 x:0 0 0 2024-02-16T22:19:00.916 INFO:tasks.workunit.client.0.smithi134.stdout:6/933: dread d17/f2d [0,4194304] 0 2024-02-16T22:19:00.916 INFO:tasks.workunit.client.0.smithi134.stdout:6/934: read - d17/d27/d93/d9c/dec/d52/d79/f114 zero size 2024-02-16T22:19:00.921 INFO:tasks.workunit.client.0.smithi134.stdout:6/935: dread d17/dfd/de2/f100 [0,4194304] 0 2024-02-16T22:19:00.923 INFO:tasks.workunit.client.0.smithi134.stdout:6/936: truncate d17/d36/d77/d9a/d28/fc7 1348062 0 2024-02-16T22:19:00.924 INFO:tasks.workunit.client.0.smithi134.stdout:6/937: mknod d17/dfd/de2/c132 0 2024-02-16T22:19:00.926 INFO:tasks.workunit.client.0.smithi134.stdout:6/938: rmdir d17/d27/d30/d32 39 2024-02-16T22:19:00.927 INFO:tasks.workunit.client.0.smithi134.stdout:6/939: truncate d17/d27/d93/d9c/dec/d52/d79/f6b 639444 0 2024-02-16T22:19:00.927 INFO:tasks.workunit.client.0.smithi134.stdout:6/940: truncate d17/d27/d93/d9c/dec/f11a 639113 0 2024-02-16T22:19:00.930 INFO:tasks.workunit.client.0.smithi134.stdout:6/941: link d17/d36/d77/d9a/d28/d5b/d88/d90/lef d17/d27/d93/d9c/dec/d52/d79/d92/de6/l133 0 2024-02-16T22:19:00.930 INFO:tasks.workunit.client.0.smithi134.stdout:6/942: fdatasync d17/d27/d93/d9c/dec/f55 0 2024-02-16T22:19:00.930 INFO:tasks.workunit.client.0.smithi134.stdout:6/943: truncate d17/f7f 961953 0 2024-02-16T22:19:00.949 INFO:tasks.workunit.client.0.smithi134.stdout:8/819: sync 2024-02-16T22:19:00.949 INFO:tasks.workunit.client.0.smithi134.stdout:7/806: sync 2024-02-16T22:19:00.949 INFO:tasks.workunit.client.0.smithi134.stdout:2/724: sync 2024-02-16T22:19:00.949 INFO:tasks.workunit.client.0.smithi134.stdout:7/807: chown c1 32594585 1 2024-02-16T22:19:00.949 INFO:tasks.workunit.client.0.smithi134.stdout:7/808: chown d2/d6/d7d/d92/dcd/fa2 6 1 2024-02-16T22:19:00.951 INFO:tasks.workunit.client.0.smithi134.stdout:8/820: creat d2/df/d18/d27/d85/f11a x:0 0 0 2024-02-16T22:19:00.951 INFO:tasks.workunit.client.0.smithi134.stdout:8/821: truncate d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/dd3/ff5 831645 0 2024-02-16T22:19:00.952 INFO:tasks.workunit.client.0.smithi134.stdout:7/809: symlink d2/d6/d7d/d9e/l109 0 2024-02-16T22:19:00.952 INFO:tasks.workunit.client.0.smithi134.stdout:8/822: mkdir d2/df/d18/dc5/d11b 0 2024-02-16T22:19:00.955 INFO:tasks.workunit.client.0.smithi134.stdout:6/944: dwrite d17/d27/d93/d9c/dec/f59 [0,4194304] 0 2024-02-16T22:19:00.955 INFO:tasks.workunit.client.0.smithi134.stdout:6/945: write d17/d27/d93/d9c/dec/d52/d79/d8b/fcd [840390,83755] 0 2024-02-16T22:19:00.956 INFO:tasks.workunit.client.0.smithi134.stdout:6/946: write d17/d63/f82 [965119,36545] 0 2024-02-16T22:19:00.956 INFO:tasks.workunit.client.0.smithi134.stdout:4/714: dwrite d0/d31/db8/d46/fbf [0,4194304] 0 2024-02-16T22:19:00.963 INFO:tasks.workunit.client.0.smithi134.stdout:2/725: dread df/f51 [4194304,4194304] 0 2024-02-16T22:19:00.963 INFO:tasks.workunit.client.0.smithi134.stdout:2/726: readlink df/d10/d15/d5a/lbc 0 2024-02-16T22:19:00.964 INFO:tasks.workunit.client.0.smithi134.stdout:2/727: symlink df/d10/d3a/da9/ld5 0 2024-02-16T22:19:00.968 INFO:tasks.workunit.client.0.smithi134.stdout:4/715: dread d0/d6/d22/d25/f73 [0,4194304] 0 2024-02-16T22:19:00.969 INFO:tasks.workunit.client.0.smithi134.stdout:4/716: creat d0/d6/d22/d97/daf/ff1 x:0 0 0 2024-02-16T22:19:00.970 INFO:tasks.workunit.client.0.smithi134.stdout:4/717: stat d0/d31/db8/d1a/fb5 0 2024-02-16T22:19:00.970 INFO:tasks.workunit.client.0.smithi134.stdout:1/847: sync 2024-02-16T22:19:00.970 INFO:tasks.workunit.client.0.smithi134.stdout:5/866: sync 2024-02-16T22:19:00.970 INFO:tasks.workunit.client.0.smithi134.stdout:3/855: sync 2024-02-16T22:19:00.970 INFO:tasks.workunit.client.0.smithi134.stdout:5/867: truncate d2/d35/d36/f77 5654732 0 2024-02-16T22:19:00.970 INFO:tasks.workunit.client.0.smithi134.stdout:1/848: truncate d5/d1a/d23/f27 691583 0 2024-02-16T22:19:00.971 INFO:tasks.workunit.client.0.smithi134.stdout:4/718: write d0/d6/d8/d30/fbe [753025,66413] 0 2024-02-16T22:19:00.972 INFO:tasks.workunit.client.0.smithi134.stdout:3/856: rmdir da/dc3/d10a 0 2024-02-16T22:19:00.972 INFO:tasks.workunit.client.0.smithi134.stdout:3/857: fsync da/d1c/d24/d9a/dc0/d8a/fef 0 2024-02-16T22:19:00.972 INFO:tasks.workunit.client.0.smithi134.stdout:3/858: creat da/d12/f114 x:0 0 0 2024-02-16T22:19:00.972 INFO:tasks.workunit.client.0.smithi134.stdout:3/859: stat da/d12/f76 0 2024-02-16T22:19:00.973 INFO:tasks.workunit.client.0.smithi134.stdout:5/868: creat d2/dc9/f111 x:0 0 0 2024-02-16T22:19:00.974 INFO:tasks.workunit.client.0.smithi134.stdout:4/719: creat d0/d6/d8/d5e/ff2 x:0 0 0 2024-02-16T22:19:00.975 INFO:tasks.workunit.client.0.smithi134.stdout:8/823: dwrite d2/df/d18/d2a/d41/f42 [0,4194304] 0 2024-02-16T22:19:00.976 INFO:tasks.workunit.client.0.smithi134.stdout:3/860: dread da/d12/f7b [0,4194304] 0 2024-02-16T22:19:00.976 INFO:tasks.workunit.client.0.smithi134.stdout:3/861: write da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/f6c [1018475,87634] 0 2024-02-16T22:19:00.976 INFO:tasks.workunit.client.0.smithi134.stdout:6/947: dwrite d17/d27/d93/d9c/dec/d52/d79/d8b/fdd [0,4194304] 0 2024-02-16T22:19:00.976 INFO:tasks.workunit.client.0.smithi134.stdout:0/823: sync 2024-02-16T22:19:00.977 INFO:tasks.workunit.client.0.smithi134.stdout:2/728: dread df/d10/d3a/f44 [0,4194304] 0 2024-02-16T22:19:00.980 INFO:tasks.workunit.client.0.smithi134.stdout:3/862: dread da/d12/f7b [0,4194304] 0 2024-02-16T22:19:00.983 INFO:tasks.workunit.client.0.smithi134.stdout:8/824: rename d2/df/d18/d2a/d41/d59/da0/d40/d53/d5e/d72/fe5 to d2/df/d18/db5/f11c 0 2024-02-16T22:19:00.983 INFO:tasks.workunit.client.0.smithi134.stdout:8/825: fsync d2/df/d18/d2a/d41/f103 0 2024-02-16T22:19:00.984 INFO:tasks.workunit.client.0.smithi134.stdout:8/826: write d2/df/d18/dc5/f111 [4750492,62602] 0 2024-02-16T22:19:00.988 INFO:tasks.workunit.client.0.smithi134.stdout:0/824: creat d2/dc/d32/d3e/da7/dc2/def/f110 x:0 0 0 2024-02-16T22:19:00.988 INFO:tasks.workunit.client.0.smithi134.stdout:4/720: dread d0/d31/db8/d86/f9f [0,4194304] 0 2024-02-16T22:19:00.989 INFO:tasks.workunit.client.0.smithi134.stdout:5/869: rmdir d2/d9/dc/d98 39 2024-02-16T22:19:00.991 INFO:tasks.workunit.client.0.smithi134.stdout:1/849: dwrite d5/da/d21/d52/fa4 [0,4194304] 0 2024-02-16T22:19:00.991 INFO:tasks.workunit.client.0.smithi134.stdout:1/850: readlink d5/da/l33 0 2024-02-16T22:19:00.992 INFO:tasks.workunit.client.0.smithi134.stdout:3/863: mknod da/d6b/dc1/de6/df5/c115 0 2024-02-16T22:19:00.994 INFO:tasks.workunit.client.0.smithi134.stdout:6/948: rename d17/d27/d30/d32/l6e to d17/d27/d93/d9c/dec/d52/d119/d122/l134 0 2024-02-16T22:19:00.998 INFO:tasks.workunit.client.0.smithi134.stdout:4/721: unlink d0/d6/d1e/d39/f45 0 2024-02-16T22:19:00.998 INFO:tasks.workunit.client.0.smithi134.stdout:4/722: fsync d0/d6/d22/f67 0 2024-02-16T22:19:00.998 INFO:tasks.workunit.client.0.smithi134.stdout:4/723: write d0/d6/d22/d25/d2a/db4/fd2 [1007062,110346] 0 2024-02-16T22:19:00.999 INFO:tasks.workunit.client.0.smithi134.stdout:0/825: mkdir d2/dc/d2d/d34/d87/d10d/d111 0 2024-02-16T22:19:01.000 INFO:tasks.workunit.client.0.smithi134.stdout:0/826: fsync d2/dc/d32/d3e/d5e/f76 0 2024-02-16T22:19:01.001 INFO:tasks.workunit.client.0.smithi134.stdout:3/864: dread da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/f6c [0,4194304] 0 2024-02-16T22:19:01.001 INFO:tasks.workunit.client.0.smithi134.stdout:1/851: mknod d5/da/d21/d52/d9b/db6/c112 0 2024-02-16T22:19:01.006 INFO:tasks.workunit.client.0.smithi134.stdout:6/949: link d17/d36/d77/d9a/d28/d5b/d88/dd8/fda d17/d36/d77/d9a/d28/f135 0 2024-02-16T22:19:01.007 INFO:tasks.workunit.client.0.smithi134.stdout:4/724: creat d0/ff3 x:0 0 0 2024-02-16T22:19:01.007 INFO:tasks.workunit.client.0.smithi134.stdout:4/725: read - d0/d6/d1e/d7c/fa0 zero size 2024-02-16T22:19:01.008 INFO:tasks.workunit.client.0.smithi134.stdout:0/827: mkdir d2/d20/d77/d85/db6/d108/d112 0 2024-02-16T22:19:01.010 INFO:tasks.workunit.client.0.smithi134.stdout:8/827: dwrite d2/df/d18/d2a/d41/d59/da0/d9f/faf [0,4194304] 0 2024-02-16T22:19:01.010 INFO:tasks.workunit.client.0.smithi134.stdout:8/828: fsync d2/df/d18/db5/f11c 0 2024-02-16T22:19:01.011 INFO:tasks.workunit.client.0.smithi134.stdout:1/852: dread d5/d1a/f40 [0,4194304] 0 2024-02-16T22:19:01.012 INFO:tasks.workunit.client.0.smithi134.stdout:4/726: creat d0/d31/db8/d86/ff4 x:0 0 0 2024-02-16T22:19:01.012 INFO:tasks.workunit.client.0.smithi134.stdout:4/727: chown d0/d6/d8/d5e/l84 245584 1 2024-02-16T22:19:01.012 INFO:tasks.workunit.client.0.smithi134.stdout:1/853: write d5/d1a/d23/d85/f103 [528552,53318] 0 2024-02-16T22:19:01.012 INFO:tasks.workunit.client.0.smithi134.stdout:1/854: fsync d5/f3f 0 2024-02-16T22:19:01.016 INFO:tasks.workunit.client.0.smithi134.stdout:8/829: unlink d2/df/d7c/f81 0 2024-02-16T22:19:01.017 INFO:tasks.workunit.client.0.smithi134.stdout:1/855: write d5/d1a/d63/f92 [670767,124728] 0 2024-02-16T22:19:01.018 INFO:tasks.workunit.client.0.smithi134.stdout:2/729: rename df/d10/d30/d49/d85/d9b to df/d41/d97/dd6 0 2024-02-16T22:19:01.021 INFO:tasks.workunit.client.0.smithi134.stdout:8/830: mknod d2/df/d18/d2a/d41/d59/da0/d40/d53/dbe/ddf/c11d 0 2024-02-16T22:19:01.022 INFO:tasks.workunit.client.0.smithi134.stdout:5/870: dwrite d2/d35/d36/d3d/fac [4194304,4194304] 0 2024-02-16T22:19:01.022 INFO:tasks.workunit.client.0.smithi134.stdout:5/871: dread - d2/d35/f96 zero size 2024-02-16T22:19:01.022 INFO:tasks.workunit.client.0.smithi134.stdout:5/872: dread - d2/d9/dc/daf/f10c zero size 2024-02-16T22:19:01.025 INFO:tasks.workunit.client.0.smithi134.stdout:5/873: unlink d2/d35/d36/d3d/d9c/d4b/le6 0 2024-02-16T22:19:01.026 INFO:tasks.workunit.client.0.smithi134.stdout:5/874: write d2/d35/d36/d46/d68/d74/fe4 [1398409,20075] 0 2024-02-16T22:19:01.033 INFO:tasks.workunit.client.0.smithi134.stdout:3/865: dwrite da/d1c/d24/d29/d51/f87 [4194304,4194304] 0 2024-02-16T22:19:01.033 INFO:tasks.workunit.client.0.smithi134.stdout:5/875: creat d2/d35/d36/f112 x:0 0 0 2024-02-16T22:19:01.035 INFO:tasks.workunit.client.0.smithi134.stdout:8/831: rename d2/df/d18/d2a/d41 to d2/df/d18/dc5/d11e 0 2024-02-16T22:19:01.035 INFO:tasks.workunit.client.0.smithi134.stdout:8/832: write d2/df/d18/dc5/d11e/d59/da0/d40/f102 [135877,64296] 0 2024-02-16T22:19:01.037 INFO:tasks.workunit.client.0.smithi134.stdout:3/866: mknod da/d1c/d24/d29/d51/d80/c116 0 2024-02-16T22:19:01.039 INFO:tasks.workunit.client.0.smithi134.stdout:5/876: mknod d2/dc9/c113 0 2024-02-16T22:19:01.039 INFO:tasks.workunit.client.0.smithi134.stdout:5/877: read d2/f6 [1646808,115917] 0 2024-02-16T22:19:01.039 INFO:tasks.workunit.client.0.smithi134.stdout:5/878: creat d2/d35/d36/f114 x:0 0 0 2024-02-16T22:19:01.039 INFO:tasks.workunit.client.0.smithi134.stdout:8/833: getdents d2/df/d18/dc5/d11e/d59/db1/d87 0 2024-02-16T22:19:01.039 INFO:tasks.workunit.client.0.smithi134.stdout:8/834: truncate d2/df/d18/d27/d85/f11a 417419 0 2024-02-16T22:19:01.039 INFO:tasks.workunit.client.0.smithi134.stdout:8/835: fdatasync d2/f8b 0 2024-02-16T22:19:01.039 INFO:tasks.workunit.client.0.smithi134.stdout:8/836: fdatasync d2/df/d18/dc5/d11e/d59/da0/f93 0 2024-02-16T22:19:01.040 INFO:tasks.workunit.client.0.smithi134.stdout:3/867: mknod da/d1c/d24/d29/c117 0 2024-02-16T22:19:01.041 INFO:tasks.workunit.client.0.smithi134.stdout:8/837: unlink d2/df/d18/dc5/d11e/d59/fed 0 2024-02-16T22:19:01.043 INFO:tasks.workunit.client.0.smithi134.stdout:4/728: dwrite d0/d6/d1e/fdd [0,4194304] 0 2024-02-16T22:19:01.043 INFO:tasks.workunit.client.0.smithi134.stdout:6/950: dwrite d17/d27/d93/d9c/dec/d52/d79/d8b/fcd [0,4194304] 0 2024-02-16T22:19:01.043 INFO:tasks.workunit.client.0.smithi134.stdout:5/879: mkdir d2/d9/dc/d115 0 2024-02-16T22:19:01.044 INFO:tasks.workunit.client.0.smithi134.stdout:8/838: mkdir d2/df/d18/dc5/d11e/d11f 0 2024-02-16T22:19:01.045 INFO:tasks.workunit.client.0.smithi134.stdout:3/868: rmdir da/d1c/d24/d9a/dc0/d8a 39 2024-02-16T22:19:01.048 INFO:tasks.workunit.client.0.smithi134.stdout:2/730: dwrite df/d41/f5e [8388608,4194304] 0 2024-02-16T22:19:01.049 INFO:tasks.workunit.client.0.smithi134.stdout:6/951: link d17/d27/d93/d9c/dec/d52/d79/d92/lf3 d17/dfd/dbc/l136 0 2024-02-16T22:19:01.050 INFO:tasks.workunit.client.0.smithi134.stdout:5/880: creat d2/dfe/f116 x:0 0 0 2024-02-16T22:19:01.051 INFO:tasks.workunit.client.0.smithi134.stdout:8/839: mknod d2/df/d18/d27/c120 0 2024-02-16T22:19:01.058 INFO:tasks.workunit.client.0.smithi134.stdout:4/729: read d0/d6/d22/d25/f3d [861854,125748] 0 2024-02-16T22:19:01.058 INFO:tasks.workunit.client.0.smithi134.stdout:1/856: dwrite d5/da/d21/d52/d9b/fb1 [0,4194304] 0 2024-02-16T22:19:01.064 INFO:tasks.workunit.client.0.smithi134.stdout:2/731: symlink df/d10/d15/da4/ld7 0 2024-02-16T22:19:01.066 INFO:tasks.workunit.client.0.smithi134.stdout:8/840: truncate d2/df/d18/dc5/d11e/f4d 6704052 0 2024-02-16T22:19:01.066 INFO:tasks.workunit.client.0.smithi134.stdout:8/841: write d2/df/d18/dc5/d11e/d59/da0/d9f/faf [4221801,119810] 0 2024-02-16T22:19:01.067 INFO:tasks.workunit.client.0.smithi134.stdout:3/869: getdents da/d1c/d24/dd5/de3 0 2024-02-16T22:19:01.069 INFO:tasks.workunit.client.0.smithi134.stdout:4/730: link d0/d6/d8/d32/d63/d6c/f49 d0/d6/d1e/ff5 0 2024-02-16T22:19:01.071 INFO:tasks.workunit.client.0.smithi134.stdout:3/870: dread da/d1c/f5d [0,4194304] 0 2024-02-16T22:19:01.076 INFO:tasks.workunit.client.0.smithi134.stdout:6/952: dwrite d17/d36/d77/d9a/f54 [4194304,4194304] 0 2024-02-16T22:19:01.076 INFO:tasks.workunit.client.0.smithi134.stdout:4/731: truncate d0/d6/d22/d25/f69 132071 0 2024-02-16T22:19:01.077 INFO:tasks.workunit.client.0.smithi134.stdout:6/953: dread - d17/d27/d93/d9c/dec/dcb/ddc/fed zero size 2024-02-16T22:19:01.077 INFO:tasks.workunit.client.0.smithi134.stdout:5/881: dwrite d2/dfe/f116 [0,4194304] 0 2024-02-16T22:19:01.078 INFO:tasks.workunit.client.0.smithi134.stdout:3/871: rename da/d1c/d24/d2c/lda to da/d1c/d24/d29/d51/d80/d89/d8e/dab/l118 0 2024-02-16T22:19:01.079 INFO:tasks.workunit.client.0.smithi134.stdout:3/872: chown da/d12/dd2 37726 1 2024-02-16T22:19:01.079 INFO:tasks.workunit.client.0.smithi134.stdout:8/842: mknod d2/da3/c121 0 2024-02-16T22:19:01.087 INFO:tasks.workunit.client.0.smithi134.stdout:6/954: rename d17/d36/d77/d9a/c23 to d17/d27/d93/d9c/dec/d52/d79/d92/de6/d10e/c137 0 2024-02-16T22:19:01.087 INFO:tasks.workunit.client.0.smithi134.stdout:6/955: fsync d17/dfd/dbc/fce 0 2024-02-16T22:19:01.087 INFO:tasks.workunit.client.0.smithi134.stdout:4/732: dread d0/f2 [0,4194304] 0 2024-02-16T22:19:01.087 INFO:tasks.workunit.client.0.smithi134.stdout:6/956: creat d17/d36/f138 x:0 0 0 2024-02-16T22:19:01.088 INFO:tasks.workunit.client.0.smithi134.stdout:6/957: chown d17/d27/d30/d32/l37 687 1 2024-02-16T22:19:01.089 INFO:tasks.workunit.client.0.smithi134.stdout:3/873: truncate da/d12/f76 73020 0 2024-02-16T22:19:01.089 INFO:tasks.workunit.client.0.smithi134.stdout:3/874: write da/d12/f114 [290232,100635] 0 2024-02-16T22:19:01.089 INFO:tasks.workunit.client.0.smithi134.stdout:3/875: fdatasync da/d1c/d24/f52 0 2024-02-16T22:19:01.090 INFO:tasks.workunit.client.0.smithi134.stdout:8/843: truncate d2/df/d18/dc5/d11e/d59/da0/d40/d53/daa/d105/fb8 3129986 0 2024-02-16T22:19:01.093 INFO:tasks.workunit.client.0.smithi134.stdout:5/882: rename d2/d35/d36/d3d/d63/fa2 to d2/d35/d36/d3d/d9c/d4b/f117 0 2024-02-16T22:19:01.093 INFO:tasks.workunit.client.0.smithi134.stdout:1/857: dwrite d5/d1a/d23/d3c/d6a/fbb [0,4194304] 0 2024-02-16T22:19:01.094 INFO:tasks.workunit.client.0.smithi134.stdout:2/732: dwrite df/d10/d30/d49/d82/f20 [0,4194304] 0 2024-02-16T22:19:01.096 INFO:tasks.workunit.client.0.smithi134.stdout:4/733: rename d0/d6/d1e/d9a to d0/d6/d8/da2/d76/df6 0 2024-02-16T22:19:01.098 INFO:tasks.workunit.client.0.smithi134.stdout:1/858: mknod d5/da/d21/d52/d9b/c113 0 2024-02-16T22:19:01.103 INFO:tasks.workunit.client.0.smithi134.stdout:4/734: symlink d0/d6/d1e/d39/lf7 0 2024-02-16T22:19:01.105 INFO:tasks.workunit.client.0.smithi134.stdout:7/810: sync 2024-02-16T22:19:01.106 INFO:tasks.workunit.client.0.smithi134.stdout:3/876: rename da/d1c/d24/d29/d51/d80/c106 to da/d1c/d24/d29/d51/d80/d89/d8e/dab/c119 0 2024-02-16T22:19:01.107 INFO:tasks.workunit.client.0.smithi134.stdout:8/844: dread d2/f36 [0,4194304] 0 2024-02-16T22:19:01.108 INFO:tasks.workunit.client.0.smithi134.stdout:4/735: creat d0/d31/db8/d1a/ff8 x:0 0 0 2024-02-16T22:19:01.111 INFO:tasks.workunit.client.0.smithi134.stdout:3/877: link da/d1c/d24/d29/d51/d79/d109/f10d da/d1c/d24/d29/d51/d80/d89/d8e/de7/f11a 0 2024-02-16T22:19:01.113 INFO:tasks.workunit.client.0.smithi134.stdout:1/859: dread d5/da/d21/d52/d9b/db3/fd2 [0,4194304] 0 2024-02-16T22:19:01.113 INFO:tasks.workunit.client.0.smithi134.stdout:1/860: chown d5/da/db8/dd5 42153 1 2024-02-16T22:19:01.114 INFO:tasks.workunit.client.0.smithi134.stdout:5/883: rename d2/d9/dc/d32/c48 to d2/d35/d36/c118 0 2024-02-16T22:19:01.114 INFO:tasks.workunit.client.0.smithi134.stdout:6/958: dwrite d17/d27/d93/d9c/dec/d52/d79/f4a [4194304,4194304] 0 2024-02-16T22:19:01.118 INFO:tasks.workunit.client.0.smithi134.stdout:4/736: creat d0/d6/d1e/d7c/ff9 x:0 0 0 2024-02-16T22:19:01.119 INFO:tasks.workunit.client.0.smithi134.stdout:1/861: mknod d5/d1a/d23/d8c/c114 0 2024-02-16T22:19:01.121 INFO:tasks.workunit.client.0.smithi134.stdout:7/811: write d2/d5/f8b [7353707,69416] 0 2024-02-16T22:19:01.121 INFO:tasks.workunit.client.0.smithi134.stdout:7/812: fsync d2/d5/d22/f66 0 2024-02-16T22:19:01.125 INFO:tasks.workunit.client.0.smithi134.stdout:6/959: unlink d17/d27/d30/d32/lbb 0 2024-02-16T22:19:01.126 INFO:tasks.workunit.client.0.smithi134.stdout:5/884: read d2/d35/d36/d3d/f9f [3551358,14593] 0 2024-02-16T22:19:01.126 INFO:tasks.workunit.client.0.smithi134.stdout:5/885: dread - d2/d9/dc/d98/fcb zero size 2024-02-16T22:19:01.126 INFO:tasks.workunit.client.0.smithi134.stdout:5/886: fsync d2/d35/d36/f114 0 2024-02-16T22:19:01.126 INFO:tasks.workunit.client.0.smithi134.stdout:5/887: read d2/d35/d36/d3d/d9c/fe3 [357973,70932] 0 2024-02-16T22:19:01.126 INFO:tasks.workunit.client.0.smithi134.stdout:4/737: mknod d0/d6/d8/da2/cfa 0 2024-02-16T22:19:01.127 INFO:tasks.workunit.client.0.smithi134.stdout:3/878: write da/d1c/d24/dae/f107 [1422928,128968] 0 2024-02-16T22:19:01.127 INFO:tasks.workunit.client.0.smithi134.stdout:2/733: dwrite df/d10/d15/d5a/fa5 [0,4194304] 0 2024-02-16T22:19:01.127 INFO:tasks.workunit.client.0.smithi134.stdout:3/879: creat da/d1c/d24/d29/d51/d80/d89/d8e/dab/f11b x:0 0 0 2024-02-16T22:19:01.128 INFO:tasks.workunit.client.0.smithi134.stdout:8/845: dwrite d2/df/d18/d91/fae [0,4194304] 0 2024-02-16T22:19:01.129 INFO:tasks.workunit.client.0.smithi134.stdout:7/813: creat d2/d6/f10a x:0 0 0 2024-02-16T22:19:01.129 INFO:tasks.workunit.client.0.smithi134.stdout:1/862: dread d5/d1a/d23/d3c/fa8 [0,4194304] 0 2024-02-16T22:19:01.130 INFO:tasks.workunit.client.0.smithi134.stdout:6/960: symlink d17/d27/d30/l139 0 2024-02-16T22:19:01.132 INFO:tasks.workunit.client.0.smithi134.stdout:5/888: mkdir d2/d35/d36/d3d/d9c/dc2/d119 0 2024-02-16T22:19:01.132 INFO:tasks.workunit.client.0.smithi134.stdout:0/828: sync 2024-02-16T22:19:01.132 INFO:tasks.workunit.client.0.smithi134.stdout:0/829: creat d2/dc/d32/d3e/dc1/f113 x:0 0 0 2024-02-16T22:19:01.133 INFO:tasks.workunit.client.0.smithi134.stdout:0/830: readlink d2/dc/d32/d3e/dc1/ld8 0 2024-02-16T22:19:01.139 INFO:tasks.workunit.client.0.smithi134.stdout:2/734: rename df/d10/d30/d4d/d94/da3/fce to df/d10/d30/da2/fd8 0 2024-02-16T22:19:01.140 INFO:tasks.workunit.client.0.smithi134.stdout:0/831: rename d2/d20/d77/d85 to d2/d20/d77/d85/db6/d108/d112/d114 22 2024-02-16T22:19:01.140 INFO:tasks.workunit.client.0.smithi134.stdout:6/961: dread d17/d36/d77/d9a/d28/d5b/d88/fa4 [4194304,4194304] 0 2024-02-16T22:19:01.140 INFO:tasks.workunit.client.0.smithi134.stdout:6/962: creat d17/d27/d93/d9c/dec/dcb/f13a x:0 0 0 2024-02-16T22:19:01.140 INFO:tasks.workunit.client.0.smithi134.stdout:6/963: creat d17/d27/d93/d9c/dec/dd4/f13b x:0 0 0 2024-02-16T22:19:01.141 INFO:tasks.workunit.client.0.smithi134.stdout:6/964: write d17/d36/d77/d9a/d73/dd6/f131 [688209,20562] 0 2024-02-16T22:19:01.146 INFO:tasks.workunit.client.0.smithi134.stdout:8/846: link d2/df/d18/cb d2/df/d18/dc5/d11e/d59/da0/d40/d53/daa/d105/c122 0 2024-02-16T22:19:01.147 INFO:tasks.workunit.client.0.smithi134.stdout:8/847: write d2/df/d18/dc5/d11e/d59/db1/fcb [596339,47258] 0 2024-02-16T22:19:01.147 INFO:tasks.workunit.client.0.smithi134.stdout:8/848: chown d2/df/d18/dc5/d11e/d59/da0/d40/d53/dbe 14796 1 2024-02-16T22:19:01.147 INFO:tasks.workunit.client.0.smithi134.stdout:8/849: chown d2/df/d18/dc5/d11e/d59/da0/d40/d53/daa/d105/f79 1007 1 2024-02-16T22:19:01.148 INFO:tasks.workunit.client.0.smithi134.stdout:1/863: mknod d5/da/d1c/c115 0 2024-02-16T22:19:01.148 INFO:tasks.workunit.client.0.smithi134.stdout:1/864: write d5/d1a/d23/f2b [1282175,90382] 0 2024-02-16T22:19:01.148 INFO:tasks.workunit.client.0.smithi134.stdout:1/865: dread - d5/fd0 zero size 2024-02-16T22:19:01.155 INFO:tasks.workunit.client.0.smithi134.stdout:6/965: mkdir d17/d36/d77/d9a/d28/d5b/d88/daf/d13c 0 2024-02-16T22:19:01.157 INFO:tasks.workunit.client.0.smithi134.stdout:8/850: rmdir d2/df/d18/dc5/d11e/d59/da0/d40/d53/daa/ddd 0 2024-02-16T22:19:01.159 INFO:tasks.workunit.client.0.smithi134.stdout:6/966: creat d17/d27/d93/d9c/ddb/f13d x:0 0 0 2024-02-16T22:19:01.160 INFO:tasks.workunit.client.0.smithi134.stdout:8/851: creat d2/df/d18/d27/d85/da4/f123 x:0 0 0 2024-02-16T22:19:01.161 INFO:tasks.workunit.client.0.smithi134.stdout:6/967: getdents d17/d36/d77/d9a/d28/d5b/de8 0 2024-02-16T22:19:01.162 INFO:tasks.workunit.client.0.smithi134.stdout:8/852: unlink d2/df/d18/d2a/c32 0 2024-02-16T22:19:01.162 INFO:tasks.workunit.client.0.smithi134.stdout:8/853: truncate d2/df/d18/dc5/d11e/d59/f98 736352 0 2024-02-16T22:19:01.164 INFO:tasks.workunit.client.0.smithi134.stdout:6/968: rename d17/d27/d93/d9c/dec/f78 to d17/d63/f13e 0 2024-02-16T22:19:01.165 INFO:tasks.workunit.client.0.smithi134.stdout:6/969: mkdir d17/d63/d13f 0 2024-02-16T22:19:01.166 INFO:tasks.workunit.client.0.smithi134.stdout:6/970: symlink d17/d36/dd0/daa/l140 0 2024-02-16T22:19:01.167 INFO:tasks.workunit.client.0.smithi134.stdout:6/971: mknod d17/d36/d77/d9a/d28/d5b/c141 0 2024-02-16T22:19:01.167 INFO:tasks.workunit.client.0.smithi134.stdout:6/972: fsync d17/d27/d93/d9c/dec/f11a 0 2024-02-16T22:19:01.167 INFO:tasks.workunit.client.0.smithi134.stdout:6/973: write d17/d27/d93/d9c/dec/d52/d87/f101 [756482,57126] 0 2024-02-16T22:19:01.175 INFO:tasks.workunit.client.0.smithi134.stdout:8/854: dread d2/df/d18/dc5/d11e/d59/da0/d9f/faf [0,4194304] 0 2024-02-16T22:19:01.176 INFO:tasks.workunit.client.0.smithi134.stdout:8/855: unlink d2/df/d18/l50 0 2024-02-16T22:19:01.177 INFO:tasks.workunit.client.0.smithi134.stdout:4/738: dwrite d0/d6/d1e/d39/f85 [0,4194304] 0 2024-02-16T22:19:01.177 INFO:tasks.workunit.client.0.smithi134.stdout:4/739: fdatasync d0/d6/d22/d25/f8e 0 2024-02-16T22:19:01.177 INFO:tasks.workunit.client.0.smithi134.stdout:4/740: fsync d0/d6/d22/d25/f98 0 2024-02-16T22:19:01.178 INFO:tasks.workunit.client.0.smithi134.stdout:8/856: rename d2/df/d18/dc5/d11e/d59/db1/l74 to d2/df/d18/db5/dce/l124 0 2024-02-16T22:19:01.178 INFO:tasks.workunit.client.0.smithi134.stdout:8/857: chown d2/df/d18/l6b 50 1 2024-02-16T22:19:01.178 INFO:tasks.workunit.client.0.smithi134.stdout:4/741: getdents d0/d6/d22/d25 0 2024-02-16T22:19:01.179 INFO:tasks.workunit.client.0.smithi134.stdout:4/742: fsync d0/d6/d8/da2/d76/fdf 0 2024-02-16T22:19:01.179 INFO:tasks.workunit.client.0.smithi134.stdout:8/858: rmdir d2/df/d18/dc5/d11e/d59/da0/d86 39 2024-02-16T22:19:01.180 INFO:tasks.workunit.client.0.smithi134.stdout:4/743: creat d0/d6/d8/da2/d76/ffb x:0 0 0 2024-02-16T22:19:01.180 INFO:tasks.workunit.client.0.smithi134.stdout:4/744: write d0/d6/d22/d97/daf/fc7 [1023675,21349] 0 2024-02-16T22:19:01.181 INFO:tasks.workunit.client.0.smithi134.stdout:8/859: link d2/df/d18/d27/l4c d2/df/d18/l125 0 2024-02-16T22:19:01.182 INFO:tasks.workunit.client.0.smithi134.stdout:4/745: rename d0/d6/d1e/d39/f85 to d0/d6/d44/ffc 0 2024-02-16T22:19:01.182 INFO:tasks.workunit.client.0.smithi134.stdout:8/860: getdents d2/df/d18/dc5/d11e/d59/db1/d87/df2 0 2024-02-16T22:19:01.183 INFO:tasks.workunit.client.0.smithi134.stdout:4/746: chown d0/d31/db8/d46/c94 22101 1 2024-02-16T22:19:01.184 INFO:tasks.workunit.client.0.smithi134.stdout:3/880: dwrite da/d1c/d24/d29/d51/f59 [0,4194304] 0 2024-02-16T22:19:01.184 INFO:tasks.workunit.client.0.smithi134.stdout:2/735: dwrite df/d10/d15/d5a/f8c [0,4194304] 0 2024-02-16T22:19:01.184 INFO:tasks.workunit.client.0.smithi134.stdout:1/866: dwrite d5/fd0 [0,4194304] 0 2024-02-16T22:19:01.184 INFO:tasks.workunit.client.0.smithi134.stdout:7/814: dwrite d2/d6/d7d/d92/dcd/f9f [0,4194304] 0 2024-02-16T22:19:01.184 INFO:tasks.workunit.client.0.smithi134.stdout:6/974: dwrite d17/d27/d93/d9c/dec/f50 [0,4194304] 0 2024-02-16T22:19:01.193 INFO:tasks.workunit.client.0.smithi134.stdout:4/747: link d0/d6/lae d0/d6/d22/d25/lfd 0 2024-02-16T22:19:01.196 INFO:tasks.workunit.client.0.smithi134.stdout:3/881: creat da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/f11c x:0 0 0 2024-02-16T22:19:01.198 INFO:tasks.workunit.client.0.smithi134.stdout:2/736: rmdir df/d10/da6 39 2024-02-16T22:19:01.200 INFO:tasks.workunit.client.0.smithi134.stdout:7/815: dread d2/d6/d7d/d92/da5/f2a [4194304,4194304] 0 2024-02-16T22:19:01.201 INFO:tasks.workunit.client.0.smithi134.stdout:1/867: link d5/d1a/d23/d3c/d6a/d5c/d72/fda d5/da/d21/d52/d9b/f116 0 2024-02-16T22:19:01.201 INFO:tasks.workunit.client.0.smithi134.stdout:7/816: write d2/d6/f41 [4312315,94564] 0 2024-02-16T22:19:01.204 INFO:tasks.workunit.client.0.smithi134.stdout:6/975: unlink d17/d27/d93/c95 0 2024-02-16T22:19:01.205 INFO:tasks.workunit.client.0.smithi134.stdout:4/748: stat d0/d6/d1e/d3b/c6f 0 2024-02-16T22:19:01.205 INFO:tasks.workunit.client.0.smithi134.stdout:4/749: chown d0/d6/d22/d25/f90 425551924 1 2024-02-16T22:19:01.206 INFO:tasks.workunit.client.0.smithi134.stdout:3/882: creat da/d1c/d24/d29/d51/d80/d89/f11d x:0 0 0 2024-02-16T22:19:01.207 INFO:tasks.workunit.client.0.smithi134.stdout:2/737: unlink df/d10/d15/d5a/f65 0 2024-02-16T22:19:01.208 INFO:tasks.workunit.client.0.smithi134.stdout:1/868: mknod d5/da/d21/d45/d93/c117 0 2024-02-16T22:19:01.208 INFO:tasks.workunit.client.0.smithi134.stdout:1/869: creat d5/da/d21/d52/f118 x:0 0 0 2024-02-16T22:19:01.208 INFO:tasks.workunit.client.0.smithi134.stdout:1/870: readlink d5/d1a/l22 0 2024-02-16T22:19:01.210 INFO:tasks.workunit.client.0.smithi134.stdout:7/817: symlink d2/d5/d19/d84/l10b 0 2024-02-16T22:19:01.211 INFO:tasks.workunit.client.0.smithi134.stdout:6/976: read d17/d36/d77/d9a/f29 [3636375,29283] 0 2024-02-16T22:19:01.211 INFO:tasks.workunit.client.0.smithi134.stdout:6/977: creat d17/d27/d93/d9c/dec/d52/d79/f142 x:0 0 0 2024-02-16T22:19:01.214 INFO:tasks.workunit.client.0.smithi134.stdout:4/750: rename d0/d6/d22/d25/f69 to d0/d6/d8/d32/d63/ffe 0 2024-02-16T22:19:01.216 INFO:tasks.workunit.client.0.smithi134.stdout:2/738: mknod df/d10/d30/d49/d85/cd9 0 2024-02-16T22:19:01.216 INFO:tasks.workunit.client.0.smithi134.stdout:2/739: fdatasync df/d10/f3b 0 2024-02-16T22:19:01.216 INFO:tasks.workunit.client.0.smithi134.stdout:2/740: creat df/d10/d30/d49/d82/d1b/fda x:0 0 0 2024-02-16T22:19:01.216 INFO:tasks.workunit.client.0.smithi134.stdout:2/741: read - df/d10/d15/d5a/fd1 zero size 2024-02-16T22:19:01.217 INFO:tasks.workunit.client.0.smithi134.stdout:3/883: write da/d1c/d24/d29/d51/fb4 [7223389,84700] 0 2024-02-16T22:19:01.218 INFO:tasks.workunit.client.0.smithi134.stdout:8/861: dwrite d2/f5d [0,4194304] 0 2024-02-16T22:19:01.221 INFO:tasks.workunit.client.0.smithi134.stdout:2/742: rename df/d10/d15/d5a/f4c to df/d41/d97/fdb 0 2024-02-16T22:19:01.223 INFO:tasks.workunit.client.0.smithi134.stdout:1/871: rmdir d5/d1a/d82 39 2024-02-16T22:19:01.223 INFO:tasks.workunit.client.0.smithi134.stdout:1/872: write d5/d1a/d23/d8c/fc7 [1585298,76810] 0 2024-02-16T22:19:01.231 INFO:tasks.workunit.client.0.smithi134.stdout:3/884: creat da/d1c/d24/d29/d51/d80/d89/d8e/dbc/f11e x:0 0 0 2024-02-16T22:19:01.231 INFO:tasks.workunit.client.0.smithi134.stdout:3/885: fsync da/d6b/dc1/ff4 0 2024-02-16T22:19:01.231 INFO:tasks.workunit.client.0.smithi134.stdout:3/886: truncate da/dc3/fd8 1030684 0 2024-02-16T22:19:01.231 INFO:tasks.workunit.client.0.smithi134.stdout:1/873: write d5/d1a/d23/f20 [1057169,25428] 0 2024-02-16T22:19:01.233 INFO:tasks.workunit.client.0.smithi134.stdout:8/862: symlink d2/df/d18/dc5/d11e/d59/db1/d90/l126 0 2024-02-16T22:19:01.236 INFO:tasks.workunit.client.0.smithi134.stdout:3/887: creat da/d6b/f11f x:0 0 0 2024-02-16T22:19:01.237 INFO:tasks.workunit.client.0.smithi134.stdout:2/743: symlink df/d10/d30/ldc 0 2024-02-16T22:19:01.238 INFO:tasks.workunit.client.0.smithi134.stdout:8/863: dread d2/df/d18/dc5/d11e/d59/db1/d87/f7a [0,4194304] 0 2024-02-16T22:19:01.239 INFO:tasks.workunit.client.0.smithi134.stdout:2/744: creat df/d10/d30/fdd x:0 0 0 2024-02-16T22:19:01.241 INFO:tasks.workunit.client.0.smithi134.stdout:8/864: creat d2/f127 x:0 0 0 2024-02-16T22:19:01.243 INFO:tasks.workunit.client.0.smithi134.stdout:2/745: mknod df/d10/d30/d49/d7b/cde 0 2024-02-16T22:19:01.244 INFO:tasks.workunit.client.0.smithi134.stdout:1/874: read d5/d1a/f62 [1532387,24821] 0 2024-02-16T22:19:01.244 INFO:tasks.workunit.client.0.smithi134.stdout:1/875: creat d5/d1a/d4d/f119 x:0 0 0 2024-02-16T22:19:01.245 INFO:tasks.workunit.client.0.smithi134.stdout:8/865: unlink d2/df/d18/dc5/d11e/d59/f84 0 2024-02-16T22:19:01.248 INFO:tasks.workunit.client.0.smithi134.stdout:1/876: mkdir d5/d1a/d23/d3c/d6a/d11a 0 2024-02-16T22:19:01.248 INFO:tasks.workunit.client.0.smithi134.stdout:1/877: readlink d5/da/d21/d52/l87 0 2024-02-16T22:19:01.248 INFO:tasks.workunit.client.0.smithi134.stdout:1/878: dread - d5/d1a/d82/f106 zero size 2024-02-16T22:19:01.248 INFO:tasks.workunit.client.0.smithi134.stdout:3/888: write da/d1c/fd6 [2441536,45096] 0 2024-02-16T22:19:01.248 INFO:tasks.workunit.client.0.smithi134.stdout:3/889: chown da/d1c/d24/dae/fdc 2840998 1 2024-02-16T22:19:01.248 INFO:tasks.workunit.client.0.smithi134.stdout:8/866: mkdir d2/df/d18/dc5/d11e/d59/da0/d40/d53/d128 0 2024-02-16T22:19:01.249 INFO:tasks.workunit.client.0.smithi134.stdout:1/879: mkdir d5/d1a/d23/d85/de5/d11b 0 2024-02-16T22:19:01.249 INFO:tasks.workunit.client.0.smithi134.stdout:1/880: readlink d5/d1a/d23/d8c/la9 0 2024-02-16T22:19:01.250 INFO:tasks.workunit.client.0.smithi134.stdout:3/890: chown da/d1c/d24/d9a/dc0/d8a/d8f/c2e 184764696 1 2024-02-16T22:19:01.251 INFO:tasks.workunit.client.0.smithi134.stdout:8/867: mknod d2/df/d18/dc5/d11e/d59/da0/d40/d53/d5e/d72/d7d/c129 0 2024-02-16T22:19:01.252 INFO:tasks.workunit.client.0.smithi134.stdout:7/818: dwrite d2/d5/d19/f44 [0,4194304] 0 2024-02-16T22:19:01.252 INFO:tasks.workunit.client.0.smithi134.stdout:1/881: truncate d5/da/d21/d45/d93/faf 1076111 0 2024-02-16T22:19:01.252 INFO:tasks.workunit.client.0.smithi134.stdout:4/751: dwrite d0/d6/d1e/d39/f66 [8388608,4194304] 0 2024-02-16T22:19:01.252 INFO:tasks.workunit.client.0.smithi134.stdout:6/978: dwrite d17/dfd/dbc/fce [0,4194304] 0 2024-02-16T22:19:01.253 INFO:tasks.workunit.client.0.smithi134.stdout:6/979: chown d17/d36/d77/d9a/d28/d5b/d103 44262667 1 2024-02-16T22:19:01.254 INFO:tasks.workunit.client.0.smithi134.stdout:7/819: rename d2/d6/d7d/d92/da5/c50 to d2/d5/d4c/df5/c10c 0 2024-02-16T22:19:01.254 INFO:tasks.workunit.client.0.smithi134.stdout:7/820: chown d2/d5/d22/d26/l8f 191 1 2024-02-16T22:19:01.254 INFO:tasks.workunit.client.0.smithi134.stdout:7/821: readlink d2/d5/d4c/l64 0 2024-02-16T22:19:01.257 INFO:tasks.workunit.client.0.smithi134.stdout:6/980: read d17/d27/f34 [3829875,129815] 0 2024-02-16T22:19:01.258 INFO:tasks.workunit.client.0.smithi134.stdout:2/746: dread df/d10/d30/d49/d82/d1b/f22 [0,4194304] 0 2024-02-16T22:19:01.261 INFO:tasks.workunit.client.0.smithi134.stdout:4/752: rename d0/d6/d58 to d0/d6/d1e/d7c/dff 0 2024-02-16T22:19:01.262 INFO:tasks.workunit.client.0.smithi134.stdout:4/753: fsync d0/d6/d1e/d39/fe0 0 2024-02-16T22:19:01.262 INFO:tasks.workunit.client.0.smithi134.stdout:8/868: write d2/df/d18/dc5/d11e/d59/db1/f7f [2921656,8116] 0 2024-02-16T22:19:01.264 INFO:tasks.workunit.client.0.smithi134.stdout:7/822: symlink d2/d6/d7d/d92/da5/d63/dc2/l10d 0 2024-02-16T22:19:01.264 INFO:tasks.workunit.client.0.smithi134.stdout:7/823: chown d2/d6/d91/db3 16 1 2024-02-16T22:19:01.265 INFO:tasks.workunit.client.0.smithi134.stdout:6/981: symlink d17/d36/d77/d9a/d28/d5b/d103/l143 0 2024-02-16T22:19:01.267 INFO:tasks.workunit.client.0.smithi134.stdout:2/747: symlink df/d6f/ldf 0 2024-02-16T22:19:01.267 INFO:tasks.workunit.client.0.smithi134.stdout:2/748: dread - df/d10/d3a/fb9 zero size 2024-02-16T22:19:01.268 INFO:tasks.workunit.client.0.smithi134.stdout:8/869: getdents d2/df/d18/dc5/d11e/d59/da0/d40/d53/d5e/d72 0 2024-02-16T22:19:01.270 INFO:tasks.workunit.client.0.smithi134.stdout:4/754: dread d0/d6/d1e/d7c/dff/d59/fa3 [0,4194304] 0 2024-02-16T22:19:01.270 INFO:tasks.workunit.client.0.smithi134.stdout:4/755: write d0/d6/d22/f67 [3569902,102741] 0 2024-02-16T22:19:01.270 INFO:tasks.workunit.client.0.smithi134.stdout:4/756: chown d0/d6/d8/da2/d76/ffb 21031829 1 2024-02-16T22:19:01.270 INFO:tasks.workunit.client.0.smithi134.stdout:4/757: chown d0/d6/d22/d25/lcb 1749197 1 2024-02-16T22:19:01.270 INFO:tasks.workunit.client.0.smithi134.stdout:7/824: mkdir d2/d5/d19/d84/d86/d93/dab/d40/df1/d104/d10e 0 2024-02-16T22:19:01.271 INFO:tasks.workunit.client.0.smithi134.stdout:6/982: symlink d17/d27/d30/d32/deb/l144 0 2024-02-16T22:19:01.274 INFO:tasks.workunit.client.0.smithi134.stdout:2/749: creat df/d6f/dd2/fe0 x:0 0 0 2024-02-16T22:19:01.274 INFO:tasks.workunit.client.0.smithi134.stdout:2/750: truncate df/d10/d30/d4d/d94/da3/f63 658683 0 2024-02-16T22:19:01.275 INFO:tasks.workunit.client.0.smithi134.stdout:8/870: symlink d2/df/d18/dc5/d11e/d59/l12a 0 2024-02-16T22:19:01.276 INFO:tasks.workunit.client.0.smithi134.stdout:8/871: truncate d2/df/fe7 955455 0 2024-02-16T22:19:01.276 INFO:tasks.workunit.client.0.smithi134.stdout:8/872: creat d2/df/d18/db5/dce/f12b x:0 0 0 2024-02-16T22:19:01.276 INFO:tasks.workunit.client.0.smithi134.stdout:8/873: chown d2/df/d18/d12/fb9 2849 1 2024-02-16T22:19:01.278 INFO:tasks.workunit.client.0.smithi134.stdout:2/751: mknod df/d10/d3a/da9/dae/ce1 0 2024-02-16T22:19:01.281 INFO:tasks.workunit.client.0.smithi134.stdout:3/891: dwrite da/d1c/d24/d9a/dc0/d8a/d8f/f3f [4194304,4194304] 0 2024-02-16T22:19:01.281 INFO:tasks.workunit.client.0.smithi134.stdout:3/892: creat da/d12/f120 x:0 0 0 2024-02-16T22:19:01.282 INFO:tasks.workunit.client.0.smithi134.stdout:3/893: creat da/d1c/d24/d29/d51/d80/d89/f121 x:0 0 0 2024-02-16T22:19:01.283 INFO:tasks.workunit.client.0.smithi134.stdout:1/882: dwrite d5/da/d21/d45/d93/fcd [0,4194304] 0 2024-02-16T22:19:01.283 INFO:tasks.workunit.client.0.smithi134.stdout:1/883: write d5/da/d21/f37 [2233794,72174] 0 2024-02-16T22:19:01.283 INFO:tasks.workunit.client.0.smithi134.stdout:1/884: chown d5/d1a/d23/d3c/d6a/d5c/d72/c105 13 1 2024-02-16T22:19:01.284 INFO:tasks.workunit.client.0.smithi134.stdout:4/758: write d0/d6/d8/da2/f80 [55163,25923] 0 2024-02-16T22:19:01.286 INFO:tasks.workunit.client.0.smithi134.stdout:3/894: dread da/d12/f114 [0,4194304] 0 2024-02-16T22:19:01.287 INFO:tasks.workunit.client.0.smithi134.stdout:5/889: sync 2024-02-16T22:19:01.287 INFO:tasks.workunit.client.0.smithi134.stdout:0/832: sync 2024-02-16T22:19:01.287 INFO:tasks.workunit.client.0.smithi134.stdout:1/885: dread d5/d1a/d63/f69 [0,4194304] 0 2024-02-16T22:19:01.287 INFO:tasks.workunit.client.0.smithi134.stdout:1/886: fdatasync d5/d1a/d23/f2b 0 2024-02-16T22:19:01.287 INFO:tasks.workunit.client.0.smithi134.stdout:5/890: write d2/d9/dc/d32/dce/f109 [552516,100866] 0 2024-02-16T22:19:01.287 INFO:tasks.workunit.client.0.smithi134.stdout:5/891: readlink d2/d9/dc/d32/d61/l8c 0 2024-02-16T22:19:01.290 INFO:tasks.workunit.client.0.smithi134.stdout:6/983: rename d17/d27/d93/d9c/dec/dcb to d17/d36/d77/d145 0 2024-02-16T22:19:01.296 INFO:tasks.workunit.client.0.smithi134.stdout:0/833: read d2/d20/d77/d85/f99 [796452,127065] 0 2024-02-16T22:19:01.298 INFO:tasks.workunit.client.0.smithi134.stdout:4/759: creat d0/d6/d22/d40/f100 x:0 0 0 2024-02-16T22:19:01.298 INFO:tasks.workunit.client.0.smithi134.stdout:4/760: fdatasync d0/d6/d1e/d3b/fe1 0 2024-02-16T22:19:01.298 INFO:tasks.workunit.client.0.smithi134.stdout:4/761: write d0/d6/d22/d25/f3d [1530085,121518] 0 2024-02-16T22:19:01.299 INFO:tasks.workunit.client.0.smithi134.stdout:3/895: symlink da/d6b/dc1/de6/l122 0 2024-02-16T22:19:01.299 INFO:tasks.workunit.client.0.smithi134.stdout:3/896: write da/d1c/d24/d9a/dc0/d8a/fd1 [44080,26175] 0 2024-02-16T22:19:01.299 INFO:tasks.workunit.client.0.smithi134.stdout:3/897: dread - da/fde zero size 2024-02-16T22:19:01.301 INFO:tasks.workunit.client.0.smithi134.stdout:1/887: creat d5/d1a/d23/d85/f11c x:0 0 0 2024-02-16T22:19:01.302 INFO:tasks.workunit.client.0.smithi134.stdout:5/892: rmdir d2/d9/dc/df7 39 2024-02-16T22:19:01.302 INFO:tasks.workunit.client.0.smithi134.stdout:5/893: chown d2/d35/d36/d46/d68/d74/c101 15 1 2024-02-16T22:19:01.303 INFO:tasks.workunit.client.0.smithi134.stdout:5/894: fdatasync d2/d35/d36/d3d/d63/d90/fa6 0 2024-02-16T22:19:01.303 INFO:tasks.workunit.client.0.smithi134.stdout:8/874: dwrite d2/f5d [0,4194304] 0 2024-02-16T22:19:01.313 INFO:tasks.workunit.client.0.smithi134.stdout:6/984: rename d17/d36/dd0/daa/cee to d17/d36/d77/d9a/d28/d5b/d88/d90/c146 0 2024-02-16T22:19:01.316 INFO:tasks.workunit.client.0.smithi134.stdout:5/895: link d2/d35/d36/da1/dbf/ffb d2/d9/dc/df7/dff/f11a 0 2024-02-16T22:19:01.320 INFO:tasks.workunit.client.0.smithi134.stdout:1/888: rename d5/d1a/d23/d3c to d5/d1a/d53/d86/d11d 0 2024-02-16T22:19:01.321 INFO:tasks.workunit.client.0.smithi134.stdout:6/985: rename d17/d36/dd0/lb8 to d17/d36/d77/d145/l147 0 2024-02-16T22:19:01.323 INFO:tasks.workunit.client.0.smithi134.stdout:5/896: rename d2/d35/d36/d3d/d9c/dc2 to d2/d9/dc/d15/d2f/ddf/d11b 0 2024-02-16T22:19:01.323 INFO:tasks.workunit.client.0.smithi134.stdout:5/897: readlink d2/d9/dc/l8d 0 2024-02-16T22:19:01.324 INFO:tasks.workunit.client.0.smithi134.stdout:5/898: creat d2/d35/d72/f11c x:0 0 0 2024-02-16T22:19:01.324 INFO:tasks.workunit.client.0.smithi134.stdout:6/986: mknod d17/d36/d77/d9a/d73/d11c/c148 0 2024-02-16T22:19:01.325 INFO:tasks.workunit.client.0.smithi134.stdout:1/889: mkdir d5/d11e 0 2024-02-16T22:19:01.325 INFO:tasks.workunit.client.0.smithi134.stdout:1/890: readlink d5/d1a/d23/d85/lc8 0 2024-02-16T22:19:01.325 INFO:tasks.workunit.client.0.smithi134.stdout:1/891: write d5/da/db8/f10f [604917,46502] 0 2024-02-16T22:19:01.327 INFO:tasks.workunit.client.0.smithi134.stdout:5/899: mknod d2/dfe/c11d 0 2024-02-16T22:19:01.327 INFO:tasks.workunit.client.0.smithi134.stdout:5/900: write d2/d35/d36/d3d/f9f [373088,52577] 0 2024-02-16T22:19:01.330 INFO:tasks.workunit.client.0.smithi134.stdout:1/892: creat d5/da/d21/d52/d9b/f11f x:0 0 0 2024-02-16T22:19:01.330 INFO:tasks.workunit.client.0.smithi134.stdout:1/893: chown d5/da/d21/d52/cfb 2581 1 2024-02-16T22:19:01.332 INFO:tasks.workunit.client.0.smithi134.stdout:5/901: truncate d2/d9/dc/d15/f3b 1625791 0 2024-02-16T22:19:01.332 INFO:tasks.workunit.client.0.smithi134.stdout:5/902: creat d2/dc9/f11e x:0 0 0 2024-02-16T22:19:01.334 INFO:tasks.workunit.client.0.smithi134.stdout:6/987: rmdir d17/d27/d93/d9c/dec/d52/d79 39 2024-02-16T22:19:01.334 INFO:tasks.workunit.client.0.smithi134.stdout:6/988: chown d17/d36/d77/d9a/d28/d5b/d88/d90/c146 10835 1 2024-02-16T22:19:01.341 INFO:tasks.workunit.client.0.smithi134.stdout:0/834: dwrite d2/d20/d7a/ffa [0,4194304] 0 2024-02-16T22:19:01.341 INFO:tasks.workunit.client.0.smithi134.stdout:0/835: creat d2/d20/d50/f115 x:0 0 0 2024-02-16T22:19:01.342 INFO:tasks.workunit.client.0.smithi134.stdout:3/898: dwrite da/d1c/d24/d9a/dc0/d8a/fef [4194304,4194304] 0 2024-02-16T22:19:01.347 INFO:tasks.workunit.client.0.smithi134.stdout:0/836: symlink d2/d56/l116 0 2024-02-16T22:19:01.348 INFO:tasks.workunit.client.0.smithi134.stdout:0/837: fdatasync d2/dc/dc4/f10e 0 2024-02-16T22:19:01.348 INFO:tasks.workunit.client.0.smithi134.stdout:8/875: dwrite d2/df/d18/dc5/d11e/d59/da0/d40/f10f [0,4194304] 0 2024-02-16T22:19:01.348 INFO:tasks.workunit.client.0.smithi134.stdout:8/876: read - d2/df/d18/d91/fd9 zero size 2024-02-16T22:19:01.350 INFO:tasks.workunit.client.0.smithi134.stdout:8/877: write d2/df/d7c/fc2 [93597,32336] 0 2024-02-16T22:19:01.354 INFO:tasks.workunit.client.0.smithi134.stdout:8/878: mknod d2/c12c 0 2024-02-16T22:19:01.354 INFO:tasks.workunit.client.0.smithi134.stdout:8/879: read d2/df/d18/dc5/d11e/d59/da0/d9f/fcf [2468438,116264] 0 2024-02-16T22:19:01.355 INFO:tasks.workunit.client.0.smithi134.stdout:8/880: mkdir d2/df/d18/d12/d12d 0 2024-02-16T22:19:01.356 INFO:tasks.workunit.client.0.smithi134.stdout:8/881: creat d2/df/d18/db5/dbc/f12e x:0 0 0 2024-02-16T22:19:01.357 INFO:tasks.workunit.client.0.smithi134.stdout:8/882: mkdir d2/df/d18/dc5/d11e/d59/da0/d40/d53/daa/df1/d12f 0 2024-02-16T22:19:01.358 INFO:tasks.workunit.client.0.smithi134.stdout:8/883: fdatasync d2/f2c 0 2024-02-16T22:19:01.362 INFO:tasks.workunit.client.0.smithi134.stdout:0/838: write d2/dc/f2b [1681129,37548] 0 2024-02-16T22:19:01.362 INFO:tasks.workunit.client.0.smithi134.stdout:0/839: write d2/dc/d32/d3e/d5e/fea [362022,123981] 0 2024-02-16T22:19:01.363 INFO:tasks.workunit.client.0.smithi134.stdout:0/840: unlink d2/d56/f8b 0 2024-02-16T22:19:01.364 INFO:tasks.workunit.client.0.smithi134.stdout:1/894: dwrite d5/da/d21/d45/f7b [0,4194304] 0 2024-02-16T22:19:01.364 INFO:tasks.workunit.client.0.smithi134.stdout:1/895: chown d5/d1a/d53/d86/f9a 83397 1 2024-02-16T22:19:01.365 INFO:tasks.workunit.client.0.smithi134.stdout:0/841: unlink d2/dc/d48/f57 0 2024-02-16T22:19:01.366 INFO:tasks.workunit.client.0.smithi134.stdout:1/896: rename d5/da/d21/d52/ce2 to d5/d1a/c120 0 2024-02-16T22:19:01.368 INFO:tasks.workunit.client.0.smithi134.stdout:1/897: dread d5/d1a/d53/d86/d11d/d6a/d5c/d72/f79 [0,4194304] 0 2024-02-16T22:19:01.370 INFO:tasks.workunit.client.0.smithi134.stdout:1/898: rename d5/da/d1c/f49 to d5/da/d2d/dca/f121 0 2024-02-16T22:19:01.372 INFO:tasks.workunit.client.0.smithi134.stdout:8/884: dread d2/df/d18/db5/f11c [4194304,4194304] 0 2024-02-16T22:19:01.372 INFO:tasks.workunit.client.0.smithi134.stdout:5/903: dwrite d2/d35/d36/da9/fb2 [0,4194304] 0 2024-02-16T22:19:01.373 INFO:tasks.workunit.client.0.smithi134.stdout:6/989: dwrite d17/d36/d77/d9a/d73/f108 [0,4194304] 0 2024-02-16T22:19:01.373 INFO:tasks.workunit.client.0.smithi134.stdout:6/990: write d17/d27/d93/d9c/dec/d52/d79/f4a [8564903,25500] 0 2024-02-16T22:19:01.375 INFO:tasks.workunit.client.0.smithi134.stdout:0/842: dread d2/d20/d50/f82 [0,4194304] 0 2024-02-16T22:19:01.376 INFO:tasks.workunit.client.0.smithi134.stdout:3/899: dwrite da/f3a [0,4194304] 0 2024-02-16T22:19:01.376 INFO:tasks.workunit.client.0.smithi134.stdout:3/900: chown da/d12/c13 403 1 2024-02-16T22:19:01.376 INFO:tasks.workunit.client.0.smithi134.stdout:3/901: readlink da/d1c/d24/d29/d51/d80/d89/d8e/dab/lb1 0 2024-02-16T22:19:01.376 INFO:tasks.workunit.client.0.smithi134.stdout:5/904: creat d2/d9/dc/d15/d2f/ddf/d11b/f11f x:0 0 0 2024-02-16T22:19:01.378 INFO:tasks.workunit.client.0.smithi134.stdout:6/991: mknod d17/d36/d77/d9a/d28/d5b/d88/dd8/c149 0 2024-02-16T22:19:01.383 INFO:tasks.workunit.client.0.smithi134.stdout:8/885: write d2/df/d18/d91/fae [1595241,66006] 0 2024-02-16T22:19:01.383 INFO:tasks.workunit.client.0.smithi134.stdout:8/886: chown d2/df/d18/dc5/d11e/d59/cdc 11 1 2024-02-16T22:19:01.387 INFO:tasks.workunit.client.0.smithi134.stdout:3/902: symlink da/d6b/dc1/de6/l123 0 2024-02-16T22:19:01.387 INFO:tasks.workunit.client.0.smithi134.stdout:1/899: dwrite d5/da/d21/d45/fad [4194304,4194304] 0 2024-02-16T22:19:01.387 INFO:tasks.workunit.client.0.smithi134.stdout:1/900: write d5/da/d21/d45/f77 [3642034,50266] 0 2024-02-16T22:19:01.388 INFO:tasks.workunit.client.0.smithi134.stdout:3/903: dread da/d1c/d24/d29/d51/d79/d109/f10d [0,4194304] 0 2024-02-16T22:19:01.388 INFO:tasks.workunit.client.0.smithi134.stdout:1/901: write d5/d1a/d63/f69 [602702,7716] 0 2024-02-16T22:19:01.388 INFO:tasks.workunit.client.0.smithi134.stdout:1/902: read d5/da/d21/d45/d93/f5e [4166,80385] 0 2024-02-16T22:19:01.388 INFO:tasks.workunit.client.0.smithi134.stdout:5/905: rmdir d2/d9/dc/df7 39 2024-02-16T22:19:01.391 INFO:tasks.workunit.client.0.smithi134.stdout:8/887: symlink d2/df/d18/d27/d85/da4/l130 0 2024-02-16T22:19:01.393 INFO:tasks.workunit.client.0.smithi134.stdout:6/992: dread d17/d27/d93/d9c/dec/d52/d79/f4a [4194304,4194304] 0 2024-02-16T22:19:01.395 INFO:tasks.workunit.client.0.smithi134.stdout:3/904: unlink da/d6b/dc1/fe9 0 2024-02-16T22:19:01.395 INFO:tasks.workunit.client.0.smithi134.stdout:3/905: chown da/dc3/lcf 21466617 1 2024-02-16T22:19:01.396 INFO:tasks.workunit.client.0.smithi134.stdout:3/906: readlink da/d1c/d24/d9a/dc0/d8a/d8f/d6d/l9e 0 2024-02-16T22:19:01.396 INFO:tasks.workunit.client.0.smithi134.stdout:3/907: chown da/d1c/d24/d9a/dc0/d8a/d8f/d5f/la2 729 1 2024-02-16T22:19:01.396 INFO:tasks.workunit.client.0.smithi134.stdout:3/908: readlink da/d1c/d24/d29/le5 0 2024-02-16T22:19:01.396 INFO:tasks.workunit.client.0.smithi134.stdout:5/906: symlink d2/d35/d36/da1/l120 0 2024-02-16T22:19:01.397 INFO:tasks.workunit.client.0.smithi134.stdout:8/888: stat d2/df/d18/dc5/d11e/c6f 0 2024-02-16T22:19:01.399 INFO:tasks.workunit.client.0.smithi134.stdout:6/993: link d17/d36/d77/d9a/d28/d5b/fe3 d17/d27/d93/d9c/dec/d52/d79/d92/de6/f14a 0 2024-02-16T22:19:01.399 INFO:tasks.workunit.client.0.smithi134.stdout:6/994: truncate d17/d27/d93/d9c/dec/d52/d79/f114 700764 0 2024-02-16T22:19:01.399 INFO:tasks.workunit.client.0.smithi134.stdout:5/907: dread d2/d9/dc/d15/f3b [0,4194304] 0 2024-02-16T22:19:01.400 INFO:tasks.workunit.client.0.smithi134.stdout:5/908: stat d2/d9/dc/daf/f10c 0 2024-02-16T22:19:01.401 INFO:tasks.workunit.client.0.smithi134.stdout:8/889: mknod d2/df/d18/dc5/d11e/d59/da0/d86/c131 0 2024-02-16T22:19:01.401 INFO:tasks.workunit.client.0.smithi134.stdout:8/890: chown d2/df/d18/dc5/d11e/d59/da0/d40/d53/d5e/lc0 11724159 1 2024-02-16T22:19:01.401 INFO:tasks.workunit.client.0.smithi134.stdout:2/752: sync 2024-02-16T22:19:01.401 INFO:tasks.workunit.client.0.smithi134.stdout:7/825: sync 2024-02-16T22:19:01.401 INFO:tasks.workunit.client.0.smithi134.stdout:4/762: sync 2024-02-16T22:19:01.403 INFO:tasks.workunit.client.0.smithi134.stdout:6/995: getdents d17/d27/d93/d9c/dec/d52/d79/d92/de6/d10e 0 2024-02-16T22:19:01.404 INFO:tasks.workunit.client.0.smithi134.stdout:5/909: creat d2/f121 x:0 0 0 2024-02-16T22:19:01.408 INFO:tasks.workunit.client.0.smithi134.stdout:3/909: rename da/d1c/d24/d9a/dc0/d8a/d8f/c9d to da/d1c/d24/d9a/dc0/c124 0 2024-02-16T22:19:01.408 INFO:tasks.workunit.client.0.smithi134.stdout:3/910: fsync da/fde 0 2024-02-16T22:19:01.410 INFO:tasks.workunit.client.0.smithi134.stdout:1/903: dwrite d5/da/d21/d52/d9b/d9f/ffa [0,4194304] 0 2024-02-16T22:19:01.412 INFO:tasks.workunit.client.0.smithi134.stdout:3/911: rename da/d1c/d24/d9a/dc0/l50 to da/d1c/d24/dae/l125 0 2024-02-16T22:19:01.414 INFO:tasks.workunit.client.0.smithi134.stdout:8/891: mkdir d2/d132 0 2024-02-16T22:19:01.414 INFO:tasks.workunit.client.0.smithi134.stdout:8/892: truncate d2/df/d18/dc5/d11e/d59/da0/d9f/faf 5003194 0 2024-02-16T22:19:01.414 INFO:tasks.workunit.client.0.smithi134.stdout:8/893: readlink d2/df/d18/d2a/la8 0 2024-02-16T22:19:01.414 INFO:tasks.workunit.client.0.smithi134.stdout:8/894: dread - d2/df/d18/dc5/d11e/d59/da0/d40/d53/d5e/d72/dd3/f114 zero size 2024-02-16T22:19:01.414 INFO:tasks.workunit.client.0.smithi134.stdout:5/910: write d2/d35/d36/d3d/d9c/d4b/f117 [6541950,122353] 0 2024-02-16T22:19:01.420 INFO:tasks.workunit.client.0.smithi134.stdout:3/912: rename da/ffd to da/d1c/d24/d9a/dc0/d8a/d8f/f126 0 2024-02-16T22:19:01.422 INFO:tasks.workunit.client.0.smithi134.stdout:3/913: unlink da/d1c/d24/c16 0 2024-02-16T22:19:01.422 INFO:tasks.workunit.client.0.smithi134.stdout:3/914: readlink da/d6b/dc1/de6/l123 0 2024-02-16T22:19:01.424 INFO:tasks.workunit.client.0.smithi134.stdout:3/915: symlink da/d1c/d24/d9a/l127 0 2024-02-16T22:19:01.424 INFO:tasks.workunit.client.0.smithi134.stdout:1/904: write d5/f3f [415133,57226] 0 2024-02-16T22:19:01.427 INFO:tasks.workunit.client.0.smithi134.stdout:1/905: creat d5/da/f122 x:0 0 0 2024-02-16T22:19:01.432 INFO:tasks.workunit.client.0.smithi134.stdout:3/916: rename da/d1c/d24/d29/d51/d80/d89/d8e/dab to da/d1c/d24/d9a/dc0/d8a/d8f/d9f/d128 0 2024-02-16T22:19:01.434 INFO:tasks.workunit.client.0.smithi134.stdout:3/917: mknod da/d1c/d24/d29/c129 0 2024-02-16T22:19:01.436 INFO:tasks.workunit.client.0.smithi134.stdout:3/918: mkdir da/d6b/d12a 0 2024-02-16T22:19:01.440 INFO:tasks.workunit.client.0.smithi134.stdout:3/919: unlink da/d1c/d24/d29/d51/d80/d89/d8e/dbc/cb5 0 2024-02-16T22:19:01.448 INFO:tasks.workunit.client.0.smithi134.stdout:2/753: dwrite df/d10/d30/d4d/d94/da3/f84 [0,4194304] 0 2024-02-16T22:19:01.448 INFO:tasks.workunit.client.0.smithi134.stdout:2/754: fdatasync df/d10/f5d 0 2024-02-16T22:19:01.448 INFO:tasks.workunit.client.0.smithi134.stdout:2/755: chown df/d10/d3a/cb1 233784 1 2024-02-16T22:19:01.457 INFO:tasks.workunit.client.0.smithi134.stdout:6/996: dwrite d17/d36/d77/d9a/d28/f96 [0,4194304] 0 2024-02-16T22:19:01.487 INFO:tasks.workunit.client.0.smithi134.stdout:1/906: dwrite d5/d1a/d53/d86/f9d [4194304,4194304] 0 2024-02-16T22:19:01.487 INFO:tasks.workunit.client.0.smithi134.stdout:1/907: fdatasync d5/fa6 0 2024-02-16T22:19:01.487 INFO:tasks.workunit.client.0.smithi134.stdout:4/763: dwrite d0/d6/d1e/ff5 [0,4194304] 0 2024-02-16T22:19:01.488 INFO:tasks.workunit.client.0.smithi134.stdout:7/826: dwrite d2/d6/d17/d31/d28/f36 [0,4194304] 0 2024-02-16T22:19:01.488 INFO:tasks.workunit.client.0.smithi134.stdout:8/895: dwrite d2/df/d18/fa9 [0,4194304] 0 2024-02-16T22:19:01.488 INFO:tasks.workunit.client.0.smithi134.stdout:8/896: chown d2/df/d18/dc5/d11e/l6c 1 1 2024-02-16T22:19:01.488 INFO:tasks.workunit.client.0.smithi134.stdout:5/911: dwrite d2/f121 [0,4194304] 0 2024-02-16T22:19:01.488 INFO:tasks.workunit.client.0.smithi134.stdout:5/912: chown d2/d35/d36/d46/d68/f7b 6315 1 2024-02-16T22:19:01.488 INFO:tasks.workunit.client.0.smithi134.stdout:5/913: fsync d2/d35/d36/d46/f6a 0 2024-02-16T22:19:01.488 INFO:tasks.workunit.client.0.smithi134.stdout:3/920: dwrite da/d1c/d24/d9a/dc0/d8a/fef [8388608,4194304] 0 2024-02-16T22:19:01.489 INFO:tasks.workunit.client.0.smithi134.stdout:3/921: write da/d1c/d24/d9a/dc0/d8a/d8f/d5f/ff7 [821800,9843] 0 2024-02-16T22:19:01.489 INFO:tasks.workunit.client.0.smithi134.stdout:3/922: fsync da/d1c/d24/d29/d51/f87 0 2024-02-16T22:19:01.489 INFO:tasks.workunit.client.0.smithi134.stdout:2/756: dwrite df/d10/d30/d4d/d94/fa1 [0,4194304] 0 2024-02-16T22:19:01.490 INFO:tasks.workunit.client.0.smithi134.stdout:1/908: unlink d5/da/d21/d52/d9b/cdb 0 2024-02-16T22:19:01.490 INFO:tasks.workunit.client.0.smithi134.stdout:1/909: write d5/d1a/d53/d86/d11d/d6a/d5c/fe8 [1874331,55377] 0 2024-02-16T22:19:01.499 INFO:tasks.workunit.client.0.smithi134.stdout:7/827: mknod d2/d5/d19/d84/d86/d93/dab/de1/c10f 0 2024-02-16T22:19:01.500 INFO:tasks.workunit.client.0.smithi134.stdout:8/897: truncate d2/df/d18/f6 4187099 0 2024-02-16T22:19:01.500 INFO:tasks.workunit.client.0.smithi134.stdout:8/898: getdents d2/df/d18/dc5/d11e/d59/da0/d40/d53/d128 0 2024-02-16T22:19:01.502 INFO:tasks.workunit.client.0.smithi134.stdout:1/910: dread d5/da/d21/d52/d9b/d9f/ffa [0,4194304] 0 2024-02-16T22:19:01.504 INFO:tasks.workunit.client.0.smithi134.stdout:3/923: dwrite da/d12/f114 [0,4194304] 0 2024-02-16T22:19:01.504 INFO:tasks.workunit.client.0.smithi134.stdout:3/924: stat da/d1c/d24/d29/d51/d80 0 2024-02-16T22:19:01.505 INFO:tasks.workunit.client.0.smithi134.stdout:3/925: dread da/d1c/d24/d29/d51/d80/d89/d8e/de7/f11a [0,4194304] 0 2024-02-16T22:19:01.514 INFO:tasks.workunit.client.0.smithi134.stdout:2/757: mknod df/d10/d3a/da9/ce2 0 2024-02-16T22:19:01.514 INFO:tasks.workunit.client.0.smithi134.stdout:2/758: chown df/d10/d30/d49/d82 9 1 2024-02-16T22:19:01.514 INFO:tasks.workunit.client.0.smithi134.stdout:2/759: fsync df/d10/d30/fac 0 2024-02-16T22:19:01.523 INFO:tasks.workunit.client.0.smithi134.stdout:4/764: rmdir d0 39 2024-02-16T22:19:01.525 INFO:tasks.workunit.client.0.smithi134.stdout:7/828: rename d2/f8c to d2/d6/d7d/d92/da5/d63/f110 0 2024-02-16T22:19:01.526 INFO:tasks.workunit.client.0.smithi134.stdout:8/899: link d2/df/d18/d27/l4c d2/df/l133 0 2024-02-16T22:19:01.526 INFO:tasks.workunit.client.0.smithi134.stdout:8/900: truncate d2/da3/fc9 115239 0 2024-02-16T22:19:01.527 INFO:tasks.workunit.client.0.smithi134.stdout:1/911: mknod d5/da/d21/d45/c123 0 2024-02-16T22:19:01.528 INFO:tasks.workunit.client.0.smithi134.stdout:0/843: sync 2024-02-16T22:19:01.528 INFO:tasks.workunit.client.0.smithi134.stdout:5/914: rmdir d2/d9/dc/d32/dce 39 2024-02-16T22:19:01.531 INFO:tasks.workunit.client.0.smithi134.stdout:3/926: fsync da/d12/d2a/f7c 0 2024-02-16T22:19:01.534 INFO:tasks.workunit.client.0.smithi134.stdout:2/760: unlink df/d10/d30/d49/f54 0 2024-02-16T22:19:01.534 INFO:tasks.workunit.client.0.smithi134.stdout:2/761: truncate df/d10/f86 5209293 0 2024-02-16T22:19:01.534 INFO:tasks.workunit.client.0.smithi134.stdout:2/762: chown df/d41/d97/dd6/cb8 1812687 1 2024-02-16T22:19:01.534 INFO:tasks.workunit.client.0.smithi134.stdout:2/763: fdatasync df/d10/d30/d49/d82/d1b/f2f 0 2024-02-16T22:19:01.537 INFO:tasks.workunit.client.0.smithi134.stdout:7/829: unlink d2/d5/d22/d83/dce/cef 0 2024-02-16T22:19:01.537 INFO:tasks.workunit.client.0.smithi134.stdout:7/830: write d2/d5/d19/f2b [2109929,45136] 0 2024-02-16T22:19:01.537 INFO:tasks.workunit.client.0.smithi134.stdout:7/831: read - d2/d6/d7d/d92/fca zero size 2024-02-16T22:19:01.540 INFO:tasks.workunit.client.0.smithi134.stdout:0/844: creat d2/dc/f117 x:0 0 0 2024-02-16T22:19:01.542 INFO:tasks.workunit.client.0.smithi134.stdout:5/915: rename d2/d35/d36/d3d/d63/d90/fbc to d2/d35/f122 0 2024-02-16T22:19:01.542 INFO:tasks.workunit.client.0.smithi134.stdout:1/912: dwrite d5/d1a/f31 [0,4194304] 0 2024-02-16T22:19:01.543 INFO:tasks.workunit.client.0.smithi134.stdout:1/913: fdatasync d5/d1a/d23/f2b 0 2024-02-16T22:19:01.543 INFO:tasks.workunit.client.0.smithi134.stdout:1/914: write d5/da/db8/f10f [596197,116717] 0 2024-02-16T22:19:01.544 INFO:tasks.workunit.client.0.smithi134.stdout:3/927: mkdir da/d1c/d24/d2c/d12b 0 2024-02-16T22:19:01.545 INFO:tasks.workunit.client.0.smithi134.stdout:7/832: mknod d2/d5/d22/d83/d101/c111 0 2024-02-16T22:19:01.547 INFO:tasks.workunit.client.0.smithi134.stdout:7/833: rename d2/d6/d7d/d92/dcd to d2/d6/d7d/d112 0 2024-02-16T22:19:01.548 INFO:tasks.workunit.client.0.smithi134.stdout:8/901: rmdir d2/df/d18/dc5/d11e/d59/da0/d40/d53/d128 0 2024-02-16T22:19:01.548 INFO:tasks.workunit.client.0.smithi134.stdout:8/902: fdatasync d2/df/d18/fa9 0 2024-02-16T22:19:01.548 INFO:tasks.workunit.client.0.smithi134.stdout:8/903: dread - d2/df/d18/d91/f107 zero size 2024-02-16T22:19:01.550 INFO:tasks.workunit.client.0.smithi134.stdout:2/764: write df/d10/f9e [2433246,25654] 0 2024-02-16T22:19:01.553 INFO:tasks.workunit.client.0.smithi134.stdout:1/915: dread d5/f46 [0,4194304] 0 2024-02-16T22:19:01.553 INFO:tasks.workunit.client.0.smithi134.stdout:1/916: stat d5/da/d21/d52/d9b/d9f/fc5 0 2024-02-16T22:19:01.553 INFO:tasks.workunit.client.0.smithi134.stdout:1/917: chown d5/d1a/d53/d86/d11d 21087730 1 2024-02-16T22:19:01.557 INFO:tasks.workunit.client.0.smithi134.stdout:2/765: rmdir df/d10/d15 39 2024-02-16T22:19:01.557 INFO:tasks.workunit.client.0.smithi134.stdout:2/766: creat df/d10/d3a/fe3 x:0 0 0 2024-02-16T22:19:01.558 INFO:tasks.workunit.client.0.smithi134.stdout:2/767: read df/f3c [1707298,35207] 0 2024-02-16T22:19:01.558 INFO:tasks.workunit.client.0.smithi134.stdout:2/768: readlink df/d10/d3a/da9/lb4 0 2024-02-16T22:19:01.560 INFO:tasks.workunit.client.0.smithi134.stdout:1/918: creat d5/f124 x:0 0 0 2024-02-16T22:19:01.561 INFO:tasks.workunit.client.0.smithi134.stdout:5/916: dwrite d2/d9/dc/d15/d2f/fc1 [0,4194304] 0 2024-02-16T22:19:01.562 INFO:tasks.workunit.client.0.smithi134.stdout:8/904: getdents d2/df/d18/dc5/d11e/d59/da0/d40/d53 0 2024-02-16T22:19:01.562 INFO:tasks.workunit.client.0.smithi134.stdout:8/905: write d2/df/d18/dc5/d11e/d59/db1/ff7 [751137,83861] 0 2024-02-16T22:19:01.566 INFO:tasks.workunit.client.0.smithi134.stdout:2/769: write df/d41/f8e [1202481,90461] 0 2024-02-16T22:19:01.614 INFO:tasks.workunit.client.0.smithi134.stdout:1/919: mkdir d5/d1a/d53/d125 0 2024-02-16T22:19:01.614 INFO:tasks.workunit.client.0.smithi134.stdout:1/920: dread - d5/da/d21/d52/ff2 zero size 2024-02-16T22:19:01.617 INFO:tasks.workunit.client.0.smithi134.stdout:5/917: truncate d2/d35/d36/d46/f6b 2402112 0 2024-02-16T22:19:01.618 INFO:tasks.workunit.client.0.smithi134.stdout:2/770: truncate df/d10/d30/fac 3039464 0 2024-02-16T22:19:01.619 INFO:tasks.workunit.client.0.smithi134.stdout:1/921: mknod d5/d1a/d4d/d99/c126 0 2024-02-16T22:19:01.620 INFO:tasks.workunit.client.0.smithi134.stdout:5/918: symlink d2/d35/d36/d46/d68/l123 0 2024-02-16T22:19:01.620 INFO:tasks.workunit.client.0.smithi134.stdout:2/771: symlink df/d10/d30/d49/d82/le4 0 2024-02-16T22:19:01.622 INFO:tasks.workunit.client.0.smithi134.stdout:1/922: creat d5/d1a/d23/f127 x:0 0 0 2024-02-16T22:19:01.623 INFO:tasks.workunit.client.0.smithi134.stdout:1/923: creat d5/d1a/d53/d86/d11d/d6a/de3/f128 x:0 0 0 2024-02-16T22:19:01.631 INFO:tasks.workunit.client.0.smithi134.stdout:7/834: dwrite d2/d6/d7d/d9e/fc9 [0,4194304] 0 2024-02-16T22:19:01.632 INFO:tasks.workunit.client.0.smithi134.stdout:7/835: symlink d2/d5/d19/d84/d86/d93/dab/d40/df1/l113 0 2024-02-16T22:19:01.632 INFO:tasks.workunit.client.0.smithi134.stdout:7/836: chown d2/d5/d19/d84/d86/d93/dab/d40/df1/d104 47972601 1 2024-02-16T22:19:01.633 INFO:tasks.workunit.client.0.smithi134.stdout:7/837: mkdir d2/d6/d7d/d92/dd5/d114 0 2024-02-16T22:19:01.633 INFO:tasks.workunit.client.0.smithi134.stdout:7/838: read d2/d5/d22/d83/dce/fd0 [22804,55269] 0 2024-02-16T22:19:01.634 INFO:tasks.workunit.client.0.smithi134.stdout:7/839: stat d2/d5/d4c/df5/c10c 0 2024-02-16T22:19:01.634 INFO:tasks.workunit.client.0.smithi134.stdout:3/928: dwrite da/d1c/d24/d29/d51/d80/d89/f121 [0,4194304] 0 2024-02-16T22:19:01.635 INFO:tasks.workunit.client.0.smithi134.stdout:3/929: creat da/d6b/f12c x:0 0 0 2024-02-16T22:19:01.635 INFO:tasks.workunit.client.0.smithi134.stdout:3/930: write da/d1c/fe2 [494123,37828] 0 2024-02-16T22:19:01.637 INFO:tasks.workunit.client.0.smithi134.stdout:3/931: creat da/d1c/d24/f12d x:0 0 0 2024-02-16T22:19:01.638 INFO:tasks.workunit.client.0.smithi134.stdout:8/906: dwrite d2/df/f6e [0,4194304] 0 2024-02-16T22:19:01.645 INFO:tasks.workunit.client.0.smithi134.stdout:8/907: mknod d2/df/d18/d27/dc4/c134 0 2024-02-16T22:19:01.645 INFO:tasks.workunit.client.0.smithi134.stdout:5/919: dwrite d2/d35/d36/d3d/fe2 [0,4194304] 0 2024-02-16T22:19:01.645 INFO:tasks.workunit.client.0.smithi134.stdout:5/920: read f0 [3238736,64551] 0 2024-02-16T22:19:01.645 INFO:tasks.workunit.client.0.smithi134.stdout:2/772: dwrite df/d10/d15/d5a/f8c [4194304,4194304] 0 2024-02-16T22:19:01.645 INFO:tasks.workunit.client.0.smithi134.stdout:8/908: truncate d2/df/d18/fc 3842048 0 2024-02-16T22:19:01.648 INFO:tasks.workunit.client.0.smithi134.stdout:2/773: creat df/d41/d97/dd6/fe5 x:0 0 0 2024-02-16T22:19:01.650 INFO:tasks.workunit.client.0.smithi134.stdout:8/909: rename d2/df/d18/db5/dbc/lde to d2/df/d18/d12/l135 0 2024-02-16T22:19:01.650 INFO:tasks.workunit.client.0.smithi134.stdout:8/910: dread - d2/f127 zero size 2024-02-16T22:19:01.650 INFO:tasks.workunit.client.0.smithi134.stdout:8/911: chown d2 3332688 1 2024-02-16T22:19:01.651 INFO:tasks.workunit.client.0.smithi134.stdout:5/921: link d2/d9/dc/d15/c110 d2/d9/dc/c124 0 2024-02-16T22:19:01.653 INFO:tasks.workunit.client.0.smithi134.stdout:3/932: dwrite da/d1c/d24/dae/fdc [0,4194304] 0 2024-02-16T22:19:01.654 INFO:tasks.workunit.client.0.smithi134.stdout:8/912: rename d2/df/d18/dc5/d11e/d59/da0/d40/d53/d5e/d72/d7d/cc6 to d2/df/d18/dc5/d11e/d59/db1/d90/c136 0 2024-02-16T22:19:01.654 INFO:tasks.workunit.client.0.smithi134.stdout:5/922: mknod d2/d9/c125 0 2024-02-16T22:19:01.657 INFO:tasks.workunit.client.0.smithi134.stdout:8/913: creat d2/df/d18/dc5/d11e/d59/da0/d40/d53/daa/d105/f137 x:0 0 0 2024-02-16T22:19:01.658 INFO:tasks.workunit.client.0.smithi134.stdout:6/997: sync 2024-02-16T22:19:01.659 INFO:tasks.workunit.client.0.smithi134.stdout:4/765: sync 2024-02-16T22:19:01.661 INFO:tasks.workunit.client.0.smithi134.stdout:4/766: rmdir d0/d6/d1e/d3b/d9e 39 2024-02-16T22:19:01.662 INFO:tasks.workunit.client.0.smithi134.stdout:3/933: dread da/d12/d2a/fbf [0,4194304] 0 2024-02-16T22:19:01.663 INFO:tasks.workunit.client.0.smithi134.stdout:5/923: dread d2/d9/dc/d32/d61/fe7 [0,4194304] 0 2024-02-16T22:19:01.663 INFO:tasks.workunit.client.0.smithi134.stdout:5/924: dread - d2/d35/d36/f114 zero size 2024-02-16T22:19:01.664 INFO:tasks.workunit.client.0.smithi134.stdout:4/767: rename d0/d6/d22/d25/lfd to d0/d6/d22/d97/l101 0 2024-02-16T22:19:01.664 INFO:tasks.workunit.client.0.smithi134.stdout:2/774: dwrite df/d10/d3a/fe3 [0,4194304] 0 2024-02-16T22:19:01.666 INFO:tasks.workunit.client.0.smithi134.stdout:5/925: getdents d2/d35/d36/da9 0 2024-02-16T22:19:01.666 INFO:tasks.workunit.client.0.smithi134.stdout:5/926: chown d2/d35/d36/d3d/c106 2 1 2024-02-16T22:19:01.666 INFO:tasks.workunit.client.0.smithi134.stdout:5/927: chown d2/d35/c73 250487511 1 2024-02-16T22:19:01.669 INFO:tasks.workunit.client.0.smithi134.stdout:3/934: rename da/d1c/d24/d29/d51/d80/d89/d8e/dbc/f11e to da/d1c/d24/d29/d51/d80/d89/d8e/de7/f12e 0 2024-02-16T22:19:01.671 INFO:tasks.workunit.client.0.smithi134.stdout:4/768: getdents d0/d6/d8/da2/d76/df0/dc8 0 2024-02-16T22:19:01.674 INFO:tasks.workunit.client.0.smithi134.stdout:2/775: creat df/d10/d30/d49/d7b/fe6 x:0 0 0 2024-02-16T22:19:01.674 INFO:tasks.workunit.client.0.smithi134.stdout:2/776: creat df/d10/d30/d4d/d94/fe7 x:0 0 0 2024-02-16T22:19:01.677 INFO:tasks.workunit.client.0.smithi134.stdout:3/935: symlink da/d6b/dc1/de6/l12f 0 2024-02-16T22:19:01.677 INFO:tasks.workunit.client.0.smithi134.stdout:3/936: getdents da/d6b/d12a 0 2024-02-16T22:19:01.678 INFO:tasks.workunit.client.0.smithi134.stdout:4/769: mknod d0/d6/d8/da2/d76/df0/dc8/c102 0 2024-02-16T22:19:01.680 INFO:tasks.workunit.client.0.smithi134.stdout:5/928: rmdir d2/d35/d36/d3d/d9c/d4b 39 2024-02-16T22:19:01.682 INFO:tasks.workunit.client.0.smithi134.stdout:3/937: creat da/d1c/d24/d9a/dc0/d8a/d8f/f130 x:0 0 0 2024-02-16T22:19:01.682 INFO:tasks.workunit.client.0.smithi134.stdout:3/938: write da/f19 [1217809,44385] 0 2024-02-16T22:19:01.682 INFO:tasks.workunit.client.0.smithi134.stdout:4/770: chown d0/d6/d8/da2/d76/df0/dc8/ccf 163 1 2024-02-16T22:19:01.685 INFO:tasks.workunit.client.0.smithi134.stdout:4/771: rename d0/d31/db8/ca8 to d0/d6/d22/d40/c103 0 2024-02-16T22:19:01.686 INFO:tasks.workunit.client.0.smithi134.stdout:4/772: symlink d0/d6/d22/d25/d2a/l104 0 2024-02-16T22:19:01.687 INFO:tasks.workunit.client.0.smithi134.stdout:4/773: creat d0/d6/d8/da2/d76/f105 x:0 0 0 2024-02-16T22:19:01.687 INFO:tasks.workunit.client.0.smithi134.stdout:2/777: write df/d10/d30/f6c [2305199,1377] 0 2024-02-16T22:19:01.687 INFO:tasks.workunit.client.0.smithi134.stdout:8/914: dwrite d2/df/d18/d12/f92 [0,4194304] 0 2024-02-16T22:19:01.689 INFO:tasks.workunit.client.0.smithi134.stdout:4/774: mknod d0/d6/d44/da9/dc4/c106 0 2024-02-16T22:19:01.689 INFO:tasks.workunit.client.0.smithi134.stdout:6/998: dwrite d17/d36/d77/d9a/d28/f135 [0,4194304] 0 2024-02-16T22:19:01.689 INFO:tasks.workunit.client.0.smithi134.stdout:6/999: write d17/d36/d77/d9a/d28/d5b/f12e [62711,91206] 0 2024-02-16T22:19:01.691 INFO:tasks.workunit.client.0.smithi134.stdout:2/778: rename df/d10/d15/d90 to df/d10/d15/d5a/de8 0 2024-02-16T22:19:01.691 INFO:tasks.workunit.client.0.smithi134.stdout:2/779: dread - df/d10/d15/f91 zero size 2024-02-16T22:19:01.697 INFO:tasks.workunit.client.0.smithi134.stdout:3/939: dread da/d1c/d24/d29/faf [0,4194304] 0 2024-02-16T22:19:01.698 INFO:tasks.workunit.client.0.smithi134.stdout:3/940: link da/d1c/d24/d9a/lfb da/d1c/d24/d29/d51/l131 0 2024-02-16T22:19:01.699 INFO:tasks.workunit.client.0.smithi134.stdout:3/941: chown da/d1c/d24/d9a/dc0/d8a/d8f/d5f/la2 6301 1 2024-02-16T22:19:01.699 INFO:tasks.workunit.client.0.smithi134.stdout:3/942: truncate da/d1c/d24/d2c/d74/fd3 773052 0 2024-02-16T22:19:01.699 INFO:tasks.workunit.client.0.smithi134.stdout:3/943: chown da/d1c/d24/d9a/dc0/d8a/d8f/d5f/ff7 772 1 2024-02-16T22:19:01.700 INFO:tasks.workunit.client.0.smithi134.stdout:2/780: dread df/d10/d15/f1d [0,4194304] 0 2024-02-16T22:19:01.702 INFO:tasks.workunit.client.0.smithi134.stdout:8/915: dwrite d2/df/d18/dc5/d11e/d59/da0/d40/d53/f10e [0,4194304] 0 2024-02-16T22:19:01.702 INFO:tasks.workunit.client.0.smithi134.stdout:8/916: dread - d2/df/d18/dc5/d11e/d59/fe9 zero size 2024-02-16T22:19:01.702 INFO:tasks.workunit.client.0.smithi134.stdout:8/917: write d2/df/d18/dc5/f111 [2655734,71068] 0 2024-02-16T22:19:01.702 INFO:tasks.workunit.client.0.smithi134.stdout:2/781: creat df/d10/d3a/da9/dae/fe9 x:0 0 0 2024-02-16T22:19:01.702 INFO:tasks.workunit.client.0.smithi134.stdout:2/782: dread - df/d10/d30/d49/d85/fd0 zero size 2024-02-16T22:19:01.710 INFO:tasks.workunit.client.0.smithi134.stdout:3/944: dread da/d1c/d24/d9a/dc0/d8a/d8f/f44 [0,4194304] 0 2024-02-16T22:19:01.710 INFO:tasks.workunit.client.0.smithi134.stdout:3/945: chown da/d1c/d24/d29/d51/f70 324549 1 2024-02-16T22:19:01.712 INFO:tasks.workunit.client.0.smithi134.stdout:8/918: mkdir d2/df/d18/db5/dbc/d138 0 2024-02-16T22:19:01.714 INFO:tasks.workunit.client.0.smithi134.stdout:2/783: symlink df/d10/d15/d5a/d34/lea 0 2024-02-16T22:19:01.714 INFO:tasks.workunit.client.0.smithi134.stdout:2/784: creat df/d10/d30/d4d/feb x:0 0 0 2024-02-16T22:19:01.717 INFO:tasks.workunit.client.0.smithi134.stdout:2/785: symlink df/d41/lec 0 2024-02-16T22:19:01.718 INFO:tasks.workunit.client.0.smithi134.stdout:2/786: mknod df/d10/d30/da2/dca/ced 0 2024-02-16T22:19:01.718 INFO:tasks.workunit.client.0.smithi134.stdout:8/919: dread d2/df/d18/d27/f7b [0,4194304] 0 2024-02-16T22:19:01.720 INFO:tasks.workunit.client.0.smithi134.stdout:0/845: sync 2024-02-16T22:19:01.721 INFO:tasks.workunit.client.0.smithi134.stdout:0/846: dread - d2/dc/d32/d3e/da7/dc2/def/f110 zero size 2024-02-16T22:19:01.727 INFO:tasks.workunit.client.0.smithi134.stdout:2/787: write df/d10/d3a/fe3 [357648,126270] 0 2024-02-16T22:19:01.729 INFO:tasks.workunit.client.0.smithi134.stdout:0/847: write d2/dc/f44 [405262,17161] 0 2024-02-16T22:19:01.729 INFO:tasks.workunit.client.0.smithi134.stdout:2/788: link df/d10/d30/d4d/d94/da3/ld4 df/d6f/lee 0 2024-02-16T22:19:01.729 INFO:tasks.workunit.client.0.smithi134.stdout:2/789: fdatasync df/d10/d30/d49/d82/f20 0 2024-02-16T22:19:01.731 INFO:tasks.workunit.client.0.smithi134.stdout:0/848: mknod d2/d20/d7a/c118 0 2024-02-16T22:19:01.733 INFO:tasks.workunit.client.0.smithi134.stdout:0/849: symlink d2/dc/d97/ddf/l119 0 2024-02-16T22:19:01.733 INFO:tasks.workunit.client.0.smithi134.stdout:3/946: dwrite da/d1c/d24/d29/d51/d80/d89/d8e/de7/f12e [0,4194304] 0 2024-02-16T22:19:01.735 INFO:tasks.workunit.client.0.smithi134.stdout:2/790: rename df/d41/d97 to df/d10/d30/d49/d85/def 0 2024-02-16T22:19:01.735 INFO:tasks.workunit.client.0.smithi134.stdout:3/947: dread da/d1c/f5d [0,4194304] 0 2024-02-16T22:19:01.735 INFO:tasks.workunit.client.0.smithi134.stdout:3/948: write da/d1c/d24/d9a/dc0/d8a/d8f/f130 [156190,21499] 0 2024-02-16T22:19:01.736 INFO:tasks.workunit.client.0.smithi134.stdout:3/949: fdatasync da/d1c/d24/d29/d51/d80/d89/d8e/de7/f12e 0 2024-02-16T22:19:01.737 INFO:tasks.workunit.client.0.smithi134.stdout:8/920: dwrite d2/df/d18/dc5/d11e/d59/da0/d40/d53/daa/d105/f79 [4194304,4194304] 0 2024-02-16T22:19:01.738 INFO:tasks.workunit.client.0.smithi134.stdout:8/921: fdatasync d2/df/d18/dc5/d11e/d59/da0/d40/f102 0 2024-02-16T22:19:01.738 INFO:tasks.workunit.client.0.smithi134.stdout:8/922: write d2/df/d18/dc5/d11e/d59/da0/d9f/fa7 [312299,37543] 0 2024-02-16T22:19:01.738 INFO:tasks.workunit.client.0.smithi134.stdout:2/791: mkdir df/d10/d15/d5a/d34/df0 0 2024-02-16T22:19:01.739 INFO:tasks.workunit.client.0.smithi134.stdout:0/850: getdents d2/dc/d32/d45 0 2024-02-16T22:19:01.741 INFO:tasks.workunit.client.0.smithi134.stdout:3/950: creat da/f132 x:0 0 0 2024-02-16T22:19:01.746 INFO:tasks.workunit.client.0.smithi134.stdout:2/792: rename df/d10/d3a/f71 to df/d10/d30/d4d/d94/da3/ff1 0 2024-02-16T22:19:01.747 INFO:tasks.workunit.client.0.smithi134.stdout:0/851: creat d2/d20/d77/dbd/dd9/f11a x:0 0 0 2024-02-16T22:19:01.747 INFO:tasks.workunit.client.0.smithi134.stdout:0/852: chown d2/d4b/lb5 191 1 2024-02-16T22:19:01.748 INFO:tasks.workunit.client.0.smithi134.stdout:3/951: rmdir da/d1c/dc2 0 2024-02-16T22:19:01.750 INFO:tasks.workunit.client.0.smithi134.stdout:0/853: symlink d2/dc/d32/d3e/d5e/l11b 0 2024-02-16T22:19:01.752 INFO:tasks.workunit.client.0.smithi134.stdout:3/952: rename da/d1c/d24/d29/d51/lf0 to da/d12/d2a/l133 0 2024-02-16T22:19:01.765 INFO:tasks.workunit.client.0.smithi134.stdout:8/923: dwrite d2/df/d18/dc5/d11e/d59/da0/d8d/fe0 [0,4194304] 0 2024-02-16T22:19:01.765 INFO:tasks.workunit.client.0.smithi134.stdout:2/793: write df/d10/d30/d49/d82/f20 [1457173,124292] 0 2024-02-16T22:19:01.769 INFO:tasks.workunit.client.0.smithi134.stdout:2/794: creat df/ff2 x:0 0 0 2024-02-16T22:19:01.769 INFO:tasks.workunit.client.0.smithi134.stdout:2/795: stat df/d10/d15/da4/fbf 0 2024-02-16T22:19:01.771 INFO:tasks.workunit.client.0.smithi134.stdout:2/796: symlink df/d10/d30/d49/d7b/lf3 0 2024-02-16T22:19:01.771 INFO:tasks.workunit.client.0.smithi134.stdout:2/797: readlink df/d10/d30/d4d/d94/da3/l60 0 2024-02-16T22:19:01.772 INFO:tasks.workunit.client.0.smithi134.stdout:8/924: dread d2/df/d18/dc5/d11e/d59/db1/ff7 [0,4194304] 0 2024-02-16T22:19:01.773 INFO:tasks.workunit.client.0.smithi134.stdout:8/925: mkdir d2/df/d18/dc5/d11b/d139 0 2024-02-16T22:19:01.773 INFO:tasks.workunit.client.0.smithi134.stdout:0/854: dwrite d2/dc/d32/d3e/da7/dc2/def/f110 [0,4194304] 0 2024-02-16T22:19:01.774 INFO:tasks.workunit.client.0.smithi134.stdout:8/926: getdents d2/d80 0 2024-02-16T22:19:01.774 INFO:tasks.workunit.client.0.smithi134.stdout:2/798: read df/d10/d3a/f44 [3204770,102732] 0 2024-02-16T22:19:01.777 INFO:tasks.workunit.client.0.smithi134.stdout:0/855: mknod d2/d20/d77/dbf/c11c 0 2024-02-16T22:19:01.780 INFO:tasks.workunit.client.0.smithi134.stdout:2/799: link df/d10/d3a/fb9 df/d10/d30/d4d/d94/ff4 0 2024-02-16T22:19:01.780 INFO:tasks.workunit.client.0.smithi134.stdout:2/800: fsync df/d10/d30/d4d/d94/da3/f61 0 2024-02-16T22:19:01.784 INFO:tasks.workunit.client.0.smithi134.stdout:3/953: dwrite da/d1c/d24/d9a/dc0/d8a/f73 [0,4194304] 0 2024-02-16T22:19:01.784 INFO:tasks.workunit.client.0.smithi134.stdout:1/924: sync 2024-02-16T22:19:01.784 INFO:tasks.workunit.client.0.smithi134.stdout:4/775: sync 2024-02-16T22:19:01.784 INFO:tasks.workunit.client.0.smithi134.stdout:5/929: sync 2024-02-16T22:19:01.784 INFO:tasks.workunit.client.0.smithi134.stdout:4/776: write d0/d6/d8/d30/f8f [4368818,98973] 0 2024-02-16T22:19:01.784 INFO:tasks.workunit.client.0.smithi134.stdout:7/840: sync 2024-02-16T22:19:01.784 INFO:tasks.workunit.client.0.smithi134.stdout:7/841: fsync d2/d6/d7d/d112/d7f/d24/f5a 0 2024-02-16T22:19:01.784 INFO:tasks.workunit.client.0.smithi134.stdout:5/930: creat d2/d9/dc/daf/f126 x:0 0 0 2024-02-16T22:19:01.785 INFO:tasks.workunit.client.0.smithi134.stdout:7/842: chown d2/d5/d19/d84/d86/d93/dab/d40/fa7 10 1 2024-02-16T22:19:01.785 INFO:tasks.workunit.client.0.smithi134.stdout:5/931: write d2/d35/d36/f114 [1035560,42083] 0 2024-02-16T22:19:01.787 INFO:tasks.workunit.client.0.smithi134.stdout:3/954: creat da/d6b/dc1/de6/df5/f134 x:0 0 0 2024-02-16T22:19:01.788 INFO:tasks.workunit.client.0.smithi134.stdout:1/925: rename d5/da/d21/f80 to d5/d1a/f129 0 2024-02-16T22:19:01.788 INFO:tasks.workunit.client.0.smithi134.stdout:1/926: creat d5/d1a/d23/d85/f12a x:0 0 0 2024-02-16T22:19:01.791 INFO:tasks.workunit.client.0.smithi134.stdout:8/927: write d2/f1b [3074993,4802] 0 2024-02-16T22:19:01.791 INFO:tasks.workunit.client.0.smithi134.stdout:3/955: creat da/f135 x:0 0 0 2024-02-16T22:19:01.794 INFO:tasks.workunit.client.0.smithi134.stdout:1/927: link d5/da/d1c/l95 d5/da/d21/d52/d9b/d9f/l12b 0 2024-02-16T22:19:01.795 INFO:tasks.workunit.client.0.smithi134.stdout:3/956: truncate da/d12/f9c 751897 0 2024-02-16T22:19:01.795 INFO:tasks.workunit.client.0.smithi134.stdout:3/957: chown da/d6b/f11f 0 1 2024-02-16T22:19:01.795 INFO:tasks.workunit.client.0.smithi134.stdout:3/958: stat da/d1c/d24/d29/d51/fb4 0 2024-02-16T22:19:01.796 INFO:tasks.workunit.client.0.smithi134.stdout:7/843: read d2/d5/d19/f1d [6361872,18500] 0 2024-02-16T22:19:01.798 INFO:tasks.workunit.client.0.smithi134.stdout:3/959: creat da/d12/dd2/f136 x:0 0 0 2024-02-16T22:19:01.800 INFO:tasks.workunit.client.0.smithi134.stdout:7/844: creat d2/d6/dcc/df7/f115 x:0 0 0 2024-02-16T22:19:01.801 INFO:tasks.workunit.client.0.smithi134.stdout:3/960: rename da/d1c/d24/d29/d51/d80/d89/f121 to da/d1c/d24/d9a/dc0/d8a/f137 0 2024-02-16T22:19:01.802 INFO:tasks.workunit.client.0.smithi134.stdout:7/845: getdents d2/d6/d91 0 2024-02-16T22:19:01.802 INFO:tasks.workunit.client.0.smithi134.stdout:7/846: creat d2/f116 x:0 0 0 2024-02-16T22:19:01.806 INFO:tasks.workunit.client.0.smithi134.stdout:3/961: mknod da/d12/d2a/c138 0 2024-02-16T22:19:01.808 INFO:tasks.workunit.client.0.smithi134.stdout:5/932: dread d2/d9/dc/daf/fd0 [0,4194304] 0 2024-02-16T22:19:01.809 INFO:tasks.workunit.client.0.smithi134.stdout:5/933: read d2/d35/d36/d3d/d63/f70 [466324,47658] 0 2024-02-16T22:19:01.809 INFO:tasks.workunit.client.0.smithi134.stdout:5/934: creat d2/d9/dc/d15/d2f/ddf/d11b/f127 x:0 0 0 2024-02-16T22:19:01.809 INFO:tasks.workunit.client.0.smithi134.stdout:5/935: write d2/d35/d36/d3d/d9c/d4b/fbe [412009,63052] 0 2024-02-16T22:19:01.809 INFO:tasks.workunit.client.0.smithi134.stdout:3/962: read da/d12/d2a/fbf [3952812,51064] 0 2024-02-16T22:19:01.812 INFO:tasks.workunit.client.0.smithi134.stdout:5/936: rmdir d2/dc9 39 2024-02-16T22:19:01.813 INFO:tasks.workunit.client.0.smithi134.stdout:0/856: dwrite d2/d20/d7a/d7e/ff7 [0,4194304] 0 2024-02-16T22:19:01.814 INFO:tasks.workunit.client.0.smithi134.stdout:4/777: dwrite d0/d6/d22/fb1 [4194304,4194304] 0 2024-02-16T22:19:01.814 INFO:tasks.workunit.client.0.smithi134.stdout:1/928: dwrite d5/da/d2d/f84 [0,4194304] 0 2024-02-16T22:19:01.816 INFO:tasks.workunit.client.0.smithi134.stdout:0/857: rmdir d2/d20/d77/d85/db6/d108 39 2024-02-16T22:19:01.820 INFO:tasks.workunit.client.0.smithi134.stdout:4/778: creat d0/d6/d1e/d7c/f107 x:0 0 0 2024-02-16T22:19:01.820 INFO:tasks.workunit.client.0.smithi134.stdout:4/779: stat d0/d6/d22/d97/daf/fc7 0 2024-02-16T22:19:01.821 INFO:tasks.workunit.client.0.smithi134.stdout:8/928: dread d2/fbd [0,4194304] 0 2024-02-16T22:19:01.822 INFO:tasks.workunit.client.0.smithi134.stdout:0/858: link d2/dc/dc4/le3 d2/d20/d77/d85/d94/l11d 0 2024-02-16T22:19:01.823 INFO:tasks.workunit.client.0.smithi134.stdout:0/859: dread - d2/dc/f101 zero size 2024-02-16T22:19:01.823 INFO:tasks.workunit.client.0.smithi134.stdout:4/780: rename d0/d6/d22/d25/f8e to d0/d31/db8/d1a/de3/f108 0 2024-02-16T22:19:01.824 INFO:tasks.workunit.client.0.smithi134.stdout:8/929: mkdir d2/df/d18/d27/d85/da4/d13a 0 2024-02-16T22:19:01.825 INFO:tasks.workunit.client.0.smithi134.stdout:5/937: dread d2/d9/dc/d15/f31 [0,4194304] 0 2024-02-16T22:19:01.826 INFO:tasks.workunit.client.0.smithi134.stdout:0/860: rename d2/db7/c96 to d2/d20/d77/dbd/dd9/c11e 0 2024-02-16T22:19:01.827 INFO:tasks.workunit.client.0.smithi134.stdout:4/781: read d0/d6/d8/d32/d63/ffe [32109,24988] 0 2024-02-16T22:19:01.827 INFO:tasks.workunit.client.0.smithi134.stdout:4/782: chown d0/d6/d8/da2/d76/df6/laa 12068465 1 2024-02-16T22:19:01.828 INFO:tasks.workunit.client.0.smithi134.stdout:4/783: chown d0/d6/d8/d5e/l84 948894 1 2024-02-16T22:19:01.830 INFO:tasks.workunit.client.0.smithi134.stdout:8/930: creat d2/df/f13b x:0 0 0 2024-02-16T22:19:01.830 INFO:tasks.workunit.client.0.smithi134.stdout:8/931: creat d2/df/d18/d27/d85/da4/f13c x:0 0 0 2024-02-16T22:19:01.830 INFO:tasks.workunit.client.0.smithi134.stdout:8/932: creat d2/df/d18/d91/f13d x:0 0 0 2024-02-16T22:19:01.831 INFO:tasks.workunit.client.0.smithi134.stdout:7/847: write d2/d6/d7d/d9e/fc9 [2788122,65694] 0 2024-02-16T22:19:01.831 INFO:tasks.workunit.client.0.smithi134.stdout:0/861: symlink d2/d20/d50/l11f 0 2024-02-16T22:19:01.831 INFO:tasks.workunit.client.0.smithi134.stdout:0/862: dread - d2/dc/d32/d3e/da7/dc2/fe5 zero size 2024-02-16T22:19:01.832 INFO:tasks.workunit.client.0.smithi134.stdout:4/784: rename d0/d6/d1e/d7c/f82 to d0/d31/f109 0 2024-02-16T22:19:01.835 INFO:tasks.workunit.client.0.smithi134.stdout:7/848: rmdir d2/d5/d19/dae 0 2024-02-16T22:19:01.838 INFO:tasks.workunit.client.0.smithi134.stdout:4/785: creat d0/d6/d1e/d39/d4e/f10a x:0 0 0 2024-02-16T22:19:01.840 INFO:tasks.workunit.client.0.smithi134.stdout:0/863: unlink d2/c2a 0 2024-02-16T22:19:01.841 INFO:tasks.workunit.client.0.smithi134.stdout:0/864: symlink d2/d20/d77/db9/l120 0 2024-02-16T22:19:01.843 INFO:tasks.workunit.client.0.smithi134.stdout:0/865: creat d2/d20/d77/d85/db6/d108/f121 x:0 0 0 2024-02-16T22:19:01.843 INFO:tasks.workunit.client.0.smithi134.stdout:0/866: mknod d2/d20/d77/d85/de2/c122 0 2024-02-16T22:19:01.844 INFO:tasks.workunit.client.0.smithi134.stdout:0/867: truncate d2/d20/d77/db9/ff2 696390 0 2024-02-16T22:19:01.848 INFO:tasks.workunit.client.0.smithi134.stdout:7/849: read d2/d5/d19/d84/d86/d93/dab/d40/fa7 [601144,54570] 0 2024-02-16T22:19:01.848 INFO:tasks.workunit.client.0.smithi134.stdout:7/850: mknod d2/d5/d22/d83/d101/c117 0 2024-02-16T22:19:01.852 INFO:tasks.workunit.client.0.smithi134.stdout:3/963: dwrite da/d1c/d24/d9a/dc0/d8a/f73 [0,4194304] 0 2024-02-16T22:19:01.852 INFO:tasks.workunit.client.0.smithi134.stdout:3/964: creat da/d1c/d24/d29/d51/d80/d89/f139 x:0 0 0 2024-02-16T22:19:01.861 INFO:tasks.workunit.client.0.smithi134.stdout:5/938: dread d2/fa [0,4194304] 0 2024-02-16T22:19:01.862 INFO:tasks.workunit.client.0.smithi134.stdout:5/939: rmdir d2/d9/dc/d15 39 2024-02-16T22:19:01.867 INFO:tasks.workunit.client.0.smithi134.stdout:1/929: dwrite d5/da/d21/d45/d93/fcd [0,4194304] 0 2024-02-16T22:19:01.869 INFO:tasks.workunit.client.0.smithi134.stdout:0/868: dwrite d2/d20/d7a/fb3 [8388608,4194304] 0 2024-02-16T22:19:01.873 INFO:tasks.workunit.client.0.smithi134.stdout:8/933: dwrite d2/df/d18/d27/d85/da4/fca [0,4194304] 0 2024-02-16T22:19:01.873 INFO:tasks.workunit.client.0.smithi134.stdout:8/934: truncate d2/df/d18/d27/fbf 5091643 0 2024-02-16T22:19:01.874 INFO:tasks.workunit.client.0.smithi134.stdout:0/869: rename d2/d20/d77/d85/db6/fc9 to d2/dc/d32/d3e/d5e/dff/f123 0 2024-02-16T22:19:01.883 INFO:tasks.workunit.client.0.smithi134.stdout:0/870: read d2/d20/d77/d85/db6/f6d [216036,33474] 0 2024-02-16T22:19:01.884 INFO:tasks.workunit.client.0.smithi134.stdout:0/871: getdents d2/dc/d97/ddf 0 2024-02-16T22:19:01.884 INFO:tasks.workunit.client.0.smithi134.stdout:0/872: creat d2/dc/d32/d3e/da7/f124 x:0 0 0 2024-02-16T22:19:01.884 INFO:tasks.workunit.client.0.smithi134.stdout:0/873: truncate d2/f6c 791597 0 2024-02-16T22:19:01.886 INFO:tasks.workunit.client.0.smithi134.stdout:1/930: dwrite d5/da/d21/d45/f7b [0,4194304] 0 2024-02-16T22:19:01.889 INFO:tasks.workunit.client.0.smithi134.stdout:8/935: dread d2/df/d18/dc5/d11e/d59/da0/d40/d53/d5e/d72/d7d/feb [0,4194304] 0 2024-02-16T22:19:01.889 INFO:tasks.workunit.client.0.smithi134.stdout:8/936: creat d2/df/f13e x:0 0 0 2024-02-16T22:19:01.890 INFO:tasks.workunit.client.0.smithi134.stdout:1/931: creat d5/da/d21/d52/d9b/db6/f12c x:0 0 0 2024-02-16T22:19:01.890 INFO:tasks.workunit.client.0.smithi134.stdout:1/932: fsync d5/da/d21/d45/f7b 0 2024-02-16T22:19:01.890 INFO:tasks.workunit.client.0.smithi134.stdout:1/933: write d5/f3f [3347877,52260] 0 2024-02-16T22:19:01.892 INFO:tasks.workunit.client.0.smithi134.stdout:8/937: mknod d2/df/d18/dc5/d11e/d59/c13f 0 2024-02-16T22:19:01.895 INFO:tasks.workunit.client.0.smithi134.stdout:8/938: dread d2/df/d18/db5/fd7 [0,4194304] 0 2024-02-16T22:19:01.895 INFO:tasks.workunit.client.0.smithi134.stdout:8/939: chown d2/df/d18/dc5/d11e/d59/da0/d40/f8e 3 1 2024-02-16T22:19:01.896 INFO:tasks.workunit.client.0.smithi134.stdout:8/940: creat d2/df/d7c/f140 x:0 0 0 2024-02-16T22:19:01.896 INFO:tasks.workunit.client.0.smithi134.stdout:2/801: sync 2024-02-16T22:19:01.897 INFO:tasks.workunit.client.0.smithi134.stdout:2/802: write df/d10/d15/d5a/fd1 [230426,19856] 0 2024-02-16T22:19:01.897 INFO:tasks.workunit.client.0.smithi134.stdout:8/941: mkdir d2/d80/d141 0 2024-02-16T22:19:01.897 INFO:tasks.workunit.client.0.smithi134.stdout:8/942: chown d2/df/d18/db5/fd7 2 1 2024-02-16T22:19:01.897 INFO:tasks.workunit.client.0.smithi134.stdout:1/934: dread d5/d1a/d53/d86/d11d/d6a/fbb [0,4194304] 0 2024-02-16T22:19:01.898 INFO:tasks.workunit.client.0.smithi134.stdout:8/943: mkdir d2/df/d18/dc5/d11e/d59/da0/d142 0 2024-02-16T22:19:01.899 INFO:tasks.workunit.client.0.smithi134.stdout:1/935: unlink d5/d1a/d23/d8c/lf7 0 2024-02-16T22:19:01.900 INFO:tasks.workunit.client.0.smithi134.stdout:8/944: truncate d2/df/d18/dc5/d11e/d59/da0/d9f/fa7 75524 0 2024-02-16T22:19:01.900 INFO:tasks.workunit.client.0.smithi134.stdout:8/945: chown d2/df/d18/dc5/d11e/d59/da0/f93 486 1 2024-02-16T22:19:01.901 INFO:tasks.workunit.client.0.smithi134.stdout:8/946: truncate d2/f127 863524 0 2024-02-16T22:19:01.901 INFO:tasks.workunit.client.0.smithi134.stdout:0/874: dwrite d2/d20/d50/f82 [0,4194304] 0 2024-02-16T22:19:01.902 INFO:tasks.workunit.client.0.smithi134.stdout:2/803: write df/d10/f5d [273651,13604] 0 2024-02-16T22:19:01.903 INFO:tasks.workunit.client.0.smithi134.stdout:0/875: write d2/f22 [754613,75519] 0 2024-02-16T22:19:01.905 INFO:tasks.workunit.client.0.smithi134.stdout:0/876: symlink d2/dc/d48/l125 0 2024-02-16T22:19:01.905 INFO:tasks.workunit.client.0.smithi134.stdout:8/947: dread d2/f2c [0,4194304] 0 2024-02-16T22:19:01.912 INFO:tasks.workunit.client.0.smithi134.stdout:0/877: truncate d2/dc/d48/f4c 148975 0 2024-02-16T22:19:01.912 INFO:tasks.workunit.client.0.smithi134.stdout:0/878: dread - d2/dc/d2d/fec zero size 2024-02-16T22:19:01.914 INFO:tasks.workunit.client.0.smithi134.stdout:0/879: link d2/d20/d7a/ff1 d2/d56/f126 0 2024-02-16T22:19:01.915 INFO:tasks.workunit.client.0.smithi134.stdout:0/880: write d2/dc/f1e [2916692,25196] 0 2024-02-16T22:19:01.916 INFO:tasks.workunit.client.0.smithi134.stdout:0/881: mkdir d2/dc/dc4/d127 0 2024-02-16T22:19:01.918 INFO:tasks.workunit.client.0.smithi134.stdout:0/882: creat d2/d20/d77/dbf/f128 x:0 0 0 2024-02-16T22:19:01.919 INFO:tasks.workunit.client.0.smithi134.stdout:0/883: mkdir d2/dc/dc4/d127/d129 0 2024-02-16T22:19:01.924 INFO:tasks.workunit.client.0.smithi134.stdout:1/936: dwrite d5/da/d2d/dca/f121 [0,4194304] 0 2024-02-16T22:19:01.924 INFO:tasks.workunit.client.0.smithi134.stdout:8/948: dwrite d2/da3/fc9 [0,4194304] 0 2024-02-16T22:19:01.928 INFO:tasks.workunit.client.0.smithi134.stdout:1/937: dread d5/d1a/d63/f69 [0,4194304] 0 2024-02-16T22:19:01.929 INFO:tasks.workunit.client.0.smithi134.stdout:1/938: mknod d5/da/d2d/de0/c12d 0 2024-02-16T22:19:01.930 INFO:tasks.workunit.client.0.smithi134.stdout:1/939: unlink d5/da/d21/d45/c75 0 2024-02-16T22:19:01.931 INFO:tasks.workunit.client.0.smithi134.stdout:1/940: mknod d5/da/d21/d52/d9b/d9f/c12e 0 2024-02-16T22:19:01.931 INFO:tasks.workunit.client.0.smithi134.stdout:1/941: read - d5/fa6 zero size 2024-02-16T22:19:01.931 INFO:tasks.workunit.client.0.smithi134.stdout:1/942: write d5/da/d21/d52/d9b/db6/ff1 [654182,99406] 0 2024-02-16T22:19:01.932 INFO:tasks.workunit.client.0.smithi134.stdout:1/943: rmdir d5/d11e 0 2024-02-16T22:19:01.934 INFO:tasks.workunit.client.0.smithi134.stdout:1/944: rename d5/d1a/d53/d86/f9d to d5/da/d1c/f12f 0 2024-02-16T22:19:01.934 INFO:tasks.workunit.client.0.smithi134.stdout:1/945: write d5/d1a/d82/f106 [819591,97596] 0 2024-02-16T22:19:01.934 INFO:tasks.workunit.client.0.smithi134.stdout:1/946: mkdir d5/da/d21/d130 0 2024-02-16T22:19:01.935 INFO:tasks.workunit.client.0.smithi134.stdout:1/947: symlink d5/d1a/d53/d86/d11d/d6a/d5c/l131 0 2024-02-16T22:19:01.936 INFO:tasks.workunit.client.0.smithi134.stdout:1/948: write d5/f46 [207349,32631] 0 2024-02-16T22:19:01.936 INFO:tasks.workunit.client.0.smithi134.stdout:0/884: dwrite d2/dc/d32/d45/fc6 [0,4194304] 0 2024-02-16T22:19:01.936 INFO:tasks.workunit.client.0.smithi134.stdout:1/949: unlink d5/f3f 0 2024-02-16T22:19:01.937 INFO:tasks.workunit.client.0.smithi134.stdout:1/950: write d5/d1a/d4d/ffe [728639,603] 0 2024-02-16T22:19:01.937 INFO:tasks.workunit.client.0.smithi134.stdout:1/951: readlink d5/da/d1c/l95 0 2024-02-16T22:19:01.939 INFO:tasks.workunit.client.0.smithi134.stdout:0/885: creat d2/dc/dc4/d127/f12a x:0 0 0 2024-02-16T22:19:01.940 INFO:tasks.workunit.client.0.smithi134.stdout:1/952: stat d5/da/d21/d52/d9b/d9f/l12b 0 2024-02-16T22:19:01.946 INFO:tasks.workunit.client.0.smithi134.stdout:0/886: write d2/dc/d32/d45/f10a [224111,95511] 0 2024-02-16T22:19:01.947 INFO:tasks.workunit.client.0.smithi134.stdout:4/786: sync 2024-02-16T22:19:01.969 INFO:tasks.workunit.client.0.smithi134.stdout:0/887: dwrite d2/d20/d50/f9b [0,4194304] 0 2024-02-16T22:19:01.969 INFO:tasks.workunit.client.0.smithi134.stdout:0/888: write d2/d20/f41 [309716,21140] 0 2024-02-16T22:19:01.969 INFO:tasks.workunit.client.0.smithi134.stdout:4/787: dwrite d0/d31/f4c [0,4194304] 0 2024-02-16T22:19:01.969 INFO:tasks.workunit.client.0.smithi134.stdout:0/889: write d2/dc/d32/fed [732752,21085] 0 2024-02-16T22:19:01.973 INFO:tasks.workunit.client.0.smithi134.stdout:4/788: truncate d0/d31/db8/d1a/fb5 59744 0 2024-02-16T22:19:01.973 INFO:tasks.workunit.client.0.smithi134.stdout:4/789: dread - d0/d6/d1e/d7c/ff9 zero size 2024-02-16T22:19:01.973 INFO:tasks.workunit.client.0.smithi134.stdout:4/790: truncate d0/d6/d8/d30/f71 827912 0 2024-02-16T22:19:01.981 INFO:tasks.workunit.client.0.smithi134.stdout:0/890: rename d2/dc/d32/d3e to d2/dc/d48/d12b 0 2024-02-16T22:19:01.996 INFO:tasks.workunit.client.0.smithi134.stdout:5/940: sync 2024-02-16T22:19:01.996 INFO:tasks.workunit.client.0.smithi134.stdout:3/965: sync 2024-02-16T22:19:01.996 INFO:tasks.workunit.client.0.smithi134.stdout:5/941: write d2/d9/dc/d15/d2f/fbb [2381607,75595] 0 2024-02-16T22:19:01.999 INFO:tasks.workunit.client.0.smithi134.stdout:4/791: dwrite d0/d6/d8/d30/f42 [0,4194304] 0 2024-02-16T22:19:01.999 INFO:tasks.workunit.client.0.smithi134.stdout:0/891: dwrite d2/dc/d48/d12b/d5e/fea [0,4194304] 0 2024-02-16T22:19:02.002 INFO:tasks.workunit.client.0.smithi134.stdout:7/851: sync 2024-02-16T22:19:02.005 INFO:tasks.workunit.client.0.smithi134.stdout:7/852: unlink d2/d6/d7d/d92/da5/f53 0 2024-02-16T22:19:02.005 INFO:tasks.workunit.client.0.smithi134.stdout:7/853: truncate d2/d6/d91/db3/fe9 606158 0 2024-02-16T22:19:02.007 INFO:tasks.workunit.client.0.smithi134.stdout:7/854: truncate d2/d6/d17/f56 3586075 0 2024-02-16T22:19:02.007 INFO:tasks.workunit.client.0.smithi134.stdout:7/855: truncate d2/d5/f87 4866715 0 2024-02-16T22:19:02.007 INFO:tasks.workunit.client.0.smithi134.stdout:0/892: dread d2/dc/dc4/f10b [0,4194304] 0 2024-02-16T22:19:02.008 INFO:tasks.workunit.client.0.smithi134.stdout:7/856: creat d2/d6/d7d/d92/da5/d63/dc2/f118 x:0 0 0 2024-02-16T22:19:02.009 INFO:tasks.workunit.client.0.smithi134.stdout:2/804: sync 2024-02-16T22:19:02.009 INFO:tasks.workunit.client.0.smithi134.stdout:3/966: dread da/d1c/d24/d29/d51/f59 [0,4194304] 0 2024-02-16T22:19:02.011 INFO:tasks.workunit.client.0.smithi134.stdout:4/792: dread d0/d6/d8/d32/f38 [0,4194304] 0 2024-02-16T22:19:02.011 INFO:tasks.workunit.client.0.smithi134.stdout:4/793: write d0/d6/d8/d32/d68/f9c [568624,71897] 0 2024-02-16T22:19:02.011 INFO:tasks.workunit.client.0.smithi134.stdout:0/893: link d2/dc/d2d/d34/d87/lb0 d2/l12c 0 2024-02-16T22:19:02.012 INFO:tasks.workunit.client.0.smithi134.stdout:7/857: dread d2/d6/d17/d31/f6f [0,4194304] 0 2024-02-16T22:19:02.012 INFO:tasks.workunit.client.0.smithi134.stdout:7/858: truncate d2/d5/d22/d83/dce/fd0 702156 0 2024-02-16T22:19:02.013 INFO:tasks.workunit.client.0.smithi134.stdout:2/805: mkdir df/d10/d15/da4/df5 0 2024-02-16T22:19:02.013 INFO:tasks.workunit.client.0.smithi134.stdout:3/967: mkdir da/d1c/d24/d29/d51/d80/d89/d8e/dbc/d13a 0 2024-02-16T22:19:02.013 INFO:tasks.workunit.client.0.smithi134.stdout:3/968: write da/f135 [523395,5435] 0 2024-02-16T22:19:02.014 INFO:tasks.workunit.client.0.smithi134.stdout:2/806: mknod df/d10/d30/d4d/d94/cf6 0 2024-02-16T22:19:02.019 INFO:tasks.workunit.client.0.smithi134.stdout:4/794: dread d0/d6/d1e/fdd [0,4194304] 0 2024-02-16T22:19:02.019 INFO:tasks.workunit.client.0.smithi134.stdout:4/795: fsync d0/d6/d22/d25/d2a/db4/fd2 0 2024-02-16T22:19:02.020 INFO:tasks.workunit.client.0.smithi134.stdout:4/796: rmdir d0/d31/db8/d1a 39 2024-02-16T22:19:02.020 INFO:tasks.workunit.client.0.smithi134.stdout:4/797: write d0/d6/d22/d25/fad [154058,72752] 0 2024-02-16T22:19:02.022 INFO:tasks.workunit.client.0.smithi134.stdout:7/859: read d2/d6/d17/d31/d28/f36 [1408625,122142] 0 2024-02-16T22:19:02.022 INFO:tasks.workunit.client.0.smithi134.stdout:4/798: mkdir d0/d6/d22/d97/d10b 0 2024-02-16T22:19:02.022 INFO:tasks.workunit.client.0.smithi134.stdout:4/799: fdatasync d0/d31/fef 0 2024-02-16T22:19:02.024 INFO:tasks.workunit.client.0.smithi134.stdout:7/860: mkdir d2/d6/d7d/d119 0 2024-02-16T22:19:02.025 INFO:tasks.workunit.client.0.smithi134.stdout:4/800: mkdir d0/d6/d1e/d10c 0 2024-02-16T22:19:02.025 INFO:tasks.workunit.client.0.smithi134.stdout:4/801: symlink d0/d6/d22/d25/l10d 0 2024-02-16T22:19:02.025 INFO:tasks.workunit.client.0.smithi134.stdout:4/802: stat d0/d6/d8/da2/cfa 0 2024-02-16T22:19:02.026 INFO:tasks.workunit.client.0.smithi134.stdout:4/803: symlink d0/d31/l10e 0 2024-02-16T22:19:02.027 INFO:tasks.workunit.client.0.smithi134.stdout:4/804: truncate d0/d6/d8/d30/f7e 2435410 0 2024-02-16T22:19:02.027 INFO:tasks.workunit.client.0.smithi134.stdout:4/805: creat d0/d6/d8/da2/d76/f10f x:0 0 0 2024-02-16T22:19:02.027 INFO:tasks.workunit.client.0.smithi134.stdout:4/806: write d0/d6/d22/d25/f98 [872924,51024] 0 2024-02-16T22:19:02.027 INFO:tasks.workunit.client.0.smithi134.stdout:4/807: truncate d0/d6/d22/d97/daf/ff1 94802 0 2024-02-16T22:19:02.029 INFO:tasks.workunit.client.0.smithi134.stdout:4/808: unlink d0/d6/d8/c10 0 2024-02-16T22:19:02.029 INFO:tasks.workunit.client.0.smithi134.stdout:4/809: chown d0/d6/d8/da2/d76/fdf 49577335 1 2024-02-16T22:19:02.030 INFO:tasks.workunit.client.0.smithi134.stdout:4/810: mkdir d0/d31/d110 0 2024-02-16T22:19:02.030 INFO:tasks.workunit.client.0.smithi134.stdout:4/811: chown d0/d6/d22/d97/ld4 299 1 2024-02-16T22:19:02.030 INFO:tasks.workunit.client.0.smithi134.stdout:4/812: truncate d0/d31/db8/d86/ff4 52280 0 2024-02-16T22:19:02.030 INFO:tasks.workunit.client.0.smithi134.stdout:4/813: dread - d0/d6/d44/fd3 zero size 2024-02-16T22:19:02.031 INFO:tasks.workunit.client.0.smithi134.stdout:4/814: creat d0/d6/d8/d32/f111 x:0 0 0 2024-02-16T22:19:02.032 INFO:tasks.workunit.client.0.smithi134.stdout:4/815: creat d0/d6/d8/da2/d76/df6/f112 x:0 0 0 2024-02-16T22:19:02.038 INFO:tasks.workunit.client.0.smithi134.stdout:7/861: dread d2/d5/d19/d4a/f58 [0,4194304] 0 2024-02-16T22:19:02.039 INFO:tasks.workunit.client.0.smithi134.stdout:4/816: write d0/d6/d1e/d3b/fe1 [1128671,77060] 0 2024-02-16T22:19:02.041 INFO:tasks.workunit.client.0.smithi134.stdout:2/807: dwrite df/d10/d30/f6c [0,4194304] 0 2024-02-16T22:19:02.041 INFO:tasks.workunit.client.0.smithi134.stdout:2/808: chown df/d10/d15/d5a/lbc 24 1 2024-02-16T22:19:02.041 INFO:tasks.workunit.client.0.smithi134.stdout:7/862: rename d2/d5/d19/f2f to d2/d5/d19/d84/d86/d93/dab/f11a 0 2024-02-16T22:19:02.043 INFO:tasks.workunit.client.0.smithi134.stdout:4/817: symlink d0/d6/d22/l113 0 2024-02-16T22:19:02.048 INFO:tasks.workunit.client.0.smithi134.stdout:2/809: dread df/d10/d30/d49/d82/f79 [0,4194304] 0 2024-02-16T22:19:02.048 INFO:tasks.workunit.client.0.smithi134.stdout:2/810: write df/d10/d30/d4d/d94/ff4 [1037240,58767] 0 2024-02-16T22:19:02.052 INFO:tasks.workunit.client.0.smithi134.stdout:4/818: mknod d0/c114 0 2024-02-16T22:19:02.053 INFO:tasks.workunit.client.0.smithi134.stdout:4/819: creat d0/d6/d44/f115 x:0 0 0 2024-02-16T22:19:02.054 INFO:tasks.workunit.client.0.smithi134.stdout:2/811: rmdir df/d10/d30/d49 39 2024-02-16T22:19:02.054 INFO:tasks.workunit.client.0.smithi134.stdout:2/812: getdents df/d10/d30/da2/dca 0 2024-02-16T22:19:02.059 INFO:tasks.workunit.client.0.smithi134.stdout:4/820: dread d0/d6/d22/d97/daf/fc7 [0,4194304] 0 2024-02-16T22:19:02.061 INFO:tasks.workunit.client.0.smithi134.stdout:4/821: rename d0/d31/db8/d1a/ff8 to d0/d31/f116 0 2024-02-16T22:19:02.061 INFO:tasks.workunit.client.0.smithi134.stdout:7/863: dwrite d2/d6/f43 [0,4194304] 0 2024-02-16T22:19:02.061 INFO:tasks.workunit.client.0.smithi134.stdout:7/864: chown d2/d5/d19/d84/cbb 1548516 1 2024-02-16T22:19:02.066 INFO:tasks.workunit.client.0.smithi134.stdout:7/865: symlink d2/d5/d22/d26/dd8/l11b 0 2024-02-16T22:19:02.066 INFO:tasks.workunit.client.0.smithi134.stdout:7/866: read d2/d5/d19/f1d [6929836,70249] 0 2024-02-16T22:19:02.066 INFO:tasks.workunit.client.0.smithi134.stdout:4/822: getdents d0/d6/d1e/d39/d4e 0 2024-02-16T22:19:02.068 INFO:tasks.workunit.client.0.smithi134.stdout:7/867: link d2/d6/l75 d2/d5/d19/d4a/d9d/l11c 0 2024-02-16T22:19:02.068 INFO:tasks.workunit.client.0.smithi134.stdout:2/813: read df/d10/d30/d49/d85/def/dd6/fc9 [2479418,76412] 0 2024-02-16T22:19:02.068 INFO:tasks.workunit.client.0.smithi134.stdout:2/814: chown df/d10/d30/d49/d82/f79 4731541 1 2024-02-16T22:19:02.069 INFO:tasks.workunit.client.0.smithi134.stdout:2/815: mkdir df/d10/d15/da4/df5/df7 0 2024-02-16T22:19:02.070 INFO:tasks.workunit.client.0.smithi134.stdout:8/949: sync 2024-02-16T22:19:02.070 INFO:tasks.workunit.client.0.smithi134.stdout:1/953: sync 2024-02-16T22:19:02.070 INFO:tasks.workunit.client.0.smithi134.stdout:8/950: fdatasync d2/f63 0 2024-02-16T22:19:02.072 INFO:tasks.workunit.client.0.smithi134.stdout:1/954: creat d5/da/d102/f132 x:0 0 0 2024-02-16T22:19:02.073 INFO:tasks.workunit.client.0.smithi134.stdout:2/816: dread df/f51 [4194304,4194304] 0 2024-02-16T22:19:02.073 INFO:tasks.workunit.client.0.smithi134.stdout:2/817: truncate df/d10/d30/d49/d85/fd0 585595 0 2024-02-16T22:19:02.075 INFO:tasks.workunit.client.0.smithi134.stdout:2/818: mkdir df/d10/d30/df8 0 2024-02-16T22:19:02.082 INFO:tasks.workunit.client.0.smithi134.stdout:2/819: write df/d10/d15/d5a/de8/f92 [2492210,29450] 0 2024-02-16T22:19:02.083 INFO:tasks.workunit.client.0.smithi134.stdout:2/820: symlink df/d6f/dd2/lf9 0 2024-02-16T22:19:02.084 INFO:tasks.workunit.client.0.smithi134.stdout:8/951: dread d2/df/f6e [0,4194304] 0 2024-02-16T22:19:02.084 INFO:tasks.workunit.client.0.smithi134.stdout:2/821: creat df/d10/d15/d5a/de8/ffa x:0 0 0 2024-02-16T22:19:02.084 INFO:tasks.workunit.client.0.smithi134.stdout:2/822: fsync df/f51 0 2024-02-16T22:19:02.085 INFO:tasks.workunit.client.0.smithi134.stdout:1/955: dread d5/da/d21/d52/f6c [0,4194304] 0 2024-02-16T22:19:02.086 INFO:tasks.workunit.client.0.smithi134.stdout:2/823: symlink df/d10/d30/da2/lfb 0 2024-02-16T22:19:02.086 INFO:tasks.workunit.client.0.smithi134.stdout:2/824: fsync df/d10/d3a/da9/dae/fe9 0 2024-02-16T22:19:02.086 INFO:tasks.workunit.client.0.smithi134.stdout:2/825: creat df/d6f/dd2/ffc x:0 0 0 2024-02-16T22:19:02.086 INFO:tasks.workunit.client.0.smithi134.stdout:2/826: chown df/d10/d30/d49/d82/d1b/c32 2308 1 2024-02-16T22:19:02.086 INFO:tasks.workunit.client.0.smithi134.stdout:2/827: dread - df/d10/d30/d49/d82/d1b/fc3 zero size 2024-02-16T22:19:02.086 INFO:tasks.workunit.client.0.smithi134.stdout:2/828: write df/d10/d30/d49/d85/fd0 [976139,41992] 0 2024-02-16T22:19:02.092 INFO:tasks.workunit.client.0.smithi134.stdout:7/868: write d2/d6/d7d/d112/d7f/d24/f5a [1836614,94138] 0 2024-02-16T22:19:02.093 INFO:tasks.workunit.client.0.smithi134.stdout:7/869: write d2/d6/dcc/df7/f115 [837648,92399] 0 2024-02-16T22:19:02.095 INFO:tasks.workunit.client.0.smithi134.stdout:7/870: creat d2/d5/d19/d84/d86/d93/de8/f11d x:0 0 0 2024-02-16T22:19:02.095 INFO:tasks.workunit.client.0.smithi134.stdout:7/871: stat d2/d6/d7d/d92/da5/d63/dc2/l10d 0 2024-02-16T22:19:02.097 INFO:tasks.workunit.client.0.smithi134.stdout:7/872: mknod d2/d5/d19/d4a/d9d/c11e 0 2024-02-16T22:19:02.099 INFO:tasks.workunit.client.0.smithi134.stdout:7/873: symlink d2/d6/d17/l11f 0 2024-02-16T22:19:02.101 INFO:tasks.workunit.client.0.smithi134.stdout:4/823: dwrite d0/d6/d44/db0/fc3 [0,4194304] 0 2024-02-16T22:19:02.102 INFO:tasks.workunit.client.0.smithi134.stdout:7/874: symlink d2/d6/d7d/d92/da5/d63/dc2/dd1/l120 0 2024-02-16T22:19:02.109 INFO:tasks.workunit.client.0.smithi134.stdout:7/875: getdents d2 0 2024-02-16T22:19:02.109 INFO:tasks.workunit.client.0.smithi134.stdout:7/876: read d2/d6/d7d/d92/da5/d63/f110 [137426,117142] 0 2024-02-16T22:19:02.109 INFO:tasks.workunit.client.0.smithi134.stdout:7/877: fdatasync d2/d6/d91/db3/fb4 0 2024-02-16T22:19:02.110 INFO:tasks.workunit.client.0.smithi134.stdout:7/878: symlink d2/d6/d7d/d92/l121 0 2024-02-16T22:19:02.111 INFO:tasks.workunit.client.0.smithi134.stdout:7/879: unlink c1 0 2024-02-16T22:19:02.113 INFO:tasks.workunit.client.0.smithi134.stdout:2/829: dwrite df/d10/d30/d49/f57 [0,4194304] 0 2024-02-16T22:19:02.114 INFO:tasks.workunit.client.0.smithi134.stdout:1/956: dwrite d5/da/d21/d52/d9b/db3/fee [4194304,4194304] 0 2024-02-16T22:19:02.115 INFO:tasks.workunit.client.0.smithi134.stdout:1/957: fdatasync d5/da/d21/d45/f7b 0 2024-02-16T22:19:02.115 INFO:tasks.workunit.client.0.smithi134.stdout:1/958: dread - d5/da/d21/d52/d9b/db6/f12c zero size 2024-02-16T22:19:02.115 INFO:tasks.workunit.client.0.smithi134.stdout:1/959: chown d5/d1a/d23/d85/lcf 1 1 2024-02-16T22:19:02.116 INFO:tasks.workunit.client.0.smithi134.stdout:2/830: creat df/d10/d15/ffd x:0 0 0 2024-02-16T22:19:02.118 INFO:tasks.workunit.client.0.smithi134.stdout:7/880: dread d2/d5/d4c/fec [0,4194304] 0 2024-02-16T22:19:02.118 INFO:tasks.workunit.client.0.smithi134.stdout:7/881: write d2/d6/d7d/d112/d7f/f54 [214273,30767] 0 2024-02-16T22:19:02.119 INFO:tasks.workunit.client.0.smithi134.stdout:2/831: creat df/d10/d30/d49/d7b/ffe x:0 0 0 2024-02-16T22:19:02.119 INFO:tasks.workunit.client.0.smithi134.stdout:2/832: chown df/d10/d15 2449231 1 2024-02-16T22:19:02.120 INFO:tasks.workunit.client.0.smithi134.stdout:7/882: creat d2/d5/d19/d84/d86/d93/dab/d40/df1/d104/d10e/f122 x:0 0 0 2024-02-16T22:19:02.121 INFO:tasks.workunit.client.0.smithi134.stdout:2/833: mknod df/d10/d30/d4d/d94/da3/cff 0 2024-02-16T22:19:02.121 INFO:tasks.workunit.client.0.smithi134.stdout:3/969: sync 2024-02-16T22:19:02.121 INFO:tasks.workunit.client.0.smithi134.stdout:0/894: sync 2024-02-16T22:19:02.121 INFO:tasks.workunit.client.0.smithi134.stdout:5/942: sync 2024-02-16T22:19:02.121 INFO:tasks.workunit.client.0.smithi134.stdout:7/883: truncate d2/d5/d19/d4a/fd3 2620481 0 2024-02-16T22:19:02.122 INFO:tasks.workunit.client.0.smithi134.stdout:1/960: read d5/d1a/d82/f97 [2397156,94744] 0 2024-02-16T22:19:02.122 INFO:tasks.workunit.client.0.smithi134.stdout:2/834: mknod df/d10/da6/c100 0 2024-02-16T22:19:02.125 INFO:tasks.workunit.client.0.smithi134.stdout:5/943: symlink d2/l128 0 2024-02-16T22:19:02.126 INFO:tasks.workunit.client.0.smithi134.stdout:7/884: truncate d2/d5/d19/f2b 475600 0 2024-02-16T22:19:02.127 INFO:tasks.workunit.client.0.smithi134.stdout:1/961: mknod d5/d1a/d82/c133 0 2024-02-16T22:19:02.130 INFO:tasks.workunit.client.0.smithi134.stdout:2/835: creat df/d10/d30/da2/dca/f101 x:0 0 0 2024-02-16T22:19:02.131 INFO:tasks.workunit.client.0.smithi134.stdout:3/970: symlink da/l13b 0 2024-02-16T22:19:02.134 INFO:tasks.workunit.client.0.smithi134.stdout:5/944: link d2/d35/f122 d2/d9/dc/daf/f129 0 2024-02-16T22:19:02.135 INFO:tasks.workunit.client.0.smithi134.stdout:5/945: fsync d2/d35/d36/d46/d68/d74/fa7 0 2024-02-16T22:19:02.135 INFO:tasks.workunit.client.0.smithi134.stdout:5/946: fdatasync d2/dc9/f11e 0 2024-02-16T22:19:02.135 INFO:tasks.workunit.client.0.smithi134.stdout:5/947: dread - d2/d35/d36/d3d/d9c/d4b/f108 zero size 2024-02-16T22:19:02.139 INFO:tasks.workunit.client.0.smithi134.stdout:2/836: read df/d10/d15/f66 [435087,24370] 0 2024-02-16T22:19:02.139 INFO:tasks.workunit.client.0.smithi134.stdout:5/948: creat d2/d9/dc/df7/d105/f12a x:0 0 0 2024-02-16T22:19:02.143 INFO:tasks.workunit.client.0.smithi134.stdout:2/837: mknod df/d10/d15/da4/df5/c102 0 2024-02-16T22:19:02.143 INFO:tasks.workunit.client.0.smithi134.stdout:2/838: creat df/d10/d30/d4d/f103 x:0 0 0 2024-02-16T22:19:02.143 INFO:tasks.workunit.client.0.smithi134.stdout:2/839: write df/d10/d30/d49/d85/def/dd6/fc1 [1149559,110208] 0 2024-02-16T22:19:02.168 INFO:tasks.workunit.client.0.smithi134.stdout:7/885: dwrite d2/d5/d19/d4a/f58 [0,4194304] 0 2024-02-16T22:19:02.168 INFO:tasks.workunit.client.0.smithi134.stdout:3/971: dwrite da/d12/d2a/fbf [0,4194304] 0 2024-02-16T22:19:02.169 INFO:tasks.workunit.client.0.smithi134.stdout:1/962: dwrite d5/f24 [0,4194304] 0 2024-02-16T22:19:02.169 INFO:tasks.workunit.client.0.smithi134.stdout:1/963: write d5/d1a/d23/d85/f103 [784562,125924] 0 2024-02-16T22:19:02.169 INFO:tasks.workunit.client.0.smithi134.stdout:1/964: write d5/d1a/d53/d86/d11d/d6a/d5c/fc1 [66215,70497] 0 2024-02-16T22:19:02.170 INFO:tasks.workunit.client.0.smithi134.stdout:2/840: dwrite df/d10/d15/ffd [0,4194304] 0 2024-02-16T22:19:02.171 INFO:tasks.workunit.client.0.smithi134.stdout:3/972: unlink da/d12/f21 0 2024-02-16T22:19:02.172 INFO:tasks.workunit.client.0.smithi134.stdout:7/886: unlink d2/d5/d4c/l64 0 2024-02-16T22:19:02.173 INFO:tasks.workunit.client.0.smithi134.stdout:7/887: write d2/d6/d7d/d92/da5/d63/fc5 [1040101,121456] 0 2024-02-16T22:19:02.271 INFO:tasks.workunit.client.0.smithi134.stdout:1/965: link d5/da/d2d/dca/lfd d5/da/d21/d45/d93/d10c/l134 0 2024-02-16T22:19:02.279 INFO:tasks.workunit.client.0.smithi134.stdout:3/973: dwrite da/f135 [0,4194304] 0 2024-02-16T22:19:02.279 INFO:tasks.workunit.client.0.smithi134.stdout:3/974: chown da/d1c/d24/d9a/dc0/d8a/d8f/d9f/d128/lb1 11794140 1 2024-02-16T22:19:02.281 INFO:tasks.workunit.client.0.smithi134.stdout:1/966: rename d5/f24 to d5/d1a/d53/f135 0 2024-02-16T22:19:02.281 INFO:tasks.workunit.client.0.smithi134.stdout:1/967: write d5/d1a/d53/d86/d11d/fd8 [724238,87165] 0 2024-02-16T22:19:02.288 INFO:tasks.workunit.client.0.smithi134.stdout:3/975: getdents da/d1c/d24/d9a/dc0/d8a/d8f/d5f 0 2024-02-16T22:19:02.288 INFO:tasks.workunit.client.0.smithi134.stdout:3/976: truncate da/d12/dd2/f105 515872 0 2024-02-16T22:19:02.288 INFO:tasks.workunit.client.0.smithi134.stdout:3/977: truncate da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/ff1 939827 0 2024-02-16T22:19:02.296 INFO:tasks.workunit.client.0.smithi134.stdout:8/952: sync 2024-02-16T22:19:02.296 INFO:tasks.workunit.client.0.smithi134.stdout:4/824: sync 2024-02-16T22:19:02.296 INFO:tasks.workunit.client.0.smithi134.stdout:5/949: sync 2024-02-16T22:19:02.296 INFO:tasks.workunit.client.0.smithi134.stdout:0/895: sync 2024-02-16T22:19:02.296 INFO:tasks.workunit.client.0.smithi134.stdout:8/953: fsync d2/df/d7c/f140 0 2024-02-16T22:19:02.296 INFO:tasks.workunit.client.0.smithi134.stdout:8/954: stat d2/df/d18/d27/fbf 0 2024-02-16T22:19:02.297 INFO:tasks.workunit.client.0.smithi134.stdout:4/825: truncate d0/d31/db8/d46/fbf 1797393 0 2024-02-16T22:19:02.297 INFO:tasks.workunit.client.0.smithi134.stdout:4/826: read - d0/d6/d22/d40/fd5 zero size 2024-02-16T22:19:02.297 INFO:tasks.workunit.client.0.smithi134.stdout:4/827: readlink d0/d6/d22/l113 0 2024-02-16T22:19:02.297 INFO:tasks.workunit.client.0.smithi134.stdout:4/828: stat d0/d6/d8/da2/c62 0 2024-02-16T22:19:02.298 INFO:tasks.workunit.client.0.smithi134.stdout:5/950: symlink d2/d9/dc/df7/l12b 0 2024-02-16T22:19:02.298 INFO:tasks.workunit.client.0.smithi134.stdout:5/951: chown d2/d9/dc/d15/c110 38336316 1 2024-02-16T22:19:02.299 INFO:tasks.workunit.client.0.smithi134.stdout:0/896: creat d2/d20/d77/d85/db6/d108/d112/f12d x:0 0 0 2024-02-16T22:19:02.299 INFO:tasks.workunit.client.0.smithi134.stdout:0/897: creat d2/d20/d77/d85/d94/f12e x:0 0 0 2024-02-16T22:19:02.302 INFO:tasks.workunit.client.0.smithi134.stdout:8/955: link d2/f2c d2/df/d18/dc5/d11e/d59/da0/d86/f143 0 2024-02-16T22:19:02.305 INFO:tasks.workunit.client.0.smithi134.stdout:8/956: mknod d2/df/d18/dc5/c144 0 2024-02-16T22:19:02.307 INFO:tasks.workunit.client.0.smithi134.stdout:8/957: mkdir d2/df/d18/dc5/d11e/d59/da0/d40/d53/d5e/d72/d7d/d145 0 2024-02-16T22:19:02.309 INFO:tasks.workunit.client.0.smithi134.stdout:0/898: dread d2/dc/d2d/d34/f37 [0,4194304] 0 2024-02-16T22:19:02.310 INFO:tasks.workunit.client.0.smithi134.stdout:0/899: chown d2/dc/d48/d12b/d5e/ld2 1 1 2024-02-16T22:19:02.312 INFO:tasks.workunit.client.0.smithi134.stdout:5/952: write d2/d9/dc/d15/d2f/fc1 [215196,98403] 0 2024-02-16T22:19:02.313 INFO:tasks.workunit.client.0.smithi134.stdout:3/978: dwrite da/d6b/dc1/de6/df5/ffc [0,4194304] 0 2024-02-16T22:19:02.313 INFO:tasks.workunit.client.0.smithi134.stdout:3/979: write da/d1c/d24/dd5/ff6 [577538,92824] 0 2024-02-16T22:19:02.313 INFO:tasks.workunit.client.0.smithi134.stdout:1/968: dwrite d5/da/f15 [4194304,4194304] 0 2024-02-16T22:19:02.314 INFO:tasks.workunit.client.0.smithi134.stdout:1/969: creat d5/d1a/d23/f136 x:0 0 0 2024-02-16T22:19:02.314 INFO:tasks.workunit.client.0.smithi134.stdout:1/970: readlink d5/da/d21/l3e 0 2024-02-16T22:19:02.314 INFO:tasks.workunit.client.0.smithi134.stdout:1/971: creat d5/da/db8/f137 x:0 0 0 2024-02-16T22:19:02.314 INFO:tasks.workunit.client.0.smithi134.stdout:5/953: creat d2/d9/dc/d15/d2f/ddf/d11b/dc8/f12c x:0 0 0 2024-02-16T22:19:02.318 INFO:tasks.workunit.client.0.smithi134.stdout:1/972: unlink d5/d1a/d82/f97 0 2024-02-16T22:19:02.319 INFO:tasks.workunit.client.0.smithi134.stdout:5/954: symlink d2/d9/dc/d15/d2f/ddf/d11b/d119/l12d 0 2024-02-16T22:19:02.319 INFO:tasks.workunit.client.0.smithi134.stdout:0/900: dread d2/d20/d50/f82 [0,4194304] 0 2024-02-16T22:19:02.319 INFO:tasks.workunit.client.0.smithi134.stdout:0/901: fdatasync d2/d20/ff0 0 2024-02-16T22:19:02.320 INFO:tasks.workunit.client.0.smithi134.stdout:0/902: mkdir d2/d20/d77/d85/de2/d12f 0 2024-02-16T22:19:02.324 INFO:tasks.workunit.client.0.smithi134.stdout:1/973: read d5/d1a/d23/f27 [415894,48287] 0 2024-02-16T22:19:02.325 INFO:tasks.workunit.client.0.smithi134.stdout:3/980: dread da/d1c/d24/f3d [0,4194304] 0 2024-02-16T22:19:02.326 INFO:tasks.workunit.client.0.smithi134.stdout:1/974: mkdir d5/d1a/d53/d86/d11d/d6a/d5c/d72/d138 0 2024-02-16T22:19:02.328 INFO:tasks.workunit.client.0.smithi134.stdout:3/981: creat da/d1c/d24/dd5/de3/f13c x:0 0 0 2024-02-16T22:19:02.329 INFO:tasks.workunit.client.0.smithi134.stdout:1/975: write d5/d1a/d63/fa5 [2974454,56267] 0 2024-02-16T22:19:02.331 INFO:tasks.workunit.client.0.smithi134.stdout:3/982: mknod da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/c13d 0 2024-02-16T22:19:02.331 INFO:tasks.workunit.client.0.smithi134.stdout:3/983: fsync da/d12/d2a/f7c 0 2024-02-16T22:19:02.333 INFO:tasks.workunit.client.0.smithi134.stdout:1/976: creat d5/d1a/d23/d85/de5/d11b/f139 x:0 0 0 2024-02-16T22:19:02.336 INFO:tasks.workunit.client.0.smithi134.stdout:1/977: link d5/da/d21/d52/d9b/d9f/fc5 d5/d1a/d53/d86/d11d/d6a/d5c/d72/d138/f13a 0 2024-02-16T22:19:02.336 INFO:tasks.workunit.client.0.smithi134.stdout:1/978: chown d5/da/db8/f137 4827233 1 2024-02-16T22:19:02.336 INFO:tasks.workunit.client.0.smithi134.stdout:1/979: chown d5/da/d21/d45/c123 16408200 1 2024-02-16T22:19:02.336 INFO:tasks.workunit.client.0.smithi134.stdout:4/829: dwrite d0/d31/db8/d46/fbb [0,4194304] 0 2024-02-16T22:19:02.338 INFO:tasks.workunit.client.0.smithi134.stdout:4/830: creat d0/d6/d1e/d3b/f117 x:0 0 0 2024-02-16T22:19:02.338 INFO:tasks.workunit.client.0.smithi134.stdout:4/831: stat d0/f11 0 2024-02-16T22:19:02.339 INFO:tasks.workunit.client.0.smithi134.stdout:4/832: mknod d0/d6/d8/d5e/c118 0 2024-02-16T22:19:02.349 INFO:tasks.workunit.client.0.smithi134.stdout:1/980: dread d5/da/d21/d52/d9b/fb1 [0,4194304] 0 2024-02-16T22:19:02.349 INFO:tasks.workunit.client.0.smithi134.stdout:1/981: fdatasync d5/d1a/d53/fce 0 2024-02-16T22:19:02.349 INFO:tasks.workunit.client.0.smithi134.stdout:8/958: dwrite d2/df/d18/dc5/d11e/d59/da0/d40/d53/daa/d105/f79 [8388608,4194304] 0 2024-02-16T22:19:02.350 INFO:tasks.workunit.client.0.smithi134.stdout:1/982: mkdir d5/d1a/d53/d86/d11d/d6a/d13b 0 2024-02-16T22:19:02.353 INFO:tasks.workunit.client.0.smithi134.stdout:0/903: dwrite d2/d20/d7a/ff1 [0,4194304] 0 2024-02-16T22:19:02.353 INFO:tasks.workunit.client.0.smithi134.stdout:5/955: dwrite d2/d35/d36/d3d/d63/d90/fd5 [0,4194304] 0 2024-02-16T22:19:02.353 INFO:tasks.workunit.client.0.smithi134.stdout:5/956: read d2/d9/dc/d15/d2f/fc1 [1264273,21120] 0 2024-02-16T22:19:02.353 INFO:tasks.workunit.client.0.smithi134.stdout:5/957: chown d2/f50 0 1 2024-02-16T22:19:02.354 INFO:tasks.workunit.client.0.smithi134.stdout:8/959: creat d2/df/d18/dc5/d11e/d59/da0/d40/d53/d5e/d72/f146 x:0 0 0 2024-02-16T22:19:02.357 INFO:tasks.workunit.client.0.smithi134.stdout:5/958: mknod d2/d35/d36/d46/c12e 0 2024-02-16T22:19:02.358 INFO:tasks.workunit.client.0.smithi134.stdout:8/960: getdents d2/df/d18/d27/dc4 0 2024-02-16T22:19:02.359 INFO:tasks.workunit.client.0.smithi134.stdout:5/959: symlink d2/d9/dc/df7/l12f 0 2024-02-16T22:19:02.359 INFO:tasks.workunit.client.0.smithi134.stdout:5/960: read - d2/d35/d36/d46/f6a zero size 2024-02-16T22:19:02.362 INFO:tasks.workunit.client.0.smithi134.stdout:3/984: dwrite da/d1c/d24/d2c/d74/f81 [0,4194304] 0 2024-02-16T22:19:02.362 INFO:tasks.workunit.client.0.smithi134.stdout:3/985: write da/d1c/d24/d9a/dc0/d8a/d8f/f4e [3730263,64805] 0 2024-02-16T22:19:02.362 INFO:tasks.workunit.client.0.smithi134.stdout:4/833: dwrite d0/f77 [8388608,4194304] 0 2024-02-16T22:19:02.366 INFO:tasks.workunit.client.0.smithi134.stdout:5/961: dread d2/f2b [4194304,4194304] 0 2024-02-16T22:19:02.366 INFO:tasks.workunit.client.0.smithi134.stdout:3/986: read da/dc3/fd8 [1019563,32374] 0 2024-02-16T22:19:02.366 INFO:tasks.workunit.client.0.smithi134.stdout:5/962: fsync d2/d9/dc/d15/f31 0 2024-02-16T22:19:02.366 INFO:tasks.workunit.client.0.smithi134.stdout:8/961: getdents d2/df/d18/dc5/d11e/d59/da0/d40/d53/d5e/d72 0 2024-02-16T22:19:02.368 INFO:tasks.workunit.client.0.smithi134.stdout:0/904: write d2/f16 [1293032,30669] 0 2024-02-16T22:19:02.368 INFO:tasks.workunit.client.0.smithi134.stdout:0/905: fsync d2/dc/d32/d45/fc6 0 2024-02-16T22:19:02.371 INFO:tasks.workunit.client.0.smithi134.stdout:4/834: link d0/d6/d1e/d39/d4e/f10a d0/d6/d8/da2/d76/df6/f119 0 2024-02-16T22:19:02.372 INFO:tasks.workunit.client.0.smithi134.stdout:8/962: dread d2/df/d18/dc5/d11e/d59/da0/d40/d53/d5e/fd4 [0,4194304] 0 2024-02-16T22:19:02.373 INFO:tasks.workunit.client.0.smithi134.stdout:5/963: creat d2/d35/d36/d3d/d63/f130 x:0 0 0 2024-02-16T22:19:02.374 INFO:tasks.workunit.client.0.smithi134.stdout:3/987: mknod da/d1c/d24/d9a/c13e 0 2024-02-16T22:19:02.375 INFO:tasks.workunit.client.0.smithi134.stdout:0/906: creat d2/dc/d48/d12b/f130 x:0 0 0 2024-02-16T22:19:02.375 INFO:tasks.workunit.client.0.smithi134.stdout:0/907: chown d2/dc/d48/d12b/da7/f124 55857 1 2024-02-16T22:19:02.375 INFO:tasks.workunit.client.0.smithi134.stdout:0/908: readlink d2/d20/d77/d85/d94/lcf 0 2024-02-16T22:19:02.376 INFO:tasks.workunit.client.0.smithi134.stdout:4/835: write d0/d6/d8/d30/fbe [2080014,58589] 0 2024-02-16T22:19:02.377 INFO:tasks.workunit.client.0.smithi134.stdout:8/963: rename d2/df/d18/dc5/d11e/c113 to d2/df/d18/db5/dbc/d138/c147 0 2024-02-16T22:19:02.378 INFO:tasks.workunit.client.0.smithi134.stdout:2/841: sync 2024-02-16T22:19:02.378 INFO:tasks.workunit.client.0.smithi134.stdout:7/888: sync 2024-02-16T22:19:02.378 INFO:tasks.workunit.client.0.smithi134.stdout:5/964: symlink d2/d8f/l131 0 2024-02-16T22:19:02.378 INFO:tasks.workunit.client.0.smithi134.stdout:5/965: getdents d2/d35/d36/da1/dbf 0 2024-02-16T22:19:02.378 INFO:tasks.workunit.client.0.smithi134.stdout:5/966: stat d2/d35/d36/d46/d68/d74/c101 0 2024-02-16T22:19:02.379 INFO:tasks.workunit.client.0.smithi134.stdout:0/909: creat d2/dc/dc4/ddc/f131 x:0 0 0 2024-02-16T22:19:02.382 INFO:tasks.workunit.client.0.smithi134.stdout:4/836: rename d0/d6/d8/lcc to d0/d6/d1e/d39/d4e/l11a 0 2024-02-16T22:19:02.382 INFO:tasks.workunit.client.0.smithi134.stdout:4/837: dread - d0/d31/fef zero size 2024-02-16T22:19:02.382 INFO:tasks.workunit.client.0.smithi134.stdout:3/988: dread da/d12/f10b [0,4194304] 0 2024-02-16T22:19:02.382 INFO:tasks.workunit.client.0.smithi134.stdout:3/989: creat da/d1c/d24/f13f x:0 0 0 2024-02-16T22:19:02.383 INFO:tasks.workunit.client.0.smithi134.stdout:3/990: fdatasync da/d12/d2a/f3c 0 2024-02-16T22:19:02.383 INFO:tasks.workunit.client.0.smithi134.stdout:3/991: fsync da/d1c/d24/d9a/dc0/d8a/d8f/d5f/d62/ff1 0 2024-02-16T22:19:02.384 INFO:tasks.workunit.client.0.smithi134.stdout:2/842: mknod df/d6f/c104 0 2024-02-16T22:19:02.386 INFO:tasks.workunit.client.0.smithi134.stdout:5/967: unlink d2/d35/d36/d3d/d9c/d4b/l83 0 2024-02-16T22:19:02.387 INFO:tasks.workunit.client.0.smithi134.stdout:0/910: mknod d2/d20/d77/dbd/c132 0 2024-02-16T22:19:02.387 INFO:tasks.workunit.client.0.smithi134.stdout:0/911: stat d2/d20/d77/dbd/c132 0 2024-02-16T22:19:02.388 INFO:tasks.workunit.client.0.smithi134.stdout:3/992: symlink da/d1c/d24/d29/l140 0 2024-02-16T22:19:02.391 INFO:tasks.workunit.client.0.smithi134.stdout:0/912: mkdir d2/dc/d2d/d133 0 2024-02-16T22:19:02.392 INFO:tasks.workunit.client.0.smithi134.stdout:3/993: symlink da/d6b/dc1/l141 0 2024-02-16T22:19:02.393 INFO:tasks.workunit.client.0.smithi134.stdout:7/889: mknod d2/d6/c123 0 2024-02-16T22:19:02.393 INFO:tasks.workunit.client.0.smithi134.stdout:4/838: dread d0/f77 [0,4194304] 0 2024-02-16T22:19:02.393 INFO:tasks.workunit.client.0.smithi134.stdout:5/968: mknod d2/d9/dc/d32/c132 0 2024-02-16T22:19:02.395 INFO:tasks.workunit.client.0.smithi134.stdout:8/964: dwrite d2/df/d18/db5/dce/f12b [0,4194304] 0 2024-02-16T22:19:02.395 INFO:tasks.workunit.client.0.smithi134.stdout:7/890: truncate d2/d6/d7d/d112/d7f/d24/fb8 108465 0 2024-02-16T22:19:02.396 INFO:tasks.workunit.client.0.smithi134.stdout:4/839: rmdir d0/d6/d8/d32/d63 39 2024-02-16T22:19:02.396 INFO:tasks.workunit.client.0.smithi134.stdout:4/840: fsync d0/d6/d8/d30/fbe 0 2024-02-16T22:19:02.398 INFO:tasks.workunit.client.0.smithi134.stdout:5/969: symlink d2/d9/dc/df7/l133 0 2024-02-16T22:19:02.401 INFO:tasks.workunit.client.0.smithi134.stdout:3/994: rmdir da/d1c/d24/d29/d51/d80 39 2024-02-16T22:19:02.401 INFO:tasks.workunit.client.0.smithi134.stdout:3/995: readlink da/d1c/d24/d29/d51/l131 0 2024-02-16T22:19:02.406 INFO:tasks.workunit.client.0.smithi134.stdout:4/841: rmdir d0/d31 39 2024-02-16T22:19:02.406 INFO:tasks.workunit.client.0.smithi134.stdout:8/965: dread d2/df/d18/dc5/d11e/d59/da0/d40/d53/daa/d105/fb8 [0,4194304] 0 2024-02-16T22:19:02.407 INFO:tasks.workunit.client.0.smithi134.stdout:5/970: mknod d2/d9/dc/d115/c134 0 2024-02-16T22:19:02.407 INFO:tasks.workunit.client.0.smithi134.stdout:5/971: write d2/d9/dc/d15/f4d [1850716,118675] 0 2024-02-16T22:19:02.409 INFO:tasks.workunit.client.0.smithi134.stdout:3/996: creat da/d1c/d24/d9a/dc0/d8a/d8f/d6d/f142 x:0 0 0 2024-02-16T22:19:02.411 INFO:tasks.workunit.client.0.smithi134.stdout:3/997: creat da/d1c/d24/d9a/f143 x:0 0 0 2024-02-16T22:19:02.411 INFO:tasks.workunit.client.0.smithi134.stdout:3/998: readlink da/d12/d2a/l133 0 2024-02-16T22:19:02.412 INFO:tasks.workunit.client.0.smithi134.stdout:7/891: mknod d2/d5/d22/d83/dce/c124 0 2024-02-16T22:19:02.413 INFO:tasks.workunit.client.0.smithi134.stdout:3/999: rename da/d1c/d24/d29/d51/d80/c93 to da/d1c/d24/d9a/dc0/d8a/d8f/d5f/c144 0 2024-02-16T22:19:02.418 INFO:tasks.workunit.client.0.smithi134.stdout:7/892: write d2/d5/d19/d4a/fd3 [513723,69285] 0 2024-02-16T22:19:02.419 INFO:tasks.workunit.client.0.smithi134.stdout:4/842: write d0/f11 [161221,19883] 0 2024-02-16T22:19:02.420 INFO:tasks.workunit.client.0.smithi134.stdout:7/893: mkdir d2/d5/d19/d84/d86/d93/de8/d125 0 2024-02-16T22:19:02.420 INFO:tasks.workunit.client.0.smithi134.stdout:7/894: dread - d2/d6/f10a zero size 2024-02-16T22:19:02.422 INFO:tasks.workunit.client.0.smithi134.stdout:4/843: link d0/d31/f4c d0/d31/db8/d46/f11b 0 2024-02-16T22:19:02.423 INFO:tasks.workunit.client.0.smithi134.stdout:0/913: dwrite d2/d20/d7a/d7e/ff7 [0,4194304] 0 2024-02-16T22:19:02.423 INFO:tasks.workunit.client.0.smithi134.stdout:8/966: dread d2/df/d18/dc5/d11e/d59/da0/f51 [0,4194304] 0 2024-02-16T22:19:02.423 INFO:tasks.workunit.client.0.smithi134.stdout:8/967: chown d2/df/d18/dc5/d11b 2110441706 1 2024-02-16T22:19:02.423 INFO:tasks.workunit.client.0.smithi134.stdout:8/968: stat d2/df/d18/dc5/d11e/d59/da0/d40/d53/d5e/d72/d7d/feb 0 2024-02-16T22:19:02.424 INFO:tasks.workunit.client.0.smithi134.stdout:4/844: creat d0/d6/d22/d97/daf/f11c x:0 0 0 2024-02-16T22:19:02.426 INFO:tasks.workunit.client.0.smithi134.stdout:5/972: read d2/d9/f6f [847534,46293] 0 2024-02-16T22:19:02.428 INFO:tasks.workunit.client.0.smithi134.stdout:0/914: rename d2/db7/fdb to d2/dc/d48/f134 0 2024-02-16T22:19:02.430 INFO:tasks.workunit.client.0.smithi134.stdout:8/969: creat d2/df/d18/d12/f148 x:0 0 0 2024-02-16T22:19:02.432 INFO:tasks.workunit.client.0.smithi134.stdout:4/845: dread d0/d31/db8/d46/fbf [0,4194304] 0 2024-02-16T22:19:02.432 INFO:tasks.workunit.client.0.smithi134.stdout:4/846: chown d0/d6/d8/d5e/f96 0 1 2024-02-16T22:19:02.435 INFO:tasks.workunit.client.0.smithi134.stdout:8/970: write d2/df/d18/dc5/d11e/d59/da0/d40/d53/daa/d105/fb8 [2479848,74074] 0 2024-02-16T22:19:02.435 INFO:tasks.workunit.client.0.smithi134.stdout:4/847: dread d0/d6/d8/d5e/fbd [0,4194304] 0 2024-02-16T22:19:02.435 INFO:tasks.workunit.client.0.smithi134.stdout:4/848: fdatasync d0/d6/d8/fa 0 2024-02-16T22:19:02.435 INFO:tasks.workunit.client.0.smithi134.stdout:4/849: stat d0/d6/d1e/fdd 0 2024-02-16T22:19:02.436 INFO:tasks.workunit.client.0.smithi134.stdout:1/983: sync 2024-02-16T22:19:02.436 INFO:tasks.workunit.client.0.smithi134.stdout:1/984: fdatasync d5/d1a/d23/fec 0 2024-02-16T22:19:02.436 INFO:tasks.workunit.client.0.smithi134.stdout:1/985: write d5/d1a/d53/d86/d11d/d6a/f51 [3327308,128388] 0 2024-02-16T22:19:02.436 INFO:tasks.workunit.client.0.smithi134.stdout:5/973: dread d2/d9/dc/daf/f129 [0,4194304] 0 2024-02-16T22:19:02.439 INFO:tasks.workunit.client.0.smithi134.stdout:1/986: rename d5/da/d21/d52/f8b to d5/da/d21/d45/f13c 0 2024-02-16T22:19:02.440 INFO:tasks.workunit.client.0.smithi134.stdout:1/987: readlink d5/da/d2d/l8e 0 2024-02-16T22:19:02.440 INFO:tasks.workunit.client.0.smithi134.stdout:5/974: rmdir d2/dc9 39 2024-02-16T22:19:02.447 INFO:tasks.workunit.client.0.smithi134.stdout:5/975: dread d2/d35/d36/d3d/d9c/d4b/f7d [0,4194304] 0 2024-02-16T22:19:02.461 INFO:tasks.workunit.client.0.smithi134.stdout:5/976: dread d2/f6 [0,4194304] 0 2024-02-16T22:19:02.465 INFO:tasks.workunit.client.0.smithi134.stdout:5/977: dread d2/d9/dc/d32/dce/f109 [0,4194304] 0 2024-02-16T22:19:02.465 INFO:tasks.workunit.client.0.smithi134.stdout:5/978: stat d2/dc9 0 2024-02-16T22:19:02.465 INFO:tasks.workunit.client.0.smithi134.stdout:5/979: write d2/d9/dc/d32/f5a [1751623,17048] 0 2024-02-16T22:19:02.465 INFO:tasks.workunit.client.0.smithi134.stdout:0/915: dwrite d2/dc/d32/f42 [0,4194304] 0 2024-02-16T22:19:02.465 INFO:tasks.workunit.client.0.smithi134.stdout:0/916: stat d2/dc/d32/f42 0 2024-02-16T22:19:02.466 INFO:tasks.workunit.client.0.smithi134.stdout:5/980: creat d2/d35/d36/da1/dbf/f135 x:0 0 0 2024-02-16T22:19:02.467 INFO:tasks.workunit.client.0.smithi134.stdout:8/971: dwrite d2/df/d18/db5/dce/f116 [0,4194304] 0 2024-02-16T22:19:02.467 INFO:tasks.workunit.client.0.smithi134.stdout:4/850: dwrite d0/d6/d8/f52 [0,4194304] 0 2024-02-16T22:19:02.468 INFO:tasks.workunit.client.0.smithi134.stdout:1/988: dwrite d5/da/d21/d45/d93/f5e [0,4194304] 0 2024-02-16T22:19:02.468 INFO:tasks.workunit.client.0.smithi134.stdout:1/989: readlink d5/d1a/d82/lc6 0 2024-02-16T22:19:02.470 INFO:tasks.workunit.client.0.smithi134.stdout:4/851: creat d0/d6/d8/da2/f11d x:0 0 0 2024-02-16T22:19:02.471 INFO:tasks.workunit.client.0.smithi134.stdout:8/972: creat d2/df/d18/dc5/d11b/d139/f149 x:0 0 0 2024-02-16T22:19:02.474 INFO:tasks.workunit.client.0.smithi134.stdout:1/990: symlink d5/da/d21/d45/d93/l13d 0 2024-02-16T22:19:02.475 INFO:tasks.workunit.client.0.smithi134.stdout:4/852: link d0/f4 d0/d6/d22/d25/d2a/db4/f11e 0 2024-02-16T22:19:02.475 INFO:tasks.workunit.client.0.smithi134.stdout:4/853: stat d0/d31/db8/d46/fbb 0 2024-02-16T22:19:02.476 INFO:tasks.workunit.client.0.smithi134.stdout:1/991: symlink d5/d1a/d4d/d99/l13e 0 2024-02-16T22:19:02.476 INFO:tasks.workunit.client.0.smithi134.stdout:1/992: truncate d5/da/d21/d45/d93/d10c/ffc 167520 0 2024-02-16T22:19:02.477 INFO:tasks.workunit.client.0.smithi134.stdout:5/981: dread d2/d9/dc/d98/ff0 [4194304,4194304] 0 2024-02-16T22:19:02.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:01 smithi134 ceph-mon[28869]: pgmap v253: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 193 MiB/s rd, 246 MiB/s wr, 355 op/s 2024-02-16T22:19:02.477 INFO:tasks.workunit.client.0.smithi134.stdout:4/854: getdents d0/d6/d1e/d7c/dff 0 2024-02-16T22:19:02.479 INFO:tasks.workunit.client.0.smithi134.stdout:5/982: rename d2/d35/c73 to d2/d9/dc/d32/dd3/c136 0 2024-02-16T22:19:02.480 INFO:tasks.workunit.client.0.smithi134.stdout:4/855: mknod d0/d31/d110/c11f 0 2024-02-16T22:19:02.480 INFO:tasks.workunit.client.0.smithi134.stdout:1/993: dread d5/da/db8/f10f [0,4194304] 0 2024-02-16T22:19:02.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:02 smithi173 ceph-mon[37280]: pgmap v253: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 193 MiB/s rd, 246 MiB/s wr, 355 op/s 2024-02-16T22:19:02.481 INFO:tasks.workunit.client.0.smithi134.stdout:4/856: mkdir d0/d6/d8/d120 0 2024-02-16T22:19:02.481 INFO:tasks.workunit.client.0.smithi134.stdout:8/973: dread d2/f5d [0,4194304] 0 2024-02-16T22:19:02.481 INFO:tasks.workunit.client.0.smithi134.stdout:5/983: mkdir d2/d9/dc/d137 0 2024-02-16T22:19:02.482 INFO:tasks.workunit.client.0.smithi134.stdout:4/857: mknod d0/d6/d1e/d7c/c121 0 2024-02-16T22:19:02.482 INFO:tasks.workunit.client.0.smithi134.stdout:4/858: fsync d0/d6/d1e/d3b/fac 0 2024-02-16T22:19:02.482 INFO:tasks.workunit.client.0.smithi134.stdout:8/974: rmdir d2/df/d18/db5 39 2024-02-16T22:19:02.482 INFO:tasks.workunit.client.0.smithi134.stdout:8/975: fsync d2/df/d18/d91/ffd 0 2024-02-16T22:19:02.483 INFO:tasks.workunit.client.0.smithi134.stdout:8/976: stat d2/df/d18/dc5/d11e/d59/da0/f51 0 2024-02-16T22:19:02.483 INFO:tasks.workunit.client.0.smithi134.stdout:0/917: dwrite d2/d20/d7a/ffa [0,4194304] 0 2024-02-16T22:19:02.483 INFO:tasks.workunit.client.0.smithi134.stdout:8/977: dread d2/df/d18/d27/d85/f11a [0,4194304] 0 2024-02-16T22:19:02.483 INFO:tasks.workunit.client.0.smithi134.stdout:5/984: link d2/d35/d36/d3d/ca0 d2/d9/dc6/c138 0 2024-02-16T22:19:02.484 INFO:tasks.workunit.client.0.smithi134.stdout:4/859: rename d0/d6/d8/da2/d76/df0/dc8 to d0/d6/d1e/d3b/d122 0 2024-02-16T22:19:02.486 INFO:tasks.workunit.client.0.smithi134.stdout:8/978: mknod d2/df/d18/db5/c14a 0 2024-02-16T22:19:02.487 INFO:tasks.workunit.client.0.smithi134.stdout:5/985: truncate d2/d35/d36/d46/d68/fb9 4981536 0 2024-02-16T22:19:02.488 INFO:tasks.workunit.client.0.smithi134.stdout:1/994: read d5/d1a/d53/d86/d11d/d6a/d5c/d72/d138/f13a [719914,119529] 0 2024-02-16T22:19:02.488 INFO:tasks.workunit.client.0.smithi134.stdout:1/995: read d5/d1a/f62 [3059624,32074] 0 2024-02-16T22:19:02.489 INFO:tasks.workunit.client.0.smithi134.stdout:4/860: rename d0/d6/d1e/d7c/f107 to d0/d6/d22/d25/d2a/f123 0 2024-02-16T22:19:02.490 INFO:tasks.workunit.client.0.smithi134.stdout:5/986: dread d2/d35/d36/d3d/d9c/ff3 [0,4194304] 0 2024-02-16T22:19:02.490 INFO:tasks.workunit.client.0.smithi134.stdout:1/996: truncate d5/da/d21/d45/fcc 748876 0 2024-02-16T22:19:02.490 INFO:tasks.workunit.client.0.smithi134.stdout:1/997: creat d5/da/d102/f13f x:0 0 0 2024-02-16T22:19:02.493 INFO:tasks.workunit.client.0.smithi134.stdout:8/979: dread d2/df/d18/dc5/d11e/d59/da0/d40/d53/d5e/fd4 [0,4194304] 0 2024-02-16T22:19:02.493 INFO:tasks.workunit.client.0.smithi134.stdout:8/980: truncate d2/df/d18/d91/ffd 1009876 0 2024-02-16T22:19:02.495 INFO:tasks.workunit.client.0.smithi134.stdout:1/998: symlink d5/d1a/d63/l140 0 2024-02-16T22:19:02.496 INFO:tasks.workunit.client.0.smithi134.stdout:8/981: mknod d2/df/d18/dc5/d11e/d59/da0/d9f/c14b 0 2024-02-16T22:19:02.499 INFO:tasks.workunit.client.0.smithi134.stdout:1/999: mkdir d5/da/db8/dd5/d141 0 2024-02-16T22:19:02.502 INFO:tasks.workunit.client.0.smithi134.stdout:2/843: sync 2024-02-16T22:19:02.507 INFO:tasks.workunit.client.0.smithi134.stdout:2/844: truncate df/d10/d15/d5a/de8/f92 5385707 0 2024-02-16T22:19:02.508 INFO:tasks.workunit.client.0.smithi134.stdout:2/845: mkdir df/d10/d30/d4d/d105 0 2024-02-16T22:19:02.510 INFO:tasks.workunit.client.0.smithi134.stdout:2/846: truncate df/f51 7130117 0 2024-02-16T22:19:02.512 INFO:tasks.workunit.client.0.smithi134.stdout:2/847: rename df/d10/d30/d49/d85/def/dd6/ld3 to df/d10/d30/d49/d85/def/dd6/l106 0 2024-02-16T22:19:02.527 INFO:tasks.workunit.client.0.smithi134.stdout:0/918: dwrite d2/d20/ff0 [0,4194304] 0 2024-02-16T22:19:02.527 INFO:tasks.workunit.client.0.smithi134.stdout:5/987: dwrite d2/d35/d36/d3d/d9c/d4b/f7d [0,4194304] 0 2024-02-16T22:19:02.528 INFO:tasks.workunit.client.0.smithi134.stdout:5/988: creat d2/d9/dc6/f139 x:0 0 0 2024-02-16T22:19:02.528 INFO:tasks.workunit.client.0.smithi134.stdout:4/861: dwrite d0/d6/d44/db0/fc3 [0,4194304] 0 2024-02-16T22:19:02.528 INFO:tasks.workunit.client.0.smithi134.stdout:8/982: dwrite d2/df/d18/dc5/d11e/d59/da0/d40/d53/d5e/fec [0,4194304] 0 2024-02-16T22:19:02.533 INFO:tasks.workunit.client.0.smithi134.stdout:5/989: dread d2/d35/d36/d46/d68/d74/fb4 [0,4194304] 0 2024-02-16T22:19:02.534 INFO:tasks.workunit.client.0.smithi134.stdout:0/919: mkdir d2/dc/d2d/d133/d135 0 2024-02-16T22:19:02.534 INFO:tasks.workunit.client.0.smithi134.stdout:0/920: creat d2/dc/d2d/d34/d87/f136 x:0 0 0 2024-02-16T22:19:02.541 INFO:tasks.workunit.client.0.smithi134.stdout:7/895: sync 2024-02-16T22:19:02.542 INFO:tasks.workunit.client.0.smithi134.stdout:8/983: truncate d2/df/d18/dc5/d11e/d59/da0/f51 2467685 0 2024-02-16T22:19:02.546 INFO:tasks.workunit.client.0.smithi134.stdout:8/984: write d2/df/d18/dc5/d11e/d59/db1/d87/f7a [3871982,114255] 0 2024-02-16T22:19:02.546 INFO:tasks.workunit.client.0.smithi134.stdout:8/985: write d2/f127 [898345,13469] 0 2024-02-16T22:19:02.548 INFO:tasks.workunit.client.0.smithi134.stdout:7/896: creat d2/d5/d19/d84/d86/d93/dab/d40/df1/f126 x:0 0 0 2024-02-16T22:19:02.548 INFO:tasks.workunit.client.0.smithi134.stdout:7/897: chown d2/d5/d19/d84 29 1 2024-02-16T22:19:02.558 INFO:tasks.workunit.client.0.smithi134.stdout:7/898: mknod d2/d6/d91/c127 0 2024-02-16T22:19:02.559 INFO:tasks.workunit.client.0.smithi134.stdout:7/899: symlink d2/d6/d7d/d112/l128 0 2024-02-16T22:19:02.561 INFO:tasks.workunit.client.0.smithi134.stdout:4/862: dwrite d0/d31/f4c [4194304,4194304] 0 2024-02-16T22:19:02.563 INFO:tasks.workunit.client.0.smithi134.stdout:5/990: dwrite d2/d9/dc/f81 [0,4194304] 0 2024-02-16T22:19:02.565 INFO:tasks.workunit.client.0.smithi134.stdout:0/921: rmdir d2 39 2024-02-16T22:19:02.570 INFO:tasks.workunit.client.0.smithi134.stdout:8/986: dwrite d2/df/d18/dc5/d11e/d59/da0/d86/ff9 [0,4194304] 0 2024-02-16T22:19:02.577 INFO:tasks.workunit.client.0.smithi134.stdout:8/987: rmdir d2/df/d18/dc5/d11e/d59/da0/d40/d53/daa/df1/d12f 0 2024-02-16T22:19:02.578 INFO:tasks.workunit.client.0.smithi134.stdout:8/988: unlink d2/f5d 0 2024-02-16T22:19:02.580 INFO:tasks.workunit.client.0.smithi134.stdout:8/989: creat d2/df/d18/f14c x:0 0 0 2024-02-16T22:19:02.582 INFO:tasks.workunit.client.0.smithi134.stdout:8/990: creat d2/df/d18/dc5/d11e/d59/da0/d40/d53/d5e/f14d x:0 0 0 2024-02-16T22:19:02.584 INFO:tasks.workunit.client.0.smithi134.stdout:8/991: truncate d2/df/d18/dc5/d11e/d59/da0/d40/d53/daa/d105/f79 8911886 0 2024-02-16T22:19:02.584 INFO:tasks.workunit.client.0.smithi134.stdout:7/900: dwrite d2/d6/d91/db3/fe9 [0,4194304] 0 2024-02-16T22:19:02.585 INFO:tasks.workunit.client.0.smithi134.stdout:8/992: mknod d2/df/d18/dc5/d11e/d11f/c14e 0 2024-02-16T22:19:02.585 INFO:tasks.workunit.client.0.smithi134.stdout:4/863: dwrite d0/da1/feb [0,4194304] 0 2024-02-16T22:19:02.586 INFO:tasks.workunit.client.0.smithi134.stdout:4/864: fdatasync d0/d6/d1e/d3b/fe1 0 2024-02-16T22:19:02.589 INFO:tasks.workunit.client.0.smithi134.stdout:7/901: rename d2/d6/d17/d31/l42 to d2/d6/dcc/l129 0 2024-02-16T22:19:02.589 INFO:tasks.workunit.client.0.smithi134.stdout:7/902: fsync d2/d6/d7d/d92/da5/d63/dc2/f118 0 2024-02-16T22:19:02.590 INFO:tasks.workunit.client.0.smithi134.stdout:8/993: creat d2/d132/f14f x:0 0 0 2024-02-16T22:19:02.590 INFO:tasks.workunit.client.0.smithi134.stdout:8/994: truncate d2/df/d18/db5/dbc/f12e 701873 0 2024-02-16T22:19:02.593 INFO:tasks.workunit.client.0.smithi134.stdout:4/865: unlink d0/d6/d8/d32/d63/l9b 0 2024-02-16T22:19:02.593 INFO:tasks.workunit.client.0.smithi134.stdout:4/866: dread - d0/d6/d22/d40/fd5 zero size 2024-02-16T22:19:02.595 INFO:tasks.workunit.client.0.smithi134.stdout:8/995: unlink d2/df/d18/d91/ffd 0 2024-02-16T22:19:02.596 INFO:tasks.workunit.client.0.smithi134.stdout:0/922: dwrite d2/dc/d2d/d34/f61 [4194304,4194304] 0 2024-02-16T22:19:02.596 INFO:tasks.workunit.client.0.smithi134.stdout:4/867: mkdir d0/d6/d22/d124 0 2024-02-16T22:19:02.596 INFO:tasks.workunit.client.0.smithi134.stdout:5/991: dwrite d2/d35/d36/f37 [4194304,4194304] 0 2024-02-16T22:19:02.597 INFO:tasks.workunit.client.0.smithi134.stdout:7/903: rmdir d2/d5/d19/d4a 39 2024-02-16T22:19:02.597 INFO:tasks.workunit.client.0.smithi134.stdout:7/904: read - d2/d6/d91/db3/fea zero size 2024-02-16T22:19:02.601 INFO:tasks.workunit.client.0.smithi134.stdout:4/868: unlink d0/d6/d22/d97/daf/lbc 0 2024-02-16T22:19:02.604 INFO:tasks.workunit.client.0.smithi134.stdout:0/923: creat d2/d20/d77/f137 x:0 0 0 2024-02-16T22:19:02.605 INFO:tasks.workunit.client.0.smithi134.stdout:5/992: write d2/d9/dc/d15/f31 [1151802,94859] 0 2024-02-16T22:19:02.606 INFO:tasks.workunit.client.0.smithi134.stdout:5/993: write d2/d35/d36/d3d/d9c/d4b/f108 [818805,77022] 0 2024-02-16T22:19:02.607 INFO:tasks.workunit.client.0.smithi134.stdout:0/924: mknod d2/d20/d77/dbf/c138 0 2024-02-16T22:19:02.613 INFO:tasks.workunit.client.0.smithi134.stdout:5/994: mkdir d2/d35/d36/d46/d68/d13a 0 2024-02-16T22:19:02.614 INFO:tasks.workunit.client.0.smithi134.stdout:5/995: write d2/d35/d36/f112 [607250,71834] 0 2024-02-16T22:19:02.614 INFO:tasks.workunit.client.0.smithi134.stdout:5/996: dread - d2/d9/dc/df7/d105/f12a zero size 2024-02-16T22:19:02.615 INFO:tasks.workunit.client.0.smithi134.stdout:0/925: rename d2/dc/d32/f42 to d2/dc/d32/d45/f139 0 2024-02-16T22:19:02.616 INFO:tasks.workunit.client.0.smithi134.stdout:5/997: symlink d2/d35/d36/d46/d68/l13b 0 2024-02-16T22:19:02.616 INFO:tasks.workunit.client.0.smithi134.stdout:5/998: readlink d2/d9/dc/df7/l12f 0 2024-02-16T22:19:02.618 INFO:tasks.workunit.client.0.smithi134.stdout:0/926: unlink d2/dc/d48/d12b/dc1/ld8 0 2024-02-16T22:19:02.623 INFO:tasks.workunit.client.0.smithi134.stdout:2/848: sync 2024-02-16T22:19:02.624 INFO:tasks.workunit.client.0.smithi134.stdout:2/849: stat df/d10/d30/d49/d82/d7a/fc7 0 2024-02-16T22:19:02.624 INFO:tasks.workunit.client.0.smithi134.stdout:2/850: creat df/d10/d15/d5a/f107 x:0 0 0 2024-02-16T22:19:02.625 INFO:tasks.workunit.client.0.smithi134.stdout:2/851: fdatasync df/d10/d30/d4d/d94/fe7 0 2024-02-16T22:19:02.625 INFO:tasks.workunit.client.0.smithi134.stdout:5/999: write d2/f6d [282623,34344] 0 2024-02-16T22:19:02.630 INFO:tasks.workunit.client.0.smithi134.stdout:7/905: dwrite d2/d5/d19/d4a/f7b [4194304,4194304] 0 2024-02-16T22:19:02.630 INFO:tasks.workunit.client.0.smithi134.stdout:4/869: dwrite d0/d6/d1e/d3b/f50 [4194304,4194304] 0 2024-02-16T22:19:02.630 INFO:tasks.workunit.client.0.smithi134.stdout:4/870: fdatasync d0/d6/d1e/d7c/dff/f92 0 2024-02-16T22:19:02.631 INFO:tasks.workunit.client.0.smithi134.stdout:8/996: dwrite d2/df/d18/dc5/d11e/d59/da0/f28 [0,4194304] 0 2024-02-16T22:19:02.631 INFO:tasks.workunit.client.0.smithi134.stdout:0/927: write d2/dc/dc4/f10b [3275909,29824] 0 2024-02-16T22:19:02.631 INFO:tasks.workunit.client.0.smithi134.stdout:0/928: getdents d2/dc/d97/df3 0 2024-02-16T22:19:02.631 INFO:tasks.workunit.client.0.smithi134.stdout:0/929: readlink d2/dc/d48/d12b/da7/ld1 0 2024-02-16T22:19:02.635 INFO:tasks.workunit.client.0.smithi134.stdout:7/906: rmdir d2/d5/d22/d83/d101 39 2024-02-16T22:19:02.638 INFO:tasks.workunit.client.0.smithi134.stdout:8/997: creat d2/df/d18/dc5/d11e/d59/da0/d142/f150 x:0 0 0 2024-02-16T22:19:02.639 INFO:tasks.workunit.client.0.smithi134.stdout:0/930: fdatasync d2/dc/f4f 0 2024-02-16T22:19:02.640 INFO:tasks.workunit.client.0.smithi134.stdout:4/871: write d0/d6/d1e/d7c/dff/d59/fa3 [3932253,92497] 0 2024-02-16T22:19:02.640 INFO:tasks.workunit.client.0.smithi134.stdout:4/872: write d0/d6/d8/d5e/fbd [1093558,115354] 0 2024-02-16T22:19:02.640 INFO:tasks.workunit.client.0.smithi134.stdout:4/873: dread - d0/d6/d44/fd3 zero size 2024-02-16T22:19:02.640 INFO:tasks.workunit.client.0.smithi134.stdout:4/874: write d0/d6/d22/d25/d2a/f123 [745388,61310] 0 2024-02-16T22:19:02.641 INFO:tasks.workunit.client.0.smithi134.stdout:8/998: truncate d2/df/d18/dc5/d11e/f42 2714990 0 2024-02-16T22:19:02.643 INFO:tasks.workunit.client.0.smithi134.stdout:0/931: rename d2/d20/d77/fa8 to d2/dc/d2d/d34/d87/f13a 0 2024-02-16T22:19:02.643 INFO:tasks.workunit.client.0.smithi134.stdout:0/932: readlink d2/d4b/d53/l7d 0 2024-02-16T22:19:02.643 INFO:tasks.workunit.client.0.smithi134.stdout:0/933: chown d2/d20/d7a/l9f 8662895 1 2024-02-16T22:19:02.646 INFO:tasks.workunit.client.0.smithi134.stdout:2/852: dwrite df/d10/f5d [0,4194304] 0 2024-02-16T22:19:02.646 INFO:tasks.workunit.client.0.smithi134.stdout:2/853: write df/d10/d15/d5a/d34/f88 [375102,3020] 0 2024-02-16T22:19:02.646 INFO:tasks.workunit.client.0.smithi134.stdout:2/854: fsync df/d10/d3a/f44 0 2024-02-16T22:19:02.647 INFO:tasks.workunit.client.0.smithi134.stdout:4/875: rename d0/d6/d8/d32/d63/d6c/fe2 to d0/d6/d44/da9/dc4/f125 0 2024-02-16T22:19:02.655 INFO:tasks.workunit.client.0.smithi134.stdout:7/907: dwrite d2/d5/d19/d84/d86/d93/dab/f3e [0,4194304] 0 2024-02-16T22:19:02.656 INFO:tasks.workunit.client.0.smithi134.stdout:8/999: rmdir d2 39 2024-02-16T22:19:02.657 INFO:tasks.workunit.client.0.smithi134.stdout:2/855: symlink df/d10/d3a/l108 0 2024-02-16T22:19:02.659 INFO:tasks.workunit.client.0.smithi134.stdout:0/934: rename d2/dc/f117 to d2/d20/d77/dbd/f13b 0 2024-02-16T22:19:02.659 INFO:tasks.workunit.client.0.smithi134.stdout:4/876: dread d0/d31/db8/f8b [0,4194304] 0 2024-02-16T22:19:02.660 INFO:tasks.workunit.client.0.smithi134.stdout:7/908: creat d2/d6/d7d/d92/da5/f12a x:0 0 0 2024-02-16T22:19:02.661 INFO:tasks.workunit.client.0.smithi134.stdout:2/856: rmdir df/d10/d15/da4/df5/df7 0 2024-02-16T22:19:02.661 INFO:tasks.workunit.client.0.smithi134.stdout:2/857: chown df/d10/d15/d5a 47 1 2024-02-16T22:19:02.661 INFO:tasks.workunit.client.0.smithi134.stdout:2/858: fsync df/d10/d15/f91 0 2024-02-16T22:19:02.662 INFO:tasks.workunit.client.0.smithi134.stdout:0/935: symlink d2/d20/d7a/l13c 0 2024-02-16T22:19:02.662 INFO:tasks.workunit.client.0.smithi134.stdout:4/877: getdents d0/d6/d8/da2/d76/df0 0 2024-02-16T22:19:02.663 INFO:tasks.workunit.client.0.smithi134.stdout:7/909: unlink d2/d6/d7d/d112/f6e 0 2024-02-16T22:19:02.664 INFO:tasks.workunit.client.0.smithi134.stdout:0/936: creat d2/dc/d2d/d133/f13d x:0 0 0 2024-02-16T22:19:02.664 INFO:tasks.workunit.client.0.smithi134.stdout:7/910: dread d2/d6/d17/ff8 [0,4194304] 0 2024-02-16T22:19:02.665 INFO:tasks.workunit.client.0.smithi134.stdout:7/911: fdatasync d2/d6/d91/db3/fb4 0 2024-02-16T22:19:02.665 INFO:tasks.workunit.client.0.smithi134.stdout:7/912: write d2/d6/d91/db3/fea [103587,23327] 0 2024-02-16T22:19:02.665 INFO:tasks.workunit.client.0.smithi134.stdout:4/878: creat d0/d6/d44/db0/f126 x:0 0 0 2024-02-16T22:19:02.665 INFO:tasks.workunit.client.0.smithi134.stdout:0/937: symlink d2/dc/d48/d12b/l13e 0 2024-02-16T22:19:02.665 INFO:tasks.workunit.client.0.smithi134.stdout:0/938: stat d2/dc/d97/l104 0 2024-02-16T22:19:02.666 INFO:tasks.workunit.client.0.smithi134.stdout:7/913: unlink d2/d6/d7d/lf6 0 2024-02-16T22:19:02.666 INFO:tasks.workunit.client.0.smithi134.stdout:7/914: chown d2/d6/d7d/d92/da5/f2a 923534316 1 2024-02-16T22:19:02.667 INFO:tasks.workunit.client.0.smithi134.stdout:7/915: creat d2/d5/d19/d84/d86/d93/f12b x:0 0 0 2024-02-16T22:19:02.667 INFO:tasks.workunit.client.0.smithi134.stdout:7/916: stat d2/d6/d7d/d112/d7f/f61 0 2024-02-16T22:19:02.668 INFO:tasks.workunit.client.0.smithi134.stdout:7/917: stat d2/d6/dcc/l103 0 2024-02-16T22:19:02.669 INFO:tasks.workunit.client.0.smithi134.stdout:7/918: symlink d2/d6/d7d/d92/l12c 0 2024-02-16T22:19:02.670 INFO:tasks.workunit.client.0.smithi134.stdout:7/919: truncate d2/d5/d22/f66 3497636 0 2024-02-16T22:19:02.670 INFO:tasks.workunit.client.0.smithi134.stdout:2/859: dread df/d41/f5e [8388608,4194304] 0 2024-02-16T22:19:02.670 INFO:tasks.workunit.client.0.smithi134.stdout:2/860: chown df/d10/d30/d49/d85/cd9 5308 1 2024-02-16T22:19:02.670 INFO:tasks.workunit.client.0.smithi134.stdout:0/939: read d2/dc/d2d/d34/f37 [3044138,58871] 0 2024-02-16T22:19:02.671 INFO:tasks.workunit.client.0.smithi134.stdout:7/920: mknod d2/d5/d19/d84/d86/d93/c12d 0 2024-02-16T22:19:02.671 INFO:tasks.workunit.client.0.smithi134.stdout:7/921: creat d2/d5/d22/d83/dce/f12e x:0 0 0 2024-02-16T22:19:02.671 INFO:tasks.workunit.client.0.smithi134.stdout:2/861: write df/d10/d30/d49/d85/def/dd6/fc1 [504822,110892] 0 2024-02-16T22:19:02.672 INFO:tasks.workunit.client.0.smithi134.stdout:2/862: creat df/d10/d3a/da9/dae/f109 x:0 0 0 2024-02-16T22:19:02.672 INFO:tasks.workunit.client.0.smithi134.stdout:2/863: fdatasync fb 0 2024-02-16T22:19:02.676 INFO:tasks.workunit.client.0.smithi134.stdout:4/879: write d0/d6/d8/d30/f42 [19152,25964] 0 2024-02-16T22:19:02.676 INFO:tasks.workunit.client.0.smithi134.stdout:7/922: truncate d2/f8d 1671556 0 2024-02-16T22:19:02.677 INFO:tasks.workunit.client.0.smithi134.stdout:4/880: mknod d0/d6/d22/d124/c127 0 2024-02-16T22:19:02.677 INFO:tasks.workunit.client.0.smithi134.stdout:4/881: creat d0/d6/d44/f128 x:0 0 0 2024-02-16T22:19:02.678 INFO:tasks.workunit.client.0.smithi134.stdout:7/923: mkdir d2/d5/d19/d84/d86/d93/dab/d40/d12f 0 2024-02-16T22:19:02.678 INFO:tasks.workunit.client.0.smithi134.stdout:7/924: dread - d2/d5/d19/d84/d86/d93/f12b zero size 2024-02-16T22:19:02.681 INFO:tasks.workunit.client.0.smithi134.stdout:4/882: rename d0/d6/d1e/d7c/dff/lb7 to d0/d6/d22/d97/l129 0 2024-02-16T22:19:02.682 INFO:tasks.workunit.client.0.smithi134.stdout:7/925: mknod d2/d5/d22/d26/dfe/c130 0 2024-02-16T22:19:02.683 INFO:tasks.workunit.client.0.smithi134.stdout:4/883: unlink d0/d6/d44/le4 0 2024-02-16T22:19:02.684 INFO:tasks.workunit.client.0.smithi134.stdout:7/926: write d2/f102 [922370,66103] 0 2024-02-16T22:19:02.685 INFO:tasks.workunit.client.0.smithi134.stdout:7/927: rmdir d2 39 2024-02-16T22:19:02.687 INFO:tasks.workunit.client.0.smithi134.stdout:2/864: write fb [1956534,29492] 0 2024-02-16T22:19:02.688 INFO:tasks.workunit.client.0.smithi134.stdout:4/884: rename d0/d6/d22/d97/daf to d0/d6/d44/db0/d12a 0 2024-02-16T22:19:02.688 INFO:tasks.workunit.client.0.smithi134.stdout:4/885: chown d0/d6/d22/d97/lb6 39846 1 2024-02-16T22:19:02.690 INFO:tasks.workunit.client.0.smithi134.stdout:4/886: truncate d0/d6/d1e/fdd 694163 0 2024-02-16T22:19:02.691 INFO:tasks.workunit.client.0.smithi134.stdout:7/928: dread d2/d6/d7d/d92/da5/d63/fc5 [0,4194304] 0 2024-02-16T22:19:02.692 INFO:tasks.workunit.client.0.smithi134.stdout:7/929: symlink d2/d6/d7d/d92/da5/l131 0 2024-02-16T22:19:02.692 INFO:tasks.workunit.client.0.smithi134.stdout:7/930: write d2/d6/d7d/d112/fb6 [286608,114962] 0 2024-02-16T22:19:02.694 INFO:tasks.workunit.client.0.smithi134.stdout:7/931: rmdir d2/d6/d91 39 2024-02-16T22:19:02.695 INFO:tasks.workunit.client.0.smithi134.stdout:7/932: rename d2/d5/d22/d83/dce/fd0 to d2/d6/d7d/d92/da5/d63/dc2/f132 0 2024-02-16T22:19:02.696 INFO:tasks.workunit.client.0.smithi134.stdout:7/933: creat d2/d5/d19/d4a/f133 x:0 0 0 2024-02-16T22:19:02.698 INFO:tasks.workunit.client.0.smithi134.stdout:7/934: rename d2/d6/d17/d31/d28/f6c to d2/d5/d19/d84/d86/d93/dab/d40/d12f/f134 0 2024-02-16T22:19:02.698 INFO:tasks.workunit.client.0.smithi134.stdout:7/935: read - d2/d6/d7d/d92/da5/f12a zero size 2024-02-16T22:19:02.698 INFO:tasks.workunit.client.0.smithi134.stdout:7/936: read - d2/d5/d19/d84/d86/d93/de8/f11d zero size 2024-02-16T22:19:02.698 INFO:tasks.workunit.client.0.smithi134.stdout:7/937: truncate d2/d5/d19/d84/d86/d93/dab/f3e 3160488 0 2024-02-16T22:19:02.698 INFO:tasks.workunit.client.0.smithi134.stdout:7/938: creat d2/d6/dcc/df7/f135 x:0 0 0 2024-02-16T22:19:02.700 INFO:tasks.workunit.client.0.smithi134.stdout:4/887: write d0/d6/d44/db0/fc3 [2717350,121213] 0 2024-02-16T22:19:02.744 INFO:tasks.workunit.client.0.smithi134.stdout:7/939: fsync d2/d5/f2d 0 2024-02-16T22:19:02.746 INFO:tasks.workunit.client.0.smithi134.stdout:7/940: write d2/fb [6800966,77959] 0 2024-02-16T22:19:02.746 INFO:tasks.workunit.client.0.smithi134.stdout:7/941: chown d2/d6/d7d/d112/d7f/lf2 32859 1 2024-02-16T22:19:02.748 INFO:tasks.workunit.client.0.smithi134.stdout:0/940: dwrite d2/f22 [0,4194304] 0 2024-02-16T22:19:02.748 INFO:tasks.workunit.client.0.smithi134.stdout:0/941: truncate d2/dc/d2d/d34/d87/fd7 267128 0 2024-02-16T22:19:02.749 INFO:tasks.workunit.client.0.smithi134.stdout:7/942: unlink d2/d6/f10a 0 2024-02-16T22:19:02.752 INFO:tasks.workunit.client.0.smithi134.stdout:0/942: mkdir d2/dc/d48/d12b/d13f 0 2024-02-16T22:19:02.752 INFO:tasks.workunit.client.0.smithi134.stdout:0/943: chown d2/dc/d48/d12b 7104412 1 2024-02-16T22:19:02.761 INFO:tasks.workunit.client.0.smithi134.stdout:7/943: creat d2/d6/d7d/d112/d7f/f136 x:0 0 0 2024-02-16T22:19:02.761 INFO:tasks.workunit.client.0.smithi134.stdout:7/944: fdatasync d2/d5/d19/f44 0 2024-02-16T22:19:02.770 INFO:tasks.workunit.client.0.smithi134.stdout:4/888: write d0/d6/d1e/fdd [576405,92391] 0 2024-02-16T22:19:02.771 INFO:tasks.workunit.client.0.smithi134.stdout:0/944: truncate d2/d20/d50/f9a 4867244 0 2024-02-16T22:19:02.772 INFO:tasks.workunit.client.0.smithi134.stdout:7/945: symlink d2/d5/d22/d26/dfe/l137 0 2024-02-16T22:19:02.772 INFO:tasks.workunit.client.0.smithi134.stdout:7/946: readlink d2/d6/d17/le 0 2024-02-16T22:19:02.774 INFO:tasks.workunit.client.0.smithi134.stdout:0/945: symlink d2/dc/d48/d12b/da7/dc2/def/l140 0 2024-02-16T22:19:02.776 INFO:tasks.workunit.client.0.smithi134.stdout:0/946: mkdir d2/dc/d48/d12b/d5e/d141 0 2024-02-16T22:19:02.781 INFO:tasks.workunit.client.0.smithi134.stdout:4/889: dread d0/d6/d1e/d39/f66 [8388608,4194304] 0 2024-02-16T22:19:02.782 INFO:tasks.workunit.client.0.smithi134.stdout:4/890: dread d0/d6/d44/db0/d12a/ff1 [0,4194304] 0 2024-02-16T22:19:02.782 INFO:tasks.workunit.client.0.smithi134.stdout:7/947: write d2/d5/d22/f66 [904984,88322] 0 2024-02-16T22:19:02.787 INFO:tasks.workunit.client.0.smithi134.stdout:2/865: sync 2024-02-16T22:19:02.792 INFO:tasks.workunit.client.0.smithi134.stdout:2/866: rmdir df/d10/d30 39 2024-02-16T22:19:02.792 INFO:tasks.workunit.client.0.smithi134.stdout:7/948: fsync d2/d5/d22/f66 0 2024-02-16T22:19:02.792 INFO:tasks.workunit.client.0.smithi134.stdout:2/867: write df/d10/d15/d5a/de8/f92 [1754157,89923] 0 2024-02-16T22:19:02.793 INFO:tasks.workunit.client.0.smithi134.stdout:0/947: dwrite d2/dc/d48/f134 [0,4194304] 0 2024-02-16T22:19:02.793 INFO:tasks.workunit.client.0.smithi134.stdout:4/891: dread d0/d31/db8/f28 [0,4194304] 0 2024-02-16T22:19:02.795 INFO:tasks.workunit.client.0.smithi134.stdout:7/949: rename d2/d5/d19/d84/d86/d93/dab/f3e to d2/d6/d17/f138 0 2024-02-16T22:19:02.797 INFO:tasks.workunit.client.0.smithi134.stdout:7/950: dread d2/d6/d7d/d92/da5/d63/dc2/f132 [0,4194304] 0 2024-02-16T22:19:02.797 INFO:tasks.workunit.client.0.smithi134.stdout:7/951: fsync d2/d6/d17/f56 0 2024-02-16T22:19:02.797 INFO:tasks.workunit.client.0.smithi134.stdout:7/952: fdatasync d2/d6/d7d/d9e/fc9 0 2024-02-16T22:19:02.799 INFO:tasks.workunit.client.0.smithi134.stdout:7/953: dread d2/d6/d7d/d9e/fb0 [0,4194304] 0 2024-02-16T22:19:02.799 INFO:tasks.workunit.client.0.smithi134.stdout:0/948: truncate d2/dc/f2b 3539011 0 2024-02-16T22:19:02.799 INFO:tasks.workunit.client.0.smithi134.stdout:0/949: fdatasync d2/d20/f29 0 2024-02-16T22:19:02.801 INFO:tasks.workunit.client.0.smithi134.stdout:7/954: unlink d2/d5/d22/d26/dfe/c130 0 2024-02-16T22:19:02.801 INFO:tasks.workunit.client.0.smithi134.stdout:7/955: write d2/d6/f43 [4964975,27278] 0 2024-02-16T22:19:02.803 INFO:tasks.workunit.client.0.smithi134.stdout:7/956: creat d2/d5/d19/d84/d86/d93/dab/f139 x:0 0 0 2024-02-16T22:19:02.828 INFO:tasks.workunit.client.0.smithi134.stdout:4/892: dwrite d0/d6/d8/d5e/ff2 [0,4194304] 0 2024-02-16T22:19:02.828 INFO:tasks.workunit.client.0.smithi134.stdout:4/893: getdents d0/d6/d1e/d10c 0 2024-02-16T22:19:02.828 INFO:tasks.workunit.client.0.smithi134.stdout:2/868: dwrite df/d10/d15/d5a/f107 [0,4194304] 0 2024-02-16T22:19:02.828 INFO:tasks.workunit.client.0.smithi134.stdout:2/869: chown df/d10/d30/ldc 759070 1 2024-02-16T22:19:02.830 INFO:tasks.workunit.client.0.smithi134.stdout:4/894: mkdir d0/d6/d1e/d39/d4e/d12b 0 2024-02-16T22:19:02.832 INFO:tasks.workunit.client.0.smithi134.stdout:0/950: dwrite d2/d20/d7a/d7e/ff7 [4194304,4194304] 0 2024-02-16T22:19:02.832 INFO:tasks.workunit.client.0.smithi134.stdout:0/951: fsync d2/d20/f29 0 2024-02-16T22:19:02.832 INFO:tasks.workunit.client.0.smithi134.stdout:7/957: dwrite d2/f1a [0,4194304] 0 2024-02-16T22:19:02.832 INFO:tasks.workunit.client.0.smithi134.stdout:7/958: fsync d2/d6/d7d/d9e/fe7 0 2024-02-16T22:19:02.834 INFO:tasks.workunit.client.0.smithi134.stdout:2/870: mknod df/d10/d30/d4d/d94/da3/c10a 0 2024-02-16T22:19:02.837 INFO:tasks.workunit.client.0.smithi134.stdout:0/952: mkdir d2/d20/d77/dbd/dd9/d142 0 2024-02-16T22:19:02.837 INFO:tasks.workunit.client.0.smithi134.stdout:0/953: dread - d2/dc/d2d/fec zero size 2024-02-16T22:19:02.838 INFO:tasks.workunit.client.0.smithi134.stdout:2/871: dread df/d10/d30/d49/d82/d1b/f22 [0,4194304] 0 2024-02-16T22:19:02.840 INFO:tasks.workunit.client.0.smithi134.stdout:2/872: mknod df/d10/d15/d5a/de8/c10b 0 2024-02-16T22:19:02.842 INFO:tasks.workunit.client.0.smithi134.stdout:0/954: link d2/d20/d7a/d7e/l98 d2/d20/d77/d85/de2/d12f/l143 0 2024-02-16T22:19:02.842 INFO:tasks.workunit.client.0.smithi134.stdout:0/955: read d2/f6c [408922,21962] 0 2024-02-16T22:19:02.842 INFO:tasks.workunit.client.0.smithi134.stdout:0/956: write d2/dc/d32/d45/f10a [107045,121896] 0 2024-02-16T22:19:02.844 INFO:tasks.workunit.client.0.smithi134.stdout:2/873: creat df/d10/d30/d49/d85/def/f10c x:0 0 0 2024-02-16T22:19:02.844 INFO:tasks.workunit.client.0.smithi134.stdout:2/874: chown df/d10/d30/d4d/d94/da3/f61 225 1 2024-02-16T22:19:02.844 INFO:tasks.workunit.client.0.smithi134.stdout:2/875: dread - df/d10/d15/d5a/d34/fa8 zero size 2024-02-16T22:19:02.844 INFO:tasks.workunit.client.0.smithi134.stdout:7/959: dread d2/d6/d7d/d112/d7f/f61 [0,4194304] 0 2024-02-16T22:19:02.850 INFO:tasks.workunit.client.0.smithi134.stdout:0/957: dread d2/dc/f2b [0,4194304] 0 2024-02-16T22:19:02.853 INFO:tasks.workunit.client.0.smithi134.stdout:2/876: dread df/d10/d30/d49/d82/d1b/f2f [0,4194304] 0 2024-02-16T22:19:02.853 INFO:tasks.workunit.client.0.smithi134.stdout:4/895: dwrite d0/d6/d44/ffc [0,4194304] 0 2024-02-16T22:19:02.854 INFO:tasks.workunit.client.0.smithi134.stdout:2/877: creat df/d10/d30/d49/f10d x:0 0 0 2024-02-16T22:19:02.854 INFO:tasks.workunit.client.0.smithi134.stdout:2/878: dread - df/d10/d30/d49/d82/d1b/fc3 zero size 2024-02-16T22:19:02.855 INFO:tasks.workunit.client.0.smithi134.stdout:7/960: write d2/d6/d7d/d92/da5/d63/f72 [2684847,55004] 0 2024-02-16T22:19:02.855 INFO:tasks.workunit.client.0.smithi134.stdout:4/896: truncate d0/d6/d8/d32/d63/d6c/f83 1792703 0 2024-02-16T22:19:02.856 INFO:tasks.workunit.client.0.smithi134.stdout:2/879: rmdir df/d10/d30/d4d 39 2024-02-16T22:19:02.857 INFO:tasks.workunit.client.0.smithi134.stdout:2/880: chown df/d10/d30/d49/d82/d1b/c8d 23 1 2024-02-16T22:19:02.857 INFO:tasks.workunit.client.0.smithi134.stdout:7/961: mkdir d2/d6/d7d/d9e/d13a 0 2024-02-16T22:19:02.875 INFO:tasks.workunit.client.0.smithi134.stdout:2/881: dread df/d10/d15/ffd [0,4194304] 0 2024-02-16T22:19:02.875 INFO:tasks.workunit.client.0.smithi134.stdout:0/958: dwrite d2/d20/d77/d85/db6/d108/f121 [0,4194304] 0 2024-02-16T22:19:02.875 INFO:tasks.workunit.client.0.smithi134.stdout:2/882: fdatasync df/d10/d3a/fc5 0 2024-02-16T22:19:02.875 INFO:tasks.workunit.client.0.smithi134.stdout:2/883: write df/d10/d30/d49/d82/d1b/f2f [5995875,96570] 0 2024-02-16T22:19:02.875 INFO:tasks.workunit.client.0.smithi134.stdout:0/959: write d2/dc/f44 [4717448,128373] 0 2024-02-16T22:19:02.878 INFO:tasks.workunit.client.0.smithi134.stdout:2/884: creat df/d10/d30/d49/d82/f10e x:0 0 0 2024-02-16T22:19:02.879 INFO:tasks.workunit.client.0.smithi134.stdout:2/885: unlink df/d10/d15/da4/df5/c102 0 2024-02-16T22:19:02.879 INFO:tasks.workunit.client.0.smithi134.stdout:2/886: creat df/d10/d3a/da9/dae/f10f x:0 0 0 2024-02-16T22:19:02.879 INFO:tasks.workunit.client.0.smithi134.stdout:2/887: readlink df/d10/d3a/da9/ld5 0 2024-02-16T22:19:02.883 INFO:tasks.workunit.client.0.smithi134.stdout:4/897: dwrite d0/d6/d44/da9/fe7 [0,4194304] 0 2024-02-16T22:19:02.884 INFO:tasks.workunit.client.0.smithi134.stdout:7/962: dwrite d2/d6/fa4 [0,4194304] 0 2024-02-16T22:19:02.886 INFO:tasks.workunit.client.0.smithi134.stdout:7/963: symlink d2/d5/d19/d84/d86/d93/l13b 0 2024-02-16T22:19:02.887 INFO:tasks.workunit.client.0.smithi134.stdout:7/964: creat d2/d6/d17/d31/f13c x:0 0 0 2024-02-16T22:19:02.887 INFO:tasks.workunit.client.0.smithi134.stdout:7/965: dread - d2/d6/d7d/d92/fc8 zero size 2024-02-16T22:19:02.888 INFO:tasks.workunit.client.0.smithi134.stdout:7/966: mknod d2/d6/d17/c13d 0 2024-02-16T22:19:02.888 INFO:tasks.workunit.client.0.smithi134.stdout:7/967: creat d2/d6/dcc/df7/f13e x:0 0 0 2024-02-16T22:19:02.888 INFO:tasks.workunit.client.0.smithi134.stdout:7/968: write d2/d5/d19/d84/d86/d93/de8/f11d [433473,12177] 0 2024-02-16T22:19:02.890 INFO:tasks.workunit.client.0.smithi134.stdout:7/969: unlink d2/d6/d7d/d92/da5/d63/dc2/dd1/l120 0 2024-02-16T22:19:02.890 INFO:tasks.workunit.client.0.smithi134.stdout:7/970: creat d2/d5/d19/d84/d86/d93/dab/d40/df1/d104/d10e/f13f x:0 0 0 2024-02-16T22:19:02.890 INFO:tasks.workunit.client.0.smithi134.stdout:7/971: chown d2/d6/d7d/d92/fc8 1 1 2024-02-16T22:19:02.892 INFO:tasks.workunit.client.0.smithi134.stdout:7/972: rename d2/d6/f43 to d2/d5/d19/d84/d86/d107/f140 0 2024-02-16T22:19:02.892 INFO:tasks.workunit.client.0.smithi134.stdout:7/973: write d2/d5/d19/d84/d86/d93/dab/d40/df1/d104/d10e/f122 [743849,41690] 0 2024-02-16T22:19:02.892 INFO:tasks.workunit.client.0.smithi134.stdout:7/974: truncate d2/d6/d7d/d92/da5/d63/fc5 2325233 0 2024-02-16T22:19:02.893 INFO:tasks.workunit.client.0.smithi134.stdout:0/960: dread d2/dc/d2d/d34/fad [0,4194304] 0 2024-02-16T22:19:02.893 INFO:tasks.workunit.client.0.smithi134.stdout:7/975: mkdir d2/d5/d19/d141 0 2024-02-16T22:19:02.893 INFO:tasks.workunit.client.0.smithi134.stdout:0/961: symlink d2/dc/dc4/ddc/l144 0 2024-02-16T22:19:02.893 INFO:tasks.workunit.client.0.smithi134.stdout:0/962: dread - d2/d20/d77/d85/db6/d108/d112/f12d zero size 2024-02-16T22:19:02.895 INFO:tasks.workunit.client.0.smithi134.stdout:7/976: rename d2/d5/d19/d84/d86/d93/f12b to d2/d6/d7d/d92/dd5/f142 0 2024-02-16T22:19:02.895 INFO:tasks.workunit.client.0.smithi134.stdout:7/977: stat d2/d5/d22/d26/cc4 0 2024-02-16T22:19:02.895 INFO:tasks.workunit.client.0.smithi134.stdout:7/978: creat d2/d6/d7d/d112/f143 x:0 0 0 2024-02-16T22:19:02.896 INFO:tasks.workunit.client.0.smithi134.stdout:7/979: write d2/f116 [807714,39113] 0 2024-02-16T22:19:02.901 INFO:tasks.workunit.client.0.smithi134.stdout:2/888: dwrite df/d6f/dd2/ffc [0,4194304] 0 2024-02-16T22:19:02.904 INFO:tasks.workunit.client.0.smithi134.stdout:2/889: creat df/d10/d30/d49/d82/d1b/f110 x:0 0 0 2024-02-16T22:19:02.904 INFO:tasks.workunit.client.0.smithi134.stdout:2/890: dread - df/d10/d15/f91 zero size 2024-02-16T22:19:02.904 INFO:tasks.workunit.client.0.smithi134.stdout:2/891: write df/d10/d30/d4d/f52 [4098670,96269] 0 2024-02-16T22:19:02.906 INFO:tasks.workunit.client.0.smithi134.stdout:2/892: truncate df/d10/d30/d49/d82/d1b/f22 820943 0 2024-02-16T22:19:02.906 INFO:tasks.workunit.client.0.smithi134.stdout:2/893: chown df/d41/f6a 3818 1 2024-02-16T22:19:02.908 INFO:tasks.workunit.client.0.smithi134.stdout:2/894: creat df/d10/d30/f111 x:0 0 0 2024-02-16T22:19:02.909 INFO:tasks.workunit.client.0.smithi134.stdout:2/895: mknod df/d10/d3a/da9/c112 0 2024-02-16T22:19:02.910 INFO:tasks.workunit.client.0.smithi134.stdout:4/898: dwrite d0/d6/d8/da2/d76/df6/f112 [0,4194304] 0 2024-02-16T22:19:02.913 INFO:tasks.workunit.client.0.smithi134.stdout:4/899: creat d0/d6/d1e/f12c x:0 0 0 2024-02-16T22:19:02.914 INFO:tasks.workunit.client.0.smithi134.stdout:4/900: mknod d0/d31/db8/d86/c12d 0 2024-02-16T22:19:02.915 INFO:tasks.workunit.client.0.smithi134.stdout:4/901: mkdir d0/d6/d1e/d7c/d12e 0 2024-02-16T22:19:02.922 INFO:tasks.workunit.client.0.smithi134.stdout:0/963: dwrite d2/dc/f2b [0,4194304] 0 2024-02-16T22:19:02.922 INFO:tasks.workunit.client.0.smithi134.stdout:0/964: truncate d2/dc/d48/d12b/f130 732549 0 2024-02-16T22:19:02.924 INFO:tasks.workunit.client.0.smithi134.stdout:7/980: dwrite d2/d6/d91/db3/fea [0,4194304] 0 2024-02-16T22:19:02.925 INFO:tasks.workunit.client.0.smithi134.stdout:0/965: rename d2/dc/f1e to d2/dc/d32/f145 0 2024-02-16T22:19:02.925 INFO:tasks.workunit.client.0.smithi134.stdout:2/896: dwrite df/d10/d30/d49/d82/d1b/f64 [0,4194304] 0 2024-02-16T22:19:02.925 INFO:tasks.workunit.client.0.smithi134.stdout:2/897: read df/d10/d15/d5a/fd1 [245638,57099] 0 2024-02-16T22:19:02.928 INFO:tasks.workunit.client.0.smithi134.stdout:7/981: symlink d2/d5/d19/d84/d86/d93/dab/d40/df1/l144 0 2024-02-16T22:19:02.929 INFO:tasks.workunit.client.0.smithi134.stdout:4/902: dread d0/d31/db8/d46/fbb [0,4194304] 0 2024-02-16T22:19:02.930 INFO:tasks.workunit.client.0.smithi134.stdout:0/966: rmdir d2/d56 39 2024-02-16T22:19:02.934 INFO:tasks.workunit.client.0.smithi134.stdout:4/903: symlink d0/d6/d44/l12f 0 2024-02-16T22:19:02.935 INFO:tasks.workunit.client.0.smithi134.stdout:0/967: rmdir d2/db7 39 2024-02-16T22:19:02.938 INFO:tasks.workunit.client.0.smithi134.stdout:7/982: link d2/d6/d7d/d92/l12c d2/d5/d19/d84/d86/d93/dab/l145 0 2024-02-16T22:19:02.941 INFO:tasks.workunit.client.0.smithi134.stdout:4/904: symlink d0/d6/d22/d124/l130 0 2024-02-16T22:19:02.942 INFO:tasks.workunit.client.0.smithi134.stdout:4/905: readlink d0/d31/l10e 0 2024-02-16T22:19:02.942 INFO:tasks.workunit.client.0.smithi134.stdout:0/968: creat d2/d20/d77/dbd/f146 x:0 0 0 2024-02-16T22:19:02.942 INFO:tasks.workunit.client.0.smithi134.stdout:0/969: chown d2/dc/d32/d45/fc6 5 1 2024-02-16T22:19:02.944 INFO:tasks.workunit.client.0.smithi134.stdout:4/906: symlink d0/d6/d1e/d7c/dff/l131 0 2024-02-16T22:19:02.945 INFO:tasks.workunit.client.0.smithi134.stdout:2/898: dwrite df/d10/d30/d49/f57 [0,4194304] 0 2024-02-16T22:19:02.951 INFO:tasks.workunit.client.0.smithi134.stdout:2/899: truncate df/d10/d30/d4d/d94/da3/f84 4162165 0 2024-02-16T22:19:02.956 INFO:tasks.workunit.client.0.smithi134.stdout:4/907: read d0/d6/d8/d5e/f96 [571693,13435] 0 2024-02-16T22:19:02.956 INFO:tasks.workunit.client.0.smithi134.stdout:4/908: read - d0/d6/d8/da2/d76/fde zero size 2024-02-16T22:19:02.958 INFO:tasks.workunit.client.0.smithi134.stdout:4/909: write d0/d6/d8/d32/d68/fb9 [5062616,37267] 0 2024-02-16T22:19:02.958 INFO:tasks.workunit.client.0.smithi134.stdout:4/910: stat d0/d6/d1e/d7c/dff 0 2024-02-16T22:19:03.144 INFO:tasks.workunit.client.0.smithi134.stdout:2/900: unlink df/d10/d30/d49/d82/d1b/fc3 0 2024-02-16T22:19:03.144 INFO:tasks.workunit.client.0.smithi134.stdout:2/901: truncate df/d10/d15/d5a/fd1 1135579 0 2024-02-16T22:19:03.145 INFO:tasks.workunit.client.0.smithi134.stdout:4/911: symlink d0/d6/d8/da2/d76/l132 0 2024-02-16T22:19:03.145 INFO:tasks.workunit.client.0.smithi134.stdout:4/912: write d0/d31/db8/d86/f9f [2485118,35461] 0 2024-02-16T22:19:03.153 INFO:tasks.workunit.client.0.smithi134.stdout:0/970: truncate d2/d20/d7a/d7e/ff7 8122217 0 2024-02-16T22:19:03.156 INFO:tasks.workunit.client.0.smithi134.stdout:0/971: unlink d2/d20/d7a/f86 0 2024-02-16T22:19:03.156 INFO:tasks.workunit.client.0.smithi134.stdout:0/972: dread - d2/dc/d48/d12b/d5e/dff/f123 zero size 2024-02-16T22:19:03.159 INFO:tasks.workunit.client.0.smithi134.stdout:0/973: rename d2/d4b/l4d to d2/dc/da0/l147 0 2024-02-16T22:19:03.160 INFO:tasks.workunit.client.0.smithi134.stdout:0/974: rmdir d2 39 2024-02-16T22:19:03.161 INFO:tasks.workunit.client.0.smithi134.stdout:0/975: dread d2/dc/d2d/d34/d87/fd7 [0,4194304] 0 2024-02-16T22:19:03.162 INFO:tasks.workunit.client.0.smithi134.stdout:0/976: symlink d2/d20/d77/d85/de2/l148 0 2024-02-16T22:19:03.164 INFO:tasks.workunit.client.0.smithi134.stdout:0/977: link d2/dc/d48/d12b/dc1/f113 d2/dc/d48/d12b/d13f/f149 0 2024-02-16T22:19:03.165 INFO:tasks.workunit.client.0.smithi134.stdout:0/978: creat d2/dc/dc4/f14a x:0 0 0 2024-02-16T22:19:03.166 INFO:tasks.workunit.client.0.smithi134.stdout:0/979: symlink d2/dc/d48/d12b/da7/l14b 0 2024-02-16T22:19:03.167 INFO:tasks.workunit.client.0.smithi134.stdout:2/902: dwrite df/d10/d30/d49/d82/f79 [0,4194304] 0 2024-02-16T22:19:03.167 INFO:tasks.workunit.client.0.smithi134.stdout:2/903: dread - df/d10/d3a/da9/dae/fe9 zero size 2024-02-16T22:19:03.167 INFO:tasks.workunit.client.0.smithi134.stdout:2/904: write df/d10/d30/fac [2864247,130880] 0 2024-02-16T22:19:03.168 INFO:tasks.workunit.client.0.smithi134.stdout:2/905: rename df/d10/d30/f6c to df/d10/d30/d49/f113 0 2024-02-16T22:19:03.170 INFO:tasks.workunit.client.0.smithi134.stdout:7/983: sync 2024-02-16T22:19:03.177 INFO:tasks.workunit.client.0.smithi134.stdout:4/913: dwrite d0/f11 [0,4194304] 0 2024-02-16T22:19:03.180 INFO:tasks.workunit.client.0.smithi134.stdout:4/914: rmdir d0/d6/d44/db0 39 2024-02-16T22:19:03.180 INFO:tasks.workunit.client.0.smithi134.stdout:4/915: stat d0/f2 0 2024-02-16T22:19:03.180 INFO:tasks.workunit.client.0.smithi134.stdout:4/916: chown d0/d6/d22/d40/c8c 246786830 1 2024-02-16T22:19:03.180 INFO:tasks.workunit.client.0.smithi134.stdout:4/917: truncate d0/d6/d8/da2/d76/f105 659268 0 2024-02-16T22:19:03.182 INFO:tasks.workunit.client.0.smithi134.stdout:7/984: dread d2/d6/d7d/d9e/fc9 [0,4194304] 0 2024-02-16T22:19:03.186 INFO:tasks.workunit.client.0.smithi134.stdout:7/985: link d2/d5/c6d d2/c146 0 2024-02-16T22:19:03.186 INFO:tasks.workunit.client.0.smithi134.stdout:7/986: chown d2/d6/lfc 3237 1 2024-02-16T22:19:03.186 INFO:tasks.workunit.client.0.smithi134.stdout:7/987: write d2/d6/d17/ff8 [1420527,38651] 0 2024-02-16T22:19:03.186 INFO:tasks.workunit.client.0.smithi134.stdout:0/980: write d2/dc/d2d/d34/f61 [4984800,8725] 0 2024-02-16T22:19:03.187 INFO:tasks.workunit.client.0.smithi134.stdout:7/988: symlink d2/d5/d22/d26/dfe/l147 0 2024-02-16T22:19:03.187 INFO:tasks.workunit.client.0.smithi134.stdout:2/906: dwrite df/d10/f4b [4194304,4194304] 0 2024-02-16T22:19:03.187 INFO:tasks.workunit.client.0.smithi134.stdout:7/989: read d2/d6/f16 [1288578,100432] 0 2024-02-16T22:19:03.188 INFO:tasks.workunit.client.0.smithi134.stdout:0/981: creat d2/db7/f14c x:0 0 0 2024-02-16T22:19:03.196 INFO:tasks.workunit.client.0.smithi134.stdout:2/907: creat df/d10/d30/da2/dca/f114 x:0 0 0 2024-02-16T22:19:03.197 INFO:tasks.workunit.client.0.smithi134.stdout:7/990: creat d2/d6/d7d/d119/f148 x:0 0 0 2024-02-16T22:19:03.197 INFO:tasks.workunit.client.0.smithi134.stdout:7/991: readlink d2/d5/d22/d26/dd8/l11b 0 2024-02-16T22:19:03.197 INFO:tasks.workunit.client.0.smithi134.stdout:7/992: chown d2/d5/d22/l71 49 1 2024-02-16T22:19:03.198 INFO:tasks.workunit.client.0.smithi134.stdout:2/908: mkdir df/d10/d15/d5a/d34/d115 0 2024-02-16T22:19:03.198 INFO:tasks.workunit.client.0.smithi134.stdout:2/909: creat df/d41/f116 x:0 0 0 2024-02-16T22:19:03.199 INFO:tasks.workunit.client.0.smithi134.stdout:2/910: creat df/d10/d30/d49/d82/f117 x:0 0 0 2024-02-16T22:19:03.200 INFO:tasks.workunit.client.0.smithi134.stdout:7/993: mkdir d2/d5/d19/d84/d86/d93/d149 0 2024-02-16T22:19:03.203 INFO:tasks.workunit.client.0.smithi134.stdout:2/911: unlink df/d10/d3a/f44 0 2024-02-16T22:19:03.203 INFO:tasks.workunit.client.0.smithi134.stdout:2/912: fdatasync df/d10/d15/f3f 0 2024-02-16T22:19:03.216 INFO:tasks.workunit.client.0.smithi134.stdout:2/913: dread df/f3c [0,4194304] 0 2024-02-16T22:19:03.216 INFO:tasks.workunit.client.0.smithi134.stdout:2/914: chown df/d10/d30/d49/f4f 1 1 2024-02-16T22:19:03.217 INFO:tasks.workunit.client.0.smithi134.stdout:0/982: dwrite d2/dc/d48/f134 [0,4194304] 0 2024-02-16T22:19:03.217 INFO:tasks.workunit.client.0.smithi134.stdout:7/994: dwrite d2/d6/d7d/d92/da5/d63/f72 [0,4194304] 0 2024-02-16T22:19:03.217 INFO:tasks.workunit.client.0.smithi134.stdout:0/983: fdatasync d2/f22 0 2024-02-16T22:19:03.217 INFO:tasks.workunit.client.0.smithi134.stdout:0/984: write d2/dc/d2d/fec [215313,70649] 0 2024-02-16T22:19:03.218 INFO:tasks.workunit.client.0.smithi134.stdout:7/995: symlink d2/d5/d22/d26/dfe/l14a 0 2024-02-16T22:19:03.218 INFO:tasks.workunit.client.0.smithi134.stdout:7/996: fsync d2/d5/f2d 0 2024-02-16T22:19:03.218 INFO:tasks.workunit.client.0.smithi134.stdout:0/985: chown d2/dc/l2f 16 1 2024-02-16T22:19:03.227 INFO:tasks.workunit.client.0.smithi134.stdout:2/915: dread df/d10/d15/d5a/f8c [4194304,4194304] 0 2024-02-16T22:19:03.228 INFO:tasks.workunit.client.0.smithi134.stdout:0/986: dread d2/dc/f44 [0,4194304] 0 2024-02-16T22:19:03.229 INFO:tasks.workunit.client.0.smithi134.stdout:2/916: rename df/d10/d30/d4d/d94/da3 to df/d10/d30/d49/d85/def/d118 0 2024-02-16T22:19:03.235 INFO:tasks.workunit.client.0.smithi134.stdout:0/987: write d2/d20/d50/f9b [496632,52125] 0 2024-02-16T22:19:03.235 INFO:tasks.workunit.client.0.smithi134.stdout:0/988: write d2/dc/d32/d45/fb2 [493978,121335] 0 2024-02-16T22:19:03.236 INFO:tasks.workunit.client.0.smithi134.stdout:7/997: dwrite d2/d6/d91/db3/fe9 [0,4194304] 0 2024-02-16T22:19:03.236 INFO:tasks.workunit.client.0.smithi134.stdout:0/989: symlink d2/dc/d48/d12b/dc1/l14d 0 2024-02-16T22:19:03.237 INFO:tasks.workunit.client.0.smithi134.stdout:7/998: chown d2/f4 99712659 1 2024-02-16T22:19:03.238 INFO:tasks.workunit.client.0.smithi134.stdout:0/990: mkdir d2/d20/d77/db9/d14e 0 2024-02-16T22:19:03.242 INFO:tasks.workunit.client.0.smithi134.stdout:2/917: write df/d10/d30/d4d/d94/fa1 [1905505,92417] 0 2024-02-16T22:19:03.244 INFO:tasks.workunit.client.0.smithi134.stdout:7/999: dread d2/ff [0,4194304] 0 2024-02-16T22:19:03.251 INFO:tasks.workunit.client.0.smithi134.stdout:2/918: write df/d10/d30/f9a [182538,34383] 0 2024-02-16T22:19:03.253 INFO:tasks.workunit.client.0.smithi134.stdout:2/919: dread df/d10/d30/d49/d85/def/d118/f63 [0,4194304] 0 2024-02-16T22:19:03.253 INFO:tasks.workunit.client.0.smithi134.stdout:2/920: rmdir df/d10/d30/d49/d82/d7a 39 2024-02-16T22:19:03.256 INFO:tasks.workunit.client.0.smithi134.stdout:0/991: dwrite d2/dc/dc4/f10b [0,4194304] 0 2024-02-16T22:19:03.256 INFO:tasks.workunit.client.0.smithi134.stdout:0/992: write d2/dc/d48/d12b/da7/dc2/fe5 [955641,26233] 0 2024-02-16T22:19:03.263 INFO:tasks.workunit.client.0.smithi134.stdout:0/993: dread d2/dc/d48/d12b/da7/ff4 [0,4194304] 0 2024-02-16T22:19:03.265 INFO:tasks.workunit.client.0.smithi134.stdout:2/921: dread df/d10/d15/d5a/f107 [0,4194304] 0 2024-02-16T22:19:03.267 INFO:tasks.workunit.client.0.smithi134.stdout:2/922: link df/d10/d15/d5a/fd1 df/d10/da6/f119 0 2024-02-16T22:19:03.268 INFO:tasks.workunit.client.0.smithi134.stdout:2/923: truncate df/d10/d15/f66 975397 0 2024-02-16T22:19:03.278 INFO:tasks.workunit.client.0.smithi134.stdout:4/918: sync 2024-02-16T22:19:03.279 INFO:tasks.workunit.client.0.smithi134.stdout:4/919: truncate d0/d6/d44/db0/d12a/f11c 950786 0 2024-02-16T22:19:03.279 INFO:tasks.workunit.client.0.smithi134.stdout:4/920: symlink d0/d6/d1e/l133 0 2024-02-16T22:19:03.282 INFO:tasks.workunit.client.0.smithi134.stdout:4/921: rename d0/d6/d8/d32/d68/la6 to d0/d6/d1e/d7c/dff/d59/l134 0 2024-02-16T22:19:03.282 INFO:tasks.workunit.client.0.smithi134.stdout:4/922: chown d0/d31/db8/f17 11 1 2024-02-16T22:19:03.282 INFO:tasks.workunit.client.0.smithi134.stdout:4/923: fdatasync d0/d31/db8/d1a/f1d 0 2024-02-16T22:19:03.283 INFO:tasks.workunit.client.0.smithi134.stdout:4/924: getdents d0/d6/d44/da9 0 2024-02-16T22:19:03.283 INFO:tasks.workunit.client.0.smithi134.stdout:4/925: creat d0/d6/d1e/d3b/f135 x:0 0 0 2024-02-16T22:19:03.284 INFO:tasks.workunit.client.0.smithi134.stdout:4/926: unlink d0/d6/d44/ffc 0 2024-02-16T22:19:03.285 INFO:tasks.workunit.client.0.smithi134.stdout:4/927: rename d0/d6/d8/d5e/ff2 to d0/d31/db8/d86/f136 0 2024-02-16T22:19:03.288 INFO:tasks.workunit.client.0.smithi134.stdout:2/924: dwrite df/d10/da6/f119 [0,4194304] 0 2024-02-16T22:19:03.288 INFO:tasks.workunit.client.0.smithi134.stdout:0/994: dwrite d2/dc/d48/d12b/f69 [0,4194304] 0 2024-02-16T22:19:03.288 INFO:tasks.workunit.client.0.smithi134.stdout:0/995: readlink d2/dc/d48/l125 0 2024-02-16T22:19:03.288 INFO:tasks.workunit.client.0.smithi134.stdout:0/996: stat d2/dc/dc4/ddc/f105 0 2024-02-16T22:19:03.290 INFO:tasks.workunit.client.0.smithi134.stdout:0/997: truncate d2/dc/d32/f145 3197060 0 2024-02-16T22:19:03.291 INFO:tasks.workunit.client.0.smithi134.stdout:0/998: chown d2/db7/lbe 59622 1 2024-02-16T22:19:03.294 INFO:tasks.workunit.client.0.smithi134.stdout:4/928: dread d0/d6/d1e/d3b/fac [0,4194304] 0 2024-02-16T22:19:03.301 INFO:tasks.workunit.client.0.smithi134.stdout:0/999: read d2/dc/f15 [193894,66788] 0 2024-02-16T22:19:03.302 INFO:tasks.workunit.client.0.smithi134.stdout:4/929: write d0/d6/d1e/d7c/dff/f92 [3958811,130255] 0 2024-02-16T22:19:03.304 INFO:tasks.workunit.client.0.smithi134.stdout:4/930: mknod d0/d6/d8/d30/c137 0 2024-02-16T22:19:03.304 INFO:tasks.workunit.client.0.smithi134.stdout:4/931: readlink d0/d6/d22/d124/l130 0 2024-02-16T22:19:03.304 INFO:tasks.workunit.client.0.smithi134.stdout:4/932: mkdir d0/d6/d22/d97/d10b/d138 0 2024-02-16T22:19:03.305 INFO:tasks.workunit.client.0.smithi134.stdout:4/933: symlink d0/d6/d1e/d3b/d9e/l139 0 2024-02-16T22:19:03.306 INFO:tasks.workunit.client.0.smithi134.stdout:4/934: fsync d0/d6/d22/f67 0 2024-02-16T22:19:03.307 INFO:tasks.workunit.client.0.smithi134.stdout:2/925: dwrite df/d10/d15/d5a/f26 [4194304,4194304] 0 2024-02-16T22:19:03.307 INFO:tasks.workunit.client.0.smithi134.stdout:4/935: mkdir d0/d6/d22/d13a 0 2024-02-16T22:19:03.307 INFO:tasks.workunit.client.0.smithi134.stdout:2/926: write df/d41/f6a [1226849,86218] 0 2024-02-16T22:19:03.308 INFO:tasks.workunit.client.0.smithi134.stdout:2/927: symlink df/d10/d30/d4d/d94/l11a 0 2024-02-16T22:19:03.309 INFO:tasks.workunit.client.0.smithi134.stdout:4/936: rmdir d0/d6/d1e/d7c 39 2024-02-16T22:19:03.310 INFO:tasks.workunit.client.0.smithi134.stdout:2/928: mkdir df/d10/d3a/da9/dae/d11b 0 2024-02-16T22:19:03.310 INFO:tasks.workunit.client.0.smithi134.stdout:2/929: write df/d41/f116 [68536,53453] 0 2024-02-16T22:19:03.311 INFO:tasks.workunit.client.0.smithi134.stdout:4/937: mkdir d0/d6/d22/d40/d13b 0 2024-02-16T22:19:03.313 INFO:tasks.workunit.client.0.smithi134.stdout:2/930: rename df/d10/d30/ldc to df/d10/d30/l11c 0 2024-02-16T22:19:03.319 INFO:tasks.workunit.client.0.smithi134.stdout:4/938: dread d0/d6/d1e/d7c/dff/fc1 [0,4194304] 0 2024-02-16T22:19:03.321 INFO:tasks.workunit.client.0.smithi134.stdout:4/939: creat d0/d6/d8/d32/d63/d6c/f13c x:0 0 0 2024-02-16T22:19:03.321 INFO:tasks.workunit.client.0.smithi134.stdout:2/931: dread df/d10/d15/f1d [0,4194304] 0 2024-02-16T22:19:03.324 INFO:tasks.workunit.client.0.smithi134.stdout:2/932: truncate df/d10/d15/d5a/fd1 3175866 0 2024-02-16T22:19:03.328 INFO:tasks.workunit.client.0.smithi134.stdout:2/933: dread df/d10/d30/d49/d82/d1b/f2f [0,4194304] 0 2024-02-16T22:19:03.329 INFO:tasks.workunit.client.0.smithi134.stdout:2/934: symlink df/d10/d30/d49/d82/d7a/l11d 0 2024-02-16T22:19:03.333 INFO:tasks.workunit.client.0.smithi134.stdout:2/935: creat df/d10/d15/d5a/d34/f11e x:0 0 0 2024-02-16T22:19:03.348 INFO:tasks.workunit.client.0.smithi134.stdout:2/936: dwrite df/d10/d15/f3f [0,4194304] 0 2024-02-16T22:19:03.349 INFO:tasks.workunit.client.0.smithi134.stdout:2/937: creat df/d6f/f11f x:0 0 0 2024-02-16T22:19:03.350 INFO:tasks.workunit.client.0.smithi134.stdout:2/938: symlink df/d10/d3a/da9/l120 0 2024-02-16T22:19:03.351 INFO:tasks.workunit.client.0.smithi134.stdout:2/939: unlink df/d10/d30/d49/d82/d1b/c32 0 2024-02-16T22:19:03.455 INFO:tasks.workunit.client.0.smithi134.stdout:2/940: dwrite df/d10/d30/d4d/f52 [0,4194304] 0 2024-02-16T22:19:03.457 INFO:tasks.workunit.client.0.smithi134.stdout:2/941: creat df/d10/d15/da4/df5/f121 x:0 0 0 2024-02-16T22:19:03.459 INFO:tasks.workunit.client.0.smithi134.stdout:2/942: link df/l27 df/d10/d30/d49/d85/def/dd6/l122 0 2024-02-16T22:19:03.463 INFO:tasks.workunit.client.0.smithi134.stdout:4/940: sync 2024-02-16T22:19:03.465 INFO:tasks.workunit.client.0.smithi134.stdout:4/941: mkdir d0/d6/d8/d32/d63/d6c/d13d 0 2024-02-16T22:19:03.465 INFO:tasks.workunit.client.0.smithi134.stdout:4/942: creat d0/d6/d8/da2/d76/df6/f13e x:0 0 0 2024-02-16T22:19:03.466 INFO:tasks.workunit.client.0.smithi134.stdout:2/943: dread df/d10/d15/d5a/f13 [0,4194304] 0 2024-02-16T22:19:03.488 INFO:tasks.workunit.client.0.smithi134.stdout:4/943: dwrite d0/d6/d22/d25/d2a/fe6 [0,4194304] 0 2024-02-16T22:19:03.490 INFO:tasks.workunit.client.0.smithi134.stdout:2/944: dwrite df/d10/d30/d49/f113 [4194304,4194304] 0 2024-02-16T22:19:03.491 INFO:tasks.workunit.client.0.smithi134.stdout:4/944: link d0/d6/d44/f115 d0/d31/db8/d1a/de3/f13f 0 2024-02-16T22:19:03.495 INFO:tasks.workunit.client.0.smithi134.stdout:2/945: unlink df/d10/d15/d5a/d34/f3e 0 2024-02-16T22:19:03.495 INFO:tasks.workunit.client.0.smithi134.stdout:2/946: fsync df/ff2 0 2024-02-16T22:19:03.495 INFO:tasks.workunit.client.0.smithi134.stdout:2/947: chown df/d10/d15/da4/df5 3859744 1 2024-02-16T22:19:03.496 INFO:tasks.workunit.client.0.smithi134.stdout:4/945: rename d0/d6/d8/da2/d76/lec to d0/da1/l140 0 2024-02-16T22:19:03.496 INFO:tasks.workunit.client.0.smithi134.stdout:4/946: dread - d0/d6/d8/da2/f11d zero size 2024-02-16T22:19:03.498 INFO:tasks.workunit.client.0.smithi134.stdout:2/948: rename df/d10/d30/da2/fd8 to df/d10/d30/d49/d7b/f123 0 2024-02-16T22:19:03.499 INFO:tasks.workunit.client.0.smithi134.stdout:2/949: rmdir df/d10/d15/da4 39 2024-02-16T22:19:03.506 INFO:tasks.workunit.client.0.smithi134.stdout:4/947: dread d0/d6/d8/d30/f8f [0,4194304] 0 2024-02-16T22:19:03.507 INFO:tasks.workunit.client.0.smithi134.stdout:4/948: unlink d0/d6/d44/db0/d12a/ff1 0 2024-02-16T22:19:03.507 INFO:tasks.workunit.client.0.smithi134.stdout:4/949: fsync d0/d6/d22/d25/f43 0 2024-02-16T22:19:03.510 INFO:tasks.workunit.client.0.smithi134.stdout:2/950: write df/d41/f5e [11758834,25971] 0 2024-02-16T22:19:03.516 INFO:tasks.workunit.client.0.smithi134.stdout:2/951: dread df/d10/d30/d49/d85/def/d118/f72 [0,4194304] 0 2024-02-16T22:19:03.517 INFO:tasks.workunit.client.0.smithi134.stdout:2/952: mkdir df/d10/d3a/da9/d124 0 2024-02-16T22:19:03.517 INFO:tasks.workunit.client.0.smithi134.stdout:2/953: truncate df/d10/d15/d5a/d34/fc0 342876 0 2024-02-16T22:19:03.518 INFO:tasks.workunit.client.0.smithi134.stdout:2/954: write df/d41/f80 [334406,81598] 0 2024-02-16T22:19:03.518 INFO:tasks.workunit.client.0.smithi134.stdout:2/955: truncate df/f3c 3565518 0 2024-02-16T22:19:03.518 INFO:tasks.workunit.client.0.smithi134.stdout:2/956: fsync df/d10/d30/d49/d82/d1b/f22 0 2024-02-16T22:19:03.518 INFO:tasks.workunit.client.0.smithi134.stdout:2/957: chown df/d10/d30/ca0 36 1 2024-02-16T22:19:03.519 INFO:tasks.workunit.client.0.smithi134.stdout:2/958: mkdir df/d10/d30/d49/d85/def/dd6/d125 0 2024-02-16T22:19:03.519 INFO:tasks.workunit.client.0.smithi134.stdout:2/959: symlink df/d10/d30/d49/d7b/l126 0 2024-02-16T22:19:03.522 INFO:tasks.workunit.client.0.smithi134.stdout:4/950: dwrite d0/d31/db8/d1a/de3/f13f [0,4194304] 0 2024-02-16T22:19:03.526 INFO:tasks.workunit.client.0.smithi134.stdout:4/951: symlink d0/d6/d1e/d7c/dff/l141 0 2024-02-16T22:19:03.530 INFO:tasks.workunit.client.0.smithi134.stdout:2/960: write df/d10/d15/d5a/f26 [7316958,60252] 0 2024-02-16T22:19:03.530 INFO:tasks.workunit.client.0.smithi134.stdout:2/961: creat df/d6f/f127 x:0 0 0 2024-02-16T22:19:03.531 INFO:tasks.workunit.client.0.smithi134.stdout:4/952: rmdir d0/d6/d44 39 2024-02-16T22:19:03.533 INFO:tasks.workunit.client.0.smithi134.stdout:4/953: mkdir d0/d6/d142 0 2024-02-16T22:19:03.536 INFO:tasks.workunit.client.0.smithi134.stdout:4/954: rename d0/d6/d22/d25/f2d to d0/d6/d1e/f143 0 2024-02-16T22:19:03.538 INFO:tasks.workunit.client.0.smithi134.stdout:4/955: mknod d0/d6/d22/d97/d10b/d138/c144 0 2024-02-16T22:19:03.538 INFO:tasks.workunit.client.0.smithi134.stdout:4/956: dread - d0/d31/fef zero size 2024-02-16T22:19:03.538 INFO:tasks.workunit.client.0.smithi134.stdout:4/957: dread - d0/d31/f116 zero size 2024-02-16T22:19:03.540 INFO:tasks.workunit.client.0.smithi134.stdout:4/958: symlink d0/d6/d1e/d39/d4e/l145 0 2024-02-16T22:19:03.540 INFO:tasks.workunit.client.0.smithi134.stdout:4/959: fsync d0/d6/d44/da9/fe7 0 2024-02-16T22:19:03.540 INFO:tasks.workunit.client.0.smithi134.stdout:4/960: creat d0/d6/d1e/d3b/f146 x:0 0 0 2024-02-16T22:19:03.552 INFO:tasks.workunit.client.0.smithi134.stdout:2/962: dwrite df/d10/d30/d4d/f52 [0,4194304] 0 2024-02-16T22:19:03.555 INFO:tasks.workunit.client.0.smithi134.stdout:2/963: rename df/d10/d3a/fc5 to df/d10/d30/d49/d85/def/f128 0 2024-02-16T22:19:03.557 INFO:tasks.workunit.client.0.smithi134.stdout:2/964: mkdir df/d10/d15/da4/d129 0 2024-02-16T22:19:03.558 INFO:tasks.workunit.client.0.smithi134.stdout:2/965: getdents df/d10/d30/d49/d82 0 2024-02-16T22:19:03.566 INFO:tasks.workunit.client.0.smithi134.stdout:2/966: dread df/d10/f47 [0,4194304] 0 2024-02-16T22:19:03.567 INFO:tasks.workunit.client.0.smithi134.stdout:2/967: mkdir df/d10/d30/da2/dca/d12a 0 2024-02-16T22:19:03.568 INFO:tasks.workunit.client.0.smithi134.stdout:2/968: rename df/d10/d30/d49/c83 to df/d10/d30/d49/d85/def/dd6/d125/c12b 0 2024-02-16T22:19:03.568 INFO:tasks.workunit.client.0.smithi134.stdout:2/969: fdatasync df/d10/d3a/da9/dae/fe9 0 2024-02-16T22:19:03.581 INFO:tasks.workunit.client.0.smithi134.stdout:2/970: dwrite df/d10/d30/d4d/d94/fe7 [0,4194304] 0 2024-02-16T22:19:03.581 INFO:tasks.workunit.client.0.smithi134.stdout:2/971: write df/d6f/f127 [98002,66920] 0 2024-02-16T22:19:03.581 INFO:tasks.workunit.client.0.smithi134.stdout:2/972: fsync df/d10/d30/d49/d85/def/fdb 0 2024-02-16T22:19:03.581 INFO:tasks.workunit.client.0.smithi134.stdout:2/973: fsync df/d10/d30/d49/d82/d7a/fc7 0 2024-02-16T22:19:03.581 INFO:tasks.workunit.client.0.smithi134.stdout:2/974: fdatasync df/d6f/dd2/fe0 0 2024-02-16T22:19:03.582 INFO:tasks.workunit.client.0.smithi134.stdout:2/975: symlink df/d10/d30/d49/d82/l12c 0 2024-02-16T22:19:03.582 INFO:tasks.workunit.client.0.smithi134.stdout:2/976: rmdir df/d10/d30/d49/d85 39 2024-02-16T22:19:03.604 INFO:tasks.workunit.client.0.smithi134.stdout:2/977: dwrite df/d10/d30/d49/d85/def/d118/f84 [0,4194304] 0 2024-02-16T22:19:03.613 INFO:tasks.workunit.client.0.smithi134.stdout:4/961: sync 2024-02-16T22:19:03.613 INFO:tasks.workunit.client.0.smithi134.stdout:4/962: fsync d0/d6/d8/da2/fd6 0 2024-02-16T22:19:03.614 INFO:tasks.workunit.client.0.smithi134.stdout:4/963: mknod d0/d6/d1e/d39/c147 0 2024-02-16T22:19:03.615 INFO:tasks.workunit.client.0.smithi134.stdout:4/964: write d0/d6/d8/da2/d76/df6/f119 [282487,122944] 0 2024-02-16T22:19:03.615 INFO:tasks.workunit.client.0.smithi134.stdout:4/965: truncate d0/d31/db8/d1a/de3/f13f 3563094 0 2024-02-16T22:19:03.617 INFO:tasks.workunit.client.0.smithi134.stdout:4/966: mkdir d0/d6/d22/d148 0 2024-02-16T22:19:03.617 INFO:tasks.workunit.client.0.smithi134.stdout:4/967: chown d0/d6/d22/d25/d2a/l36 453282314 1 2024-02-16T22:19:03.617 INFO:tasks.workunit.client.0.smithi134.stdout:4/968: dread - d0/d6/d8/da2/d76/fde zero size 2024-02-16T22:19:03.617 INFO:tasks.workunit.client.0.smithi134.stdout:4/969: fsync d0/d6/d8/da2/d76/df6/f112 0 2024-02-16T22:19:03.618 INFO:tasks.workunit.client.0.smithi134.stdout:4/970: mkdir d0/d6/d8/d120/d149 0 2024-02-16T22:19:03.619 INFO:tasks.workunit.client.0.smithi134.stdout:4/971: creat d0/d6/d1e/d7c/d12e/f14a x:0 0 0 2024-02-16T22:19:03.621 INFO:tasks.workunit.client.0.smithi134.stdout:4/972: link d0/d6/d22/d97/lb6 d0/d6/d8/da2/d76/l14b 0 2024-02-16T22:19:03.623 INFO:tasks.workunit.client.0.smithi134.stdout:4/973: link d0/d6/d22/d25/f48 d0/d31/db8/d86/f14c 0 2024-02-16T22:19:03.623 INFO:tasks.workunit.client.0.smithi134.stdout:4/974: stat d0/d6/d22/d25 0 2024-02-16T22:19:03.627 INFO:tasks.workunit.client.0.smithi134.stdout:2/978: dwrite df/d10/d30/d49/d82/d1b/f2f [4194304,4194304] 0 2024-02-16T22:19:03.630 INFO:tasks.workunit.client.0.smithi134.stdout:2/979: creat df/d10/d30/d49/d85/def/dd6/f12d x:0 0 0 2024-02-16T22:19:03.630 INFO:tasks.workunit.client.0.smithi134.stdout:2/980: read - df/d10/d30/d49/d82/d1b/fda zero size 2024-02-16T22:19:03.637 INFO:tasks.workunit.client.0.smithi134.stdout:4/975: dwrite d0/d6/d1e/fdd [0,4194304] 0 2024-02-16T22:19:03.639 INFO:tasks.workunit.client.0.smithi134.stdout:4/976: rename d0/d31/f116 to d0/d6/d22/d13a/f14d 0 2024-02-16T22:19:03.641 INFO:tasks.workunit.client.0.smithi134.stdout:4/977: truncate d0/d6/d22/d25/f3d 1506910 0 2024-02-16T22:19:03.641 INFO:tasks.workunit.client.0.smithi134.stdout:4/978: truncate d0/d6/d44/db0/f126 243345 0 2024-02-16T22:19:03.643 INFO:tasks.workunit.client.0.smithi134.stdout:4/979: creat d0/d6/d8/d30/f14e x:0 0 0 2024-02-16T22:19:03.644 INFO:tasks.workunit.client.0.smithi134.stdout:4/980: symlink d0/d6/d8/d120/d149/l14f 0 2024-02-16T22:19:03.645 INFO:tasks.workunit.client.0.smithi134.stdout:4/981: truncate d0/d6/d22/d25/d2a/f2e 2587324 0 2024-02-16T22:19:03.646 INFO:tasks.workunit.client.0.smithi134.stdout:2/981: dwrite df/d10/d30/d49/d82/d1b/f56 [0,4194304] 0 2024-02-16T22:19:03.648 INFO:tasks.workunit.client.0.smithi134.stdout:2/982: creat df/d10/d30/d4d/d105/f12e x:0 0 0 2024-02-16T22:19:03.648 INFO:tasks.workunit.client.0.smithi134.stdout:2/983: chown df/d10/d15/da4/fbf 31593 1 2024-02-16T22:19:03.648 INFO:tasks.workunit.client.0.smithi134.stdout:2/984: creat df/d10/d30/d49/d82/d1b/f12f x:0 0 0 2024-02-16T22:19:03.650 INFO:tasks.workunit.client.0.smithi134.stdout:2/985: fsync df/d6f/f127 0 2024-02-16T22:19:03.657 INFO:tasks.workunit.client.0.smithi134.stdout:4/982: dread d0/d31/db8/d1a/de3/f13f [0,4194304] 0 2024-02-16T22:19:03.657 INFO:tasks.workunit.client.0.smithi134.stdout:4/983: chown d0/d6/d8/d32/f38 83860 1 2024-02-16T22:19:03.658 INFO:tasks.workunit.client.0.smithi134.stdout:4/984: symlink d0/d6/d1e/d7c/l150 0 2024-02-16T22:19:03.679 INFO:tasks.workunit.client.0.smithi134.stdout:2/986: dwrite df/d10/d30/d49/f10d [0,4194304] 0 2024-02-16T22:19:03.679 INFO:tasks.workunit.client.0.smithi134.stdout:4/985: dwrite d0/ff3 [0,4194304] 0 2024-02-16T22:19:03.679 INFO:tasks.workunit.client.0.smithi134.stdout:4/986: write d0/d6/d22/d25/f56 [5184218,6147] 0 2024-02-16T22:19:03.679 INFO:tasks.workunit.client.0.smithi134.stdout:4/987: chown d0/d31/f109 0 1 2024-02-16T22:19:03.683 INFO:tasks.workunit.client.0.smithi134.stdout:4/988: creat d0/d31/db8/d46/f151 x:0 0 0 2024-02-16T22:19:03.683 INFO:tasks.workunit.client.0.smithi134.stdout:4/989: write d0/d6/d8/da2/d76/fde [795132,18829] 0 2024-02-16T22:19:03.683 INFO:tasks.workunit.client.0.smithi134.stdout:4/990: chown d0/d6/d1e/d39/d4e/d12b 315031736 1 2024-02-16T22:19:03.683 INFO:tasks.workunit.client.0.smithi134.stdout:4/991: chown d0/d6/d8/l1f 307095983 1 2024-02-16T22:19:03.687 INFO:tasks.workunit.client.0.smithi134.stdout:4/992: dread d0/d31/db8/d86/f14c [0,4194304] 0 2024-02-16T22:19:03.688 INFO:tasks.workunit.client.0.smithi134.stdout:4/993: truncate d0/d6/d22/d13a/f14d 436975 0 2024-02-16T22:19:03.688 INFO:tasks.workunit.client.0.smithi134.stdout:4/994: mkdir d0/d6/d22/d40/d13b/d152 0 2024-02-16T22:19:03.689 INFO:tasks.workunit.client.0.smithi134.stdout:2/987: read df/d10/f86 [3118403,103374] 0 2024-02-16T22:19:03.690 INFO:tasks.workunit.client.0.smithi134.stdout:2/988: write df/d10/d30/d4d/f103 [925107,17121] 0 2024-02-16T22:19:03.690 INFO:tasks.workunit.client.0.smithi134.stdout:2/989: creat df/d10/d30/d49/d85/def/f130 x:0 0 0 2024-02-16T22:19:03.698 INFO:tasks.workunit.client.0.smithi134.stdout:4/995: write d0/d6/d8/fa [318304,14553] 0 2024-02-16T22:19:03.698 INFO:tasks.workunit.client.0.smithi134.stdout:4/996: chown d0/f2 1542 1 2024-02-16T22:19:03.699 INFO:tasks.workunit.client.0.smithi134.stdout:4/997: mkdir d0/d6/d44/db0/d12a/d153 0 2024-02-16T22:19:03.699 INFO:tasks.workunit.client.0.smithi134.stdout:4/998: stat d0/d6/d22/d40/fd5 0 2024-02-16T22:19:03.700 INFO:tasks.workunit.client.0.smithi134.stdout:4/999: unlink d0/d31/db8/d86/lab 0 2024-02-16T22:19:03.706 INFO:tasks.workunit.client.0.smithi134.stdout:2/990: dwrite df/d10/d30/d49/f57 [4194304,4194304] 0 2024-02-16T22:19:03.708 INFO:tasks.workunit.client.0.smithi134.stdout:2/991: mkdir df/d10/d30/d49/d85/def/d131 0 2024-02-16T22:19:03.709 INFO:tasks.workunit.client.0.smithi134.stdout:2/992: symlink df/d10/d15/d5a/l132 0 2024-02-16T22:19:03.709 INFO:tasks.workunit.client.0.smithi134.stdout:2/993: readlink df/d10/d30/d49/d82/d1b/l37 0 2024-02-16T22:19:03.717 INFO:tasks.workunit.client.0.smithi134.stdout:2/994: dread df/d10/d30/d49/d82/f79 [0,4194304] 0 2024-02-16T22:19:03.717 INFO:tasks.workunit.client.0.smithi134.stdout:2/995: truncate df/d10/f3b 1420457 0 2024-02-16T22:19:03.717 INFO:tasks.workunit.client.0.smithi134.stdout:2/996: rmdir df/d10/d30/d49/d85/def/d118 39 2024-02-16T22:19:03.726 INFO:tasks.workunit.client.0.smithi134.stdout:2/997: read df/d41/f5e [6699183,87983] 0 2024-02-16T22:19:03.727 INFO:tasks.workunit.client.0.smithi134.stdout:2/998: mknod df/d6f/c133 0 2024-02-16T22:19:03.727 INFO:tasks.workunit.client.0.smithi134.stdout:2/999: read df/d41/f80 [322129,55771] 0 2024-02-16T22:19:03.730 INFO:tasks.workunit.client.0.smithi134.stderr:+ rm -rf -- ./tmp.MZEO0YumiE 2024-02-16T22:19:04.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:04 smithi173 ceph-mon[37280]: pgmap v254: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 215 MiB/s rd, 276 MiB/s wr, 320 op/s 2024-02-16T22:19:04.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:04 smithi134 ceph-mon[28869]: pgmap v254: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 215 MiB/s rd, 276 MiB/s wr, 320 op/s 2024-02-16T22:19:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.959+0000 7f47fc504700 1 -- 172.21.15.134:0/196766090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47f41003a0 msgr2=0x7f47f4102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.959+0000 7f47fc504700 1 --2- 172.21.15.134:0/196766090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47f41003a0 0x7f47f4102780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f47e4004940 tx=0x7f47e4009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.959+0000 7f47fc504700 1 -- 172.21.15.134:0/196766090 shutdown_connections 2024-02-16T22:19:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.959+0000 7f47fc504700 1 --2- 172.21.15.134:0/196766090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47f41003a0 0x7f47f4102780 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.959+0000 7f47fc504700 1 --2- 172.21.15.134:0/196766090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f40fda80 0x7f47f40ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.959+0000 7f47fc504700 1 -- 172.21.15.134:0/196766090 >> 172.21.15.134:0/196766090 conn(0x7f47f40f74e0 msgr2=0x7f47f40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.959+0000 7f47fc504700 1 -- 172.21.15.134:0/196766090 shutdown_connections 2024-02-16T22:19:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.959+0000 7f47fc504700 1 -- 172.21.15.134:0/196766090 wait complete. 2024-02-16T22:19:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.960+0000 7f47fc504700 1 Processor -- start 2024-02-16T22:19:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.960+0000 7f47fc504700 1 -- start start 2024-02-16T22:19:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.960+0000 7f47fc504700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47f40fda80 0x7f47f410d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.960+0000 7f47fc504700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f41003a0 0x7f47f410de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:04.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.960+0000 7f47fc504700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f410e410 con 0x7f47f40fda80 2024-02-16T22:19:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.960+0000 7f47fc504700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f410ecb0 con 0x7f47f41003a0 2024-02-16T22:19:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.960+0000 7f47fa2a0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47f40fda80 0x7f47f410d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.960+0000 7f47fa2a0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47f40fda80 0x7f47f410d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59274/0 (socket says 172.21.15.134:59274) 2024-02-16T22:19:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.960+0000 7f47fa2a0700 1 -- 172.21.15.134:0/543382939 learned_addr learned my addr 172.21.15.134:0/543382939 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:19:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.960+0000 7f47f9a9f700 1 --2- 172.21.15.134:0/543382939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f41003a0 0x7f47f410de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.960+0000 7f47fa2a0700 1 -- 172.21.15.134:0/543382939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f41003a0 msgr2=0x7f47f410de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.960+0000 7f47fa2a0700 1 --2- 172.21.15.134:0/543382939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f41003a0 0x7f47f410de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.960+0000 7f47fa2a0700 1 -- 172.21.15.134:0/543382939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e4005040 con 0x7f47f40fda80 2024-02-16T22:19:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.960+0000 7f47fa2a0700 1 --2- 172.21.15.134:0/543382939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47f40fda80 0x7f47f410d8d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f47f000eb70 tx=0x7f47f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.961+0000 7f47eaffd700 1 -- 172.21.15.134:0/543382939 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47f0007cc0 con 0x7f47f40fda80 2024-02-16T22:19:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.961+0000 7f47eaffd700 1 -- 172.21.15.134:0/543382939 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f47f000f040 con 0x7f47f40fda80 2024-02-16T22:19:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.961+0000 7f47fc504700 1 -- 172.21.15.134:0/543382939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f410ef30 con 0x7f47f40fda80 2024-02-16T22:19:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.961+0000 7f47eaffd700 1 -- 172.21.15.134:0/543382939 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47f000ca90 con 0x7f47f40fda80 2024-02-16T22:19:04.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.961+0000 7f47fc504700 1 -- 172.21.15.134:0/543382939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f410f470 con 0x7f47f40fda80 2024-02-16T22:19:04.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.962+0000 7f47fc504700 1 -- 172.21.15.134:0/543382939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f404bed0 con 0x7f47f40fda80 2024-02-16T22:19:04.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.963+0000 7f47eaffd700 1 -- 172.21.15.134:0/543382939 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) v1 ==== 88916+0+0 (secure 0 0 0) 0x7f47f000cbf0 con 0x7f47f40fda80 2024-02-16T22:19:04.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.963+0000 7f47eaffd700 1 --2- 172.21.15.134:0/543382939 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f47e006b1d0 0x7f47e006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:04.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.963+0000 7f47eaffd700 1 -- 172.21.15.134:0/543382939 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f47f0089570 con 0x7f47f40fda80 2024-02-16T22:19:04.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.963+0000 7f47f9a9f700 1 --2- 172.21.15.134:0/543382939 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f47e006b1d0 0x7f47e006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:04.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.964+0000 7f47f9a9f700 1 --2- 172.21.15.134:0/543382939 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f47e006b1d0 0x7f47e006d680 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f47e4013740 tx=0x7f47e4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:04.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:04.972+0000 7f47eaffd700 1 -- 172.21.15.134:0/543382939 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f47f00592e0 con 0x7f47f40fda80 2024-02-16T22:19:05.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.220+0000 7f47fc504700 1 -- 172.21.15.134:0/543382939 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f47f4101000 con 0x7f47e006b1d0 2024-02-16T22:19:05.222 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:05 smithi134 ceph-mon[28869]: fsmap cephfs:2 {0=cephfs.smithi134.jyajef=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:19:05.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.222+0000 7f47eaffd700 1 -- 172.21.15.134:0/543382939 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f47f4101000 con 0x7f47e006b1d0 2024-02-16T22:19:05.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.224+0000 7f47fc504700 1 -- 172.21.15.134:0/543382939 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f47e006b1d0 msgr2=0x7f47e006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:05.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.224+0000 7f47fc504700 1 --2- 172.21.15.134:0/543382939 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f47e006b1d0 0x7f47e006d680 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f47e4013740 tx=0x7f47e4009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:05.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.224+0000 7f47fc504700 1 -- 172.21.15.134:0/543382939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47f40fda80 msgr2=0x7f47f410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:05.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.224+0000 7f47fc504700 1 --2- 172.21.15.134:0/543382939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47f40fda80 0x7f47f410d8d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f47f000eb70 tx=0x7f47f000b040 comp rx=0 tx=0).stop 2024-02-16T22:19:05.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.224+0000 7f47fc504700 1 -- 172.21.15.134:0/543382939 shutdown_connections 2024-02-16T22:19:05.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.224+0000 7f47fc504700 1 --2- 172.21.15.134:0/543382939 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f47e006b1d0 0x7f47e006d680 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:05.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.224+0000 7f47fc504700 1 --2- 172.21.15.134:0/543382939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47f40fda80 0x7f47f410d8d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:05.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.224+0000 7f47fc504700 1 --2- 172.21.15.134:0/543382939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f41003a0 0x7f47f410de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:05.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.225+0000 7f47fc504700 1 -- 172.21.15.134:0/543382939 >> 172.21.15.134:0/543382939 conn(0x7f47f40f74e0 msgr2=0x7f47f40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:05.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.225+0000 7f47fc504700 1 -- 172.21.15.134:0/543382939 shutdown_connections 2024-02-16T22:19:05.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.225+0000 7f47fc504700 1 -- 172.21.15.134:0/543382939 wait complete. 2024-02-16T22:19:05.241 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:19:05.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.360+0000 7f3f9c524700 1 -- 172.21.15.134:0/937426857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f940fbe40 msgr2=0x7f3f940fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:05.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.360+0000 7f3f9c524700 1 --2- 172.21.15.134:0/937426857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f940fbe40 0x7f3f940fc250 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3f90004940 tx=0x7f3f90009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:05.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.360+0000 7f3f9c524700 1 -- 172.21.15.134:0/937426857 shutdown_connections 2024-02-16T22:19:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.360+0000 7f3f9c524700 1 --2- 172.21.15.134:0/937426857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f940fcfb0 0x7f3f940fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.360+0000 7f3f9c524700 1 --2- 172.21.15.134:0/937426857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f940fbe40 0x7f3f940fc250 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.360+0000 7f3f9c524700 1 -- 172.21.15.134:0/937426857 >> 172.21.15.134:0/937426857 conn(0x7f3f940f74e0 msgr2=0x7f3f940f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.360+0000 7f3f9c524700 1 -- 172.21.15.134:0/937426857 shutdown_connections 2024-02-16T22:19:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.360+0000 7f3f9c524700 1 -- 172.21.15.134:0/937426857 wait complete. 2024-02-16T22:19:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.360+0000 7f3f9c524700 1 Processor -- start 2024-02-16T22:19:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.361+0000 7f3f9c524700 1 -- start start 2024-02-16T22:19:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.361+0000 7f3f9c524700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f940fbe40 0x7f3f9410fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.361+0000 7f3f9c524700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f940fcfb0 0x7f3f94110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.361+0000 7f3f9c524700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f94110610 con 0x7f3f940fcfb0 2024-02-16T22:19:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.361+0000 7f3f9c524700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f94110eb0 con 0x7f3f940fbe40 2024-02-16T22:19:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.361+0000 7f3f99abf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f940fcfb0 0x7f3f94110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.361+0000 7f3f99abf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f940fcfb0 0x7f3f94110010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59296/0 (socket says 172.21.15.134:59296) 2024-02-16T22:19:05.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.361+0000 7f3f99abf700 1 -- 172.21.15.134:0/1587608527 learned_addr learned my addr 172.21.15.134:0/1587608527 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:19:05.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.361+0000 7f3f9a2c0700 1 --2- 172.21.15.134:0/1587608527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f940fbe40 0x7f3f9410fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:05.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.361+0000 7f3f99abf700 1 -- 172.21.15.134:0/1587608527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f940fbe40 msgr2=0x7f3f9410fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:05.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.361+0000 7f3f99abf700 1 --2- 172.21.15.134:0/1587608527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f940fbe40 0x7f3f9410fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:05.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.361+0000 7f3f99abf700 1 -- 172.21.15.134:0/1587608527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90005040 con 0x7f3f940fcfb0 2024-02-16T22:19:05.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.361+0000 7f3f9a2c0700 1 --2- 172.21.15.134:0/1587608527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f940fbe40 0x7f3f9410fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:19:05.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.361+0000 7f3f99abf700 1 --2- 172.21.15.134:0/1587608527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f940fcfb0 0x7f3f94110010 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400eb70 tx=0x7f3f8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:05.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.362+0000 7f3f8affd700 1 -- 172.21.15.134:0/1587608527 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f84007cc0 con 0x7f3f940fcfb0 2024-02-16T22:19:05.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.362+0000 7f3f9c524700 1 -- 172.21.15.134:0/1587608527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f94111130 con 0x7f3f940fcfb0 2024-02-16T22:19:05.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.362+0000 7f3f8affd700 1 -- 172.21.15.134:0/1587608527 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f8400f040 con 0x7f3f940fcfb0 2024-02-16T22:19:05.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.362+0000 7f3f8affd700 1 -- 172.21.15.134:0/1587608527 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f8400ca90 con 0x7f3f940fcfb0 2024-02-16T22:19:05.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.362+0000 7f3f9c524700 1 -- 172.21.15.134:0/1587608527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f94111670 con 0x7f3f940fcfb0 2024-02-16T22:19:05.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.363+0000 7f3f9c524700 1 -- 172.21.15.134:0/1587608527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9404bed0 con 0x7f3f940fcfb0 2024-02-16T22:19:05.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.363+0000 7f3f8affd700 1 -- 172.21.15.134:0/1587608527 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) v1 ==== 88916+0+0 (secure 0 0 0) 0x7f3f8400cbf0 con 0x7f3f940fcfb0 2024-02-16T22:19:05.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.364+0000 7f3f8affd700 1 --2- 172.21.15.134:0/1587608527 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3f8006b1d0 0x7f3f8006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:05.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.364+0000 7f3f8affd700 1 -- 172.21.15.134:0/1587608527 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3f840895f0 con 0x7f3f940fcfb0 2024-02-16T22:19:05.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.364+0000 7f3f9a2c0700 1 --2- 172.21.15.134:0/1587608527 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3f8006b1d0 0x7f3f8006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:05.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.364+0000 7f3f9a2c0700 1 --2- 172.21.15.134:0/1587608527 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3f8006b1d0 0x7f3f8006d680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3f90013740 tx=0x7f3f90009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:05.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.368+0000 7f3f8affd700 1 -- 172.21.15.134:0/1587608527 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3f840592e0 con 0x7f3f940fcfb0 2024-02-16T22:19:05.444 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:05 smithi173 ceph-mon[37280]: fsmap cephfs:2 {0=cephfs.smithi134.jyajef=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:19:05.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.598+0000 7f3f9c524700 1 -- 172.21.15.134:0/1587608527 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f94111b30 con 0x7f3f8006b1d0 2024-02-16T22:19:05.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.600+0000 7f3f8affd700 1 -- 172.21.15.134:0/1587608527 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f3f94111b30 con 0x7f3f8006b1d0 2024-02-16T22:19:05.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.602+0000 7f3f9c524700 1 -- 172.21.15.134:0/1587608527 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3f8006b1d0 msgr2=0x7f3f8006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:05.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.602+0000 7f3f9c524700 1 --2- 172.21.15.134:0/1587608527 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3f8006b1d0 0x7f3f8006d680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3f90013740 tx=0x7f3f90009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:05.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.602+0000 7f3f9c524700 1 -- 172.21.15.134:0/1587608527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f940fcfb0 msgr2=0x7f3f94110010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:05.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.602+0000 7f3f9c524700 1 --2- 172.21.15.134:0/1587608527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f940fcfb0 0x7f3f94110010 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400eb70 tx=0x7f3f8400b040 comp rx=0 tx=0).stop 2024-02-16T22:19:05.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.602+0000 7f3f9c524700 1 -- 172.21.15.134:0/1587608527 shutdown_connections 2024-02-16T22:19:05.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.602+0000 7f3f9c524700 1 --2- 172.21.15.134:0/1587608527 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7f3f8006b1d0 0x7f3f8006d680 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:05.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.602+0000 7f3f9c524700 1 --2- 172.21.15.134:0/1587608527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f940fbe40 0x7f3f9410fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:05.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.602+0000 7f3f9c524700 1 --2- 172.21.15.134:0/1587608527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f940fcfb0 0x7f3f94110010 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:05.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.602+0000 7f3f9c524700 1 -- 172.21.15.134:0/1587608527 >> 172.21.15.134:0/1587608527 conn(0x7f3f940f74e0 msgr2=0x7f3f940656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:05.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.602+0000 7f3f9c524700 1 -- 172.21.15.134:0/1587608527 shutdown_connections 2024-02-16T22:19:05.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.602+0000 7f3f9c524700 1 -- 172.21.15.134:0/1587608527 wait complete. 2024-02-16T22:19:05.690 INFO:tasks.workunit.client.1.smithi173.stdout:4/22: sync 2024-02-16T22:19:05.690 INFO:tasks.workunit.client.1.smithi173.stdout:5/54: sync 2024-02-16T22:19:05.690 INFO:tasks.workunit.client.1.smithi173.stdout:7/19: sync 2024-02-16T22:19:05.691 INFO:tasks.workunit.client.1.smithi173.stdout:6/3: sync 2024-02-16T22:19:05.691 INFO:tasks.workunit.client.1.smithi173.stdout:0/74: sync 2024-02-16T22:19:05.691 INFO:tasks.workunit.client.1.smithi173.stdout:6/4: stat d0 0 2024-02-16T22:19:05.691 INFO:tasks.workunit.client.1.smithi173.stdout:0/75: chown d0 0 1 2024-02-16T22:19:05.691 INFO:tasks.workunit.client.1.smithi173.stdout:9/5: sync 2024-02-16T22:19:05.691 INFO:tasks.workunit.client.1.smithi173.stdout:0/76: dread - d0/d4/fe zero size 2024-02-16T22:19:05.691 INFO:tasks.workunit.client.1.smithi173.stdout:3/3: sync 2024-02-16T22:19:05.691 INFO:tasks.workunit.client.1.smithi173.stdout:1/0: sync 2024-02-16T22:19:05.691 INFO:tasks.workunit.client.1.smithi173.stdout:1/1: rename - no filename 2024-02-16T22:19:05.691 INFO:tasks.workunit.client.1.smithi173.stdout:2/69: sync 2024-02-16T22:19:05.691 INFO:tasks.workunit.client.1.smithi173.stdout:8/76: sync 2024-02-16T22:19:05.691 INFO:tasks.workunit.client.1.smithi173.stdout:3/4: chown c0 394 1 2024-02-16T22:19:05.692 INFO:tasks.workunit.client.1.smithi173.stdout:3/5: dread - f1 zero size 2024-02-16T22:19:05.692 INFO:tasks.workunit.client.1.smithi173.stdout:8/77: chown dd/l10 51 1 2024-02-16T22:19:05.692 INFO:tasks.workunit.client.1.smithi173.stdout:3/6: creat f2 x:0 0 0 2024-02-16T22:19:05.692 INFO:tasks.workunit.client.1.smithi173.stdout:3/7: write f1 [26943,95298] 0 2024-02-16T22:19:05.693 INFO:tasks.workunit.client.1.smithi173.stdout:8/78: write f9 [850110,87099] 0 2024-02-16T22:19:05.698 INFO:tasks.workunit.client.1.smithi173.stdout:0/77: write d0/f11 [1832065,18473] 0 2024-02-16T22:19:05.711 INFO:tasks.workunit.client.1.smithi173.stdout:8/79: dwrite dd/d11/f14 [0,4194304] 0 2024-02-16T22:19:05.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.720+0000 7fdafe9da700 1 -- 172.21.15.134:0/2526891152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf8071e90 msgr2=0x7fdaf8070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:05.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.720+0000 7fdafe9da700 1 --2- 172.21.15.134:0/2526891152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf8071e90 0x7fdaf8070300 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdae8004940 tx=0x7fdae8009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:05.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.720+0000 7fdafe9da700 1 -- 172.21.15.134:0/2526891152 shutdown_connections 2024-02-16T22:19:05.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.720+0000 7fdafe9da700 1 --2- 172.21.15.134:0/2526891152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaf8070840 0x7fdaf8070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:05.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.720+0000 7fdafe9da700 1 --2- 172.21.15.134:0/2526891152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf8071e90 0x7fdaf8070300 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:05.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.720+0000 7fdafe9da700 1 -- 172.21.15.134:0/2526891152 >> 172.21.15.134:0/2526891152 conn(0x7fdaf80f8620 msgr2=0x7fdaf80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:05.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.720+0000 7fdafe9da700 1 -- 172.21.15.134:0/2526891152 shutdown_connections 2024-02-16T22:19:05.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.720+0000 7fdafe9da700 1 -- 172.21.15.134:0/2526891152 wait complete. 2024-02-16T22:19:05.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.721+0000 7fdafe9da700 1 Processor -- start 2024-02-16T22:19:05.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.721+0000 7fdafe9da700 1 -- start start 2024-02-16T22:19:05.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.721+0000 7fdafe9da700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaf8070840 0x7fdaf810fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:05.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.721+0000 7fdafe9da700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf8071e90 0x7fdaf8110020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:05.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.721+0000 7fdafe9da700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf8110620 con 0x7fdaf8071e90 2024-02-16T22:19:05.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.721+0000 7fdafe9da700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf8110ec0 con 0x7fdaf8070840 2024-02-16T22:19:05.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.722+0000 7fdaf77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf8071e90 0x7fdaf8110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:05.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.722+0000 7fdaf77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf8071e90 0x7fdaf8110020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59312/0 (socket says 172.21.15.134:59312) 2024-02-16T22:19:05.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.722+0000 7fdaf77fe700 1 -- 172.21.15.134:0/2936751534 learned_addr learned my addr 172.21.15.134:0/2936751534 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:19:05.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.722+0000 7fdaf7fff700 1 --2- 172.21.15.134:0/2936751534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaf8070840 0x7fdaf810fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:05.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.722+0000 7fdaf77fe700 1 -- 172.21.15.134:0/2936751534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaf8070840 msgr2=0x7fdaf810fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:05.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.722+0000 7fdaf77fe700 1 --2- 172.21.15.134:0/2936751534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaf8070840 0x7fdaf810fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:05.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.722+0000 7fdaf77fe700 1 -- 172.21.15.134:0/2936751534 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae8005040 con 0x7fdaf8071e90 2024-02-16T22:19:05.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.722+0000 7fdaf7fff700 1 --2- 172.21.15.134:0/2936751534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaf8070840 0x7fdaf810fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:19:05.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.722+0000 7fdaf77fe700 1 --2- 172.21.15.134:0/2936751534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf8071e90 0x7fdaf8110020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00eb40 tx=0x7fdaec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:05.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.722+0000 7fdaf4ff9700 1 -- 172.21.15.134:0/2936751534 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaec007cc0 con 0x7fdaf8071e90 2024-02-16T22:19:05.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.722+0000 7fdafe9da700 1 -- 172.21.15.134:0/2936751534 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf8111140 con 0x7fdaf8071e90 2024-02-16T22:19:05.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.722+0000 7fdaf4ff9700 1 -- 172.21.15.134:0/2936751534 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdaec00f040 con 0x7fdaf8071e90 2024-02-16T22:19:05.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.722+0000 7fdafe9da700 1 -- 172.21.15.134:0/2936751534 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf8111680 con 0x7fdaf8071e90 2024-02-16T22:19:05.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.722+0000 7fdaf4ff9700 1 -- 172.21.15.134:0/2936751534 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaec00ca10 con 0x7fdaf8071e90 2024-02-16T22:19:05.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.724+0000 7fdafe9da700 1 -- 172.21.15.134:0/2936751534 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf804bed0 con 0x7fdaf8071e90 2024-02-16T22:19:05.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.724+0000 7fdaf4ff9700 1 -- 172.21.15.134:0/2936751534 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) v1 ==== 88916+0+0 (secure 0 0 0) 0x7fdaec00cc80 con 0x7fdaf8071e90 2024-02-16T22:19:05.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.724+0000 7fdaf4ff9700 1 --2- 172.21.15.134:0/2936751534 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fdae006b1c0 0x7fdae006d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:05.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.725+0000 7fdaf4ff9700 1 -- 172.21.15.134:0/2936751534 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdaec089680 con 0x7fdaf8071e90 2024-02-16T22:19:05.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.725+0000 7fdaf7fff700 1 --2- 172.21.15.134:0/2936751534 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fdae006b1c0 0x7fdae006d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:05.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.725+0000 7fdaf7fff700 1 --2- 172.21.15.134:0/2936751534 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fdae006b1c0 0x7fdae006d670 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009fd0 tx=0x7fdae8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:05.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.729+0000 7fdaf4ff9700 1 -- 172.21.15.134:0/2936751534 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fdaec059420 con 0x7fdaf8071e90 2024-02-16T22:19:05.773 INFO:tasks.workunit.client.1.smithi173.stdout:5/55: dread - d8/da/ff zero size 2024-02-16T22:19:05.779 INFO:tasks.workunit.client.1.smithi173.stdout:7/20: mkdir d1/d5/da 0 2024-02-16T22:19:05.779 INFO:tasks.workunit.client.1.smithi173.stdout:7/21: write d1/d5/f8 [509314,51075] 0 2024-02-16T22:19:05.779 INFO:tasks.workunit.client.1.smithi173.stdout:4/23: truncate f1 3857293 0 2024-02-16T22:19:05.779 INFO:tasks.workunit.client.1.smithi173.stdout:4/24: chown c6 38 1 2024-02-16T22:19:05.780 INFO:tasks.workunit.client.1.smithi173.stdout:6/5: creat d0/f1 x:0 0 0 2024-02-16T22:19:05.780 INFO:tasks.workunit.client.1.smithi173.stdout:6/6: write d0/f1 [245625,2061] 0 2024-02-16T22:19:05.781 INFO:tasks.workunit.client.1.smithi173.stdout:1/2: creat f0 x:0 0 0 2024-02-16T22:19:05.781 INFO:tasks.workunit.client.1.smithi173.stdout:1/3: stat f0 0 2024-02-16T22:19:05.781 INFO:tasks.workunit.client.1.smithi173.stdout:1/4: write f0 [614329,110137] 0 2024-02-16T22:19:05.783 INFO:tasks.workunit.client.1.smithi173.stdout:3/8: symlink l3 0 2024-02-16T22:19:05.783 INFO:tasks.workunit.client.1.smithi173.stdout:3/9: dread - f2 zero size 2024-02-16T22:19:05.785 INFO:tasks.workunit.client.1.smithi173.stdout:0/78: rmdir d0/d4/d14 39 2024-02-16T22:19:05.786 INFO:tasks.workunit.client.1.smithi173.stdout:0/79: fsync d0/f5 0 2024-02-16T22:19:05.789 INFO:tasks.workunit.client.1.smithi173.stdout:8/80: mknod dd/d11/c21 0 2024-02-16T22:19:05.789 INFO:tasks.workunit.client.1.smithi173.stdout:8/81: chown dd 5683894 1 2024-02-16T22:19:05.790 INFO:tasks.workunit.client.1.smithi173.stdout:8/82: truncate dd/d11/f1a 685113 0 2024-02-16T22:19:05.790 INFO:tasks.workunit.client.1.smithi173.stdout:8/83: chown dd/d11/f20 3322 1 2024-02-16T22:19:05.790 INFO:tasks.workunit.client.1.smithi173.stdout:8/84: truncate dd/d11/f1a 1216406 0 2024-02-16T22:19:05.790 INFO:tasks.workunit.client.1.smithi173.stdout:8/85: truncate f9 1923674 0 2024-02-16T22:19:05.790 INFO:tasks.workunit.client.1.smithi173.stdout:1/5: fsync f0 0 2024-02-16T22:19:05.793 INFO:tasks.workunit.client.1.smithi173.stdout:2/70: write d2/ff [481896,47992] 0 2024-02-16T22:19:05.793 INFO:tasks.workunit.client.1.smithi173.stdout:2/71: fdatasync d2/f17 0 2024-02-16T22:19:05.793 INFO:tasks.workunit.client.1.smithi173.stdout:2/72: fsync d2/f17 0 2024-02-16T22:19:05.794 INFO:tasks.workunit.client.1.smithi173.stdout:7/22: unlink d1/c2 0 2024-02-16T22:19:05.794 INFO:tasks.workunit.client.1.smithi173.stdout:7/23: write d1/f9 [417944,87760] 0 2024-02-16T22:19:05.794 INFO:tasks.workunit.client.1.smithi173.stdout:4/25: readlink l2 0 2024-02-16T22:19:05.798 INFO:tasks.workunit.client.1.smithi173.stdout:3/10: symlink l4 0 2024-02-16T22:19:05.798 INFO:tasks.workunit.client.1.smithi173.stdout:3/11: stat f2 0 2024-02-16T22:19:05.802 INFO:tasks.workunit.client.1.smithi173.stdout:0/80: dwrite d0/d12/d15/f1c [0,4194304] 0 2024-02-16T22:19:05.823 INFO:tasks.workunit.client.1.smithi173.stdout:3/12: dwrite f2 [0,4194304] 0 2024-02-16T22:19:05.823 INFO:tasks.workunit.client.1.smithi173.stdout:0/81: dwrite d0/d4/f7 [0,4194304] 0 2024-02-16T22:19:05.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:05.995+0000 7fdafe9da700 1 -- 172.21.15.134:0/2936751534 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdaf8111ae0 con 0x7fdae006b1c0 2024-02-16T22:19:06.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.004+0000 7fdaf4ff9700 1 -- 172.21.15.134:0/2936751534 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fdaf8111ae0 con 0x7fdae006b1c0 2024-02-16T22:19:06.006 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (6m) 2m ago 8m 24.8M - 0.25.0 c8568f914cd2 62f86e3efbe2 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (8m) 2m ago 8m 6660k - 17.2.7-513-gb88fae66 870a0944ccb8 a0d53bc0a925 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (7m) 0s ago 7m 6669k - 17.2.7-513-gb88fae66 870a0944ccb8 a8d69537e08a 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (6m) 2m ago 7m 87.8M - 9.4.7 954c08fa6188 67572f26488e 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (2m) 2m ago 2m 10.4M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (2m) 2m ago 2m 15.6M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (2m) 0s ago 2m 14.1M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (2m) 0s ago 2m 141M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:9283 running (9m) 2m ago 9m 480M - 17.2.7-513-gb88fae66 870a0944ccb8 52095085178d 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283 running (30s) 0s ago 6m 135M - 19.0.0-1450-gf78a58c0 f081f847070a 9d4cb8c4184e 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (9m) 2m ago 9m 44.9M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 93a679740d93 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (6m) 0s ago 6m 32.7M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 cfbef35950ef 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (8m) 2m ago 8m 15.9M - 1.5.0 0da6a335fe13 7e7604241558 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (7m) 0s ago 7m 15.3M - 1.5.0 0da6a335fe13 cddf6bc3c421 2024-02-16T22:19:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (6m) 2m ago 6m 44.7M 4288M 17.2.7-513-gb88fae66 870a0944ccb8 099f0b29d202 2024-02-16T22:19:06.008 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (5m) 2m ago 5m 48.4M 4288M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:19:06.008 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (5m) 2m ago 5m 44.4M 4288M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:19:06.008 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (4m) 0s ago 4m 137M 5312M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:19:06.008 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (4m) 0s ago 4m 133M 5312M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:19:06.008 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (3m) 0s ago 3m 124M 5312M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:19:06.008 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (6m) 2m ago 7m 54.3M - 2.43.0 a07b618ecd1d 37e529bd9229 2024-02-16T22:19:06.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.008+0000 7fdafe9da700 1 -- 172.21.15.134:0/2936751534 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fdae006b1c0 msgr2=0x7fdae006d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:06.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.008+0000 7fdafe9da700 1 --2- 172.21.15.134:0/2936751534 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fdae006b1c0 0x7fdae006d670 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009fd0 tx=0x7fdae8009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:06.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.008+0000 7fdafe9da700 1 -- 172.21.15.134:0/2936751534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf8071e90 msgr2=0x7fdaf8110020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:06.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.008+0000 7fdafe9da700 1 --2- 172.21.15.134:0/2936751534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf8071e90 0x7fdaf8110020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00eb40 tx=0x7fdaec00b040 comp rx=0 tx=0).stop 2024-02-16T22:19:06.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.008+0000 7fdafe9da700 1 -- 172.21.15.134:0/2936751534 shutdown_connections 2024-02-16T22:19:06.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.008+0000 7fdafe9da700 1 --2- 172.21.15.134:0/2936751534 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fdae006b1c0 0x7fdae006d670 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.008+0000 7fdafe9da700 1 --2- 172.21.15.134:0/2936751534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaf8070840 0x7fdaf810fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.008+0000 7fdafe9da700 1 --2- 172.21.15.134:0/2936751534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf8071e90 0x7fdaf8110020 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.008+0000 7fdafe9da700 1 -- 172.21.15.134:0/2936751534 >> 172.21.15.134:0/2936751534 conn(0x7fdaf80f8620 msgr2=0x7fdaf8102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:06.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.009+0000 7fdafe9da700 1 -- 172.21.15.134:0/2936751534 shutdown_connections 2024-02-16T22:19:06.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.009+0000 7fdafe9da700 1 -- 172.21.15.134:0/2936751534 wait complete. 2024-02-16T22:19:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.152+0000 7ff2d838e700 1 -- 172.21.15.134:0/1715460820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d0100360 msgr2=0x7ff2d01007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.152+0000 7ff2d838e700 1 --2- 172.21.15.134:0/1715460820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d0100360 0x7ff2d01007b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0004940 tx=0x7ff2c0009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.152+0000 7ff2d838e700 1 -- 172.21.15.134:0/1715460820 shutdown_connections 2024-02-16T22:19:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.152+0000 7ff2d838e700 1 --2- 172.21.15.134:0/1715460820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d0100360 0x7ff2d01007b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.152+0000 7ff2d838e700 1 --2- 172.21.15.134:0/1715460820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d00ff150 0x7ff2d00ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.152+0000 7ff2d838e700 1 -- 172.21.15.134:0/1715460820 >> 172.21.15.134:0/1715460820 conn(0x7ff2d00fa920 msgr2=0x7ff2d00fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.152+0000 7ff2d838e700 1 -- 172.21.15.134:0/1715460820 shutdown_connections 2024-02-16T22:19:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.152+0000 7ff2d838e700 1 -- 172.21.15.134:0/1715460820 wait complete. 2024-02-16T22:19:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.152+0000 7ff2d838e700 1 Processor -- start 2024-02-16T22:19:06.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.152+0000 7ff2d838e700 1 -- start start 2024-02-16T22:19:06.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.153+0000 7ff2d838e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d00ff150 0x7ff2d010fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.153+0000 7ff2d838e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d0100360 0x7ff2d0110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.153+0000 7ff2d838e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0110650 con 0x7ff2d0100360 2024-02-16T22:19:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.153+0000 7ff2d838e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0110ef0 con 0x7ff2d00ff150 2024-02-16T22:19:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.153+0000 7ff2d612a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d00ff150 0x7ff2d010fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.153+0000 7ff2d5929700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d0100360 0x7ff2d0110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.153+0000 7ff2d612a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d00ff150 0x7ff2d010fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.134:36430/0 (socket says 172.21.15.134:36430) 2024-02-16T22:19:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.153+0000 7ff2d612a700 1 -- 172.21.15.134:0/734954665 learned_addr learned my addr 172.21.15.134:0/734954665 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:19:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.153+0000 7ff2d5929700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d0100360 0x7ff2d0110050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59318/0 (socket says 172.21.15.134:59318) 2024-02-16T22:19:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.153+0000 7ff2d5929700 1 -- 172.21.15.134:0/734954665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d00ff150 msgr2=0x7ff2d010fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.153+0000 7ff2d5929700 1 --2- 172.21.15.134:0/734954665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d00ff150 0x7ff2d010fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.153+0000 7ff2d5929700 1 -- 172.21.15.134:0/734954665 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c0005040 con 0x7ff2d0100360 2024-02-16T22:19:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.153+0000 7ff2d612a700 1 --2- 172.21.15.134:0/734954665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d00ff150 0x7ff2d010fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:19:06.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.153+0000 7ff2d5929700 1 --2- 172.21.15.134:0/734954665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d0100360 0x7ff2d0110050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0004890 tx=0x7ff2c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:06.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.154+0000 7ff2c6ffd700 1 -- 172.21.15.134:0/734954665 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c0021070 con 0x7ff2d0100360 2024-02-16T22:19:06.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.154+0000 7ff2d838e700 1 -- 172.21.15.134:0/734954665 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d0111170 con 0x7ff2d0100360 2024-02-16T22:19:06.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.154+0000 7ff2c6ffd700 1 -- 172.21.15.134:0/734954665 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2c00093f0 con 0x7ff2d0100360 2024-02-16T22:19:06.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.154+0000 7ff2d838e700 1 -- 172.21.15.134:0/734954665 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d01116b0 con 0x7ff2d0100360 2024-02-16T22:19:06.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.154+0000 7ff2c6ffd700 1 -- 172.21.15.134:0/734954665 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c000e070 con 0x7ff2d0100360 2024-02-16T22:19:06.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.155+0000 7ff2d838e700 1 -- 172.21.15.134:0/734954665 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d004bed0 con 0x7ff2d0100360 2024-02-16T22:19:06.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.155+0000 7ff2c6ffd700 1 -- 172.21.15.134:0/734954665 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) v1 ==== 88916+0+0 (secure 0 0 0) 0x7ff2c0013d00 con 0x7ff2d0100360 2024-02-16T22:19:06.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.156+0000 7ff2c6ffd700 1 --2- 172.21.15.134:0/734954665 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff2bc06b150 0x7ff2bc06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:06.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.156+0000 7ff2c6ffd700 1 -- 172.21.15.134:0/734954665 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff2c008ab50 con 0x7ff2d0100360 2024-02-16T22:19:06.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.156+0000 7ff2d612a700 1 --2- 172.21.15.134:0/734954665 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff2bc06b150 0x7ff2bc06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:06.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.156+0000 7ff2d612a700 1 --2- 172.21.15.134:0/734954665 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff2bc06b150 0x7ff2bc06d600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00f6a0 tx=0x7ff2cc00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:06.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.161+0000 7ff2c6ffd700 1 -- 172.21.15.134:0/734954665 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff2c005a980 con 0x7ff2d0100360 2024-02-16T22:19:06.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:06 smithi173 ceph-mon[37280]: pgmap v255: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 239 MiB/s rd, 303 MiB/s wr, 398 op/s 2024-02-16T22:19:06.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:06 smithi173 ceph-mon[37280]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:06.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:06 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:19:06.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:06 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:19:06.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.460+0000 7ff2d838e700 1 -- 172.21.15.134:0/734954665 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff2d0107c30 con 0x7ff2d0100360 2024-02-16T22:19:06.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:06 smithi134 ceph-mon[28869]: pgmap v255: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 239 MiB/s rd, 303 MiB/s wr, 398 op/s 2024-02-16T22:19:06.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:06 smithi134 ceph-mon[28869]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:06.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:06 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:19:06.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:06 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:19:06.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.460+0000 7ff2c6ffd700 1 -- 172.21.15.134:0/734954665 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7ff2c005a980 con 0x7ff2d0100360 2024-02-16T22:19:06.463 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:19:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:19:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 2 2024-02-16T22:19:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:19:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:19:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 1, 2024-02-16T22:19:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-16T22:19:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:19:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:19:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 6 2024-02-16T22:19:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:19:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:19:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:19:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:19:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:19:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 13, 2024-02-16T22:19:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-16T22:19:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:19:06.464 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:19:06.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.463+0000 7ff2d838e700 1 -- 172.21.15.134:0/734954665 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff2bc06b150 msgr2=0x7ff2bc06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:06.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.463+0000 7ff2d838e700 1 --2- 172.21.15.134:0/734954665 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff2bc06b150 0x7ff2bc06d600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00f6a0 tx=0x7ff2cc00b040 comp rx=0 tx=0).stop 2024-02-16T22:19:06.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.463+0000 7ff2d838e700 1 -- 172.21.15.134:0/734954665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d0100360 msgr2=0x7ff2d0110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:06.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.463+0000 7ff2d838e700 1 --2- 172.21.15.134:0/734954665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d0100360 0x7ff2d0110050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0004890 tx=0x7ff2c0009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:06.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.463+0000 7ff2d838e700 1 -- 172.21.15.134:0/734954665 shutdown_connections 2024-02-16T22:19:06.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.463+0000 7ff2d838e700 1 --2- 172.21.15.134:0/734954665 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7ff2bc06b150 0x7ff2bc06d600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.463+0000 7ff2d838e700 1 --2- 172.21.15.134:0/734954665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d00ff150 0x7ff2d010fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.463+0000 7ff2d838e700 1 --2- 172.21.15.134:0/734954665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d0100360 0x7ff2d0110050 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.463+0000 7ff2d838e700 1 -- 172.21.15.134:0/734954665 >> 172.21.15.134:0/734954665 conn(0x7ff2d00fa920 msgr2=0x7ff2d0103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:06.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.463+0000 7ff2d838e700 1 -- 172.21.15.134:0/734954665 shutdown_connections 2024-02-16T22:19:06.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.463+0000 7ff2d838e700 1 -- 172.21.15.134:0/734954665 wait complete. 2024-02-16T22:19:06.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.570+0000 7faff3191700 1 -- 172.21.15.134:0/2454020480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec0fda80 msgr2=0x7fafec0ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.570+0000 7faff3191700 1 --2- 172.21.15.134:0/2454020480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec0fda80 0x7fafec0ffe60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fafe0004940 tx=0x7fafe0009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.570+0000 7faff3191700 1 -- 172.21.15.134:0/2454020480 shutdown_connections 2024-02-16T22:19:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.570+0000 7faff3191700 1 --2- 172.21.15.134:0/2454020480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafec1003a0 0x7fafec102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.570+0000 7faff3191700 1 --2- 172.21.15.134:0/2454020480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec0fda80 0x7fafec0ffe60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.570+0000 7faff3191700 1 -- 172.21.15.134:0/2454020480 >> 172.21.15.134:0/2454020480 conn(0x7fafec0f74e0 msgr2=0x7fafec0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.570+0000 7faff3191700 1 -- 172.21.15.134:0/2454020480 shutdown_connections 2024-02-16T22:19:06.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.570+0000 7faff3191700 1 -- 172.21.15.134:0/2454020480 wait complete. 2024-02-16T22:19:06.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.571+0000 7faff3191700 1 Processor -- start 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.571+0000 7faff3191700 1 -- start start 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.571+0000 7faff3191700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec0fda80 0x7fafec10d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.571+0000 7faff3191700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafec1003a0 0x7fafec10de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.571+0000 7faff3191700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec10e470 con 0x7fafec0fda80 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.571+0000 7faff3191700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec10ed10 con 0x7fafec1003a0 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.571+0000 7faff0f2d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec0fda80 0x7fafec10d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.571+0000 7faff0f2d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec0fda80 0x7fafec10d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59340/0 (socket says 172.21.15.134:59340) 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.571+0000 7faff0f2d700 1 -- 172.21.15.134:0/2473797118 learned_addr learned my addr 172.21.15.134:0/2473797118 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.571+0000 7fafebfff700 1 --2- 172.21.15.134:0/2473797118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafec1003a0 0x7fafec10de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.571+0000 7faff0f2d700 1 -- 172.21.15.134:0/2473797118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafec1003a0 msgr2=0x7fafec10de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.571+0000 7faff0f2d700 1 --2- 172.21.15.134:0/2473797118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafec1003a0 0x7fafec10de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.571+0000 7faff0f2d700 1 -- 172.21.15.134:0/2473797118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0005040 con 0x7fafec0fda80 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.572+0000 7faff0f2d700 1 --2- 172.21.15.134:0/2473797118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec0fda80 0x7fafec10d930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fafe00093b0 tx=0x7fafe0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.572+0000 7fafe97fa700 1 -- 172.21.15.134:0/2473797118 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafe000e040 con 0x7fafec0fda80 2024-02-16T22:19:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.572+0000 7fafe97fa700 1 -- 172.21.15.134:0/2473797118 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fafe000bcc0 con 0x7fafec0fda80 2024-02-16T22:19:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.572+0000 7faff3191700 1 -- 172.21.15.134:0/2473797118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafec10ef90 con 0x7fafec0fda80 2024-02-16T22:19:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.572+0000 7fafe97fa700 1 -- 172.21.15.134:0/2473797118 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafe001c630 con 0x7fafec0fda80 2024-02-16T22:19:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.572+0000 7faff3191700 1 -- 172.21.15.134:0/2473797118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafec10f4d0 con 0x7fafec0fda80 2024-02-16T22:19:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.573+0000 7faff3191700 1 -- 172.21.15.134:0/2473797118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafec04bed0 con 0x7fafec0fda80 2024-02-16T22:19:06.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.574+0000 7fafe97fa700 1 -- 172.21.15.134:0/2473797118 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) v1 ==== 88916+0+0 (secure 0 0 0) 0x7fafe0013980 con 0x7fafec0fda80 2024-02-16T22:19:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.574+0000 7fafe97fa700 1 --2- 172.21.15.134:0/2473797118 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fafdc06f5d0 0x7fafdc071a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.574+0000 7fafe97fa700 1 -- 172.21.15.134:0/2473797118 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fafe008b8b0 con 0x7fafec0fda80 2024-02-16T22:19:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.574+0000 7fafebfff700 1 --2- 172.21.15.134:0/2473797118 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fafdc06f5d0 0x7fafdc071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:06.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.575+0000 7fafebfff700 1 --2- 172.21.15.134:0/2473797118 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fafdc06f5d0 0x7fafdc071a80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fafd8004f40 tx=0x7fafd800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:06.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.578+0000 7fafe97fa700 1 -- 172.21.15.134:0/2473797118 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fafe005b6c0 con 0x7fafec0fda80 2024-02-16T22:19:06.615 INFO:tasks.workunit.client.1.smithi173.stdout:8/86: mkdir dd/d11/d22 0 2024-02-16T22:19:06.615 INFO:tasks.workunit.client.1.smithi173.stdout:8/87: dread - dd/d11/f13 zero size 2024-02-16T22:19:06.615 INFO:tasks.workunit.client.1.smithi173.stdout:8/88: chown dd/d11/d22 49640803 1 2024-02-16T22:19:06.615 INFO:tasks.workunit.client.1.smithi173.stdout:8/89: stat dd/d11/f14 0 2024-02-16T22:19:06.615 INFO:tasks.workunit.client.1.smithi173.stdout:8/90: creat dd/d11/f23 x:0 0 0 2024-02-16T22:19:06.615 INFO:tasks.workunit.client.1.smithi173.stdout:8/91: truncate dd/d11/f23 474615 0 2024-02-16T22:19:06.616 INFO:tasks.workunit.client.1.smithi173.stdout:2/73: creat d2/db/f18 x:0 0 0 2024-02-16T22:19:06.616 INFO:tasks.workunit.client.1.smithi173.stdout:2/74: write d2/db/f18 [247980,27219] 0 2024-02-16T22:19:06.616 INFO:tasks.workunit.client.1.smithi173.stdout:7/24: creat d1/fb x:0 0 0 2024-02-16T22:19:06.617 INFO:tasks.workunit.client.1.smithi173.stdout:7/25: chown d1/d5 648321348 1 2024-02-16T22:19:06.617 INFO:tasks.workunit.client.1.smithi173.stdout:7/26: write d1/d5/f4 [5104354,6136] 0 2024-02-16T22:19:06.617 INFO:tasks.workunit.client.1.smithi173.stdout:7/27: rename d1/d5 to d1/d5/da/dc 22 2024-02-16T22:19:06.619 INFO:tasks.workunit.client.1.smithi173.stdout:6/7: unlink d0/f1 0 2024-02-16T22:19:06.619 INFO:tasks.workunit.client.1.smithi173.stdout:6/8: write - no filename 2024-02-16T22:19:06.619 INFO:tasks.workunit.client.1.smithi173.stdout:6/9: chown d0 10 1 2024-02-16T22:19:06.619 INFO:tasks.workunit.client.1.smithi173.stdout:6/10: write - no filename 2024-02-16T22:19:06.619 INFO:tasks.workunit.client.1.smithi173.stdout:6/11: chown d0 587145 1 2024-02-16T22:19:06.619 INFO:tasks.workunit.client.1.smithi173.stdout:6/12: write - no filename 2024-02-16T22:19:06.619 INFO:tasks.workunit.client.1.smithi173.stdout:6/13: write - no filename 2024-02-16T22:19:06.623 INFO:tasks.workunit.client.1.smithi173.stdout:3/13: unlink l4 0 2024-02-16T22:19:06.623 INFO:tasks.workunit.client.1.smithi173.stdout:0/82: symlink d0/l20 0 2024-02-16T22:19:06.628 INFO:tasks.workunit.client.1.smithi173.stdout:4/26: dread f1 [0,4194304] 0 2024-02-16T22:19:06.631 INFO:tasks.workunit.client.1.smithi173.stdout:8/92: creat dd/f24 x:0 0 0 2024-02-16T22:19:06.631 INFO:tasks.workunit.client.1.smithi173.stdout:1/6: getdents . 0 2024-02-16T22:19:06.631 INFO:tasks.workunit.client.1.smithi173.stdout:1/7: fsync f0 0 2024-02-16T22:19:06.633 INFO:tasks.workunit.client.1.smithi173.stdout:2/75: unlink d2/d10/c13 0 2024-02-16T22:19:06.635 INFO:tasks.workunit.client.1.smithi173.stdout:7/28: mknod d1/d5/cd 0 2024-02-16T22:19:06.636 INFO:tasks.workunit.client.1.smithi173.stdout:6/14: symlink d0/l2 0 2024-02-16T22:19:06.637 INFO:tasks.workunit.client.1.smithi173.stdout:0/83: dread d0/fb [0,4194304] 0 2024-02-16T22:19:06.637 INFO:tasks.workunit.client.1.smithi173.stdout:1/8: creat f1 x:0 0 0 2024-02-16T22:19:06.639 INFO:tasks.workunit.client.1.smithi173.stdout:0/84: dread d0/d4/d14/f16 [0,4194304] 0 2024-02-16T22:19:06.639 INFO:tasks.workunit.client.1.smithi173.stdout:0/85: chown d0/d12 197210176 1 2024-02-16T22:19:06.639 INFO:tasks.workunit.client.1.smithi173.stdout:0/86: chown d0/d4/d14 80266276 1 2024-02-16T22:19:06.640 INFO:tasks.workunit.client.1.smithi173.stdout:6/15: link d0/l2 d0/l3 0 2024-02-16T22:19:06.640 INFO:tasks.workunit.client.1.smithi173.stdout:6/16: rename d0 to d0/d4 22 2024-02-16T22:19:06.640 INFO:tasks.workunit.client.1.smithi173.stdout:1/9: creat f2 x:0 0 0 2024-02-16T22:19:06.640 INFO:tasks.workunit.client.1.smithi173.stdout:1/10: dread - f1 zero size 2024-02-16T22:19:06.641 INFO:tasks.workunit.client.1.smithi173.stdout:7/29: getdents d1 0 2024-02-16T22:19:06.642 INFO:tasks.workunit.client.1.smithi173.stdout:0/87: mkdir d0/d4/d14/d21 0 2024-02-16T22:19:06.644 INFO:tasks.workunit.client.1.smithi173.stdout:1/11: write f0 [147653,69073] 0 2024-02-16T22:19:06.645 INFO:tasks.workunit.client.1.smithi173.stdout:1/12: chown f0 38 1 2024-02-16T22:19:06.645 INFO:tasks.workunit.client.1.smithi173.stdout:7/30: rmdir d1/d5/da 0 2024-02-16T22:19:06.645 INFO:tasks.workunit.client.1.smithi173.stdout:7/31: chown d1/d5/f4 7814 1 2024-02-16T22:19:06.645 INFO:tasks.workunit.client.1.smithi173.stdout:5/56: sync 2024-02-16T22:19:06.645 INFO:tasks.workunit.client.1.smithi173.stdout:9/6: sync 2024-02-16T22:19:06.645 INFO:tasks.workunit.client.1.smithi173.stdout:9/7: dread - no filename 2024-02-16T22:19:06.645 INFO:tasks.workunit.client.1.smithi173.stdout:0/88: getdents d0 0 2024-02-16T22:19:06.645 INFO:tasks.workunit.client.1.smithi173.stdout:0/89: chown d0/f5 239 1 2024-02-16T22:19:06.647 INFO:tasks.workunit.client.1.smithi173.stdout:8/93: dread f5 [4194304,4194304] 0 2024-02-16T22:19:06.647 INFO:tasks.workunit.client.1.smithi173.stdout:7/32: rename d1/d5/f8 to d1/d5/fe 0 2024-02-16T22:19:06.647 INFO:tasks.workunit.client.1.smithi173.stdout:7/33: creat d1/d5/ff x:0 0 0 2024-02-16T22:19:06.647 INFO:tasks.workunit.client.1.smithi173.stdout:5/57: link c1 d8/c15 0 2024-02-16T22:19:06.648 INFO:tasks.workunit.client.1.smithi173.stdout:9/8: creat f0 x:0 0 0 2024-02-16T22:19:06.648 INFO:tasks.workunit.client.1.smithi173.stdout:9/9: chown f0 14 1 2024-02-16T22:19:06.648 INFO:tasks.workunit.client.1.smithi173.stdout:3/14: dwrite f1 [0,4194304] 0 2024-02-16T22:19:06.649 INFO:tasks.workunit.client.1.smithi173.stdout:0/90: truncate d0/fb 1082043 0 2024-02-16T22:19:06.649 INFO:tasks.workunit.client.1.smithi173.stdout:4/27: dwrite f5 [0,4194304] 0 2024-02-16T22:19:06.650 INFO:tasks.workunit.client.1.smithi173.stdout:8/94: mknod dd/d11/d22/c25 0 2024-02-16T22:19:06.650 INFO:tasks.workunit.client.1.smithi173.stdout:8/95: chown dd/c1f 76 1 2024-02-16T22:19:06.651 INFO:tasks.workunit.client.1.smithi173.stdout:5/58: dread - d8/da/f11 zero size 2024-02-16T22:19:06.651 INFO:tasks.workunit.client.1.smithi173.stdout:5/59: readlink d8/l10 0 2024-02-16T22:19:06.651 INFO:tasks.workunit.client.1.smithi173.stdout:5/60: chown d8/f14 68723394 1 2024-02-16T22:19:06.651 INFO:tasks.workunit.client.1.smithi173.stdout:7/34: mkdir d1/d5/d10 0 2024-02-16T22:19:06.651 INFO:tasks.workunit.client.1.smithi173.stdout:7/35: stat d1/d5/d10 0 2024-02-16T22:19:06.651 INFO:tasks.workunit.client.1.smithi173.stdout:7/36: stat d1/d5/cd 0 2024-02-16T22:19:06.652 INFO:tasks.workunit.client.1.smithi173.stdout:9/10: mkdir d1 0 2024-02-16T22:19:06.652 INFO:tasks.workunit.client.1.smithi173.stdout:9/11: chown d1 5 1 2024-02-16T22:19:06.658 INFO:tasks.workunit.client.1.smithi173.stdout:2/76: rmdir d2/d10 39 2024-02-16T22:19:06.658 INFO:tasks.workunit.client.1.smithi173.stdout:2/77: fsync d2/d4/f7 0 2024-02-16T22:19:06.658 INFO:tasks.workunit.client.1.smithi173.stdout:5/61: dread f7 [0,4194304] 0 2024-02-16T22:19:06.658 INFO:tasks.workunit.client.1.smithi173.stdout:5/62: write f7 [1781915,109031] 0 2024-02-16T22:19:06.658 INFO:tasks.workunit.client.1.smithi173.stdout:3/15: rename l3 to l5 0 2024-02-16T22:19:06.658 INFO:tasks.workunit.client.1.smithi173.stdout:3/16: chown l5 216 1 2024-02-16T22:19:06.658 INFO:tasks.workunit.client.1.smithi173.stdout:1/13: fsync f2 0 2024-02-16T22:19:06.659 INFO:tasks.workunit.client.1.smithi173.stdout:1/14: rmdir - no directory 2024-02-16T22:19:06.659 INFO:tasks.workunit.client.1.smithi173.stdout:1/15: write f2 [717631,5005] 0 2024-02-16T22:19:06.659 INFO:tasks.workunit.client.1.smithi173.stdout:1/16: rmdir - no directory 2024-02-16T22:19:06.659 INFO:tasks.workunit.client.1.smithi173.stdout:9/12: mkdir d1/d2 0 2024-02-16T22:19:06.659 INFO:tasks.workunit.client.1.smithi173.stdout:4/28: mkdir d7 0 2024-02-16T22:19:06.663 INFO:tasks.workunit.client.1.smithi173.stdout:2/78: dread d2/d4/f6 [0,4194304] 0 2024-02-16T22:19:06.663 INFO:tasks.workunit.client.1.smithi173.stdout:5/63: fsync d8/da/fc 0 2024-02-16T22:19:06.665 INFO:tasks.workunit.client.1.smithi173.stdout:7/37: dread d1/d5/f4 [0,4194304] 0 2024-02-16T22:19:06.665 INFO:tasks.workunit.client.1.smithi173.stdout:7/38: read d1/d5/fe [226892,39208] 0 2024-02-16T22:19:06.666 INFO:tasks.workunit.client.1.smithi173.stdout:3/17: mknod c6 0 2024-02-16T22:19:06.666 INFO:tasks.workunit.client.1.smithi173.stdout:3/18: creat f7 x:0 0 0 2024-02-16T22:19:06.666 INFO:tasks.workunit.client.1.smithi173.stdout:3/19: readlink l5 0 2024-02-16T22:19:06.667 INFO:tasks.workunit.client.1.smithi173.stdout:9/13: symlink d1/d2/l3 0 2024-02-16T22:19:06.668 INFO:tasks.workunit.client.1.smithi173.stdout:1/17: dread f0 [0,4194304] 0 2024-02-16T22:19:06.668 INFO:tasks.workunit.client.1.smithi173.stdout:1/18: rmdir - no directory 2024-02-16T22:19:06.668 INFO:tasks.workunit.client.1.smithi173.stdout:0/91: dwrite d0/d12/d15/f1c [0,4194304] 0 2024-02-16T22:19:06.669 INFO:tasks.workunit.client.1.smithi173.stdout:4/29: link c6 d7/c8 0 2024-02-16T22:19:06.671 INFO:tasks.workunit.client.1.smithi173.stdout:8/96: rmdir dd/d11 39 2024-02-16T22:19:06.674 INFO:tasks.workunit.client.1.smithi173.stdout:5/64: dread d8/fb [0,4194304] 0 2024-02-16T22:19:06.674 INFO:tasks.workunit.client.1.smithi173.stdout:5/65: write d8/f14 [130086,14878] 0 2024-02-16T22:19:06.675 INFO:tasks.workunit.client.1.smithi173.stdout:3/20: rename f1 to f8 0 2024-02-16T22:19:06.675 INFO:tasks.workunit.client.1.smithi173.stdout:7/39: dread d1/d5/fe [0,4194304] 0 2024-02-16T22:19:06.675 INFO:tasks.workunit.client.1.smithi173.stdout:7/40: dread - d1/fb zero size 2024-02-16T22:19:06.675 INFO:tasks.workunit.client.1.smithi173.stdout:7/41: write d1/d5/ff [142831,123349] 0 2024-02-16T22:19:06.676 INFO:tasks.workunit.client.1.smithi173.stdout:9/14: creat d1/d2/f4 x:0 0 0 2024-02-16T22:19:06.676 INFO:tasks.workunit.client.1.smithi173.stdout:9/15: truncate d1/d2/f4 635308 0 2024-02-16T22:19:06.677 INFO:tasks.workunit.client.1.smithi173.stdout:7/42: dread d1/f9 [0,4194304] 0 2024-02-16T22:19:06.677 INFO:tasks.workunit.client.1.smithi173.stdout:7/43: chown d1/d5/f4 25 1 2024-02-16T22:19:06.677 INFO:tasks.workunit.client.1.smithi173.stdout:7/44: write d1/f9 [1377035,78183] 0 2024-02-16T22:19:06.680 INFO:tasks.workunit.client.1.smithi173.stdout:0/92: symlink d0/d4/d14/d21/l22 0 2024-02-16T22:19:06.681 INFO:tasks.workunit.client.1.smithi173.stdout:4/30: creat d7/f9 x:0 0 0 2024-02-16T22:19:06.681 INFO:tasks.workunit.client.1.smithi173.stdout:4/31: truncate d7/f9 143009 0 2024-02-16T22:19:06.681 INFO:tasks.workunit.client.1.smithi173.stdout:4/32: truncate d7/f9 1131075 0 2024-02-16T22:19:06.682 INFO:tasks.workunit.client.1.smithi173.stdout:5/66: fdatasync d8/da/f12 0 2024-02-16T22:19:06.684 INFO:tasks.workunit.client.1.smithi173.stdout:3/21: truncate f2 331083 0 2024-02-16T22:19:06.686 INFO:tasks.workunit.client.1.smithi173.stdout:7/45: mkdir d1/d5/d11 0 2024-02-16T22:19:06.686 INFO:tasks.workunit.client.1.smithi173.stdout:7/46: readlink d1/l7 0 2024-02-16T22:19:06.688 INFO:tasks.workunit.client.1.smithi173.stdout:1/19: rename f0 to f3 0 2024-02-16T22:19:06.688 INFO:tasks.workunit.client.1.smithi173.stdout:8/97: dread dd/d11/f14 [0,4194304] 0 2024-02-16T22:19:06.688 INFO:tasks.workunit.client.1.smithi173.stdout:2/79: dwrite d2/f17 [0,4194304] 0 2024-02-16T22:19:06.688 INFO:tasks.workunit.client.1.smithi173.stdout:2/80: write f1 [3240026,79104] 0 2024-02-16T22:19:06.689 INFO:tasks.workunit.client.1.smithi173.stdout:4/33: mknod d7/ca 0 2024-02-16T22:19:06.696 INFO:tasks.workunit.client.1.smithi173.stdout:3/22: mkdir d9 0 2024-02-16T22:19:06.696 INFO:tasks.workunit.client.1.smithi173.stdout:3/23: stat f7 0 2024-02-16T22:19:06.701 INFO:tasks.workunit.client.1.smithi173.stdout:8/98: mknod dd/d11/d22/c26 0 2024-02-16T22:19:06.701 INFO:tasks.workunit.client.1.smithi173.stdout:8/99: truncate dd/d11/f23 881568 0 2024-02-16T22:19:06.703 INFO:tasks.workunit.client.1.smithi173.stdout:4/34: mknod d7/cb 0 2024-02-16T22:19:06.703 INFO:tasks.workunit.client.1.smithi173.stdout:0/93: dwrite d0/d4/f18 [0,4194304] 0 2024-02-16T22:19:06.703 INFO:tasks.workunit.client.1.smithi173.stdout:0/94: truncate d0/ff 776864 0 2024-02-16T22:19:06.703 INFO:tasks.workunit.client.1.smithi173.stdout:0/95: chown d0/d12/c1f 144156320 1 2024-02-16T22:19:06.708 INFO:tasks.workunit.client.1.smithi173.stdout:2/81: rename d2/db/de to d2/dc/d19 0 2024-02-16T22:19:06.709 INFO:tasks.workunit.client.1.smithi173.stdout:1/20: dwrite f3 [0,4194304] 0 2024-02-16T22:19:06.709 INFO:tasks.workunit.client.1.smithi173.stdout:2/82: mkdir d2/dc/d19/d1a 0 2024-02-16T22:19:06.710 INFO:tasks.workunit.client.1.smithi173.stdout:3/24: write f8 [399705,94195] 0 2024-02-16T22:19:06.710 INFO:tasks.workunit.client.1.smithi173.stdout:3/25: dread - f7 zero size 2024-02-16T22:19:06.711 INFO:tasks.workunit.client.1.smithi173.stdout:7/47: rmdir d1/d5 39 2024-02-16T22:19:06.715 INFO:tasks.workunit.client.1.smithi173.stdout:2/83: creat d2/d4/f1b x:0 0 0 2024-02-16T22:19:06.716 INFO:tasks.workunit.client.1.smithi173.stdout:2/84: write d2/dc/d19/f16 [2019680,114490] 0 2024-02-16T22:19:06.716 INFO:tasks.workunit.client.1.smithi173.stdout:2/85: stat d2/dc/d19/f16 0 2024-02-16T22:19:06.716 INFO:tasks.workunit.client.1.smithi173.stdout:5/67: write d8/fd [702744,115972] 0 2024-02-16T22:19:06.718 INFO:tasks.workunit.client.1.smithi173.stdout:4/35: read f5 [3510276,126758] 0 2024-02-16T22:19:06.719 INFO:tasks.workunit.client.1.smithi173.stdout:4/36: creat d7/fc x:0 0 0 2024-02-16T22:19:06.719 INFO:tasks.workunit.client.1.smithi173.stdout:3/26: mkdir d9/da 0 2024-02-16T22:19:06.720 INFO:tasks.workunit.client.1.smithi173.stdout:1/21: symlink l4 0 2024-02-16T22:19:06.721 INFO:tasks.workunit.client.1.smithi173.stdout:5/68: getdents d8/da 0 2024-02-16T22:19:06.728 INFO:tasks.workunit.client.1.smithi173.stdout:0/96: dread d0/d12/d15/f1c [0,4194304] 0 2024-02-16T22:19:06.728 INFO:tasks.workunit.client.1.smithi173.stdout:1/22: truncate f2 614768 0 2024-02-16T22:19:06.728 INFO:tasks.workunit.client.1.smithi173.stdout:1/23: rmdir - no directory 2024-02-16T22:19:06.729 INFO:tasks.workunit.client.1.smithi173.stdout:5/69: mknod d8/c16 0 2024-02-16T22:19:06.731 INFO:tasks.workunit.client.1.smithi173.stdout:0/97: link d0/d4/f8 d0/d4/d14/f23 0 2024-02-16T22:19:06.734 INFO:tasks.workunit.client.1.smithi173.stdout:5/70: rmdir d8/da 39 2024-02-16T22:19:06.735 INFO:tasks.workunit.client.1.smithi173.stdout:5/71: mknod d8/da/c17 0 2024-02-16T22:19:06.737 INFO:tasks.workunit.client.1.smithi173.stdout:5/72: symlink d8/l18 0 2024-02-16T22:19:06.737 INFO:tasks.workunit.client.1.smithi173.stdout:5/73: fdatasync f4 0 2024-02-16T22:19:06.737 INFO:tasks.workunit.client.1.smithi173.stdout:5/74: readlink l3 0 2024-02-16T22:19:06.738 INFO:tasks.workunit.client.1.smithi173.stdout:5/75: link d8/da/ce d8/c19 0 2024-02-16T22:19:06.740 INFO:tasks.workunit.client.1.smithi173.stdout:2/86: dwrite f1 [0,4194304] 0 2024-02-16T22:19:06.740 INFO:tasks.workunit.client.1.smithi173.stdout:7/48: dwrite d1/d5/fe [0,4194304] 0 2024-02-16T22:19:06.740 INFO:tasks.workunit.client.1.smithi173.stdout:7/49: chown d1/d5/f4 611 1 2024-02-16T22:19:06.740 INFO:tasks.workunit.client.1.smithi173.stdout:2/87: write d2/d4/f6 [2709026,21893] 0 2024-02-16T22:19:06.744 INFO:tasks.workunit.client.1.smithi173.stdout:4/37: getdents d7 0 2024-02-16T22:19:06.750 INFO:tasks.workunit.client.1.smithi173.stdout:2/88: dread d2/f17 [0,4194304] 0 2024-02-16T22:19:06.750 INFO:tasks.workunit.client.1.smithi173.stdout:2/89: write d2/db/f18 [882024,130186] 0 2024-02-16T22:19:06.750 INFO:tasks.workunit.client.1.smithi173.stdout:2/90: write d2/db/f15 [474898,130554] 0 2024-02-16T22:19:06.750 INFO:tasks.workunit.client.1.smithi173.stdout:1/24: write f2 [381789,7115] 0 2024-02-16T22:19:06.750 INFO:tasks.workunit.client.1.smithi173.stdout:1/25: stat f3 0 2024-02-16T22:19:06.752 INFO:tasks.workunit.client.1.smithi173.stdout:2/91: mkdir d2/dc/d19/d1c 0 2024-02-16T22:19:06.752 INFO:tasks.workunit.client.1.smithi173.stdout:7/50: truncate d1/d5/fe 2735386 0 2024-02-16T22:19:06.753 INFO:tasks.workunit.client.1.smithi173.stdout:1/26: creat f5 x:0 0 0 2024-02-16T22:19:06.755 INFO:tasks.workunit.client.1.smithi173.stdout:2/92: truncate d2/f17 3819612 0 2024-02-16T22:19:06.755 INFO:tasks.workunit.client.1.smithi173.stdout:7/51: symlink d1/d5/d11/l12 0 2024-02-16T22:19:06.757 INFO:tasks.workunit.client.1.smithi173.stdout:2/93: mknod d2/db/c1d 0 2024-02-16T22:19:06.757 INFO:tasks.workunit.client.1.smithi173.stdout:2/94: truncate d2/ff 1176089 0 2024-02-16T22:19:06.758 INFO:tasks.workunit.client.1.smithi173.stdout:7/52: mkdir d1/d5/d13 0 2024-02-16T22:19:06.758 INFO:tasks.workunit.client.1.smithi173.stdout:7/53: readlink d1/l7 0 2024-02-16T22:19:06.759 INFO:tasks.workunit.client.1.smithi173.stdout:7/54: readlink d1/d5/d11/l12 0 2024-02-16T22:19:06.759 INFO:tasks.workunit.client.1.smithi173.stdout:7/55: fdatasync d1/fb 0 2024-02-16T22:19:06.759 INFO:tasks.workunit.client.1.smithi173.stdout:5/76: dwrite d8/da/fc [0,4194304] 0 2024-02-16T22:19:06.759 INFO:tasks.workunit.client.1.smithi173.stdout:5/77: read - d8/da/ff zero size 2024-02-16T22:19:06.759 INFO:tasks.workunit.client.1.smithi173.stdout:5/78: truncate d8/da/ff 749880 0 2024-02-16T22:19:06.760 INFO:tasks.workunit.client.1.smithi173.stdout:1/27: mknod c6 0 2024-02-16T22:19:06.761 INFO:tasks.workunit.client.1.smithi173.stdout:7/56: read d1/d5/f4 [1042743,46295] 0 2024-02-16T22:19:06.761 INFO:tasks.workunit.client.1.smithi173.stdout:2/95: getdents d2/dc/d19 0 2024-02-16T22:19:06.765 INFO:tasks.workunit.client.1.smithi173.stdout:5/79: link d8/fb d8/da/f1a 0 2024-02-16T22:19:06.767 INFO:tasks.workunit.client.1.smithi173.stdout:7/57: creat d1/d5/d11/f14 x:0 0 0 2024-02-16T22:19:06.769 INFO:tasks.workunit.client.1.smithi173.stdout:2/96: creat d2/dc/d19/d1c/f1e x:0 0 0 2024-02-16T22:19:06.769 INFO:tasks.workunit.client.1.smithi173.stdout:2/97: write d2/d4/f7 [8572649,103041] 0 2024-02-16T22:19:06.770 INFO:tasks.workunit.client.1.smithi173.stdout:5/80: mkdir d8/da/d1b 0 2024-02-16T22:19:06.771 INFO:tasks.workunit.client.1.smithi173.stdout:5/81: read d8/da/f1a [3432,98535] 0 2024-02-16T22:19:06.771 INFO:tasks.workunit.client.1.smithi173.stdout:1/28: mknod c7 0 2024-02-16T22:19:06.774 INFO:tasks.workunit.client.1.smithi173.stdout:7/58: symlink d1/d5/l15 0 2024-02-16T22:19:06.774 INFO:tasks.workunit.client.1.smithi173.stdout:7/59: stat d1/d5/f4 0 2024-02-16T22:19:06.777 INFO:tasks.workunit.client.1.smithi173.stdout:2/98: rename d2/ff to d2/dc/d19/f1f 0 2024-02-16T22:19:06.777 INFO:tasks.workunit.client.1.smithi173.stdout:2/99: chown f1 2431 1 2024-02-16T22:19:06.777 INFO:tasks.workunit.client.1.smithi173.stdout:2/100: creat d2/dc/d19/d1c/f20 x:0 0 0 2024-02-16T22:19:06.779 INFO:tasks.workunit.client.1.smithi173.stdout:7/60: mknod d1/d5/d13/c16 0 2024-02-16T22:19:06.781 INFO:tasks.workunit.client.1.smithi173.stdout:2/101: symlink d2/dc/l21 0 2024-02-16T22:19:06.781 INFO:tasks.workunit.client.1.smithi173.stdout:2/102: readlink d2/l3 0 2024-02-16T22:19:06.782 INFO:tasks.workunit.client.1.smithi173.stdout:7/61: symlink d1/d5/d13/l17 0 2024-02-16T22:19:06.784 INFO:tasks.workunit.client.1.smithi173.stdout:2/103: getdents d2/db 0 2024-02-16T22:19:06.784 INFO:tasks.workunit.client.1.smithi173.stdout:7/62: dread d1/f9 [0,4194304] 0 2024-02-16T22:19:06.785 INFO:tasks.workunit.client.1.smithi173.stdout:2/104: creat d2/f22 x:0 0 0 2024-02-16T22:19:06.786 INFO:tasks.workunit.client.1.smithi173.stdout:7/63: dread d1/f9 [0,4194304] 0 2024-02-16T22:19:06.787 INFO:tasks.workunit.client.1.smithi173.stdout:7/64: fdatasync d1/d5/f4 0 2024-02-16T22:19:06.787 INFO:tasks.workunit.client.1.smithi173.stdout:2/105: rename d2/l5 to d2/db/l23 0 2024-02-16T22:19:06.787 INFO:tasks.workunit.client.1.smithi173.stdout:7/65: truncate d1/d5/d11/f14 717505 0 2024-02-16T22:19:06.787 INFO:tasks.workunit.client.1.smithi173.stdout:2/106: write d2/dc/d19/d1c/f1e [219272,40032] 0 2024-02-16T22:19:06.787 INFO:tasks.workunit.client.1.smithi173.stdout:5/82: write d8/da/f1a [1486518,49187] 0 2024-02-16T22:19:06.788 INFO:tasks.workunit.client.1.smithi173.stdout:2/107: rmdir d2/dc/d19 39 2024-02-16T22:19:06.788 INFO:tasks.workunit.client.1.smithi173.stdout:2/108: chown d2/f17 120 1 2024-02-16T22:19:06.788 INFO:tasks.workunit.client.1.smithi173.stdout:7/66: read d1/f9 [1062176,114566] 0 2024-02-16T22:19:06.788 INFO:tasks.workunit.client.1.smithi173.stdout:7/67: fsync d1/d5/ff 0 2024-02-16T22:19:06.788 INFO:tasks.workunit.client.1.smithi173.stdout:7/68: fsync d1/d5/fe 0 2024-02-16T22:19:06.788 INFO:tasks.workunit.client.1.smithi173.stdout:7/69: write d1/d5/fe [3089470,86991] 0 2024-02-16T22:19:06.789 INFO:tasks.workunit.client.1.smithi173.stdout:1/29: dwrite f1 [0,4194304] 0 2024-02-16T22:19:06.790 INFO:tasks.workunit.client.1.smithi173.stdout:5/83: creat d8/da/f1c x:0 0 0 2024-02-16T22:19:06.790 INFO:tasks.workunit.client.1.smithi173.stdout:5/84: stat f4 0 2024-02-16T22:19:06.790 INFO:tasks.workunit.client.1.smithi173.stdout:5/85: chown d8/fb 2425549 1 2024-02-16T22:19:06.790 INFO:tasks.workunit.client.1.smithi173.stdout:5/86: creat d8/da/f1d x:0 0 0 2024-02-16T22:19:06.794 INFO:tasks.workunit.client.1.smithi173.stdout:5/87: unlink d8/da/f12 0 2024-02-16T22:19:06.796 INFO:tasks.workunit.client.1.smithi173.stdout:1/30: rename l4 to l8 0 2024-02-16T22:19:06.798 INFO:tasks.workunit.client.1.smithi173.stdout:1/31: rename f5 to f9 0 2024-02-16T22:19:06.798 INFO:tasks.workunit.client.1.smithi173.stdout:1/32: chown f9 0 1 2024-02-16T22:19:06.801 INFO:tasks.workunit.client.1.smithi173.stdout:1/33: mknod ca 0 2024-02-16T22:19:06.814 INFO:tasks.workunit.client.1.smithi173.stdout:7/70: dwrite d1/d5/f4 [4194304,4194304] 0 2024-02-16T22:19:06.814 INFO:tasks.workunit.client.1.smithi173.stdout:5/88: dwrite f7 [0,4194304] 0 2024-02-16T22:19:06.816 INFO:tasks.workunit.client.1.smithi173.stdout:7/71: mknod d1/d5/c18 0 2024-02-16T22:19:06.816 INFO:tasks.workunit.client.1.smithi173.stdout:7/72: truncate d1/f9 1850851 0 2024-02-16T22:19:06.819 INFO:tasks.workunit.client.1.smithi173.stdout:5/89: symlink d8/da/d1b/l1e 0 2024-02-16T22:19:06.820 INFO:tasks.workunit.client.1.smithi173.stdout:7/73: dread d1/d5/f4 [0,4194304] 0 2024-02-16T22:19:06.828 INFO:tasks.workunit.client.1.smithi173.stdout:7/74: dread d1/d5/f4 [4194304,4194304] 0 2024-02-16T22:19:06.828 INFO:tasks.workunit.client.1.smithi173.stdout:7/75: chown d1/l7 374 1 2024-02-16T22:19:06.831 INFO:tasks.workunit.client.1.smithi173.stdout:7/76: dread d1/d5/f4 [4194304,4194304] 0 2024-02-16T22:19:06.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.852+0000 7faff3191700 1 -- 172.21.15.134:0/2473797118 --> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fafec10fb30 con 0x7fafdc06f5d0 2024-02-16T22:19:06.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.854+0000 7fafe97fa700 1 -- 172.21.15.134:0/2473797118 <== mgr.14214 v2:172.21.15.134:6800/2578294352 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fafec10fb30 con 0x7fafdc06f5d0 2024-02-16T22:19:06.856 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:19:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:19:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:19:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-16T22:19:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-02-16T22:19:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "1/2 daemons upgraded", 2024-02-16T22:19:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mgr daemons", 2024-02-16T22:19:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:19:06.856 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:19:06.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.857+0000 7faff3191700 1 -- 172.21.15.134:0/2473797118 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fafdc06f5d0 msgr2=0x7fafdc071a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:06.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.857+0000 7faff3191700 1 --2- 172.21.15.134:0/2473797118 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fafdc06f5d0 0x7fafdc071a80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fafd8004f40 tx=0x7fafd800b040 comp rx=0 tx=0).stop 2024-02-16T22:19:06.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.857+0000 7faff3191700 1 -- 172.21.15.134:0/2473797118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec0fda80 msgr2=0x7fafec10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:06.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.857+0000 7faff3191700 1 --2- 172.21.15.134:0/2473797118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec0fda80 0x7fafec10d930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fafe00093b0 tx=0x7fafe0009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:06.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.857+0000 7faff3191700 1 -- 172.21.15.134:0/2473797118 shutdown_connections 2024-02-16T22:19:06.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.857+0000 7faff3191700 1 --2- 172.21.15.134:0/2473797118 >> [v2:172.21.15.134:6800/2578294352,v1:172.21.15.134:6801/2578294352] conn(0x7fafdc06f5d0 0x7fafdc071a80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.857+0000 7faff3191700 1 --2- 172.21.15.134:0/2473797118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec0fda80 0x7fafec10d930 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.857+0000 7faff3191700 1 --2- 172.21.15.134:0/2473797118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafec1003a0 0x7fafec10de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:06.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.857+0000 7faff3191700 1 -- 172.21.15.134:0/2473797118 >> 172.21.15.134:0/2473797118 conn(0x7fafec0f74e0 msgr2=0x7fafec0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:06.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.857+0000 7faff3191700 1 -- 172.21.15.134:0/2473797118 shutdown_connections 2024-02-16T22:19:06.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:06.857+0000 7faff3191700 1 -- 172.21.15.134:0/2473797118 wait complete. 2024-02-16T22:19:07.009 INFO:tasks.workunit.client.1.smithi173.stdout:5/90: mkdir d8/da/d1f 0 2024-02-16T22:19:07.009 INFO:tasks.workunit.client.1.smithi173.stdout:5/91: chown d8/l18 7312 1 2024-02-16T22:19:07.029 INFO:tasks.workunit.client.1.smithi173.stdout:5/92: dwrite d8/f14 [0,4194304] 0 2024-02-16T22:19:07.029 INFO:tasks.workunit.client.1.smithi173.stdout:5/93: chown c5 2984587 1 2024-02-16T22:19:07.029 INFO:tasks.workunit.client.1.smithi173.stdout:5/94: creat d8/da/f20 x:0 0 0 2024-02-16T22:19:07.031 INFO:tasks.workunit.client.1.smithi173.stdout:7/77: unlink d1/fb 0 2024-02-16T22:19:07.031 INFO:tasks.workunit.client.1.smithi173.stdout:7/78: chown d1 7 1 2024-02-16T22:19:07.046 INFO:tasks.workunit.client.1.smithi173.stdout:1/34: fsync f9 0 2024-02-16T22:19:07.046 INFO:tasks.workunit.client.1.smithi173.stdout:1/35: write f9 [907072,106115] 0 2024-02-16T22:19:07.049 INFO:tasks.workunit.client.1.smithi173.stdout:5/95: mknod d8/da/c21 0 2024-02-16T22:19:07.051 INFO:tasks.workunit.client.1.smithi173.stdout:7/79: mknod d1/d5/d13/c19 0 2024-02-16T22:19:07.055 INFO:tasks.workunit.client.1.smithi173.stdout:5/96: mknod d8/da/d1b/c22 0 2024-02-16T22:19:07.056 INFO:tasks.workunit.client.1.smithi173.stdout:1/36: mkdir db 0 2024-02-16T22:19:07.058 INFO:tasks.workunit.client.1.smithi173.stdout:1/37: unlink f3 0 2024-02-16T22:19:07.058 INFO:tasks.workunit.client.1.smithi173.stdout:1/38: write f9 [1717874,100044] 0 2024-02-16T22:19:07.060 INFO:tasks.workunit.client.1.smithi173.stdout:1/39: rename c7 to db/cc 0 2024-02-16T22:19:07.060 INFO:tasks.workunit.client.1.smithi173.stdout:1/40: chown f1 5 1 2024-02-16T22:19:07.060 INFO:tasks.workunit.client.1.smithi173.stdout:1/41: readlink l8 0 2024-02-16T22:19:07.061 INFO:tasks.workunit.client.1.smithi173.stdout:1/42: link f9 db/fd 0 2024-02-16T22:19:07.062 INFO:tasks.workunit.client.1.smithi173.stdout:1/43: write f9 [1816144,120698] 0 2024-02-16T22:19:07.066 INFO:tasks.workunit.client.1.smithi173.stdout:7/80: dread d1/d5/fe [0,4194304] 0 2024-02-16T22:19:07.066 INFO:tasks.workunit.client.1.smithi173.stdout:7/81: chown d1/d5/d11/l12 963369 1 2024-02-16T22:19:07.066 INFO:tasks.workunit.client.1.smithi173.stdout:7/82: chown d1/d5/d11 1 1 2024-02-16T22:19:07.066 INFO:tasks.workunit.client.1.smithi173.stdout:7/83: write d1/d5/d11/f14 [892165,20337] 0 2024-02-16T22:19:07.069 INFO:tasks.workunit.client.1.smithi173.stdout:5/97: write d8/f14 [4052546,20851] 0 2024-02-16T22:19:07.069 INFO:tasks.workunit.client.1.smithi173.stdout:5/98: creat d8/da/f23 x:0 0 0 2024-02-16T22:19:07.072 INFO:tasks.workunit.client.1.smithi173.stdout:7/84: write d1/d5/f4 [5899744,35049] 0 2024-02-16T22:19:07.072 INFO:tasks.workunit.client.1.smithi173.stdout:5/99: unlink c1 0 2024-02-16T22:19:07.073 INFO:tasks.workunit.client.1.smithi173.stdout:5/100: stat d8/da/f1c 0 2024-02-16T22:19:07.074 INFO:tasks.workunit.client.1.smithi173.stdout:7/85: link d1/d5/d13/c19 d1/d5/d10/c1a 0 2024-02-16T22:19:07.076 INFO:tasks.workunit.client.1.smithi173.stdout:7/86: symlink d1/l1b 0 2024-02-16T22:19:07.077 INFO:tasks.workunit.client.1.smithi173.stdout:5/101: dread d8/fd [0,4194304] 0 2024-02-16T22:19:07.077 INFO:tasks.workunit.client.1.smithi173.stdout:5/102: creat d8/da/f24 x:0 0 0 2024-02-16T22:19:07.077 INFO:tasks.workunit.client.1.smithi173.stdout:5/103: fdatasync d8/da/ff 0 2024-02-16T22:19:07.077 INFO:tasks.workunit.client.1.smithi173.stdout:5/104: dread - d8/da/f24 zero size 2024-02-16T22:19:07.077 INFO:tasks.workunit.client.1.smithi173.stdout:5/105: chown d8/da/f1c 71555 1 2024-02-16T22:19:07.081 INFO:tasks.workunit.client.1.smithi173.stdout:5/106: mknod d8/da/d1f/c25 0 2024-02-16T22:19:07.081 INFO:tasks.workunit.client.1.smithi173.stdout:5/107: dread - d8/da/f1d zero size 2024-02-16T22:19:07.081 INFO:tasks.workunit.client.1.smithi173.stdout:5/108: chown c5 425 1 2024-02-16T22:19:07.081 INFO:tasks.workunit.client.1.smithi173.stdout:5/109: dread - d8/da/f23 zero size 2024-02-16T22:19:07.081 INFO:tasks.workunit.client.1.smithi173.stdout:5/110: chown d8 0 1 2024-02-16T22:19:07.094 INFO:tasks.workunit.client.1.smithi173.stdout:1/44: truncate db/fd 1778316 0 2024-02-16T22:19:07.095 INFO:tasks.workunit.client.1.smithi173.stdout:1/45: truncate f1 300601 0 2024-02-16T22:19:07.113 INFO:tasks.workunit.client.1.smithi173.stdout:7/87: dwrite d1/d5/ff [0,4194304] 0 2024-02-16T22:19:07.116 INFO:tasks.workunit.client.1.smithi173.stdout:5/111: dwrite d8/da/f1c [0,4194304] 0 2024-02-16T22:19:07.117 INFO:tasks.workunit.client.1.smithi173.stdout:7/88: dread d1/f9 [0,4194304] 0 2024-02-16T22:19:07.117 INFO:tasks.workunit.client.1.smithi173.stdout:7/89: chown d1/d5/d13/c16 59 1 2024-02-16T22:19:07.121 INFO:tasks.workunit.client.1.smithi173.stdout:1/46: write f9 [952684,41247] 0 2024-02-16T22:19:07.126 INFO:tasks.workunit.client.1.smithi173.stdout:1/47: dread f2 [0,4194304] 0 2024-02-16T22:19:07.145 INFO:tasks.workunit.client.1.smithi173.stdout:5/112: dwrite d8/da/f20 [0,4194304] 0 2024-02-16T22:19:07.147 INFO:tasks.workunit.client.1.smithi173.stdout:7/90: dwrite d1/d5/fe [0,4194304] 0 2024-02-16T22:19:07.147 INFO:tasks.workunit.client.1.smithi173.stdout:7/91: fdatasync d1/d5/ff 0 2024-02-16T22:19:07.149 INFO:tasks.workunit.client.1.smithi173.stdout:7/92: dread d1/f9 [0,4194304] 0 2024-02-16T22:19:07.150 INFO:tasks.workunit.client.1.smithi173.stdout:7/93: read d1/d5/d11/f14 [627848,102805] 0 2024-02-16T22:19:07.151 INFO:tasks.workunit.client.1.smithi173.stdout:7/94: mknod d1/d5/d13/c1c 0 2024-02-16T22:19:07.152 INFO:tasks.workunit.client.1.smithi173.stdout:7/95: write d1/f9 [2701397,96430] 0 2024-02-16T22:19:07.153 INFO:tasks.workunit.client.1.smithi173.stdout:7/96: mkdir d1/d1d 0 2024-02-16T22:19:07.156 INFO:tasks.workunit.client.1.smithi173.stdout:5/113: rename d8/da/f20 to d8/f26 0 2024-02-16T22:19:07.156 INFO:tasks.workunit.client.1.smithi173.stdout:5/114: fdatasync d8/da/ff 0 2024-02-16T22:19:07.157 INFO:tasks.workunit.client.1.smithi173.stdout:5/115: write d8/f14 [1215971,51892] 0 2024-02-16T22:19:07.158 INFO:tasks.workunit.client.1.smithi173.stdout:1/48: truncate f9 1032327 0 2024-02-16T22:19:07.165 INFO:tasks.workunit.client.1.smithi173.stdout:7/97: write d1/d5/fe [1976597,69434] 0 2024-02-16T22:19:07.165 INFO:tasks.workunit.client.1.smithi173.stdout:5/116: mkdir d8/d27 0 2024-02-16T22:19:07.167 INFO:tasks.workunit.client.1.smithi173.stdout:7/98: stat d1/d5/d10/c1a 0 2024-02-16T22:19:07.167 INFO:tasks.workunit.client.1.smithi173.stdout:5/117: chown d8/fd 14998 1 2024-02-16T22:19:07.168 INFO:tasks.workunit.client.1.smithi173.stdout:7/99: creat d1/d1d/f1e x:0 0 0 2024-02-16T22:19:07.169 INFO:tasks.workunit.client.1.smithi173.stdout:5/118: mkdir d8/d27/d28 0 2024-02-16T22:19:07.171 INFO:tasks.workunit.client.1.smithi173.stdout:1/49: read f9 [40260,12045] 0 2024-02-16T22:19:07.171 INFO:tasks.workunit.client.1.smithi173.stdout:1/50: read db/fd [227638,61654] 0 2024-02-16T22:19:07.171 INFO:tasks.workunit.client.1.smithi173.stdout:7/100: creat d1/d5/f1f x:0 0 0 2024-02-16T22:19:07.171 INFO:tasks.workunit.client.1.smithi173.stdout:7/101: chown d1/l7 250 1 2024-02-16T22:19:07.171 INFO:tasks.workunit.client.1.smithi173.stdout:7/102: creat d1/d1d/f20 x:0 0 0 2024-02-16T22:19:07.172 INFO:tasks.workunit.client.1.smithi173.stdout:5/119: rmdir d8 39 2024-02-16T22:19:07.173 INFO:tasks.workunit.client.1.smithi173.stdout:1/51: truncate f9 457826 0 2024-02-16T22:19:07.174 INFO:tasks.workunit.client.1.smithi173.stdout:5/120: truncate d8/da/fc 3125711 0 2024-02-16T22:19:07.176 INFO:tasks.workunit.client.1.smithi173.stdout:1/52: creat db/fe x:0 0 0 2024-02-16T22:19:07.176 INFO:tasks.workunit.client.1.smithi173.stdout:1/53: creat db/ff x:0 0 0 2024-02-16T22:19:07.188 INFO:tasks.workunit.client.1.smithi173.stdout:1/54: dread f9 [0,4194304] 0 2024-02-16T22:19:07.188 INFO:tasks.workunit.client.1.smithi173.stdout:1/55: creat db/f10 x:0 0 0 2024-02-16T22:19:07.188 INFO:tasks.workunit.client.1.smithi173.stdout:1/56: dread - db/fe zero size 2024-02-16T22:19:07.191 INFO:tasks.workunit.client.1.smithi173.stdout:1/57: symlink db/l11 0 2024-02-16T22:19:07.191 INFO:tasks.workunit.client.1.smithi173.stdout:1/58: dread - db/f10 zero size 2024-02-16T22:19:07.192 INFO:tasks.workunit.client.1.smithi173.stdout:1/59: link f1 db/f12 0 2024-02-16T22:19:07.193 INFO:tasks.workunit.client.1.smithi173.stdout:7/103: dwrite d1/f9 [0,4194304] 0 2024-02-16T22:19:07.193 INFO:tasks.workunit.client.1.smithi173.stdout:7/104: chown d1/d5/d13/c16 4737 1 2024-02-16T22:19:07.197 INFO:tasks.workunit.client.1.smithi173.stdout:1/60: write db/f12 [236830,15523] 0 2024-02-16T22:19:07.197 INFO:tasks.workunit.client.1.smithi173.stdout:1/61: creat db/f13 x:0 0 0 2024-02-16T22:19:07.199 INFO:tasks.workunit.client.1.smithi173.stdout:4/38: sync 2024-02-16T22:19:07.199 INFO:tasks.workunit.client.1.smithi173.stdout:9/16: sync 2024-02-16T22:19:07.199 INFO:tasks.workunit.client.1.smithi173.stdout:3/27: sync 2024-02-16T22:19:07.199 INFO:tasks.workunit.client.1.smithi173.stdout:3/28: chown c0 2397 1 2024-02-16T22:19:07.199 INFO:tasks.workunit.client.1.smithi173.stdout:0/98: sync 2024-02-16T22:19:07.200 INFO:tasks.workunit.client.1.smithi173.stdout:4/39: getdents d7 0 2024-02-16T22:19:07.200 INFO:tasks.workunit.client.1.smithi173.stdout:8/100: sync 2024-02-16T22:19:07.200 INFO:tasks.workunit.client.1.smithi173.stdout:2/109: sync 2024-02-16T22:19:07.200 INFO:tasks.workunit.client.1.smithi173.stdout:6/17: sync 2024-02-16T22:19:07.200 INFO:tasks.workunit.client.1.smithi173.stdout:6/18: dread - no filename 2024-02-16T22:19:07.202 INFO:tasks.workunit.client.1.smithi173.stdout:4/40: creat d7/fd x:0 0 0 2024-02-16T22:19:07.202 INFO:tasks.workunit.client.1.smithi173.stdout:9/17: write d1/d2/f4 [410366,54009] 0 2024-02-16T22:19:07.202 INFO:tasks.workunit.client.1.smithi173.stdout:5/121: dwrite d8/f14 [0,4194304] 0 2024-02-16T22:19:07.203 INFO:tasks.workunit.client.1.smithi173.stdout:2/110: rename d2/f22 to d2/db/f24 0 2024-02-16T22:19:07.203 INFO:tasks.workunit.client.1.smithi173.stdout:9/18: rename d1 to d1/d5 22 2024-02-16T22:19:07.205 INFO:tasks.workunit.client.1.smithi173.stdout:0/99: mkdir d0/d4/d14/d24 0 2024-02-16T22:19:07.205 INFO:tasks.workunit.client.1.smithi173.stdout:0/100: chown d0/d4/f8 1580 1 2024-02-16T22:19:07.207 INFO:tasks.workunit.client.1.smithi173.stdout:6/19: mknod d0/c5 0 2024-02-16T22:19:07.207 INFO:tasks.workunit.client.1.smithi173.stdout:8/101: rmdir dd 39 2024-02-16T22:19:07.208 INFO:tasks.workunit.client.1.smithi173.stdout:4/41: mknod d7/ce 0 2024-02-16T22:19:07.209 INFO:tasks.workunit.client.1.smithi173.stdout:2/111: getdents d2/dc/d19 0 2024-02-16T22:19:07.211 INFO:tasks.workunit.client.1.smithi173.stdout:0/101: unlink d0/c2 0 2024-02-16T22:19:07.212 INFO:tasks.workunit.client.1.smithi173.stdout:6/20: mknod d0/c6 0 2024-02-16T22:19:07.213 INFO:tasks.workunit.client.1.smithi173.stdout:6/21: readlink d0/l2 0 2024-02-16T22:19:07.213 INFO:tasks.workunit.client.1.smithi173.stdout:6/22: truncate - no filename 2024-02-16T22:19:07.213 INFO:tasks.workunit.client.1.smithi173.stdout:6/23: creat d0/f7 x:0 0 0 2024-02-16T22:19:07.213 INFO:tasks.workunit.client.1.smithi173.stdout:9/19: fdatasync d1/d2/f4 0 2024-02-16T22:19:07.213 INFO:tasks.workunit.client.1.smithi173.stdout:8/102: creat dd/d11/f27 x:0 0 0 2024-02-16T22:19:07.214 INFO:tasks.workunit.client.1.smithi173.stdout:5/122: truncate d8/fb 493187 0 2024-02-16T22:19:07.215 INFO:tasks.workunit.client.1.smithi173.stdout:2/112: creat d2/dc/d19/f25 x:0 0 0 2024-02-16T22:19:07.215 INFO:tasks.workunit.client.1.smithi173.stdout:0/102: truncate d0/f1 2307943 0 2024-02-16T22:19:07.216 INFO:tasks.workunit.client.1.smithi173.stdout:2/113: write d2/d4/f6 [1933944,8994] 0 2024-02-16T22:19:07.217 INFO:tasks.workunit.client.1.smithi173.stdout:9/20: mknod d1/d2/c6 0 2024-02-16T22:19:07.217 INFO:tasks.workunit.client.1.smithi173.stdout:9/21: truncate f0 619299 0 2024-02-16T22:19:07.217 INFO:tasks.workunit.client.1.smithi173.stdout:8/103: mkdir dd/d11/d22/d28 0 2024-02-16T22:19:07.217 INFO:tasks.workunit.client.1.smithi173.stdout:8/104: fdatasync dd/d11/f1a 0 2024-02-16T22:19:07.218 INFO:tasks.workunit.client.1.smithi173.stdout:5/123: creat d8/f29 x:0 0 0 2024-02-16T22:19:07.219 INFO:tasks.workunit.client.1.smithi173.stdout:9/22: rmdir d1 39 2024-02-16T22:19:07.221 INFO:tasks.workunit.client.1.smithi173.stdout:8/105: symlink dd/d11/d22/l29 0 2024-02-16T22:19:07.221 INFO:tasks.workunit.client.1.smithi173.stdout:8/106: write dd/d11/f20 [192602,31683] 0 2024-02-16T22:19:07.221 INFO:tasks.workunit.client.1.smithi173.stdout:8/107: fsync dd/d11/f23 0 2024-02-16T22:19:07.221 INFO:tasks.workunit.client.1.smithi173.stdout:5/124: mknod d8/da/c2a 0 2024-02-16T22:19:07.222 INFO:tasks.workunit.client.1.smithi173.stdout:2/114: creat d2/dc/d19/d1a/f26 x:0 0 0 2024-02-16T22:19:07.222 INFO:tasks.workunit.client.1.smithi173.stdout:7/105: dwrite d1/d5/f1f [0,4194304] 0 2024-02-16T22:19:07.223 INFO:tasks.workunit.client.1.smithi173.stdout:8/108: creat dd/d11/d22/f2a x:0 0 0 2024-02-16T22:19:07.226 INFO:tasks.workunit.client.1.smithi173.stdout:1/62: dwrite f9 [0,4194304] 0 2024-02-16T22:19:07.226 INFO:tasks.workunit.client.1.smithi173.stdout:3/29: dwrite f8 [0,4194304] 0 2024-02-16T22:19:07.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:07 smithi134 ceph-mon[28869]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:07.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:07 smithi134 ceph-mon[28869]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:07.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:07 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/734954665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:19:07.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:07 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:19:07.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:07 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:19:07.228 INFO:tasks.workunit.client.1.smithi173.stdout:1/63: dread f2 [0,4194304] 0 2024-02-16T22:19:07.228 INFO:tasks.workunit.client.1.smithi173.stdout:1/64: dread - db/f13 zero size 2024-02-16T22:19:07.228 INFO:tasks.workunit.client.1.smithi173.stdout:1/65: dread - db/ff zero size 2024-02-16T22:19:07.228 INFO:tasks.workunit.client.1.smithi173.stdout:1/66: truncate f1 334590 0 2024-02-16T22:19:07.228 INFO:tasks.workunit.client.1.smithi173.stdout:1/67: readlink db/l11 0 2024-02-16T22:19:07.228 INFO:tasks.workunit.client.1.smithi173.stdout:1/68: dread - db/f10 zero size 2024-02-16T22:19:07.229 INFO:tasks.workunit.client.1.smithi173.stdout:7/106: link d1/d5/d10/c1a d1/c21 0 2024-02-16T22:19:07.229 INFO:tasks.workunit.client.1.smithi173.stdout:7/107: write d1/d5/ff [5173757,71355] 0 2024-02-16T22:19:07.230 INFO:tasks.workunit.client.1.smithi173.stdout:7/108: stat d1/d5 0 2024-02-16T22:19:07.230 INFO:tasks.workunit.client.1.smithi173.stdout:7/109: stat d1/d5/cd 0 2024-02-16T22:19:07.230 INFO:tasks.workunit.client.1.smithi173.stdout:7/110: fdatasync d1/d1d/f20 0 2024-02-16T22:19:07.230 INFO:tasks.workunit.client.1.smithi173.stdout:4/42: getdents d7 0 2024-02-16T22:19:07.232 INFO:tasks.workunit.client.1.smithi173.stdout:8/109: mknod dd/d11/d22/c2b 0 2024-02-16T22:19:07.232 INFO:tasks.workunit.client.1.smithi173.stdout:8/110: write dd/d11/f20 [56923,119082] 0 2024-02-16T22:19:07.233 INFO:tasks.workunit.client.1.smithi173.stdout:2/115: symlink d2/dc/d19/d1c/l27 0 2024-02-16T22:19:07.236 INFO:tasks.workunit.client.1.smithi173.stdout:0/103: dwrite d0/d4/f7 [0,4194304] 0 2024-02-16T22:19:07.237 INFO:tasks.workunit.client.1.smithi173.stdout:3/30: creat d9/fb x:0 0 0 2024-02-16T22:19:07.237 INFO:tasks.workunit.client.1.smithi173.stdout:6/24: fsync d0/f7 0 2024-02-16T22:19:07.239 INFO:tasks.workunit.client.1.smithi173.stdout:8/111: rename dd/ff to dd/d11/f2c 0 2024-02-16T22:19:07.241 INFO:tasks.workunit.client.1.smithi173.stdout:2/116: truncate d2/db/f15 538553 0 2024-02-16T22:19:07.241 INFO:tasks.workunit.client.1.smithi173.stdout:1/69: dread db/f12 [0,4194304] 0 2024-02-16T22:19:07.241 INFO:tasks.workunit.client.1.smithi173.stdout:1/70: stat db 0 2024-02-16T22:19:07.241 INFO:tasks.workunit.client.1.smithi173.stdout:1/71: fsync f1 0 2024-02-16T22:19:07.242 INFO:tasks.workunit.client.1.smithi173.stdout:0/104: symlink d0/d4/d14/l25 0 2024-02-16T22:19:07.242 INFO:tasks.workunit.client.1.smithi173.stdout:3/31: dread f2 [0,4194304] 0 2024-02-16T22:19:07.245 INFO:tasks.workunit.client.1.smithi173.stdout:4/43: dwrite d7/f9 [0,4194304] 0 2024-02-16T22:19:07.247 INFO:tasks.workunit.client.1.smithi173.stdout:2/117: link d2/dc/d19/d1c/f20 d2/f28 0 2024-02-16T22:19:07.250 INFO:tasks.workunit.client.1.smithi173.stdout:1/72: mknod db/c14 0 2024-02-16T22:19:07.251 INFO:tasks.workunit.client.1.smithi173.stdout:7/111: dread d1/d5/ff [0,4194304] 0 2024-02-16T22:19:07.251 INFO:tasks.workunit.client.1.smithi173.stdout:7/112: truncate d1/d5/ff 5945570 0 2024-02-16T22:19:07.251 INFO:tasks.workunit.client.1.smithi173.stdout:9/23: truncate d1/d2/f4 283375 0 2024-02-16T22:19:07.251 INFO:tasks.workunit.client.1.smithi173.stdout:9/24: stat d1/d2/c6 0 2024-02-16T22:19:07.251 INFO:tasks.workunit.client.1.smithi173.stdout:9/25: creat d1/d2/f7 x:0 0 0 2024-02-16T22:19:07.253 INFO:tasks.workunit.client.1.smithi173.stdout:0/105: read d0/f1 [2083700,101850] 0 2024-02-16T22:19:07.253 INFO:tasks.workunit.client.1.smithi173.stdout:3/32: symlink d9/lc 0 2024-02-16T22:19:07.253 INFO:tasks.workunit.client.1.smithi173.stdout:3/33: chown c6 116460193 1 2024-02-16T22:19:07.256 INFO:tasks.workunit.client.1.smithi173.stdout:4/44: mkdir d7/df 0 2024-02-16T22:19:07.257 INFO:tasks.workunit.client.1.smithi173.stdout:5/125: truncate d8/f14 1214663 0 2024-02-16T22:19:07.259 INFO:tasks.workunit.client.1.smithi173.stdout:1/73: rename db/f12 to db/f15 0 2024-02-16T22:19:07.259 INFO:tasks.workunit.client.1.smithi173.stdout:1/74: readlink db/l11 0 2024-02-16T22:19:07.259 INFO:tasks.workunit.client.1.smithi173.stdout:1/75: dread - db/fe zero size 2024-02-16T22:19:07.260 INFO:tasks.workunit.client.1.smithi173.stdout:6/25: dwrite d0/f7 [0,4194304] 0 2024-02-16T22:19:07.260 INFO:tasks.workunit.client.1.smithi173.stdout:6/26: chown d0/l2 0 1 2024-02-16T22:19:07.260 INFO:tasks.workunit.client.1.smithi173.stdout:6/27: creat d0/f8 x:0 0 0 2024-02-16T22:19:07.260 INFO:tasks.workunit.client.1.smithi173.stdout:7/113: mkdir d1/d5/d13/d22 0 2024-02-16T22:19:07.260 INFO:tasks.workunit.client.1.smithi173.stdout:7/114: readlink d1/l1b 0 2024-02-16T22:19:07.261 INFO:tasks.workunit.client.1.smithi173.stdout:4/45: write f1 [458964,71917] 0 2024-02-16T22:19:07.261 INFO:tasks.workunit.client.1.smithi173.stdout:9/26: mknod d1/c8 0 2024-02-16T22:19:07.263 INFO:tasks.workunit.client.1.smithi173.stdout:0/106: creat d0/d4/f26 x:0 0 0 2024-02-16T22:19:07.263 INFO:tasks.workunit.client.1.smithi173.stdout:0/107: readlink d0/d4/d14/d21/l22 0 2024-02-16T22:19:07.264 INFO:tasks.workunit.client.1.smithi173.stdout:3/34: creat d9/da/fd x:0 0 0 2024-02-16T22:19:07.264 INFO:tasks.workunit.client.1.smithi173.stdout:8/112: dwrite dd/d11/f1a [0,4194304] 0 2024-02-16T22:19:07.270 INFO:tasks.workunit.client.1.smithi173.stdout:1/76: rename db/c14 to db/c16 0 2024-02-16T22:19:07.270 INFO:tasks.workunit.client.1.smithi173.stdout:1/77: write db/fe [42478,18514] 0 2024-02-16T22:19:07.270 INFO:tasks.workunit.client.1.smithi173.stdout:1/78: read - db/ff zero size 2024-02-16T22:19:07.270 INFO:tasks.workunit.client.1.smithi173.stdout:1/79: chown db/fd 13266944 1 2024-02-16T22:19:07.276 INFO:tasks.workunit.client.1.smithi173.stdout:6/28: rename d0/f7 to d0/f9 0 2024-02-16T22:19:07.276 INFO:tasks.workunit.client.1.smithi173.stdout:6/29: readlink d0/l2 0 2024-02-16T22:19:07.279 INFO:tasks.workunit.client.1.smithi173.stdout:7/115: rename d1/d5/l15 to d1/d5/d13/l23 0 2024-02-16T22:19:07.280 INFO:tasks.workunit.client.1.smithi173.stdout:4/46: mkdir d7/df/d10 0 2024-02-16T22:19:07.280 INFO:tasks.workunit.client.1.smithi173.stdout:1/80: read db/fd [1481694,80848] 0 2024-02-16T22:19:07.280 INFO:tasks.workunit.client.1.smithi173.stdout:1/81: write db/f10 [584253,80954] 0 2024-02-16T22:19:07.282 INFO:tasks.workunit.client.1.smithi173.stdout:3/35: dwrite f2 [0,4194304] 0 2024-02-16T22:19:07.283 INFO:tasks.workunit.client.1.smithi173.stdout:3/36: chown c6 6165077 1 2024-02-16T22:19:07.283 INFO:tasks.workunit.client.1.smithi173.stdout:3/37: chown c6 483904 1 2024-02-16T22:19:07.283 INFO:tasks.workunit.client.1.smithi173.stdout:1/82: fdatasync db/fe 0 2024-02-16T22:19:07.283 INFO:tasks.workunit.client.1.smithi173.stdout:0/108: mkdir d0/d4/d27 0 2024-02-16T22:19:07.286 INFO:tasks.workunit.client.1.smithi173.stdout:8/113: link dd/d11/f20 dd/f2d 0 2024-02-16T22:19:07.286 INFO:tasks.workunit.client.1.smithi173.stdout:8/114: stat f9 0 2024-02-16T22:19:07.286 INFO:tasks.workunit.client.1.smithi173.stdout:8/115: stat dd/d11 0 2024-02-16T22:19:07.287 INFO:tasks.workunit.client.1.smithi173.stdout:5/126: rmdir d8 39 2024-02-16T22:19:07.288 INFO:tasks.workunit.client.1.smithi173.stdout:4/47: mknod d7/df/d10/c11 0 2024-02-16T22:19:07.289 INFO:tasks.workunit.client.1.smithi173.stdout:9/27: rmdir d1/d2 39 2024-02-16T22:19:07.290 INFO:tasks.workunit.client.1.smithi173.stdout:9/28: dread d1/d2/f4 [0,4194304] 0 2024-02-16T22:19:07.291 INFO:tasks.workunit.client.1.smithi173.stdout:3/38: mknod d9/da/ce 0 2024-02-16T22:19:07.294 INFO:tasks.workunit.client.1.smithi173.stdout:8/116: mkdir dd/d11/d22/d2e 0 2024-02-16T22:19:07.294 INFO:tasks.workunit.client.1.smithi173.stdout:8/117: chown f9 298891512 1 2024-02-16T22:19:07.295 INFO:tasks.workunit.client.1.smithi173.stdout:5/127: symlink d8/da/l2b 0 2024-02-16T22:19:07.295 INFO:tasks.workunit.client.1.smithi173.stdout:5/128: truncate f4 1902083 0 2024-02-16T22:19:07.296 INFO:tasks.workunit.client.1.smithi173.stdout:4/48: stat d7/c8 0 2024-02-16T22:19:07.299 INFO:tasks.workunit.client.1.smithi173.stdout:3/39: mknod d9/da/cf 0 2024-02-16T22:19:07.299 INFO:tasks.workunit.client.1.smithi173.stdout:8/118: dread dd/d11/f14 [0,4194304] 0 2024-02-16T22:19:07.315 INFO:tasks.workunit.client.1.smithi173.stdout:3/40: dwrite d9/da/fd [0,4194304] 0 2024-02-16T22:19:07.339 INFO:tasks.workunit.client.1.smithi173.stdout:4/49: mkdir d7/d12 0 2024-02-16T22:19:07.339 INFO:tasks.workunit.client.1.smithi173.stdout:8/119: readlink l8 0 2024-02-16T22:19:07.342 INFO:tasks.workunit.client.1.smithi173.stdout:5/129: symlink d8/l2c 0 2024-02-16T22:19:07.342 INFO:tasks.workunit.client.1.smithi173.stdout:5/130: write d8/da/f1d [44198,72365] 0 2024-02-16T22:19:07.342 INFO:tasks.workunit.client.1.smithi173.stdout:8/120: creat dd/d11/d22/d28/f2f x:0 0 0 2024-02-16T22:19:07.343 INFO:tasks.workunit.client.1.smithi173.stdout:5/131: rmdir d8/d27 39 2024-02-16T22:19:07.344 INFO:tasks.workunit.client.1.smithi173.stdout:8/121: symlink dd/d11/l30 0 2024-02-16T22:19:07.346 INFO:tasks.workunit.client.1.smithi173.stdout:5/132: mkdir d8/da/d2d 0 2024-02-16T22:19:07.347 INFO:tasks.workunit.client.1.smithi173.stdout:8/122: rmdir dd 39 2024-02-16T22:19:07.348 INFO:tasks.workunit.client.1.smithi173.stdout:1/83: truncate db/f10 467455 0 2024-02-16T22:19:07.348 INFO:tasks.workunit.client.1.smithi173.stdout:1/84: dread - db/ff zero size 2024-02-16T22:19:07.349 INFO:tasks.workunit.client.1.smithi173.stdout:5/133: creat d8/f2e x:0 0 0 2024-02-16T22:19:07.352 INFO:tasks.workunit.client.1.smithi173.stdout:8/123: creat dd/f31 x:0 0 0 2024-02-16T22:19:07.352 INFO:tasks.workunit.client.1.smithi173.stdout:8/124: readlink dd/d11/l30 0 2024-02-16T22:19:07.352 INFO:tasks.workunit.client.1.smithi173.stdout:8/125: creat dd/d11/d22/f32 x:0 0 0 2024-02-16T22:19:07.352 INFO:tasks.workunit.client.1.smithi173.stdout:8/126: creat dd/d11/d22/d28/f33 x:0 0 0 2024-02-16T22:19:07.352 INFO:tasks.workunit.client.1.smithi173.stdout:8/127: write f2 [209397,106045] 0 2024-02-16T22:19:07.353 INFO:tasks.workunit.client.1.smithi173.stdout:1/85: dread db/fd [0,4194304] 0 2024-02-16T22:19:07.353 INFO:tasks.workunit.client.1.smithi173.stdout:1/86: chown c6 47 1 2024-02-16T22:19:07.354 INFO:tasks.workunit.client.1.smithi173.stdout:4/50: dwrite d7/fd [0,4194304] 0 2024-02-16T22:19:07.354 INFO:tasks.workunit.client.1.smithi173.stdout:4/51: chown d7/fd 193385 1 2024-02-16T22:19:07.358 INFO:tasks.workunit.client.1.smithi173.stdout:1/87: symlink db/l17 0 2024-02-16T22:19:07.360 INFO:tasks.workunit.client.1.smithi173.stdout:4/52: dread f1 [0,4194304] 0 2024-02-16T22:19:07.362 INFO:tasks.workunit.client.1.smithi173.stdout:5/134: write d8/f26 [3198743,88515] 0 2024-02-16T22:19:07.362 INFO:tasks.workunit.client.1.smithi173.stdout:4/53: creat d7/df/f13 x:0 0 0 2024-02-16T22:19:07.365 INFO:tasks.workunit.client.1.smithi173.stdout:5/135: mkdir d8/d27/d2f 0 2024-02-16T22:19:07.365 INFO:tasks.workunit.client.1.smithi173.stdout:5/136: write d8/da/ff [1579248,53187] 0 2024-02-16T22:19:07.366 INFO:tasks.workunit.client.1.smithi173.stdout:4/54: mkdir d7/df/d10/d14 0 2024-02-16T22:19:07.367 INFO:tasks.workunit.client.1.smithi173.stdout:4/55: creat d7/f15 x:0 0 0 2024-02-16T22:19:07.368 INFO:tasks.workunit.client.1.smithi173.stdout:8/128: dwrite dd/d11/d22/d28/f33 [0,4194304] 0 2024-02-16T22:19:07.369 INFO:tasks.workunit.client.1.smithi173.stdout:8/129: write dd/d11/d22/f32 [996603,130015] 0 2024-02-16T22:19:07.371 INFO:tasks.workunit.client.1.smithi173.stdout:1/88: rmdir db 39 2024-02-16T22:19:07.373 INFO:tasks.workunit.client.1.smithi173.stdout:8/130: rename dd/d11/d22/c25 to dd/d11/d22/c34 0 2024-02-16T22:19:07.373 INFO:tasks.workunit.client.1.smithi173.stdout:8/131: creat dd/d11/d22/d28/f35 x:0 0 0 2024-02-16T22:19:07.374 INFO:tasks.workunit.client.1.smithi173.stdout:4/56: dread f1 [0,4194304] 0 2024-02-16T22:19:07.374 INFO:tasks.workunit.client.1.smithi173.stdout:4/57: getdents d7/df/d10/d14 0 2024-02-16T22:19:07.374 INFO:tasks.workunit.client.1.smithi173.stdout:1/89: rename db/fe to db/f18 0 2024-02-16T22:19:07.378 INFO:tasks.workunit.client.1.smithi173.stdout:4/58: symlink d7/l16 0 2024-02-16T22:19:07.378 INFO:tasks.workunit.client.1.smithi173.stdout:4/59: readlink l2 0 2024-02-16T22:19:07.379 INFO:tasks.workunit.client.1.smithi173.stdout:1/90: creat db/f19 x:0 0 0 2024-02-16T22:19:07.381 INFO:tasks.workunit.client.1.smithi173.stdout:4/60: creat d7/d12/f17 x:0 0 0 2024-02-16T22:19:07.381 INFO:tasks.workunit.client.1.smithi173.stdout:4/61: truncate d7/d12/f17 264420 0 2024-02-16T22:19:07.382 INFO:tasks.workunit.client.1.smithi173.stdout:1/91: mknod db/c1a 0 2024-02-16T22:19:07.385 INFO:tasks.workunit.client.1.smithi173.stdout:4/62: dread f5 [0,4194304] 0 2024-02-16T22:19:07.386 INFO:tasks.workunit.client.1.smithi173.stdout:8/132: getdents dd/d11/d22 0 2024-02-16T22:19:07.387 INFO:tasks.workunit.client.1.smithi173.stdout:8/133: creat dd/d11/f36 x:0 0 0 2024-02-16T22:19:07.387 INFO:tasks.workunit.client.1.smithi173.stdout:5/137: dwrite d8/da/ff [0,4194304] 0 2024-02-16T22:19:07.393 INFO:tasks.workunit.client.1.smithi173.stdout:5/138: dread d8/f14 [0,4194304] 0 2024-02-16T22:19:07.394 INFO:tasks.workunit.client.1.smithi173.stdout:5/139: truncate d8/da/f1a 1335387 0 2024-02-16T22:19:07.395 INFO:tasks.workunit.client.1.smithi173.stdout:5/140: dread d8/fd [0,4194304] 0 2024-02-16T22:19:07.397 INFO:tasks.workunit.client.1.smithi173.stdout:5/141: getdents d8/da/d1f 0 2024-02-16T22:19:07.400 INFO:tasks.workunit.client.1.smithi173.stdout:5/142: mkdir d8/da/d1f/d30 0 2024-02-16T22:19:07.400 INFO:tasks.workunit.client.1.smithi173.stdout:5/143: fdatasync d8/da/f11 0 2024-02-16T22:19:07.400 INFO:tasks.workunit.client.1.smithi173.stdout:8/134: dread dd/d11/f14 [0,4194304] 0 2024-02-16T22:19:07.400 INFO:tasks.workunit.client.1.smithi173.stdout:8/135: fdatasync f5 0 2024-02-16T22:19:07.401 INFO:tasks.workunit.client.1.smithi173.stdout:5/144: mknod d8/da/d1f/d30/c31 0 2024-02-16T22:19:07.401 INFO:tasks.workunit.client.1.smithi173.stdout:5/145: write d8/da/f24 [130894,26518] 0 2024-02-16T22:19:07.402 INFO:tasks.workunit.client.1.smithi173.stdout:8/136: truncate f5 928209 0 2024-02-16T22:19:07.402 INFO:tasks.workunit.client.1.smithi173.stdout:8/137: dread - dd/d11/d22/d28/f2f zero size 2024-02-16T22:19:07.402 INFO:tasks.workunit.client.1.smithi173.stdout:8/138: dread - dd/f31 zero size 2024-02-16T22:19:07.403 INFO:tasks.workunit.client.1.smithi173.stdout:8/139: dread dd/d11/f23 [0,4194304] 0 2024-02-16T22:19:07.403 INFO:tasks.workunit.client.1.smithi173.stdout:8/140: getdents dd/d11/d22 0 2024-02-16T22:19:07.403 INFO:tasks.workunit.client.1.smithi173.stdout:5/146: mkdir d8/da/d2d/d32 0 2024-02-16T22:19:07.403 INFO:tasks.workunit.client.1.smithi173.stdout:5/147: getdents d8/d27/d28 0 2024-02-16T22:19:07.405 INFO:tasks.workunit.client.1.smithi173.stdout:8/141: rmdir dd/d11/d22/d28 39 2024-02-16T22:19:07.409 INFO:tasks.workunit.client.1.smithi173.stdout:5/148: rmdir d8 39 2024-02-16T22:19:07.411 INFO:tasks.workunit.client.1.smithi173.stdout:1/92: dwrite f2 [0,4194304] 0 2024-02-16T22:19:07.411 INFO:tasks.workunit.client.1.smithi173.stdout:1/93: chown db 376 1 2024-02-16T22:19:07.417 INFO:tasks.workunit.client.1.smithi173.stdout:5/149: write d8/da/fc [2780693,57550] 0 2024-02-16T22:19:07.417 INFO:tasks.workunit.client.1.smithi173.stdout:4/63: dwrite d7/fc [0,4194304] 0 2024-02-16T22:19:07.421 INFO:tasks.workunit.client.1.smithi173.stdout:4/64: symlink d7/l18 0 2024-02-16T22:19:07.422 INFO:tasks.workunit.client.1.smithi173.stdout:8/142: dread dd/d11/d22/f32 [0,4194304] 0 2024-02-16T22:19:07.422 INFO:tasks.workunit.client.1.smithi173.stdout:8/143: chown f9 2836619 1 2024-02-16T22:19:07.422 INFO:tasks.workunit.client.1.smithi173.stdout:8/144: write dd/d11/f1c [913510,41730] 0 2024-02-16T22:19:07.423 INFO:tasks.workunit.client.1.smithi173.stdout:4/65: rmdir d7/df/d10 39 2024-02-16T22:19:07.425 INFO:tasks.workunit.client.1.smithi173.stdout:4/66: rmdir d7/d12 39 2024-02-16T22:19:07.435 INFO:tasks.workunit.client.1.smithi173.stdout:8/145: write f4 [4952194,86130] 0 2024-02-16T22:19:07.436 INFO:tasks.workunit.client.1.smithi173.stdout:4/67: read d7/f9 [1250647,21378] 0 2024-02-16T22:19:07.437 INFO:tasks.workunit.client.1.smithi173.stdout:1/94: dwrite f1 [0,4194304] 0 2024-02-16T22:19:07.437 INFO:tasks.workunit.client.1.smithi173.stdout:1/95: creat db/f1b x:0 0 0 2024-02-16T22:19:07.437 INFO:tasks.workunit.client.1.smithi173.stdout:8/146: rename dd/d11/f1c to dd/d11/d22/f37 0 2024-02-16T22:19:07.438 INFO:tasks.workunit.client.1.smithi173.stdout:5/150: dwrite d8/f2e [0,4194304] 0 2024-02-16T22:19:07.439 INFO:tasks.workunit.client.1.smithi173.stdout:4/68: dread f5 [0,4194304] 0 2024-02-16T22:19:07.439 INFO:tasks.workunit.client.1.smithi173.stdout:1/96: mkdir db/d1c 0 2024-02-16T22:19:07.441 INFO:tasks.workunit.client.1.smithi173.stdout:8/147: rename dd/d11/d22/c26 to dd/d11/d22/d2e/c38 0 2024-02-16T22:19:07.441 INFO:tasks.workunit.client.1.smithi173.stdout:8/148: fsync dd/d11/f20 0 2024-02-16T22:19:07.443 INFO:tasks.workunit.client.1.smithi173.stdout:4/69: truncate d7/fd 4072285 0 2024-02-16T22:19:07.443 INFO:tasks.workunit.client.1.smithi173.stdout:1/97: mkdir db/d1d 0 2024-02-16T22:19:07.444 INFO:tasks.workunit.client.1.smithi173.stdout:8/149: fsync f2 0 2024-02-16T22:19:07.444 INFO:tasks.workunit.client.1.smithi173.stdout:8/150: creat dd/d11/f39 x:0 0 0 2024-02-16T22:19:07.444 INFO:tasks.workunit.client.1.smithi173.stdout:5/151: mkdir d8/da/d1f/d33 0 2024-02-16T22:19:07.445 INFO:tasks.workunit.client.1.smithi173.stdout:4/70: rename d7/df/f13 to d7/d12/f19 0 2024-02-16T22:19:07.445 INFO:tasks.workunit.client.1.smithi173.stdout:4/71: readlink d7/l16 0 2024-02-16T22:19:07.446 INFO:tasks.workunit.client.1.smithi173.stdout:1/98: creat db/d1d/f1e x:0 0 0 2024-02-16T22:19:07.448 INFO:tasks.workunit.client.1.smithi173.stdout:8/151: mknod dd/d11/d22/d2e/c3a 0 2024-02-16T22:19:07.450 INFO:tasks.workunit.client.1.smithi173.stdout:4/72: creat d7/df/d10/f1a x:0 0 0 2024-02-16T22:19:07.451 INFO:tasks.workunit.client.1.smithi173.stdout:8/152: mknod dd/c3b 0 2024-02-16T22:19:07.454 INFO:tasks.workunit.client.1.smithi173.stdout:5/152: rename d8/c19 to d8/d27/c34 0 2024-02-16T22:19:07.455 INFO:tasks.workunit.client.1.smithi173.stdout:8/153: creat dd/d11/d22/d28/f3c x:0 0 0 2024-02-16T22:19:07.457 INFO:tasks.workunit.client.1.smithi173.stdout:1/99: rename f1 to db/d1c/f1f 0 2024-02-16T22:19:07.457 INFO:tasks.workunit.client.1.smithi173.stdout:1/100: truncate db/f13 221443 0 2024-02-16T22:19:07.460 INFO:tasks.workunit.client.1.smithi173.stdout:5/153: mkdir d8/d27/d35 0 2024-02-16T22:19:07.477 INFO:tasks.workunit.client.1.smithi173.stdout:8/154: dwrite dd/f16 [0,4194304] 0 2024-02-16T22:19:07.477 INFO:tasks.workunit.client.1.smithi173.stdout:4/73: dwrite f1 [0,4194304] 0 2024-02-16T22:19:07.477 INFO:tasks.workunit.client.1.smithi173.stdout:4/74: fsync d7/f9 0 2024-02-16T22:19:07.478 INFO:tasks.workunit.client.1.smithi173.stdout:4/75: fdatasync d7/fd 0 2024-02-16T22:19:07.478 INFO:tasks.workunit.client.1.smithi173.stdout:1/101: rmdir db 39 2024-02-16T22:19:07.478 INFO:tasks.workunit.client.1.smithi173.stdout:1/102: write db/f1b [544853,70810] 0 2024-02-16T22:19:07.478 INFO:tasks.workunit.client.1.smithi173.stdout:1/103: dread - db/ff zero size 2024-02-16T22:19:07.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:07 smithi173 ceph-mon[37280]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:07.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:07 smithi173 ceph-mon[37280]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:07.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:07 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/734954665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:19:07.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:07 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:19:07.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:07 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:19:07.481 INFO:tasks.workunit.client.1.smithi173.stdout:4/76: rename f1 to d7/df/f1b 0 2024-02-16T22:19:07.482 INFO:tasks.workunit.client.1.smithi173.stdout:1/104: creat db/d1d/f20 x:0 0 0 2024-02-16T22:19:07.482 INFO:tasks.workunit.client.1.smithi173.stdout:1/105: dread - db/d1d/f20 zero size 2024-02-16T22:19:07.483 INFO:tasks.workunit.client.1.smithi173.stdout:4/77: symlink d7/df/d10/d14/l1c 0 2024-02-16T22:19:07.483 INFO:tasks.workunit.client.1.smithi173.stdout:4/78: write d7/f15 [206740,4816] 0 2024-02-16T22:19:07.483 INFO:tasks.workunit.client.1.smithi173.stdout:4/79: stat d7 0 2024-02-16T22:19:07.483 INFO:tasks.workunit.client.1.smithi173.stdout:4/80: creat d7/df/d10/f1d x:0 0 0 2024-02-16T22:19:07.483 INFO:tasks.workunit.client.1.smithi173.stdout:1/106: symlink db/d1c/l21 0 2024-02-16T22:19:07.484 INFO:tasks.workunit.client.1.smithi173.stdout:1/107: write db/d1d/f1e [788518,104489] 0 2024-02-16T22:19:07.484 INFO:tasks.workunit.client.1.smithi173.stdout:8/155: dread dd/f16 [0,4194304] 0 2024-02-16T22:19:07.484 INFO:tasks.workunit.client.1.smithi173.stdout:8/156: creat dd/d11/f3d x:0 0 0 2024-02-16T22:19:07.484 INFO:tasks.workunit.client.1.smithi173.stdout:8/157: dread - dd/d11/d22/d28/f2f zero size 2024-02-16T22:19:07.485 INFO:tasks.workunit.client.1.smithi173.stdout:4/81: rename l2 to d7/df/d10/l1e 0 2024-02-16T22:19:07.486 INFO:tasks.workunit.client.1.smithi173.stdout:1/108: mknod db/d1c/c22 0 2024-02-16T22:19:07.486 INFO:tasks.workunit.client.1.smithi173.stdout:1/109: write db/f13 [881924,90358] 0 2024-02-16T22:19:07.487 INFO:tasks.workunit.client.1.smithi173.stdout:8/158: mknod dd/d11/d22/d28/c3e 0 2024-02-16T22:19:07.487 INFO:tasks.workunit.client.1.smithi173.stdout:1/110: mknod db/c23 0 2024-02-16T22:19:07.487 INFO:tasks.workunit.client.1.smithi173.stdout:1/111: fdatasync db/d1c/f1f 0 2024-02-16T22:19:07.488 INFO:tasks.workunit.client.1.smithi173.stdout:8/159: creat dd/d11/d22/f3f x:0 0 0 2024-02-16T22:19:07.489 INFO:tasks.workunit.client.1.smithi173.stdout:5/154: dwrite d8/da/fc [0,4194304] 0 2024-02-16T22:19:07.489 INFO:tasks.workunit.client.1.smithi173.stdout:5/155: read d8/f26 [2723150,23275] 0 2024-02-16T22:19:07.489 INFO:tasks.workunit.client.1.smithi173.stdout:8/160: getdents dd/d11/d22/d2e 0 2024-02-16T22:19:07.489 INFO:tasks.workunit.client.1.smithi173.stdout:8/161: write dd/d11/f27 [443041,82326] 0 2024-02-16T22:19:07.491 INFO:tasks.workunit.client.1.smithi173.stdout:8/162: mkdir dd/d11/d22/d28/d40 0 2024-02-16T22:19:07.491 INFO:tasks.workunit.client.1.smithi173.stdout:8/163: truncate dd/d11/d22/f37 1402197 0 2024-02-16T22:19:07.493 INFO:tasks.workunit.client.1.smithi173.stdout:8/164: mkdir dd/d11/d22/d2e/d41 0 2024-02-16T22:19:07.500 INFO:tasks.workunit.client.1.smithi173.stdout:1/112: dread db/fd [0,4194304] 0 2024-02-16T22:19:07.502 INFO:tasks.workunit.client.1.smithi173.stdout:1/113: link db/d1d/f20 db/f24 0 2024-02-16T22:19:07.502 INFO:tasks.workunit.client.1.smithi173.stdout:5/156: write d8/f2e [2080452,51972] 0 2024-02-16T22:19:07.504 INFO:tasks.workunit.client.1.smithi173.stdout:5/157: unlink d8/da/c2a 0 2024-02-16T22:19:07.504 INFO:tasks.workunit.client.1.smithi173.stdout:5/158: rmdir d8/da/d1f 39 2024-02-16T22:19:07.504 INFO:tasks.workunit.client.1.smithi173.stdout:5/159: write d8/f26 [2750912,78947] 0 2024-02-16T22:19:07.509 INFO:tasks.workunit.client.1.smithi173.stdout:4/82: dwrite d7/fc [0,4194304] 0 2024-02-16T22:19:07.510 INFO:tasks.workunit.client.1.smithi173.stdout:4/83: creat d7/df/d10/d14/f1f x:0 0 0 2024-02-16T22:19:07.510 INFO:tasks.workunit.client.1.smithi173.stdout:4/84: getdents d7/d12 0 2024-02-16T22:19:07.517 INFO:tasks.workunit.client.1.smithi173.stdout:1/114: dread db/f13 [0,4194304] 0 2024-02-16T22:19:07.517 INFO:tasks.workunit.client.1.smithi173.stdout:1/115: write db/f19 [502089,77557] 0 2024-02-16T22:19:07.518 INFO:tasks.workunit.client.1.smithi173.stdout:1/116: mkdir db/d1c/d25 0 2024-02-16T22:19:07.519 INFO:tasks.workunit.client.1.smithi173.stdout:1/117: rename db/f13 to db/d1d/f26 0 2024-02-16T22:19:07.520 INFO:tasks.workunit.client.1.smithi173.stdout:4/85: write d7/fd [3876057,2076] 0 2024-02-16T22:19:07.520 INFO:tasks.workunit.client.1.smithi173.stdout:4/86: chown d7/df/f1b 12696 1 2024-02-16T22:19:07.520 INFO:tasks.workunit.client.1.smithi173.stdout:8/165: dwrite dd/d11/d22/d28/f3c [0,4194304] 0 2024-02-16T22:19:07.520 INFO:tasks.workunit.client.1.smithi173.stdout:1/118: mknod db/d1c/c27 0 2024-02-16T22:19:07.521 INFO:tasks.workunit.client.1.smithi173.stdout:4/87: mknod d7/df/c20 0 2024-02-16T22:19:07.521 INFO:tasks.workunit.client.1.smithi173.stdout:4/88: write d7/df/d10/f1d [668415,19260] 0 2024-02-16T22:19:07.522 INFO:tasks.workunit.client.1.smithi173.stdout:8/166: creat dd/d11/d22/d2e/d41/f42 x:0 0 0 2024-02-16T22:19:07.523 INFO:tasks.workunit.client.1.smithi173.stdout:1/119: mkdir db/d1c/d25/d28 0 2024-02-16T22:19:07.524 INFO:tasks.workunit.client.1.smithi173.stdout:4/89: symlink d7/df/l21 0 2024-02-16T22:19:07.524 INFO:tasks.workunit.client.1.smithi173.stdout:4/90: creat d7/df/f22 x:0 0 0 2024-02-16T22:19:07.524 INFO:tasks.workunit.client.1.smithi173.stdout:4/91: chown d7/fc 3573 1 2024-02-16T22:19:07.524 INFO:tasks.workunit.client.1.smithi173.stdout:4/92: chown d7/df/d10/d14/l1c 472990 1 2024-02-16T22:19:07.525 INFO:tasks.workunit.client.1.smithi173.stdout:4/93: creat d7/df/f23 x:0 0 0 2024-02-16T22:19:07.525 INFO:tasks.workunit.client.1.smithi173.stdout:4/94: creat d7/df/f24 x:0 0 0 2024-02-16T22:19:07.525 INFO:tasks.workunit.client.1.smithi173.stdout:4/95: chown d7/df/d10/d14 2677890 1 2024-02-16T22:19:07.525 INFO:tasks.workunit.client.1.smithi173.stdout:1/120: mkdir db/d29 0 2024-02-16T22:19:07.526 INFO:tasks.workunit.client.1.smithi173.stdout:1/121: fdatasync f9 0 2024-02-16T22:19:07.530 INFO:tasks.workunit.client.1.smithi173.stdout:1/122: symlink db/d1c/l2a 0 2024-02-16T22:19:07.530 INFO:tasks.workunit.client.1.smithi173.stdout:1/123: write f9 [3316203,20619] 0 2024-02-16T22:19:07.533 INFO:tasks.workunit.client.1.smithi173.stdout:1/124: creat db/f2b x:0 0 0 2024-02-16T22:19:07.533 INFO:tasks.workunit.client.1.smithi173.stdout:1/125: creat db/d1d/f2c x:0 0 0 2024-02-16T22:19:07.535 INFO:tasks.workunit.client.1.smithi173.stdout:4/96: dread d7/df/f1b [0,4194304] 0 2024-02-16T22:19:07.535 INFO:tasks.workunit.client.1.smithi173.stdout:4/97: chown d7/ca 597899 1 2024-02-16T22:19:07.535 INFO:tasks.workunit.client.1.smithi173.stdout:4/98: write d7/f9 [1170118,1775] 0 2024-02-16T22:19:07.535 INFO:tasks.workunit.client.1.smithi173.stdout:1/126: link db/fd db/d1c/d25/f2d 0 2024-02-16T22:19:07.538 INFO:tasks.workunit.client.1.smithi173.stdout:4/99: link d7/c8 d7/d12/c25 0 2024-02-16T22:19:07.540 INFO:tasks.workunit.client.1.smithi173.stdout:1/127: mknod db/d1d/c2e 0 2024-02-16T22:19:07.540 INFO:tasks.workunit.client.1.smithi173.stdout:1/128: read db/f19 [536304,125225] 0 2024-02-16T22:19:07.541 INFO:tasks.workunit.client.1.smithi173.stdout:4/100: link d7/ce d7/c26 0 2024-02-16T22:19:07.542 INFO:tasks.workunit.client.1.smithi173.stdout:1/129: creat db/d1c/d25/d28/f2f x:0 0 0 2024-02-16T22:19:07.543 INFO:tasks.workunit.client.1.smithi173.stdout:1/130: mkdir db/d30 0 2024-02-16T22:19:07.544 INFO:tasks.workunit.client.1.smithi173.stdout:1/131: truncate db/f1b 1023912 0 2024-02-16T22:19:07.545 INFO:tasks.workunit.client.1.smithi173.stdout:1/132: mknod db/d1c/d25/d28/c31 0 2024-02-16T22:19:07.545 INFO:tasks.workunit.client.1.smithi173.stdout:1/133: creat db/d1d/f32 x:0 0 0 2024-02-16T22:19:07.545 INFO:tasks.workunit.client.1.smithi173.stdout:8/167: dwrite dd/d11/f1a [0,4194304] 0 2024-02-16T22:19:07.554 INFO:tasks.workunit.client.1.smithi173.stdout:8/168: read dd/d11/d22/d28/f33 [1184109,47284] 0 2024-02-16T22:19:07.556 INFO:tasks.workunit.client.1.smithi173.stdout:4/101: truncate d7/f9 2127705 0 2024-02-16T22:19:07.557 INFO:tasks.workunit.client.1.smithi173.stdout:8/169: dread dd/d11/d22/f32 [0,4194304] 0 2024-02-16T22:19:07.557 INFO:tasks.workunit.client.1.smithi173.stdout:8/170: truncate dd/d11/f20 704514 0 2024-02-16T22:19:07.558 INFO:tasks.workunit.client.1.smithi173.stdout:4/102: mkdir d7/df/d27 0 2024-02-16T22:19:07.559 INFO:tasks.workunit.client.1.smithi173.stdout:8/171: symlink dd/d11/d22/d2e/l43 0 2024-02-16T22:19:07.560 INFO:tasks.workunit.client.1.smithi173.stdout:8/172: chown dd/d11/f14 51329 1 2024-02-16T22:19:07.560 INFO:tasks.workunit.client.1.smithi173.stdout:8/173: readlink dd/l10 0 2024-02-16T22:19:07.562 INFO:tasks.workunit.client.1.smithi173.stdout:8/174: unlink dd/f2d 0 2024-02-16T22:19:07.563 INFO:tasks.workunit.client.1.smithi173.stdout:1/134: dwrite db/d1d/f26 [0,4194304] 0 2024-02-16T22:19:07.563 INFO:tasks.workunit.client.1.smithi173.stdout:1/135: creat db/d1d/f33 x:0 0 0 2024-02-16T22:19:07.568 INFO:tasks.workunit.client.1.smithi173.stdout:4/103: rename d7/df/d10 to d7/d28 0 2024-02-16T22:19:07.568 INFO:tasks.workunit.client.1.smithi173.stdout:8/175: rename dd/d11/d22 to dd/d11/d22/d28/d40/d44 22 2024-02-16T22:19:07.571 INFO:tasks.workunit.client.1.smithi173.stdout:4/104: rmdir d7/d12 39 2024-02-16T22:19:07.571 INFO:tasks.workunit.client.1.smithi173.stdout:4/105: creat d7/f29 x:0 0 0 2024-02-16T22:19:07.571 INFO:tasks.workunit.client.1.smithi173.stdout:4/106: fdatasync d7/f29 0 2024-02-16T22:19:07.573 INFO:tasks.workunit.client.1.smithi173.stdout:4/107: creat d7/d28/d14/f2a x:0 0 0 2024-02-16T22:19:07.575 INFO:tasks.workunit.client.1.smithi173.stdout:8/176: rmdir dd/d11/d22 39 2024-02-16T22:19:07.576 INFO:tasks.workunit.client.1.smithi173.stdout:8/177: write fc [665961,15580] 0 2024-02-16T22:19:07.576 INFO:tasks.workunit.client.1.smithi173.stdout:4/108: rename d7/f29 to d7/d12/f2b 0 2024-02-16T22:19:07.577 INFO:tasks.workunit.client.1.smithi173.stdout:4/109: read d7/f15 [178257,88165] 0 2024-02-16T22:19:07.577 INFO:tasks.workunit.client.1.smithi173.stdout:8/178: creat dd/d11/d22/d2e/d41/f45 x:0 0 0 2024-02-16T22:19:07.577 INFO:tasks.workunit.client.1.smithi173.stdout:8/179: stat dd/d11/d22/l29 0 2024-02-16T22:19:07.577 INFO:tasks.workunit.client.1.smithi173.stdout:8/180: write dd/d11/d22/f3f [163973,124836] 0 2024-02-16T22:19:07.578 INFO:tasks.workunit.client.1.smithi173.stdout:8/181: rmdir dd/d11/d22/d28 39 2024-02-16T22:19:07.578 INFO:tasks.workunit.client.1.smithi173.stdout:4/110: dread d7/d12/f17 [0,4194304] 0 2024-02-16T22:19:07.578 INFO:tasks.workunit.client.1.smithi173.stdout:8/182: mknod dd/d11/d22/d2e/c46 0 2024-02-16T22:19:07.579 INFO:tasks.workunit.client.1.smithi173.stdout:4/111: symlink d7/d28/l2c 0 2024-02-16T22:19:07.580 INFO:tasks.workunit.client.1.smithi173.stdout:4/112: mkdir d7/d12/d2d 0 2024-02-16T22:19:07.931 INFO:tasks.workunit.client.1.smithi173.stdout:2/118: sync 2024-02-16T22:19:07.945 INFO:tasks.workunit.client.1.smithi173.stdout:2/119: dread d2/d4/f7 [4194304,4194304] 0 2024-02-16T22:19:07.946 INFO:tasks.workunit.client.1.smithi173.stdout:2/120: readlink d2/l3 0 2024-02-16T22:19:07.958 INFO:tasks.workunit.client.1.smithi173.stdout:2/121: dwrite d2/dc/d19/f25 [0,4194304] 0 2024-02-16T22:19:07.958 INFO:tasks.workunit.client.1.smithi173.stdout:2/122: truncate d2/db/f24 570539 0 2024-02-16T22:19:07.958 INFO:tasks.workunit.client.1.smithi173.stdout:2/123: fsync d2/f28 0 2024-02-16T22:19:07.974 INFO:tasks.workunit.client.1.smithi173.stdout:2/124: dwrite d2/db/f18 [0,4194304] 0 2024-02-16T22:19:07.976 INFO:tasks.workunit.client.1.smithi173.stdout:2/125: creat d2/dc/d19/f29 x:0 0 0 2024-02-16T22:19:07.976 INFO:tasks.workunit.client.1.smithi173.stdout:2/126: creat d2/d4/f2a x:0 0 0 2024-02-16T22:19:07.978 INFO:tasks.workunit.client.1.smithi173.stdout:2/127: creat d2/dc/f2b x:0 0 0 2024-02-16T22:19:07.978 INFO:tasks.workunit.client.1.smithi173.stdout:2/128: symlink d2/dc/l2c 0 2024-02-16T22:19:07.979 INFO:tasks.workunit.client.1.smithi173.stdout:2/129: chown d2/dc/l2c 5603774 1 2024-02-16T22:19:07.979 INFO:tasks.workunit.client.1.smithi173.stdout:2/130: mkdir d2/d4/d8/d2d 0 2024-02-16T22:19:07.981 INFO:tasks.workunit.client.1.smithi173.stdout:2/131: link d2/dc/d19/f25 d2/f2e 0 2024-02-16T22:19:07.982 INFO:tasks.workunit.client.1.smithi173.stdout:2/132: rename d2/d4/f6 to d2/dc/f2f 0 2024-02-16T22:19:07.983 INFO:tasks.workunit.client.1.smithi173.stdout:2/133: unlink d2/dc/d19/d1c/l27 0 2024-02-16T22:19:07.984 INFO:tasks.workunit.client.1.smithi173.stdout:2/134: mkdir d2/d4/d8/d30 0 2024-02-16T22:19:07.985 INFO:tasks.workunit.client.1.smithi173.stdout:2/135: creat d2/db/f31 x:0 0 0 2024-02-16T22:19:07.986 INFO:tasks.workunit.client.1.smithi173.stdout:2/136: unlink d2/d4/d8/la 0 2024-02-16T22:19:07.986 INFO:tasks.workunit.client.1.smithi173.stdout:2/137: read d2/dc/d19/f1f [1169430,83698] 0 2024-02-16T22:19:07.987 INFO:tasks.workunit.client.1.smithi173.stdout:2/138: readlink d2/dc/l21 0 2024-02-16T22:19:07.999 INFO:tasks.workunit.client.1.smithi173.stdout:2/139: dwrite d2/db/f31 [0,4194304] 0 2024-02-16T22:19:07.999 INFO:tasks.workunit.client.1.smithi173.stdout:2/140: write d2/dc/d19/f29 [561418,8638] 0 2024-02-16T22:19:08.008 INFO:tasks.workunit.client.1.smithi173.stdout:2/141: dread d2/dc/d19/f25 [0,4194304] 0 2024-02-16T22:19:08.008 INFO:tasks.workunit.client.1.smithi173.stdout:2/142: write d2/f28 [53051,97897] 0 2024-02-16T22:19:08.009 INFO:tasks.workunit.client.1.smithi173.stdout:2/143: creat d2/d10/f32 x:0 0 0 2024-02-16T22:19:08.009 INFO:tasks.workunit.client.1.smithi173.stdout:2/144: read d2/f28 [49847,56811] 0 2024-02-16T22:19:08.011 INFO:tasks.workunit.client.1.smithi173.stdout:2/145: dread d2/dc/d19/f1f [0,4194304] 0 2024-02-16T22:19:08.012 INFO:tasks.workunit.client.1.smithi173.stdout:2/146: symlink d2/dc/l33 0 2024-02-16T22:19:08.013 INFO:tasks.workunit.client.1.smithi173.stdout:2/147: unlink d2/f17 0 2024-02-16T22:19:08.013 INFO:tasks.workunit.client.1.smithi173.stdout:2/148: chown d2/db/c1d 2604720 1 2024-02-16T22:19:08.013 INFO:tasks.workunit.client.1.smithi173.stdout:2/149: creat d2/dc/d19/d1a/f34 x:0 0 0 2024-02-16T22:19:08.015 INFO:tasks.workunit.client.1.smithi173.stdout:2/150: unlink d2/dc/l33 0 2024-02-16T22:19:08.042 INFO:tasks.workunit.client.1.smithi173.stdout:2/151: dwrite d2/f28 [0,4194304] 0 2024-02-16T22:19:08.185 INFO:tasks.workunit.client.1.smithi173.stdout:6/30: sync 2024-02-16T22:19:08.185 INFO:tasks.workunit.client.1.smithi173.stdout:6/31: write d0/f8 [55596,73216] 0 2024-02-16T22:19:08.185 INFO:tasks.workunit.client.1.smithi173.stdout:6/32: creat d0/fa x:0 0 0 2024-02-16T22:19:08.187 INFO:tasks.workunit.client.1.smithi173.stdout:6/33: mkdir d0/db 0 2024-02-16T22:19:08.196 INFO:tasks.workunit.client.1.smithi173.stdout:6/34: read d0/f9 [1370895,20517] 0 2024-02-16T22:19:08.201 INFO:tasks.workunit.client.1.smithi173.stdout:6/35: dread d0/f9 [0,4194304] 0 2024-02-16T22:19:08.201 INFO:tasks.workunit.client.1.smithi173.stdout:6/36: stat d0/l3 0 2024-02-16T22:19:08.202 INFO:tasks.workunit.client.1.smithi173.stdout:6/37: symlink d0/db/lc 0 2024-02-16T22:19:08.202 INFO:tasks.workunit.client.1.smithi173.stdout:6/38: creat d0/fd x:0 0 0 2024-02-16T22:19:08.202 INFO:tasks.workunit.client.1.smithi173.stdout:6/39: fdatasync d0/f9 0 2024-02-16T22:19:08.202 INFO:tasks.workunit.client.1.smithi173.stdout:6/40: truncate d0/fd 509551 0 2024-02-16T22:19:08.217 INFO:tasks.workunit.client.1.smithi173.stdout:6/41: dwrite d0/fa [0,4194304] 0 2024-02-16T22:19:08.218 INFO:tasks.workunit.client.1.smithi173.stdout:6/42: fdatasync d0/fd 0 2024-02-16T22:19:08.219 INFO:tasks.workunit.client.1.smithi173.stdout:6/43: mknod d0/ce 0 2024-02-16T22:19:08.220 INFO:tasks.workunit.client.1.smithi173.stdout:6/44: creat d0/ff x:0 0 0 2024-02-16T22:19:08.222 INFO:tasks.workunit.client.1.smithi173.stdout:6/45: creat d0/db/f10 x:0 0 0 2024-02-16T22:19:08.236 INFO:tasks.workunit.client.1.smithi173.stdout:6/46: dwrite d0/db/f10 [0,4194304] 0 2024-02-16T22:19:08.241 INFO:tasks.workunit.client.1.smithi173.stdout:6/47: dread d0/f9 [0,4194304] 0 2024-02-16T22:19:08.241 INFO:tasks.workunit.client.1.smithi173.stdout:6/48: creat d0/f11 x:0 0 0 2024-02-16T22:19:08.241 INFO:tasks.workunit.client.1.smithi173.stdout:6/49: dread d0/fd [0,4194304] 0 2024-02-16T22:19:08.245 INFO:tasks.workunit.client.1.smithi173.stdout:6/50: rename d0/f9 to d0/db/f12 0 2024-02-16T22:19:08.263 INFO:tasks.workunit.client.1.smithi173.stdout:9/29: sync 2024-02-16T22:19:08.264 INFO:tasks.workunit.client.1.smithi173.stdout:0/109: sync 2024-02-16T22:19:08.264 INFO:tasks.workunit.client.1.smithi173.stdout:7/116: sync 2024-02-16T22:19:08.264 INFO:tasks.workunit.client.1.smithi173.stdout:2/152: sync 2024-02-16T22:19:08.264 INFO:tasks.workunit.client.1.smithi173.stdout:3/41: sync 2024-02-16T22:19:08.264 INFO:tasks.workunit.client.1.smithi173.stdout:1/136: sync 2024-02-16T22:19:08.264 INFO:tasks.workunit.client.1.smithi173.stdout:4/113: sync 2024-02-16T22:19:08.264 INFO:tasks.workunit.client.1.smithi173.stdout:8/183: sync 2024-02-16T22:19:08.264 INFO:tasks.workunit.client.1.smithi173.stdout:5/160: sync 2024-02-16T22:19:08.264 INFO:tasks.workunit.client.1.smithi173.stdout:5/161: write d8/f29 [140766,31972] 0 2024-02-16T22:19:08.265 INFO:tasks.workunit.client.1.smithi173.stdout:6/51: dwrite d0/ff [0,4194304] 0 2024-02-16T22:19:08.268 INFO:tasks.workunit.client.1.smithi173.stdout:0/110: mknod d0/d4/d27/c28 0 2024-02-16T22:19:08.268 INFO:tasks.workunit.client.1.smithi173.stdout:0/111: chown d0/d4/d14/f23 190200880 1 2024-02-16T22:19:08.268 INFO:tasks.workunit.client.1.smithi173.stdout:7/117: link d1/d1d/f1e d1/d5/d10/f24 0 2024-02-16T22:19:08.268 INFO:tasks.workunit.client.1.smithi173.stdout:2/153: mkdir d2/d4/d35 0 2024-02-16T22:19:08.275 INFO:tasks.workunit.client.1.smithi173.stdout:3/42: write d9/da/fd [752199,90357] 0 2024-02-16T22:19:08.275 INFO:tasks.workunit.client.1.smithi173.stdout:3/43: creat d9/da/f10 x:0 0 0 2024-02-16T22:19:08.275 INFO:tasks.workunit.client.1.smithi173.stdout:3/44: write d9/da/fd [3922729,71473] 0 2024-02-16T22:19:08.276 INFO:tasks.workunit.client.1.smithi173.stdout:1/137: mknod db/d29/c34 0 2024-02-16T22:19:08.276 INFO:tasks.workunit.client.1.smithi173.stdout:0/112: rmdir d0/d12 39 2024-02-16T22:19:08.277 INFO:tasks.workunit.client.1.smithi173.stdout:2/154: chown d2/dc/d19/f16 195552047 1 2024-02-16T22:19:08.279 INFO:tasks.workunit.client.1.smithi173.stdout:8/184: dread dd/d11/f20 [0,4194304] 0 2024-02-16T22:19:08.282 INFO:tasks.workunit.client.1.smithi173.stdout:6/52: read d0/db/f10 [3524862,51562] 0 2024-02-16T22:19:08.282 INFO:tasks.workunit.client.1.smithi173.stdout:3/45: unlink d9/lc 0 2024-02-16T22:19:08.284 INFO:tasks.workunit.client.1.smithi173.stdout:1/138: rename db/d29/c34 to db/d1c/c35 0 2024-02-16T22:19:08.285 INFO:tasks.workunit.client.1.smithi173.stdout:0/113: creat d0/d4/d27/f29 x:0 0 0 2024-02-16T22:19:08.286 INFO:tasks.workunit.client.1.smithi173.stdout:1/139: write db/f10 [142741,98824] 0 2024-02-16T22:19:08.286 INFO:tasks.workunit.client.1.smithi173.stdout:1/140: stat db/f1b 0 2024-02-16T22:19:08.286 INFO:tasks.workunit.client.1.smithi173.stdout:6/53: dread d0/f8 [0,4194304] 0 2024-02-16T22:19:08.286 INFO:tasks.workunit.client.1.smithi173.stdout:6/54: write d0/db/f10 [1451456,64182] 0 2024-02-16T22:19:08.287 INFO:tasks.workunit.client.1.smithi173.stdout:8/185: unlink dd/d11/d22/l29 0 2024-02-16T22:19:08.288 INFO:tasks.workunit.client.1.smithi173.stdout:3/46: symlink d9/l11 0 2024-02-16T22:19:08.290 INFO:tasks.workunit.client.1.smithi173.stdout:0/114: link d0/f11 d0/d4/f2a 0 2024-02-16T22:19:08.290 INFO:tasks.workunit.client.1.smithi173.stdout:0/115: stat d0/d4/f26 0 2024-02-16T22:19:08.292 INFO:tasks.workunit.client.1.smithi173.stdout:6/55: link d0/f8 d0/db/f13 0 2024-02-16T22:19:08.292 INFO:tasks.workunit.client.1.smithi173.stdout:6/56: stat d0/db/f12 0 2024-02-16T22:19:08.292 INFO:tasks.workunit.client.1.smithi173.stdout:6/57: creat d0/f14 x:0 0 0 2024-02-16T22:19:08.292 INFO:tasks.workunit.client.1.smithi173.stdout:6/58: chown d0/db/f12 312495 1 2024-02-16T22:19:08.293 INFO:tasks.workunit.client.1.smithi173.stdout:8/186: creat dd/d11/d22/d28/f47 x:0 0 0 2024-02-16T22:19:08.293 INFO:tasks.workunit.client.1.smithi173.stdout:8/187: fdatasync dd/d11/f39 0 2024-02-16T22:19:08.295 INFO:tasks.workunit.client.1.smithi173.stdout:3/47: rename l5 to d9/l12 0 2024-02-16T22:19:08.295 INFO:tasks.workunit.client.1.smithi173.stdout:3/48: write d9/da/f10 [44306,6750] 0 2024-02-16T22:19:08.295 INFO:tasks.workunit.client.1.smithi173.stdout:0/116: symlink d0/d4/d27/l2b 0 2024-02-16T22:19:08.297 INFO:tasks.workunit.client.1.smithi173.stdout:6/59: link d0/db/f13 d0/db/f15 0 2024-02-16T22:19:08.299 INFO:tasks.workunit.client.1.smithi173.stdout:0/117: creat d0/d4/d14/d21/f2c x:0 0 0 2024-02-16T22:19:08.301 INFO:tasks.workunit.client.1.smithi173.stdout:6/60: unlink d0/db/f15 0 2024-02-16T22:19:08.304 INFO:tasks.workunit.client.1.smithi173.stdout:6/61: unlink d0/db/f13 0 2024-02-16T22:19:08.304 INFO:tasks.workunit.client.1.smithi173.stdout:6/62: read d0/fd [343089,26191] 0 2024-02-16T22:19:08.306 INFO:tasks.workunit.client.1.smithi173.stdout:6/63: read d0/f8 [95968,6833] 0 2024-02-16T22:19:08.307 INFO:tasks.workunit.client.1.smithi173.stdout:6/64: mknod d0/c16 0 2024-02-16T22:19:08.309 INFO:tasks.workunit.client.1.smithi173.stdout:6/65: mknod d0/c17 0 2024-02-16T22:19:08.309 INFO:tasks.workunit.client.1.smithi173.stdout:6/66: truncate d0/db/f10 4823692 0 2024-02-16T22:19:08.311 INFO:tasks.workunit.client.1.smithi173.stdout:3/49: read f2 [1684634,124763] 0 2024-02-16T22:19:08.312 INFO:tasks.workunit.client.1.smithi173.stdout:4/114: dwrite d7/d12/f2b [0,4194304] 0 2024-02-16T22:19:08.312 INFO:tasks.workunit.client.1.smithi173.stdout:4/115: fdatasync d7/df/f1b 0 2024-02-16T22:19:08.328 INFO:tasks.workunit.client.1.smithi173.stdout:5/162: dwrite f7 [0,4194304] 0 2024-02-16T22:19:08.328 INFO:tasks.workunit.client.1.smithi173.stdout:5/163: truncate d8/f29 791300 0 2024-02-16T22:19:08.328 INFO:tasks.workunit.client.1.smithi173.stdout:9/30: dwrite d1/d2/f7 [0,4194304] 0 2024-02-16T22:19:08.328 INFO:tasks.workunit.client.1.smithi173.stdout:1/141: dwrite db/f15 [0,4194304] 0 2024-02-16T22:19:08.332 INFO:tasks.workunit.client.1.smithi173.stdout:9/31: symlink d1/l9 0 2024-02-16T22:19:08.333 INFO:tasks.workunit.client.1.smithi173.stdout:9/32: readlink d1/l9 0 2024-02-16T22:19:08.336 INFO:tasks.workunit.client.1.smithi173.stdout:7/118: dwrite d1/d1d/f20 [0,4194304] 0 2024-02-16T22:19:08.336 INFO:tasks.workunit.client.1.smithi173.stdout:0/118: dwrite d0/d12/d15/f1c [0,4194304] 0 2024-02-16T22:19:08.336 INFO:tasks.workunit.client.1.smithi173.stdout:0/119: truncate d0/d4/f26 123868 0 2024-02-16T22:19:08.338 INFO:tasks.workunit.client.1.smithi173.stdout:0/120: dread d0/ff [0,4194304] 0 2024-02-16T22:19:08.340 INFO:tasks.workunit.client.1.smithi173.stdout:0/121: link d0/d4/d14/f23 d0/d4/d14/f2d 0 2024-02-16T22:19:08.341 INFO:tasks.workunit.client.1.smithi173.stdout:0/122: unlink d0/d12/c19 0 2024-02-16T22:19:08.345 INFO:tasks.workunit.client.1.smithi173.stdout:1/142: dread db/d1d/f26 [0,4194304] 0 2024-02-16T22:19:08.346 INFO:tasks.workunit.client.1.smithi173.stdout:1/143: fsync db/fd 0 2024-02-16T22:19:08.346 INFO:tasks.workunit.client.1.smithi173.stdout:1/144: dread - db/d1d/f32 zero size 2024-02-16T22:19:08.350 INFO:tasks.workunit.client.1.smithi173.stdout:9/33: write d1/d2/f7 [2129437,4171] 0 2024-02-16T22:19:08.350 INFO:tasks.workunit.client.1.smithi173.stdout:8/188: dwrite f4 [0,4194304] 0 2024-02-16T22:19:08.351 INFO:tasks.workunit.client.1.smithi173.stdout:7/119: write d1/f9 [858052,110539] 0 2024-02-16T22:19:08.352 INFO:tasks.workunit.client.1.smithi173.stdout:7/120: symlink d1/d5/d11/l25 0 2024-02-16T22:19:08.353 INFO:tasks.workunit.client.1.smithi173.stdout:7/121: chown d1/d5/d10 140038167 1 2024-02-16T22:19:08.353 INFO:tasks.workunit.client.1.smithi173.stdout:6/67: dwrite d0/f8 [0,4194304] 0 2024-02-16T22:19:08.354 INFO:tasks.workunit.client.1.smithi173.stdout:6/68: stat d0/f11 0 2024-02-16T22:19:08.354 INFO:tasks.workunit.client.1.smithi173.stdout:4/116: dwrite d7/df/f23 [0,4194304] 0 2024-02-16T22:19:08.354 INFO:tasks.workunit.client.1.smithi173.stdout:4/117: chown d7/df/l21 5 1 2024-02-16T22:19:08.354 INFO:tasks.workunit.client.1.smithi173.stdout:6/69: read d0/db/f10 [4260207,98027] 0 2024-02-16T22:19:08.357 INFO:tasks.workunit.client.1.smithi173.stdout:3/50: fsync d9/da/f10 0 2024-02-16T22:19:08.361 INFO:tasks.workunit.client.1.smithi173.stdout:4/118: truncate d7/fc 2453562 0 2024-02-16T22:19:08.362 INFO:tasks.workunit.client.1.smithi173.stdout:5/164: dwrite d8/da/f1c [0,4194304] 0 2024-02-16T22:19:08.363 INFO:tasks.workunit.client.1.smithi173.stdout:0/123: dwrite d0/d4/fe [0,4194304] 0 2024-02-16T22:19:08.363 INFO:tasks.workunit.client.1.smithi173.stdout:0/124: chown d0/f10 3373 1 2024-02-16T22:19:08.363 INFO:tasks.workunit.client.1.smithi173.stdout:0/125: chown d0 0 1 2024-02-16T22:19:08.364 INFO:tasks.workunit.client.1.smithi173.stdout:7/122: write d1/d5/ff [526289,92554] 0 2024-02-16T22:19:08.364 INFO:tasks.workunit.client.1.smithi173.stdout:7/123: truncate d1/d5/fe 4801776 0 2024-02-16T22:19:08.365 INFO:tasks.workunit.client.1.smithi173.stdout:4/119: creat d7/d12/d2d/f2e x:0 0 0 2024-02-16T22:19:08.370 INFO:tasks.workunit.client.1.smithi173.stdout:5/165: mkdir d8/da/d2d/d36 0 2024-02-16T22:19:08.373 INFO:tasks.workunit.client.1.smithi173.stdout:3/51: dwrite f8 [0,4194304] 0 2024-02-16T22:19:08.373 INFO:tasks.workunit.client.1.smithi173.stdout:3/52: fsync f8 0 2024-02-16T22:19:08.375 INFO:tasks.workunit.client.1.smithi173.stdout:0/126: mkdir d0/d4/d14/d24/d2e 0 2024-02-16T22:19:08.379 INFO:tasks.workunit.client.1.smithi173.stdout:7/124: creat d1/d5/d13/f26 x:0 0 0 2024-02-16T22:19:08.379 INFO:tasks.workunit.client.1.smithi173.stdout:7/125: fdatasync d1/f9 0 2024-02-16T22:19:08.381 INFO:tasks.workunit.client.1.smithi173.stdout:4/120: mknod d7/c2f 0 2024-02-16T22:19:08.382 INFO:tasks.workunit.client.1.smithi173.stdout:5/166: mkdir d8/da/d1f/d30/d37 0 2024-02-16T22:19:08.384 INFO:tasks.workunit.client.1.smithi173.stdout:0/127: unlink d0/d4/d27/f29 0 2024-02-16T22:19:08.386 INFO:tasks.workunit.client.1.smithi173.stdout:1/145: truncate db/f15 2476227 0 2024-02-16T22:19:08.388 INFO:tasks.workunit.client.1.smithi173.stdout:4/121: creat d7/d12/f30 x:0 0 0 2024-02-16T22:19:08.388 INFO:tasks.workunit.client.1.smithi173.stdout:4/122: dread - d7/d12/f30 zero size 2024-02-16T22:19:08.390 INFO:tasks.workunit.client.1.smithi173.stdout:5/167: chown d8/l18 221 1 2024-02-16T22:19:08.393 INFO:tasks.workunit.client.1.smithi173.stdout:0/128: symlink d0/d4/d14/l2f 0 2024-02-16T22:19:08.395 INFO:tasks.workunit.client.1.smithi173.stdout:1/146: dread db/d1d/f26 [0,4194304] 0 2024-02-16T22:19:08.414 INFO:tasks.workunit.client.1.smithi173.stdout:7/126: truncate d1/d5/fe 1009148 0 2024-02-16T22:19:08.414 INFO:tasks.workunit.client.1.smithi173.stdout:7/127: write d1/d5/ff [6022025,105937] 0 2024-02-16T22:19:08.429 INFO:tasks.workunit.client.1.smithi173.stdout:3/53: dwrite f7 [0,4194304] 0 2024-02-16T22:19:08.429 INFO:tasks.workunit.client.1.smithi173.stdout:9/34: dwrite d1/d2/f7 [4194304,4194304] 0 2024-02-16T22:19:08.429 INFO:tasks.workunit.client.1.smithi173.stdout:5/168: dwrite d8/f2e [4194304,4194304] 0 2024-02-16T22:19:08.432 INFO:tasks.workunit.client.1.smithi173.stdout:3/54: symlink d9/da/l13 0 2024-02-16T22:19:08.433 INFO:tasks.workunit.client.1.smithi173.stdout:1/147: dwrite db/d1d/f33 [0,4194304] 0 2024-02-16T22:19:08.434 INFO:tasks.workunit.client.1.smithi173.stdout:5/169: dread f4 [0,4194304] 0 2024-02-16T22:19:08.438 INFO:tasks.workunit.client.1.smithi173.stdout:7/128: dwrite d1/d5/fe [0,4194304] 0 2024-02-16T22:19:08.447 INFO:tasks.workunit.client.1.smithi173.stdout:1/148: creat db/d29/f36 x:0 0 0 2024-02-16T22:19:08.458 INFO:tasks.workunit.client.1.smithi173.stdout:1/149: dread f2 [0,4194304] 0 2024-02-16T22:19:08.459 INFO:tasks.workunit.client.1.smithi173.stdout:1/150: creat db/d1c/f37 x:0 0 0 2024-02-16T22:19:08.461 INFO:tasks.workunit.client.1.smithi173.stdout:5/170: dwrite d8/f29 [0,4194304] 0 2024-02-16T22:19:08.463 INFO:tasks.workunit.client.1.smithi173.stdout:9/35: truncate d1/d2/f7 1449124 0 2024-02-16T22:19:08.463 INFO:tasks.workunit.client.1.smithi173.stdout:9/36: write f0 [660525,23603] 0 2024-02-16T22:19:08.464 INFO:tasks.workunit.client.1.smithi173.stdout:3/55: dwrite f7 [0,4194304] 0 2024-02-16T22:19:08.464 INFO:tasks.workunit.client.1.smithi173.stdout:5/171: symlink d8/da/d2d/d36/l38 0 2024-02-16T22:19:08.465 INFO:tasks.workunit.client.1.smithi173.stdout:3/56: rename d9/da/l13 to d9/l14 0 2024-02-16T22:19:08.467 INFO:tasks.workunit.client.1.smithi173.stdout:3/57: rename f2 to d9/da/f15 0 2024-02-16T22:19:08.472 INFO:tasks.workunit.client.1.smithi173.stdout:7/129: dwrite d1/d5/ff [0,4194304] 0 2024-02-16T22:19:08.472 INFO:tasks.workunit.client.1.smithi173.stdout:1/151: dread db/d1d/f33 [0,4194304] 0 2024-02-16T22:19:08.472 INFO:tasks.workunit.client.1.smithi173.stdout:1/152: write db/d1c/d25/d28/f2f [382584,7936] 0 2024-02-16T22:19:08.472 INFO:tasks.workunit.client.1.smithi173.stdout:1/153: write db/f10 [1343583,25422] 0 2024-02-16T22:19:08.472 INFO:tasks.workunit.client.1.smithi173.stdout:1/154: fsync db/fd 0 2024-02-16T22:19:08.474 INFO:tasks.workunit.client.1.smithi173.stdout:9/37: write d1/d2/f7 [1088383,117509] 0 2024-02-16T22:19:08.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:08 smithi134 ceph-mon[28869]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:08.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:08 smithi134 ceph-mon[28869]: pgmap v256: 65 pgs: 65 active+clean; 2.4 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 205 MiB/s rd, 253 MiB/s wr, 361 op/s 2024-02-16T22:19:08.477 INFO:tasks.workunit.client.1.smithi173.stdout:1/155: mknod db/d1c/d25/c38 0 2024-02-16T22:19:08.479 INFO:tasks.workunit.client.1.smithi173.stdout:9/38: rename d1/l9 to d1/la 0 2024-02-16T22:19:08.479 INFO:tasks.workunit.client.1.smithi173.stdout:3/58: rmdir d9 39 2024-02-16T22:19:08.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:08 smithi173 ceph-mon[37280]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:08.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:08 smithi173 ceph-mon[37280]: pgmap v256: 65 pgs: 65 active+clean; 2.4 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 205 MiB/s rd, 253 MiB/s wr, 361 op/s 2024-02-16T22:19:08.481 INFO:tasks.workunit.client.1.smithi173.stdout:7/130: rmdir d1/d1d 39 2024-02-16T22:19:08.482 INFO:tasks.workunit.client.1.smithi173.stdout:9/39: creat d1/fb x:0 0 0 2024-02-16T22:19:08.482 INFO:tasks.workunit.client.1.smithi173.stdout:9/40: creat d1/fc x:0 0 0 2024-02-16T22:19:08.483 INFO:tasks.workunit.client.1.smithi173.stdout:3/59: creat d9/da/f16 x:0 0 0 2024-02-16T22:19:08.485 INFO:tasks.workunit.client.1.smithi173.stdout:7/131: mkdir d1/d5/d10/d27 0 2024-02-16T22:19:08.485 INFO:tasks.workunit.client.1.smithi173.stdout:1/156: dread db/d1c/d25/f2d [0,4194304] 0 2024-02-16T22:19:08.488 INFO:tasks.workunit.client.1.smithi173.stdout:9/41: rename d1/d2/f7 to d1/d2/fd 0 2024-02-16T22:19:08.491 INFO:tasks.workunit.client.1.smithi173.stdout:9/42: unlink d1/c8 0 2024-02-16T22:19:08.491 INFO:tasks.workunit.client.1.smithi173.stdout:9/43: write d1/fc [218590,57054] 0 2024-02-16T22:19:08.492 INFO:tasks.workunit.client.1.smithi173.stdout:1/157: getdents db/d1c 0 2024-02-16T22:19:08.493 INFO:tasks.workunit.client.1.smithi173.stdout:1/158: creat db/d29/f39 x:0 0 0 2024-02-16T22:19:08.493 INFO:tasks.workunit.client.1.smithi173.stdout:9/44: symlink d1/le 0 2024-02-16T22:19:08.493 INFO:tasks.workunit.client.1.smithi173.stdout:9/45: stat d1/fb 0 2024-02-16T22:19:08.496 INFO:tasks.workunit.client.1.smithi173.stdout:3/60: dwrite d9/da/f16 [0,4194304] 0 2024-02-16T22:19:08.497 INFO:tasks.workunit.client.1.smithi173.stdout:1/159: truncate db/f15 2107248 0 2024-02-16T22:19:08.497 INFO:tasks.workunit.client.1.smithi173.stdout:7/132: write d1/d1d/f20 [2949666,87935] 0 2024-02-16T22:19:08.499 INFO:tasks.workunit.client.1.smithi173.stdout:1/160: dread db/f1b [0,4194304] 0 2024-02-16T22:19:08.499 INFO:tasks.workunit.client.1.smithi173.stdout:1/161: truncate db/d1c/f37 37909 0 2024-02-16T22:19:08.508 INFO:tasks.workunit.client.1.smithi173.stdout:7/133: mkdir d1/d5/d10/d28 0 2024-02-16T22:19:08.508 INFO:tasks.workunit.client.1.smithi173.stdout:7/134: truncate d1/d5/d11/f14 1737488 0 2024-02-16T22:19:08.509 INFO:tasks.workunit.client.1.smithi173.stdout:9/46: rename d1/fb to d1/ff 0 2024-02-16T22:19:08.512 INFO:tasks.workunit.client.1.smithi173.stdout:1/162: link db/d1c/f37 db/d1c/d25/d28/f3a 0 2024-02-16T22:19:08.513 INFO:tasks.workunit.client.1.smithi173.stdout:9/47: fdatasync d1/fc 0 2024-02-16T22:19:08.514 INFO:tasks.workunit.client.1.smithi173.stdout:3/61: dwrite d9/da/f15 [0,4194304] 0 2024-02-16T22:19:08.514 INFO:tasks.workunit.client.1.smithi173.stdout:3/62: write d9/da/f10 [13685,118736] 0 2024-02-16T22:19:08.515 INFO:tasks.workunit.client.1.smithi173.stdout:7/135: dread d1/f9 [0,4194304] 0 2024-02-16T22:19:08.515 INFO:tasks.workunit.client.1.smithi173.stdout:7/136: dread - d1/d5/d13/f26 zero size 2024-02-16T22:19:08.515 INFO:tasks.workunit.client.1.smithi173.stdout:7/137: truncate d1/d1d/f20 4314852 0 2024-02-16T22:19:08.516 INFO:tasks.workunit.client.1.smithi173.stdout:1/163: rename db/fd to db/d29/f3b 0 2024-02-16T22:19:08.517 INFO:tasks.workunit.client.1.smithi173.stdout:9/48: unlink d1/la 0 2024-02-16T22:19:08.517 INFO:tasks.workunit.client.1.smithi173.stdout:9/49: write d1/fc [408709,18693] 0 2024-02-16T22:19:08.521 INFO:tasks.workunit.client.1.smithi173.stdout:3/63: mkdir d9/d17 0 2024-02-16T22:19:08.521 INFO:tasks.workunit.client.1.smithi173.stdout:3/64: chown d9/l11 109 1 2024-02-16T22:19:08.521 INFO:tasks.workunit.client.1.smithi173.stdout:7/138: mknod d1/d5/d10/d28/c29 0 2024-02-16T22:19:08.522 INFO:tasks.workunit.client.1.smithi173.stdout:1/164: mknod db/d1c/d25/d28/c3c 0 2024-02-16T22:19:08.523 INFO:tasks.workunit.client.1.smithi173.stdout:9/50: dread d1/d2/fd [0,4194304] 0 2024-02-16T22:19:08.530 INFO:tasks.workunit.client.1.smithi173.stdout:3/65: mkdir d9/d18 0 2024-02-16T22:19:08.532 INFO:tasks.workunit.client.1.smithi173.stdout:7/139: rename d1/d5/c18 to d1/d5/d10/d27/c2a 0 2024-02-16T22:19:08.532 INFO:tasks.workunit.client.1.smithi173.stdout:7/140: creat d1/d5/f2b x:0 0 0 2024-02-16T22:19:08.533 INFO:tasks.workunit.client.1.smithi173.stdout:1/165: symlink db/d30/l3d 0 2024-02-16T22:19:08.534 INFO:tasks.workunit.client.1.smithi173.stdout:1/166: write db/f15 [2130715,36166] 0 2024-02-16T22:19:08.534 INFO:tasks.workunit.client.1.smithi173.stdout:1/167: write f9 [560321,64148] 0 2024-02-16T22:19:08.534 INFO:tasks.workunit.client.1.smithi173.stdout:1/168: readlink db/l11 0 2024-02-16T22:19:08.534 INFO:tasks.workunit.client.1.smithi173.stdout:1/169: fdatasync db/d1c/f37 0 2024-02-16T22:19:08.534 INFO:tasks.workunit.client.1.smithi173.stdout:1/170: read - db/d29/f39 zero size 2024-02-16T22:19:08.536 INFO:tasks.workunit.client.1.smithi173.stdout:9/51: mkdir d1/d2/d10 0 2024-02-16T22:19:08.538 INFO:tasks.workunit.client.1.smithi173.stdout:7/141: dread d1/d1d/f20 [0,4194304] 0 2024-02-16T22:19:08.538 INFO:tasks.workunit.client.1.smithi173.stdout:3/66: rename d9/l14 to d9/da/l19 0 2024-02-16T22:19:08.542 INFO:tasks.workunit.client.1.smithi173.stdout:1/171: dread db/f15 [0,4194304] 0 2024-02-16T22:19:08.542 INFO:tasks.workunit.client.1.smithi173.stdout:1/172: stat db/d1c/d25/d28/f3a 0 2024-02-16T22:19:08.543 INFO:tasks.workunit.client.1.smithi173.stdout:1/173: dread - db/d1d/f2c zero size 2024-02-16T22:19:08.543 INFO:tasks.workunit.client.1.smithi173.stdout:9/52: creat d1/d2/d10/f11 x:0 0 0 2024-02-16T22:19:08.543 INFO:tasks.workunit.client.1.smithi173.stdout:7/142: getdents d1/d5/d10 0 2024-02-16T22:19:08.543 INFO:tasks.workunit.client.1.smithi173.stdout:7/143: dread - d1/d5/d13/f26 zero size 2024-02-16T22:19:08.544 INFO:tasks.workunit.client.1.smithi173.stdout:1/174: symlink db/d1d/l3e 0 2024-02-16T22:19:08.547 INFO:tasks.workunit.client.1.smithi173.stdout:3/67: write d9/da/f15 [1544165,51170] 0 2024-02-16T22:19:08.550 INFO:tasks.workunit.client.1.smithi173.stdout:3/68: mkdir d9/d1a 0 2024-02-16T22:19:08.551 INFO:tasks.workunit.client.1.smithi173.stdout:1/175: dread db/d1d/f26 [0,4194304] 0 2024-02-16T22:19:08.551 INFO:tasks.workunit.client.1.smithi173.stdout:3/69: creat d9/da/f1b x:0 0 0 2024-02-16T22:19:08.553 INFO:tasks.workunit.client.1.smithi173.stdout:1/176: mkdir db/d1c/d25/d28/d3f 0 2024-02-16T22:19:08.553 INFO:tasks.workunit.client.1.smithi173.stdout:1/177: write db/d29/f36 [505746,28655] 0 2024-02-16T22:19:08.553 INFO:tasks.workunit.client.1.smithi173.stdout:9/53: getdents d1/d2 0 2024-02-16T22:19:08.553 INFO:tasks.workunit.client.1.smithi173.stdout:7/144: write d1/d5/fe [3434472,93180] 0 2024-02-16T22:19:08.556 INFO:tasks.workunit.client.1.smithi173.stdout:1/178: mknod db/d1c/d25/d28/c40 0 2024-02-16T22:19:08.557 INFO:tasks.workunit.client.1.smithi173.stdout:3/70: dread d9/da/f16 [0,4194304] 0 2024-02-16T22:19:08.557 INFO:tasks.workunit.client.1.smithi173.stdout:9/54: rename d1/d2/f4 to d1/f12 0 2024-02-16T22:19:08.562 INFO:tasks.workunit.client.1.smithi173.stdout:7/145: unlink d1/d5/f1f 0 2024-02-16T22:19:08.569 INFO:tasks.workunit.client.1.smithi173.stdout:3/71: creat d9/d17/f1c x:0 0 0 2024-02-16T22:19:08.570 INFO:tasks.workunit.client.1.smithi173.stdout:9/55: creat d1/d2/f13 x:0 0 0 2024-02-16T22:19:08.571 INFO:tasks.workunit.client.1.smithi173.stdout:9/56: readlink d1/le 0 2024-02-16T22:19:08.571 INFO:tasks.workunit.client.1.smithi173.stdout:9/57: chown d1 257821976 1 2024-02-16T22:19:08.572 INFO:tasks.workunit.client.1.smithi173.stdout:7/146: symlink d1/d5/d11/l2c 0 2024-02-16T22:19:08.575 INFO:tasks.workunit.client.1.smithi173.stdout:3/72: unlink d9/da/f10 0 2024-02-16T22:19:08.575 INFO:tasks.workunit.client.1.smithi173.stdout:9/58: creat d1/d2/d10/f14 x:0 0 0 2024-02-16T22:19:08.576 INFO:tasks.workunit.client.1.smithi173.stdout:9/59: dread - d1/d2/d10/f11 zero size 2024-02-16T22:19:08.577 INFO:tasks.workunit.client.1.smithi173.stdout:3/73: mkdir d9/d17/d1d 0 2024-02-16T22:19:08.577 INFO:tasks.workunit.client.1.smithi173.stdout:3/74: read - d9/d17/f1c zero size 2024-02-16T22:19:08.578 INFO:tasks.workunit.client.1.smithi173.stdout:1/179: dwrite db/d29/f36 [0,4194304] 0 2024-02-16T22:19:08.578 INFO:tasks.workunit.client.1.smithi173.stdout:1/180: fdatasync db/f15 0 2024-02-16T22:19:08.578 INFO:tasks.workunit.client.1.smithi173.stdout:1/181: dread - db/d1d/f20 zero size 2024-02-16T22:19:08.578 INFO:tasks.workunit.client.1.smithi173.stdout:1/182: fdatasync db/d29/f3b 0 2024-02-16T22:19:08.579 INFO:tasks.workunit.client.1.smithi173.stdout:9/60: chown d1/d2/l3 1 1 2024-02-16T22:19:08.579 INFO:tasks.workunit.client.1.smithi173.stdout:9/61: write d1/d2/d10/f14 [431764,13194] 0 2024-02-16T22:19:08.579 INFO:tasks.workunit.client.1.smithi173.stdout:9/62: chown d1/d2/f13 2 1 2024-02-16T22:19:08.579 INFO:tasks.workunit.client.1.smithi173.stdout:9/63: rename d1 to d1/d2/d10/d15 22 2024-02-16T22:19:08.579 INFO:tasks.workunit.client.1.smithi173.stdout:9/64: chown d1 2 1 2024-02-16T22:19:08.582 INFO:tasks.workunit.client.1.smithi173.stdout:1/183: dread db/f10 [0,4194304] 0 2024-02-16T22:19:08.582 INFO:tasks.workunit.client.1.smithi173.stdout:1/184: write db/d29/f39 [632756,119150] 0 2024-02-16T22:19:08.582 INFO:tasks.workunit.client.1.smithi173.stdout:1/185: write db/d1c/d25/d28/f2f [778087,83039] 0 2024-02-16T22:19:08.584 INFO:tasks.workunit.client.1.smithi173.stdout:1/186: symlink db/d1c/l41 0 2024-02-16T22:19:08.584 INFO:tasks.workunit.client.1.smithi173.stdout:1/187: creat db/d29/f42 x:0 0 0 2024-02-16T22:19:08.586 INFO:tasks.workunit.client.1.smithi173.stdout:7/147: write d1/d5/ff [2087608,12149] 0 2024-02-16T22:19:08.587 INFO:tasks.workunit.client.1.smithi173.stdout:1/188: creat db/d30/f43 x:0 0 0 2024-02-16T22:19:08.589 INFO:tasks.workunit.client.1.smithi173.stdout:7/148: rename d1/d5/d11/l12 to d1/d5/d13/l2d 0 2024-02-16T22:19:08.589 INFO:tasks.workunit.client.1.smithi173.stdout:7/149: chown d1/d5 250932626 1 2024-02-16T22:19:08.591 INFO:tasks.workunit.client.1.smithi173.stdout:1/189: mkdir db/d1c/d25/d44 0 2024-02-16T22:19:08.593 INFO:tasks.workunit.client.1.smithi173.stdout:7/150: dread d1/d5/d11/f14 [0,4194304] 0 2024-02-16T22:19:08.595 INFO:tasks.workunit.client.1.smithi173.stdout:7/151: mknod d1/d5/d11/c2e 0 2024-02-16T22:19:08.595 INFO:tasks.workunit.client.1.smithi173.stdout:7/152: write d1/d1d/f20 [4859975,79902] 0 2024-02-16T22:19:08.598 INFO:tasks.workunit.client.1.smithi173.stdout:7/153: creat d1/f2f x:0 0 0 2024-02-16T22:19:08.601 INFO:tasks.workunit.client.1.smithi173.stdout:3/75: dwrite f8 [0,4194304] 0 2024-02-16T22:19:08.601 INFO:tasks.workunit.client.1.smithi173.stdout:9/65: dwrite d1/d2/d10/f11 [0,4194304] 0 2024-02-16T22:19:08.601 INFO:tasks.workunit.client.1.smithi173.stdout:3/76: readlink d9/l11 0 2024-02-16T22:19:08.607 INFO:tasks.workunit.client.1.smithi173.stdout:1/190: getdents db/d29 0 2024-02-16T22:19:08.609 INFO:tasks.workunit.client.1.smithi173.stdout:1/191: read db/d1c/f1f [1830055,58979] 0 2024-02-16T22:19:08.610 INFO:tasks.workunit.client.1.smithi173.stdout:3/77: mknod d9/da/c1e 0 2024-02-16T22:19:08.615 INFO:tasks.workunit.client.1.smithi173.stdout:9/66: write d1/d2/d10/f11 [4702777,122986] 0 2024-02-16T22:19:08.619 INFO:tasks.workunit.client.1.smithi173.stdout:3/78: symlink d9/l1f 0 2024-02-16T22:19:08.621 INFO:tasks.workunit.client.1.smithi173.stdout:1/192: dwrite db/d1d/f26 [4194304,4194304] 0 2024-02-16T22:19:08.621 INFO:tasks.workunit.client.1.smithi173.stdout:1/193: write db/d29/f39 [1332762,84212] 0 2024-02-16T22:19:08.622 INFO:tasks.workunit.client.1.smithi173.stdout:9/67: mkdir d1/d2/d10/d16 0 2024-02-16T22:19:08.624 INFO:tasks.workunit.client.1.smithi173.stdout:3/79: mknod d9/d17/d1d/c20 0 2024-02-16T22:19:08.629 INFO:tasks.workunit.client.1.smithi173.stdout:1/194: mkdir db/d1c/d25/d45 0 2024-02-16T22:19:08.641 INFO:tasks.workunit.client.1.smithi173.stdout:3/80: dwrite d9/da/fd [0,4194304] 0 2024-02-16T22:19:08.641 INFO:tasks.workunit.client.1.smithi173.stdout:3/81: dread - d9/d17/f1c zero size 2024-02-16T22:19:08.642 INFO:tasks.workunit.client.1.smithi173.stdout:3/82: write f8 [5195814,66612] 0 2024-02-16T22:19:08.642 INFO:tasks.workunit.client.1.smithi173.stdout:3/83: getdents d9/d18 0 2024-02-16T22:19:08.643 INFO:tasks.workunit.client.1.smithi173.stdout:3/84: mkdir d9/d1a/d21 0 2024-02-16T22:19:08.643 INFO:tasks.workunit.client.1.smithi173.stdout:3/85: chown d9/da/cf 136572440 1 2024-02-16T22:19:08.659 INFO:tasks.workunit.client.1.smithi173.stdout:2/155: sync 2024-02-16T22:19:08.659 INFO:tasks.workunit.client.1.smithi173.stdout:2/156: fsync d2/dc/d19/f16 0 2024-02-16T22:19:08.661 INFO:tasks.workunit.client.1.smithi173.stdout:3/86: dwrite d9/da/fd [0,4194304] 0 2024-02-16T22:19:08.661 INFO:tasks.workunit.client.1.smithi173.stdout:2/157: mknod d2/c36 0 2024-02-16T22:19:08.664 INFO:tasks.workunit.client.1.smithi173.stdout:3/87: write d9/da/f16 [323231,78960] 0 2024-02-16T22:19:08.665 INFO:tasks.workunit.client.1.smithi173.stdout:2/158: dread d2/f2e [0,4194304] 0 2024-02-16T22:19:08.668 INFO:tasks.workunit.client.1.smithi173.stdout:2/159: rename d2/dc/d19/d1c/f1e to d2/d4/d8/d30/f37 0 2024-02-16T22:19:08.672 INFO:tasks.workunit.client.1.smithi173.stdout:3/88: dread f7 [0,4194304] 0 2024-02-16T22:19:08.672 INFO:tasks.workunit.client.1.smithi173.stdout:2/160: link d2/dc/d19/f25 d2/d4/d8/d30/f38 0 2024-02-16T22:19:08.672 INFO:tasks.workunit.client.1.smithi173.stdout:2/161: creat d2/d4/f39 x:0 0 0 2024-02-16T22:19:08.673 INFO:tasks.workunit.client.1.smithi173.stdout:2/162: dread d2/db/f15 [0,4194304] 0 2024-02-16T22:19:08.674 INFO:tasks.workunit.client.1.smithi173.stdout:3/89: rename d9/da/f16 to d9/f22 0 2024-02-16T22:19:08.674 INFO:tasks.workunit.client.1.smithi173.stdout:3/90: readlink d9/l11 0 2024-02-16T22:19:08.674 INFO:tasks.workunit.client.1.smithi173.stdout:3/91: rename d9 to d9/d17/d1d/d23 22 2024-02-16T22:19:08.676 INFO:tasks.workunit.client.1.smithi173.stdout:2/163: mkdir d2/d4/d8/d3a 0 2024-02-16T22:19:08.677 INFO:tasks.workunit.client.1.smithi173.stdout:2/164: getdents d2/d4/d35 0 2024-02-16T22:19:08.677 INFO:tasks.workunit.client.1.smithi173.stdout:2/165: chown d2/dc/d19/f25 179106 1 2024-02-16T22:19:08.678 INFO:tasks.workunit.client.1.smithi173.stdout:3/92: creat d9/d17/d1d/f24 x:0 0 0 2024-02-16T22:19:08.678 INFO:tasks.workunit.client.1.smithi173.stdout:3/93: write d9/da/f1b [717188,50531] 0 2024-02-16T22:19:08.680 INFO:tasks.workunit.client.1.smithi173.stdout:2/166: rename d2/dc/f2f to d2/d4/d8/d30/f3b 0 2024-02-16T22:19:08.680 INFO:tasks.workunit.client.1.smithi173.stdout:2/167: write d2/dc/d19/d1a/f34 [427724,118007] 0 2024-02-16T22:19:08.680 INFO:tasks.workunit.client.1.smithi173.stdout:2/168: write d2/db/f24 [1447702,34986] 0 2024-02-16T22:19:08.680 INFO:tasks.workunit.client.1.smithi173.stdout:2/169: chown d2/d4/f39 6443 1 2024-02-16T22:19:08.680 INFO:tasks.workunit.client.1.smithi173.stdout:2/170: chown d2/c36 21191826 1 2024-02-16T22:19:08.680 INFO:tasks.workunit.client.1.smithi173.stdout:2/171: stat d2/dc/d19/d1a 0 2024-02-16T22:19:08.685 INFO:tasks.workunit.client.1.smithi173.stdout:3/94: getdents d9/da 0 2024-02-16T22:19:08.690 INFO:tasks.workunit.client.1.smithi173.stdout:3/95: dread d9/da/f15 [0,4194304] 0 2024-02-16T22:19:08.691 INFO:tasks.workunit.client.1.smithi173.stdout:3/96: mkdir d9/d17/d25 0 2024-02-16T22:19:08.693 INFO:tasks.workunit.client.1.smithi173.stdout:3/97: mknod d9/d17/c26 0 2024-02-16T22:19:08.693 INFO:tasks.workunit.client.1.smithi173.stdout:3/98: write d9/da/fd [4554060,48769] 0 2024-02-16T22:19:08.694 INFO:tasks.workunit.client.1.smithi173.stdout:2/172: dwrite d2/dc/d19/f25 [0,4194304] 0 2024-02-16T22:19:08.695 INFO:tasks.workunit.client.1.smithi173.stdout:3/99: creat d9/da/f27 x:0 0 0 2024-02-16T22:19:08.699 INFO:tasks.workunit.client.1.smithi173.stdout:3/100: link d9/da/fd d9/da/f28 0 2024-02-16T22:19:08.703 INFO:tasks.workunit.client.1.smithi173.stdout:3/101: creat d9/f29 x:0 0 0 2024-02-16T22:19:08.703 INFO:tasks.workunit.client.1.smithi173.stdout:3/102: fsync f7 0 2024-02-16T22:19:08.706 INFO:tasks.workunit.client.1.smithi173.stdout:3/103: mkdir d9/d17/d2a 0 2024-02-16T22:19:08.718 INFO:tasks.workunit.client.1.smithi173.stdout:2/173: dwrite d2/d4/f7 [0,4194304] 0 2024-02-16T22:19:08.718 INFO:tasks.workunit.client.1.smithi173.stdout:2/174: fsync d2/f2e 0 2024-02-16T22:19:08.718 INFO:tasks.workunit.client.1.smithi173.stdout:2/175: chown d2/dc/f2b 1704246890 1 2024-02-16T22:19:08.723 INFO:tasks.workunit.client.1.smithi173.stdout:2/176: write d2/d4/f7 [4357195,112948] 0 2024-02-16T22:19:08.723 INFO:tasks.workunit.client.1.smithi173.stdout:2/177: getdents d2/d4/d8/d2d 0 2024-02-16T22:19:08.723 INFO:tasks.workunit.client.1.smithi173.stdout:2/178: truncate d2/dc/d19/d1a/f26 1034923 0 2024-02-16T22:19:08.723 INFO:tasks.workunit.client.1.smithi173.stdout:2/179: write d2/dc/d19/d1a/f34 [1543420,34515] 0 2024-02-16T22:19:08.730 INFO:tasks.workunit.client.1.smithi173.stdout:2/180: dread d2/db/f31 [0,4194304] 0 2024-02-16T22:19:08.730 INFO:tasks.workunit.client.1.smithi173.stdout:2/181: read - d2/dc/f2b zero size 2024-02-16T22:19:08.730 INFO:tasks.workunit.client.1.smithi173.stdout:3/104: truncate d9/da/f28 2120552 0 2024-02-16T22:19:08.732 INFO:tasks.workunit.client.1.smithi173.stdout:3/105: write d9/da/fd [2276370,781] 0 2024-02-16T22:19:08.735 INFO:tasks.workunit.client.1.smithi173.stdout:3/106: truncate d9/f22 1139051 0 2024-02-16T22:19:08.735 INFO:tasks.workunit.client.1.smithi173.stdout:3/107: write d9/da/f15 [3559572,2872] 0 2024-02-16T22:19:08.737 INFO:tasks.workunit.client.1.smithi173.stdout:2/182: read d2/dc/d19/d1c/f20 [2544617,41104] 0 2024-02-16T22:19:08.744 INFO:tasks.workunit.client.1.smithi173.stdout:2/183: dread d2/dc/d19/d1a/f34 [0,4194304] 0 2024-02-16T22:19:08.748 INFO:tasks.workunit.client.1.smithi173.stdout:2/184: dread d2/d4/d8/d30/f3b [0,4194304] 0 2024-02-16T22:19:08.748 INFO:tasks.workunit.client.1.smithi173.stdout:2/185: creat d2/f3c x:0 0 0 2024-02-16T22:19:08.752 INFO:tasks.workunit.client.1.smithi173.stdout:3/108: dwrite d9/d17/d1d/f24 [0,4194304] 0 2024-02-16T22:19:08.787 INFO:tasks.workunit.client.1.smithi173.stdout:3/109: unlink d9/l11 0 2024-02-16T22:19:08.789 INFO:tasks.workunit.client.1.smithi173.stdout:3/110: rename d9/d17/d2a to d9/d1a/d2b 0 2024-02-16T22:19:08.791 INFO:tasks.workunit.client.1.smithi173.stdout:3/111: rename d9/da/f28 to d9/d1a/f2c 0 2024-02-16T22:19:08.792 INFO:tasks.workunit.client.1.smithi173.stdout:3/112: link f8 d9/d1a/d2b/f2d 0 2024-02-16T22:19:08.810 INFO:tasks.workunit.client.1.smithi173.stdout:3/113: dwrite d9/d17/f1c [0,4194304] 0 2024-02-16T22:19:08.810 INFO:tasks.workunit.client.1.smithi173.stdout:3/114: fsync d9/da/f15 0 2024-02-16T22:19:08.812 INFO:tasks.workunit.client.1.smithi173.stdout:3/115: mknod d9/d18/c2e 0 2024-02-16T22:19:08.812 INFO:tasks.workunit.client.1.smithi173.stdout:3/116: fdatasync d9/f22 0 2024-02-16T22:19:08.814 INFO:tasks.workunit.client.1.smithi173.stdout:3/117: link c6 d9/d1a/c2f 0 2024-02-16T22:19:08.815 INFO:tasks.workunit.client.1.smithi173.stdout:4/123: sync 2024-02-16T22:19:08.815 INFO:tasks.workunit.client.1.smithi173.stdout:5/172: sync 2024-02-16T22:19:08.815 INFO:tasks.workunit.client.1.smithi173.stdout:8/189: sync 2024-02-16T22:19:08.816 INFO:tasks.workunit.client.1.smithi173.stdout:6/70: sync 2024-02-16T22:19:08.816 INFO:tasks.workunit.client.1.smithi173.stdout:0/129: sync 2024-02-16T22:19:08.816 INFO:tasks.workunit.client.1.smithi173.stdout:0/130: chown d0/d4/d14/d24 1898876 1 2024-02-16T22:19:08.816 INFO:tasks.workunit.client.1.smithi173.stdout:6/71: write d0/f11 [432963,89498] 0 2024-02-16T22:19:08.821 INFO:tasks.workunit.client.1.smithi173.stdout:3/118: symlink d9/d18/l30 0 2024-02-16T22:19:08.824 INFO:tasks.workunit.client.1.smithi173.stdout:5/173: creat d8/d27/d28/f39 x:0 0 0 2024-02-16T22:19:08.825 INFO:tasks.workunit.client.1.smithi173.stdout:8/190: rename dd/f24 to dd/d11/d22/d2e/f48 0 2024-02-16T22:19:08.827 INFO:tasks.workunit.client.1.smithi173.stdout:6/72: dread d0/f8 [0,4194304] 0 2024-02-16T22:19:08.827 INFO:tasks.workunit.client.1.smithi173.stdout:4/124: mkdir d7/d28/d31 0 2024-02-16T22:19:08.827 INFO:tasks.workunit.client.1.smithi173.stdout:6/73: creat d0/f18 x:0 0 0 2024-02-16T22:19:08.827 INFO:tasks.workunit.client.1.smithi173.stdout:6/74: chown d0/ff 247586181 1 2024-02-16T22:19:08.827 INFO:tasks.workunit.client.1.smithi173.stdout:6/75: creat d0/f19 x:0 0 0 2024-02-16T22:19:08.827 INFO:tasks.workunit.client.1.smithi173.stdout:6/76: creat d0/db/f1a x:0 0 0 2024-02-16T22:19:08.830 INFO:tasks.workunit.client.1.smithi173.stdout:3/119: dread f8 [0,4194304] 0 2024-02-16T22:19:08.831 INFO:tasks.workunit.client.1.smithi173.stdout:8/191: mknod dd/d11/d22/c49 0 2024-02-16T22:19:08.831 INFO:tasks.workunit.client.1.smithi173.stdout:8/192: chown dd/d11/l30 61302 1 2024-02-16T22:19:08.831 INFO:tasks.workunit.client.1.smithi173.stdout:8/193: stat dd/l1b 0 2024-02-16T22:19:08.834 INFO:tasks.workunit.client.1.smithi173.stdout:9/68: sync 2024-02-16T22:19:08.834 INFO:tasks.workunit.client.1.smithi173.stdout:7/154: sync 2024-02-16T22:19:08.834 INFO:tasks.workunit.client.1.smithi173.stdout:7/155: chown d1/d5/d13/c1c 58393248 1 2024-02-16T22:19:08.834 INFO:tasks.workunit.client.1.smithi173.stdout:7/156: fsync d1/d1d/f1e 0 2024-02-16T22:19:08.834 INFO:tasks.workunit.client.1.smithi173.stdout:7/157: chown d1 453 1 2024-02-16T22:19:08.834 INFO:tasks.workunit.client.1.smithi173.stdout:7/158: dread - d1/d1d/f1e zero size 2024-02-16T22:19:08.834 INFO:tasks.workunit.client.1.smithi173.stdout:0/131: dwrite d0/d4/f2a [0,4194304] 0 2024-02-16T22:19:08.835 INFO:tasks.workunit.client.1.smithi173.stdout:5/174: dread d8/f26 [0,4194304] 0 2024-02-16T22:19:08.835 INFO:tasks.workunit.client.1.smithi173.stdout:5/175: fdatasync d8/f26 0 2024-02-16T22:19:08.835 INFO:tasks.workunit.client.1.smithi173.stdout:6/77: mknod d0/c1b 0 2024-02-16T22:19:08.835 INFO:tasks.workunit.client.1.smithi173.stdout:6/78: chown d0/fa 14 1 2024-02-16T22:19:08.836 INFO:tasks.workunit.client.1.smithi173.stdout:8/194: read dd/d11/f14 [1035383,21969] 0 2024-02-16T22:19:08.838 INFO:tasks.workunit.client.1.smithi173.stdout:3/120: mknod d9/d17/d1d/c31 0 2024-02-16T22:19:08.838 INFO:tasks.workunit.client.1.smithi173.stdout:3/121: chown d9/f29 308 1 2024-02-16T22:19:08.839 INFO:tasks.workunit.client.1.smithi173.stdout:7/159: mknod d1/d5/d10/d27/c30 0 2024-02-16T22:19:08.842 INFO:tasks.workunit.client.1.smithi173.stdout:5/176: mkdir d8/da/d2d/d3a 0 2024-02-16T22:19:08.845 INFO:tasks.workunit.client.1.smithi173.stdout:9/69: rmdir d1 39 2024-02-16T22:19:08.846 INFO:tasks.workunit.client.1.smithi173.stdout:7/160: truncate d1/d5/ff 3252227 0 2024-02-16T22:19:08.846 INFO:tasks.workunit.client.1.smithi173.stdout:8/195: dread dd/d11/f1a [0,4194304] 0 2024-02-16T22:19:08.846 INFO:tasks.workunit.client.1.smithi173.stdout:8/196: creat dd/d11/d22/d2e/d41/f4a x:0 0 0 2024-02-16T22:19:08.846 INFO:tasks.workunit.client.1.smithi173.stdout:8/197: truncate dd/f31 529694 0 2024-02-16T22:19:08.846 INFO:tasks.workunit.client.1.smithi173.stdout:8/198: dread - dd/d11/f2c zero size 2024-02-16T22:19:08.847 INFO:tasks.workunit.client.1.smithi173.stdout:9/70: mkdir d1/d2/d10/d17 0 2024-02-16T22:19:08.848 INFO:tasks.workunit.client.1.smithi173.stdout:7/161: link d1/d5/cd d1/d5/d10/c31 0 2024-02-16T22:19:08.848 INFO:tasks.workunit.client.1.smithi173.stdout:7/162: dread - d1/d5/d13/f26 zero size 2024-02-16T22:19:08.851 INFO:tasks.workunit.client.1.smithi173.stdout:5/177: unlink l3 0 2024-02-16T22:19:08.853 INFO:tasks.workunit.client.1.smithi173.stdout:8/199: rename dd/d11/d22/c49 to dd/c4b 0 2024-02-16T22:19:08.853 INFO:tasks.workunit.client.1.smithi173.stdout:8/200: truncate dd/d11/d22/d28/f35 409318 0 2024-02-16T22:19:08.853 INFO:tasks.workunit.client.1.smithi173.stdout:5/178: dread f4 [0,4194304] 0 2024-02-16T22:19:08.855 INFO:tasks.workunit.client.1.smithi173.stdout:9/71: link f0 d1/f18 0 2024-02-16T22:19:08.859 INFO:tasks.workunit.client.1.smithi173.stdout:7/163: creat d1/d1d/f32 x:0 0 0 2024-02-16T22:19:08.861 INFO:tasks.workunit.client.1.smithi173.stdout:3/122: dwrite d9/fb [0,4194304] 0 2024-02-16T22:19:08.862 INFO:tasks.workunit.client.1.smithi173.stdout:5/179: creat d8/da/d1b/f3b x:0 0 0 2024-02-16T22:19:08.864 INFO:tasks.workunit.client.1.smithi173.stdout:6/79: dwrite d0/f8 [0,4194304] 0 2024-02-16T22:19:08.866 INFO:tasks.workunit.client.1.smithi173.stdout:9/72: rmdir d1/d2/d10/d16 0 2024-02-16T22:19:08.866 INFO:tasks.workunit.client.1.smithi173.stdout:9/73: chown d1/d2/l3 1209150 1 2024-02-16T22:19:08.866 INFO:tasks.workunit.client.1.smithi173.stdout:9/74: getdents d1/d2/d10/d17 0 2024-02-16T22:19:08.873 INFO:tasks.workunit.client.1.smithi173.stdout:3/123: symlink d9/d1a/d21/l32 0 2024-02-16T22:19:08.873 INFO:tasks.workunit.client.1.smithi173.stdout:5/180: symlink d8/da/d1f/d30/d37/l3c 0 2024-02-16T22:19:08.876 INFO:tasks.workunit.client.1.smithi173.stdout:8/201: dwrite dd/d11/f1a [0,4194304] 0 2024-02-16T22:19:08.880 INFO:tasks.workunit.client.1.smithi173.stdout:6/80: rename d0/c16 to d0/db/c1c 0 2024-02-16T22:19:08.884 INFO:tasks.workunit.client.1.smithi173.stdout:9/75: mknod d1/c19 0 2024-02-16T22:19:08.884 INFO:tasks.workunit.client.1.smithi173.stdout:3/124: write d9/d17/d1d/f24 [3325227,86912] 0 2024-02-16T22:19:08.886 INFO:tasks.workunit.client.1.smithi173.stdout:5/181: creat d8/da/d2d/d36/f3d x:0 0 0 2024-02-16T22:19:08.888 INFO:tasks.workunit.client.1.smithi173.stdout:8/202: write dd/d11/f1a [2065924,21] 0 2024-02-16T22:19:08.888 INFO:tasks.workunit.client.1.smithi173.stdout:8/203: truncate dd/d11/d22/d2e/d41/f4a 27963 0 2024-02-16T22:19:08.890 INFO:tasks.workunit.client.1.smithi173.stdout:0/132: dwrite d0/d4/fa [0,4194304] 0 2024-02-16T22:19:08.894 INFO:tasks.workunit.client.1.smithi173.stdout:3/125: mknod d9/d18/c33 0 2024-02-16T22:19:08.896 INFO:tasks.workunit.client.1.smithi173.stdout:5/182: rename d8/da/f11 to d8/da/d1f/d33/f3e 0 2024-02-16T22:19:08.896 INFO:tasks.workunit.client.1.smithi173.stdout:5/183: dread - d8/da/f23 zero size 2024-02-16T22:19:08.897 INFO:tasks.workunit.client.1.smithi173.stdout:5/184: read f4 [1093713,119540] 0 2024-02-16T22:19:08.898 INFO:tasks.workunit.client.1.smithi173.stdout:5/185: write f4 [1674224,44150] 0 2024-02-16T22:19:08.899 INFO:tasks.workunit.client.1.smithi173.stdout:3/126: write f8 [3776075,45669] 0 2024-02-16T22:19:08.899 INFO:tasks.workunit.client.1.smithi173.stdout:3/127: stat d9/d17/c26 0 2024-02-16T22:19:08.899 INFO:tasks.workunit.client.1.smithi173.stdout:8/204: symlink dd/d11/d22/d28/d40/l4c 0 2024-02-16T22:19:08.901 INFO:tasks.workunit.client.1.smithi173.stdout:9/76: mkdir d1/d2/d1a 0 2024-02-16T22:19:08.901 INFO:tasks.workunit.client.1.smithi173.stdout:6/81: dwrite d0/f14 [0,4194304] 0 2024-02-16T22:19:08.901 INFO:tasks.workunit.client.1.smithi173.stdout:3/128: getdents d9/d1a 0 2024-02-16T22:19:08.901 INFO:tasks.workunit.client.1.smithi173.stdout:3/129: read d9/d1a/d2b/f2d [1864286,2175] 0 2024-02-16T22:19:08.901 INFO:tasks.workunit.client.1.smithi173.stdout:3/130: chown d9/d1a/d2b 190 1 2024-02-16T22:19:08.903 INFO:tasks.workunit.client.1.smithi173.stdout:8/205: symlink dd/d11/d22/d2e/l4d 0 2024-02-16T22:19:08.905 INFO:tasks.workunit.client.1.smithi173.stdout:0/133: dread d0/d4/f2a [0,4194304] 0 2024-02-16T22:19:08.905 INFO:tasks.workunit.client.1.smithi173.stdout:0/134: chown d0/l20 0 1 2024-02-16T22:19:08.905 INFO:tasks.workunit.client.1.smithi173.stdout:0/135: stat d0/l9 0 2024-02-16T22:19:08.905 INFO:tasks.workunit.client.1.smithi173.stdout:3/131: dread d9/da/f1b [0,4194304] 0 2024-02-16T22:19:08.906 INFO:tasks.workunit.client.1.smithi173.stdout:8/206: dread f9 [0,4194304] 0 2024-02-16T22:19:08.910 INFO:tasks.workunit.client.1.smithi173.stdout:6/82: link d0/db/c1c d0/db/c1d 0 2024-02-16T22:19:08.911 INFO:tasks.workunit.client.1.smithi173.stdout:6/83: chown d0/c17 321243 1 2024-02-16T22:19:08.914 INFO:tasks.workunit.client.1.smithi173.stdout:3/132: creat d9/d1a/f34 x:0 0 0 2024-02-16T22:19:08.918 INFO:tasks.workunit.client.1.smithi173.stdout:8/207: rename dd/d11/f1a to dd/d11/d22/f4e 0 2024-02-16T22:19:08.918 INFO:tasks.workunit.client.1.smithi173.stdout:8/208: write dd/d11/d22/d28/f33 [1308809,74549] 0 2024-02-16T22:19:08.921 INFO:tasks.workunit.client.1.smithi173.stdout:5/186: dwrite d8/da/f1c [0,4194304] 0 2024-02-16T22:19:08.923 INFO:tasks.workunit.client.1.smithi173.stdout:3/133: link d9/d17/c26 d9/d1a/c35 0 2024-02-16T22:19:08.923 INFO:tasks.workunit.client.1.smithi173.stdout:5/187: read d8/fd [525260,113667] 0 2024-02-16T22:19:08.923 INFO:tasks.workunit.client.1.smithi173.stdout:5/188: write d8/f26 [3743338,98756] 0 2024-02-16T22:19:08.923 INFO:tasks.workunit.client.1.smithi173.stdout:5/189: truncate d8/da/d2d/d36/f3d 891732 0 2024-02-16T22:19:08.923 INFO:tasks.workunit.client.1.smithi173.stdout:5/190: chown d8/da/f24 102504647 1 2024-02-16T22:19:08.924 INFO:tasks.workunit.client.1.smithi173.stdout:5/191: chown d8/fd 0 1 2024-02-16T22:19:08.928 INFO:tasks.workunit.client.1.smithi173.stdout:9/77: getdents d1/d2 0 2024-02-16T22:19:08.928 INFO:tasks.workunit.client.1.smithi173.stdout:9/78: readlink d1/le 0 2024-02-16T22:19:08.931 INFO:tasks.workunit.client.1.smithi173.stdout:6/84: dwrite d0/db/f12 [0,4194304] 0 2024-02-16T22:19:08.931 INFO:tasks.workunit.client.1.smithi173.stdout:6/85: dread - d0/f19 zero size 2024-02-16T22:19:08.931 INFO:tasks.workunit.client.1.smithi173.stdout:6/86: write d0/f19 [599220,1286] 0 2024-02-16T22:19:08.931 INFO:tasks.workunit.client.1.smithi173.stdout:6/87: chown d0/db/lc 3135 1 2024-02-16T22:19:08.931 INFO:tasks.workunit.client.1.smithi173.stdout:6/88: creat d0/f1e x:0 0 0 2024-02-16T22:19:08.931 INFO:tasks.workunit.client.1.smithi173.stdout:6/89: read d0/fd [444432,40674] 0 2024-02-16T22:19:08.931 INFO:tasks.workunit.client.1.smithi173.stdout:6/90: creat d0/db/f1f x:0 0 0 2024-02-16T22:19:08.932 INFO:tasks.workunit.client.1.smithi173.stdout:8/209: rename dd/c19 to dd/d11/d22/c4f 0 2024-02-16T22:19:08.935 INFO:tasks.workunit.client.1.smithi173.stdout:3/134: symlink d9/d17/l36 0 2024-02-16T22:19:08.936 INFO:tasks.workunit.client.1.smithi173.stdout:5/192: unlink d8/da/l2b 0 2024-02-16T22:19:08.936 INFO:tasks.workunit.client.1.smithi173.stdout:5/193: write d8/da/d1b/f3b [53125,12977] 0 2024-02-16T22:19:08.938 INFO:tasks.workunit.client.1.smithi173.stdout:9/79: rmdir d1/d2 39 2024-02-16T22:19:08.944 INFO:tasks.workunit.client.1.smithi173.stdout:3/135: link d9/d1a/d21/l32 d9/d1a/d2b/l37 0 2024-02-16T22:19:08.944 INFO:tasks.workunit.client.1.smithi173.stdout:3/136: creat d9/d17/d1d/f38 x:0 0 0 2024-02-16T22:19:08.947 INFO:tasks.workunit.client.1.smithi173.stdout:6/91: dread d0/ff [0,4194304] 0 2024-02-16T22:19:08.948 INFO:tasks.workunit.client.1.smithi173.stdout:3/137: creat d9/d17/d25/f39 x:0 0 0 2024-02-16T22:19:08.951 INFO:tasks.workunit.client.1.smithi173.stdout:3/138: mknod d9/d1a/d2b/c3a 0 2024-02-16T22:19:08.951 INFO:tasks.workunit.client.1.smithi173.stdout:3/139: write d9/f22 [2168424,8422] 0 2024-02-16T22:19:08.951 INFO:tasks.workunit.client.1.smithi173.stdout:3/140: chown d9/d17/d1d/f38 66211 1 2024-02-16T22:19:08.951 INFO:tasks.workunit.client.1.smithi173.stdout:3/141: truncate d9/d1a/f2c 3274585 0 2024-02-16T22:19:08.953 INFO:tasks.workunit.client.1.smithi173.stdout:3/142: symlink d9/d17/d25/l3b 0 2024-02-16T22:19:08.953 INFO:tasks.workunit.client.1.smithi173.stdout:3/143: write d9/f22 [3010892,106968] 0 2024-02-16T22:19:08.964 INFO:tasks.workunit.client.1.smithi173.stdout:8/210: dwrite f4 [8388608,4194304] 0 2024-02-16T22:19:08.964 INFO:tasks.workunit.client.1.smithi173.stdout:8/211: dread - dd/d11/d22/d28/f2f zero size 2024-02-16T22:19:08.964 INFO:tasks.workunit.client.1.smithi173.stdout:6/92: dwrite d0/db/f1f [0,4194304] 0 2024-02-16T22:19:08.979 INFO:tasks.workunit.client.1.smithi173.stdout:8/212: mkdir dd/d11/d22/d50 0 2024-02-16T22:19:08.979 INFO:tasks.workunit.client.1.smithi173.stdout:8/213: write dd/f31 [828326,83834] 0 2024-02-16T22:19:08.979 INFO:tasks.workunit.client.1.smithi173.stdout:8/214: readlink l8 0 2024-02-16T22:19:08.987 INFO:tasks.workunit.client.1.smithi173.stdout:6/93: rename d0/db/c1c to d0/db/c20 0 2024-02-16T22:19:08.989 INFO:tasks.workunit.client.1.smithi173.stdout:8/215: mkdir dd/d11/d22/d28/d40/d51 0 2024-02-16T22:19:08.991 INFO:tasks.workunit.client.1.smithi173.stdout:8/216: mkdir dd/d11/d22/d28/d40/d52 0 2024-02-16T22:19:08.991 INFO:tasks.workunit.client.1.smithi173.stdout:8/217: write dd/d11/d22/d28/f2f [731679,103961] 0 2024-02-16T22:19:08.991 INFO:tasks.workunit.client.1.smithi173.stdout:8/218: write dd/d11/f36 [25720,99380] 0 2024-02-16T22:19:08.992 INFO:tasks.workunit.client.1.smithi173.stdout:8/219: chown c3 2 1 2024-02-16T22:19:08.992 INFO:tasks.workunit.client.1.smithi173.stdout:8/220: dread - dd/d11/d22/f2a zero size 2024-02-16T22:19:08.994 INFO:tasks.workunit.client.1.smithi173.stdout:8/221: symlink dd/d11/d22/d28/d40/l53 0 2024-02-16T22:19:08.994 INFO:tasks.workunit.client.1.smithi173.stdout:8/222: readlink dd/d11/l1e 0 2024-02-16T22:19:08.997 INFO:tasks.workunit.client.1.smithi173.stdout:8/223: link fc dd/d11/d22/d28/d40/d52/f54 0 2024-02-16T22:19:09.010 INFO:tasks.workunit.client.1.smithi173.stdout:1/195: sync 2024-02-16T22:19:09.011 INFO:tasks.workunit.client.1.smithi173.stdout:1/196: mknod db/d1d/c46 0 2024-02-16T22:19:09.012 INFO:tasks.workunit.client.1.smithi173.stdout:1/197: chown db/d1c/d25/d28/d3f 103550 1 2024-02-16T22:19:09.012 INFO:tasks.workunit.client.1.smithi173.stdout:1/198: readlink db/d1c/l2a 0 2024-02-16T22:19:09.012 INFO:tasks.workunit.client.1.smithi173.stdout:1/199: write db/d1c/d25/d28/f3a [61883,42056] 0 2024-02-16T22:19:09.017 INFO:tasks.workunit.client.1.smithi173.stdout:8/224: write dd/f16 [3237716,55460] 0 2024-02-16T22:19:09.017 INFO:tasks.workunit.client.1.smithi173.stdout:6/94: dwrite d0/f19 [0,4194304] 0 2024-02-16T22:19:09.017 INFO:tasks.workunit.client.1.smithi173.stdout:6/95: fsync d0/f1e 0 2024-02-16T22:19:09.022 INFO:tasks.workunit.client.1.smithi173.stdout:8/225: unlink dd/d11/f23 0 2024-02-16T22:19:09.026 INFO:tasks.workunit.client.1.smithi173.stdout:6/96: dread d0/db/f12 [0,4194304] 0 2024-02-16T22:19:09.027 INFO:tasks.workunit.client.1.smithi173.stdout:6/97: mknod d0/db/c21 0 2024-02-16T22:19:09.029 INFO:tasks.workunit.client.1.smithi173.stdout:1/200: dwrite db/d1d/f2c [0,4194304] 0 2024-02-16T22:19:09.029 INFO:tasks.workunit.client.1.smithi173.stdout:1/201: fsync db/d30/f43 0 2024-02-16T22:19:09.036 INFO:tasks.workunit.client.1.smithi173.stdout:6/98: write d0/db/f12 [648034,82337] 0 2024-02-16T22:19:09.037 INFO:tasks.workunit.client.1.smithi173.stdout:1/202: creat db/d1c/d25/f47 x:0 0 0 2024-02-16T22:19:09.037 INFO:tasks.workunit.client.1.smithi173.stdout:1/203: write db/d1c/d25/f47 [36736,49088] 0 2024-02-16T22:19:09.041 INFO:tasks.workunit.client.1.smithi173.stdout:1/204: rmdir db/d1c/d25/d44 0 2024-02-16T22:19:09.041 INFO:tasks.workunit.client.1.smithi173.stdout:1/205: write db/d1c/d25/d28/f3a [974721,97880] 0 2024-02-16T22:19:09.043 INFO:tasks.workunit.client.1.smithi173.stdout:1/206: rename db/d1d/f32 to db/d30/f48 0 2024-02-16T22:19:09.043 INFO:tasks.workunit.client.1.smithi173.stdout:1/207: write db/d1c/d25/d28/f3a [1184538,123238] 0 2024-02-16T22:19:09.043 INFO:tasks.workunit.client.1.smithi173.stdout:1/208: write db/f18 [464612,120970] 0 2024-02-16T22:19:09.044 INFO:tasks.workunit.client.1.smithi173.stdout:8/226: dwrite dd/d11/d22/d2e/d41/f45 [0,4194304] 0 2024-02-16T22:19:09.057 INFO:tasks.workunit.client.1.smithi173.stdout:6/99: dwrite d0/db/f1a [0,4194304] 0 2024-02-16T22:19:09.062 INFO:tasks.workunit.client.1.smithi173.stdout:6/100: getdents d0/db 0 2024-02-16T22:19:09.071 INFO:tasks.workunit.client.1.smithi173.stdout:8/227: dwrite dd/d11/f13 [0,4194304] 0 2024-02-16T22:19:09.071 INFO:tasks.workunit.client.1.smithi173.stdout:8/228: readlink dd/l1b 0 2024-02-16T22:19:09.071 INFO:tasks.workunit.client.1.smithi173.stdout:1/209: dwrite db/d1c/d25/f47 [0,4194304] 0 2024-02-16T22:19:09.071 INFO:tasks.workunit.client.1.smithi173.stdout:1/210: creat db/d1c/d25/d28/f49 x:0 0 0 2024-02-16T22:19:09.076 INFO:tasks.workunit.client.1.smithi173.stdout:6/101: write d0/f8 [1127961,119450] 0 2024-02-16T22:19:09.076 INFO:tasks.workunit.client.1.smithi173.stdout:6/102: truncate d0/fd 703203 0 2024-02-16T22:19:09.076 INFO:tasks.workunit.client.1.smithi173.stdout:6/103: creat d0/f22 x:0 0 0 2024-02-16T22:19:09.076 INFO:tasks.workunit.client.1.smithi173.stdout:6/104: write d0/fd [97358,125501] 0 2024-02-16T22:19:09.076 INFO:tasks.workunit.client.1.smithi173.stdout:6/105: dread - d0/f22 zero size 2024-02-16T22:19:09.082 INFO:tasks.workunit.client.1.smithi173.stdout:1/211: unlink db/f10 0 2024-02-16T22:19:09.082 INFO:tasks.workunit.client.1.smithi173.stdout:1/212: chown db/d1c/d25/d45 10 1 2024-02-16T22:19:09.087 INFO:tasks.workunit.client.1.smithi173.stdout:8/229: dwrite dd/d11/d22/d2e/d41/f42 [0,4194304] 0 2024-02-16T22:19:09.087 INFO:tasks.workunit.client.1.smithi173.stdout:1/213: dread db/d29/f39 [0,4194304] 0 2024-02-16T22:19:09.087 INFO:tasks.workunit.client.1.smithi173.stdout:1/214: chown db/d1c/l21 1006756516 1 2024-02-16T22:19:09.091 INFO:tasks.workunit.client.1.smithi173.stdout:8/230: rename dd/d11/l30 to dd/d11/d22/l55 0 2024-02-16T22:19:09.092 INFO:tasks.workunit.client.1.smithi173.stdout:1/215: mkdir db/d1c/d25/d28/d3f/d4a 0 2024-02-16T22:19:09.094 INFO:tasks.workunit.client.1.smithi173.stdout:8/231: rename dd/d11/f36 to dd/d11/d22/d2e/d41/f56 0 2024-02-16T22:19:09.094 INFO:tasks.workunit.client.1.smithi173.stdout:8/232: fsync dd/d11/d22/d28/f35 0 2024-02-16T22:19:09.095 INFO:tasks.workunit.client.1.smithi173.stdout:6/106: rmdir d0 39 2024-02-16T22:19:09.095 INFO:tasks.workunit.client.1.smithi173.stdout:6/107: write d0/f8 [2686353,46487] 0 2024-02-16T22:19:09.096 INFO:tasks.workunit.client.1.smithi173.stdout:1/216: unlink c6 0 2024-02-16T22:19:09.096 INFO:tasks.workunit.client.1.smithi173.stdout:1/217: creat db/f4b x:0 0 0 2024-02-16T22:19:09.101 INFO:tasks.workunit.client.1.smithi173.stdout:2/186: sync 2024-02-16T22:19:09.101 INFO:tasks.workunit.client.1.smithi173.stdout:2/187: write d2/d4/f39 [188054,56989] 0 2024-02-16T22:19:09.101 INFO:tasks.workunit.client.1.smithi173.stdout:2/188: chown d2/dc/l2c 999615 1 2024-02-16T22:19:09.101 INFO:tasks.workunit.client.1.smithi173.stdout:2/189: chown d2/d4/d8/d30/f3b 28 1 2024-02-16T22:19:09.103 INFO:tasks.workunit.client.1.smithi173.stdout:2/190: symlink d2/d4/l3d 0 2024-02-16T22:19:09.109 INFO:tasks.workunit.client.1.smithi173.stdout:2/191: link d2/d4/d8/d30/f38 d2/dc/d19/d1c/f3e 0 2024-02-16T22:19:09.111 INFO:tasks.workunit.client.1.smithi173.stdout:1/218: write f2 [2769001,16805] 0 2024-02-16T22:19:09.114 INFO:tasks.workunit.client.1.smithi173.stdout:1/219: symlink db/d30/l4c 0 2024-02-16T22:19:09.114 INFO:tasks.workunit.client.1.smithi173.stdout:1/220: truncate db/d1c/d25/d28/f49 375078 0 2024-02-16T22:19:09.119 INFO:tasks.workunit.client.1.smithi173.stdout:8/233: dwrite fc [0,4194304] 0 2024-02-16T22:19:09.119 INFO:tasks.workunit.client.1.smithi173.stdout:8/234: write dd/d11/d22/d28/f2f [1335566,3030] 0 2024-02-16T22:19:09.123 INFO:tasks.workunit.client.1.smithi173.stdout:8/235: rename dd/d11/d22/d28/f35 to dd/d11/d22/d2e/f57 0 2024-02-16T22:19:09.124 INFO:tasks.workunit.client.1.smithi173.stdout:6/108: dwrite d0/db/f12 [0,4194304] 0 2024-02-16T22:19:09.124 INFO:tasks.workunit.client.1.smithi173.stdout:8/236: mkdir dd/d11/d58 0 2024-02-16T22:19:09.125 INFO:tasks.workunit.client.1.smithi173.stdout:6/109: mknod d0/c23 0 2024-02-16T22:19:09.125 INFO:tasks.workunit.client.1.smithi173.stdout:2/192: dwrite f1 [0,4194304] 0 2024-02-16T22:19:09.126 INFO:tasks.workunit.client.1.smithi173.stdout:8/237: creat dd/d11/d22/d28/d40/f59 x:0 0 0 2024-02-16T22:19:09.128 INFO:tasks.workunit.client.1.smithi173.stdout:6/110: rename d0/f8 to d0/f24 0 2024-02-16T22:19:09.129 INFO:tasks.workunit.client.1.smithi173.stdout:8/238: dread dd/d11/d22/f3f [0,4194304] 0 2024-02-16T22:19:09.130 INFO:tasks.workunit.client.1.smithi173.stdout:2/193: getdents d2/d4/d8 0 2024-02-16T22:19:09.130 INFO:tasks.workunit.client.1.smithi173.stdout:2/194: creat d2/dc/d19/d1a/f3f x:0 0 0 2024-02-16T22:19:09.130 INFO:tasks.workunit.client.1.smithi173.stdout:2/195: stat d2/d4/d8/d30 0 2024-02-16T22:19:09.133 INFO:tasks.workunit.client.1.smithi173.stdout:8/239: mkdir dd/d11/d22/d5a 0 2024-02-16T22:19:09.133 INFO:tasks.workunit.client.1.smithi173.stdout:2/196: dread d2/f28 [0,4194304] 0 2024-02-16T22:19:09.133 INFO:tasks.workunit.client.1.smithi173.stdout:2/197: chown d2/d4/d8/d2d 464914093 1 2024-02-16T22:19:09.136 INFO:tasks.workunit.client.1.smithi173.stdout:8/240: dread dd/d11/d22/d28/f33 [0,4194304] 0 2024-02-16T22:19:09.136 INFO:tasks.workunit.client.1.smithi173.stdout:8/241: readlink dd/l1b 0 2024-02-16T22:19:09.142 INFO:tasks.workunit.client.1.smithi173.stdout:2/198: symlink d2/dc/d19/d1a/l40 0 2024-02-16T22:19:09.143 INFO:tasks.workunit.client.1.smithi173.stdout:8/242: dread f2 [0,4194304] 0 2024-02-16T22:19:09.143 INFO:tasks.workunit.client.1.smithi173.stdout:8/243: stat dd/d11/c21 0 2024-02-16T22:19:09.143 INFO:tasks.workunit.client.1.smithi173.stdout:8/244: creat dd/d11/f5b x:0 0 0 2024-02-16T22:19:09.143 INFO:tasks.workunit.client.1.smithi173.stdout:8/245: fdatasync dd/d11/f5b 0 2024-02-16T22:19:09.144 INFO:tasks.workunit.client.1.smithi173.stdout:2/199: mknod d2/dc/d19/d1a/c41 0 2024-02-16T22:19:09.144 INFO:tasks.workunit.client.1.smithi173.stdout:2/200: read d2/dc/d19/d1c/f20 [571541,87156] 0 2024-02-16T22:19:09.146 INFO:tasks.workunit.client.1.smithi173.stdout:8/246: rename dd/l10 to dd/d11/d22/d2e/l5c 0 2024-02-16T22:19:09.146 INFO:tasks.workunit.client.1.smithi173.stdout:8/247: truncate dd/d11/d22/f4e 4950333 0 2024-02-16T22:19:09.146 INFO:tasks.workunit.client.1.smithi173.stdout:8/248: write dd/d11/d22/f4e [2092115,59003] 0 2024-02-16T22:19:09.147 INFO:tasks.workunit.client.1.smithi173.stdout:8/249: link dd/d11/f39 dd/d11/d22/d50/f5d 0 2024-02-16T22:19:09.152 INFO:tasks.workunit.client.1.smithi173.stdout:8/250: rename dd/d11/l1e to dd/d11/d22/d28/l5e 0 2024-02-16T22:19:09.152 INFO:tasks.workunit.client.1.smithi173.stdout:8/251: chown dd/d11/f13 22 1 2024-02-16T22:19:09.152 INFO:tasks.workunit.client.1.smithi173.stdout:8/252: readlink dd/d11/d22/d2e/l4d 0 2024-02-16T22:19:09.159 INFO:tasks.workunit.client.1.smithi173.stdout:6/111: getdents d0 0 2024-02-16T22:19:09.159 INFO:tasks.workunit.client.1.smithi173.stdout:6/112: dread - d0/f22 zero size 2024-02-16T22:19:09.159 INFO:tasks.workunit.client.1.smithi173.stdout:6/113: write d0/f22 [577199,8234] 0 2024-02-16T22:19:09.161 INFO:tasks.workunit.client.1.smithi173.stdout:6/114: link d0/ff d0/db/f25 0 2024-02-16T22:19:09.161 INFO:tasks.workunit.client.1.smithi173.stdout:6/115: stat d0/ce 0 2024-02-16T22:19:09.164 INFO:tasks.workunit.client.1.smithi173.stdout:6/116: creat d0/f26 x:0 0 0 2024-02-16T22:19:09.165 INFO:tasks.workunit.client.1.smithi173.stdout:6/117: symlink d0/l27 0 2024-02-16T22:19:09.166 INFO:tasks.workunit.client.1.smithi173.stdout:6/118: creat d0/db/f28 x:0 0 0 2024-02-16T22:19:09.169 INFO:tasks.workunit.client.1.smithi173.stdout:2/201: dwrite d2/dc/d19/d1a/f34 [0,4194304] 0 2024-02-16T22:19:09.169 INFO:tasks.workunit.client.1.smithi173.stdout:8/253: dwrite dd/d11/f27 [0,4194304] 0 2024-02-16T22:19:09.172 INFO:tasks.workunit.client.1.smithi173.stdout:2/202: link d2/l3 d2/d10/l42 0 2024-02-16T22:19:09.172 INFO:tasks.workunit.client.1.smithi173.stdout:2/203: read d2/dc/d19/f1f [831994,26689] 0 2024-02-16T22:19:09.176 INFO:tasks.workunit.client.1.smithi173.stdout:8/254: stat dd/d11/d22/d28/l5e 0 2024-02-16T22:19:09.176 INFO:tasks.workunit.client.1.smithi173.stdout:7/164: sync 2024-02-16T22:19:09.176 INFO:tasks.workunit.client.1.smithi173.stdout:7/165: dread - d1/d5/d10/f24 zero size 2024-02-16T22:19:09.176 INFO:tasks.workunit.client.1.smithi173.stdout:7/166: truncate d1/d1d/f1e 390817 0 2024-02-16T22:19:09.176 INFO:tasks.workunit.client.1.smithi173.stdout:4/125: sync 2024-02-16T22:19:09.177 INFO:tasks.workunit.client.1.smithi173.stdout:0/136: sync 2024-02-16T22:19:09.177 INFO:tasks.workunit.client.1.smithi173.stdout:6/119: write d0/fa [614237,110357] 0 2024-02-16T22:19:09.177 INFO:tasks.workunit.client.1.smithi173.stdout:6/120: creat d0/db/f29 x:0 0 0 2024-02-16T22:19:09.177 INFO:tasks.workunit.client.1.smithi173.stdout:6/121: fsync d0/f19 0 2024-02-16T22:19:09.178 INFO:tasks.workunit.client.1.smithi173.stdout:7/167: rename d1/d5/cd to d1/d5/c33 0 2024-02-16T22:19:09.180 INFO:tasks.workunit.client.1.smithi173.stdout:4/126: mkdir d7/d28/d14/d32 0 2024-02-16T22:19:09.180 INFO:tasks.workunit.client.1.smithi173.stdout:4/127: read - d7/d12/f19 zero size 2024-02-16T22:19:09.183 INFO:tasks.workunit.client.1.smithi173.stdout:0/137: symlink d0/d4/d14/d24/l30 0 2024-02-16T22:19:09.183 INFO:tasks.workunit.client.1.smithi173.stdout:0/138: chown d0/ff 36935 1 2024-02-16T22:19:09.184 INFO:tasks.workunit.client.1.smithi173.stdout:6/122: dread d0/f24 [0,4194304] 0 2024-02-16T22:19:09.184 INFO:tasks.workunit.client.1.smithi173.stdout:6/123: creat d0/db/f2a x:0 0 0 2024-02-16T22:19:09.184 INFO:tasks.workunit.client.1.smithi173.stdout:6/124: write d0/db/f10 [405481,5193] 0 2024-02-16T22:19:09.184 INFO:tasks.workunit.client.1.smithi173.stdout:6/125: creat d0/f2b x:0 0 0 2024-02-16T22:19:09.184 INFO:tasks.workunit.client.1.smithi173.stdout:0/139: rmdir d0/d4/d14 39 2024-02-16T22:19:09.185 INFO:tasks.workunit.client.1.smithi173.stdout:8/255: read dd/d11/f13 [1080601,77700] 0 2024-02-16T22:19:09.193 INFO:tasks.workunit.client.1.smithi173.stdout:4/128: write d7/d12/f2b [949024,120990] 0 2024-02-16T22:19:09.194 INFO:tasks.workunit.client.1.smithi173.stdout:0/140: dread d0/d4/f2a [0,4194304] 0 2024-02-16T22:19:09.194 INFO:tasks.workunit.client.1.smithi173.stdout:0/141: fdatasync d0/d4/f26 0 2024-02-16T22:19:09.194 INFO:tasks.workunit.client.1.smithi173.stdout:2/204: dwrite d2/db/f18 [4194304,4194304] 0 2024-02-16T22:19:09.198 INFO:tasks.workunit.client.1.smithi173.stdout:6/126: getdents d0 0 2024-02-16T22:19:09.201 INFO:tasks.workunit.client.1.smithi173.stdout:6/127: link d0/ce d0/c2c 0 2024-02-16T22:19:09.201 INFO:tasks.workunit.client.1.smithi173.stdout:4/129: rmdir d7/d12/d2d 39 2024-02-16T22:19:09.202 INFO:tasks.workunit.client.1.smithi173.stdout:4/130: truncate d7/df/f22 854214 0 2024-02-16T22:19:09.203 INFO:tasks.workunit.client.1.smithi173.stdout:6/128: creat d0/f2d x:0 0 0 2024-02-16T22:19:09.204 INFO:tasks.workunit.client.1.smithi173.stdout:4/131: rmdir d7/df/d27 0 2024-02-16T22:19:09.205 INFO:tasks.workunit.client.1.smithi173.stdout:4/132: mkdir d7/d28/d31/d33 0 2024-02-16T22:19:09.205 INFO:tasks.workunit.client.1.smithi173.stdout:4/133: fsync d7/df/f1b 0 2024-02-16T22:19:09.206 INFO:tasks.workunit.client.1.smithi173.stdout:4/134: write d7/d28/f1d [1522803,113585] 0 2024-02-16T22:19:09.206 INFO:tasks.workunit.client.1.smithi173.stdout:6/129: mkdir d0/db/d2e 0 2024-02-16T22:19:09.207 INFO:tasks.workunit.client.1.smithi173.stdout:2/205: read d2/db/f18 [5050368,63176] 0 2024-02-16T22:19:09.207 INFO:tasks.workunit.client.1.smithi173.stdout:7/168: dwrite d1/f9 [0,4194304] 0 2024-02-16T22:19:09.207 INFO:tasks.workunit.client.1.smithi173.stdout:8/256: dwrite dd/d11/d22/d28/f47 [0,4194304] 0 2024-02-16T22:19:09.207 INFO:tasks.workunit.client.1.smithi173.stdout:8/257: chown dd/d11/d22/d5a 1820371 1 2024-02-16T22:19:09.207 INFO:tasks.workunit.client.1.smithi173.stdout:8/258: fdatasync dd/f16 0 2024-02-16T22:19:09.209 INFO:tasks.workunit.client.1.smithi173.stdout:4/135: symlink d7/d28/d14/d32/l34 0 2024-02-16T22:19:09.209 INFO:tasks.workunit.client.1.smithi173.stdout:7/169: dread d1/d5/d11/f14 [0,4194304] 0 2024-02-16T22:19:09.209 INFO:tasks.workunit.client.1.smithi173.stdout:7/170: fsync d1/d1d/f20 0 2024-02-16T22:19:09.209 INFO:tasks.workunit.client.1.smithi173.stdout:7/171: truncate d1/d5/d10/f24 866236 0 2024-02-16T22:19:09.210 INFO:tasks.workunit.client.1.smithi173.stdout:6/130: mkdir d0/db/d2e/d2f 0 2024-02-16T22:19:09.219 INFO:tasks.workunit.client.1.smithi173.stdout:8/259: rmdir dd/d11/d22/d2e 39 2024-02-16T22:19:09.221 INFO:tasks.workunit.client.1.smithi173.stdout:7/172: unlink d1/d5/d13/c1c 0 2024-02-16T22:19:09.221 INFO:tasks.workunit.client.1.smithi173.stdout:7/173: truncate d1/d5/f2b 920495 0 2024-02-16T22:19:09.222 INFO:tasks.workunit.client.1.smithi173.stdout:8/260: dread dd/d11/d22/d28/f2f [0,4194304] 0 2024-02-16T22:19:09.222 INFO:tasks.workunit.client.1.smithi173.stdout:8/261: fsync dd/f16 0 2024-02-16T22:19:09.223 INFO:tasks.workunit.client.1.smithi173.stdout:6/131: rename d0/db/f10 to d0/db/d2e/f30 0 2024-02-16T22:19:09.225 INFO:tasks.workunit.client.1.smithi173.stdout:7/174: truncate d1/d1d/f20 2215374 0 2024-02-16T22:19:09.225 INFO:tasks.workunit.client.1.smithi173.stdout:8/262: mkdir dd/d11/d22/d28/d40/d51/d5f 0 2024-02-16T22:19:09.226 INFO:tasks.workunit.client.1.smithi173.stdout:8/263: read dd/d11/f13 [1322537,56563] 0 2024-02-16T22:19:09.226 INFO:tasks.workunit.client.1.smithi173.stdout:6/132: mkdir d0/db/d2e/d2f/d31 0 2024-02-16T22:19:09.227 INFO:tasks.workunit.client.1.smithi173.stdout:7/175: symlink d1/d5/d10/d27/l34 0 2024-02-16T22:19:09.229 INFO:tasks.workunit.client.1.smithi173.stdout:6/133: rename d0/db/c1d to d0/db/d2e/c32 0 2024-02-16T22:19:09.230 INFO:tasks.workunit.client.1.smithi173.stdout:7/176: link d1/d5/f2b d1/d5/d10/d28/f35 0 2024-02-16T22:19:09.230 INFO:tasks.workunit.client.1.smithi173.stdout:7/177: dread - d1/f2f zero size 2024-02-16T22:19:09.230 INFO:tasks.workunit.client.1.smithi173.stdout:7/178: write d1/d5/f4 [2815751,120680] 0 2024-02-16T22:19:09.230 INFO:tasks.workunit.client.1.smithi173.stdout:6/134: mkdir d0/db/d2e/d2f/d31/d33 0 2024-02-16T22:19:09.232 INFO:tasks.workunit.client.1.smithi173.stdout:6/135: mknod d0/db/d2e/d2f/c34 0 2024-02-16T22:19:09.232 INFO:tasks.workunit.client.1.smithi173.stdout:4/136: dwrite d7/d12/f2b [4194304,4194304] 0 2024-02-16T22:19:09.232 INFO:tasks.workunit.client.1.smithi173.stdout:2/206: dwrite d2/f3c [0,4194304] 0 2024-02-16T22:19:09.238 INFO:tasks.workunit.client.1.smithi173.stdout:4/137: rename d7/l16 to d7/d28/d14/l35 0 2024-02-16T22:19:09.242 INFO:tasks.workunit.client.1.smithi173.stdout:2/207: mkdir d2/d4/d43 0 2024-02-16T22:19:09.245 INFO:tasks.workunit.client.1.smithi173.stdout:2/208: unlink d2/dc/l2c 0 2024-02-16T22:19:09.247 INFO:tasks.workunit.client.1.smithi173.stdout:2/209: mkdir d2/d4/d8/d30/d44 0 2024-02-16T22:19:09.250 INFO:tasks.workunit.client.1.smithi173.stdout:8/264: dwrite dd/d11/d22/d28/f33 [0,4194304] 0 2024-02-16T22:19:09.250 INFO:tasks.workunit.client.1.smithi173.stdout:7/179: dwrite d1/f9 [0,4194304] 0 2024-02-16T22:19:09.251 INFO:tasks.workunit.client.1.smithi173.stdout:7/180: fdatasync d1/d1d/f1e 0 2024-02-16T22:19:09.251 INFO:tasks.workunit.client.1.smithi173.stdout:7/181: write d1/d5/d10/d28/f35 [1355550,25286] 0 2024-02-16T22:19:09.251 INFO:tasks.workunit.client.1.smithi173.stdout:8/265: write dd/d11/d22/d50/f5d [617138,59456] 0 2024-02-16T22:19:09.251 INFO:tasks.workunit.client.1.smithi173.stdout:8/266: creat dd/d11/f60 x:0 0 0 2024-02-16T22:19:09.251 INFO:tasks.workunit.client.1.smithi173.stdout:8/267: chown l8 9767 1 2024-02-16T22:19:09.251 INFO:tasks.workunit.client.1.smithi173.stdout:2/210: creat d2/d4/d8/d30/f45 x:0 0 0 2024-02-16T22:19:09.253 INFO:tasks.workunit.client.1.smithi173.stdout:7/182: mkdir d1/d5/d13/d36 0 2024-02-16T22:19:09.253 INFO:tasks.workunit.client.1.smithi173.stdout:2/211: dread d2/dc/d19/f1f [0,4194304] 0 2024-02-16T22:19:09.253 INFO:tasks.workunit.client.1.smithi173.stdout:2/212: chown d2/db 126 1 2024-02-16T22:19:09.255 INFO:tasks.workunit.client.1.smithi173.stdout:7/183: symlink d1/d5/d13/l37 0 2024-02-16T22:19:09.257 INFO:tasks.workunit.client.1.smithi173.stdout:7/184: link d1/d1d/f32 d1/d5/d13/d36/f38 0 2024-02-16T22:19:09.258 INFO:tasks.workunit.client.1.smithi173.stdout:7/185: truncate d1/d5/d10/f24 1242708 0 2024-02-16T22:19:09.264 INFO:tasks.workunit.client.1.smithi173.stdout:5/194: sync 2024-02-16T22:19:09.264 INFO:tasks.workunit.client.1.smithi173.stdout:9/80: sync 2024-02-16T22:19:09.264 INFO:tasks.workunit.client.1.smithi173.stdout:3/144: sync 2024-02-16T22:19:09.264 INFO:tasks.workunit.client.1.smithi173.stdout:9/81: write f0 [776420,25364] 0 2024-02-16T22:19:09.264 INFO:tasks.workunit.client.1.smithi173.stdout:9/82: write d1/f12 [875740,19315] 0 2024-02-16T22:19:09.267 INFO:tasks.workunit.client.1.smithi173.stdout:5/195: creat d8/da/d1f/d33/f3f x:0 0 0 2024-02-16T22:19:09.267 INFO:tasks.workunit.client.1.smithi173.stdout:5/196: write d8/f14 [1951344,77319] 0 2024-02-16T22:19:09.267 INFO:tasks.workunit.client.1.smithi173.stdout:5/197: creat d8/da/d2d/d36/f40 x:0 0 0 2024-02-16T22:19:09.268 INFO:tasks.workunit.client.1.smithi173.stdout:6/136: dwrite d0/f24 [0,4194304] 0 2024-02-16T22:19:09.268 INFO:tasks.workunit.client.1.smithi173.stdout:3/145: creat d9/d18/f3c x:0 0 0 2024-02-16T22:19:09.268 INFO:tasks.workunit.client.1.smithi173.stdout:3/146: creat d9/d17/d1d/f3d x:0 0 0 2024-02-16T22:19:09.268 INFO:tasks.workunit.client.1.smithi173.stdout:3/147: creat d9/d17/d25/f3e x:0 0 0 2024-02-16T22:19:09.275 INFO:tasks.workunit.client.1.smithi173.stdout:6/137: creat d0/db/d2e/d2f/d31/f35 x:0 0 0 2024-02-16T22:19:09.278 INFO:tasks.workunit.client.1.smithi173.stdout:5/198: write f7 [2108074,89512] 0 2024-02-16T22:19:09.280 INFO:tasks.workunit.client.1.smithi173.stdout:3/148: mknod d9/d1a/c3f 0 2024-02-16T22:19:09.282 INFO:tasks.workunit.client.1.smithi173.stdout:3/149: rename d9/l12 to d9/d1a/d2b/l40 0 2024-02-16T22:19:09.284 INFO:tasks.workunit.client.1.smithi173.stdout:4/138: dwrite d7/df/f23 [0,4194304] 0 2024-02-16T22:19:09.285 INFO:tasks.workunit.client.1.smithi173.stdout:3/150: rename d9/d17/c26 to d9/d17/d1d/c41 0 2024-02-16T22:19:09.287 INFO:tasks.workunit.client.1.smithi173.stdout:6/138: dread d0/db/f1f [0,4194304] 0 2024-02-16T22:19:09.287 INFO:tasks.workunit.client.1.smithi173.stdout:6/139: read - d0/db/f29 zero size 2024-02-16T22:19:09.287 INFO:tasks.workunit.client.1.smithi173.stdout:6/140: write d0/db/f28 [461397,69040] 0 2024-02-16T22:19:09.288 INFO:tasks.workunit.client.1.smithi173.stdout:4/139: rename d7/d28/d14/d32/l34 to d7/d28/d31/l36 0 2024-02-16T22:19:09.288 INFO:tasks.workunit.client.1.smithi173.stdout:4/140: write d7/d12/f19 [394195,52218] 0 2024-02-16T22:19:09.288 INFO:tasks.workunit.client.1.smithi173.stdout:4/141: readlink d7/d28/d31/l36 0 2024-02-16T22:19:09.288 INFO:tasks.workunit.client.1.smithi173.stdout:4/142: stat d7/df/f23 0 2024-02-16T22:19:09.289 INFO:tasks.workunit.client.1.smithi173.stdout:3/151: mknod d9/d1a/c42 0 2024-02-16T22:19:09.289 INFO:tasks.workunit.client.1.smithi173.stdout:7/186: dwrite d1/d5/d10/f24 [0,4194304] 0 2024-02-16T22:19:09.290 INFO:tasks.workunit.client.1.smithi173.stdout:6/141: write d0/f11 [585982,51106] 0 2024-02-16T22:19:09.291 INFO:tasks.workunit.client.1.smithi173.stdout:5/199: read d8/da/fc [2688403,117296] 0 2024-02-16T22:19:09.291 INFO:tasks.workunit.client.1.smithi173.stdout:8/268: dwrite dd/d11/d22/f3f [0,4194304] 0 2024-02-16T22:19:09.292 INFO:tasks.workunit.client.1.smithi173.stdout:2/213: dwrite d2/d4/f39 [0,4194304] 0 2024-02-16T22:19:09.292 INFO:tasks.workunit.client.1.smithi173.stdout:9/83: dwrite d1/ff [0,4194304] 0 2024-02-16T22:19:09.297 INFO:tasks.workunit.client.1.smithi173.stdout:7/187: mkdir d1/d5/d11/d39 0 2024-02-16T22:19:09.300 INFO:tasks.workunit.client.1.smithi173.stdout:9/84: dread d1/f12 [0,4194304] 0 2024-02-16T22:19:09.300 INFO:tasks.workunit.client.1.smithi173.stdout:9/85: chown d1/d2 4520 1 2024-02-16T22:19:09.316 INFO:tasks.workunit.client.1.smithi173.stdout:2/214: dwrite d2/dc/d19/d1a/f3f [0,4194304] 0 2024-02-16T22:19:09.316 INFO:tasks.workunit.client.1.smithi173.stdout:7/188: dwrite d1/d5/d10/f24 [0,4194304] 0 2024-02-16T22:19:09.321 INFO:tasks.workunit.client.1.smithi173.stdout:7/189: dread d1/d5/fe [0,4194304] 0 2024-02-16T22:19:09.323 INFO:tasks.workunit.client.1.smithi173.stdout:5/200: mknod d8/d27/c41 0 2024-02-16T22:19:09.325 INFO:tasks.workunit.client.1.smithi173.stdout:8/269: getdents dd/d11/d22/d28/d40/d51 0 2024-02-16T22:19:09.336 INFO:tasks.workunit.client.1.smithi173.stdout:6/142: rename d0/ff to d0/db/d2e/d2f/d31/d33/f36 0 2024-02-16T22:19:09.337 INFO:tasks.workunit.client.1.smithi173.stdout:9/86: unlink d1/ff 0 2024-02-16T22:19:09.339 INFO:tasks.workunit.client.1.smithi173.stdout:5/201: dwrite d8/da/f1d [0,4194304] 0 2024-02-16T22:19:09.339 INFO:tasks.workunit.client.1.smithi173.stdout:5/202: read f7 [1489328,81283] 0 2024-02-16T22:19:09.344 INFO:tasks.workunit.client.1.smithi173.stdout:2/215: truncate d2/d4/d8/d30/f38 2347881 0 2024-02-16T22:19:09.345 INFO:tasks.workunit.client.1.smithi173.stdout:2/216: creat d2/dc/d19/d1a/f46 x:0 0 0 2024-02-16T22:19:09.354 INFO:tasks.workunit.client.1.smithi173.stdout:7/190: rmdir d1/d5/d10/d27 39 2024-02-16T22:19:09.355 INFO:tasks.workunit.client.1.smithi173.stdout:1/221: sync 2024-02-16T22:19:09.356 INFO:tasks.workunit.client.1.smithi173.stdout:8/270: rename dd/d11/d22/d2e/d41/f45 to dd/d11/d22/d5a/f61 0 2024-02-16T22:19:09.356 INFO:tasks.workunit.client.1.smithi173.stdout:8/271: dread - dd/d11/f3d zero size 2024-02-16T22:19:09.358 INFO:tasks.workunit.client.1.smithi173.stdout:6/143: creat d0/db/d2e/f37 x:0 0 0 2024-02-16T22:19:09.358 INFO:tasks.workunit.client.1.smithi173.stdout:6/144: chown d0/db/d2e/d2f/d31/d33 252 1 2024-02-16T22:19:09.362 INFO:tasks.workunit.client.1.smithi173.stdout:9/87: dwrite d1/f18 [0,4194304] 0 2024-02-16T22:19:09.362 INFO:tasks.workunit.client.1.smithi173.stdout:7/191: dread d1/d1d/f1e [0,4194304] 0 2024-02-16T22:19:09.362 INFO:tasks.workunit.client.1.smithi173.stdout:9/88: chown d1/d2/c6 39352733 1 2024-02-16T22:19:09.362 INFO:tasks.workunit.client.1.smithi173.stdout:5/203: dwrite d8/da/d1f/d33/f3e [0,4194304] 0 2024-02-16T22:19:09.362 INFO:tasks.workunit.client.1.smithi173.stdout:5/204: write f4 [727963,110980] 0 2024-02-16T22:19:09.365 INFO:tasks.workunit.client.1.smithi173.stdout:9/89: dread d1/f12 [0,4194304] 0 2024-02-16T22:19:09.365 INFO:tasks.workunit.client.1.smithi173.stdout:8/272: creat dd/d11/d22/d50/f62 x:0 0 0 2024-02-16T22:19:09.365 INFO:tasks.workunit.client.1.smithi173.stdout:8/273: readlink dd/d11/d22/d2e/l4d 0 2024-02-16T22:19:09.365 INFO:tasks.workunit.client.1.smithi173.stdout:8/274: write dd/d11/f5b [610269,63996] 0 2024-02-16T22:19:09.365 INFO:tasks.workunit.client.1.smithi173.stdout:0/142: sync 2024-02-16T22:19:09.366 INFO:tasks.workunit.client.1.smithi173.stdout:5/205: dread d8/da/f1a [0,4194304] 0 2024-02-16T22:19:09.366 INFO:tasks.workunit.client.1.smithi173.stdout:5/206: write d8/da/d1f/d33/f3f [670671,91047] 0 2024-02-16T22:19:09.366 INFO:tasks.workunit.client.1.smithi173.stdout:5/207: write d8/da/f24 [615128,48081] 0 2024-02-16T22:19:09.374 INFO:tasks.workunit.client.1.smithi173.stdout:7/192: symlink d1/d5/d13/d36/l3a 0 2024-02-16T22:19:09.374 INFO:tasks.workunit.client.1.smithi173.stdout:7/193: readlink d1/d5/d13/l17 0 2024-02-16T22:19:09.374 INFO:tasks.workunit.client.1.smithi173.stdout:7/194: write d1/f2f [482026,112801] 0 2024-02-16T22:19:09.374 INFO:tasks.workunit.client.1.smithi173.stdout:7/195: write d1/d5/fe [3591751,26525] 0 2024-02-16T22:19:09.375 INFO:tasks.workunit.client.1.smithi173.stdout:7/196: chown d1/l1b 7 1 2024-02-16T22:19:09.375 INFO:tasks.workunit.client.1.smithi173.stdout:7/197: stat d1/d5/d13/l17 0 2024-02-16T22:19:09.375 INFO:tasks.workunit.client.1.smithi173.stdout:7/198: write d1/d5/d10/d28/f35 [2181528,57876] 0 2024-02-16T22:19:09.375 INFO:tasks.workunit.client.1.smithi173.stdout:1/222: dwrite db/d1d/f26 [0,4194304] 0 2024-02-16T22:19:09.380 INFO:tasks.workunit.client.1.smithi173.stdout:9/90: symlink d1/l1b 0 2024-02-16T22:19:09.380 INFO:tasks.workunit.client.1.smithi173.stdout:9/91: stat d1/fc 0 2024-02-16T22:19:09.382 INFO:tasks.workunit.client.1.smithi173.stdout:0/143: link d0/d4/d27/l2b d0/d4/d14/d24/l31 0 2024-02-16T22:19:09.383 INFO:tasks.workunit.client.1.smithi173.stdout:7/199: creat d1/d5/d10/d28/f3b x:0 0 0 2024-02-16T22:19:09.384 INFO:tasks.workunit.client.1.smithi173.stdout:1/223: symlink db/d1c/d25/d28/d3f/d4a/l4d 0 2024-02-16T22:19:09.385 INFO:tasks.workunit.client.1.smithi173.stdout:2/217: rmdir d2/d4/d35 0 2024-02-16T22:19:09.386 INFO:tasks.workunit.client.1.smithi173.stdout:5/208: truncate d8/da/f1d 3478244 0 2024-02-16T22:19:09.388 INFO:tasks.workunit.client.1.smithi173.stdout:7/200: creat d1/d5/d10/d27/f3c x:0 0 0 2024-02-16T22:19:09.388 INFO:tasks.workunit.client.1.smithi173.stdout:7/201: readlink d1/d5/d11/l25 0 2024-02-16T22:19:09.388 INFO:tasks.workunit.client.1.smithi173.stdout:1/224: creat db/d1c/d25/d28/d3f/f4e x:0 0 0 2024-02-16T22:19:09.390 INFO:tasks.workunit.client.1.smithi173.stdout:2/218: link d2/dc/d19/d1a/f26 d2/d4/d8/d3a/f47 0 2024-02-16T22:19:09.391 INFO:tasks.workunit.client.1.smithi173.stdout:7/202: symlink d1/d5/d13/d36/l3d 0 2024-02-16T22:19:09.391 INFO:tasks.workunit.client.1.smithi173.stdout:7/203: fdatasync d1/d5/d13/d36/f38 0 2024-02-16T22:19:09.391 INFO:tasks.workunit.client.1.smithi173.stdout:6/145: dwrite d0/f26 [0,4194304] 0 2024-02-16T22:19:09.391 INFO:tasks.workunit.client.1.smithi173.stdout:6/146: chown d0/db/f1a 12 1 2024-02-16T22:19:09.392 INFO:tasks.workunit.client.1.smithi173.stdout:9/92: dread d1/f18 [0,4194304] 0 2024-02-16T22:19:09.392 INFO:tasks.workunit.client.1.smithi173.stdout:0/144: dread d0/d4/d14/f23 [0,4194304] 0 2024-02-16T22:19:09.393 INFO:tasks.workunit.client.1.smithi173.stdout:7/204: write d1/d5/f2b [1150390,26021] 0 2024-02-16T22:19:09.395 INFO:tasks.workunit.client.1.smithi173.stdout:2/219: symlink d2/dc/d19/d1c/l48 0 2024-02-16T22:19:09.399 INFO:tasks.workunit.client.1.smithi173.stdout:0/145: write d0/d4/f18 [3472774,54541] 0 2024-02-16T22:19:09.403 INFO:tasks.workunit.client.1.smithi173.stdout:8/275: truncate dd/d11/f5b 14235 0 2024-02-16T22:19:09.404 INFO:tasks.workunit.client.1.smithi173.stdout:6/147: dread - d0/f2b zero size 2024-02-16T22:19:09.404 INFO:tasks.workunit.client.1.smithi173.stdout:6/148: write d0/db/f29 [156161,63474] 0 2024-02-16T22:19:09.404 INFO:tasks.workunit.client.1.smithi173.stdout:6/149: truncate d0/db/f28 1311143 0 2024-02-16T22:19:09.408 INFO:tasks.workunit.client.1.smithi173.stdout:9/93: unlink d1/fc 0 2024-02-16T22:19:09.411 INFO:tasks.workunit.client.1.smithi173.stdout:2/220: truncate d2/dc/d19/d1a/f34 2513769 0 2024-02-16T22:19:09.415 INFO:tasks.workunit.client.1.smithi173.stdout:7/205: getdents d1/d1d 0 2024-02-16T22:19:09.415 INFO:tasks.workunit.client.1.smithi173.stdout:2/221: unlink d2/dc/d19/d1c/f3e 0 2024-02-16T22:19:09.417 INFO:tasks.workunit.client.1.smithi173.stdout:8/276: read dd/d11/d22/d5a/f61 [3653547,48219] 0 2024-02-16T22:19:09.417 INFO:tasks.workunit.client.1.smithi173.stdout:8/277: chown dd/d11/d22/d28/d40/d52/f54 1423724 1 2024-02-16T22:19:09.417 INFO:tasks.workunit.client.1.smithi173.stdout:8/278: write dd/d11/d22/d28/d40/f59 [569142,3326] 0 2024-02-16T22:19:09.417 INFO:tasks.workunit.client.1.smithi173.stdout:8/279: creat dd/d11/d22/d28/d40/f63 x:0 0 0 2024-02-16T22:19:09.417 INFO:tasks.workunit.client.1.smithi173.stdout:2/222: symlink d2/dc/d19/l49 0 2024-02-16T22:19:09.420 INFO:tasks.workunit.client.1.smithi173.stdout:2/223: mknod d2/dc/d19/d1c/c4a 0 2024-02-16T22:19:09.422 INFO:tasks.workunit.client.1.smithi173.stdout:2/224: symlink d2/l4b 0 2024-02-16T22:19:09.423 INFO:tasks.workunit.client.1.smithi173.stdout:8/280: write f5 [558320,85336] 0 2024-02-16T22:19:09.423 INFO:tasks.workunit.client.1.smithi173.stdout:8/281: creat dd/d11/d22/d28/d40/f64 x:0 0 0 2024-02-16T22:19:09.423 INFO:tasks.workunit.client.1.smithi173.stdout:8/282: write dd/d11/f39 [1188338,17739] 0 2024-02-16T22:19:09.424 INFO:tasks.workunit.client.1.smithi173.stdout:8/283: write dd/d11/d22/d28/f2f [2030723,121805] 0 2024-02-16T22:19:09.424 INFO:tasks.workunit.client.1.smithi173.stdout:5/209: dwrite d8/f14 [0,4194304] 0 2024-02-16T22:19:09.429 INFO:tasks.workunit.client.1.smithi173.stdout:8/284: rmdir dd/d11/d22/d28/d40/d51/d5f 0 2024-02-16T22:19:09.429 INFO:tasks.workunit.client.1.smithi173.stdout:8/285: chown dd/d11/d22/d50/f5d 53281 1 2024-02-16T22:19:09.430 INFO:tasks.workunit.client.1.smithi173.stdout:5/210: symlink d8/da/d1b/l42 0 2024-02-16T22:19:09.431 INFO:tasks.workunit.client.1.smithi173.stdout:8/286: link l8 dd/l65 0 2024-02-16T22:19:09.432 INFO:tasks.workunit.client.1.smithi173.stdout:8/287: rename dd/c1d to dd/d11/c66 0 2024-02-16T22:19:09.433 INFO:tasks.workunit.client.1.smithi173.stdout:2/225: write d2/dc/d19/f25 [983307,54522] 0 2024-02-16T22:19:09.433 INFO:tasks.workunit.client.1.smithi173.stdout:2/226: write d2/d4/d8/d30/f37 [843361,119231] 0 2024-02-16T22:19:09.433 INFO:tasks.workunit.client.1.smithi173.stdout:2/227: creat d2/d4/f4c x:0 0 0 2024-02-16T22:19:09.437 INFO:tasks.workunit.client.1.smithi173.stdout:2/228: mkdir d2/d4/d8/d30/d4d 0 2024-02-16T22:19:09.438 INFO:tasks.workunit.client.1.smithi173.stdout:1/225: dwrite db/f15 [0,4194304] 0 2024-02-16T22:19:09.439 INFO:tasks.workunit.client.1.smithi173.stdout:2/229: creat d2/d4/d8/d30/d4d/f4e x:0 0 0 2024-02-16T22:19:09.439 INFO:tasks.workunit.client.1.smithi173.stdout:2/230: stat d2/db/c11 0 2024-02-16T22:19:09.439 INFO:tasks.workunit.client.1.smithi173.stdout:2/231: chown d2/d4/f4c 131141 1 2024-02-16T22:19:09.439 INFO:tasks.workunit.client.1.smithi173.stdout:2/232: chown d2/d10/l12 0 1 2024-02-16T22:19:09.440 INFO:tasks.workunit.client.1.smithi173.stdout:1/226: stat l8 0 2024-02-16T22:19:09.440 INFO:tasks.workunit.client.1.smithi173.stdout:9/94: dwrite d1/f18 [0,4194304] 0 2024-02-16T22:19:09.440 INFO:tasks.workunit.client.1.smithi173.stdout:9/95: chown d1/d2/l3 3504416 1 2024-02-16T22:19:09.441 INFO:tasks.workunit.client.1.smithi173.stdout:0/146: dwrite d0/d4/d14/f2d [0,4194304] 0 2024-02-16T22:19:09.444 INFO:tasks.workunit.client.1.smithi173.stdout:1/227: unlink db/d1c/f1f 0 2024-02-16T22:19:09.444 INFO:tasks.workunit.client.1.smithi173.stdout:1/228: creat db/d30/f4f x:0 0 0 2024-02-16T22:19:09.444 INFO:tasks.workunit.client.1.smithi173.stdout:7/206: dwrite d1/d1d/f32 [0,4194304] 0 2024-02-16T22:19:09.445 INFO:tasks.workunit.client.1.smithi173.stdout:6/150: dwrite d0/f14 [4194304,4194304] 0 2024-02-16T22:19:09.445 INFO:tasks.workunit.client.1.smithi173.stdout:9/96: unlink d1/c19 0 2024-02-16T22:19:09.448 INFO:tasks.workunit.client.1.smithi173.stdout:0/147: mkdir d0/d4/d14/d24/d32 0 2024-02-16T22:19:09.451 INFO:tasks.workunit.client.1.smithi173.stdout:1/229: mkdir db/d29/d50 0 2024-02-16T22:19:09.456 INFO:tasks.workunit.client.1.smithi173.stdout:7/207: symlink d1/d5/d10/d27/l3e 0 2024-02-16T22:19:09.457 INFO:tasks.workunit.client.1.smithi173.stdout:9/97: write f0 [488294,113136] 0 2024-02-16T22:19:09.458 INFO:tasks.workunit.client.1.smithi173.stdout:5/211: dwrite f7 [0,4194304] 0 2024-02-16T22:19:09.458 INFO:tasks.workunit.client.1.smithi173.stdout:9/98: write d1/d2/fd [911602,49048] 0 2024-02-16T22:19:09.458 INFO:tasks.workunit.client.1.smithi173.stdout:9/99: readlink d1/le 0 2024-02-16T22:19:09.458 INFO:tasks.workunit.client.1.smithi173.stdout:9/100: write d1/d2/fd [1467612,93913] 0 2024-02-16T22:19:09.458 INFO:tasks.workunit.client.1.smithi173.stdout:2/233: dwrite d2/d4/f1b [0,4194304] 0 2024-02-16T22:19:09.459 INFO:tasks.workunit.client.1.smithi173.stdout:2/234: creat d2/d10/f4f x:0 0 0 2024-02-16T22:19:09.459 INFO:tasks.workunit.client.1.smithi173.stdout:2/235: fdatasync d2/d4/f1b 0 2024-02-16T22:19:09.459 INFO:tasks.workunit.client.1.smithi173.stdout:9/101: write d1/d2/fd [1330918,124039] 0 2024-02-16T22:19:09.459 INFO:tasks.workunit.client.1.smithi173.stdout:9/102: fdatasync d1/d2/f13 0 2024-02-16T22:19:09.460 INFO:tasks.workunit.client.1.smithi173.stdout:2/236: read d2/dc/d19/f16 [307929,20718] 0 2024-02-16T22:19:09.462 INFO:tasks.workunit.client.1.smithi173.stdout:0/148: read d0/d4/fe [3233525,20924] 0 2024-02-16T22:19:09.462 INFO:tasks.workunit.client.1.smithi173.stdout:6/151: rename d0/db/lc to d0/db/d2e/d2f/d31/d33/l38 0 2024-02-16T22:19:09.472 INFO:tasks.workunit.client.1.smithi173.stdout:1/230: mknod db/d30/c51 0 2024-02-16T22:19:09.475 INFO:tasks.workunit.client.1.smithi173.stdout:2/237: dwrite d2/db/f31 [0,4194304] 0 2024-02-16T22:19:09.475 INFO:tasks.workunit.client.1.smithi173.stdout:2/238: write d2/d4/f7 [9082040,21572] 0 2024-02-16T22:19:09.485 INFO:tasks.workunit.client.1.smithi173.stdout:2/239: dread d2/dc/d19/d1a/f3f [0,4194304] 0 2024-02-16T22:19:09.485 INFO:tasks.workunit.client.1.smithi173.stdout:2/240: chown d2/dc/d19/d1a 130154 1 2024-02-16T22:19:09.486 INFO:tasks.workunit.client.1.smithi173.stdout:5/212: link d8/da/f1d d8/da/d2d/d36/f43 0 2024-02-16T22:19:09.491 INFO:tasks.workunit.client.1.smithi173.stdout:9/103: mknod d1/c1c 0 2024-02-16T22:19:09.500 INFO:tasks.workunit.client.1.smithi173.stdout:0/149: mkdir d0/d4/d33 0 2024-02-16T22:19:09.500 INFO:tasks.workunit.client.1.smithi173.stdout:0/150: chown d0/d4/d27/c28 33400581 1 2024-02-16T22:19:09.502 INFO:tasks.workunit.client.1.smithi173.stdout:5/213: dwrite f4 [0,4194304] 0 2024-02-16T22:19:09.503 INFO:tasks.workunit.client.1.smithi173.stdout:1/231: getdents db/d1c/d25/d28/d3f/d4a 0 2024-02-16T22:19:09.517 INFO:tasks.workunit.client.1.smithi173.stdout:7/208: getdents d1/d5/d11 0 2024-02-16T22:19:09.519 INFO:tasks.workunit.client.1.smithi173.stdout:2/241: mknod d2/d4/d8/d30/d44/c50 0 2024-02-16T22:19:09.524 INFO:tasks.workunit.client.1.smithi173.stdout:6/152: unlink d0/c5 0 2024-02-16T22:19:09.524 INFO:tasks.workunit.client.1.smithi173.stdout:6/153: creat d0/db/d2e/d2f/d31/f39 x:0 0 0 2024-02-16T22:19:09.525 INFO:tasks.workunit.client.1.smithi173.stdout:1/232: truncate db/d1c/f37 1999160 0 2024-02-16T22:19:09.526 INFO:tasks.workunit.client.1.smithi173.stdout:2/242: creat d2/dc/d19/f51 x:0 0 0 2024-02-16T22:19:09.526 INFO:tasks.workunit.client.1.smithi173.stdout:2/243: truncate d2/dc/d19/f16 2519784 0 2024-02-16T22:19:09.527 INFO:tasks.workunit.client.1.smithi173.stdout:1/233: chown db/d30/f43 62089 1 2024-02-16T22:19:09.528 INFO:tasks.workunit.client.1.smithi173.stdout:9/104: rmdir d1/d2/d10/d17 0 2024-02-16T22:19:09.528 INFO:tasks.workunit.client.1.smithi173.stdout:9/105: chown d1/f12 0 1 2024-02-16T22:19:09.529 INFO:tasks.workunit.client.1.smithi173.stdout:1/234: link db/d1c/d25/d28/d3f/f4e db/d30/f52 0 2024-02-16T22:19:09.529 INFO:tasks.workunit.client.1.smithi173.stdout:0/151: dwrite d0/d4/d14/f23 [0,4194304] 0 2024-02-16T22:19:09.531 INFO:tasks.workunit.client.1.smithi173.stdout:5/214: dwrite d8/da/ff [0,4194304] 0 2024-02-16T22:19:09.532 INFO:tasks.workunit.client.1.smithi173.stdout:9/106: rename d1/le to d1/d2/d10/l1d 0 2024-02-16T22:19:09.533 INFO:tasks.workunit.client.1.smithi173.stdout:5/215: write d8/da/d1f/d33/f3f [249861,38724] 0 2024-02-16T22:19:09.533 INFO:tasks.workunit.client.1.smithi173.stdout:9/107: write d1/f12 [259814,28669] 0 2024-02-16T22:19:09.536 INFO:tasks.workunit.client.1.smithi173.stdout:0/152: rename d0/d12/d15/c17 to d0/d4/d14/d21/c34 0 2024-02-16T22:19:09.536 INFO:tasks.workunit.client.1.smithi173.stdout:0/153: readlink d0/d4/d14/l1a 0 2024-02-16T22:19:09.536 INFO:tasks.workunit.client.1.smithi173.stdout:0/154: chown d0/f11 1654800 1 2024-02-16T22:19:09.539 INFO:tasks.workunit.client.1.smithi173.stdout:7/209: dwrite d1/f2f [0,4194304] 0 2024-02-16T22:19:09.540 INFO:tasks.workunit.client.1.smithi173.stdout:1/235: creat db/d29/f53 x:0 0 0 2024-02-16T22:19:09.542 INFO:tasks.workunit.client.1.smithi173.stdout:0/155: mknod d0/c35 0 2024-02-16T22:19:09.548 INFO:tasks.workunit.client.1.smithi173.stdout:1/236: creat db/d1c/d25/d28/d3f/d4a/f54 x:0 0 0 2024-02-16T22:19:09.550 INFO:tasks.workunit.client.1.smithi173.stdout:4/143: sync 2024-02-16T22:19:09.550 INFO:tasks.workunit.client.1.smithi173.stdout:3/152: sync 2024-02-16T22:19:09.550 INFO:tasks.workunit.client.1.smithi173.stdout:3/153: write d9/d17/d25/f3e [776695,116062] 0 2024-02-16T22:19:09.550 INFO:tasks.workunit.client.1.smithi173.stdout:3/154: fsync d9/d17/d1d/f3d 0 2024-02-16T22:19:09.551 INFO:tasks.workunit.client.1.smithi173.stdout:3/155: chown d9/d17/d1d/c20 866 1 2024-02-16T22:19:09.551 INFO:tasks.workunit.client.1.smithi173.stdout:3/156: creat d9/da/f43 x:0 0 0 2024-02-16T22:19:09.551 INFO:tasks.workunit.client.1.smithi173.stdout:3/157: creat d9/d1a/f44 x:0 0 0 2024-02-16T22:19:09.552 INFO:tasks.workunit.client.1.smithi173.stdout:4/144: creat d7/d28/d31/f37 x:0 0 0 2024-02-16T22:19:09.554 INFO:tasks.workunit.client.1.smithi173.stdout:3/158: mkdir d9/d1a/d2b/d45 0 2024-02-16T22:19:09.554 INFO:tasks.workunit.client.1.smithi173.stdout:3/159: creat d9/d17/d25/f46 x:0 0 0 2024-02-16T22:19:09.554 INFO:tasks.workunit.client.1.smithi173.stdout:3/160: chown d9/d17/d1d/f24 317675878 1 2024-02-16T22:19:09.555 INFO:tasks.workunit.client.1.smithi173.stdout:4/145: mknod d7/d28/d31/d33/c38 0 2024-02-16T22:19:09.556 INFO:tasks.workunit.client.1.smithi173.stdout:4/146: mknod d7/d28/d31/d33/c39 0 2024-02-16T22:19:09.557 INFO:tasks.workunit.client.1.smithi173.stdout:4/147: chown d7/df/l21 146387797 1 2024-02-16T22:19:09.559 INFO:tasks.workunit.client.1.smithi173.stdout:7/210: write d1/f2f [1743431,15475] 0 2024-02-16T22:19:09.559 INFO:tasks.workunit.client.1.smithi173.stdout:7/211: chown d1/d5/ff 45 1 2024-02-16T22:19:09.559 INFO:tasks.workunit.client.1.smithi173.stdout:7/212: fdatasync d1/d5/ff 0 2024-02-16T22:19:09.559 INFO:tasks.workunit.client.1.smithi173.stdout:7/213: truncate d1/d5/d11/f14 1812188 0 2024-02-16T22:19:09.560 INFO:tasks.workunit.client.1.smithi173.stdout:3/161: dread f8 [4194304,4194304] 0 2024-02-16T22:19:09.563 INFO:tasks.workunit.client.1.smithi173.stdout:2/244: dwrite d2/db/f18 [0,4194304] 0 2024-02-16T22:19:09.564 INFO:tasks.workunit.client.1.smithi173.stdout:2/245: creat d2/dc/d19/d1a/f52 x:0 0 0 2024-02-16T22:19:09.566 INFO:tasks.workunit.client.1.smithi173.stdout:4/148: write d7/fc [625101,23089] 0 2024-02-16T22:19:09.566 INFO:tasks.workunit.client.1.smithi173.stdout:4/149: creat d7/d28/d31/f3a x:0 0 0 2024-02-16T22:19:09.566 INFO:tasks.workunit.client.1.smithi173.stdout:2/246: mkdir d2/dc/d19/d1c/d53 0 2024-02-16T22:19:09.566 INFO:tasks.workunit.client.1.smithi173.stdout:2/247: write d2/dc/d19/d1c/f20 [1134036,53287] 0 2024-02-16T22:19:09.568 INFO:tasks.workunit.client.1.smithi173.stdout:4/150: stat d7/d12/c25 0 2024-02-16T22:19:09.568 INFO:tasks.workunit.client.1.smithi173.stdout:4/151: stat c6 0 2024-02-16T22:19:09.570 INFO:tasks.workunit.client.1.smithi173.stdout:8/288: sync 2024-02-16T22:19:09.570 INFO:tasks.workunit.client.1.smithi173.stdout:0/156: dwrite d0/d4/fe [4194304,4194304] 0 2024-02-16T22:19:09.574 INFO:tasks.workunit.client.1.smithi173.stdout:8/289: truncate f4 7626522 0 2024-02-16T22:19:09.575 INFO:tasks.workunit.client.1.smithi173.stdout:0/157: truncate d0/d4/f2a 640701 0 2024-02-16T22:19:09.576 INFO:tasks.workunit.client.1.smithi173.stdout:8/290: creat dd/d11/d22/d5a/f67 x:0 0 0 2024-02-16T22:19:09.577 INFO:tasks.workunit.client.1.smithi173.stdout:0/158: truncate d0/ff 1823396 0 2024-02-16T22:19:09.579 INFO:tasks.workunit.client.1.smithi173.stdout:1/237: dwrite db/d1d/f33 [0,4194304] 0 2024-02-16T22:19:09.579 INFO:tasks.workunit.client.1.smithi173.stdout:1/238: creat db/d1c/d25/d28/f55 x:0 0 0 2024-02-16T22:19:09.580 INFO:tasks.workunit.client.1.smithi173.stdout:8/291: write dd/d11/d22/d2e/d41/f56 [21575,116703] 0 2024-02-16T22:19:09.581 INFO:tasks.workunit.client.1.smithi173.stdout:8/292: read dd/d11/d22/d2e/f57 [4803,74828] 0 2024-02-16T22:19:09.588 INFO:tasks.workunit.client.1.smithi173.stdout:8/293: symlink dd/d11/d22/d2e/d41/l68 0 2024-02-16T22:19:09.589 INFO:tasks.workunit.client.1.smithi173.stdout:1/239: symlink db/l56 0 2024-02-16T22:19:09.589 INFO:tasks.workunit.client.1.smithi173.stdout:1/240: write db/d30/f43 [909557,102102] 0 2024-02-16T22:19:09.590 INFO:tasks.workunit.client.1.smithi173.stdout:8/294: mkdir dd/d11/d22/d28/d40/d69 0 2024-02-16T22:19:09.591 INFO:tasks.workunit.client.1.smithi173.stdout:8/295: symlink dd/l6a 0 2024-02-16T22:19:09.592 INFO:tasks.workunit.client.1.smithi173.stdout:8/296: mkdir dd/d11/d22/d2e/d41/d6b 0 2024-02-16T22:19:09.594 INFO:tasks.workunit.client.1.smithi173.stdout:8/297: rename dd/d11/c66 to dd/d11/d22/d28/d40/d69/c6c 0 2024-02-16T22:19:09.599 INFO:tasks.workunit.client.1.smithi173.stdout:3/162: dwrite d9/d17/d25/f3e [0,4194304] 0 2024-02-16T22:19:09.599 INFO:tasks.workunit.client.1.smithi173.stdout:3/163: rename d9/d17 to d9/d17/d47 22 2024-02-16T22:19:09.599 INFO:tasks.workunit.client.1.smithi173.stdout:3/164: chown d9/da/f15 916 1 2024-02-16T22:19:09.599 INFO:tasks.workunit.client.1.smithi173.stdout:3/165: dread - d9/d17/d1d/f38 zero size 2024-02-16T22:19:09.599 INFO:tasks.workunit.client.1.smithi173.stdout:3/166: creat d9/d17/f48 x:0 0 0 2024-02-16T22:19:09.599 INFO:tasks.workunit.client.1.smithi173.stdout:3/167: chown d9/d1a/c2f 871 1 2024-02-16T22:19:09.599 INFO:tasks.workunit.client.1.smithi173.stdout:3/168: chown d9/l1f 399 1 2024-02-16T22:19:09.600 INFO:tasks.workunit.client.1.smithi173.stdout:0/159: write d0/f1 [1276123,73324] 0 2024-02-16T22:19:09.603 INFO:tasks.workunit.client.1.smithi173.stdout:6/154: dwrite d0/f2d [0,4194304] 0 2024-02-16T22:19:09.604 INFO:tasks.workunit.client.1.smithi173.stdout:6/155: chown d0/db 2610 1 2024-02-16T22:19:09.605 INFO:tasks.workunit.client.1.smithi173.stdout:3/169: mkdir d9/d1a/d2b/d49 0 2024-02-16T22:19:09.605 INFO:tasks.workunit.client.1.smithi173.stdout:0/160: link d0/l20 d0/d4/d14/d24/l36 0 2024-02-16T22:19:09.607 INFO:tasks.workunit.client.1.smithi173.stdout:7/214: dread d1/d5/fe [0,4194304] 0 2024-02-16T22:19:09.607 INFO:tasks.workunit.client.1.smithi173.stdout:7/215: chown d1/d5/d10/d28/f35 11007129 1 2024-02-16T22:19:09.608 INFO:tasks.workunit.client.1.smithi173.stdout:6/156: symlink d0/db/d2e/l3a 0 2024-02-16T22:19:09.610 INFO:tasks.workunit.client.1.smithi173.stdout:0/161: symlink d0/d4/d14/l37 0 2024-02-16T22:19:09.612 INFO:tasks.workunit.client.1.smithi173.stdout:6/157: creat d0/db/d2e/d2f/f3b x:0 0 0 2024-02-16T22:19:09.612 INFO:tasks.workunit.client.1.smithi173.stdout:6/158: creat d0/db/d2e/f3c x:0 0 0 2024-02-16T22:19:09.615 INFO:tasks.workunit.client.1.smithi173.stdout:6/159: chown d0/f18 3250 1 2024-02-16T22:19:09.615 INFO:tasks.workunit.client.1.smithi173.stdout:6/160: creat d0/db/f3d x:0 0 0 2024-02-16T22:19:09.615 INFO:tasks.workunit.client.1.smithi173.stdout:6/161: write d0/db/f2a [131414,98239] 0 2024-02-16T22:19:09.615 INFO:tasks.workunit.client.1.smithi173.stdout:6/162: write d0/f18 [514064,53187] 0 2024-02-16T22:19:09.617 INFO:tasks.workunit.client.1.smithi173.stdout:8/298: link dd/d11/d22/d28/d40/d69/c6c dd/c6d 0 2024-02-16T22:19:09.617 INFO:tasks.workunit.client.1.smithi173.stdout:8/299: chown dd/d11/d22/f32 168359714 1 2024-02-16T22:19:09.617 INFO:tasks.workunit.client.1.smithi173.stdout:3/170: read d9/fb [4042070,113217] 0 2024-02-16T22:19:09.619 INFO:tasks.workunit.client.1.smithi173.stdout:6/163: truncate d0/db/f25 122352 0 2024-02-16T22:19:09.620 INFO:tasks.workunit.client.1.smithi173.stdout:8/300: dread f2 [0,4194304] 0 2024-02-16T22:19:09.620 INFO:tasks.workunit.client.1.smithi173.stdout:3/171: rmdir d9/d18 39 2024-02-16T22:19:09.620 INFO:tasks.workunit.client.1.smithi173.stdout:3/172: stat d9/f22 0 2024-02-16T22:19:09.620 INFO:tasks.workunit.client.1.smithi173.stdout:3/173: chown d9/d1a/d21/l32 6465 1 2024-02-16T22:19:09.620 INFO:tasks.workunit.client.1.smithi173.stdout:3/174: creat d9/d17/d25/f4a x:0 0 0 2024-02-16T22:19:09.622 INFO:tasks.workunit.client.1.smithi173.stdout:1/241: dwrite f2 [4194304,4194304] 0 2024-02-16T22:19:09.623 INFO:tasks.workunit.client.1.smithi173.stdout:9/108: dwrite d1/f12 [0,4194304] 0 2024-02-16T22:19:09.623 INFO:tasks.workunit.client.1.smithi173.stdout:2/248: dwrite d2/d4/f1b [4194304,4194304] 0 2024-02-16T22:19:09.626 INFO:tasks.workunit.client.1.smithi173.stdout:4/152: dwrite d7/d12/f17 [0,4194304] 0 2024-02-16T22:19:09.628 INFO:tasks.workunit.client.1.smithi173.stdout:8/301: dread dd/d11/d22/d28/f2f [0,4194304] 0 2024-02-16T22:19:09.628 INFO:tasks.workunit.client.1.smithi173.stdout:8/302: creat dd/d11/d22/d50/f6e x:0 0 0 2024-02-16T22:19:09.634 INFO:tasks.workunit.client.1.smithi173.stdout:9/109: creat d1/d2/d10/f1e x:0 0 0 2024-02-16T22:19:09.634 INFO:tasks.workunit.client.1.smithi173.stdout:6/164: dwrite d0/db/f3d [0,4194304] 0 2024-02-16T22:19:09.650 INFO:tasks.workunit.client.1.smithi173.stdout:1/242: dwrite db/f15 [0,4194304] 0 2024-02-16T22:19:09.650 INFO:tasks.workunit.client.1.smithi173.stdout:3/175: rmdir d9 39 2024-02-16T22:19:09.654 INFO:tasks.workunit.client.1.smithi173.stdout:4/153: dwrite d7/d28/d14/f2a [0,4194304] 0 2024-02-16T22:19:09.654 INFO:tasks.workunit.client.1.smithi173.stdout:4/154: stat d7/l18 0 2024-02-16T22:19:09.654 INFO:tasks.workunit.client.1.smithi173.stdout:4/155: creat d7/d28/d31/f3b x:0 0 0 2024-02-16T22:19:09.658 INFO:tasks.workunit.client.1.smithi173.stdout:8/303: creat dd/d11/d22/d2e/d41/d6b/f6f x:0 0 0 2024-02-16T22:19:09.660 INFO:tasks.workunit.client.1.smithi173.stdout:9/110: mkdir d1/d2/d1a/d1f 0 2024-02-16T22:19:09.661 INFO:tasks.workunit.client.1.smithi173.stdout:9/111: write d1/d2/d10/f14 [100262,100699] 0 2024-02-16T22:19:09.661 INFO:tasks.workunit.client.1.smithi173.stdout:9/112: truncate d1/d2/d10/f1e 339353 0 2024-02-16T22:19:09.663 INFO:tasks.workunit.client.1.smithi173.stdout:6/165: truncate d0/f14 4546872 0 2024-02-16T22:19:09.663 INFO:tasks.workunit.client.1.smithi173.stdout:6/166: chown d0/f24 6727520 1 2024-02-16T22:19:09.664 INFO:tasks.workunit.client.1.smithi173.stdout:2/249: getdents d2/dc/d19/d1c 0 2024-02-16T22:19:09.664 INFO:tasks.workunit.client.1.smithi173.stdout:0/162: dwrite d0/ff [0,4194304] 0 2024-02-16T22:19:09.677 INFO:tasks.workunit.client.1.smithi173.stdout:6/167: dwrite d0/db/f3d [0,4194304] 0 2024-02-16T22:19:09.681 INFO:tasks.workunit.client.1.smithi173.stdout:1/243: write db/f4b [386230,54304] 0 2024-02-16T22:19:09.682 INFO:tasks.workunit.client.1.smithi173.stdout:3/176: mkdir d9/d1a/d2b/d45/d4b 0 2024-02-16T22:19:09.688 INFO:tasks.workunit.client.1.smithi173.stdout:8/304: creat dd/d11/d22/d28/d40/d52/f70 x:0 0 0 2024-02-16T22:19:09.691 INFO:tasks.workunit.client.1.smithi173.stdout:9/113: creat d1/d2/d1a/f20 x:0 0 0 2024-02-16T22:19:09.691 INFO:tasks.workunit.client.1.smithi173.stdout:9/114: creat d1/d2/d10/f21 x:0 0 0 2024-02-16T22:19:09.697 INFO:tasks.workunit.client.1.smithi173.stdout:0/163: mkdir d0/d4/d14/d38 0 2024-02-16T22:19:09.703 INFO:tasks.workunit.client.1.smithi173.stdout:6/168: write d0/f22 [162047,15517] 0 2024-02-16T22:19:09.703 INFO:tasks.workunit.client.1.smithi173.stdout:1/244: mkdir db/d29/d57 0 2024-02-16T22:19:09.704 INFO:tasks.workunit.client.1.smithi173.stdout:3/177: creat d9/f4c x:0 0 0 2024-02-16T22:19:09.705 INFO:tasks.workunit.client.1.smithi173.stdout:4/156: rmdir d7/df 39 2024-02-16T22:19:09.707 INFO:tasks.workunit.client.1.smithi173.stdout:8/305: link dd/d11/f60 dd/d11/d22/d2e/f71 0 2024-02-16T22:19:09.707 INFO:tasks.workunit.client.1.smithi173.stdout:8/306: write dd/d11/f60 [284290,112133] 0 2024-02-16T22:19:09.707 INFO:tasks.workunit.client.1.smithi173.stdout:3/178: dread d9/f22 [0,4194304] 0 2024-02-16T22:19:09.710 INFO:tasks.workunit.client.1.smithi173.stdout:9/115: creat d1/f22 x:0 0 0 2024-02-16T22:19:09.710 INFO:tasks.workunit.client.1.smithi173.stdout:9/116: readlink d1/d2/d10/l1d 0 2024-02-16T22:19:09.712 INFO:tasks.workunit.client.1.smithi173.stdout:2/250: getdents d2/d10 0 2024-02-16T22:19:09.714 INFO:tasks.workunit.client.1.smithi173.stdout:3/179: dread d9/da/fd [0,4194304] 0 2024-02-16T22:19:09.716 INFO:tasks.workunit.client.1.smithi173.stdout:4/157: write d7/df/f23 [4069869,101926] 0 2024-02-16T22:19:09.725 INFO:tasks.workunit.client.1.smithi173.stdout:6/169: symlink d0/db/d2e/d2f/d31/l3e 0 2024-02-16T22:19:09.725 INFO:tasks.workunit.client.1.smithi173.stdout:6/170: write d0/db/d2e/f3c [195729,101759] 0 2024-02-16T22:19:09.725 INFO:tasks.workunit.client.1.smithi173.stdout:6/171: stat d0/db/f25 0 2024-02-16T22:19:09.730 INFO:tasks.workunit.client.1.smithi173.stdout:9/117: link d1/d2/d10/f1e d1/f23 0 2024-02-16T22:19:09.731 INFO:tasks.workunit.client.1.smithi173.stdout:2/251: symlink d2/d4/d8/d30/d44/l54 0 2024-02-16T22:19:09.731 INFO:tasks.workunit.client.1.smithi173.stdout:2/252: creat d2/db/f55 x:0 0 0 2024-02-16T22:19:09.732 INFO:tasks.workunit.client.1.smithi173.stdout:3/180: mkdir d9/d1a/d2b/d4d 0 2024-02-16T22:19:09.733 INFO:tasks.workunit.client.1.smithi173.stdout:4/158: dwrite d7/f15 [0,4194304] 0 2024-02-16T22:19:09.733 INFO:tasks.workunit.client.1.smithi173.stdout:4/159: read f5 [2260121,13519] 0 2024-02-16T22:19:09.733 INFO:tasks.workunit.client.1.smithi173.stdout:4/160: fdatasync d7/d28/d31/f37 0 2024-02-16T22:19:09.733 INFO:tasks.workunit.client.1.smithi173.stdout:6/172: read - d0/f1e zero size 2024-02-16T22:19:09.735 INFO:tasks.workunit.client.1.smithi173.stdout:1/245: getdents db/d1c/d25/d28/d3f 0 2024-02-16T22:19:09.735 INFO:tasks.workunit.client.1.smithi173.stdout:1/246: read - db/d1c/d25/d28/f55 zero size 2024-02-16T22:19:09.735 INFO:tasks.workunit.client.1.smithi173.stdout:2/253: dread d2/dc/d19/d1c/f20 [0,4194304] 0 2024-02-16T22:19:09.735 INFO:tasks.workunit.client.1.smithi173.stdout:2/254: chown d2/dc/d19/d1a/f46 189205974 1 2024-02-16T22:19:09.738 INFO:tasks.workunit.client.1.smithi173.stdout:0/164: rename d0/d4/d14/d21 to d0/d4/d14/d24/d32/d39 0 2024-02-16T22:19:09.740 INFO:tasks.workunit.client.1.smithi173.stdout:0/165: dread d0/d4/f2a [0,4194304] 0 2024-02-16T22:19:09.749 INFO:tasks.workunit.client.1.smithi173.stdout:4/161: creat d7/d28/f3c x:0 0 0 2024-02-16T22:19:09.752 INFO:tasks.workunit.client.1.smithi173.stdout:1/247: symlink db/d1d/l58 0 2024-02-16T22:19:09.755 INFO:tasks.workunit.client.1.smithi173.stdout:2/255: unlink d2/d4/d8/d30/d44/c50 0 2024-02-16T22:19:09.755 INFO:tasks.workunit.client.1.smithi173.stdout:2/256: write d2/d10/f4f [972449,41581] 0 2024-02-16T22:19:09.755 INFO:tasks.workunit.client.1.smithi173.stdout:3/181: dwrite d9/f22 [0,4194304] 0 2024-02-16T22:19:09.755 INFO:tasks.workunit.client.1.smithi173.stdout:0/166: dwrite d0/d4/d14/d24/d32/d39/f2c [0,4194304] 0 2024-02-16T22:19:09.755 INFO:tasks.workunit.client.1.smithi173.stdout:3/182: write d9/d17/f48 [56002,126857] 0 2024-02-16T22:19:09.756 INFO:tasks.workunit.client.1.smithi173.stdout:0/167: read d0/f11 [299364,55659] 0 2024-02-16T22:19:09.756 INFO:tasks.workunit.client.1.smithi173.stdout:0/168: fsync d0/f11 0 2024-02-16T22:19:09.756 INFO:tasks.workunit.client.1.smithi173.stdout:0/169: fsync d0/f1 0 2024-02-16T22:19:09.756 INFO:tasks.workunit.client.1.smithi173.stdout:0/170: creat d0/d12/d15/f3a x:0 0 0 2024-02-16T22:19:09.756 INFO:tasks.workunit.client.1.smithi173.stdout:4/162: mkdir d7/d28/d14/d32/d3d 0 2024-02-16T22:19:09.763 INFO:tasks.workunit.client.1.smithi173.stdout:0/171: dread d0/d4/fe [4194304,4194304] 0 2024-02-16T22:19:09.766 INFO:tasks.workunit.client.1.smithi173.stdout:6/173: rmdir d0 39 2024-02-16T22:19:09.766 INFO:tasks.workunit.client.1.smithi173.stdout:6/174: fsync d0/db/f25 0 2024-02-16T22:19:09.767 INFO:tasks.workunit.client.1.smithi173.stdout:1/248: rmdir db/d1c/d25/d28/d3f 39 2024-02-16T22:19:09.767 INFO:tasks.workunit.client.1.smithi173.stdout:1/249: chown db/d1c/l2a 5803485 1 2024-02-16T22:19:09.767 INFO:tasks.workunit.client.1.smithi173.stdout:2/257: mknod d2/d4/d43/c56 0 2024-02-16T22:19:09.771 INFO:tasks.workunit.client.1.smithi173.stdout:0/172: dread d0/d12/d15/f1c [0,4194304] 0 2024-02-16T22:19:09.771 INFO:tasks.workunit.client.1.smithi173.stdout:0/173: chown d0/d12/d15 64648143 1 2024-02-16T22:19:09.771 INFO:tasks.workunit.client.1.smithi173.stdout:0/174: chown d0/d4/d14/f2d 53423 1 2024-02-16T22:19:09.771 INFO:tasks.workunit.client.1.smithi173.stdout:3/183: mkdir d9/d17/d1d/d4e 0 2024-02-16T22:19:09.771 INFO:tasks.workunit.client.1.smithi173.stdout:0/175: truncate d0/f1 2522712 0 2024-02-16T22:19:09.772 INFO:tasks.workunit.client.1.smithi173.stdout:4/163: mknod d7/d28/d31/c3e 0 2024-02-16T22:19:09.776 INFO:tasks.workunit.client.1.smithi173.stdout:6/175: mknod d0/db/d2e/d2f/c3f 0 2024-02-16T22:19:09.776 INFO:tasks.workunit.client.1.smithi173.stdout:6/176: fsync d0/db/f3d 0 2024-02-16T22:19:09.779 INFO:tasks.workunit.client.1.smithi173.stdout:2/258: mkdir d2/d4/d57 0 2024-02-16T22:19:09.783 INFO:tasks.workunit.client.1.smithi173.stdout:3/184: creat d9/d1a/d2b/d4d/f4f x:0 0 0 2024-02-16T22:19:09.784 INFO:tasks.workunit.client.1.smithi173.stdout:5/216: sync 2024-02-16T22:19:09.784 INFO:tasks.workunit.client.1.smithi173.stdout:5/217: fdatasync f4 0 2024-02-16T22:19:09.785 INFO:tasks.workunit.client.1.smithi173.stdout:6/177: rename d0/db/d2e/d2f/d31/l3e to d0/db/l40 0 2024-02-16T22:19:09.785 INFO:tasks.workunit.client.1.smithi173.stdout:6/178: write d0/db/d2e/d2f/d31/d33/f36 [1095982,53858] 0 2024-02-16T22:19:09.786 INFO:tasks.workunit.client.1.smithi173.stdout:1/250: getdents db/d29 0 2024-02-16T22:19:09.788 INFO:tasks.workunit.client.1.smithi173.stdout:2/259: mkdir d2/d4/d8/d58 0 2024-02-16T22:19:09.788 INFO:tasks.workunit.client.1.smithi173.stdout:2/260: creat d2/d4/f59 x:0 0 0 2024-02-16T22:19:09.789 INFO:tasks.workunit.client.1.smithi173.stdout:3/185: creat d9/d17/d25/f50 x:0 0 0 2024-02-16T22:19:09.790 INFO:tasks.workunit.client.1.smithi173.stdout:4/164: dwrite d7/fc [0,4194304] 0 2024-02-16T22:19:09.790 INFO:tasks.workunit.client.1.smithi173.stdout:4/165: fsync d7/df/f24 0 2024-02-16T22:19:09.793 INFO:tasks.workunit.client.1.smithi173.stdout:3/186: dread d9/d1a/f2c [0,4194304] 0 2024-02-16T22:19:09.793 INFO:tasks.workunit.client.1.smithi173.stdout:3/187: read - d9/d17/d1d/f3d zero size 2024-02-16T22:19:09.794 INFO:tasks.workunit.client.1.smithi173.stdout:0/176: write d0/fb [547170,123153] 0 2024-02-16T22:19:09.794 INFO:tasks.workunit.client.1.smithi173.stdout:0/177: chown d0/l20 23285461 1 2024-02-16T22:19:09.796 INFO:tasks.workunit.client.1.smithi173.stdout:6/179: link d0/db/d2e/c32 d0/db/d2e/d2f/d31/d33/c41 0 2024-02-16T22:19:09.800 INFO:tasks.workunit.client.1.smithi173.stdout:2/261: truncate d2/dc/d19/f25 955638 0 2024-02-16T22:19:09.802 INFO:tasks.workunit.client.1.smithi173.stdout:2/262: symlink d2/dc/l5a 0 2024-02-16T22:19:09.802 INFO:tasks.workunit.client.1.smithi173.stdout:2/263: write d2/dc/d19/d1a/f52 [75655,109855] 0 2024-02-16T22:19:09.803 INFO:tasks.workunit.client.1.smithi173.stdout:2/264: symlink d2/d4/d57/l5b 0 2024-02-16T22:19:09.808 INFO:tasks.workunit.client.1.smithi173.stdout:0/178: write d0/ff [337533,81225] 0 2024-02-16T22:19:09.812 INFO:tasks.workunit.client.1.smithi173.stdout:1/251: dwrite db/d29/f39 [0,4194304] 0 2024-02-16T22:19:09.815 INFO:tasks.workunit.client.1.smithi173.stdout:6/180: dread d0/f2d [0,4194304] 0 2024-02-16T22:19:09.815 INFO:tasks.workunit.client.1.smithi173.stdout:6/181: dread - d0/f2b zero size 2024-02-16T22:19:09.816 INFO:tasks.workunit.client.1.smithi173.stdout:2/265: write d2/dc/d19/d1a/f3f [1636090,121267] 0 2024-02-16T22:19:09.816 INFO:tasks.workunit.client.1.smithi173.stdout:4/166: dwrite d7/df/f23 [0,4194304] 0 2024-02-16T22:19:09.817 INFO:tasks.workunit.client.1.smithi173.stdout:1/252: creat db/f59 x:0 0 0 2024-02-16T22:19:09.817 INFO:tasks.workunit.client.1.smithi173.stdout:1/253: getdents db/d29/d57 0 2024-02-16T22:19:09.820 INFO:tasks.workunit.client.1.smithi173.stdout:3/188: getdents d9/d17/d25 0 2024-02-16T22:19:09.820 INFO:tasks.workunit.client.1.smithi173.stdout:3/189: stat d9/d17/d25/f46 0 2024-02-16T22:19:09.820 INFO:tasks.workunit.client.1.smithi173.stdout:3/190: write d9/d17/d1d/f3d [884147,71763] 0 2024-02-16T22:19:09.820 INFO:tasks.workunit.client.1.smithi173.stdout:3/191: truncate d9/da/f27 71865 0 2024-02-16T22:19:09.820 INFO:tasks.workunit.client.1.smithi173.stdout:3/192: dread - d9/d1a/f44 zero size 2024-02-16T22:19:09.820 INFO:tasks.workunit.client.1.smithi173.stdout:2/266: mknod d2/dc/d19/d1a/c5c 0 2024-02-16T22:19:09.825 INFO:tasks.workunit.client.1.smithi173.stdout:1/254: mknod db/d1c/d25/c5a 0 2024-02-16T22:19:09.825 INFO:tasks.workunit.client.1.smithi173.stdout:1/255: creat db/d1c/d25/d28/d3f/d4a/f5b x:0 0 0 2024-02-16T22:19:09.826 INFO:tasks.workunit.client.1.smithi173.stdout:1/256: chown db/d1c/d25/d28/d3f/f4e 2 1 2024-02-16T22:19:09.826 INFO:tasks.workunit.client.1.smithi173.stdout:1/257: chown db/d1c/d25/d28/c3c 560035351 1 2024-02-16T22:19:09.828 INFO:tasks.workunit.client.1.smithi173.stdout:6/182: rename d0/c17 to d0/db/d2e/c42 0 2024-02-16T22:19:09.828 INFO:tasks.workunit.client.1.smithi173.stdout:6/183: write d0/db/f2a [925071,52395] 0 2024-02-16T22:19:09.828 INFO:tasks.workunit.client.1.smithi173.stdout:0/179: dwrite d0/d4/f18 [0,4194304] 0 2024-02-16T22:19:09.829 INFO:tasks.workunit.client.1.smithi173.stdout:6/184: read d0/db/f25 [285277,111069] 0 2024-02-16T22:19:09.831 INFO:tasks.workunit.client.1.smithi173.stdout:3/193: mkdir d9/d1a/d2b/d45/d51 0 2024-02-16T22:19:09.831 INFO:tasks.workunit.client.1.smithi173.stdout:3/194: write d9/da/f15 [4742547,120992] 0 2024-02-16T22:19:09.831 INFO:tasks.workunit.client.1.smithi173.stdout:3/195: creat d9/d1a/d2b/d4d/f52 x:0 0 0 2024-02-16T22:19:09.831 INFO:tasks.workunit.client.1.smithi173.stdout:3/196: truncate d9/da/f43 471338 0 2024-02-16T22:19:09.832 INFO:tasks.workunit.client.1.smithi173.stdout:2/267: dread f1 [0,4194304] 0 2024-02-16T22:19:09.832 INFO:tasks.workunit.client.1.smithi173.stdout:2/268: read - d2/dc/f2b zero size 2024-02-16T22:19:09.834 INFO:tasks.workunit.client.1.smithi173.stdout:4/167: rmdir d7/d28 39 2024-02-16T22:19:09.837 INFO:tasks.workunit.client.1.smithi173.stdout:1/258: truncate db/d29/f3b 1533466 0 2024-02-16T22:19:09.838 INFO:tasks.workunit.client.1.smithi173.stdout:4/168: dread d7/d12/f2b [0,4194304] 0 2024-02-16T22:19:09.839 INFO:tasks.workunit.client.1.smithi173.stdout:4/169: write d7/d28/f1d [787472,23887] 0 2024-02-16T22:19:09.839 INFO:tasks.workunit.client.1.smithi173.stdout:4/170: truncate d7/d28/f1a 133614 0 2024-02-16T22:19:09.844 INFO:tasks.workunit.client.1.smithi173.stdout:0/180: link d0/d4/d14/d24/l36 d0/d4/d14/d24/l3b 0 2024-02-16T22:19:09.845 INFO:tasks.workunit.client.1.smithi173.stdout:1/259: write db/d29/f3b [2482886,43766] 0 2024-02-16T22:19:09.851 INFO:tasks.workunit.client.1.smithi173.stdout:6/185: rename d0/l27 to d0/db/d2e/d2f/l43 0 2024-02-16T22:19:09.851 INFO:tasks.workunit.client.1.smithi173.stdout:4/171: dread d7/fc [0,4194304] 0 2024-02-16T22:19:09.851 INFO:tasks.workunit.client.1.smithi173.stdout:7/216: sync 2024-02-16T22:19:09.851 INFO:tasks.workunit.client.1.smithi173.stdout:8/307: sync 2024-02-16T22:19:09.852 INFO:tasks.workunit.client.1.smithi173.stdout:6/186: dread d0/f18 [0,4194304] 0 2024-02-16T22:19:09.852 INFO:tasks.workunit.client.1.smithi173.stdout:0/181: rmdir d0/d12/d15 39 2024-02-16T22:19:09.854 INFO:tasks.workunit.client.1.smithi173.stdout:0/182: dread d0/f11 [0,4194304] 0 2024-02-16T22:19:09.854 INFO:tasks.workunit.client.1.smithi173.stdout:0/183: write d0/f5 [913359,97591] 0 2024-02-16T22:19:09.854 INFO:tasks.workunit.client.1.smithi173.stdout:0/184: write d0/d4/f26 [508951,73653] 0 2024-02-16T22:19:09.854 INFO:tasks.workunit.client.1.smithi173.stdout:0/185: chown d0/d12/d15 2 1 2024-02-16T22:19:09.856 INFO:tasks.workunit.client.1.smithi173.stdout:3/197: rename d9/d17/d1d/f24 to d9/d1a/d2b/d49/f53 0 2024-02-16T22:19:09.858 INFO:tasks.workunit.client.1.smithi173.stdout:7/217: symlink d1/d5/d13/l3f 0 2024-02-16T22:19:09.858 INFO:tasks.workunit.client.1.smithi173.stdout:8/308: symlink dd/d11/d22/d5a/l72 0 2024-02-16T22:19:09.860 INFO:tasks.workunit.client.1.smithi173.stdout:6/187: readlink d0/l2 0 2024-02-16T22:19:09.860 INFO:tasks.workunit.client.1.smithi173.stdout:4/172: write d7/f15 [2400893,16387] 0 2024-02-16T22:19:09.860 INFO:tasks.workunit.client.1.smithi173.stdout:4/173: chown d7/ca 4 1 2024-02-16T22:19:09.861 INFO:tasks.workunit.client.1.smithi173.stdout:1/260: dwrite db/d1c/d25/d28/f55 [0,4194304] 0 2024-02-16T22:19:09.861 INFO:tasks.workunit.client.1.smithi173.stdout:0/186: creat d0/d4/d33/f3c x:0 0 0 2024-02-16T22:19:09.868 INFO:tasks.workunit.client.1.smithi173.stdout:0/187: dread d0/d4/fe [4194304,4194304] 0 2024-02-16T22:19:09.868 INFO:tasks.workunit.client.1.smithi173.stdout:0/188: chown d0/d4/d14/d24/l36 502 1 2024-02-16T22:19:09.868 INFO:tasks.workunit.client.1.smithi173.stdout:0/189: chown d0/d4/f26 2035917340 1 2024-02-16T22:19:09.868 INFO:tasks.workunit.client.1.smithi173.stdout:0/190: chown d0/d4/d14/l1b 2150028 1 2024-02-16T22:19:09.869 INFO:tasks.workunit.client.1.smithi173.stdout:3/198: creat d9/d17/f54 x:0 0 0 2024-02-16T22:19:09.871 INFO:tasks.workunit.client.1.smithi173.stdout:7/218: unlink d1/d5/d11/l2c 0 2024-02-16T22:19:09.873 INFO:tasks.workunit.client.1.smithi173.stdout:8/309: mkdir dd/d11/d22/d2e/d41/d73 0 2024-02-16T22:19:09.873 INFO:tasks.workunit.client.1.smithi173.stdout:8/310: creat dd/d11/d22/d28/d40/f74 x:0 0 0 2024-02-16T22:19:09.876 INFO:tasks.workunit.client.1.smithi173.stdout:6/188: creat d0/f44 x:0 0 0 2024-02-16T22:19:09.876 INFO:tasks.workunit.client.1.smithi173.stdout:8/311: dread f2 [0,4194304] 0 2024-02-16T22:19:09.880 INFO:tasks.workunit.client.1.smithi173.stdout:0/191: dwrite d0/f10 [0,4194304] 0 2024-02-16T22:19:09.889 INFO:tasks.workunit.client.1.smithi173.stdout:3/199: link d9/d1a/c2f d9/d1a/d2b/d4d/c55 0 2024-02-16T22:19:09.890 INFO:tasks.workunit.client.1.smithi173.stdout:7/219: unlink d1/d5/d10/c31 0 2024-02-16T22:19:09.893 INFO:tasks.workunit.client.1.smithi173.stdout:6/189: link d0/db/f1f d0/db/d2e/d2f/f45 0 2024-02-16T22:19:09.895 INFO:tasks.workunit.client.1.smithi173.stdout:6/190: dread d0/f11 [0,4194304] 0 2024-02-16T22:19:09.896 INFO:tasks.workunit.client.1.smithi173.stdout:0/192: mkdir d0/d12/d15/d3d 0 2024-02-16T22:19:09.896 INFO:tasks.workunit.client.1.smithi173.stdout:0/193: fdatasync d0/d4/fe 0 2024-02-16T22:19:09.896 INFO:tasks.workunit.client.1.smithi173.stdout:0/194: truncate d0/d4/d14/d24/d32/d39/f2c 4569583 0 2024-02-16T22:19:09.897 INFO:tasks.workunit.client.1.smithi173.stdout:0/195: write d0/d4/d33/f3c [616967,73356] 0 2024-02-16T22:19:09.897 INFO:tasks.workunit.client.1.smithi173.stdout:0/196: stat d0/d4/fa 0 2024-02-16T22:19:09.897 INFO:tasks.workunit.client.1.smithi173.stdout:0/197: read - d0/d12/d15/f3a zero size 2024-02-16T22:19:09.897 INFO:tasks.workunit.client.1.smithi173.stdout:0/198: creat d0/d4/f3e x:0 0 0 2024-02-16T22:19:09.897 INFO:tasks.workunit.client.1.smithi173.stdout:2/269: rename d2/db to d2/dc/d5d 0 2024-02-16T22:19:09.900 INFO:tasks.workunit.client.1.smithi173.stdout:3/200: mknod d9/da/c56 0 2024-02-16T22:19:09.900 INFO:tasks.workunit.client.1.smithi173.stdout:3/201: write d9/da/f15 [3517197,78135] 0 2024-02-16T22:19:09.900 INFO:tasks.workunit.client.1.smithi173.stdout:3/202: creat d9/d17/f57 x:0 0 0 2024-02-16T22:19:09.900 INFO:tasks.workunit.client.1.smithi173.stdout:3/203: write d9/d1a/d2b/d49/f53 [3637366,40468] 0 2024-02-16T22:19:09.900 INFO:tasks.workunit.client.1.smithi173.stdout:8/312: dwrite f9 [0,4194304] 0 2024-02-16T22:19:09.901 INFO:tasks.workunit.client.1.smithi173.stdout:7/220: truncate d1/d5/f4 196087 0 2024-02-16T22:19:09.902 INFO:tasks.workunit.client.1.smithi173.stdout:7/221: readlink d1/l1b 0 2024-02-16T22:19:09.904 INFO:tasks.workunit.client.1.smithi173.stdout:6/191: creat d0/db/d2e/f46 x:0 0 0 2024-02-16T22:19:09.904 INFO:tasks.workunit.client.1.smithi173.stdout:6/192: truncate d0/f2b 349572 0 2024-02-16T22:19:09.908 INFO:tasks.workunit.client.1.smithi173.stdout:4/174: rename d7/df/f24 to d7/d28/d14/d32/f3f 0 2024-02-16T22:19:09.908 INFO:tasks.workunit.client.1.smithi173.stdout:4/175: readlink d7/l18 0 2024-02-16T22:19:09.909 INFO:tasks.workunit.client.1.smithi173.stdout:3/204: read d9/d17/f1c [3011908,86333] 0 2024-02-16T22:19:09.911 INFO:tasks.workunit.client.1.smithi173.stdout:2/270: mknod d2/d4/d8/d30/d4d/c5e 0 2024-02-16T22:19:09.911 INFO:tasks.workunit.client.1.smithi173.stdout:2/271: write d2/d4/f7 [7104173,22866] 0 2024-02-16T22:19:09.919 INFO:tasks.workunit.client.1.smithi173.stdout:8/313: dwrite dd/d11/d22/d50/f6e [0,4194304] 0 2024-02-16T22:19:09.919 INFO:tasks.workunit.client.1.smithi173.stdout:8/314: truncate dd/d11/d22/d28/d40/d52/f54 4374665 0 2024-02-16T22:19:09.919 INFO:tasks.workunit.client.1.smithi173.stdout:8/315: write dd/d11/d22/d2e/d41/f4a [333697,128615] 0 2024-02-16T22:19:09.919 INFO:tasks.workunit.client.1.smithi173.stdout:8/316: creat dd/d11/d22/d28/d40/d52/f75 x:0 0 0 2024-02-16T22:19:09.919 INFO:tasks.workunit.client.1.smithi173.stdout:8/317: creat dd/d11/d22/d2e/d41/f76 x:0 0 0 2024-02-16T22:19:09.927 INFO:tasks.workunit.client.1.smithi173.stdout:7/222: dwrite d1/f2f [0,4194304] 0 2024-02-16T22:19:09.928 INFO:tasks.workunit.client.1.smithi173.stdout:6/193: creat d0/db/f47 x:0 0 0 2024-02-16T22:19:09.931 INFO:tasks.workunit.client.1.smithi173.stdout:0/199: fsync d0/d4/f3e 0 2024-02-16T22:19:09.931 INFO:tasks.workunit.client.1.smithi173.stdout:0/200: chown d0/fb 42 1 2024-02-16T22:19:09.933 INFO:tasks.workunit.client.1.smithi173.stdout:4/176: creat d7/d28/d14/f40 x:0 0 0 2024-02-16T22:19:09.939 INFO:tasks.workunit.client.1.smithi173.stdout:3/205: dwrite d9/d1a/d2b/d49/f53 [0,4194304] 0 2024-02-16T22:19:09.943 INFO:tasks.workunit.client.1.smithi173.stdout:7/223: mknod d1/d5/d10/d27/c40 0 2024-02-16T22:19:09.943 INFO:tasks.workunit.client.1.smithi173.stdout:7/224: read d1/d5/d11/f14 [217351,90419] 0 2024-02-16T22:19:09.943 INFO:tasks.workunit.client.1.smithi173.stdout:7/225: creat d1/f41 x:0 0 0 2024-02-16T22:19:09.944 INFO:tasks.workunit.client.1.smithi173.stdout:0/201: mknod d0/d4/d14/d24/d32/d39/c3f 0 2024-02-16T22:19:09.945 INFO:tasks.workunit.client.1.smithi173.stdout:4/177: symlink d7/d28/l41 0 2024-02-16T22:19:09.945 INFO:tasks.workunit.client.1.smithi173.stdout:4/178: readlink d7/d28/l41 0 2024-02-16T22:19:09.949 INFO:tasks.workunit.client.1.smithi173.stdout:2/272: rmdir d2/d4/d8/d30 39 2024-02-16T22:19:09.950 INFO:tasks.workunit.client.1.smithi173.stdout:3/206: rmdir d9/d17/d1d 39 2024-02-16T22:19:09.951 INFO:tasks.workunit.client.1.smithi173.stdout:7/226: getdents d1/d5/d13/d36 0 2024-02-16T22:19:09.951 INFO:tasks.workunit.client.1.smithi173.stdout:3/207: write d9/d17/d1d/f3d [708013,77379] 0 2024-02-16T22:19:09.954 INFO:tasks.workunit.client.1.smithi173.stdout:8/318: dwrite dd/d11/d22/d2e/d41/f4a [0,4194304] 0 2024-02-16T22:19:09.954 INFO:tasks.workunit.client.1.smithi173.stdout:8/319: write dd/d11/d22/d2e/d41/d6b/f6f [283654,61554] 0 2024-02-16T22:19:09.954 INFO:tasks.workunit.client.1.smithi173.stdout:8/320: readlink dd/d11/d22/d28/l5e 0 2024-02-16T22:19:09.954 INFO:tasks.workunit.client.1.smithi173.stdout:5/218: sync 2024-02-16T22:19:09.954 INFO:tasks.workunit.client.1.smithi173.stdout:9/118: sync 2024-02-16T22:19:09.954 INFO:tasks.workunit.client.1.smithi173.stdout:9/119: fsync d1/d2/d10/f1e 0 2024-02-16T22:19:09.954 INFO:tasks.workunit.client.1.smithi173.stdout:6/194: dwrite d0/f1e [0,4194304] 0 2024-02-16T22:19:09.954 INFO:tasks.workunit.client.1.smithi173.stdout:9/120: read f0 [1161535,62183] 0 2024-02-16T22:19:09.955 INFO:tasks.workunit.client.1.smithi173.stdout:9/121: chown d1/c1c 2592430 1 2024-02-16T22:19:09.955 INFO:tasks.workunit.client.1.smithi173.stdout:9/122: truncate d1/d2/d1a/f20 752732 0 2024-02-16T22:19:09.955 INFO:tasks.workunit.client.1.smithi173.stdout:9/123: chown d1/d2/d1a 502 1 2024-02-16T22:19:09.955 INFO:tasks.workunit.client.1.smithi173.stdout:9/124: dread d1/d2/d1a/f20 [0,4194304] 0 2024-02-16T22:19:09.956 INFO:tasks.workunit.client.1.smithi173.stdout:9/125: truncate f0 4805633 0 2024-02-16T22:19:09.956 INFO:tasks.workunit.client.1.smithi173.stdout:4/179: mknod d7/d28/d31/c42 0 2024-02-16T22:19:09.956 INFO:tasks.workunit.client.1.smithi173.stdout:2/273: getdents d2/d4/d43 0 2024-02-16T22:19:09.956 INFO:tasks.workunit.client.1.smithi173.stdout:2/274: chown d2/d10/f4f 1846082 1 2024-02-16T22:19:09.956 INFO:tasks.workunit.client.1.smithi173.stdout:4/180: write d7/d28/d31/f3b [510498,86826] 0 2024-02-16T22:19:09.956 INFO:tasks.workunit.client.1.smithi173.stdout:5/219: read d8/da/f1a [909581,49005] 0 2024-02-16T22:19:09.958 INFO:tasks.workunit.client.1.smithi173.stdout:7/227: unlink d1/d5/d10/d27/l34 0 2024-02-16T22:19:09.959 INFO:tasks.workunit.client.1.smithi173.stdout:7/228: chown d1/d5/d13/l17 25065532 1 2024-02-16T22:19:09.959 INFO:tasks.workunit.client.1.smithi173.stdout:7/229: fdatasync d1/d5/d10/f24 0 2024-02-16T22:19:09.959 INFO:tasks.workunit.client.1.smithi173.stdout:7/230: fsync d1/f9 0 2024-02-16T22:19:09.960 INFO:tasks.workunit.client.1.smithi173.stdout:3/208: mknod d9/d1a/d2b/d45/d51/c58 0 2024-02-16T22:19:09.964 INFO:tasks.workunit.client.1.smithi173.stdout:9/126: read d1/d2/d10/f11 [2692059,58741] 0 2024-02-16T22:19:09.970 INFO:tasks.workunit.client.1.smithi173.stdout:4/181: rename d7/ce to d7/d28/c43 0 2024-02-16T22:19:09.978 INFO:tasks.workunit.client.1.smithi173.stdout:3/209: link d9/d18/l30 d9/d1a/l59 0 2024-02-16T22:19:09.978 INFO:tasks.workunit.client.1.smithi173.stdout:3/210: readlink d9/d1a/d2b/l40 0 2024-02-16T22:19:09.982 INFO:tasks.workunit.client.1.smithi173.stdout:5/220: getdents d8/da 0 2024-02-16T22:19:09.984 INFO:tasks.workunit.client.1.smithi173.stdout:5/221: truncate f4 1752056 0 2024-02-16T22:19:09.984 INFO:tasks.workunit.client.1.smithi173.stdout:5/222: write d8/da/d2d/d36/f40 [492900,68006] 0 2024-02-16T22:19:09.990 INFO:tasks.workunit.client.1.smithi173.stdout:5/223: dread d8/da/d2d/d36/f3d [0,4194304] 0 2024-02-16T22:19:09.990 INFO:tasks.workunit.client.1.smithi173.stdout:5/224: write d8/da/d1f/d33/f3e [4995588,84158] 0 2024-02-16T22:19:09.990 INFO:tasks.workunit.client.1.smithi173.stdout:5/225: stat d8/da/d2d/d32 0 2024-02-16T22:19:09.991 INFO:tasks.workunit.client.1.smithi173.stdout:5/226: dread d8/da/f1a [0,4194304] 0 2024-02-16T22:19:09.991 INFO:tasks.workunit.client.1.smithi173.stdout:5/227: readlink d8/l2c 0 2024-02-16T22:19:09.995 INFO:tasks.workunit.client.1.smithi173.stdout:5/228: rmdir d8/da/d1b 39 2024-02-16T22:19:09.997 INFO:tasks.workunit.client.1.smithi173.stdout:5/229: creat d8/d27/d35/f44 x:0 0 0 2024-02-16T22:19:09.997 INFO:tasks.workunit.client.1.smithi173.stdout:5/230: fsync d8/d27/d28/f39 0 2024-02-16T22:19:09.998 INFO:tasks.workunit.client.1.smithi173.stdout:5/231: creat d8/da/f45 x:0 0 0 2024-02-16T22:19:10.000 INFO:tasks.workunit.client.1.smithi173.stdout:5/232: rmdir d8/da/d2d/d32 0 2024-02-16T22:19:10.001 INFO:tasks.workunit.client.1.smithi173.stdout:5/233: symlink d8/d27/d35/l46 0 2024-02-16T22:19:10.005 INFO:tasks.workunit.client.1.smithi173.stdout:6/195: dwrite d0/f2b [0,4194304] 0 2024-02-16T22:19:10.005 INFO:tasks.workunit.client.1.smithi173.stdout:5/234: dread d8/da/d1b/f3b [0,4194304] 0 2024-02-16T22:19:10.007 INFO:tasks.workunit.client.1.smithi173.stdout:9/127: dwrite d1/d2/d1a/f20 [0,4194304] 0 2024-02-16T22:19:10.007 INFO:tasks.workunit.client.1.smithi173.stdout:9/128: dread - d1/d2/f13 zero size 2024-02-16T22:19:10.007 INFO:tasks.workunit.client.1.smithi173.stdout:8/321: dwrite dd/d11/d22/d28/d40/f74 [0,4194304] 0 2024-02-16T22:19:10.007 INFO:tasks.workunit.client.1.smithi173.stdout:8/322: write dd/d11/d22/d5a/f61 [1167420,114891] 0 2024-02-16T22:19:10.007 INFO:tasks.workunit.client.1.smithi173.stdout:7/231: dwrite d1/d5/fe [0,4194304] 0 2024-02-16T22:19:10.007 INFO:tasks.workunit.client.1.smithi173.stdout:7/232: readlink d1/l7 0 2024-02-16T22:19:10.007 INFO:tasks.workunit.client.1.smithi173.stdout:4/182: dwrite d7/df/f23 [4194304,4194304] 0 2024-02-16T22:19:10.007 INFO:tasks.workunit.client.1.smithi173.stdout:2/275: dwrite d2/dc/d19/f1f [0,4194304] 0 2024-02-16T22:19:10.009 INFO:tasks.workunit.client.1.smithi173.stdout:3/211: dwrite d9/d1a/f44 [0,4194304] 0 2024-02-16T22:19:10.009 INFO:tasks.workunit.client.1.smithi173.stdout:5/235: fsync d8/da/d1f/d33/f3e 0 2024-02-16T22:19:10.009 INFO:tasks.workunit.client.1.smithi173.stdout:5/236: stat d8/da/d1f/d30/c31 0 2024-02-16T22:19:10.017 INFO:tasks.workunit.client.1.smithi173.stdout:9/129: creat d1/d2/f24 x:0 0 0 2024-02-16T22:19:10.020 INFO:tasks.workunit.client.1.smithi173.stdout:7/233: creat d1/d5/d11/f42 x:0 0 0 2024-02-16T22:19:10.020 INFO:tasks.workunit.client.1.smithi173.stdout:7/234: chown d1/d5/d13/d36/l3a 4446 1 2024-02-16T22:19:10.026 INFO:tasks.workunit.client.1.smithi173.stdout:5/237: dwrite d8/da/f45 [0,4194304] 0 2024-02-16T22:19:10.037 INFO:tasks.workunit.client.1.smithi173.stdout:2/276: unlink d2/dc/d19/f1f 0 2024-02-16T22:19:10.037 INFO:tasks.workunit.client.1.smithi173.stdout:2/277: creat d2/dc/d19/d1a/f5f x:0 0 0 2024-02-16T22:19:10.037 INFO:tasks.workunit.client.1.smithi173.stdout:4/183: creat d7/d12/d2d/f44 x:0 0 0 2024-02-16T22:19:10.042 INFO:tasks.workunit.client.1.smithi173.stdout:3/212: rmdir d9/d1a/d2b/d45/d51 39 2024-02-16T22:19:10.042 INFO:tasks.workunit.client.1.smithi173.stdout:3/213: truncate d9/d17/d25/f39 67974 0 2024-02-16T22:19:10.044 INFO:tasks.workunit.client.1.smithi173.stdout:6/196: unlink d0/c1b 0 2024-02-16T22:19:10.047 INFO:tasks.workunit.client.1.smithi173.stdout:9/130: mknod d1/d2/d1a/c25 0 2024-02-16T22:19:10.048 INFO:tasks.workunit.client.1.smithi173.stdout:7/235: symlink d1/d5/d10/d28/l43 0 2024-02-16T22:19:10.055 INFO:tasks.workunit.client.1.smithi173.stdout:4/184: dwrite d7/d28/d14/f2a [0,4194304] 0 2024-02-16T22:19:10.055 INFO:tasks.workunit.client.1.smithi173.stdout:2/278: creat d2/dc/d19/f60 x:0 0 0 2024-02-16T22:19:10.056 INFO:tasks.workunit.client.1.smithi173.stdout:3/214: creat d9/d17/d1d/f5a x:0 0 0 2024-02-16T22:19:10.060 INFO:tasks.workunit.client.1.smithi173.stdout:9/131: link d1/d2/d10/f11 d1/d2/d1a/f26 0 2024-02-16T22:19:10.064 INFO:tasks.workunit.client.1.smithi173.stdout:4/185: mkdir d7/d28/d14/d32/d45 0 2024-02-16T22:19:10.067 INFO:tasks.workunit.client.1.smithi173.stdout:9/132: dread f0 [0,4194304] 0 2024-02-16T22:19:10.067 INFO:tasks.workunit.client.1.smithi173.stdout:9/133: stat d1/d2/d10/f14 0 2024-02-16T22:19:10.067 INFO:tasks.workunit.client.1.smithi173.stdout:9/134: readlink d1/l1b 0 2024-02-16T22:19:10.067 INFO:tasks.workunit.client.1.smithi173.stdout:9/135: fsync d1/d2/d1a/f20 0 2024-02-16T22:19:10.067 INFO:tasks.workunit.client.1.smithi173.stdout:2/279: mknod d2/d4/c61 0 2024-02-16T22:19:10.067 INFO:tasks.workunit.client.1.smithi173.stdout:2/280: chown d2/dc/d5d/c11 178 1 2024-02-16T22:19:10.068 INFO:tasks.workunit.client.1.smithi173.stdout:6/197: dwrite d0/db/d2e/d2f/f45 [4194304,4194304] 0 2024-02-16T22:19:10.068 INFO:tasks.workunit.client.1.smithi173.stdout:3/215: mkdir d9/d1a/d2b/d4d/d5b 0 2024-02-16T22:19:10.068 INFO:tasks.workunit.client.1.smithi173.stdout:7/236: dwrite d1/d1d/f32 [0,4194304] 0 2024-02-16T22:19:10.070 INFO:tasks.workunit.client.1.smithi173.stdout:9/136: stat d1/d2/d10/l1d 0 2024-02-16T22:19:10.070 INFO:tasks.workunit.client.1.smithi173.stdout:9/137: chown d1/d2/d10/f11 40367 1 2024-02-16T22:19:10.070 INFO:tasks.workunit.client.1.smithi173.stdout:9/138: read d1/d2/d10/f1e [95280,53214] 0 2024-02-16T22:19:10.070 INFO:tasks.workunit.client.1.smithi173.stdout:9/139: stat d1/d2/c6 0 2024-02-16T22:19:10.076 INFO:tasks.workunit.client.1.smithi173.stdout:2/281: mkdir d2/d10/d62 0 2024-02-16T22:19:10.079 INFO:tasks.workunit.client.1.smithi173.stdout:9/140: dread d1/d2/d1a/f20 [0,4194304] 0 2024-02-16T22:19:10.079 INFO:tasks.workunit.client.1.smithi173.stdout:9/141: chown d1/d2 3821 1 2024-02-16T22:19:10.079 INFO:tasks.workunit.client.1.smithi173.stdout:6/198: link d0/db/d2e/d2f/f3b d0/db/d2e/d2f/d31/d33/f48 0 2024-02-16T22:19:10.079 INFO:tasks.workunit.client.1.smithi173.stdout:6/199: readlink d0/l2 0 2024-02-16T22:19:10.079 INFO:tasks.workunit.client.1.smithi173.stdout:6/200: chown d0/db/f1f 48 1 2024-02-16T22:19:10.079 INFO:tasks.workunit.client.1.smithi173.stdout:9/142: creat d1/d2/d10/f27 x:0 0 0 2024-02-16T22:19:10.079 INFO:tasks.workunit.client.1.smithi173.stdout:9/143: chown d1/f18 30398126 1 2024-02-16T22:19:10.079 INFO:tasks.workunit.client.1.smithi173.stdout:9/144: creat d1/d2/d1a/f28 x:0 0 0 2024-02-16T22:19:10.080 INFO:tasks.workunit.client.1.smithi173.stdout:3/216: mkdir d9/d1a/d2b/d45/d4b/d5c 0 2024-02-16T22:19:10.080 INFO:tasks.workunit.client.1.smithi173.stdout:3/217: stat f8 0 2024-02-16T22:19:10.080 INFO:tasks.workunit.client.1.smithi173.stdout:3/218: chown d9/d18/c33 160 1 2024-02-16T22:19:10.085 INFO:tasks.workunit.client.1.smithi173.stdout:6/201: write d0/fa [453395,46539] 0 2024-02-16T22:19:10.089 INFO:tasks.workunit.client.1.smithi173.stdout:9/145: creat d1/d2/d1a/d1f/f29 x:0 0 0 2024-02-16T22:19:10.090 INFO:tasks.workunit.client.1.smithi173.stdout:6/202: mknod d0/db/c49 0 2024-02-16T22:19:10.093 INFO:tasks.workunit.client.1.smithi173.stdout:9/146: rename d1/d2/d10/f1e to d1/d2/d1a/f2a 0 2024-02-16T22:19:10.093 INFO:tasks.workunit.client.1.smithi173.stdout:9/147: creat d1/d2/d1a/f2b x:0 0 0 2024-02-16T22:19:10.093 INFO:tasks.workunit.client.1.smithi173.stdout:9/148: creat d1/d2/d1a/d1f/f2c x:0 0 0 2024-02-16T22:19:10.093 INFO:tasks.workunit.client.1.smithi173.stdout:9/149: write d1/d2/d1a/f2b [728840,129925] 0 2024-02-16T22:19:10.093 INFO:tasks.workunit.client.1.smithi173.stdout:6/203: mkdir d0/db/d2e/d2f/d31/d4a 0 2024-02-16T22:19:10.097 INFO:tasks.workunit.client.1.smithi173.stdout:6/204: chown d0/fd 28 1 2024-02-16T22:19:10.099 INFO:tasks.workunit.client.1.smithi173.stdout:6/205: creat d0/db/d2e/d2f/f4b x:0 0 0 2024-02-16T22:19:10.099 INFO:tasks.workunit.client.1.smithi173.stdout:6/206: dread - d0/db/d2e/d2f/d31/d33/f48 zero size 2024-02-16T22:19:10.099 INFO:tasks.workunit.client.1.smithi173.stdout:6/207: creat d0/db/d2e/d2f/f4c x:0 0 0 2024-02-16T22:19:10.100 INFO:tasks.workunit.client.1.smithi173.stdout:6/208: unlink d0/f26 0 2024-02-16T22:19:10.101 INFO:tasks.workunit.client.1.smithi173.stdout:6/209: mkdir d0/db/d4d 0 2024-02-16T22:19:10.102 INFO:tasks.workunit.client.1.smithi173.stdout:6/210: unlink d0/f14 0 2024-02-16T22:19:10.103 INFO:tasks.workunit.client.1.smithi173.stdout:6/211: write d0/f18 [428361,116377] 0 2024-02-16T22:19:10.104 INFO:tasks.workunit.client.1.smithi173.stdout:4/186: dwrite d7/f15 [4194304,4194304] 0 2024-02-16T22:19:10.108 INFO:tasks.workunit.client.1.smithi173.stdout:4/187: mknod d7/d28/c46 0 2024-02-16T22:19:10.108 INFO:tasks.workunit.client.1.smithi173.stdout:2/282: dwrite d2/f3c [0,4194304] 0 2024-02-16T22:19:10.111 INFO:tasks.workunit.client.1.smithi173.stdout:4/188: dread d7/d28/d31/f3b [0,4194304] 0 2024-02-16T22:19:10.111 INFO:tasks.workunit.client.1.smithi173.stdout:3/219: dwrite d9/f22 [0,4194304] 0 2024-02-16T22:19:10.111 INFO:tasks.workunit.client.1.smithi173.stdout:3/220: truncate d9/d17/d25/f4a 779690 0 2024-02-16T22:19:10.111 INFO:tasks.workunit.client.1.smithi173.stdout:2/283: creat d2/d10/d62/f63 x:0 0 0 2024-02-16T22:19:10.113 INFO:tasks.workunit.client.1.smithi173.stdout:2/284: rename d2/d4/f2a to d2/d10/f64 0 2024-02-16T22:19:10.121 INFO:tasks.workunit.client.1.smithi173.stdout:1/261: sync 2024-02-16T22:19:10.122 INFO:tasks.workunit.client.1.smithi173.stdout:1/262: mkdir db/d1c/d5c 0 2024-02-16T22:19:10.125 INFO:tasks.workunit.client.1.smithi173.stdout:2/285: read d2/dc/d5d/f18 [2308487,101502] 0 2024-02-16T22:19:10.125 INFO:tasks.workunit.client.1.smithi173.stdout:2/286: readlink d2/d4/l3d 0 2024-02-16T22:19:10.125 INFO:tasks.workunit.client.1.smithi173.stdout:1/263: link db/d1c/d25/d28/f2f db/d29/d57/f5d 0 2024-02-16T22:19:10.128 INFO:tasks.workunit.client.1.smithi173.stdout:6/212: dwrite d0/db/f28 [0,4194304] 0 2024-02-16T22:19:10.130 INFO:tasks.workunit.client.1.smithi173.stdout:2/287: mknod d2/dc/d19/d1c/d53/c65 0 2024-02-16T22:19:10.130 INFO:tasks.workunit.client.1.smithi173.stdout:0/202: sync 2024-02-16T22:19:10.130 INFO:tasks.workunit.client.1.smithi173.stdout:8/323: sync 2024-02-16T22:19:10.130 INFO:tasks.workunit.client.1.smithi173.stdout:0/203: read - d0/d12/d15/f3a zero size 2024-02-16T22:19:10.131 INFO:tasks.workunit.client.1.smithi173.stdout:4/189: dwrite d7/d28/d14/f2a [0,4194304] 0 2024-02-16T22:19:10.131 INFO:tasks.workunit.client.1.smithi173.stdout:4/190: fdatasync d7/d12/f30 0 2024-02-16T22:19:10.131 INFO:tasks.workunit.client.1.smithi173.stdout:2/288: read d2/d10/f4f [27571,86726] 0 2024-02-16T22:19:10.132 INFO:tasks.workunit.client.1.smithi173.stdout:0/204: dread d0/d4/d33/f3c [0,4194304] 0 2024-02-16T22:19:10.135 INFO:tasks.workunit.client.1.smithi173.stdout:6/213: unlink d0/f2b 0 2024-02-16T22:19:10.135 INFO:tasks.workunit.client.1.smithi173.stdout:6/214: fsync d0/db/f12 0 2024-02-16T22:19:10.138 INFO:tasks.workunit.client.1.smithi173.stdout:8/324: unlink dd/d11/d22/d2e/c3a 0 2024-02-16T22:19:10.139 INFO:tasks.workunit.client.1.smithi173.stdout:4/191: creat d7/d28/d14/d32/f47 x:0 0 0 2024-02-16T22:19:10.139 INFO:tasks.workunit.client.1.smithi173.stdout:4/192: dread - d7/d28/d31/f37 zero size 2024-02-16T22:19:10.139 INFO:tasks.workunit.client.1.smithi173.stdout:4/193: stat d7/d28/f1d 0 2024-02-16T22:19:10.139 INFO:tasks.workunit.client.1.smithi173.stdout:4/194: chown d7 27 1 2024-02-16T22:19:10.142 INFO:tasks.workunit.client.1.smithi173.stdout:2/289: creat d2/d10/f66 x:0 0 0 2024-02-16T22:19:10.142 INFO:tasks.workunit.client.1.smithi173.stdout:2/290: read - d2/d10/f64 zero size 2024-02-16T22:19:10.142 INFO:tasks.workunit.client.1.smithi173.stdout:2/291: write d2/dc/d19/d1a/f3f [612875,1915] 0 2024-02-16T22:19:10.142 INFO:tasks.workunit.client.1.smithi173.stdout:1/264: dwrite db/d30/f4f [0,4194304] 0 2024-02-16T22:19:10.144 INFO:tasks.workunit.client.1.smithi173.stdout:6/215: unlink d0/db/d2e/c42 0 2024-02-16T22:19:10.146 INFO:tasks.workunit.client.1.smithi173.stdout:2/292: dread d2/d4/d8/d30/f3b [0,4194304] 0 2024-02-16T22:19:10.146 INFO:tasks.workunit.client.1.smithi173.stdout:8/325: mknod dd/d11/d22/d28/d40/d52/c77 0 2024-02-16T22:19:10.146 INFO:tasks.workunit.client.1.smithi173.stdout:8/326: creat dd/d11/d22/d28/d40/f78 x:0 0 0 2024-02-16T22:19:10.146 INFO:tasks.workunit.client.1.smithi173.stdout:8/327: chown dd/d11/d22/c4f 599918267 1 2024-02-16T22:19:10.148 INFO:tasks.workunit.client.1.smithi173.stdout:4/195: unlink d7/d28/d14/d32/f3f 0 2024-02-16T22:19:10.151 INFO:tasks.workunit.client.1.smithi173.stdout:0/205: dwrite d0/f1 [0,4194304] 0 2024-02-16T22:19:10.153 INFO:tasks.workunit.client.1.smithi173.stdout:1/265: mknod db/d1c/c5e 0 2024-02-16T22:19:10.156 INFO:tasks.workunit.client.1.smithi173.stdout:6/216: rename d0/f24 to d0/db/d2e/d2f/f4e 0 2024-02-16T22:19:10.163 INFO:tasks.workunit.client.1.smithi173.stdout:8/328: symlink dd/d11/d22/d2e/l79 0 2024-02-16T22:19:10.165 INFO:tasks.workunit.client.1.smithi173.stdout:0/206: link d0/d4/d14/d24/d32/d39/l22 d0/d4/l40 0 2024-02-16T22:19:10.169 INFO:tasks.workunit.client.1.smithi173.stdout:4/196: rename d7/d28/d31/d33/c38 to d7/d28/d14/d32/d3d/c48 0 2024-02-16T22:19:10.171 INFO:tasks.workunit.client.1.smithi173.stdout:8/329: write dd/d11/d22/f3f [1757415,113768] 0 2024-02-16T22:19:10.171 INFO:tasks.workunit.client.1.smithi173.stdout:6/217: symlink d0/db/d2e/d2f/l4f 0 2024-02-16T22:19:10.171 INFO:tasks.workunit.client.1.smithi173.stdout:6/218: write d0/fa [1582740,50526] 0 2024-02-16T22:19:10.172 INFO:tasks.workunit.client.1.smithi173.stdout:0/207: write d0/f1e [998875,55742] 0 2024-02-16T22:19:10.172 INFO:tasks.workunit.client.1.smithi173.stdout:0/208: chown d0/d4/d14/d24/d32/d39/c3f 496 1 2024-02-16T22:19:10.173 INFO:tasks.workunit.client.1.smithi173.stdout:2/293: getdents d2/dc/d19 0 2024-02-16T22:19:10.173 INFO:tasks.workunit.client.1.smithi173.stdout:2/294: write d2/d4/f59 [664263,54943] 0 2024-02-16T22:19:10.175 INFO:tasks.workunit.client.1.smithi173.stdout:1/266: mkdir db/d5f 0 2024-02-16T22:19:10.178 INFO:tasks.workunit.client.1.smithi173.stdout:4/197: mkdir d7/d28/d31/d33/d49 0 2024-02-16T22:19:10.181 INFO:tasks.workunit.client.1.smithi173.stdout:1/267: write db/d1c/d25/f47 [2504225,69185] 0 2024-02-16T22:19:10.182 INFO:tasks.workunit.client.1.smithi173.stdout:8/330: rename dd/c3b to dd/d11/d22/d2e/c7a 0 2024-02-16T22:19:10.182 INFO:tasks.workunit.client.1.smithi173.stdout:8/331: write dd/d11/f2c [1019815,76530] 0 2024-02-16T22:19:10.187 INFO:tasks.workunit.client.1.smithi173.stdout:2/295: symlink d2/d10/d62/l67 0 2024-02-16T22:19:10.187 INFO:tasks.workunit.client.1.smithi173.stdout:4/198: mknod d7/c4a 0 2024-02-16T22:19:10.189 INFO:tasks.workunit.client.1.smithi173.stdout:1/268: mknod db/d5f/c60 0 2024-02-16T22:19:10.192 INFO:tasks.workunit.client.1.smithi173.stdout:0/209: rename d0/d4/d14/d24/l3b to d0/d4/d14/d24/d32/l41 0 2024-02-16T22:19:10.198 INFO:tasks.workunit.client.1.smithi173.stdout:0/210: dread d0/d4/f8 [0,4194304] 0 2024-02-16T22:19:10.207 INFO:tasks.workunit.client.1.smithi173.stdout:6/219: symlink d0/l50 0 2024-02-16T22:19:10.207 INFO:tasks.workunit.client.1.smithi173.stdout:2/296: dwrite d2/dc/d5d/f24 [0,4194304] 0 2024-02-16T22:19:10.209 INFO:tasks.workunit.client.1.smithi173.stdout:4/199: dwrite d7/f15 [0,4194304] 0 2024-02-16T22:19:10.209 INFO:tasks.workunit.client.1.smithi173.stdout:8/332: rename dd/d11/d22/f2a to dd/d11/d22/d2e/f7b 0 2024-02-16T22:19:10.211 INFO:tasks.workunit.client.1.smithi173.stdout:0/211: creat d0/d4/d14/d24/d32/d39/f42 x:0 0 0 2024-02-16T22:19:10.211 INFO:tasks.workunit.client.1.smithi173.stdout:0/212: fdatasync d0/d4/f3e 0 2024-02-16T22:19:10.211 INFO:tasks.workunit.client.1.smithi173.stdout:0/213: dread - d0/d12/d15/f3a zero size 2024-02-16T22:19:10.212 INFO:tasks.workunit.client.1.smithi173.stdout:6/220: mknod d0/db/d2e/d2f/d31/c51 0 2024-02-16T22:19:10.217 INFO:tasks.workunit.client.1.smithi173.stdout:0/214: write d0/f10 [2463645,37681] 0 2024-02-16T22:19:10.217 INFO:tasks.workunit.client.1.smithi173.stdout:2/297: creat d2/dc/d19/d1c/f68 x:0 0 0 2024-02-16T22:19:10.222 INFO:tasks.workunit.client.1.smithi173.stdout:6/221: unlink d0/db/f1f 0 2024-02-16T22:19:10.222 INFO:tasks.workunit.client.1.smithi173.stdout:6/222: chown d0/db/d2e/f46 51 1 2024-02-16T22:19:10.227 INFO:tasks.workunit.client.1.smithi173.stdout:0/215: symlink d0/d4/d14/d24/l43 0 2024-02-16T22:19:10.227 INFO:tasks.workunit.client.1.smithi173.stdout:2/298: mkdir d2/dc/d19/d69 0 2024-02-16T22:19:10.227 INFO:tasks.workunit.client.1.smithi173.stdout:2/299: readlink d2/d4/d57/l5b 0 2024-02-16T22:19:10.227 INFO:tasks.workunit.client.1.smithi173.stdout:2/300: chown d2/d4/d8/d30/f37 335 1 2024-02-16T22:19:10.227 INFO:tasks.workunit.client.1.smithi173.stdout:2/301: chown d2/dc/d19/d1c/f20 3 1 2024-02-16T22:19:10.229 INFO:tasks.workunit.client.1.smithi173.stdout:1/269: rename db/l11 to db/d29/d50/l61 0 2024-02-16T22:19:10.230 INFO:tasks.workunit.client.1.smithi173.stdout:1/270: write db/d1c/d25/d28/f49 [372658,47527] 0 2024-02-16T22:19:10.230 INFO:tasks.workunit.client.1.smithi173.stdout:1/271: chown db/d1c/d25/d28/c31 22841 1 2024-02-16T22:19:10.230 INFO:tasks.workunit.client.1.smithi173.stdout:1/272: write db/d29/f42 [879965,105801] 0 2024-02-16T22:19:10.230 INFO:tasks.workunit.client.1.smithi173.stdout:8/333: getdents dd/d11/d22/d2e/d41/d6b 0 2024-02-16T22:19:10.234 INFO:tasks.workunit.client.1.smithi173.stdout:5/238: sync 2024-02-16T22:19:10.235 INFO:tasks.workunit.client.1.smithi173.stdout:2/302: creat d2/dc/d5d/f6a x:0 0 0 2024-02-16T22:19:10.239 INFO:tasks.workunit.client.1.smithi173.stdout:4/200: rename d7/fc to d7/d12/d2d/f4b 0 2024-02-16T22:19:10.241 INFO:tasks.workunit.client.1.smithi173.stdout:1/273: chown db/f19 14 1 2024-02-16T22:19:10.243 INFO:tasks.workunit.client.1.smithi173.stdout:5/239: dread d8/da/f1c [0,4194304] 0 2024-02-16T22:19:10.243 INFO:tasks.workunit.client.1.smithi173.stdout:5/240: creat d8/da/f47 x:0 0 0 2024-02-16T22:19:10.245 INFO:tasks.workunit.client.1.smithi173.stdout:4/201: dread d7/d12/d2d/f4b [0,4194304] 0 2024-02-16T22:19:10.245 INFO:tasks.workunit.client.1.smithi173.stdout:8/334: mkdir dd/d7c 0 2024-02-16T22:19:10.248 INFO:tasks.workunit.client.1.smithi173.stdout:6/223: rename d0/f22 to d0/db/d2e/f52 0 2024-02-16T22:19:10.248 INFO:tasks.workunit.client.1.smithi173.stdout:7/237: sync 2024-02-16T22:19:10.249 INFO:tasks.workunit.client.1.smithi173.stdout:2/303: dwrite d2/dc/d19/f25 [0,4194304] 0 2024-02-16T22:19:10.249 INFO:tasks.workunit.client.1.smithi173.stdout:2/304: write d2/d4/d8/d30/f45 [11214,126785] 0 2024-02-16T22:19:10.265 INFO:tasks.workunit.client.1.smithi173.stdout:0/216: rename d0/c35 to d0/d4/d27/c44 0 2024-02-16T22:19:10.265 INFO:tasks.workunit.client.1.smithi173.stdout:0/217: fdatasync d0/d4/d14/f2d 0 2024-02-16T22:19:10.268 INFO:tasks.workunit.client.1.smithi173.stdout:7/238: mkdir d1/d1d/d44 0 2024-02-16T22:19:10.268 INFO:tasks.workunit.client.1.smithi173.stdout:7/239: fdatasync d1/f41 0 2024-02-16T22:19:10.269 INFO:tasks.workunit.client.1.smithi173.stdout:5/241: dwrite d8/d27/d35/f44 [0,4194304] 0 2024-02-16T22:19:10.269 INFO:tasks.workunit.client.1.smithi173.stdout:1/274: dwrite db/d1c/f37 [0,4194304] 0 2024-02-16T22:19:10.271 INFO:tasks.workunit.client.1.smithi173.stdout:2/305: truncate d2/d4/f7 4728519 0 2024-02-16T22:19:10.272 INFO:tasks.workunit.client.1.smithi173.stdout:2/306: chown d2/dc/f2b 69037 1 2024-02-16T22:19:10.273 INFO:tasks.workunit.client.1.smithi173.stdout:0/218: read d0/f1 [4108661,9847] 0 2024-02-16T22:19:10.274 INFO:tasks.workunit.client.1.smithi173.stdout:4/202: rmdir d7/d12/d2d 39 2024-02-16T22:19:10.278 INFO:tasks.workunit.client.1.smithi173.stdout:6/224: mknod d0/db/d2e/d2f/d31/d33/c53 0 2024-02-16T22:19:10.278 INFO:tasks.workunit.client.1.smithi173.stdout:6/225: creat d0/db/d2e/f54 x:0 0 0 2024-02-16T22:19:10.278 INFO:tasks.workunit.client.1.smithi173.stdout:6/226: write d0/db/d2e/d2f/d31/d33/f48 [1033563,21295] 0 2024-02-16T22:19:10.280 INFO:tasks.workunit.client.1.smithi173.stdout:7/240: creat d1/d1d/f45 x:0 0 0 2024-02-16T22:19:10.283 INFO:tasks.workunit.client.1.smithi173.stdout:7/241: dread d1/d1d/f20 [0,4194304] 0 2024-02-16T22:19:10.283 INFO:tasks.workunit.client.1.smithi173.stdout:5/242: symlink d8/d27/d28/l48 0 2024-02-16T22:19:10.283 INFO:tasks.workunit.client.1.smithi173.stdout:5/243: chown d8/da/f45 820 1 2024-02-16T22:19:10.283 INFO:tasks.workunit.client.1.smithi173.stdout:5/244: readlink d8/da/d1b/l42 0 2024-02-16T22:19:10.288 INFO:tasks.workunit.client.1.smithi173.stdout:1/275: mknod db/d29/c62 0 2024-02-16T22:19:10.289 INFO:tasks.workunit.client.1.smithi173.stdout:2/307: symlink d2/d4/d8/d30/l6b 0 2024-02-16T22:19:10.290 INFO:tasks.workunit.client.1.smithi173.stdout:0/219: truncate d0/fb 139177 0 2024-02-16T22:19:10.290 INFO:tasks.workunit.client.1.smithi173.stdout:4/203: symlink d7/d28/d31/d33/d49/l4c 0 2024-02-16T22:19:10.295 INFO:tasks.workunit.client.1.smithi173.stdout:7/242: mknod d1/d5/c46 0 2024-02-16T22:19:10.296 INFO:tasks.workunit.client.1.smithi173.stdout:1/276: creat db/d1c/d5c/f63 x:0 0 0 2024-02-16T22:19:10.296 INFO:tasks.workunit.client.1.smithi173.stdout:1/277: fsync db/d1c/d25/d28/f55 0 2024-02-16T22:19:10.296 INFO:tasks.workunit.client.1.smithi173.stdout:1/278: write db/d1c/d5c/f63 [175397,61309] 0 2024-02-16T22:19:10.297 INFO:tasks.workunit.client.1.smithi173.stdout:1/279: stat db/d1c/d25/d28/d3f/d4a 0 2024-02-16T22:19:10.297 INFO:tasks.workunit.client.1.smithi173.stdout:2/308: mkdir d2/d10/d62/d6c 0 2024-02-16T22:19:10.297 INFO:tasks.workunit.client.1.smithi173.stdout:2/309: write d2/f28 [4557593,103946] 0 2024-02-16T22:19:10.298 INFO:tasks.workunit.client.1.smithi173.stdout:0/220: symlink d0/d12/d15/l45 0 2024-02-16T22:19:10.300 INFO:tasks.workunit.client.1.smithi173.stdout:0/221: read d0/d4/d33/f3c [410146,86527] 0 2024-02-16T22:19:10.300 INFO:tasks.workunit.client.1.smithi173.stdout:8/335: rename dd/d11 to dd/d7c/d7d 0 2024-02-16T22:19:10.300 INFO:tasks.workunit.client.1.smithi173.stdout:8/336: stat dd/d7c/d7d/d22/d5a/f67 0 2024-02-16T22:19:10.300 INFO:tasks.workunit.client.1.smithi173.stdout:8/337: stat dd/d7c/d7d/f3d 0 2024-02-16T22:19:10.301 INFO:tasks.workunit.client.1.smithi173.stdout:7/243: symlink d1/d5/d13/d36/l47 0 2024-02-16T22:19:10.303 INFO:tasks.workunit.client.1.smithi173.stdout:1/280: write db/d1c/f37 [4663804,62394] 0 2024-02-16T22:19:10.303 INFO:tasks.workunit.client.1.smithi173.stdout:1/281: write db/d1c/d25/d28/f49 [1025643,127329] 0 2024-02-16T22:19:10.303 INFO:tasks.workunit.client.1.smithi173.stdout:1/282: write db/d29/f53 [407386,47570] 0 2024-02-16T22:19:10.303 INFO:tasks.workunit.client.1.smithi173.stdout:1/283: write db/d1c/d25/d28/d3f/f4e [395836,111708] 0 2024-02-16T22:19:10.303 INFO:tasks.workunit.client.1.smithi173.stdout:2/310: mknod d2/d10/c6d 0 2024-02-16T22:19:10.304 INFO:tasks.workunit.client.1.smithi173.stdout:0/222: symlink d0/d12/d15/l46 0 2024-02-16T22:19:10.305 INFO:tasks.workunit.client.1.smithi173.stdout:1/284: chown db/f1b 4 1 2024-02-16T22:19:10.307 INFO:tasks.workunit.client.1.smithi173.stdout:8/338: dread dd/d7c/d7d/d22/d28/f3c [0,4194304] 0 2024-02-16T22:19:10.308 INFO:tasks.workunit.client.1.smithi173.stdout:1/285: write db/d29/f53 [77209,125798] 0 2024-02-16T22:19:10.309 INFO:tasks.workunit.client.1.smithi173.stdout:2/311: unlink d2/dc/d19/d1a/c41 0 2024-02-16T22:19:10.309 INFO:tasks.workunit.client.1.smithi173.stdout:2/312: truncate d2/dc/d19/f16 3328963 0 2024-02-16T22:19:10.313 INFO:tasks.workunit.client.1.smithi173.stdout:8/339: dread dd/d7c/d7d/f14 [0,4194304] 0 2024-02-16T22:19:10.320 INFO:tasks.workunit.client.1.smithi173.stdout:2/313: dread d2/d4/f7 [0,4194304] 0 2024-02-16T22:19:10.321 INFO:tasks.workunit.client.1.smithi173.stdout:2/314: rmdir d2/dc/d19 39 2024-02-16T22:19:10.323 INFO:tasks.workunit.client.1.smithi173.stdout:2/315: mkdir d2/dc/d19/d1c/d53/d6e 0 2024-02-16T22:19:10.324 INFO:tasks.workunit.client.1.smithi173.stdout:2/316: mknod d2/dc/d19/d1c/d53/c6f 0 2024-02-16T22:19:10.324 INFO:tasks.workunit.client.1.smithi173.stdout:2/317: creat d2/d4/f70 x:0 0 0 2024-02-16T22:19:10.324 INFO:tasks.workunit.client.1.smithi173.stdout:2/318: stat d2/dc/d19/d1c/l48 0 2024-02-16T22:19:10.325 INFO:tasks.workunit.client.1.smithi173.stdout:2/319: fsync d2/d10/f66 0 2024-02-16T22:19:10.326 INFO:tasks.workunit.client.1.smithi173.stdout:7/244: dwrite d1/d5/d13/f26 [0,4194304] 0 2024-02-16T22:19:10.326 INFO:tasks.workunit.client.1.smithi173.stdout:7/245: fdatasync d1/d5/fe 0 2024-02-16T22:19:10.327 INFO:tasks.workunit.client.1.smithi173.stdout:2/320: link d2/d4/f7 d2/d4/d8/d30/d44/f71 0 2024-02-16T22:19:10.330 INFO:tasks.workunit.client.1.smithi173.stdout:7/246: mkdir d1/d5/d48 0 2024-02-16T22:19:10.331 INFO:tasks.workunit.client.1.smithi173.stdout:2/321: creat d2/d4/d43/f72 x:0 0 0 2024-02-16T22:19:10.331 INFO:tasks.workunit.client.1.smithi173.stdout:2/322: chown d2/dc/l21 933 1 2024-02-16T22:19:10.331 INFO:tasks.workunit.client.1.smithi173.stdout:2/323: write d2/d4/d8/d30/d4d/f4e [280661,21494] 0 2024-02-16T22:19:10.333 INFO:tasks.workunit.client.1.smithi173.stdout:2/324: creat d2/dc/d19/d1c/d53/d6e/f73 x:0 0 0 2024-02-16T22:19:10.336 INFO:tasks.workunit.client.1.smithi173.stdout:7/247: rename d1/d5/d10/d28 to d1/d5/d13/d36/d49 0 2024-02-16T22:19:10.338 INFO:tasks.workunit.client.1.smithi173.stdout:2/325: rename d2/d4/d8/d58 to d2/dc/d19/d1a/d74 0 2024-02-16T22:19:10.339 INFO:tasks.workunit.client.1.smithi173.stdout:7/248: creat d1/d5/d13/d36/f4a x:0 0 0 2024-02-16T22:19:10.339 INFO:tasks.workunit.client.1.smithi173.stdout:7/249: chown d1/d1d 939 1 2024-02-16T22:19:10.339 INFO:tasks.workunit.client.1.smithi173.stdout:7/250: dread - d1/d5/d13/d36/d49/f3b zero size 2024-02-16T22:19:10.343 INFO:tasks.workunit.client.1.smithi173.stdout:7/251: rmdir d1/d5/d11 39 2024-02-16T22:19:10.343 INFO:tasks.workunit.client.1.smithi173.stdout:3/221: sync 2024-02-16T22:19:10.343 INFO:tasks.workunit.client.1.smithi173.stdout:9/150: sync 2024-02-16T22:19:10.345 INFO:tasks.workunit.client.1.smithi173.stdout:9/151: symlink d1/l2d 0 2024-02-16T22:19:10.345 INFO:tasks.workunit.client.1.smithi173.stdout:9/152: truncate d1/d2/f24 831175 0 2024-02-16T22:19:10.345 INFO:tasks.workunit.client.1.smithi173.stdout:9/153: creat d1/d2/d10/f2e x:0 0 0 2024-02-16T22:19:10.346 INFO:tasks.workunit.client.1.smithi173.stdout:7/252: getdents d1 0 2024-02-16T22:19:10.350 INFO:tasks.workunit.client.1.smithi173.stdout:9/154: dread d1/d2/d1a/f20 [0,4194304] 0 2024-02-16T22:19:10.351 INFO:tasks.workunit.client.1.smithi173.stdout:9/155: mkdir d1/d2/d1a/d2f 0 2024-02-16T22:19:10.351 INFO:tasks.workunit.client.1.smithi173.stdout:9/156: creat d1/f30 x:0 0 0 2024-02-16T22:19:10.353 INFO:tasks.workunit.client.1.smithi173.stdout:9/157: read d1/d2/d1a/f2b [514492,46216] 0 2024-02-16T22:19:10.353 INFO:tasks.workunit.client.1.smithi173.stdout:9/158: fdatasync d1/d2/d1a/d1f/f2c 0 2024-02-16T22:19:10.353 INFO:tasks.workunit.client.1.smithi173.stdout:9/159: chown d1/d2/d10/f14 163306 1 2024-02-16T22:19:10.353 INFO:tasks.workunit.client.1.smithi173.stdout:9/160: creat d1/d2/d1a/f31 x:0 0 0 2024-02-16T22:19:10.354 INFO:tasks.workunit.client.1.smithi173.stdout:9/161: write d1/d2/d1a/f31 [426436,89982] 0 2024-02-16T22:19:10.356 INFO:tasks.workunit.client.1.smithi173.stdout:9/162: symlink d1/d2/d1a/l32 0 2024-02-16T22:19:10.356 INFO:tasks.workunit.client.1.smithi173.stdout:9/163: truncate d1/d2/f24 1110112 0 2024-02-16T22:19:10.359 INFO:tasks.workunit.client.1.smithi173.stdout:9/164: dread d1/d2/d10/f11 [0,4194304] 0 2024-02-16T22:19:10.359 INFO:tasks.workunit.client.1.smithi173.stdout:9/165: truncate d1/d2/d1a/f31 968429 0 2024-02-16T22:19:10.361 INFO:tasks.workunit.client.1.smithi173.stdout:9/166: rename d1/d2/d10/f14 to d1/d2/d10/f33 0 2024-02-16T22:19:10.379 INFO:tasks.workunit.client.1.smithi173.stdout:8/340: dwrite dd/d7c/d7d/d22/d2e/d41/f76 [0,4194304] 0 2024-02-16T22:19:10.379 INFO:tasks.workunit.client.1.smithi173.stdout:8/341: dread - dd/d7c/d7d/d22/d28/d40/f63 zero size 2024-02-16T22:19:10.379 INFO:tasks.workunit.client.1.smithi173.stdout:5/245: dwrite d8/f29 [4194304,4194304] 0 2024-02-16T22:19:10.379 INFO:tasks.workunit.client.1.smithi173.stdout:5/246: chown d8/f29 2185614 1 2024-02-16T22:19:10.379 INFO:tasks.workunit.client.1.smithi173.stdout:5/247: stat d8/da/d1f/d33/f3e 0 2024-02-16T22:19:10.381 INFO:tasks.workunit.client.1.smithi173.stdout:8/342: symlink dd/d7c/d7d/d22/d28/l7e 0 2024-02-16T22:19:10.382 INFO:tasks.workunit.client.1.smithi173.stdout:8/343: write dd/d7c/d7d/f39 [803002,50653] 0 2024-02-16T22:19:10.383 INFO:tasks.workunit.client.1.smithi173.stdout:1/286: dwrite db/d29/f42 [0,4194304] 0 2024-02-16T22:19:10.383 INFO:tasks.workunit.client.1.smithi173.stdout:3/222: dwrite d9/fb [0,4194304] 0 2024-02-16T22:19:10.383 INFO:tasks.workunit.client.1.smithi173.stdout:2/326: dwrite d2/dc/d5d/f55 [0,4194304] 0 2024-02-16T22:19:10.383 INFO:tasks.workunit.client.1.smithi173.stdout:2/327: write d2/d4/f70 [316254,38985] 0 2024-02-16T22:19:10.383 INFO:tasks.workunit.client.1.smithi173.stdout:5/248: mkdir d8/da/d1f/d30/d49 0 2024-02-16T22:19:10.383 INFO:tasks.workunit.client.1.smithi173.stdout:9/167: dwrite d1/f22 [0,4194304] 0 2024-02-16T22:19:10.383 INFO:tasks.workunit.client.1.smithi173.stdout:8/344: symlink dd/d7c/d7d/d22/d28/d40/d51/l7f 0 2024-02-16T22:19:10.386 INFO:tasks.workunit.client.1.smithi173.stdout:2/328: dread d2/d4/f59 [0,4194304] 0 2024-02-16T22:19:10.386 INFO:tasks.workunit.client.1.smithi173.stdout:2/329: readlink d2/d4/d57/l5b 0 2024-02-16T22:19:10.387 INFO:tasks.workunit.client.1.smithi173.stdout:3/223: symlink d9/da/l5d 0 2024-02-16T22:19:10.393 INFO:tasks.workunit.client.1.smithi173.stdout:7/253: getdents d1/d5/d13/d36 0 2024-02-16T22:19:10.393 INFO:tasks.workunit.client.1.smithi173.stdout:7/254: write d1/d1d/f45 [115400,36468] 0 2024-02-16T22:19:10.394 INFO:tasks.workunit.client.1.smithi173.stdout:9/168: mkdir d1/d2/d1a/d1f/d34 0 2024-02-16T22:19:10.395 INFO:tasks.workunit.client.1.smithi173.stdout:9/169: truncate d1/d2/d10/f27 693618 0 2024-02-16T22:19:10.395 INFO:tasks.workunit.client.1.smithi173.stdout:1/287: read db/d29/f42 [2742155,62335] 0 2024-02-16T22:19:10.395 INFO:tasks.workunit.client.1.smithi173.stdout:1/288: chown db/d1c/c27 111673244 1 2024-02-16T22:19:10.395 INFO:tasks.workunit.client.1.smithi173.stdout:8/345: rmdir dd/d7c/d7d 39 2024-02-16T22:19:10.395 INFO:tasks.workunit.client.1.smithi173.stdout:8/346: write f2 [3290953,29189] 0 2024-02-16T22:19:10.401 INFO:tasks.workunit.client.1.smithi173.stdout:3/224: unlink d9/d1a/c42 0 2024-02-16T22:19:10.402 INFO:tasks.workunit.client.1.smithi173.stdout:9/170: symlink d1/d2/l35 0 2024-02-16T22:19:10.403 INFO:tasks.workunit.client.1.smithi173.stdout:9/171: creat d1/d2/d1a/d1f/f36 x:0 0 0 2024-02-16T22:19:10.406 INFO:tasks.workunit.client.1.smithi173.stdout:3/225: unlink d9/d17/f57 0 2024-02-16T22:19:10.406 INFO:tasks.workunit.client.1.smithi173.stdout:3/226: fdatasync d9/da/f43 0 2024-02-16T22:19:10.406 INFO:tasks.workunit.client.1.smithi173.stdout:3/227: chown d9/d17/d25/f50 192 1 2024-02-16T22:19:10.409 INFO:tasks.workunit.client.1.smithi173.stdout:9/172: rename d1/d2/l35 to d1/d2/d1a/d1f/l37 0 2024-02-16T22:19:10.409 INFO:tasks.workunit.client.1.smithi173.stdout:9/173: truncate d1/d2/d1a/f26 5765365 0 2024-02-16T22:19:10.410 INFO:tasks.workunit.client.1.smithi173.stdout:1/289: unlink db/cc 0 2024-02-16T22:19:10.412 INFO:tasks.workunit.client.1.smithi173.stdout:3/228: creat d9/d1a/d2b/d4d/d5b/f5e x:0 0 0 2024-02-16T22:19:10.412 INFO:tasks.workunit.client.1.smithi173.stdout:3/229: chown d9/da/f27 4832718 1 2024-02-16T22:19:10.412 INFO:tasks.workunit.client.1.smithi173.stdout:3/230: write d9/d17/d1d/f5a [916085,88651] 0 2024-02-16T22:19:10.412 INFO:tasks.workunit.client.1.smithi173.stdout:8/347: dwrite dd/d7c/d7d/f27 [0,4194304] 0 2024-02-16T22:19:10.413 INFO:tasks.workunit.client.1.smithi173.stdout:9/174: mkdir d1/d2/d1a/d2f/d38 0 2024-02-16T22:19:10.413 INFO:tasks.workunit.client.1.smithi173.stdout:9/175: chown d1/f23 10926761 1 2024-02-16T22:19:10.413 INFO:tasks.workunit.client.1.smithi173.stdout:9/176: readlink d1/l1b 0 2024-02-16T22:19:10.413 INFO:tasks.workunit.client.1.smithi173.stdout:9/177: chown d1/d2 14 1 2024-02-16T22:19:10.414 INFO:tasks.workunit.client.1.smithi173.stdout:1/290: dread db/d1c/d25/d28/f2f [0,4194304] 0 2024-02-16T22:19:10.415 INFO:tasks.workunit.client.1.smithi173.stdout:3/231: unlink d9/d18/c2e 0 2024-02-16T22:19:10.417 INFO:tasks.workunit.client.1.smithi173.stdout:8/348: rename dd/d7c/d7d/d22/d2e/c46 to dd/d7c/d7d/d22/d2e/d41/d6b/c80 0 2024-02-16T22:19:10.417 INFO:tasks.workunit.client.1.smithi173.stdout:8/349: chown dd/d7c/d7d/d22/d28/d40/d52/c77 1650 1 2024-02-16T22:19:10.418 INFO:tasks.workunit.client.1.smithi173.stdout:9/178: rmdir d1/d2/d1a/d2f/d38 0 2024-02-16T22:19:10.420 INFO:tasks.workunit.client.1.smithi173.stdout:3/232: mkdir d9/d18/d5f 0 2024-02-16T22:19:10.420 INFO:tasks.workunit.client.1.smithi173.stdout:8/350: mknod dd/d7c/d7d/c81 0 2024-02-16T22:19:10.422 INFO:tasks.workunit.client.1.smithi173.stdout:1/291: getdents db/d1c 0 2024-02-16T22:19:10.424 INFO:tasks.workunit.client.1.smithi173.stdout:3/233: rename d9/d1a/d2b/d45/d4b/d5c to d9/d1a/d2b/d45/d60 0 2024-02-16T22:19:10.424 INFO:tasks.workunit.client.1.smithi173.stdout:1/292: symlink db/d1c/d25/d28/d3f/l64 0 2024-02-16T22:19:10.425 INFO:tasks.workunit.client.1.smithi173.stdout:3/234: creat d9/d1a/f61 x:0 0 0 2024-02-16T22:19:10.467 INFO:tasks.workunit.client.1.smithi173.stdout:5/249: dwrite d8/da/f47 [0,4194304] 0 2024-02-16T22:19:10.469 INFO:tasks.workunit.client.1.smithi173.stdout:5/250: creat d8/da/d1f/d30/d37/f4a x:0 0 0 2024-02-16T22:19:10.475 INFO:tasks.workunit.client.1.smithi173.stdout:1/293: getdents db 0 2024-02-16T22:19:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:10 smithi134 ceph-mon[28869]: pgmap v257: 65 pgs: 65 active+clean; 2.3 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 171 MiB/s rd, 210 MiB/s wr, 274 op/s 2024-02-16T22:19:10.479 INFO:tasks.workunit.client.1.smithi173.stdout:5/251: write d8/f14 [323789,48108] 0 2024-02-16T22:19:10.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:10 smithi173 ceph-mon[37280]: pgmap v257: 65 pgs: 65 active+clean; 2.3 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 171 MiB/s rd, 210 MiB/s wr, 274 op/s 2024-02-16T22:19:10.484 INFO:tasks.workunit.client.1.smithi173.stdout:5/252: dread d8/f2e [0,4194304] 0 2024-02-16T22:19:10.486 INFO:tasks.workunit.client.1.smithi173.stdout:5/253: truncate d8/da/f45 3342382 0 2024-02-16T22:19:10.488 INFO:tasks.workunit.client.1.smithi173.stdout:3/235: rmdir d9/d1a/d2b/d45/d4b 0 2024-02-16T22:19:10.488 INFO:tasks.workunit.client.1.smithi173.stdout:3/236: dread - d9/d17/f54 zero size 2024-02-16T22:19:10.488 INFO:tasks.workunit.client.1.smithi173.stdout:8/351: dwrite dd/d7c/d7d/d22/d28/d40/f78 [0,4194304] 0 2024-02-16T22:19:10.488 INFO:tasks.workunit.client.1.smithi173.stdout:7/255: dwrite d1/d5/d13/d36/f4a [0,4194304] 0 2024-02-16T22:19:10.489 INFO:tasks.workunit.client.1.smithi173.stdout:1/294: dread db/d1c/d25/d28/f55 [0,4194304] 0 2024-02-16T22:19:10.489 INFO:tasks.workunit.client.1.smithi173.stdout:9/179: dwrite d1/f23 [0,4194304] 0 2024-02-16T22:19:10.489 INFO:tasks.workunit.client.1.smithi173.stdout:9/180: chown d1/f23 130437516 1 2024-02-16T22:19:10.491 INFO:tasks.workunit.client.1.smithi173.stdout:9/181: dread d1/d2/d10/f33 [0,4194304] 0 2024-02-16T22:19:10.491 INFO:tasks.workunit.client.1.smithi173.stdout:9/182: stat d1/d2/d10 0 2024-02-16T22:19:10.496 INFO:tasks.workunit.client.1.smithi173.stdout:8/352: mknod dd/d7c/d7d/d22/d2e/d41/c82 0 2024-02-16T22:19:10.497 INFO:tasks.workunit.client.1.smithi173.stdout:5/254: dread f7 [0,4194304] 0 2024-02-16T22:19:10.497 INFO:tasks.workunit.client.1.smithi173.stdout:7/256: symlink d1/d5/d13/d22/l4b 0 2024-02-16T22:19:10.504 INFO:tasks.workunit.client.1.smithi173.stdout:8/353: write dd/d7c/d7d/d22/d28/d40/d52/f54 [394123,115872] 0 2024-02-16T22:19:10.505 INFO:tasks.workunit.client.1.smithi173.stdout:8/354: read dd/f31 [408903,66443] 0 2024-02-16T22:19:10.507 INFO:tasks.workunit.client.1.smithi173.stdout:8/355: dread dd/d7c/d7d/d22/f37 [0,4194304] 0 2024-02-16T22:19:10.507 INFO:tasks.workunit.client.1.smithi173.stdout:3/237: dwrite d9/d17/f1c [0,4194304] 0 2024-02-16T22:19:10.512 INFO:tasks.workunit.client.1.smithi173.stdout:9/183: rename d1/d2/fd to d1/f39 0 2024-02-16T22:19:10.512 INFO:tasks.workunit.client.1.smithi173.stdout:9/184: fsync d1/f18 0 2024-02-16T22:19:10.513 INFO:tasks.workunit.client.1.smithi173.stdout:5/255: getdents d8 0 2024-02-16T22:19:10.513 INFO:tasks.workunit.client.1.smithi173.stdout:6/227: sync 2024-02-16T22:19:10.514 INFO:tasks.workunit.client.1.smithi173.stdout:8/356: dread dd/d7c/d7d/d22/d28/d40/f78 [0,4194304] 0 2024-02-16T22:19:10.515 INFO:tasks.workunit.client.1.smithi173.stdout:7/257: mkdir d1/d1d/d4c 0 2024-02-16T22:19:10.517 INFO:tasks.workunit.client.1.smithi173.stdout:3/238: rmdir d9/d17/d25 39 2024-02-16T22:19:10.517 INFO:tasks.workunit.client.1.smithi173.stdout:3/239: write d9/d17/d25/f4a [1164920,127942] 0 2024-02-16T22:19:10.517 INFO:tasks.workunit.client.1.smithi173.stdout:3/240: dread - d9/d1a/d2b/d4d/f52 zero size 2024-02-16T22:19:10.518 INFO:tasks.workunit.client.1.smithi173.stdout:1/295: getdents db/d1c/d5c 0 2024-02-16T22:19:10.519 INFO:tasks.workunit.client.1.smithi173.stdout:9/185: dread d1/f23 [0,4194304] 0 2024-02-16T22:19:10.519 INFO:tasks.workunit.client.1.smithi173.stdout:5/256: rename f4 to d8/da/d1f/d33/f4b 0 2024-02-16T22:19:10.519 INFO:tasks.workunit.client.1.smithi173.stdout:5/257: write d8/f14 [4626080,14394] 0 2024-02-16T22:19:10.521 INFO:tasks.workunit.client.1.smithi173.stdout:6/228: creat d0/db/d2e/d2f/d31/f55 x:0 0 0 2024-02-16T22:19:10.522 INFO:tasks.workunit.client.1.smithi173.stdout:8/357: symlink dd/d7c/d7d/l83 0 2024-02-16T22:19:10.527 INFO:tasks.workunit.client.1.smithi173.stdout:0/223: sync 2024-02-16T22:19:10.527 INFO:tasks.workunit.client.1.smithi173.stdout:4/204: sync 2024-02-16T22:19:10.527 INFO:tasks.workunit.client.1.smithi173.stdout:4/205: dread - d7/d28/d31/f37 zero size 2024-02-16T22:19:10.527 INFO:tasks.workunit.client.1.smithi173.stdout:0/224: write d0/d4/f2a [1180465,109059] 0 2024-02-16T22:19:10.528 INFO:tasks.workunit.client.1.smithi173.stdout:1/296: mknod db/d1c/d25/d45/c65 0 2024-02-16T22:19:10.528 INFO:tasks.workunit.client.1.smithi173.stdout:1/297: write db/d29/f53 [542574,41232] 0 2024-02-16T22:19:10.529 INFO:tasks.workunit.client.1.smithi173.stdout:1/298: read db/d1c/d25/d28/d3f/f4e [159644,98779] 0 2024-02-16T22:19:10.529 INFO:tasks.workunit.client.1.smithi173.stdout:9/186: mknod d1/d2/c3a 0 2024-02-16T22:19:10.534 INFO:tasks.workunit.client.1.smithi173.stdout:5/258: symlink d8/da/l4c 0 2024-02-16T22:19:10.537 INFO:tasks.workunit.client.1.smithi173.stdout:7/258: getdents d1/d1d 0 2024-02-16T22:19:10.539 INFO:tasks.workunit.client.1.smithi173.stdout:0/225: rename d0/d4/d14/l1b to d0/d4/d14/l47 0 2024-02-16T22:19:10.543 INFO:tasks.workunit.client.1.smithi173.stdout:1/299: truncate db/d1c/d25/d28/f3a 1488357 0 2024-02-16T22:19:10.543 INFO:tasks.workunit.client.1.smithi173.stdout:1/300: fsync db/d29/f36 0 2024-02-16T22:19:10.543 INFO:tasks.workunit.client.1.smithi173.stdout:3/241: dwrite d9/da/f27 [0,4194304] 0 2024-02-16T22:19:10.544 INFO:tasks.workunit.client.1.smithi173.stdout:3/242: write d9/f4c [94095,28835] 0 2024-02-16T22:19:10.544 INFO:tasks.workunit.client.1.smithi173.stdout:3/243: truncate d9/d17/d25/f46 752583 0 2024-02-16T22:19:10.544 INFO:tasks.workunit.client.1.smithi173.stdout:3/244: write d9/d1a/d2b/d4d/d5b/f5e [663705,51232] 0 2024-02-16T22:19:10.545 INFO:tasks.workunit.client.1.smithi173.stdout:5/259: rmdir d8/da/d1f/d30/d49 0 2024-02-16T22:19:10.546 INFO:tasks.workunit.client.1.smithi173.stdout:5/260: dread d8/da/d2d/d36/f3d [0,4194304] 0 2024-02-16T22:19:10.547 INFO:tasks.workunit.client.1.smithi173.stdout:5/261: write d8/fb [1148265,63121] 0 2024-02-16T22:19:10.547 INFO:tasks.workunit.client.1.smithi173.stdout:1/301: dread db/d29/f42 [0,4194304] 0 2024-02-16T22:19:10.549 INFO:tasks.workunit.client.1.smithi173.stdout:7/259: rename d1/d5/d10/d27/f3c to d1/d5/d13/d36/f4d 0 2024-02-16T22:19:10.549 INFO:tasks.workunit.client.1.smithi173.stdout:7/260: chown d1/d5/d13/d36/d49/c29 1010 1 2024-02-16T22:19:10.550 INFO:tasks.workunit.client.1.smithi173.stdout:0/226: symlink d0/l48 0 2024-02-16T22:19:10.550 INFO:tasks.workunit.client.1.smithi173.stdout:6/229: dwrite d0/db/f28 [0,4194304] 0 2024-02-16T22:19:10.550 INFO:tasks.workunit.client.1.smithi173.stdout:6/230: write d0/db/d2e/d2f/d31/f39 [49710,57946] 0 2024-02-16T22:19:10.550 INFO:tasks.workunit.client.1.smithi173.stdout:6/231: dread - d0/db/d2e/d2f/d31/f35 zero size 2024-02-16T22:19:10.551 INFO:tasks.workunit.client.1.smithi173.stdout:8/358: dwrite dd/d7c/d7d/d22/f37 [0,4194304] 0 2024-02-16T22:19:10.557 INFO:tasks.workunit.client.1.smithi173.stdout:4/206: dwrite d7/d12/d2d/f44 [0,4194304] 0 2024-02-16T22:19:10.559 INFO:tasks.workunit.client.1.smithi173.stdout:5/262: unlink d8/da/f1c 0 2024-02-16T22:19:10.560 INFO:tasks.workunit.client.1.smithi173.stdout:4/207: dread d7/d12/f19 [0,4194304] 0 2024-02-16T22:19:10.560 INFO:tasks.workunit.client.1.smithi173.stdout:4/208: getdents d7/d28/d14/d32/d45 0 2024-02-16T22:19:10.560 INFO:tasks.workunit.client.1.smithi173.stdout:1/302: link db/d1d/l3e db/d1c/d5c/l66 0 2024-02-16T22:19:10.560 INFO:tasks.workunit.client.1.smithi173.stdout:4/209: dread d7/d28/f1a [0,4194304] 0 2024-02-16T22:19:10.562 INFO:tasks.workunit.client.1.smithi173.stdout:7/261: creat d1/d1d/f4e x:0 0 0 2024-02-16T22:19:10.562 INFO:tasks.workunit.client.1.smithi173.stdout:7/262: fdatasync d1/d5/d10/f24 0 2024-02-16T22:19:10.564 INFO:tasks.workunit.client.1.smithi173.stdout:0/227: creat d0/d4/d14/d38/f49 x:0 0 0 2024-02-16T22:19:10.565 INFO:tasks.workunit.client.1.smithi173.stdout:7/263: write d1/d5/d10/f24 [494805,123945] 0 2024-02-16T22:19:10.568 INFO:tasks.workunit.client.1.smithi173.stdout:6/232: rename d0/f2d to d0/db/d2e/f56 0 2024-02-16T22:19:10.568 INFO:tasks.workunit.client.1.smithi173.stdout:6/233: chown d0/db/d2e/d2f/d31/f55 1680808949 1 2024-02-16T22:19:10.568 INFO:tasks.workunit.client.1.smithi173.stdout:6/234: creat d0/db/f57 x:0 0 0 2024-02-16T22:19:10.569 INFO:tasks.workunit.client.1.smithi173.stdout:8/359: creat dd/d7c/d7d/d22/d2e/d41/d6b/f84 x:0 0 0 2024-02-16T22:19:10.584 INFO:tasks.workunit.client.1.smithi173.stdout:5/263: mknod d8/da/d2d/d3a/c4d 0 2024-02-16T22:19:10.586 INFO:tasks.workunit.client.1.smithi173.stdout:4/210: truncate d7/fd 2201331 0 2024-02-16T22:19:10.586 INFO:tasks.workunit.client.1.smithi173.stdout:4/211: truncate d7/d28/d31/f3a 70768 0 2024-02-16T22:19:10.587 INFO:tasks.workunit.client.1.smithi173.stdout:0/228: mknod d0/d4/d33/c4a 0 2024-02-16T22:19:10.587 INFO:tasks.workunit.client.1.smithi173.stdout:0/229: dread - d0/d12/d15/f3a zero size 2024-02-16T22:19:10.588 INFO:tasks.workunit.client.1.smithi173.stdout:0/230: write d0/f11 [987234,69273] 0 2024-02-16T22:19:10.588 INFO:tasks.workunit.client.1.smithi173.stdout:1/303: rename db/d1c/d25/d28/f55 to db/d1c/d5c/f67 0 2024-02-16T22:19:10.588 INFO:tasks.workunit.client.1.smithi173.stdout:1/304: creat db/d1d/f68 x:0 0 0 2024-02-16T22:19:10.589 INFO:tasks.workunit.client.1.smithi173.stdout:1/305: write db/d1c/d5c/f63 [510507,118327] 0 2024-02-16T22:19:10.591 INFO:tasks.workunit.client.1.smithi173.stdout:6/235: rmdir d0/db/d2e/d2f/d31/d4a 0 2024-02-16T22:19:10.592 INFO:tasks.workunit.client.1.smithi173.stdout:8/360: creat dd/d7c/d7d/d58/f85 x:0 0 0 2024-02-16T22:19:10.593 INFO:tasks.workunit.client.1.smithi173.stdout:5/264: mknod d8/d27/d35/c4e 0 2024-02-16T22:19:10.593 INFO:tasks.workunit.client.1.smithi173.stdout:5/265: write d8/da/f23 [762295,97833] 0 2024-02-16T22:19:10.595 INFO:tasks.workunit.client.1.smithi173.stdout:4/212: mknod d7/d28/c4d 0 2024-02-16T22:19:10.595 INFO:tasks.workunit.client.1.smithi173.stdout:4/213: fsync d7/d12/f30 0 2024-02-16T22:19:10.596 INFO:tasks.workunit.client.1.smithi173.stdout:4/214: dread d7/d28/f1a [0,4194304] 0 2024-02-16T22:19:10.596 INFO:tasks.workunit.client.1.smithi173.stdout:0/231: dread d0/d4/f7 [0,4194304] 0 2024-02-16T22:19:10.598 INFO:tasks.workunit.client.1.smithi173.stdout:7/264: rename d1/d5/d13/l2d to d1/d5/d11/l4f 0 2024-02-16T22:19:10.598 INFO:tasks.workunit.client.1.smithi173.stdout:1/306: rename db/d29/d50 to db/d29/d50/d69 22 2024-02-16T22:19:10.598 INFO:tasks.workunit.client.1.smithi173.stdout:7/265: chown d1/d1d/f20 1675 1 2024-02-16T22:19:10.598 INFO:tasks.workunit.client.1.smithi173.stdout:1/307: write db/d1c/d25/d28/d3f/d4a/f54 [921997,41801] 0 2024-02-16T22:19:10.598 INFO:tasks.workunit.client.1.smithi173.stdout:1/308: readlink db/d1d/l58 0 2024-02-16T22:19:10.598 INFO:tasks.workunit.client.1.smithi173.stdout:0/232: dread d0/d4/d33/f3c [0,4194304] 0 2024-02-16T22:19:10.599 INFO:tasks.workunit.client.1.smithi173.stdout:6/236: link d0/fa d0/db/f58 0 2024-02-16T22:19:10.601 INFO:tasks.workunit.client.1.smithi173.stdout:5/266: mknod d8/d27/d2f/c4f 0 2024-02-16T22:19:10.604 INFO:tasks.workunit.client.1.smithi173.stdout:4/215: rmdir d7/d28/d31 39 2024-02-16T22:19:10.606 INFO:tasks.workunit.client.1.smithi173.stdout:7/266: mknod d1/d5/d10/c50 0 2024-02-16T22:19:10.606 INFO:tasks.workunit.client.1.smithi173.stdout:7/267: write d1/d1d/f20 [2234613,98102] 0 2024-02-16T22:19:10.609 INFO:tasks.workunit.client.1.smithi173.stdout:6/237: symlink d0/db/l59 0 2024-02-16T22:19:10.609 INFO:tasks.workunit.client.1.smithi173.stdout:0/233: getdents d0/d4/d14/d24/d32/d39 0 2024-02-16T22:19:10.609 INFO:tasks.workunit.client.1.smithi173.stdout:6/238: write d0/db/d2e/f37 [466322,58730] 0 2024-02-16T22:19:10.609 INFO:tasks.workunit.client.1.smithi173.stdout:6/239: chown d0/db/d2e/d2f/d31/d33/c53 591467 1 2024-02-16T22:19:10.611 INFO:tasks.workunit.client.1.smithi173.stdout:0/234: rename d0/d4/l40 to d0/d12/d15/d3d/l4b 0 2024-02-16T22:19:10.611 INFO:tasks.workunit.client.1.smithi173.stdout:0/235: chown d0/f11 197185723 1 2024-02-16T22:19:10.612 INFO:tasks.workunit.client.1.smithi173.stdout:6/240: chown d0/ce 9231 1 2024-02-16T22:19:10.613 INFO:tasks.workunit.client.1.smithi173.stdout:0/236: mknod d0/d4/d27/c4c 0 2024-02-16T22:19:10.614 INFO:tasks.workunit.client.1.smithi173.stdout:6/241: mknod d0/db/d4d/c5a 0 2024-02-16T22:19:10.615 INFO:tasks.workunit.client.1.smithi173.stdout:6/242: creat d0/f5b x:0 0 0 2024-02-16T22:19:10.619 INFO:tasks.workunit.client.1.smithi173.stdout:5/267: dread d8/f2e [4194304,4194304] 0 2024-02-16T22:19:10.631 INFO:tasks.workunit.client.1.smithi173.stdout:0/237: dread d0/d4/f18 [0,4194304] 0 2024-02-16T22:19:10.633 INFO:tasks.workunit.client.1.smithi173.stdout:0/238: unlink d0/d12/d15/f3a 0 2024-02-16T22:19:10.634 INFO:tasks.workunit.client.1.smithi173.stdout:0/239: write d0/d4/f8 [818162,120978] 0 2024-02-16T22:19:10.635 INFO:tasks.workunit.client.1.smithi173.stdout:1/309: dwrite db/d1c/d5c/f67 [4194304,4194304] 0 2024-02-16T22:19:10.635 INFO:tasks.workunit.client.1.smithi173.stdout:5/268: write d8/f29 [2412326,72153] 0 2024-02-16T22:19:10.635 INFO:tasks.workunit.client.1.smithi173.stdout:4/216: dwrite d7/d28/d14/f1f [0,4194304] 0 2024-02-16T22:19:10.637 INFO:tasks.workunit.client.1.smithi173.stdout:7/268: dwrite d1/d1d/f1e [4194304,4194304] 0 2024-02-16T22:19:10.637 INFO:tasks.workunit.client.1.smithi173.stdout:7/269: fsync d1/d5/d13/d36/d49/f35 0 2024-02-16T22:19:10.637 INFO:tasks.workunit.client.1.smithi173.stdout:8/361: dwrite dd/d7c/d7d/d22/d28/f3c [0,4194304] 0 2024-02-16T22:19:10.637 INFO:tasks.workunit.client.1.smithi173.stdout:8/362: creat dd/f86 x:0 0 0 2024-02-16T22:19:10.637 INFO:tasks.workunit.client.1.smithi173.stdout:8/363: chown f2 4017169 1 2024-02-16T22:19:10.637 INFO:tasks.workunit.client.1.smithi173.stdout:1/310: mknod db/d29/d50/c6a 0 2024-02-16T22:19:10.637 INFO:tasks.workunit.client.1.smithi173.stdout:1/311: write db/d1c/d25/f47 [143903,112210] 0 2024-02-16T22:19:10.640 INFO:tasks.workunit.client.1.smithi173.stdout:1/312: dread db/d1c/d25/d28/d3f/d4a/f54 [0,4194304] 0 2024-02-16T22:19:10.641 INFO:tasks.workunit.client.1.smithi173.stdout:4/217: rmdir d7/d28/d31/d33/d49 39 2024-02-16T22:19:10.641 INFO:tasks.workunit.client.1.smithi173.stdout:4/218: readlink d7/d28/l2c 0 2024-02-16T22:19:10.644 INFO:tasks.workunit.client.1.smithi173.stdout:0/240: dread d0/d4/d14/f23 [0,4194304] 0 2024-02-16T22:19:10.644 INFO:tasks.workunit.client.1.smithi173.stdout:0/241: dread - d0/d4/f3e zero size 2024-02-16T22:19:10.647 INFO:tasks.workunit.client.1.smithi173.stdout:7/270: truncate d1/d5/ff 1240465 0 2024-02-16T22:19:10.649 INFO:tasks.workunit.client.1.smithi173.stdout:5/269: dwrite d8/fd [0,4194304] 0 2024-02-16T22:19:10.652 INFO:tasks.workunit.client.1.smithi173.stdout:1/313: creat db/d1c/f6b x:0 0 0 2024-02-16T22:19:10.652 INFO:tasks.workunit.client.1.smithi173.stdout:1/314: creat db/d1c/d25/d28/f6c x:0 0 0 2024-02-16T22:19:10.653 INFO:tasks.workunit.client.1.smithi173.stdout:4/219: mkdir d7/d28/d14/d32/d4e 0 2024-02-16T22:19:10.654 INFO:tasks.workunit.client.1.smithi173.stdout:0/242: creat d0/d12/f4d x:0 0 0 2024-02-16T22:19:10.656 INFO:tasks.workunit.client.1.smithi173.stdout:7/271: unlink d1/d5/fe 0 2024-02-16T22:19:10.657 INFO:tasks.workunit.client.1.smithi173.stdout:0/243: dread d0/d4/f2a [0,4194304] 0 2024-02-16T22:19:10.661 INFO:tasks.workunit.client.1.smithi173.stdout:5/270: mkdir d8/da/d2d/d36/d50 0 2024-02-16T22:19:10.664 INFO:tasks.workunit.client.1.smithi173.stdout:1/315: rename db/f19 to db/d1c/d5c/f6d 0 2024-02-16T22:19:10.664 INFO:tasks.workunit.client.1.smithi173.stdout:4/220: truncate d7/df/f1b 3644021 0 2024-02-16T22:19:10.666 INFO:tasks.workunit.client.1.smithi173.stdout:7/272: symlink d1/d5/d13/d36/d49/l51 0 2024-02-16T22:19:10.668 INFO:tasks.workunit.client.1.smithi173.stdout:5/271: creat d8/da/d1f/f51 x:0 0 0 2024-02-16T22:19:10.670 INFO:tasks.workunit.client.1.smithi173.stdout:1/316: rename db/l17 to db/d1c/l6e 0 2024-02-16T22:19:10.671 INFO:tasks.workunit.client.1.smithi173.stdout:7/273: creat d1/d5/d13/d36/f52 x:0 0 0 2024-02-16T22:19:10.671 INFO:tasks.workunit.client.1.smithi173.stdout:0/244: getdents d0 0 2024-02-16T22:19:10.672 INFO:tasks.workunit.client.1.smithi173.stdout:5/272: creat d8/da/d1b/f52 x:0 0 0 2024-02-16T22:19:10.675 INFO:tasks.workunit.client.1.smithi173.stdout:0/245: mknod d0/d12/c4e 0 2024-02-16T22:19:10.676 INFO:tasks.workunit.client.1.smithi173.stdout:5/273: unlink d8/da/c21 0 2024-02-16T22:19:10.678 INFO:tasks.workunit.client.1.smithi173.stdout:7/274: dread d1/d1d/f32 [0,4194304] 0 2024-02-16T22:19:10.678 INFO:tasks.workunit.client.1.smithi173.stdout:7/275: readlink d1/d5/d13/d36/d49/l43 0 2024-02-16T22:19:10.678 INFO:tasks.workunit.client.1.smithi173.stdout:0/246: mkdir d0/d12/d15/d4f 0 2024-02-16T22:19:10.679 INFO:tasks.workunit.client.1.smithi173.stdout:7/276: truncate d1/d5/d13/d36/f4a 3363549 0 2024-02-16T22:19:10.680 INFO:tasks.workunit.client.1.smithi173.stdout:0/247: mkdir d0/d4/d14/d50 0 2024-02-16T22:19:10.680 INFO:tasks.workunit.client.1.smithi173.stdout:1/317: dread f2 [4194304,4194304] 0 2024-02-16T22:19:10.682 INFO:tasks.workunit.client.1.smithi173.stdout:1/318: write db/d1c/d25/d28/d3f/d4a/f54 [330554,52707] 0 2024-02-16T22:19:10.682 INFO:tasks.workunit.client.1.smithi173.stdout:1/319: chown db/d1c/d25/d28/f3a 1466800 1 2024-02-16T22:19:10.684 INFO:tasks.workunit.client.1.smithi173.stdout:1/320: getdents db/d1c/d25/d28/d3f/d4a 0 2024-02-16T22:19:10.685 INFO:tasks.workunit.client.1.smithi173.stdout:1/321: write db/d1d/f1e [762941,47122] 0 2024-02-16T22:19:10.687 INFO:tasks.workunit.client.1.smithi173.stdout:1/322: mknod db/d1c/d25/d28/d3f/d4a/c6f 0 2024-02-16T22:19:10.687 INFO:tasks.workunit.client.1.smithi173.stdout:1/323: dread - db/f2b zero size 2024-02-16T22:19:10.689 INFO:tasks.workunit.client.1.smithi173.stdout:1/324: creat db/d29/d50/f70 x:0 0 0 2024-02-16T22:19:10.690 INFO:tasks.workunit.client.1.smithi173.stdout:1/325: link db/d1c/f37 db/d29/d57/f71 0 2024-02-16T22:19:10.699 INFO:tasks.workunit.client.1.smithi173.stdout:5/274: dwrite d8/da/fc [0,4194304] 0 2024-02-16T22:19:10.703 INFO:tasks.workunit.client.1.smithi173.stdout:2/330: sync 2024-02-16T22:19:10.703 INFO:tasks.workunit.client.1.smithi173.stdout:2/331: chown d2/d4/d8/d30/f45 5 1 2024-02-16T22:19:10.705 INFO:tasks.workunit.client.1.smithi173.stdout:4/221: rename d7/d28/d14/d32 to d7/df/d4f 0 2024-02-16T22:19:10.705 INFO:tasks.workunit.client.1.smithi173.stdout:4/222: chown d7/d28/l2c 11 1 2024-02-16T22:19:10.705 INFO:tasks.workunit.client.1.smithi173.stdout:4/223: chown d7/d28/d31/c3e 15000495 1 2024-02-16T22:19:10.708 INFO:tasks.workunit.client.1.smithi173.stdout:1/326: dwrite db/f18 [0,4194304] 0 2024-02-16T22:19:10.708 INFO:tasks.workunit.client.1.smithi173.stdout:1/327: creat db/d30/f72 x:0 0 0 2024-02-16T22:19:10.712 INFO:tasks.workunit.client.1.smithi173.stdout:7/277: rename d1/d5/d10 to d1/d5/d13/d22/d53 0 2024-02-16T22:19:10.716 INFO:tasks.workunit.client.1.smithi173.stdout:1/328: mkdir db/d29/d57/d73 0 2024-02-16T22:19:10.718 INFO:tasks.workunit.client.1.smithi173.stdout:5/275: rename d8/c16 to d8/d27/d2f/c53 0 2024-02-16T22:19:10.721 INFO:tasks.workunit.client.1.smithi173.stdout:7/278: mkdir d1/d5/d54 0 2024-02-16T22:19:10.721 INFO:tasks.workunit.client.1.smithi173.stdout:7/279: creat d1/d5/d13/d36/f55 x:0 0 0 2024-02-16T22:19:10.722 INFO:tasks.workunit.client.1.smithi173.stdout:1/329: rmdir db/d1c/d25/d28/d3f/d4a 39 2024-02-16T22:19:10.725 INFO:tasks.workunit.client.1.smithi173.stdout:5/276: truncate d8/da/d1f/d33/f3f 695235 0 2024-02-16T22:19:10.726 INFO:tasks.workunit.client.1.smithi173.stdout:5/277: dread d8/da/d1b/f3b [0,4194304] 0 2024-02-16T22:19:10.730 INFO:tasks.workunit.client.1.smithi173.stdout:1/330: creat db/d1c/d5c/f74 x:0 0 0 2024-02-16T22:19:10.730 INFO:tasks.workunit.client.1.smithi173.stdout:2/332: dwrite d2/d4/f7 [0,4194304] 0 2024-02-16T22:19:10.730 INFO:tasks.workunit.client.1.smithi173.stdout:2/333: write d2/dc/d19/d1a/f46 [912047,83913] 0 2024-02-16T22:19:10.733 INFO:tasks.workunit.client.1.smithi173.stdout:1/331: dread db/d29/f53 [0,4194304] 0 2024-02-16T22:19:10.733 INFO:tasks.workunit.client.1.smithi173.stdout:1/332: chown db/c1a 22833 1 2024-02-16T22:19:10.741 INFO:tasks.workunit.client.1.smithi173.stdout:5/278: dwrite d8/da/d1f/f51 [0,4194304] 0 2024-02-16T22:19:10.741 INFO:tasks.workunit.client.1.smithi173.stdout:5/279: fdatasync d8/da/ff 0 2024-02-16T22:19:10.745 INFO:tasks.workunit.client.1.smithi173.stdout:2/334: creat d2/d4/d8/d30/d4d/f75 x:0 0 0 2024-02-16T22:19:10.748 INFO:tasks.workunit.client.1.smithi173.stdout:1/333: link db/f1b db/f75 0 2024-02-16T22:19:10.755 INFO:tasks.workunit.client.1.smithi173.stdout:1/334: symlink db/d1c/d5c/l76 0 2024-02-16T22:19:10.755 INFO:tasks.workunit.client.1.smithi173.stdout:1/335: write db/d1c/f37 [1958457,111467] 0 2024-02-16T22:19:10.757 INFO:tasks.workunit.client.1.smithi173.stdout:5/280: getdents d8/da/d1b 0 2024-02-16T22:19:10.757 INFO:tasks.workunit.client.1.smithi173.stdout:5/281: fdatasync d8/da/d1f/d30/d37/f4a 0 2024-02-16T22:19:10.762 INFO:tasks.workunit.client.1.smithi173.stdout:5/282: mknod d8/da/d2d/d3a/c54 0 2024-02-16T22:19:10.768 INFO:tasks.workunit.client.1.smithi173.stdout:1/336: dread db/d29/f36 [0,4194304] 0 2024-02-16T22:19:10.773 INFO:tasks.workunit.client.1.smithi173.stdout:1/337: creat db/d1c/d25/d28/d3f/f77 x:0 0 0 2024-02-16T22:19:10.776 INFO:tasks.workunit.client.1.smithi173.stdout:5/283: read d8/da/f45 [672270,38799] 0 2024-02-16T22:19:10.779 INFO:tasks.workunit.client.1.smithi173.stdout:5/284: rename d8/f14 to d8/da/d2d/d36/f55 0 2024-02-16T22:19:10.779 INFO:tasks.workunit.client.1.smithi173.stdout:5/285: chown d8/da/d2d/d36/f40 448 1 2024-02-16T22:19:10.795 INFO:tasks.workunit.client.1.smithi173.stdout:5/286: dread d8/da/d1f/d33/f3e [0,4194304] 0 2024-02-16T22:19:10.795 INFO:tasks.workunit.client.1.smithi173.stdout:5/287: write d8/f2e [2740352,91084] 0 2024-02-16T22:19:10.795 INFO:tasks.workunit.client.1.smithi173.stdout:5/288: chown d8/da/d2d/d3a/c54 922 1 2024-02-16T22:19:10.795 INFO:tasks.workunit.client.1.smithi173.stdout:5/289: chown d8/da/d1f/d30/d37/f4a 296 1 2024-02-16T22:19:10.796 INFO:tasks.workunit.client.1.smithi173.stdout:5/290: getdents d8/d27/d35 0 2024-02-16T22:19:10.798 INFO:tasks.workunit.client.1.smithi173.stdout:1/338: dwrite db/ff [0,4194304] 0 2024-02-16T22:19:10.805 INFO:tasks.workunit.client.1.smithi173.stdout:1/339: mknod db/d1c/d25/d28/c78 0 2024-02-16T22:19:10.806 INFO:tasks.workunit.client.1.smithi173.stdout:1/340: mknod db/d5f/c79 0 2024-02-16T22:19:10.806 INFO:tasks.workunit.client.1.smithi173.stdout:1/341: truncate db/f24 233537 0 2024-02-16T22:19:10.809 INFO:tasks.workunit.client.1.smithi173.stdout:1/342: rename db/d1d/f68 to db/d1c/d25/d28/f7a 0 2024-02-16T22:19:10.809 INFO:tasks.workunit.client.1.smithi173.stdout:1/343: creat db/d1c/d25/d28/f7b x:0 0 0 2024-02-16T22:19:10.811 INFO:tasks.workunit.client.1.smithi173.stdout:5/291: dread d8/da/d2d/d36/f43 [0,4194304] 0 2024-02-16T22:19:10.825 INFO:tasks.workunit.client.1.smithi173.stdout:9/187: sync 2024-02-16T22:19:10.825 INFO:tasks.workunit.client.1.smithi173.stdout:3/245: sync 2024-02-16T22:19:10.827 INFO:tasks.workunit.client.1.smithi173.stdout:9/188: getdents d1/d2/d10 0 2024-02-16T22:19:10.829 INFO:tasks.workunit.client.1.smithi173.stdout:9/189: mkdir d1/d2/d1a/d2f/d3b 0 2024-02-16T22:19:10.829 INFO:tasks.workunit.client.1.smithi173.stdout:9/190: fdatasync d1/f23 0 2024-02-16T22:19:10.829 INFO:tasks.workunit.client.1.smithi173.stdout:1/344: dwrite db/d1c/d25/d28/d3f/f4e [0,4194304] 0 2024-02-16T22:19:10.833 INFO:tasks.workunit.client.1.smithi173.stdout:5/292: dread d8/da/d1f/d33/f3f [0,4194304] 0 2024-02-16T22:19:10.834 INFO:tasks.workunit.client.1.smithi173.stdout:5/293: dread d8/da/d1b/f3b [0,4194304] 0 2024-02-16T22:19:10.834 INFO:tasks.workunit.client.1.smithi173.stdout:5/294: write d8/fb [182033,12092] 0 2024-02-16T22:19:10.834 INFO:tasks.workunit.client.1.smithi173.stdout:3/246: write f7 [2183500,56312] 0 2024-02-16T22:19:10.834 INFO:tasks.workunit.client.1.smithi173.stdout:3/247: readlink d9/d18/l30 0 2024-02-16T22:19:10.842 INFO:tasks.workunit.client.1.smithi173.stdout:5/295: mkdir d8/da/d2d/d56 0 2024-02-16T22:19:10.844 INFO:tasks.workunit.client.1.smithi173.stdout:3/248: getdents d9/d1a/d2b 0 2024-02-16T22:19:10.844 INFO:tasks.workunit.client.1.smithi173.stdout:3/249: stat d9/da/f15 0 2024-02-16T22:19:10.845 INFO:tasks.workunit.client.1.smithi173.stdout:5/296: dread d8/da/d1f/d33/f3f [0,4194304] 0 2024-02-16T22:19:10.847 INFO:tasks.workunit.client.1.smithi173.stdout:5/297: mkdir d8/da/d1b/d57 0 2024-02-16T22:19:10.852 INFO:tasks.workunit.client.1.smithi173.stdout:6/243: sync 2024-02-16T22:19:10.852 INFO:tasks.workunit.client.1.smithi173.stdout:6/244: chown d0/db/l40 477076757 1 2024-02-16T22:19:10.852 INFO:tasks.workunit.client.1.smithi173.stdout:6/245: truncate d0/db/d2e/f46 252343 0 2024-02-16T22:19:10.852 INFO:tasks.workunit.client.1.smithi173.stdout:5/298: unlink d8/l2c 0 2024-02-16T22:19:10.855 INFO:tasks.workunit.client.1.smithi173.stdout:1/345: dwrite db/d30/f72 [0,4194304] 0 2024-02-16T22:19:10.855 INFO:tasks.workunit.client.1.smithi173.stdout:1/346: chown db/c16 2 1 2024-02-16T22:19:10.855 INFO:tasks.workunit.client.1.smithi173.stdout:1/347: write db/d30/f48 [497471,52193] 0 2024-02-16T22:19:10.859 INFO:tasks.workunit.client.1.smithi173.stdout:9/191: rmdir d1 39 2024-02-16T22:19:10.862 INFO:tasks.workunit.client.1.smithi173.stdout:1/348: mkdir db/d1d/d7c 0 2024-02-16T22:19:10.862 INFO:tasks.workunit.client.1.smithi173.stdout:1/349: write db/d1c/d25/d28/f6c [583932,103930] 0 2024-02-16T22:19:10.862 INFO:tasks.workunit.client.1.smithi173.stdout:1/350: chown db/f59 413 1 2024-02-16T22:19:10.863 INFO:tasks.workunit.client.1.smithi173.stdout:1/351: symlink db/d29/d57/d73/l7d 0 2024-02-16T22:19:10.864 INFO:tasks.workunit.client.1.smithi173.stdout:1/352: getdents db/d29/d57 0 2024-02-16T22:19:10.864 INFO:tasks.workunit.client.1.smithi173.stdout:1/353: readlink db/d29/d57/d73/l7d 0 2024-02-16T22:19:10.865 INFO:tasks.workunit.client.1.smithi173.stdout:5/299: dread d8/da/ff [0,4194304] 0 2024-02-16T22:19:10.867 INFO:tasks.workunit.client.1.smithi173.stdout:1/354: rename db/c23 to db/d1d/c7e 0 2024-02-16T22:19:10.867 INFO:tasks.workunit.client.1.smithi173.stdout:1/355: fsync db/d1c/d25/d28/f2f 0 2024-02-16T22:19:10.867 INFO:tasks.workunit.client.1.smithi173.stdout:1/356: readlink db/d1c/l6e 0 2024-02-16T22:19:10.869 INFO:tasks.workunit.client.1.smithi173.stdout:1/357: rename db/d1d/d7c to db/d1c/d7f 0 2024-02-16T22:19:10.869 INFO:tasks.workunit.client.1.smithi173.stdout:1/358: creat db/d1d/f80 x:0 0 0 2024-02-16T22:19:10.870 INFO:tasks.workunit.client.1.smithi173.stdout:5/300: getdents d8/d27/d28 0 2024-02-16T22:19:10.871 INFO:tasks.workunit.client.1.smithi173.stdout:6/246: dwrite d0/f5b [0,4194304] 0 2024-02-16T22:19:10.873 INFO:tasks.workunit.client.1.smithi173.stdout:1/359: truncate db/f15 1144119 0 2024-02-16T22:19:10.878 INFO:tasks.workunit.client.1.smithi173.stdout:5/301: mkdir d8/d27/d2f/d58 0 2024-02-16T22:19:10.878 INFO:tasks.workunit.client.1.smithi173.stdout:5/302: readlink d8/d27/d28/l48 0 2024-02-16T22:19:10.884 INFO:tasks.workunit.client.1.smithi173.stdout:9/192: dwrite d1/d2/d1a/f28 [0,4194304] 0 2024-02-16T22:19:10.886 INFO:tasks.workunit.client.1.smithi173.stdout:1/360: read db/ff [2377653,75837] 0 2024-02-16T22:19:10.887 INFO:tasks.workunit.client.1.smithi173.stdout:6/247: rename d0/db/f25 to d0/f5c 0 2024-02-16T22:19:10.887 INFO:tasks.workunit.client.1.smithi173.stdout:6/248: fsync d0/db/d2e/d2f/d31/f35 0 2024-02-16T22:19:10.887 INFO:tasks.workunit.client.1.smithi173.stdout:5/303: write d8/da/d1f/f51 [3669465,40446] 0 2024-02-16T22:19:10.895 INFO:tasks.workunit.client.1.smithi173.stdout:6/249: mkdir d0/db/d2e/d2f/d31/d5d 0 2024-02-16T22:19:10.903 INFO:tasks.workunit.client.1.smithi173.stdout:5/304: getdents d8/da/d1f/d30 0 2024-02-16T22:19:10.903 INFO:tasks.workunit.client.1.smithi173.stdout:5/305: stat d8/da/f45 0 2024-02-16T22:19:10.903 INFO:tasks.workunit.client.1.smithi173.stdout:5/306: chown d8/d27/d35/c4e 6292742 1 2024-02-16T22:19:10.903 INFO:tasks.workunit.client.1.smithi173.stdout:6/250: dread - d0/db/d2e/d2f/f4b zero size 2024-02-16T22:19:10.903 INFO:tasks.workunit.client.1.smithi173.stdout:6/251: creat d0/db/d2e/d2f/d31/f5e x:0 0 0 2024-02-16T22:19:10.907 INFO:tasks.workunit.client.1.smithi173.stdout:5/307: creat d8/da/d1f/d30/f59 x:0 0 0 2024-02-16T22:19:10.907 INFO:tasks.workunit.client.1.smithi173.stdout:5/308: getdents d8/da/d2d/d56 0 2024-02-16T22:19:10.907 INFO:tasks.workunit.client.1.smithi173.stdout:5/309: stat d8/da 0 2024-02-16T22:19:10.919 INFO:tasks.workunit.client.1.smithi173.stdout:6/252: write d0/db/f1a [4093114,83431] 0 2024-02-16T22:19:10.919 INFO:tasks.workunit.client.1.smithi173.stdout:6/253: dread - d0/db/d2e/d2f/f4b zero size 2024-02-16T22:19:10.919 INFO:tasks.workunit.client.1.smithi173.stdout:6/254: chown d0/db/d2e/f52 0 1 2024-02-16T22:19:10.919 INFO:tasks.workunit.client.1.smithi173.stdout:6/255: write d0/db/f58 [4143119,104952] 0 2024-02-16T22:19:10.931 INFO:tasks.workunit.client.1.smithi173.stdout:6/256: dread d0/db/f12 [0,4194304] 0 2024-02-16T22:19:10.933 INFO:tasks.workunit.client.1.smithi173.stdout:9/193: dwrite d1/d2/d1a/d1f/f36 [0,4194304] 0 2024-02-16T22:19:10.934 INFO:tasks.workunit.client.1.smithi173.stdout:1/361: dwrite db/d1d/f33 [0,4194304] 0 2024-02-16T22:19:10.934 INFO:tasks.workunit.client.1.smithi173.stdout:5/310: dwrite d8/da/d1f/d30/d37/f4a [0,4194304] 0 2024-02-16T22:19:10.934 INFO:tasks.workunit.client.1.smithi173.stdout:6/257: fdatasync d0/db/f58 0 2024-02-16T22:19:10.942 INFO:tasks.workunit.client.1.smithi173.stdout:9/194: write d1/f23 [1931103,114019] 0 2024-02-16T22:19:10.945 INFO:tasks.workunit.client.1.smithi173.stdout:6/258: write d0/f1e [498124,114217] 0 2024-02-16T22:19:10.945 INFO:tasks.workunit.client.1.smithi173.stdout:1/362: mknod db/d1c/d25/d28/d3f/c81 0 2024-02-16T22:19:10.945 INFO:tasks.workunit.client.1.smithi173.stdout:1/363: chown db/d1c/d25/d45 1031158 1 2024-02-16T22:19:10.945 INFO:tasks.workunit.client.1.smithi173.stdout:1/364: stat db/d1d/l58 0 2024-02-16T22:19:10.950 INFO:tasks.workunit.client.1.smithi173.stdout:9/195: getdents d1/d2/d1a/d1f 0 2024-02-16T22:19:10.950 INFO:tasks.workunit.client.1.smithi173.stdout:9/196: chown d1/d2/d1a/c25 115 1 2024-02-16T22:19:10.950 INFO:tasks.workunit.client.1.smithi173.stdout:9/197: truncate d1/f23 4848588 0 2024-02-16T22:19:10.950 INFO:tasks.workunit.client.1.smithi173.stdout:9/198: chown d1/d2/d1a/l32 130850 1 2024-02-16T22:19:10.950 INFO:tasks.workunit.client.1.smithi173.stdout:9/199: read f0 [2213259,89287] 0 2024-02-16T22:19:10.952 INFO:tasks.workunit.client.1.smithi173.stdout:6/259: creat d0/db/d4d/f5f x:0 0 0 2024-02-16T22:19:10.953 INFO:tasks.workunit.client.1.smithi173.stdout:1/365: creat db/d1c/d7f/f82 x:0 0 0 2024-02-16T22:19:10.954 INFO:tasks.workunit.client.1.smithi173.stdout:1/366: readlink db/d1c/l2a 0 2024-02-16T22:19:10.954 INFO:tasks.workunit.client.1.smithi173.stdout:1/367: write db/d29/d57/f71 [3091155,67110] 0 2024-02-16T22:19:10.954 INFO:tasks.workunit.client.1.smithi173.stdout:1/368: chown db/d1c/d5c/l66 2707 1 2024-02-16T22:19:10.956 INFO:tasks.workunit.client.1.smithi173.stdout:5/311: rmdir d8/da 39 2024-02-16T22:19:10.958 INFO:tasks.workunit.client.1.smithi173.stdout:9/200: link d1/l2d d1/d2/d1a/d2f/d3b/l3c 0 2024-02-16T22:19:10.958 INFO:tasks.workunit.client.1.smithi173.stdout:9/201: write d1/d2/d1a/d1f/f29 [12122,97485] 0 2024-02-16T22:19:10.958 INFO:tasks.workunit.client.1.smithi173.stdout:9/202: truncate d1/d2/d1a/d1f/f36 5131098 0 2024-02-16T22:19:10.958 INFO:tasks.workunit.client.1.smithi173.stdout:6/260: mknod d0/db/d2e/d2f/d31/d5d/c60 0 2024-02-16T22:19:10.960 INFO:tasks.workunit.client.1.smithi173.stdout:8/364: sync 2024-02-16T22:19:10.960 INFO:tasks.workunit.client.1.smithi173.stdout:7/280: sync 2024-02-16T22:19:10.960 INFO:tasks.workunit.client.1.smithi173.stdout:3/250: sync 2024-02-16T22:19:10.960 INFO:tasks.workunit.client.1.smithi173.stdout:2/335: sync 2024-02-16T22:19:10.960 INFO:tasks.workunit.client.1.smithi173.stdout:0/248: sync 2024-02-16T22:19:10.960 INFO:tasks.workunit.client.1.smithi173.stdout:4/224: sync 2024-02-16T22:19:10.960 INFO:tasks.workunit.client.1.smithi173.stdout:2/336: readlink d2/l4b 0 2024-02-16T22:19:10.960 INFO:tasks.workunit.client.1.smithi173.stdout:8/365: write dd/d7c/d7d/f5b [1019124,42045] 0 2024-02-16T22:19:10.960 INFO:tasks.workunit.client.1.smithi173.stdout:8/366: readlink dd/d7c/d7d/d22/d2e/d41/l68 0 2024-02-16T22:19:10.960 INFO:tasks.workunit.client.1.smithi173.stdout:3/251: write d9/d17/d25/f50 [10251,50275] 0 2024-02-16T22:19:10.960 INFO:tasks.workunit.client.1.smithi173.stdout:8/367: fdatasync dd/d7c/d7d/f2c 0 2024-02-16T22:19:10.960 INFO:tasks.workunit.client.1.smithi173.stdout:8/368: chown dd/f86 1 1 2024-02-16T22:19:10.960 INFO:tasks.workunit.client.1.smithi173.stdout:3/252: truncate d9/d17/d1d/f38 479672 0 2024-02-16T22:19:10.961 INFO:tasks.workunit.client.1.smithi173.stdout:5/312: link d8/da/d1b/f52 d8/da/d1f/d33/f5a 0 2024-02-16T22:19:10.961 INFO:tasks.workunit.client.1.smithi173.stdout:6/261: dread - d0/db/d2e/d2f/f4c zero size 2024-02-16T22:19:10.963 INFO:tasks.workunit.client.1.smithi173.stdout:8/369: mkdir dd/d7c/d87 0 2024-02-16T22:19:10.963 INFO:tasks.workunit.client.1.smithi173.stdout:8/370: chown dd/d7c/d7d/d22/d2e/d41/d6b 6568699 1 2024-02-16T22:19:10.963 INFO:tasks.workunit.client.1.smithi173.stdout:8/371: read - dd/d7c/d7d/d22/d2e/f7b zero size 2024-02-16T22:19:10.963 INFO:tasks.workunit.client.1.smithi173.stdout:5/313: creat d8/d27/d28/f5b x:0 0 0 2024-02-16T22:19:10.963 INFO:tasks.workunit.client.1.smithi173.stdout:7/281: write d1/d1d/f32 [3222781,46232] 0 2024-02-16T22:19:10.963 INFO:tasks.workunit.client.1.smithi173.stdout:7/282: truncate d1/d5/d13/d36/f4d 879474 0 2024-02-16T22:19:10.964 INFO:tasks.workunit.client.1.smithi173.stdout:7/283: stat d1/d5/d13/d22/d53/f24 0 2024-02-16T22:19:10.965 INFO:tasks.workunit.client.1.smithi173.stdout:6/262: mkdir d0/db/d2e/d61 0 2024-02-16T22:19:10.965 INFO:tasks.workunit.client.1.smithi173.stdout:2/337: getdents d2/dc/d19/d1a 0 2024-02-16T22:19:10.965 INFO:tasks.workunit.client.1.smithi173.stdout:2/338: truncate d2/dc/d19/d1a/f5f 421463 0 2024-02-16T22:19:10.965 INFO:tasks.workunit.client.1.smithi173.stdout:2/339: creat d2/d10/d62/f76 x:0 0 0 2024-02-16T22:19:10.965 INFO:tasks.workunit.client.1.smithi173.stdout:1/369: write db/d30/f52 [3578866,51014] 0 2024-02-16T22:19:10.967 INFO:tasks.workunit.client.1.smithi173.stdout:5/314: rename d8/d27/d35/l46 to d8/da/d2d/d56/l5c 0 2024-02-16T22:19:10.972 INFO:tasks.workunit.client.1.smithi173.stdout:6/263: link d0/fd d0/db/d2e/d2f/d31/f62 0 2024-02-16T22:19:10.972 INFO:tasks.workunit.client.1.smithi173.stdout:0/249: dread d0/f10 [0,4194304] 0 2024-02-16T22:19:10.972 INFO:tasks.workunit.client.1.smithi173.stdout:9/203: unlink d1/l1b 0 2024-02-16T22:19:10.972 INFO:tasks.workunit.client.1.smithi173.stdout:9/204: fsync d1/d2/d10/f11 0 2024-02-16T22:19:10.972 INFO:tasks.workunit.client.1.smithi173.stdout:0/250: write d0/d12/f4d [786948,10644] 0 2024-02-16T22:19:10.972 INFO:tasks.workunit.client.1.smithi173.stdout:2/340: unlink d2/f28 0 2024-02-16T22:19:10.974 INFO:tasks.workunit.client.1.smithi173.stdout:1/370: mkdir db/d29/d83 0 2024-02-16T22:19:10.975 INFO:tasks.workunit.client.1.smithi173.stdout:1/371: dread db/d1d/f20 [0,4194304] 0 2024-02-16T22:19:10.976 INFO:tasks.workunit.client.1.smithi173.stdout:1/372: read db/ff [3462694,117056] 0 2024-02-16T22:19:10.976 INFO:tasks.workunit.client.1.smithi173.stdout:1/373: write db/d1c/d25/d28/f2f [1783092,2099] 0 2024-02-16T22:19:10.976 INFO:tasks.workunit.client.1.smithi173.stdout:1/374: creat db/d1d/f84 x:0 0 0 2024-02-16T22:19:10.976 INFO:tasks.workunit.client.1.smithi173.stdout:5/315: symlink d8/da/d2d/d3a/l5d 0 2024-02-16T22:19:10.978 INFO:tasks.workunit.client.1.smithi173.stdout:9/205: mknod d1/d2/d1a/d2f/d3b/c3d 0 2024-02-16T22:19:10.980 INFO:tasks.workunit.client.1.smithi173.stdout:2/341: symlink d2/dc/l77 0 2024-02-16T22:19:10.984 INFO:tasks.workunit.client.1.smithi173.stdout:1/375: mkdir db/d29/d50/d85 0 2024-02-16T22:19:10.985 INFO:tasks.workunit.client.1.smithi173.stdout:6/264: mknod d0/c63 0 2024-02-16T22:19:10.986 INFO:tasks.workunit.client.1.smithi173.stdout:9/206: mkdir d1/d2/d1a/d3e 0 2024-02-16T22:19:10.986 INFO:tasks.workunit.client.1.smithi173.stdout:0/251: getdents d0/d12 0 2024-02-16T22:19:10.988 INFO:tasks.workunit.client.1.smithi173.stdout:9/207: rename d1/d2/d1a/d1f/f36 to d1/d2/d10/f3f 0 2024-02-16T22:19:10.990 INFO:tasks.workunit.client.1.smithi173.stdout:0/252: link d0/d12/d15/d3d/l4b d0/d4/d33/l51 0 2024-02-16T22:19:10.991 INFO:tasks.workunit.client.1.smithi173.stdout:9/208: mknod d1/d2/d1a/d2f/d3b/c40 0 2024-02-16T22:19:10.992 INFO:tasks.workunit.client.1.smithi173.stdout:0/253: unlink d0/d4/f26 0 2024-02-16T22:19:10.994 INFO:tasks.workunit.client.1.smithi173.stdout:9/209: mknod d1/c41 0 2024-02-16T22:19:11.000 INFO:tasks.workunit.client.1.smithi173.stdout:9/210: dread d1/d2/d1a/f2b [0,4194304] 0 2024-02-16T22:19:11.001 INFO:tasks.workunit.client.1.smithi173.stdout:2/342: dread d2/f3c [0,4194304] 0 2024-02-16T22:19:11.001 INFO:tasks.workunit.client.1.smithi173.stdout:9/211: truncate f0 3431053 0 2024-02-16T22:19:11.001 INFO:tasks.workunit.client.1.smithi173.stdout:2/343: dread d2/dc/d19/d1a/f5f [0,4194304] 0 2024-02-16T22:19:11.003 INFO:tasks.workunit.client.1.smithi173.stdout:9/212: symlink d1/d2/d1a/l42 0 2024-02-16T22:19:11.006 INFO:tasks.workunit.client.1.smithi173.stdout:2/344: truncate d2/dc/d19/d1a/f26 159620 0 2024-02-16T22:19:11.006 INFO:tasks.workunit.client.1.smithi173.stdout:2/345: write d2/d4/d8/d30/f37 [1684630,7281] 0 2024-02-16T22:19:11.006 INFO:tasks.workunit.client.1.smithi173.stdout:2/346: write d2/f2e [4959004,67637] 0 2024-02-16T22:19:11.006 INFO:tasks.workunit.client.1.smithi173.stdout:2/347: dread - d2/dc/f2b zero size 2024-02-16T22:19:11.006 INFO:tasks.workunit.client.1.smithi173.stdout:2/348: creat d2/d10/d62/f78 x:0 0 0 2024-02-16T22:19:11.007 INFO:tasks.workunit.client.1.smithi173.stdout:9/213: rename d1/d2/d1a/f2a to d1/d2/d1a/d1f/f43 0 2024-02-16T22:19:11.009 INFO:tasks.workunit.client.1.smithi173.stdout:4/225: dwrite d7/d28/d31/f3b [0,4194304] 0 2024-02-16T22:19:11.009 INFO:tasks.workunit.client.1.smithi173.stdout:8/372: dwrite dd/d7c/d7d/d22/d28/f3c [0,4194304] 0 2024-02-16T22:19:11.009 INFO:tasks.workunit.client.1.smithi173.stdout:8/373: write dd/d7c/d7d/d22/f3f [3905983,22893] 0 2024-02-16T22:19:11.009 INFO:tasks.workunit.client.1.smithi173.stdout:8/374: write dd/d7c/d7d/d22/d28/d40/d52/f75 [1040946,101620] 0 2024-02-16T22:19:11.009 INFO:tasks.workunit.client.1.smithi173.stdout:8/375: fsync dd/d7c/d7d/d22/d28/d40/d52/f70 0 2024-02-16T22:19:11.009 INFO:tasks.workunit.client.1.smithi173.stdout:5/316: dwrite d8/fb [0,4194304] 0 2024-02-16T22:19:11.010 INFO:tasks.workunit.client.1.smithi173.stdout:2/349: mkdir d2/dc/d19/d1a/d79 0 2024-02-16T22:19:11.010 INFO:tasks.workunit.client.1.smithi173.stdout:9/214: rmdir d1/d2/d10 39 2024-02-16T22:19:11.012 INFO:tasks.workunit.client.1.smithi173.stdout:4/226: creat d7/d28/d31/d33/f50 x:0 0 0 2024-02-16T22:19:11.013 INFO:tasks.workunit.client.1.smithi173.stdout:8/376: symlink dd/d7c/d7d/d22/d2e/d41/d6b/l88 0 2024-02-16T22:19:11.015 INFO:tasks.workunit.client.1.smithi173.stdout:5/317: creat d8/d27/d35/f5e x:0 0 0 2024-02-16T22:19:11.016 INFO:tasks.workunit.client.1.smithi173.stdout:5/318: chown d8/d27/d2f/d58 6714830 1 2024-02-16T22:19:11.016 INFO:tasks.workunit.client.1.smithi173.stdout:3/253: dwrite d9/d17/d25/f50 [0,4194304] 0 2024-02-16T22:19:11.016 INFO:tasks.workunit.client.1.smithi173.stdout:3/254: fsync d9/d1a/f44 0 2024-02-16T22:19:11.016 INFO:tasks.workunit.client.1.smithi173.stdout:6/265: dwrite d0/db/f3d [0,4194304] 0 2024-02-16T22:19:11.016 INFO:tasks.workunit.client.1.smithi173.stdout:2/350: truncate d2/d4/f39 1181410 0 2024-02-16T22:19:11.017 INFO:tasks.workunit.client.1.smithi173.stdout:1/376: dwrite db/d1c/d25/d28/f3a [0,4194304] 0 2024-02-16T22:19:11.017 INFO:tasks.workunit.client.1.smithi173.stdout:9/215: link d1/d2/d1a/d2f/d3b/c3d d1/d2/d1a/d1f/d34/c44 0 2024-02-16T22:19:11.018 INFO:tasks.workunit.client.1.smithi173.stdout:9/216: chown d1/d2/d1a/d2f/d3b 164901584 1 2024-02-16T22:19:11.018 INFO:tasks.workunit.client.1.smithi173.stdout:9/217: write d1/f39 [2025419,76606] 0 2024-02-16T22:19:11.018 INFO:tasks.workunit.client.1.smithi173.stdout:1/377: read db/d1d/f20 [106715,30976] 0 2024-02-16T22:19:11.018 INFO:tasks.workunit.client.1.smithi173.stdout:1/378: fsync db/d1d/f2c 0 2024-02-16T22:19:11.021 INFO:tasks.workunit.client.1.smithi173.stdout:4/227: rename d7/l18 to d7/d12/l51 0 2024-02-16T22:19:11.023 INFO:tasks.workunit.client.1.smithi173.stdout:8/377: mkdir dd/d7c/d7d/d89 0 2024-02-16T22:19:11.030 INFO:tasks.workunit.client.1.smithi173.stdout:3/255: creat d9/d18/f62 x:0 0 0 2024-02-16T22:19:11.031 INFO:tasks.workunit.client.1.smithi173.stdout:5/319: dread d8/da/f47 [0,4194304] 0 2024-02-16T22:19:11.031 INFO:tasks.workunit.client.1.smithi173.stdout:5/320: readlink d8/l10 0 2024-02-16T22:19:11.035 INFO:tasks.workunit.client.1.smithi173.stdout:1/379: truncate db/d1d/f1e 125444 0 2024-02-16T22:19:11.035 INFO:tasks.workunit.client.1.smithi173.stdout:1/380: write f9 [502809,54973] 0 2024-02-16T22:19:11.042 INFO:tasks.workunit.client.1.smithi173.stdout:2/351: getdents d2/dc 0 2024-02-16T22:19:11.043 INFO:tasks.workunit.client.1.smithi173.stdout:8/378: write dd/d7c/d7d/d22/d2e/d41/f4a [1983990,4349] 0 2024-02-16T22:19:11.043 INFO:tasks.workunit.client.1.smithi173.stdout:5/321: rmdir d8/da/d1f/d33 39 2024-02-16T22:19:11.043 INFO:tasks.workunit.client.1.smithi173.stdout:8/379: read dd/d7c/d7d/d22/d50/f5d [806319,73759] 0 2024-02-16T22:19:11.044 INFO:tasks.workunit.client.1.smithi173.stdout:5/322: read d8/da/d2d/d36/f40 [133436,48631] 0 2024-02-16T22:19:11.044 INFO:tasks.workunit.client.1.smithi173.stdout:1/381: rename db/d1c/d25/f47 to db/d1c/d5c/f86 0 2024-02-16T22:19:11.045 INFO:tasks.workunit.client.1.smithi173.stdout:2/352: truncate d2/dc/d5d/f24 279219 0 2024-02-16T22:19:11.046 INFO:tasks.workunit.client.1.smithi173.stdout:2/353: fsync d2/d4/d8/d30/f45 0 2024-02-16T22:19:11.046 INFO:tasks.workunit.client.1.smithi173.stdout:2/354: stat d2/dc/d19/d1c/l48 0 2024-02-16T22:19:11.046 INFO:tasks.workunit.client.1.smithi173.stdout:5/323: dread d8/da/d1f/d33/f3f [0,4194304] 0 2024-02-16T22:19:11.047 INFO:tasks.workunit.client.1.smithi173.stdout:6/266: dwrite d0/db/f58 [0,4194304] 0 2024-02-16T22:19:11.048 INFO:tasks.workunit.client.1.smithi173.stdout:6/267: dread - d0/db/d2e/d2f/d31/f35 zero size 2024-02-16T22:19:11.048 INFO:tasks.workunit.client.1.smithi173.stdout:4/228: dwrite d7/d12/d2d/f4b [4194304,4194304] 0 2024-02-16T22:19:11.048 INFO:tasks.workunit.client.1.smithi173.stdout:4/229: chown d7/d28/c43 22301732 1 2024-02-16T22:19:11.048 INFO:tasks.workunit.client.1.smithi173.stdout:4/230: chown d7/df/d4f/d3d/c48 167 1 2024-02-16T22:19:11.048 INFO:tasks.workunit.client.1.smithi173.stdout:8/380: mknod dd/d7c/d7d/d58/c8a 0 2024-02-16T22:19:11.048 INFO:tasks.workunit.client.1.smithi173.stdout:8/381: getdents dd/d7c/d7d/d89 0 2024-02-16T22:19:11.048 INFO:tasks.workunit.client.1.smithi173.stdout:3/256: dwrite d9/d17/f48 [0,4194304] 0 2024-02-16T22:19:11.049 INFO:tasks.workunit.client.1.smithi173.stdout:1/382: creat db/d29/d57/d73/f87 x:0 0 0 2024-02-16T22:19:11.049 INFO:tasks.workunit.client.1.smithi173.stdout:1/383: chown db/d1c/c22 88839 1 2024-02-16T22:19:11.051 INFO:tasks.workunit.client.1.smithi173.stdout:2/355: rename d2/dc/d19/d1a/d79 to d2/dc/d5d/d7a 0 2024-02-16T22:19:11.051 INFO:tasks.workunit.client.1.smithi173.stdout:5/324: dread d8/da/d1f/d33/f4b [0,4194304] 0 2024-02-16T22:19:11.051 INFO:tasks.workunit.client.1.smithi173.stdout:5/325: write d8/da/d1b/f3b [515899,22683] 0 2024-02-16T22:19:11.052 INFO:tasks.workunit.client.1.smithi173.stdout:8/382: dread dd/d7c/d7d/d22/f32 [0,4194304] 0 2024-02-16T22:19:11.055 INFO:tasks.workunit.client.1.smithi173.stdout:3/257: mknod d9/d18/d5f/c63 0 2024-02-16T22:19:11.057 INFO:tasks.workunit.client.1.smithi173.stdout:4/231: unlink d7/d12/d2d/f2e 0 2024-02-16T22:19:11.057 INFO:tasks.workunit.client.1.smithi173.stdout:4/232: fsync d7/df/d4f/f47 0 2024-02-16T22:19:11.058 INFO:tasks.workunit.client.1.smithi173.stdout:1/384: unlink db/d1c/d25/d28/d3f/l64 0 2024-02-16T22:19:11.058 INFO:tasks.workunit.client.1.smithi173.stdout:1/385: chown db/d1c/l21 1 1 2024-02-16T22:19:11.058 INFO:tasks.workunit.client.1.smithi173.stdout:1/386: creat db/d1c/d5c/f88 x:0 0 0 2024-02-16T22:19:11.058 INFO:tasks.workunit.client.1.smithi173.stdout:1/387: stat db/d1c/d25/c38 0 2024-02-16T22:19:11.058 INFO:tasks.workunit.client.1.smithi173.stdout:4/233: read d7/d12/f19 [139065,15369] 0 2024-02-16T22:19:11.060 INFO:tasks.workunit.client.1.smithi173.stdout:6/268: rename d0/db/d2e/d2f/d31/d33/f48 to d0/db/d2e/d61/f64 0 2024-02-16T22:19:11.061 INFO:tasks.workunit.client.1.smithi173.stdout:2/356: symlink d2/d10/l7b 0 2024-02-16T22:19:11.065 INFO:tasks.workunit.client.1.smithi173.stdout:1/388: mknod db/d1c/d25/c89 0 2024-02-16T22:19:11.068 INFO:tasks.workunit.client.1.smithi173.stdout:5/326: dwrite d8/fd [0,4194304] 0 2024-02-16T22:19:11.069 INFO:tasks.workunit.client.1.smithi173.stdout:8/383: rename dd/d7c/d7d/d22/d28/d40/d69/c6c to dd/d7c/d7d/d22/d28/c8b 0 2024-02-16T22:19:11.070 INFO:tasks.workunit.client.1.smithi173.stdout:6/269: mkdir d0/db/d2e/d65 0 2024-02-16T22:19:11.071 INFO:tasks.workunit.client.1.smithi173.stdout:4/234: write d7/d12/d2d/f4b [6992176,38638] 0 2024-02-16T22:19:11.071 INFO:tasks.workunit.client.1.smithi173.stdout:4/235: stat d7/d28/d31/f3a 0 2024-02-16T22:19:11.071 INFO:tasks.workunit.client.1.smithi173.stdout:4/236: chown d7/f9 24 1 2024-02-16T22:19:11.072 INFO:tasks.workunit.client.1.smithi173.stdout:1/389: symlink db/d1c/d7f/l8a 0 2024-02-16T22:19:11.076 INFO:tasks.workunit.client.1.smithi173.stdout:8/384: unlink dd/d7c/d7d/d22/d2e/d41/f42 0 2024-02-16T22:19:11.077 INFO:tasks.workunit.client.1.smithi173.stdout:5/327: dread d8/fd [0,4194304] 0 2024-02-16T22:19:11.082 INFO:tasks.workunit.client.1.smithi173.stdout:2/357: rmdir d2/d4 39 2024-02-16T22:19:11.087 INFO:tasks.workunit.client.1.smithi173.stdout:6/270: dread d0/f19 [0,4194304] 0 2024-02-16T22:19:11.088 INFO:tasks.workunit.client.1.smithi173.stdout:3/258: truncate d9/d17/f48 2589575 0 2024-02-16T22:19:11.088 INFO:tasks.workunit.client.1.smithi173.stdout:3/259: readlink d9/d1a/d21/l32 0 2024-02-16T22:19:11.088 INFO:tasks.workunit.client.1.smithi173.stdout:3/260: chown d9/d1a/d2b/d45/d60 37 1 2024-02-16T22:19:11.091 INFO:tasks.workunit.client.1.smithi173.stdout:3/261: dread d9/d1a/f2c [0,4194304] 0 2024-02-16T22:19:11.091 INFO:tasks.workunit.client.1.smithi173.stdout:1/390: symlink db/d5f/l8b 0 2024-02-16T22:19:11.091 INFO:tasks.workunit.client.1.smithi173.stdout:1/391: readlink db/d29/d50/l61 0 2024-02-16T22:19:11.092 INFO:tasks.workunit.client.1.smithi173.stdout:8/385: rename dd/d7c/d7d/d22/d28/c3e to dd/d7c/d7d/d22/d28/d40/c8c 0 2024-02-16T22:19:11.094 INFO:tasks.workunit.client.1.smithi173.stdout:5/328: symlink d8/d27/d2f/l5f 0 2024-02-16T22:19:11.095 INFO:tasks.workunit.client.1.smithi173.stdout:2/358: unlink d2/dc/d19/c14 0 2024-02-16T22:19:11.095 INFO:tasks.workunit.client.1.smithi173.stdout:2/359: fsync d2/d4/d8/d30/f3b 0 2024-02-16T22:19:11.096 INFO:tasks.workunit.client.1.smithi173.stdout:6/271: creat d0/db/d2e/d2f/d31/d33/f66 x:0 0 0 2024-02-16T22:19:11.097 INFO:tasks.workunit.client.1.smithi173.stdout:3/262: mknod d9/d1a/d2b/d45/c64 0 2024-02-16T22:19:11.097 INFO:tasks.workunit.client.1.smithi173.stdout:3/263: dread - d9/d1a/d2b/d4d/f4f zero size 2024-02-16T22:19:11.098 INFO:tasks.workunit.client.1.smithi173.stdout:1/392: mkdir db/d29/d57/d8c 0 2024-02-16T22:19:11.098 INFO:tasks.workunit.client.1.smithi173.stdout:1/393: read db/d1d/f1e [104729,59560] 0 2024-02-16T22:19:11.100 INFO:tasks.workunit.client.1.smithi173.stdout:8/386: symlink dd/d7c/d7d/d22/d5a/l8d 0 2024-02-16T22:19:11.100 INFO:tasks.workunit.client.1.smithi173.stdout:8/387: creat dd/d7c/d7d/d22/d2e/d41/d6b/f8e x:0 0 0 2024-02-16T22:19:11.100 INFO:tasks.workunit.client.1.smithi173.stdout:8/388: fdatasync dd/d7c/d7d/d22/d2e/d41/d6b/f8e 0 2024-02-16T22:19:11.101 INFO:tasks.workunit.client.1.smithi173.stdout:5/329: creat d8/da/f60 x:0 0 0 2024-02-16T22:19:11.101 INFO:tasks.workunit.client.1.smithi173.stdout:5/330: readlink d8/da/d2d/d3a/l5d 0 2024-02-16T22:19:11.101 INFO:tasks.workunit.client.1.smithi173.stdout:5/331: chown d8/d27/c41 402091725 1 2024-02-16T22:19:11.105 INFO:tasks.workunit.client.1.smithi173.stdout:8/389: mkdir dd/d7c/d8f 0 2024-02-16T22:19:11.107 INFO:tasks.workunit.client.1.smithi173.stdout:8/390: rmdir dd/d7c/d87 0 2024-02-16T22:19:11.108 INFO:tasks.workunit.client.1.smithi173.stdout:1/394: dread db/d30/f52 [0,4194304] 0 2024-02-16T22:19:11.108 INFO:tasks.workunit.client.1.smithi173.stdout:1/395: creat db/d30/f8d x:0 0 0 2024-02-16T22:19:11.111 INFO:tasks.workunit.client.1.smithi173.stdout:1/396: mknod db/d29/d57/c8e 0 2024-02-16T22:19:11.111 INFO:tasks.workunit.client.1.smithi173.stdout:1/397: chown db/d5f/l8b 66621 1 2024-02-16T22:19:11.111 INFO:tasks.workunit.client.1.smithi173.stdout:8/391: rmdir dd/d7c/d7d/d58 39 2024-02-16T22:19:11.112 INFO:tasks.workunit.client.1.smithi173.stdout:1/398: mkdir db/d29/d8f 0 2024-02-16T22:19:11.115 INFO:tasks.workunit.client.1.smithi173.stdout:1/399: rename db/d1c/d5c/f67 to db/d1c/d25/d45/f90 0 2024-02-16T22:19:11.116 INFO:tasks.workunit.client.1.smithi173.stdout:1/400: rmdir db 39 2024-02-16T22:19:11.117 INFO:tasks.workunit.client.1.smithi173.stdout:1/401: symlink db/d29/d57/d8c/l91 0 2024-02-16T22:19:11.118 INFO:tasks.workunit.client.1.smithi173.stdout:3/264: dwrite d9/f22 [0,4194304] 0 2024-02-16T22:19:11.118 INFO:tasks.workunit.client.1.smithi173.stdout:3/265: chown d9/d17/d25/f39 196976653 1 2024-02-16T22:19:11.119 INFO:tasks.workunit.client.1.smithi173.stdout:1/402: rmdir db/d1c/d25/d45 39 2024-02-16T22:19:11.119 INFO:tasks.workunit.client.1.smithi173.stdout:1/403: readlink db/d30/l4c 0 2024-02-16T22:19:11.119 INFO:tasks.workunit.client.1.smithi173.stdout:1/404: chown db/d1d/f26 81415 1 2024-02-16T22:19:11.119 INFO:tasks.workunit.client.1.smithi173.stdout:1/405: truncate db/d1c/d25/d45/f90 8993073 0 2024-02-16T22:19:11.122 INFO:tasks.workunit.client.1.smithi173.stdout:6/272: dwrite d0/db/f29 [0,4194304] 0 2024-02-16T22:19:11.127 INFO:tasks.workunit.client.1.smithi173.stdout:6/273: mkdir d0/db/d2e/d65/d67 0 2024-02-16T22:19:11.129 INFO:tasks.workunit.client.1.smithi173.stdout:6/274: symlink d0/db/d2e/d65/l68 0 2024-02-16T22:19:11.129 INFO:tasks.workunit.client.1.smithi173.stdout:6/275: truncate d0/db/d2e/d2f/f3b 1809403 0 2024-02-16T22:19:11.129 INFO:tasks.workunit.client.1.smithi173.stdout:6/276: fdatasync d0/db/d2e/f56 0 2024-02-16T22:19:11.130 INFO:tasks.workunit.client.1.smithi173.stdout:6/277: creat d0/db/d2e/d2f/d31/d33/f69 x:0 0 0 2024-02-16T22:19:11.130 INFO:tasks.workunit.client.1.smithi173.stdout:1/406: write db/d29/f36 [1602225,72832] 0 2024-02-16T22:19:11.130 INFO:tasks.workunit.client.1.smithi173.stdout:3/266: dread d9/d1a/d2b/d49/f53 [0,4194304] 0 2024-02-16T22:19:11.131 INFO:tasks.workunit.client.1.smithi173.stdout:1/407: read db/d29/d57/f5d [434470,105137] 0 2024-02-16T22:19:11.132 INFO:tasks.workunit.client.1.smithi173.stdout:6/278: creat d0/db/d2e/d61/f6a x:0 0 0 2024-02-16T22:19:11.133 INFO:tasks.workunit.client.1.smithi173.stdout:8/392: dwrite dd/f86 [0,4194304] 0 2024-02-16T22:19:11.133 INFO:tasks.workunit.client.1.smithi173.stdout:3/267: symlink d9/d1a/d2b/d45/l65 0 2024-02-16T22:19:11.134 INFO:tasks.workunit.client.1.smithi173.stdout:1/408: creat db/d29/d50/d85/f92 x:0 0 0 2024-02-16T22:19:11.137 INFO:tasks.workunit.client.1.smithi173.stdout:8/393: creat dd/d7c/d7d/d22/d28/f90 x:0 0 0 2024-02-16T22:19:11.138 INFO:tasks.workunit.client.1.smithi173.stdout:3/268: truncate d9/da/f27 3078972 0 2024-02-16T22:19:11.142 INFO:tasks.workunit.client.1.smithi173.stdout:8/394: creat dd/d7c/d7d/d58/f91 x:0 0 0 2024-02-16T22:19:11.143 INFO:tasks.workunit.client.1.smithi173.stdout:1/409: unlink db/d1c/l2a 0 2024-02-16T22:19:11.144 INFO:tasks.workunit.client.1.smithi173.stdout:1/410: dread db/d1d/f20 [0,4194304] 0 2024-02-16T22:19:11.144 INFO:tasks.workunit.client.1.smithi173.stdout:1/411: write db/d1c/d5c/f63 [1267974,97265] 0 2024-02-16T22:19:11.145 INFO:tasks.workunit.client.1.smithi173.stdout:3/269: rename d9/d17/f1c to d9/da/f66 0 2024-02-16T22:19:11.146 INFO:tasks.workunit.client.1.smithi173.stdout:8/395: unlink dd/d7c/d7d/l18 0 2024-02-16T22:19:11.147 INFO:tasks.workunit.client.1.smithi173.stdout:8/396: write fc [3617551,38058] 0 2024-02-16T22:19:11.147 INFO:tasks.workunit.client.1.smithi173.stdout:8/397: getdents dd/d7c/d7d/d89 0 2024-02-16T22:19:11.147 INFO:tasks.workunit.client.1.smithi173.stdout:8/398: mknod dd/d7c/d7d/d22/d28/d40/d51/c92 0 2024-02-16T22:19:11.147 INFO:tasks.workunit.client.1.smithi173.stdout:8/399: fsync dd/d7c/d7d/d22/d28/f90 0 2024-02-16T22:19:11.149 INFO:tasks.workunit.client.1.smithi173.stdout:6/279: truncate d0/db/d2e/d61/f64 340009 0 2024-02-16T22:19:11.154 INFO:tasks.workunit.client.1.smithi173.stdout:1/412: write db/d29/d57/f71 [2908784,42755] 0 2024-02-16T22:19:11.154 INFO:tasks.workunit.client.1.smithi173.stdout:3/270: write d9/fb [2006663,80882] 0 2024-02-16T22:19:11.159 INFO:tasks.workunit.client.1.smithi173.stdout:3/271: dread d9/fb [0,4194304] 0 2024-02-16T22:19:11.159 INFO:tasks.workunit.client.1.smithi173.stdout:3/272: dread - d9/d17/f54 zero size 2024-02-16T22:19:11.159 INFO:tasks.workunit.client.1.smithi173.stdout:6/280: rmdir d0/db/d2e 39 2024-02-16T22:19:11.159 INFO:tasks.workunit.client.1.smithi173.stdout:6/281: fsync d0/db/d2e/d2f/d31/d33/f36 0 2024-02-16T22:19:11.161 INFO:tasks.workunit.client.1.smithi173.stdout:3/273: dread d9/d17/d1d/f3d [0,4194304] 0 2024-02-16T22:19:11.163 INFO:tasks.workunit.client.1.smithi173.stdout:1/413: rmdir db/d1c 39 2024-02-16T22:19:11.165 INFO:tasks.workunit.client.1.smithi173.stdout:6/282: creat d0/db/d2e/d65/f6b x:0 0 0 2024-02-16T22:19:11.167 INFO:tasks.workunit.client.1.smithi173.stdout:3/274: rename d9/d1a/c2f to d9/d1a/d2b/d4d/c67 0 2024-02-16T22:19:11.169 INFO:tasks.workunit.client.1.smithi173.stdout:1/414: unlink db/d1c/d25/f2d 0 2024-02-16T22:19:11.170 INFO:tasks.workunit.client.1.smithi173.stdout:3/275: mknod d9/d18/d5f/c68 0 2024-02-16T22:19:11.174 INFO:tasks.workunit.client.1.smithi173.stdout:6/283: dread d0/db/f3d [0,4194304] 0 2024-02-16T22:19:11.174 INFO:tasks.workunit.client.1.smithi173.stdout:6/284: write d0/db/d2e/d2f/d31/f39 [112924,106659] 0 2024-02-16T22:19:11.174 INFO:tasks.workunit.client.1.smithi173.stdout:6/285: rename d0/db/d2e/d2f/d31 to d0/db/d2e/d2f/d31/d5d/d6c 22 2024-02-16T22:19:11.176 INFO:tasks.workunit.client.1.smithi173.stdout:3/276: dread d9/d17/f48 [0,4194304] 0 2024-02-16T22:19:11.178 INFO:tasks.workunit.client.1.smithi173.stdout:6/286: read d0/f19 [976146,42931] 0 2024-02-16T22:19:11.178 INFO:tasks.workunit.client.1.smithi173.stdout:3/277: link d9/da/f43 d9/d18/d5f/f69 0 2024-02-16T22:19:11.179 INFO:tasks.workunit.client.1.smithi173.stdout:6/287: mkdir d0/db/d2e/d2f/d31/d33/d6d 0 2024-02-16T22:19:11.182 INFO:tasks.workunit.client.1.smithi173.stdout:6/288: dread d0/db/d2e/d2f/d31/d33/f36 [0,4194304] 0 2024-02-16T22:19:11.187 INFO:tasks.workunit.client.1.smithi173.stdout:1/415: dwrite db/d1d/f80 [0,4194304] 0 2024-02-16T22:19:11.191 INFO:tasks.workunit.client.1.smithi173.stdout:3/278: write d9/f22 [1151946,115231] 0 2024-02-16T22:19:11.191 INFO:tasks.workunit.client.1.smithi173.stdout:3/279: chown d9/da/f1b 24325 1 2024-02-16T22:19:11.193 INFO:tasks.workunit.client.1.smithi173.stdout:1/416: unlink db/d1c/d25/d28/f7a 0 2024-02-16T22:19:11.199 INFO:tasks.workunit.client.1.smithi173.stdout:3/280: rmdir d9/d1a 39 2024-02-16T22:19:11.201 INFO:tasks.workunit.client.1.smithi173.stdout:3/281: rename d9/d1a/d21 to d9/d1a/d2b/d45/d60/d6a 0 2024-02-16T22:19:11.203 INFO:tasks.workunit.client.1.smithi173.stdout:6/289: dwrite d0/f1e [0,4194304] 0 2024-02-16T22:19:11.203 INFO:tasks.workunit.client.1.smithi173.stdout:3/282: creat d9/d1a/d2b/d4d/f6b x:0 0 0 2024-02-16T22:19:11.204 INFO:tasks.workunit.client.1.smithi173.stdout:6/290: chown d0/c6 1754 1 2024-02-16T22:19:11.204 INFO:tasks.workunit.client.1.smithi173.stdout:6/291: write d0/db/d2e/d2f/d31/d33/f66 [735683,49455] 0 2024-02-16T22:19:11.206 INFO:tasks.workunit.client.1.smithi173.stdout:3/283: rename d9/d18/d5f/c68 to d9/c6c 0 2024-02-16T22:19:11.206 INFO:tasks.workunit.client.1.smithi173.stdout:3/284: chown d9/da/f1b 9693 1 2024-02-16T22:19:11.206 INFO:tasks.workunit.client.1.smithi173.stdout:1/417: dwrite db/f4b [0,4194304] 0 2024-02-16T22:19:11.207 INFO:tasks.workunit.client.1.smithi173.stdout:6/292: truncate d0/db/d2e/d2f/d31/d33/f36 23117 0 2024-02-16T22:19:11.208 INFO:tasks.workunit.client.1.smithi173.stdout:6/293: write d0/db/d2e/f52 [1197820,80620] 0 2024-02-16T22:19:11.210 INFO:tasks.workunit.client.1.smithi173.stdout:1/418: rename db/d1c/d5c/f74 to db/d29/d8f/f93 0 2024-02-16T22:19:11.211 INFO:tasks.workunit.client.1.smithi173.stdout:6/294: mknod d0/db/d2e/d61/c6e 0 2024-02-16T22:19:11.212 INFO:tasks.workunit.client.1.smithi173.stdout:1/419: dread db/f1b [0,4194304] 0 2024-02-16T22:19:11.226 INFO:tasks.workunit.client.1.smithi173.stdout:3/285: dwrite d9/d17/d25/f39 [0,4194304] 0 2024-02-16T22:19:11.228 INFO:tasks.workunit.client.1.smithi173.stdout:3/286: unlink d9/da/ce 0 2024-02-16T22:19:11.229 INFO:tasks.workunit.client.1.smithi173.stdout:3/287: chown d9/d17/d25/l3b 159 1 2024-02-16T22:19:11.229 INFO:tasks.workunit.client.1.smithi173.stdout:3/288: link d9/d1a/d2b/d4d/c55 d9/d1a/c6d 0 2024-02-16T22:19:11.237 INFO:tasks.workunit.client.1.smithi173.stdout:1/420: dwrite db/d1c/d7f/f82 [0,4194304] 0 2024-02-16T22:19:11.237 INFO:tasks.workunit.client.1.smithi173.stdout:1/421: fdatasync db/d30/f8d 0 2024-02-16T22:19:11.241 INFO:tasks.workunit.client.1.smithi173.stdout:6/295: dwrite d0/db/d4d/f5f [0,4194304] 0 2024-02-16T22:19:11.244 INFO:tasks.workunit.client.1.smithi173.stdout:6/296: getdents d0/db/d2e 0 2024-02-16T22:19:11.245 INFO:tasks.workunit.client.1.smithi173.stdout:1/422: dread db/d1c/d25/d28/f49 [0,4194304] 0 2024-02-16T22:19:11.246 INFO:tasks.workunit.client.1.smithi173.stdout:1/423: write db/d1d/f20 [937534,127221] 0 2024-02-16T22:19:11.247 INFO:tasks.workunit.client.1.smithi173.stdout:1/424: creat db/d29/f94 x:0 0 0 2024-02-16T22:19:11.247 INFO:tasks.workunit.client.1.smithi173.stdout:1/425: readlink db/d1c/d5c/l66 0 2024-02-16T22:19:11.261 INFO:tasks.workunit.client.1.smithi173.stdout:3/289: dwrite d9/d17/d1d/f5a [0,4194304] 0 2024-02-16T22:19:11.265 INFO:tasks.workunit.client.1.smithi173.stdout:3/290: write d9/d17/f48 [2339307,7322] 0 2024-02-16T22:19:11.265 INFO:tasks.workunit.client.1.smithi173.stdout:3/291: write d9/d1a/d2b/d4d/d5b/f5e [1755361,24251] 0 2024-02-16T22:19:11.265 INFO:tasks.workunit.client.1.smithi173.stdout:3/292: dread d9/da/f43 [0,4194304] 0 2024-02-16T22:19:11.268 INFO:tasks.workunit.client.1.smithi173.stdout:3/293: rename d9/d17/d1d to d9/d18/d5f/d6e 0 2024-02-16T22:19:11.268 INFO:tasks.workunit.client.1.smithi173.stdout:3/294: readlink d9/d17/l36 0 2024-02-16T22:19:11.269 INFO:tasks.workunit.client.1.smithi173.stdout:3/295: creat d9/d1a/d2b/d45/d60/d6a/f6f x:0 0 0 2024-02-16T22:19:11.270 INFO:tasks.workunit.client.1.smithi173.stdout:1/426: dwrite db/d29/f39 [0,4194304] 0 2024-02-16T22:19:11.271 INFO:tasks.workunit.client.1.smithi173.stdout:6/297: dwrite d0/db/d2e/f52 [0,4194304] 0 2024-02-16T22:19:11.276 INFO:tasks.workunit.client.1.smithi173.stdout:6/298: dread d0/f19 [0,4194304] 0 2024-02-16T22:19:11.278 INFO:tasks.workunit.client.1.smithi173.stdout:6/299: rename d0/db/f47 to d0/db/d4d/f6f 0 2024-02-16T22:19:11.280 INFO:tasks.workunit.client.1.smithi173.stdout:1/427: write db/d1c/d7f/f82 [3543228,103620] 0 2024-02-16T22:19:11.280 INFO:tasks.workunit.client.1.smithi173.stdout:1/428: write db/d1c/f37 [2250626,7414] 0 2024-02-16T22:19:11.280 INFO:tasks.workunit.client.1.smithi173.stdout:1/429: write db/d1c/d5c/f6d [1005899,70463] 0 2024-02-16T22:19:11.282 INFO:tasks.workunit.client.1.smithi173.stdout:1/430: truncate db/d1d/f80 295593 0 2024-02-16T22:19:11.282 INFO:tasks.workunit.client.1.smithi173.stdout:6/300: dread d0/db/f3d [0,4194304] 0 2024-02-16T22:19:11.283 INFO:tasks.workunit.client.1.smithi173.stdout:6/301: dread d0/db/d2e/d2f/d31/d33/f36 [0,4194304] 0 2024-02-16T22:19:11.283 INFO:tasks.workunit.client.1.smithi173.stdout:6/302: truncate d0/fd 1314727 0 2024-02-16T22:19:11.283 INFO:tasks.workunit.client.1.smithi173.stdout:6/303: write d0/f44 [723043,122271] 0 2024-02-16T22:19:11.283 INFO:tasks.workunit.client.1.smithi173.stdout:6/304: chown d0/f19 103748727 1 2024-02-16T22:19:11.283 INFO:tasks.workunit.client.1.smithi173.stdout:6/305: rmdir d0/db/d2e/d2f/d31/d5d 39 2024-02-16T22:19:11.288 INFO:tasks.workunit.client.1.smithi173.stdout:6/306: dread d0/f19 [0,4194304] 0 2024-02-16T22:19:11.288 INFO:tasks.workunit.client.1.smithi173.stdout:6/307: write d0/f44 [798371,63422] 0 2024-02-16T22:19:11.288 INFO:tasks.workunit.client.1.smithi173.stdout:6/308: chown d0/db/d2e/d2f 71510 1 2024-02-16T22:19:11.289 INFO:tasks.workunit.client.1.smithi173.stdout:6/309: creat d0/f70 x:0 0 0 2024-02-16T22:19:11.289 INFO:tasks.workunit.client.1.smithi173.stdout:3/296: dwrite d9/d1a/d2b/d4d/f52 [0,4194304] 0 2024-02-16T22:19:11.290 INFO:tasks.workunit.client.1.smithi173.stdout:6/310: rmdir d0/db/d2e/d2f 39 2024-02-16T22:19:11.299 INFO:tasks.workunit.client.1.smithi173.stdout:7/284: sync 2024-02-16T22:19:11.304 INFO:tasks.workunit.client.1.smithi173.stdout:6/311: write d0/f5b [3785093,122022] 0 2024-02-16T22:19:11.304 INFO:tasks.workunit.client.1.smithi173.stdout:6/312: write d0/db/f57 [789321,45980] 0 2024-02-16T22:19:11.305 INFO:tasks.workunit.client.1.smithi173.stdout:6/313: creat d0/db/d2e/f71 x:0 0 0 2024-02-16T22:19:11.306 INFO:tasks.workunit.client.1.smithi173.stdout:1/431: dwrite db/d30/f48 [0,4194304] 0 2024-02-16T22:19:11.307 INFO:tasks.workunit.client.1.smithi173.stdout:3/297: dwrite d9/d1a/d2b/d45/d60/d6a/f6f [0,4194304] 0 2024-02-16T22:19:11.309 INFO:tasks.workunit.client.1.smithi173.stdout:1/432: symlink db/d1c/d25/d28/d3f/l95 0 2024-02-16T22:19:11.314 INFO:tasks.workunit.client.1.smithi173.stdout:1/433: mknod db/d29/d57/d73/c96 0 2024-02-16T22:19:11.317 INFO:tasks.workunit.client.1.smithi173.stdout:6/314: dread d0/db/f58 [0,4194304] 0 2024-02-16T22:19:11.317 INFO:tasks.workunit.client.1.smithi173.stdout:6/315: creat d0/db/f72 x:0 0 0 2024-02-16T22:19:11.319 INFO:tasks.workunit.client.1.smithi173.stdout:6/316: fdatasync d0/db/d2e/d2f/f4e 0 2024-02-16T22:19:11.319 INFO:tasks.workunit.client.1.smithi173.stdout:6/317: fdatasync d0/db/d2e/d2f/d31/f5e 0 2024-02-16T22:19:11.321 INFO:tasks.workunit.client.1.smithi173.stdout:6/318: mkdir d0/db/d2e/d65/d73 0 2024-02-16T22:19:11.321 INFO:tasks.workunit.client.1.smithi173.stdout:3/298: dwrite d9/d18/f62 [0,4194304] 0 2024-02-16T22:19:11.321 INFO:tasks.workunit.client.1.smithi173.stdout:3/299: read d9/fb [1800694,102954] 0 2024-02-16T22:19:11.324 INFO:tasks.workunit.client.1.smithi173.stdout:6/319: rename d0/db/f58 to d0/db/d2e/d2f/d31/d5d/f74 0 2024-02-16T22:19:11.327 INFO:tasks.workunit.client.1.smithi173.stdout:6/320: mknod d0/db/d2e/d2f/d31/c75 0 2024-02-16T22:19:11.327 INFO:tasks.workunit.client.1.smithi173.stdout:6/321: creat d0/db/d4d/f76 x:0 0 0 2024-02-16T22:19:11.327 INFO:tasks.workunit.client.1.smithi173.stdout:6/322: creat d0/db/f77 x:0 0 0 2024-02-16T22:19:11.352 INFO:tasks.workunit.client.1.smithi173.stdout:1/434: dwrite db/ff [0,4194304] 0 2024-02-16T22:19:11.352 INFO:tasks.workunit.client.1.smithi173.stdout:6/323: dwrite d0/db/d4d/f6f [0,4194304] 0 2024-02-16T22:19:11.352 INFO:tasks.workunit.client.1.smithi173.stdout:3/300: dwrite d9/d18/d5f/f69 [0,4194304] 0 2024-02-16T22:19:11.355 INFO:tasks.workunit.client.1.smithi173.stdout:1/435: dread db/d1d/f20 [0,4194304] 0 2024-02-16T22:19:11.355 INFO:tasks.workunit.client.1.smithi173.stdout:6/324: mkdir d0/db/d2e/d65/d67/d78 0 2024-02-16T22:19:11.357 INFO:tasks.workunit.client.1.smithi173.stdout:3/301: creat d9/da/f70 x:0 0 0 2024-02-16T22:19:11.358 INFO:tasks.workunit.client.1.smithi173.stdout:1/436: mkdir db/d5f/d97 0 2024-02-16T22:19:11.359 INFO:tasks.workunit.client.1.smithi173.stdout:6/325: link d0/db/d2e/f30 d0/db/d2e/d2f/d31/d33/f79 0 2024-02-16T22:19:11.361 INFO:tasks.workunit.client.1.smithi173.stdout:1/437: mkdir db/d1c/d7f/d98 0 2024-02-16T22:19:11.361 INFO:tasks.workunit.client.1.smithi173.stdout:1/438: stat db/d30/f4f 0 2024-02-16T22:19:11.362 INFO:tasks.workunit.client.1.smithi173.stdout:6/326: mkdir d0/db/d2e/d2f/d31/d7a 0 2024-02-16T22:19:11.362 INFO:tasks.workunit.client.1.smithi173.stdout:6/327: truncate d0/db/d2e/f56 5104547 0 2024-02-16T22:19:11.363 INFO:tasks.workunit.client.1.smithi173.stdout:6/328: mknod d0/db/d2e/d2f/d31/d33/c7b 0 2024-02-16T22:19:11.365 INFO:tasks.workunit.client.1.smithi173.stdout:6/329: mkdir d0/d7c 0 2024-02-16T22:19:11.365 INFO:tasks.workunit.client.1.smithi173.stdout:6/330: stat d0/db/d2e/d2f 0 2024-02-16T22:19:11.365 INFO:tasks.workunit.client.1.smithi173.stdout:3/302: dread d9/d17/d25/f3e [0,4194304] 0 2024-02-16T22:19:11.365 INFO:tasks.workunit.client.1.smithi173.stdout:3/303: rename d9 to d9/d1a/d2b/d45/d60/d71 22 2024-02-16T22:19:11.370 INFO:tasks.workunit.client.1.smithi173.stdout:1/439: write db/d29/f39 [1939529,33850] 0 2024-02-16T22:19:11.370 INFO:tasks.workunit.client.1.smithi173.stdout:1/440: read db/d29/f53 [448138,448] 0 2024-02-16T22:19:11.370 INFO:tasks.workunit.client.1.smithi173.stdout:1/441: write db/d1c/d7f/f82 [2264688,27616] 0 2024-02-16T22:19:11.371 INFO:tasks.workunit.client.1.smithi173.stdout:1/442: getdents db/d29/d50/d85 0 2024-02-16T22:19:11.373 INFO:tasks.workunit.client.1.smithi173.stdout:1/443: creat db/d1c/d25/d28/d3f/d4a/f99 x:0 0 0 2024-02-16T22:19:11.373 INFO:tasks.workunit.client.1.smithi173.stdout:1/444: write db/d29/f36 [2425764,106397] 0 2024-02-16T22:19:11.375 INFO:tasks.workunit.client.1.smithi173.stdout:1/445: rename db/d1c/d25/d28/d3f/f77 to db/d29/f9a 0 2024-02-16T22:19:11.382 INFO:tasks.workunit.client.1.smithi173.stdout:3/304: dwrite d9/da/fd [0,4194304] 0 2024-02-16T22:19:11.383 INFO:tasks.workunit.client.1.smithi173.stdout:1/446: dread db/d30/f48 [0,4194304] 0 2024-02-16T22:19:11.393 INFO:tasks.workunit.client.1.smithi173.stdout:1/447: dread db/d29/f3b [0,4194304] 0 2024-02-16T22:19:11.393 INFO:tasks.workunit.client.1.smithi173.stdout:1/448: chown db/d1c/l21 37262 1 2024-02-16T22:19:11.394 INFO:tasks.workunit.client.1.smithi173.stdout:1/449: mkdir db/d1c/d7f/d9b 0 2024-02-16T22:19:11.394 INFO:tasks.workunit.client.1.smithi173.stdout:1/450: read - db/d29/f94 zero size 2024-02-16T22:19:11.396 INFO:tasks.workunit.client.1.smithi173.stdout:1/451: write db/d1d/f20 [685271,111922] 0 2024-02-16T22:19:11.396 INFO:tasks.workunit.client.1.smithi173.stdout:3/305: dread d9/da/f43 [0,4194304] 0 2024-02-16T22:19:11.397 INFO:tasks.workunit.client.1.smithi173.stdout:3/306: chown d9/d1a/d2b/d4d/c55 3304 1 2024-02-16T22:19:11.397 INFO:tasks.workunit.client.1.smithi173.stdout:3/307: chown d9/d1a/d2b/d45/d51 1633140053 1 2024-02-16T22:19:11.397 INFO:tasks.workunit.client.1.smithi173.stdout:1/452: link db/f1b db/d29/f9c 0 2024-02-16T22:19:11.399 INFO:tasks.workunit.client.1.smithi173.stdout:3/308: link f8 d9/d1a/d2b/d49/f72 0 2024-02-16T22:19:11.399 INFO:tasks.workunit.client.1.smithi173.stdout:1/453: dread db/d1c/d25/d28/f6c [0,4194304] 0 2024-02-16T22:19:11.417 INFO:tasks.workunit.client.1.smithi173.stdout:0/254: sync 2024-02-16T22:19:11.417 INFO:tasks.workunit.client.1.smithi173.stdout:0/255: write d0/d4/d14/f16 [1191791,127490] 0 2024-02-16T22:19:11.417 INFO:tasks.workunit.client.1.smithi173.stdout:0/256: stat d0/d4/d14/d38 0 2024-02-16T22:19:11.419 INFO:tasks.workunit.client.1.smithi173.stdout:0/257: dread d0/f5 [0,4194304] 0 2024-02-16T22:19:11.419 INFO:tasks.workunit.client.1.smithi173.stdout:3/309: dwrite d9/da/f1b [0,4194304] 0 2024-02-16T22:19:11.420 INFO:tasks.workunit.client.1.smithi173.stdout:1/454: dwrite db/d29/f53 [0,4194304] 0 2024-02-16T22:19:11.422 INFO:tasks.workunit.client.1.smithi173.stdout:3/310: unlink d9/d1a/d2b/d45/l65 0 2024-02-16T22:19:11.425 INFO:tasks.workunit.client.1.smithi173.stdout:1/455: symlink db/d1c/l9d 0 2024-02-16T22:19:11.427 INFO:tasks.workunit.client.1.smithi173.stdout:3/311: mkdir d9/d18/d73 0 2024-02-16T22:19:11.428 INFO:tasks.workunit.client.1.smithi173.stdout:1/456: creat db/d1c/f9e x:0 0 0 2024-02-16T22:19:11.429 INFO:tasks.workunit.client.1.smithi173.stdout:3/312: mknod d9/c74 0 2024-02-16T22:19:11.429 INFO:tasks.workunit.client.1.smithi173.stdout:3/313: write d9/d17/f48 [1456214,73116] 0 2024-02-16T22:19:11.430 INFO:tasks.workunit.client.1.smithi173.stdout:1/457: symlink db/d29/d50/d85/l9f 0 2024-02-16T22:19:11.437 INFO:tasks.workunit.client.1.smithi173.stdout:3/314: write d9/d18/f62 [1088386,120655] 0 2024-02-16T22:19:11.439 INFO:tasks.workunit.client.1.smithi173.stdout:1/458: write f2 [7829505,115166] 0 2024-02-16T22:19:11.439 INFO:tasks.workunit.client.1.smithi173.stdout:3/315: unlink d9/d18/d5f/d6e/f38 0 2024-02-16T22:19:11.439 INFO:tasks.workunit.client.1.smithi173.stdout:1/459: symlink db/d5f/d97/la0 0 2024-02-16T22:19:11.442 INFO:tasks.workunit.client.1.smithi173.stdout:1/460: unlink db/d29/f53 0 2024-02-16T22:19:11.444 INFO:tasks.workunit.client.1.smithi173.stdout:1/461: rename db/d29/d50/d85/f92 to db/d1d/fa1 0 2024-02-16T22:19:11.444 INFO:tasks.workunit.client.1.smithi173.stdout:1/462: readlink db/d29/d57/d73/l7d 0 2024-02-16T22:19:11.445 INFO:tasks.workunit.client.1.smithi173.stdout:1/463: symlink db/d1c/d5c/la2 0 2024-02-16T22:19:11.445 INFO:tasks.workunit.client.1.smithi173.stdout:1/464: truncate db/d1c/d25/d28/d3f/f4e 5033499 0 2024-02-16T22:19:11.445 INFO:tasks.workunit.client.1.smithi173.stdout:1/465: symlink db/d1c/d5c/la3 0 2024-02-16T22:19:11.446 INFO:tasks.workunit.client.1.smithi173.stdout:1/466: mknod db/d30/ca4 0 2024-02-16T22:19:11.447 INFO:tasks.workunit.client.1.smithi173.stdout:1/467: write db/d29/f3b [2849567,103014] 0 2024-02-16T22:19:11.447 INFO:tasks.workunit.client.1.smithi173.stdout:1/468: mknod db/d29/d8f/ca5 0 2024-02-16T22:19:11.451 INFO:tasks.workunit.client.1.smithi173.stdout:1/469: dread db/f1b [0,4194304] 0 2024-02-16T22:19:11.451 INFO:tasks.workunit.client.1.smithi173.stdout:1/470: creat db/d29/d50/fa6 x:0 0 0 2024-02-16T22:19:11.451 INFO:tasks.workunit.client.1.smithi173.stdout:1/471: creat db/d1c/d25/d45/fa7 x:0 0 0 2024-02-16T22:19:11.452 INFO:tasks.workunit.client.1.smithi173.stdout:1/472: chown db/c16 7 1 2024-02-16T22:19:11.465 INFO:tasks.workunit.client.1.smithi173.stdout:1/473: dwrite db/d1c/d25/d28/f6c [0,4194304] 0 2024-02-16T22:19:11.467 INFO:tasks.workunit.client.1.smithi173.stdout:1/474: truncate db/f75 724743 0 2024-02-16T22:19:11.470 INFO:tasks.workunit.client.1.smithi173.stdout:1/475: rmdir db/d29 39 2024-02-16T22:19:11.470 INFO:tasks.workunit.client.1.smithi173.stdout:1/476: readlink db/d1c/d25/d28/d3f/d4a/l4d 0 2024-02-16T22:19:11.470 INFO:tasks.workunit.client.1.smithi173.stdout:1/477: truncate db/f24 1490513 0 2024-02-16T22:19:11.471 INFO:tasks.workunit.client.1.smithi173.stdout:1/478: stat db/d29/d8f 0 2024-02-16T22:19:11.472 INFO:tasks.workunit.client.1.smithi173.stdout:1/479: rmdir db/d1c/d7f/d9b 0 2024-02-16T22:19:11.472 INFO:tasks.workunit.client.1.smithi173.stdout:1/480: stat db/d1c/d7f 0 2024-02-16T22:19:11.472 INFO:tasks.workunit.client.1.smithi173.stdout:1/481: truncate db/d1c/d25/d28/d3f/d4a/f54 606939 0 2024-02-16T22:19:11.474 INFO:tasks.workunit.client.1.smithi173.stdout:1/482: mknod db/d29/d57/d73/ca8 0 2024-02-16T22:19:11.474 INFO:tasks.workunit.client.1.smithi173.stdout:1/483: stat db/c1a 0 2024-02-16T22:19:11.476 INFO:tasks.workunit.client.1.smithi173.stdout:1/484: unlink db/d1c/d7f/f82 0 2024-02-16T22:19:11.478 INFO:tasks.workunit.client.1.smithi173.stdout:1/485: mkdir db/d5f/da9 0 2024-02-16T22:19:11.478 INFO:tasks.workunit.client.1.smithi173.stdout:1/486: read - db/d1c/d25/d45/fa7 zero size 2024-02-16T22:19:11.479 INFO:tasks.workunit.client.1.smithi173.stdout:1/487: creat db/d1c/d7f/faa x:0 0 0 2024-02-16T22:19:11.479 INFO:tasks.workunit.client.1.smithi173.stdout:1/488: chown db/d29/d57/d8c/l91 1142 1 2024-02-16T22:19:11.489 INFO:tasks.workunit.client.1.smithi173.stdout:1/489: dread db/d30/f72 [0,4194304] 0 2024-02-16T22:19:11.490 INFO:tasks.workunit.client.1.smithi173.stdout:1/490: creat db/d5f/d97/fab x:0 0 0 2024-02-16T22:19:11.491 INFO:tasks.workunit.client.1.smithi173.stdout:1/491: mkdir db/d1c/d5c/dac 0 2024-02-16T22:19:11.491 INFO:tasks.workunit.client.1.smithi173.stdout:1/492: readlink db/d1c/l41 0 2024-02-16T22:19:11.492 INFO:tasks.workunit.client.1.smithi173.stdout:1/493: rename db/d29/d8f/ca5 to db/cad 0 2024-02-16T22:19:11.495 INFO:tasks.workunit.client.1.smithi173.stdout:1/494: getdents db/d1c/d5c 0 2024-02-16T22:19:11.496 INFO:tasks.workunit.client.1.smithi173.stdout:1/495: mkdir db/d1c/d5c/dac/dae 0 2024-02-16T22:19:11.498 INFO:tasks.workunit.client.1.smithi173.stdout:1/496: mkdir db/d1c/d5c/daf 0 2024-02-16T22:19:11.498 INFO:tasks.workunit.client.1.smithi173.stdout:1/497: write db/d1c/f6b [482667,66181] 0 2024-02-16T22:19:11.498 INFO:tasks.workunit.client.1.smithi173.stdout:1/498: getdents db/d29/d57/d73 0 2024-02-16T22:19:11.498 INFO:tasks.workunit.client.1.smithi173.stdout:1/499: write db/d30/f52 [108176,23732] 0 2024-02-16T22:19:11.500 INFO:tasks.workunit.client.1.smithi173.stdout:1/500: symlink db/d1c/d5c/lb0 0 2024-02-16T22:19:11.501 INFO:tasks.workunit.client.1.smithi173.stdout:1/501: truncate db/d1c/d25/d28/f3a 2856824 0 2024-02-16T22:19:11.501 INFO:tasks.workunit.client.1.smithi173.stdout:1/502: readlink db/d1c/d25/d28/d3f/l95 0 2024-02-16T22:19:11.501 INFO:tasks.workunit.client.1.smithi173.stdout:1/503: stat db/d5f/d97/fab 0 2024-02-16T22:19:11.502 INFO:tasks.workunit.client.1.smithi173.stdout:1/504: rename db/d29/d57/d8c/l91 to db/d29/d57/d8c/lb1 0 2024-02-16T22:19:11.503 INFO:tasks.workunit.client.1.smithi173.stdout:1/505: symlink db/d1c/d5c/dac/dae/lb2 0 2024-02-16T22:19:11.503 INFO:tasks.workunit.client.1.smithi173.stdout:1/506: chown db/d30/f52 3236710 1 2024-02-16T22:19:11.504 INFO:tasks.workunit.client.1.smithi173.stdout:1/507: getdents db/d1c/d25/d45 0 2024-02-16T22:19:11.505 INFO:tasks.workunit.client.1.smithi173.stdout:1/508: read db/f1b [664760,52322] 0 2024-02-16T22:19:11.505 INFO:tasks.workunit.client.1.smithi173.stdout:1/509: chown db/c16 76053 1 2024-02-16T22:19:11.506 INFO:tasks.workunit.client.1.smithi173.stdout:1/510: symlink db/d1c/d25/d28/lb3 0 2024-02-16T22:19:11.510 INFO:tasks.workunit.client.1.smithi173.stdout:1/511: mknod db/d1c/d5c/daf/cb4 0 2024-02-16T22:19:11.510 INFO:tasks.workunit.client.1.smithi173.stdout:1/512: fdatasync db/d5f/d97/fab 0 2024-02-16T22:19:11.511 INFO:tasks.workunit.client.1.smithi173.stdout:9/218: sync 2024-02-16T22:19:11.511 INFO:tasks.workunit.client.1.smithi173.stdout:2/360: sync 2024-02-16T22:19:11.512 INFO:tasks.workunit.client.1.smithi173.stdout:4/237: sync 2024-02-16T22:19:11.512 INFO:tasks.workunit.client.1.smithi173.stdout:9/219: rmdir d1/d2/d1a/d2f 39 2024-02-16T22:19:11.514 INFO:tasks.workunit.client.1.smithi173.stdout:2/361: rename d2/dc/d19/d1c/d53/c6f to d2/d4/c7c 0 2024-02-16T22:19:11.515 INFO:tasks.workunit.client.1.smithi173.stdout:9/220: creat d1/d2/d1a/d1f/f45 x:0 0 0 2024-02-16T22:19:11.516 INFO:tasks.workunit.client.1.smithi173.stdout:1/513: dread db/d1c/f37 [0,4194304] 0 2024-02-16T22:19:11.517 INFO:tasks.workunit.client.1.smithi173.stdout:1/514: fdatasync db/d1c/f9e 0 2024-02-16T22:19:11.517 INFO:tasks.workunit.client.1.smithi173.stdout:9/221: creat d1/d2/d10/f46 x:0 0 0 2024-02-16T22:19:11.517 INFO:tasks.workunit.client.1.smithi173.stdout:9/222: chown d1/d2/f24 76913731 1 2024-02-16T22:19:11.518 INFO:tasks.workunit.client.1.smithi173.stdout:1/515: mkdir db/d29/db5 0 2024-02-16T22:19:11.518 INFO:tasks.workunit.client.1.smithi173.stdout:9/223: dread d1/d2/f24 [0,4194304] 0 2024-02-16T22:19:11.518 INFO:tasks.workunit.client.1.smithi173.stdout:1/516: chown db/d5f/c60 66565114 1 2024-02-16T22:19:11.518 INFO:tasks.workunit.client.1.smithi173.stdout:1/517: chown db/d29/d83 2063413 1 2024-02-16T22:19:11.519 INFO:tasks.workunit.client.1.smithi173.stdout:2/362: dread d2/d4/d8/d30/f3b [0,4194304] 0 2024-02-16T22:19:11.520 INFO:tasks.workunit.client.1.smithi173.stdout:9/224: read d1/d2/d1a/f26 [4583326,62853] 0 2024-02-16T22:19:11.520 INFO:tasks.workunit.client.1.smithi173.stdout:2/363: mknod d2/d4/d43/c7d 0 2024-02-16T22:19:11.520 INFO:tasks.workunit.client.1.smithi173.stdout:9/225: mkdir d1/d2/d1a/d3e/d47 0 2024-02-16T22:19:11.521 INFO:tasks.workunit.client.1.smithi173.stdout:9/226: readlink d1/d2/d1a/d2f/d3b/l3c 0 2024-02-16T22:19:11.521 INFO:tasks.workunit.client.1.smithi173.stdout:9/227: creat d1/d2/d10/f48 x:0 0 0 2024-02-16T22:19:11.521 INFO:tasks.workunit.client.1.smithi173.stdout:2/364: creat d2/dc/d19/d1c/d53/f7e x:0 0 0 2024-02-16T22:19:11.521 INFO:tasks.workunit.client.1.smithi173.stdout:2/365: dread - d2/d10/d62/f78 zero size 2024-02-16T22:19:11.522 INFO:tasks.workunit.client.1.smithi173.stdout:2/366: write d2/dc/d5d/f55 [4872754,35103] 0 2024-02-16T22:19:11.522 INFO:tasks.workunit.client.1.smithi173.stdout:9/228: mkdir d1/d2/d1a/d1f/d34/d49 0 2024-02-16T22:19:11.523 INFO:tasks.workunit.client.1.smithi173.stdout:9/229: write d1/d2/d10/f48 [421968,38780] 0 2024-02-16T22:19:11.523 INFO:tasks.workunit.client.1.smithi173.stdout:9/230: stat d1/c1c 0 2024-02-16T22:19:11.526 INFO:tasks.workunit.client.1.smithi173.stdout:2/367: dread d2/d4/d8/d30/f3b [0,4194304] 0 2024-02-16T22:19:11.526 INFO:tasks.workunit.client.1.smithi173.stdout:2/368: read d2/dc/d19/d1a/f52 [105329,19130] 0 2024-02-16T22:19:11.528 INFO:tasks.workunit.client.1.smithi173.stdout:2/369: symlink d2/d10/d62/l7f 0 2024-02-16T22:19:11.531 INFO:tasks.workunit.client.1.smithi173.stdout:9/231: rmdir d1/d2/d1a/d1f 39 2024-02-16T22:19:11.532 INFO:tasks.workunit.client.1.smithi173.stdout:9/232: dread d1/d2/d1a/d1f/f29 [0,4194304] 0 2024-02-16T22:19:11.533 INFO:tasks.workunit.client.1.smithi173.stdout:9/233: mknod d1/d2/d1a/d1f/c4a 0 2024-02-16T22:19:11.541 INFO:tasks.workunit.client.1.smithi173.stdout:1/518: dwrite db/f1b [0,4194304] 0 2024-02-16T22:19:11.547 INFO:tasks.workunit.client.1.smithi173.stdout:9/234: dread d1/f22 [0,4194304] 0 2024-02-16T22:19:11.547 INFO:tasks.workunit.client.1.smithi173.stdout:9/235: fdatasync d1/d2/d1a/d1f/f43 0 2024-02-16T22:19:11.547 INFO:tasks.workunit.client.1.smithi173.stdout:9/236: readlink d1/d2/d1a/d1f/l37 0 2024-02-16T22:19:11.547 INFO:tasks.workunit.client.1.smithi173.stdout:9/237: dread - d1/d2/d10/f46 zero size 2024-02-16T22:19:11.548 INFO:tasks.workunit.client.1.smithi173.stdout:9/238: rmdir d1/d2/d1a/d1f/d34 39 2024-02-16T22:19:11.549 INFO:tasks.workunit.client.1.smithi173.stdout:9/239: truncate d1/f18 1206144 0 2024-02-16T22:19:11.551 INFO:tasks.workunit.client.1.smithi173.stdout:9/240: rename d1/d2/d10/f27 to d1/d2/d1a/d2f/d3b/f4b 0 2024-02-16T22:19:11.553 INFO:tasks.workunit.client.1.smithi173.stdout:9/241: creat d1/d2/f4c x:0 0 0 2024-02-16T22:19:11.553 INFO:tasks.workunit.client.1.smithi173.stdout:9/242: truncate d1/d2/d1a/f2b 1128984 0 2024-02-16T22:19:11.553 INFO:tasks.workunit.client.1.smithi173.stdout:9/243: write d1/d2/f4c [768911,81834] 0 2024-02-16T22:19:11.554 INFO:tasks.workunit.client.1.smithi173.stdout:9/244: truncate d1/d2/d1a/f28 2756463 0 2024-02-16T22:19:11.556 INFO:tasks.workunit.client.1.smithi173.stdout:9/245: rename d1/f39 to d1/d2/d1a/d1f/f4d 0 2024-02-16T22:19:11.556 INFO:tasks.workunit.client.1.smithi173.stdout:9/246: chown d1/d2/d10/f3f 39 1 2024-02-16T22:19:11.562 INFO:tasks.workunit.client.1.smithi173.stdout:1/519: dwrite db/d1c/d5c/f88 [0,4194304] 0 2024-02-16T22:19:11.562 INFO:tasks.workunit.client.1.smithi173.stdout:1/520: write db/d30/f4f [4729014,126024] 0 2024-02-16T22:19:11.563 INFO:tasks.workunit.client.1.smithi173.stdout:1/521: write db/d1d/f84 [909781,13538] 0 2024-02-16T22:19:11.566 INFO:tasks.workunit.client.1.smithi173.stdout:1/522: rename db/f59 to db/d29/d57/d8c/fb6 0 2024-02-16T22:19:11.566 INFO:tasks.workunit.client.1.smithi173.stdout:1/523: fsync db/d1c/d7f/faa 0 2024-02-16T22:19:11.580 INFO:tasks.workunit.client.1.smithi173.stdout:9/247: dwrite d1/d2/f4c [0,4194304] 0 2024-02-16T22:19:11.582 INFO:tasks.workunit.client.1.smithi173.stdout:9/248: creat d1/d2/d1a/d3e/d47/f4e x:0 0 0 2024-02-16T22:19:11.586 INFO:tasks.workunit.client.1.smithi173.stdout:9/249: rename d1/d2/d1a/d3e/d47 to d1/d2/d1a/d3e/d4f 0 2024-02-16T22:19:11.607 INFO:tasks.workunit.client.1.smithi173.stdout:9/250: dwrite d1/d2/d1a/d1f/f45 [0,4194304] 0 2024-02-16T22:19:11.607 INFO:tasks.workunit.client.1.smithi173.stdout:9/251: stat d1/d2/d1a/d3e 0 2024-02-16T22:19:11.609 INFO:tasks.workunit.client.1.smithi173.stdout:9/252: getdents d1/d2/d10 0 2024-02-16T22:19:11.610 INFO:tasks.workunit.client.1.smithi173.stdout:9/253: creat d1/d2/d1a/d2f/f50 x:0 0 0 2024-02-16T22:19:11.611 INFO:tasks.workunit.client.1.smithi173.stdout:9/254: mkdir d1/d2/d1a/d2f/d51 0 2024-02-16T22:19:11.613 INFO:tasks.workunit.client.1.smithi173.stdout:9/255: creat d1/d2/d1a/d3e/f52 x:0 0 0 2024-02-16T22:19:11.613 INFO:tasks.workunit.client.1.smithi173.stdout:9/256: creat d1/d2/d1a/d2f/f53 x:0 0 0 2024-02-16T22:19:11.613 INFO:tasks.workunit.client.1.smithi173.stdout:9/257: write d1/d2/f4c [4340048,28444] 0 2024-02-16T22:19:11.613 INFO:tasks.workunit.client.1.smithi173.stdout:9/258: truncate d1/d2/d10/f2e 742240 0 2024-02-16T22:19:11.620 INFO:tasks.workunit.client.1.smithi173.stdout:9/259: dread d1/d2/d10/f3f [0,4194304] 0 2024-02-16T22:19:11.620 INFO:tasks.workunit.client.1.smithi173.stdout:9/260: symlink d1/d2/d1a/d3e/d4f/l54 0 2024-02-16T22:19:11.622 INFO:tasks.workunit.client.1.smithi173.stdout:9/261: link d1/d2/d1a/d2f/f50 d1/d2/d1a/d1f/d34/f55 0 2024-02-16T22:19:11.623 INFO:tasks.workunit.client.1.smithi173.stdout:9/262: mknod d1/d2/d1a/d2f/d3b/c56 0 2024-02-16T22:19:11.623 INFO:tasks.workunit.client.1.smithi173.stdout:9/263: truncate d1/d2/f24 1939994 0 2024-02-16T22:19:11.627 INFO:tasks.workunit.client.1.smithi173.stdout:9/264: getdents d1/d2/d1a/d3e 0 2024-02-16T22:19:11.627 INFO:tasks.workunit.client.1.smithi173.stdout:9/265: stat d1/d2/d1a/d2f/d3b/c40 0 2024-02-16T22:19:11.627 INFO:tasks.workunit.client.1.smithi173.stdout:9/266: write d1/f18 [1434262,128277] 0 2024-02-16T22:19:11.627 INFO:tasks.workunit.client.1.smithi173.stdout:9/267: chown d1/d2/d1a/d2f/d3b/c3d 35311038 1 2024-02-16T22:19:11.628 INFO:tasks.workunit.client.1.smithi173.stdout:9/268: link d1/d2/d10/f46 d1/d2/d1a/d3e/f57 0 2024-02-16T22:19:11.629 INFO:tasks.workunit.client.1.smithi173.stdout:9/269: truncate d1/d2/d1a/d3e/f52 61761 0 2024-02-16T22:19:11.629 INFO:tasks.workunit.client.1.smithi173.stdout:9/270: write d1/d2/d10/f21 [227096,121263] 0 2024-02-16T22:19:11.629 INFO:tasks.workunit.client.1.smithi173.stdout:9/271: chown d1/d2/d1a/d2f/d3b/f4b 1752080336 1 2024-02-16T22:19:11.643 INFO:tasks.workunit.client.1.smithi173.stdout:9/272: dwrite d1/d2/d10/f11 [0,4194304] 0 2024-02-16T22:19:11.643 INFO:tasks.workunit.client.1.smithi173.stdout:9/273: write d1/d2/d10/f48 [507548,33169] 0 2024-02-16T22:19:11.663 INFO:tasks.workunit.client.1.smithi173.stdout:9/274: dwrite d1/f12 [0,4194304] 0 2024-02-16T22:19:11.681 INFO:tasks.workunit.client.1.smithi173.stdout:9/275: dwrite d1/f12 [0,4194304] 0 2024-02-16T22:19:11.684 INFO:tasks.workunit.client.1.smithi173.stdout:9/276: unlink d1/d2/d1a/d2f/d3b/c56 0 2024-02-16T22:19:11.684 INFO:tasks.workunit.client.1.smithi173.stdout:9/277: write d1/d2/d1a/d2f/d3b/f4b [1270724,85167] 0 2024-02-16T22:19:11.684 INFO:tasks.workunit.client.1.smithi173.stdout:9/278: fsync d1/d2/d1a/f28 0 2024-02-16T22:19:11.686 INFO:tasks.workunit.client.1.smithi173.stdout:9/279: mkdir d1/d2/d10/d58 0 2024-02-16T22:19:11.706 INFO:tasks.workunit.client.1.smithi173.stdout:5/332: sync 2024-02-16T22:19:11.719 INFO:tasks.workunit.client.1.smithi173.stdout:5/333: dread d8/da/d2d/d36/f43 [0,4194304] 0 2024-02-16T22:19:11.723 INFO:tasks.workunit.client.1.smithi173.stdout:5/334: dread f7 [0,4194304] 0 2024-02-16T22:19:11.724 INFO:tasks.workunit.client.1.smithi173.stdout:5/335: mknod d8/da/d1f/c61 0 2024-02-16T22:19:11.725 INFO:tasks.workunit.client.1.smithi173.stdout:5/336: dread d8/da/d1f/d33/f3f [0,4194304] 0 2024-02-16T22:19:11.726 INFO:tasks.workunit.client.1.smithi173.stdout:5/337: rmdir d8/da/d2d/d56 39 2024-02-16T22:19:11.727 INFO:tasks.workunit.client.1.smithi173.stdout:5/338: rename d8/da/d1f/d30/d37 to d8/d27/d62 0 2024-02-16T22:19:11.728 INFO:tasks.workunit.client.1.smithi173.stdout:5/339: mkdir d8/d27/d63 0 2024-02-16T22:19:11.745 INFO:tasks.workunit.client.1.smithi173.stdout:5/340: dwrite d8/da/f1d [0,4194304] 0 2024-02-16T22:19:11.745 INFO:tasks.workunit.client.1.smithi173.stdout:5/341: chown d8/da/d1b/f3b 6 1 2024-02-16T22:19:11.760 INFO:tasks.workunit.client.1.smithi173.stdout:5/342: dwrite d8/d27/d35/f44 [0,4194304] 0 2024-02-16T22:19:11.761 INFO:tasks.workunit.client.1.smithi173.stdout:5/343: readlink d8/da/d1b/l42 0 2024-02-16T22:19:11.762 INFO:tasks.workunit.client.1.smithi173.stdout:5/344: rmdir d8/d27/d2f/d58 0 2024-02-16T22:19:11.763 INFO:tasks.workunit.client.1.smithi173.stdout:5/345: write d8/da/d2d/d36/f55 [3284942,65869] 0 2024-02-16T22:19:11.764 INFO:tasks.workunit.client.1.smithi173.stdout:5/346: creat d8/da/d1b/f64 x:0 0 0 2024-02-16T22:19:11.764 INFO:tasks.workunit.client.1.smithi173.stdout:5/347: write d8/d27/d28/f39 [710717,28107] 0 2024-02-16T22:19:11.764 INFO:tasks.workunit.client.1.smithi173.stdout:5/348: symlink d8/d27/d2f/l65 0 2024-02-16T22:19:11.780 INFO:tasks.workunit.client.1.smithi173.stdout:5/349: dwrite d8/d27/d35/f5e [0,4194304] 0 2024-02-16T22:19:11.797 INFO:tasks.workunit.client.1.smithi173.stdout:5/350: dwrite d8/da/d2d/d36/f3d [0,4194304] 0 2024-02-16T22:19:11.799 INFO:tasks.workunit.client.1.smithi173.stdout:5/351: rename d8/da/d2d/d56/l5c to d8/da/d1f/d30/l66 0 2024-02-16T22:19:11.800 INFO:tasks.workunit.client.1.smithi173.stdout:5/352: link d8/da/d1b/c22 d8/c67 0 2024-02-16T22:19:11.801 INFO:tasks.workunit.client.1.smithi173.stdout:5/353: creat d8/d27/d62/f68 x:0 0 0 2024-02-16T22:19:11.802 INFO:tasks.workunit.client.1.smithi173.stdout:5/354: link d8/d27/d2f/l5f d8/d27/d63/l69 0 2024-02-16T22:19:11.802 INFO:tasks.workunit.client.1.smithi173.stdout:5/355: readlink d8/da/d2d/d3a/l5d 0 2024-02-16T22:19:11.802 INFO:tasks.workunit.client.1.smithi173.stdout:5/356: chown d8/da/l4c 43786 1 2024-02-16T22:19:11.803 INFO:tasks.workunit.client.1.smithi173.stdout:5/357: creat d8/f6a x:0 0 0 2024-02-16T22:19:11.804 INFO:tasks.workunit.client.1.smithi173.stdout:5/358: unlink d8/da/d2d/d36/f55 0 2024-02-16T22:19:11.805 INFO:tasks.workunit.client.1.smithi173.stdout:5/359: link d8/d27/d63/l69 d8/da/d1f/d33/l6b 0 2024-02-16T22:19:11.814 INFO:tasks.workunit.client.1.smithi173.stdout:8/400: sync 2024-02-16T22:19:11.815 INFO:tasks.workunit.client.1.smithi173.stdout:5/360: dread d8/da/f1a [0,4194304] 0 2024-02-16T22:19:11.815 INFO:tasks.workunit.client.1.smithi173.stdout:5/361: creat d8/d27/d35/f6c x:0 0 0 2024-02-16T22:19:11.815 INFO:tasks.workunit.client.1.smithi173.stdout:8/401: mkdir dd/d7c/d7d/d93 0 2024-02-16T22:19:11.815 INFO:tasks.workunit.client.1.smithi173.stdout:8/402: chown dd/d7c/d7d/d22/d28/d40/l4c 1651794 1 2024-02-16T22:19:11.817 INFO:tasks.workunit.client.1.smithi173.stdout:5/362: mknod d8/c6d 0 2024-02-16T22:19:11.817 INFO:tasks.workunit.client.1.smithi173.stdout:5/363: write d8/d27/d28/f39 [1300947,53307] 0 2024-02-16T22:19:11.818 INFO:tasks.workunit.client.1.smithi173.stdout:8/403: creat dd/d7c/d7d/d22/d2e/f94 x:0 0 0 2024-02-16T22:19:11.818 INFO:tasks.workunit.client.1.smithi173.stdout:5/364: rmdir d8/da/d2d 39 2024-02-16T22:19:11.819 INFO:tasks.workunit.client.1.smithi173.stdout:8/404: getdents dd/d7c/d7d/d22/d28/d40/d52 0 2024-02-16T22:19:11.820 INFO:tasks.workunit.client.1.smithi173.stdout:5/365: dread d8/da/d2d/d36/f40 [0,4194304] 0 2024-02-16T22:19:11.820 INFO:tasks.workunit.client.1.smithi173.stdout:8/405: link dd/d7c/d7d/d22/d2e/d41/l68 dd/d7c/d7d/d22/d2e/d41/l95 0 2024-02-16T22:19:11.821 INFO:tasks.workunit.client.1.smithi173.stdout:5/366: mknod d8/da/d1b/d57/c6e 0 2024-02-16T22:19:11.832 INFO:tasks.workunit.client.1.smithi173.stdout:5/367: read d8/da/d2d/d36/f3d [449483,10940] 0 2024-02-16T22:19:11.835 INFO:tasks.workunit.client.1.smithi173.stdout:5/368: dread d8/fd [0,4194304] 0 2024-02-16T22:19:11.851 INFO:tasks.workunit.client.1.smithi173.stdout:8/406: dwrite dd/d7c/d7d/f13 [0,4194304] 0 2024-02-16T22:19:11.851 INFO:tasks.workunit.client.1.smithi173.stdout:8/407: write dd/d7c/d7d/f3d [1046078,11691] 0 2024-02-16T22:19:11.851 INFO:tasks.workunit.client.1.smithi173.stdout:5/369: dwrite d8/d27/d28/f39 [0,4194304] 0 2024-02-16T22:19:11.854 INFO:tasks.workunit.client.1.smithi173.stdout:5/370: mkdir d8/da/d1f/d6f 0 2024-02-16T22:19:11.854 INFO:tasks.workunit.client.1.smithi173.stdout:5/371: fsync d8/fb 0 2024-02-16T22:19:11.854 INFO:tasks.workunit.client.1.smithi173.stdout:5/372: fsync d8/da/d2d/d36/f40 0 2024-02-16T22:19:11.870 INFO:tasks.workunit.client.1.smithi173.stdout:5/373: dwrite d8/da/d1f/d33/f4b [0,4194304] 0 2024-02-16T22:19:11.880 INFO:tasks.workunit.client.1.smithi173.stdout:5/374: dread d8/f29 [0,4194304] 0 2024-02-16T22:19:11.899 INFO:tasks.workunit.client.1.smithi173.stdout:5/375: dwrite d8/da/d1f/f51 [0,4194304] 0 2024-02-16T22:19:11.902 INFO:tasks.workunit.client.1.smithi173.stdout:5/376: dread d8/da/d1b/f3b [0,4194304] 0 2024-02-16T22:19:11.923 INFO:tasks.workunit.client.1.smithi173.stdout:5/377: dwrite d8/fb [0,4194304] 0 2024-02-16T22:19:11.925 INFO:tasks.workunit.client.1.smithi173.stdout:5/378: mkdir d8/d27/d70 0 2024-02-16T22:19:11.925 INFO:tasks.workunit.client.1.smithi173.stdout:5/379: truncate d8/da/d1b/f52 56818 0 2024-02-16T22:19:11.926 INFO:tasks.workunit.client.1.smithi173.stdout:5/380: creat d8/da/d2d/d36/f71 x:0 0 0 2024-02-16T22:19:11.929 INFO:tasks.workunit.client.1.smithi173.stdout:5/381: rename d8/da/d1f/c25 to d8/d27/d70/c72 0 2024-02-16T22:19:11.929 INFO:tasks.workunit.client.1.smithi173.stdout:5/382: write d8/da/d1b/f52 [317266,27231] 0 2024-02-16T22:19:11.930 INFO:tasks.workunit.client.1.smithi173.stdout:5/383: mkdir d8/da/d1f/d73 0 2024-02-16T22:19:11.939 INFO:tasks.workunit.client.1.smithi173.stdout:5/384: truncate d8/da/d1f/f51 82903 0 2024-02-16T22:19:11.963 INFO:tasks.workunit.client.1.smithi173.stdout:5/385: dwrite d8/da/d2d/d36/f43 [0,4194304] 0 2024-02-16T22:19:11.963 INFO:tasks.workunit.client.1.smithi173.stdout:5/386: stat d8/d27/d63 0 2024-02-16T22:19:11.963 INFO:tasks.workunit.client.1.smithi173.stdout:5/387: chown c5 70468 1 2024-02-16T22:19:11.963 INFO:tasks.workunit.client.1.smithi173.stdout:5/388: fdatasync d8/da/d2d/d36/f43 0 2024-02-16T22:19:11.983 INFO:tasks.workunit.client.1.smithi173.stdout:5/389: dwrite d8/da/d1f/f51 [0,4194304] 0 2024-02-16T22:19:11.993 INFO:tasks.workunit.client.1.smithi173.stdout:6/331: sync 2024-02-16T22:19:11.994 INFO:tasks.workunit.client.1.smithi173.stdout:7/285: sync 2024-02-16T22:19:11.995 INFO:tasks.workunit.client.1.smithi173.stdout:5/390: write d8/f2e [5252861,25935] 0 2024-02-16T22:19:11.995 INFO:tasks.workunit.client.1.smithi173.stdout:6/332: mkdir d0/db/d2e/d65/d73/d7d 0 2024-02-16T22:19:11.995 INFO:tasks.workunit.client.1.smithi173.stdout:6/333: read d0/db/d2e/d2f/d31/f39 [58714,9217] 0 2024-02-16T22:19:11.995 INFO:tasks.workunit.client.1.smithi173.stdout:6/334: readlink d0/db/d2e/d65/l68 0 2024-02-16T22:19:12.003 INFO:tasks.workunit.client.1.smithi173.stdout:7/286: write d1/d5/d13/f26 [3726352,3813] 0 2024-02-16T22:19:12.003 INFO:tasks.workunit.client.1.smithi173.stdout:7/287: dread - d1/d5/d11/f42 zero size 2024-02-16T22:19:12.006 INFO:tasks.workunit.client.1.smithi173.stdout:7/288: symlink d1/l56 0 2024-02-16T22:19:12.007 INFO:tasks.workunit.client.1.smithi173.stdout:7/289: write d1/d5/d13/d36/f4d [1889142,1479] 0 2024-02-16T22:19:12.007 INFO:tasks.workunit.client.1.smithi173.stdout:7/290: stat d1/d5/d54 0 2024-02-16T22:19:12.007 INFO:tasks.workunit.client.1.smithi173.stdout:5/391: dread d8/da/f45 [0,4194304] 0 2024-02-16T22:19:12.008 INFO:tasks.workunit.client.1.smithi173.stdout:5/392: creat d8/da/d2d/d3a/f74 x:0 0 0 2024-02-16T22:19:12.010 INFO:tasks.workunit.client.1.smithi173.stdout:5/393: creat d8/da/d1b/d57/f75 x:0 0 0 2024-02-16T22:19:12.011 INFO:tasks.workunit.client.1.smithi173.stdout:5/394: dread - d8/da/d1b/d57/f75 zero size 2024-02-16T22:19:12.013 INFO:tasks.workunit.client.1.smithi173.stdout:5/395: unlink d8/c6d 0 2024-02-16T22:19:12.013 INFO:tasks.workunit.client.1.smithi173.stdout:5/396: write d8/da/d1b/f64 [994684,32263] 0 2024-02-16T22:19:12.023 INFO:tasks.workunit.client.1.smithi173.stdout:7/291: dwrite d1/d5/d13/d36/d49/f35 [0,4194304] 0 2024-02-16T22:19:12.024 INFO:tasks.workunit.client.1.smithi173.stdout:7/292: creat d1/d1d/d44/f57 x:0 0 0 2024-02-16T22:19:12.040 INFO:tasks.workunit.client.1.smithi173.stdout:7/293: dwrite d1/d1d/f1e [0,4194304] 0 2024-02-16T22:19:12.048 INFO:tasks.workunit.client.1.smithi173.stdout:7/294: write d1/d5/d13/d36/f4a [2661708,23745] 0 2024-02-16T22:19:12.055 INFO:tasks.workunit.client.1.smithi173.stdout:7/295: dread d1/d5/d13/d36/f4a [0,4194304] 0 2024-02-16T22:19:12.078 INFO:tasks.workunit.client.1.smithi173.stdout:7/296: dwrite d1/f2f [0,4194304] 0 2024-02-16T22:19:12.078 INFO:tasks.workunit.client.1.smithi173.stdout:7/297: getdents d1/d5/d11/d39 0 2024-02-16T22:19:12.083 INFO:tasks.workunit.client.1.smithi173.stdout:7/298: getdents d1/d1d/d44 0 2024-02-16T22:19:12.105 INFO:tasks.workunit.client.1.smithi173.stdout:7/299: dwrite d1/d1d/f20 [0,4194304] 0 2024-02-16T22:19:12.105 INFO:tasks.workunit.client.1.smithi173.stdout:7/300: truncate d1/d1d/f20 4601049 0 2024-02-16T22:19:12.107 INFO:tasks.workunit.client.1.smithi173.stdout:7/301: link d1/d5/d13/d22/d53/d27/c30 d1/d5/d13/d36/c58 0 2024-02-16T22:19:12.107 INFO:tasks.workunit.client.1.smithi173.stdout:7/302: fdatasync d1/d1d/f4e 0 2024-02-16T22:19:12.107 INFO:tasks.workunit.client.1.smithi173.stdout:7/303: getdents d1 0 2024-02-16T22:19:12.108 INFO:tasks.workunit.client.1.smithi173.stdout:7/304: creat d1/d1d/d44/f59 x:0 0 0 2024-02-16T22:19:12.129 INFO:tasks.workunit.client.1.smithi173.stdout:7/305: dwrite d1/d5/d13/d36/f52 [0,4194304] 0 2024-02-16T22:19:12.129 INFO:tasks.workunit.client.1.smithi173.stdout:7/306: chown d1/d5/d13/d22/d53/d27/c30 11647 1 2024-02-16T22:19:12.129 INFO:tasks.workunit.client.1.smithi173.stdout:7/307: truncate d1/d5/d11/f42 17757 0 2024-02-16T22:19:12.130 INFO:tasks.workunit.client.1.smithi173.stdout:7/308: dread d1/d1d/f45 [0,4194304] 0 2024-02-16T22:19:12.132 INFO:tasks.workunit.client.1.smithi173.stdout:7/309: rename d1/d5/d13/l37 to d1/d5/d11/d39/l5a 0 2024-02-16T22:19:12.133 INFO:tasks.workunit.client.1.smithi173.stdout:7/310: symlink d1/d5/d11/d39/l5b 0 2024-02-16T22:19:12.134 INFO:tasks.workunit.client.1.smithi173.stdout:7/311: truncate d1/d5/d13/d22/d53/f24 1845803 0 2024-02-16T22:19:12.135 INFO:tasks.workunit.client.1.smithi173.stdout:7/312: creat d1/d5/d48/f5c x:0 0 0 2024-02-16T22:19:12.155 INFO:tasks.workunit.client.1.smithi173.stdout:7/313: dwrite d1/d5/d13/f26 [0,4194304] 0 2024-02-16T22:19:12.156 INFO:tasks.workunit.client.1.smithi173.stdout:7/314: unlink d1/c21 0 2024-02-16T22:19:12.164 INFO:tasks.workunit.client.1.smithi173.stdout:3/316: sync 2024-02-16T22:19:12.164 INFO:tasks.workunit.client.1.smithi173.stdout:0/258: sync 2024-02-16T22:19:12.164 INFO:tasks.workunit.client.1.smithi173.stdout:3/317: dread - d9/d1a/f61 zero size 2024-02-16T22:19:12.166 INFO:tasks.workunit.client.1.smithi173.stdout:3/318: unlink d9/d1a/d2b/d4d/c67 0 2024-02-16T22:19:12.176 INFO:tasks.workunit.client.1.smithi173.stdout:3/319: write d9/d17/d25/f50 [1017234,23434] 0 2024-02-16T22:19:12.183 INFO:tasks.workunit.client.1.smithi173.stdout:7/315: dwrite d1/f2f [0,4194304] 0 2024-02-16T22:19:12.183 INFO:tasks.workunit.client.1.smithi173.stdout:7/316: creat d1/d5/d48/f5d x:0 0 0 2024-02-16T22:19:12.183 INFO:tasks.workunit.client.1.smithi173.stdout:7/317: chown d1/d1d/f4e 4971 1 2024-02-16T22:19:12.184 INFO:tasks.workunit.client.1.smithi173.stdout:0/259: dwrite d0/d12/f4d [0,4194304] 0 2024-02-16T22:19:12.184 INFO:tasks.workunit.client.1.smithi173.stdout:0/260: fdatasync d0/d4/d14/d38/f49 0 2024-02-16T22:19:12.185 INFO:tasks.workunit.client.1.smithi173.stdout:7/318: rename d1/d5/d13/l23 to d1/d5/d13/d36/l5e 0 2024-02-16T22:19:12.187 INFO:tasks.workunit.client.1.smithi173.stdout:0/261: dread d0/d4/f7 [0,4194304] 0 2024-02-16T22:19:12.194 INFO:tasks.workunit.client.1.smithi173.stdout:3/320: dwrite d9/da/f1b [4194304,4194304] 0 2024-02-16T22:19:12.196 INFO:tasks.workunit.client.1.smithi173.stdout:3/321: getdents d9/d18/d5f 0 2024-02-16T22:19:12.198 INFO:tasks.workunit.client.1.smithi173.stdout:3/322: getdents d9/d1a/d2b/d4d 0 2024-02-16T22:19:12.198 INFO:tasks.workunit.client.1.smithi173.stdout:3/323: chown d9/da/fd 805 1 2024-02-16T22:19:12.200 INFO:tasks.workunit.client.1.smithi173.stdout:3/324: creat d9/d18/d73/f75 x:0 0 0 2024-02-16T22:19:12.200 INFO:tasks.workunit.client.1.smithi173.stdout:7/319: dread d1/d5/d13/d36/f52 [0,4194304] 0 2024-02-16T22:19:12.201 INFO:tasks.workunit.client.1.smithi173.stdout:3/325: rename d9/da/f1b to d9/d1a/d2b/d4d/d5b/f76 0 2024-02-16T22:19:12.203 INFO:tasks.workunit.client.1.smithi173.stdout:7/320: rename d1/d5/d13/d22/d53/c1a to d1/d5/c5f 0 2024-02-16T22:19:12.204 INFO:tasks.workunit.client.1.smithi173.stdout:7/321: getdents d1/d1d 0 2024-02-16T22:19:12.208 INFO:tasks.workunit.client.1.smithi173.stdout:0/262: dwrite d0/d4/d14/f16 [0,4194304] 0 2024-02-16T22:19:12.208 INFO:tasks.workunit.client.1.smithi173.stdout:0/263: write d0/d4/d14/d24/d32/d39/f42 [641806,12218] 0 2024-02-16T22:19:12.212 INFO:tasks.workunit.client.1.smithi173.stdout:0/264: mknod d0/d4/d14/d24/d2e/c52 0 2024-02-16T22:19:12.213 INFO:tasks.workunit.client.1.smithi173.stdout:3/326: dread d9/da/f15 [0,4194304] 0 2024-02-16T22:19:12.214 INFO:tasks.workunit.client.1.smithi173.stdout:3/327: truncate d9/d17/f48 1868500 0 2024-02-16T22:19:12.215 INFO:tasks.workunit.client.1.smithi173.stdout:3/328: creat d9/d1a/d2b/d4d/d5b/f77 x:0 0 0 2024-02-16T22:19:12.220 INFO:tasks.workunit.client.1.smithi173.stdout:0/265: write d0/d4/fa [978102,126346] 0 2024-02-16T22:19:12.220 INFO:tasks.workunit.client.1.smithi173.stdout:0/266: stat d0/d4/d14/d24/d32/d39/f2c 0 2024-02-16T22:19:12.221 INFO:tasks.workunit.client.1.smithi173.stdout:0/267: symlink d0/d4/d14/d24/l53 0 2024-02-16T22:19:12.222 INFO:tasks.workunit.client.1.smithi173.stdout:0/268: rmdir d0/d4/d14 39 2024-02-16T22:19:12.223 INFO:tasks.workunit.client.1.smithi173.stdout:0/269: mkdir d0/d4/d33/d54 0 2024-02-16T22:19:12.241 INFO:tasks.workunit.client.1.smithi173.stdout:0/270: dwrite d0/d4/f18 [4194304,4194304] 0 2024-02-16T22:19:12.242 INFO:tasks.workunit.client.1.smithi173.stdout:0/271: fdatasync d0/f11 0 2024-02-16T22:19:12.242 INFO:tasks.workunit.client.1.smithi173.stdout:0/272: stat d0/d4/d14/l2f 0 2024-02-16T22:19:12.270 INFO:tasks.workunit.client.1.smithi173.stdout:3/329: dwrite d9/da/f43 [0,4194304] 0 2024-02-16T22:19:12.270 INFO:tasks.workunit.client.1.smithi173.stdout:3/330: truncate d9/d17/d25/f4a 1356004 0 2024-02-16T22:19:12.272 INFO:tasks.workunit.client.1.smithi173.stdout:3/331: symlink d9/d18/d73/l78 0 2024-02-16T22:19:12.272 INFO:tasks.workunit.client.1.smithi173.stdout:3/332: write f8 [5673057,106363] 0 2024-02-16T22:19:12.273 INFO:tasks.workunit.client.1.smithi173.stdout:0/273: truncate d0/d4/f18 1602868 0 2024-02-16T22:19:12.275 INFO:tasks.workunit.client.1.smithi173.stdout:3/333: rmdir d9/d1a/d2b/d45 39 2024-02-16T22:19:12.275 INFO:tasks.workunit.client.1.smithi173.stdout:0/274: truncate d0/d4/d14/f16 2813586 0 2024-02-16T22:19:12.277 INFO:tasks.workunit.client.1.smithi173.stdout:0/275: getdents d0/d4/d33 0 2024-02-16T22:19:12.279 INFO:tasks.workunit.client.1.smithi173.stdout:0/276: getdents d0/d12/d15 0 2024-02-16T22:19:12.289 INFO:tasks.workunit.client.1.smithi173.stdout:3/334: dwrite d9/da/f70 [0,4194304] 0 2024-02-16T22:19:12.295 INFO:tasks.workunit.client.1.smithi173.stdout:0/277: dread d0/d4/fa [0,4194304] 0 2024-02-16T22:19:12.300 INFO:tasks.workunit.client.1.smithi173.stdout:0/278: dread d0/f1 [0,4194304] 0 2024-02-16T22:19:12.300 INFO:tasks.workunit.client.1.smithi173.stdout:0/279: stat d0/d12/d15/d3d 0 2024-02-16T22:19:12.306 INFO:tasks.workunit.client.1.smithi173.stdout:3/335: dwrite d9/d18/f62 [0,4194304] 0 2024-02-16T22:19:12.306 INFO:tasks.workunit.client.1.smithi173.stdout:3/336: truncate d9/d17/d25/f3e 4531993 0 2024-02-16T22:19:12.327 INFO:tasks.workunit.client.1.smithi173.stdout:0/280: mknod d0/d4/d14/d24/d2e/c55 0 2024-02-16T22:19:12.329 INFO:tasks.workunit.client.1.smithi173.stdout:0/281: dread d0/f5 [0,4194304] 0 2024-02-16T22:19:12.353 INFO:tasks.workunit.client.1.smithi173.stdout:0/282: symlink d0/d4/d14/d24/d32/d39/l56 0 2024-02-16T22:19:12.381 INFO:tasks.workunit.client.1.smithi173.stdout:0/283: getdents d0/d4/d14/d24/d32/d39 0 2024-02-16T22:19:12.397 INFO:tasks.workunit.client.1.smithi173.stdout:0/284: dwrite d0/d4/f8 [0,4194304] 0 2024-02-16T22:19:12.399 INFO:tasks.workunit.client.1.smithi173.stdout:3/337: rename d9/c6c to d9/d1a/d2b/d45/d60/d6a/c79 0 2024-02-16T22:19:12.400 INFO:tasks.workunit.client.1.smithi173.stdout:3/338: mkdir d9/d1a/d2b/d49/d7a 0 2024-02-16T22:19:12.418 INFO:tasks.workunit.client.1.smithi173.stdout:8/408: sync 2024-02-16T22:19:12.419 INFO:tasks.workunit.client.1.smithi173.stdout:7/322: sync 2024-02-16T22:19:12.419 INFO:tasks.workunit.client.1.smithi173.stdout:5/397: sync 2024-02-16T22:19:12.419 INFO:tasks.workunit.client.1.smithi173.stdout:2/370: sync 2024-02-16T22:19:12.419 INFO:tasks.workunit.client.1.smithi173.stdout:5/398: fdatasync d8/d27/d28/f5b 0 2024-02-16T22:19:12.419 INFO:tasks.workunit.client.1.smithi173.stdout:7/323: creat d1/d1d/d44/f60 x:0 0 0 2024-02-16T22:19:12.419 INFO:tasks.workunit.client.1.smithi173.stdout:4/238: sync 2024-02-16T22:19:12.419 INFO:tasks.workunit.client.1.smithi173.stdout:4/239: dread - d7/d28/d31/f37 zero size 2024-02-16T22:19:12.419 INFO:tasks.workunit.client.1.smithi173.stdout:6/335: sync 2024-02-16T22:19:12.419 INFO:tasks.workunit.client.1.smithi173.stdout:1/524: sync 2024-02-16T22:19:12.419 INFO:tasks.workunit.client.1.smithi173.stdout:6/336: stat d0/db/d2e/d2f/d31/f55 0 2024-02-16T22:19:12.419 INFO:tasks.workunit.client.1.smithi173.stdout:6/337: readlink d0/l2 0 2024-02-16T22:19:12.419 INFO:tasks.workunit.client.1.smithi173.stdout:6/338: fsync d0/db/d2e/d2f/f4c 0 2024-02-16T22:19:12.419 INFO:tasks.workunit.client.1.smithi173.stdout:9/280: sync 2024-02-16T22:19:12.421 INFO:tasks.workunit.client.1.smithi173.stdout:5/399: truncate d8/f29 7068160 0 2024-02-16T22:19:12.423 INFO:tasks.workunit.client.1.smithi173.stdout:4/240: unlink d7/d12/d2d/f4b 0 2024-02-16T22:19:12.423 INFO:tasks.workunit.client.1.smithi173.stdout:4/241: readlink d7/d28/d14/l35 0 2024-02-16T22:19:12.424 INFO:tasks.workunit.client.1.smithi173.stdout:0/285: dwrite d0/d4/d14/f16 [0,4194304] 0 2024-02-16T22:19:12.425 INFO:tasks.workunit.client.1.smithi173.stdout:3/339: dwrite d9/f22 [0,4194304] 0 2024-02-16T22:19:12.425 INFO:tasks.workunit.client.1.smithi173.stdout:3/340: creat d9/d1a/d2b/d4d/d5b/f7b x:0 0 0 2024-02-16T22:19:12.425 INFO:tasks.workunit.client.1.smithi173.stdout:3/341: write d9/d17/f54 [748533,84645] 0 2024-02-16T22:19:12.425 INFO:tasks.workunit.client.1.smithi173.stdout:5/400: symlink d8/da/d2d/d56/l76 0 2024-02-16T22:19:12.425 INFO:tasks.workunit.client.1.smithi173.stdout:5/401: stat d8/da/f47 0 2024-02-16T22:19:12.429 INFO:tasks.workunit.client.1.smithi173.stdout:0/286: rename d0/d4/fa to d0/d4/d27/f57 0 2024-02-16T22:19:12.429 INFO:tasks.workunit.client.1.smithi173.stdout:0/287: stat d0/d4/d27/f57 0 2024-02-16T22:19:12.429 INFO:tasks.workunit.client.1.smithi173.stdout:0/288: chown d0/d4/d14/d24/d32/d39 42878 1 2024-02-16T22:19:12.431 INFO:tasks.workunit.client.1.smithi173.stdout:6/339: rmdir d0/db 39 2024-02-16T22:19:12.431 INFO:tasks.workunit.client.1.smithi173.stdout:6/340: fdatasync d0/db/d2e/d2f/d31/f55 0 2024-02-16T22:19:12.431 INFO:tasks.workunit.client.1.smithi173.stdout:6/341: stat d0/db/d2e/f37 0 2024-02-16T22:19:12.433 INFO:tasks.workunit.client.1.smithi173.stdout:5/402: creat d8/d27/d70/f77 x:0 0 0 2024-02-16T22:19:12.435 INFO:tasks.workunit.client.1.smithi173.stdout:0/289: mkdir d0/d4/d14/d24/d58 0 2024-02-16T22:19:12.436 INFO:tasks.workunit.client.1.smithi173.stdout:7/324: dread d1/f9 [0,4194304] 0 2024-02-16T22:19:12.436 INFO:tasks.workunit.client.1.smithi173.stdout:3/342: rename d9/da/f27 to d9/f7c 0 2024-02-16T22:19:12.437 INFO:tasks.workunit.client.1.smithi173.stdout:3/343: creat d9/d1a/d2b/d4d/d5b/f7d x:0 0 0 2024-02-16T22:19:12.437 INFO:tasks.workunit.client.1.smithi173.stdout:3/344: creat d9/da/f7e x:0 0 0 2024-02-16T22:19:12.437 INFO:tasks.workunit.client.1.smithi173.stdout:3/345: dread - d9/d1a/d2b/d4d/d5b/f77 zero size 2024-02-16T22:19:12.438 INFO:tasks.workunit.client.1.smithi173.stdout:6/342: creat d0/db/d2e/f7e x:0 0 0 2024-02-16T22:19:12.439 INFO:tasks.workunit.client.1.smithi173.stdout:5/403: symlink d8/l78 0 2024-02-16T22:19:12.440 INFO:tasks.workunit.client.1.smithi173.stdout:0/290: symlink d0/d4/d14/d24/d32/l59 0 2024-02-16T22:19:12.440 INFO:tasks.workunit.client.1.smithi173.stdout:7/325: symlink d1/l61 0 2024-02-16T22:19:12.443 INFO:tasks.workunit.client.1.smithi173.stdout:3/346: symlink d9/d1a/d2b/d49/l7f 0 2024-02-16T22:19:12.445 INFO:tasks.workunit.client.1.smithi173.stdout:6/343: symlink d0/db/d2e/d2f/d31/d7a/l7f 0 2024-02-16T22:19:12.446 INFO:tasks.workunit.client.1.smithi173.stdout:5/404: rename d8/da/d1f/d33/f3f to d8/da/d1b/d57/f79 0 2024-02-16T22:19:12.447 INFO:tasks.workunit.client.1.smithi173.stdout:0/291: link d0/d4/d33/f3c d0/d4/d27/f5a 0 2024-02-16T22:19:12.448 INFO:tasks.workunit.client.1.smithi173.stdout:6/344: creat d0/db/d2e/d65/d67/f80 x:0 0 0 2024-02-16T22:19:12.450 INFO:tasks.workunit.client.1.smithi173.stdout:7/326: rename d1/d5/d13/d36/d49/f3b to d1/d5/d13/d22/d53/d27/f62 0 2024-02-16T22:19:12.451 INFO:tasks.workunit.client.1.smithi173.stdout:7/327: chown d1/d5/d13/d22/d53/d27/f62 147593106 1 2024-02-16T22:19:12.451 INFO:tasks.workunit.client.1.smithi173.stdout:7/328: read - d1/d1d/d44/f57 zero size 2024-02-16T22:19:12.451 INFO:tasks.workunit.client.1.smithi173.stdout:7/329: stat d1/l56 0 2024-02-16T22:19:12.451 INFO:tasks.workunit.client.1.smithi173.stdout:7/330: fdatasync d1/d1d/f4e 0 2024-02-16T22:19:12.451 INFO:tasks.workunit.client.1.smithi173.stdout:7/331: truncate d1/d5/d13/d22/d53/f24 2704895 0 2024-02-16T22:19:12.451 INFO:tasks.workunit.client.1.smithi173.stdout:7/332: write d1/d5/d48/f5c [645867,21821] 0 2024-02-16T22:19:12.451 INFO:tasks.workunit.client.1.smithi173.stdout:5/405: truncate d8/da/f45 313854 0 2024-02-16T22:19:12.451 INFO:tasks.workunit.client.1.smithi173.stdout:5/406: chown d8/f29 0 1 2024-02-16T22:19:12.452 INFO:tasks.workunit.client.1.smithi173.stdout:0/292: link d0/d12/d15/l45 d0/d4/d14/d24/d58/l5b 0 2024-02-16T22:19:12.452 INFO:tasks.workunit.client.1.smithi173.stdout:0/293: chown d0/d4/f3e 234 1 2024-02-16T22:19:12.460 INFO:tasks.workunit.client.1.smithi173.stdout:2/371: dwrite d2/d10/f66 [0,4194304] 0 2024-02-16T22:19:12.461 INFO:tasks.workunit.client.1.smithi173.stdout:2/372: write d2/dc/d19/f16 [2815594,10913] 0 2024-02-16T22:19:12.464 INFO:tasks.workunit.client.1.smithi173.stdout:2/373: read f1 [23238,78124] 0 2024-02-16T22:19:12.466 INFO:tasks.workunit.client.1.smithi173.stdout:5/407: dread d8/d27/d35/f5e [0,4194304] 0 2024-02-16T22:19:12.467 INFO:tasks.workunit.client.1.smithi173.stdout:5/408: mknod d8/d27/d35/c7a 0 2024-02-16T22:19:12.467 INFO:tasks.workunit.client.1.smithi173.stdout:5/409: stat d8/d27/d28/f5b 0 2024-02-16T22:19:12.468 INFO:tasks.workunit.client.1.smithi173.stdout:5/410: mknod d8/c7b 0 2024-02-16T22:19:12.471 INFO:tasks.workunit.client.1.smithi173.stdout:5/411: unlink d8/da/d1b/f3b 0 2024-02-16T22:19:12.471 INFO:tasks.workunit.client.1.smithi173.stdout:5/412: write d8/da/f23 [579979,114490] 0 2024-02-16T22:19:12.471 INFO:tasks.workunit.client.1.smithi173.stdout:5/413: symlink d8/d27/d28/l7c 0 2024-02-16T22:19:12.472 INFO:tasks.workunit.client.1.smithi173.stdout:5/414: creat d8/f7d x:0 0 0 2024-02-16T22:19:12.473 INFO:tasks.workunit.client.1.smithi173.stdout:5/415: write d8/da/d1b/d57/f79 [644793,124822] 0 2024-02-16T22:19:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:12 smithi134 ceph-mon[28869]: pgmap v258: 65 pgs: 65 active+clean; 2.3 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 144 MiB/s rd, 184 MiB/s wr, 255 op/s 2024-02-16T22:19:12.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:12 smithi173 ceph-mon[37280]: pgmap v258: 65 pgs: 65 active+clean; 2.3 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 144 MiB/s rd, 184 MiB/s wr, 255 op/s 2024-02-16T22:19:12.490 INFO:tasks.workunit.client.1.smithi173.stdout:5/416: dwrite d8/d27/d28/f5b [0,4194304] 0 2024-02-16T22:19:12.490 INFO:tasks.workunit.client.1.smithi173.stdout:5/417: chown d8/f29 6939110 1 2024-02-16T22:19:12.490 INFO:tasks.workunit.client.1.smithi173.stdout:5/418: fsync d8/fd 0 2024-02-16T22:19:12.490 INFO:tasks.workunit.client.1.smithi173.stdout:5/419: fsync d8/da/d1f/d30/f59 0 2024-02-16T22:19:12.491 INFO:tasks.workunit.client.1.smithi173.stdout:8/409: dwrite dd/d7c/d7d/d22/d2e/f7b [0,4194304] 0 2024-02-16T22:19:12.496 INFO:tasks.workunit.client.1.smithi173.stdout:1/525: dwrite db/d1c/f6b [0,4194304] 0 2024-02-16T22:19:12.496 INFO:tasks.workunit.client.1.smithi173.stdout:9/281: dwrite d1/d2/d1a/d1f/f29 [0,4194304] 0 2024-02-16T22:19:12.496 INFO:tasks.workunit.client.1.smithi173.stdout:9/282: write d1/d2/d1a/d1f/d34/f55 [1009363,89949] 0 2024-02-16T22:19:12.497 INFO:tasks.workunit.client.1.smithi173.stdout:3/347: dwrite d9/fb [4194304,4194304] 0 2024-02-16T22:19:12.499 INFO:tasks.workunit.client.1.smithi173.stdout:4/242: rmdir d7/d12/d2d 39 2024-02-16T22:19:12.499 INFO:tasks.workunit.client.1.smithi173.stdout:0/294: dwrite d0/f11 [0,4194304] 0 2024-02-16T22:19:12.501 INFO:tasks.workunit.client.1.smithi173.stdout:1/526: creat db/d29/d57/d73/fb7 x:0 0 0 2024-02-16T22:19:12.501 INFO:tasks.workunit.client.1.smithi173.stdout:1/527: fdatasync db/d29/d57/d8c/fb6 0 2024-02-16T22:19:12.501 INFO:tasks.workunit.client.1.smithi173.stdout:1/528: truncate db/d30/f48 4342933 0 2024-02-16T22:19:12.504 INFO:tasks.workunit.client.1.smithi173.stdout:9/283: truncate d1/d2/d10/f3f 3642568 0 2024-02-16T22:19:12.507 INFO:tasks.workunit.client.1.smithi173.stdout:5/420: dwrite d8/da/f24 [0,4194304] 0 2024-02-16T22:19:12.507 INFO:tasks.workunit.client.1.smithi173.stdout:3/348: symlink d9/d1a/d2b/d45/d60/l80 0 2024-02-16T22:19:12.508 INFO:tasks.workunit.client.1.smithi173.stdout:3/349: write d9/d1a/d2b/d4d/f6b [697443,69441] 0 2024-02-16T22:19:12.508 INFO:tasks.workunit.client.1.smithi173.stdout:3/350: stat d9/d1a/d2b/d4d/d5b/f76 0 2024-02-16T22:19:12.508 INFO:tasks.workunit.client.1.smithi173.stdout:3/351: getdents d9/d18/d5f/d6e/d4e 0 2024-02-16T22:19:12.508 INFO:tasks.workunit.client.1.smithi173.stdout:3/352: fsync d9/d17/f54 0 2024-02-16T22:19:12.508 INFO:tasks.workunit.client.1.smithi173.stdout:5/421: dread d8/da/d2d/d36/f40 [0,4194304] 0 2024-02-16T22:19:12.509 INFO:tasks.workunit.client.1.smithi173.stdout:0/295: creat d0/d4/d33/d54/f5c x:0 0 0 2024-02-16T22:19:12.509 INFO:tasks.workunit.client.1.smithi173.stdout:4/243: mkdir d7/d28/d52 0 2024-02-16T22:19:12.511 INFO:tasks.workunit.client.1.smithi173.stdout:1/529: link db/d1c/d5c/la3 db/d1c/lb8 0 2024-02-16T22:19:12.515 INFO:tasks.workunit.client.1.smithi173.stdout:7/333: rename d1/d5 to d1/d1d/d4c/d63 0 2024-02-16T22:19:12.515 INFO:tasks.workunit.client.1.smithi173.stdout:7/334: dread - d1/d1d/d4c/d63/d13/d22/d53/d27/f62 zero size 2024-02-16T22:19:12.517 INFO:tasks.workunit.client.1.smithi173.stdout:5/422: creat d8/da/d1f/d33/f7e x:0 0 0 2024-02-16T22:19:12.519 INFO:tasks.workunit.client.1.smithi173.stdout:0/296: mknod d0/c5d 0 2024-02-16T22:19:12.519 INFO:tasks.workunit.client.1.smithi173.stdout:0/297: chown d0/d12/c1f 850094 1 2024-02-16T22:19:12.520 INFO:tasks.workunit.client.1.smithi173.stdout:4/244: getdents d7/df 0 2024-02-16T22:19:12.521 INFO:tasks.workunit.client.1.smithi173.stdout:1/530: mknod db/d1c/d7f/cb9 0 2024-02-16T22:19:12.521 INFO:tasks.workunit.client.1.smithi173.stdout:1/531: getdents db/d29/d83 0 2024-02-16T22:19:12.521 INFO:tasks.workunit.client.1.smithi173.stdout:1/532: chown db/d1c/d25/d28/lb3 22 1 2024-02-16T22:19:12.521 INFO:tasks.workunit.client.1.smithi173.stdout:1/533: creat db/d5f/d97/fba x:0 0 0 2024-02-16T22:19:12.521 INFO:tasks.workunit.client.1.smithi173.stdout:9/284: rmdir d1/d2/d1a/d2f/d3b 39 2024-02-16T22:19:12.522 INFO:tasks.workunit.client.1.smithi173.stdout:0/298: write d0/d12/d15/f1c [3941848,109396] 0 2024-02-16T22:19:12.523 INFO:tasks.workunit.client.1.smithi173.stdout:2/374: rename d2/d4/d43 to d2/d4/d8/d80 0 2024-02-16T22:19:12.523 INFO:tasks.workunit.client.1.smithi173.stdout:2/375: truncate d2/d4/d8/d80/f72 214929 0 2024-02-16T22:19:12.524 INFO:tasks.workunit.client.1.smithi173.stdout:2/376: read d2/dc/d19/d1a/f52 [26783,116433] 0 2024-02-16T22:19:12.524 INFO:tasks.workunit.client.1.smithi173.stdout:2/377: stat d2/dc/l21 0 2024-02-16T22:19:12.524 INFO:tasks.workunit.client.1.smithi173.stdout:7/335: mknod d1/d1d/d4c/d63/d11/c64 0 2024-02-16T22:19:12.525 INFO:tasks.workunit.client.1.smithi173.stdout:3/353: rmdir d9/d18/d73 39 2024-02-16T22:19:12.527 INFO:tasks.workunit.client.1.smithi173.stdout:4/245: mknod d7/df/d4f/d4e/c53 0 2024-02-16T22:19:12.527 INFO:tasks.workunit.client.1.smithi173.stdout:4/246: fdatasync d7/df/f23 0 2024-02-16T22:19:12.530 INFO:tasks.workunit.client.1.smithi173.stdout:1/534: symlink db/d1c/d25/lbb 0 2024-02-16T22:19:12.531 INFO:tasks.workunit.client.1.smithi173.stdout:1/535: read db/d29/d57/f5d [190127,59276] 0 2024-02-16T22:19:12.533 INFO:tasks.workunit.client.1.smithi173.stdout:9/285: creat d1/d2/d10/f59 x:0 0 0 2024-02-16T22:19:12.533 INFO:tasks.workunit.client.1.smithi173.stdout:9/286: chown d1/f23 428 1 2024-02-16T22:19:12.533 INFO:tasks.workunit.client.1.smithi173.stdout:0/299: creat d0/f5e x:0 0 0 2024-02-16T22:19:12.535 INFO:tasks.workunit.client.1.smithi173.stdout:8/410: rename dd/d7c/d7d/d22/d2e/d41/d6b/f6f to dd/d7c/d7d/d22/f96 0 2024-02-16T22:19:12.536 INFO:tasks.workunit.client.1.smithi173.stdout:7/336: creat d1/d1d/d4c/d63/d13/d22/d53/d27/f65 x:0 0 0 2024-02-16T22:19:12.538 INFO:tasks.workunit.client.1.smithi173.stdout:3/354: mkdir d9/d1a/d2b/d49/d81 0 2024-02-16T22:19:12.538 INFO:tasks.workunit.client.1.smithi173.stdout:3/355: stat d9/d17/d25 0 2024-02-16T22:19:12.539 INFO:tasks.workunit.client.1.smithi173.stdout:4/247: truncate d7/fd 209112 0 2024-02-16T22:19:12.541 INFO:tasks.workunit.client.1.smithi173.stdout:9/287: creat d1/f5a x:0 0 0 2024-02-16T22:19:12.542 INFO:tasks.workunit.client.1.smithi173.stdout:0/300: mkdir d0/d4/d14/d24/d5f 0 2024-02-16T22:19:12.544 INFO:tasks.workunit.client.1.smithi173.stdout:2/378: dwrite d2/dc/d19/f51 [0,4194304] 0 2024-02-16T22:19:12.544 INFO:tasks.workunit.client.1.smithi173.stdout:2/379: stat d2/dc/d19 0 2024-02-16T22:19:12.545 INFO:tasks.workunit.client.1.smithi173.stdout:2/380: chown f1 26383 1 2024-02-16T22:19:12.545 INFO:tasks.workunit.client.1.smithi173.stdout:2/381: readlink d2/dc/d19/l49 0 2024-02-16T22:19:12.545 INFO:tasks.workunit.client.1.smithi173.stdout:2/382: truncate d2/d4/f4c 808820 0 2024-02-16T22:19:12.545 INFO:tasks.workunit.client.1.smithi173.stdout:2/383: write d2/dc/d5d/f6a [305843,96565] 0 2024-02-16T22:19:12.545 INFO:tasks.workunit.client.1.smithi173.stdout:5/423: rename d8/da/ce to d8/da/d1b/d57/c7f 0 2024-02-16T22:19:12.547 INFO:tasks.workunit.client.1.smithi173.stdout:8/411: link dd/d7c/d7d/d22/d28/d40/l4c dd/d7c/d7d/d22/d5a/l97 0 2024-02-16T22:19:12.547 INFO:tasks.workunit.client.1.smithi173.stdout:8/412: write dd/d7c/d7d/f60 [845705,7980] 0 2024-02-16T22:19:12.549 INFO:tasks.workunit.client.1.smithi173.stdout:3/356: symlink d9/d1a/d2b/d45/d60/d6a/l82 0 2024-02-16T22:19:12.551 INFO:tasks.workunit.client.1.smithi173.stdout:0/301: creat d0/d4/f60 x:0 0 0 2024-02-16T22:19:12.554 INFO:tasks.workunit.client.1.smithi173.stdout:2/384: rmdir d2/dc/d19 39 2024-02-16T22:19:12.555 INFO:tasks.workunit.client.1.smithi173.stdout:1/536: dwrite db/d29/d57/f71 [0,4194304] 0 2024-02-16T22:19:12.556 INFO:tasks.workunit.client.1.smithi173.stdout:1/537: fdatasync db/d5f/d97/fba 0 2024-02-16T22:19:12.556 INFO:tasks.workunit.client.1.smithi173.stdout:1/538: readlink db/d30/l4c 0 2024-02-16T22:19:12.556 INFO:tasks.workunit.client.1.smithi173.stdout:7/337: rename d1/d1d/d4c/d63/d13/d36/d49/l43 to d1/d1d/d4c/d63/d13/d22/l66 0 2024-02-16T22:19:12.556 INFO:tasks.workunit.client.1.smithi173.stdout:3/357: dread d9/d17/d25/f50 [0,4194304] 0 2024-02-16T22:19:12.558 INFO:tasks.workunit.client.1.smithi173.stdout:5/424: read d8/d27/d62/f4a [1921111,14776] 0 2024-02-16T22:19:12.558 INFO:tasks.workunit.client.1.smithi173.stdout:0/302: symlink d0/d4/d33/d54/l61 0 2024-02-16T22:19:12.559 INFO:tasks.workunit.client.1.smithi173.stdout:2/385: mkdir d2/d4/d8/d30/d44/d81 0 2024-02-16T22:19:12.560 INFO:tasks.workunit.client.1.smithi173.stdout:1/539: symlink db/d1c/d5c/dac/dae/lbc 0 2024-02-16T22:19:12.563 INFO:tasks.workunit.client.1.smithi173.stdout:9/288: rename d1/d2/d10/f21 to d1/d2/d1a/d1f/d34/f5b 0 2024-02-16T22:19:12.563 INFO:tasks.workunit.client.1.smithi173.stdout:7/338: getdents d1/d1d/d4c/d63/d48 0 2024-02-16T22:19:12.565 INFO:tasks.workunit.client.1.smithi173.stdout:5/425: symlink d8/da/d2d/d36/l80 0 2024-02-16T22:19:12.566 INFO:tasks.workunit.client.1.smithi173.stdout:1/540: creat db/d1c/d7f/d98/fbd x:0 0 0 2024-02-16T22:19:12.568 INFO:tasks.workunit.client.1.smithi173.stdout:4/248: dwrite d7/df/d4f/f47 [0,4194304] 0 2024-02-16T22:19:12.568 INFO:tasks.workunit.client.1.smithi173.stdout:4/249: write d7/d12/f19 [1315677,95275] 0 2024-02-16T22:19:12.568 INFO:tasks.workunit.client.1.smithi173.stdout:3/358: rename d9/d1a/f61 to d9/d1a/d2b/d4d/f83 0 2024-02-16T22:19:12.568 INFO:tasks.workunit.client.1.smithi173.stdout:3/359: fsync d9/da/f15 0 2024-02-16T22:19:12.568 INFO:tasks.workunit.client.1.smithi173.stdout:9/289: unlink d1/d2/d1a/d3e/f52 0 2024-02-16T22:19:12.568 INFO:tasks.workunit.client.1.smithi173.stdout:9/290: chown d1/d2/d10/f2e 535392611 1 2024-02-16T22:19:12.569 INFO:tasks.workunit.client.1.smithi173.stdout:9/291: write d1/d2/d1a/d1f/f2c [539044,26303] 0 2024-02-16T22:19:12.569 INFO:tasks.workunit.client.1.smithi173.stdout:5/426: mknod d8/d27/d70/c81 0 2024-02-16T22:19:12.570 INFO:tasks.workunit.client.1.smithi173.stdout:4/250: creat d7/df/d4f/d4e/f54 x:0 0 0 2024-02-16T22:19:12.570 INFO:tasks.workunit.client.1.smithi173.stdout:4/251: chown d7/d28/d14/f1f 128268830 1 2024-02-16T22:19:12.570 INFO:tasks.workunit.client.1.smithi173.stdout:4/252: write d7/d12/f30 [251333,84217] 0 2024-02-16T22:19:12.571 INFO:tasks.workunit.client.1.smithi173.stdout:3/360: mknod d9/d1a/d2b/c84 0 2024-02-16T22:19:12.571 INFO:tasks.workunit.client.1.smithi173.stdout:3/361: write d9/d1a/d2b/d49/f72 [1489182,6849] 0 2024-02-16T22:19:12.571 INFO:tasks.workunit.client.1.smithi173.stdout:3/362: fdatasync f7 0 2024-02-16T22:19:12.571 INFO:tasks.workunit.client.1.smithi173.stdout:3/363: write d9/d17/f48 [139706,101881] 0 2024-02-16T22:19:12.571 INFO:tasks.workunit.client.1.smithi173.stdout:3/364: chown d9/d1a/d2b/l37 0 1 2024-02-16T22:19:12.571 INFO:tasks.workunit.client.1.smithi173.stdout:9/292: mknod d1/d2/d1a/d2f/d3b/c5c 0 2024-02-16T22:19:12.571 INFO:tasks.workunit.client.1.smithi173.stdout:5/427: rmdir d8/d27/d63 39 2024-02-16T22:19:12.573 INFO:tasks.workunit.client.1.smithi173.stdout:7/339: write d1/d1d/d4c/d63/d13/d36/f52 [1055896,56852] 0 2024-02-16T22:19:12.574 INFO:tasks.workunit.client.1.smithi173.stdout:3/365: rename d9/d1a/d2b/d49/f72 to d9/da/f85 0 2024-02-16T22:19:12.574 INFO:tasks.workunit.client.1.smithi173.stdout:8/413: dwrite dd/d7c/d7d/d22/d28/d40/d52/f54 [4194304,4194304] 0 2024-02-16T22:19:12.574 INFO:tasks.workunit.client.1.smithi173.stdout:8/414: dread - dd/d7c/d7d/d22/d5a/f67 zero size 2024-02-16T22:19:12.574 INFO:tasks.workunit.client.1.smithi173.stdout:9/293: creat d1/d2/d1a/f5d x:0 0 0 2024-02-16T22:19:12.577 INFO:tasks.workunit.client.1.smithi173.stdout:7/340: creat d1/d1d/d4c/d63/d13/f67 x:0 0 0 2024-02-16T22:19:12.579 INFO:tasks.workunit.client.1.smithi173.stdout:3/366: unlink d9/d17/d25/f3e 0 2024-02-16T22:19:12.579 INFO:tasks.workunit.client.1.smithi173.stdout:3/367: dread - d9/da/f7e zero size 2024-02-16T22:19:12.581 INFO:tasks.workunit.client.1.smithi173.stdout:8/415: mknod dd/d7c/d7d/d93/c98 0 2024-02-16T22:19:12.581 INFO:tasks.workunit.client.1.smithi173.stdout:8/416: read - dd/d7c/d7d/d58/f91 zero size 2024-02-16T22:19:12.582 INFO:tasks.workunit.client.1.smithi173.stdout:7/341: truncate d1/d1d/d4c/d63/d13/d36/f38 157517 0 2024-02-16T22:19:12.584 INFO:tasks.workunit.client.1.smithi173.stdout:7/342: rmdir d1/d1d/d4c/d63/d13/d22 39 2024-02-16T22:19:12.584 INFO:tasks.workunit.client.1.smithi173.stdout:7/343: readlink d1/d1d/d4c/d63/d13/d22/d53/d27/l3e 0 2024-02-16T22:19:12.584 INFO:tasks.workunit.client.1.smithi173.stdout:7/344: readlink d1/l7 0 2024-02-16T22:19:12.597 INFO:tasks.workunit.client.1.smithi173.stdout:3/368: write d9/d1a/d2b/d45/d60/d6a/f6f [2763741,102840] 0 2024-02-16T22:19:12.597 INFO:tasks.workunit.client.1.smithi173.stdout:3/369: readlink d9/d1a/d2b/l37 0 2024-02-16T22:19:12.597 INFO:tasks.workunit.client.1.smithi173.stdout:3/370: truncate d9/d17/f48 2537051 0 2024-02-16T22:19:12.598 INFO:tasks.workunit.client.1.smithi173.stdout:8/417: dread dd/f86 [0,4194304] 0 2024-02-16T22:19:12.599 INFO:tasks.workunit.client.1.smithi173.stdout:8/418: mknod dd/d7c/d7d/d22/d5a/c99 0 2024-02-16T22:19:12.599 INFO:tasks.workunit.client.1.smithi173.stdout:8/419: mknod dd/c9a 0 2024-02-16T22:19:12.600 INFO:tasks.workunit.client.1.smithi173.stdout:8/420: symlink dd/d7c/d7d/d93/l9b 0 2024-02-16T22:19:12.603 INFO:tasks.workunit.client.1.smithi173.stdout:1/541: dwrite db/d1d/f1e [0,4194304] 0 2024-02-16T22:19:12.603 INFO:tasks.workunit.client.1.smithi173.stdout:1/542: chown db/d1c/d25/d28/c3c 0 1 2024-02-16T22:19:12.603 INFO:tasks.workunit.client.1.smithi173.stdout:2/386: dwrite d2/f3c [0,4194304] 0 2024-02-16T22:19:12.603 INFO:tasks.workunit.client.1.smithi173.stdout:2/387: stat d2/dc/d19/d1a 0 2024-02-16T22:19:12.603 INFO:tasks.workunit.client.1.smithi173.stdout:8/421: write dd/d7c/d7d/d22/d28/d40/f78 [2211430,27951] 0 2024-02-16T22:19:12.603 INFO:tasks.workunit.client.1.smithi173.stdout:1/543: write db/d30/f8d [618935,100451] 0 2024-02-16T22:19:12.604 INFO:tasks.workunit.client.1.smithi173.stdout:4/253: dwrite d7/f15 [8388608,4194304] 0 2024-02-16T22:19:12.605 INFO:tasks.workunit.client.1.smithi173.stdout:5/428: dwrite d8/da/d1b/d57/f79 [0,4194304] 0 2024-02-16T22:19:12.608 INFO:tasks.workunit.client.1.smithi173.stdout:1/544: creat db/d1c/d5c/dac/fbe x:0 0 0 2024-02-16T22:19:12.609 INFO:tasks.workunit.client.1.smithi173.stdout:8/422: getdents dd/d7c/d7d 0 2024-02-16T22:19:12.617 INFO:tasks.workunit.client.1.smithi173.stdout:1/545: creat db/d1c/d25/d28/fbf x:0 0 0 2024-02-16T22:19:12.619 INFO:tasks.workunit.client.1.smithi173.stdout:2/388: dread d2/dc/d19/f25 [0,4194304] 0 2024-02-16T22:19:12.623 INFO:tasks.workunit.client.1.smithi173.stdout:7/345: truncate d1/d1d/d4c/d63/d13/d36/f38 707931 0 2024-02-16T22:19:12.623 INFO:tasks.workunit.client.1.smithi173.stdout:7/346: stat d1/d1d/d4c/d63/c5f 0 2024-02-16T22:19:12.643 INFO:tasks.workunit.client.1.smithi173.stdout:8/423: dwrite dd/d7c/d7d/d22/d2e/f7b [4194304,4194304] 0 2024-02-16T22:19:12.643 INFO:tasks.workunit.client.1.smithi173.stdout:4/254: dwrite d7/d28/d14/f2a [0,4194304] 0 2024-02-16T22:19:12.644 INFO:tasks.workunit.client.1.smithi173.stdout:5/429: dwrite d8/da/d1f/f51 [0,4194304] 0 2024-02-16T22:19:12.644 INFO:tasks.workunit.client.1.smithi173.stdout:5/430: write d8/da/f45 [1350412,112981] 0 2024-02-16T22:19:12.644 INFO:tasks.workunit.client.1.smithi173.stdout:2/389: dwrite d2/d4/f70 [0,4194304] 0 2024-02-16T22:19:12.644 INFO:tasks.workunit.client.1.smithi173.stdout:5/431: write d8/da/f60 [288294,1126] 0 2024-02-16T22:19:12.644 INFO:tasks.workunit.client.1.smithi173.stdout:2/390: stat d2/dc/f2b 0 2024-02-16T22:19:12.648 INFO:tasks.workunit.client.1.smithi173.stdout:4/255: mknod d7/d12/c55 0 2024-02-16T22:19:12.661 INFO:tasks.workunit.client.1.smithi173.stdout:2/391: rmdir d2/dc/d19/d1a 39 2024-02-16T22:19:12.662 INFO:tasks.workunit.client.1.smithi173.stdout:4/256: rename d7/d28/l2c to d7/df/l56 0 2024-02-16T22:19:12.664 INFO:tasks.workunit.client.1.smithi173.stdout:8/424: dwrite dd/d7c/d7d/d22/d50/f5d [0,4194304] 0 2024-02-16T22:19:12.664 INFO:tasks.workunit.client.1.smithi173.stdout:2/392: truncate d2/d4/f7 2641059 0 2024-02-16T22:19:12.664 INFO:tasks.workunit.client.1.smithi173.stdout:5/432: dwrite d8/d27/d35/f6c [0,4194304] 0 2024-02-16T22:19:12.667 INFO:tasks.workunit.client.1.smithi173.stdout:8/425: mknod dd/d7c/d7d/c9c 0 2024-02-16T22:19:12.669 INFO:tasks.workunit.client.1.smithi173.stdout:2/393: dread d2/dc/d19/f16 [0,4194304] 0 2024-02-16T22:19:12.669 INFO:tasks.workunit.client.1.smithi173.stdout:2/394: read - d2/d4/d8/d30/d4d/f75 zero size 2024-02-16T22:19:12.671 INFO:tasks.workunit.client.1.smithi173.stdout:8/426: rename dd/d7c/d7d/d22/d28/d40/d52 to dd/d9d 0 2024-02-16T22:19:12.671 INFO:tasks.workunit.client.1.smithi173.stdout:8/427: readlink dd/l65 0 2024-02-16T22:19:12.675 INFO:tasks.workunit.client.1.smithi173.stdout:5/433: dread d8/da/d2d/d36/f43 [0,4194304] 0 2024-02-16T22:19:12.676 INFO:tasks.workunit.client.1.smithi173.stdout:5/434: stat d8/f29 0 2024-02-16T22:19:12.676 INFO:tasks.workunit.client.1.smithi173.stdout:5/435: fsync d8/da/d1b/f64 0 2024-02-16T22:19:12.680 INFO:tasks.workunit.client.1.smithi173.stdout:5/436: dread d8/da/d1b/f52 [0,4194304] 0 2024-02-16T22:19:12.680 INFO:tasks.workunit.client.1.smithi173.stdout:5/437: creat d8/da/d2d/d3a/f82 x:0 0 0 2024-02-16T22:19:12.683 INFO:tasks.workunit.client.1.smithi173.stdout:5/438: rmdir d8/da/d1f/d73 0 2024-02-16T22:19:12.689 INFO:tasks.workunit.client.1.smithi173.stdout:4/257: dwrite d7/d28/f1d [0,4194304] 0 2024-02-16T22:19:12.690 INFO:tasks.workunit.client.1.smithi173.stdout:8/428: dwrite f2 [4194304,4194304] 0 2024-02-16T22:19:12.691 INFO:tasks.workunit.client.1.smithi173.stdout:8/429: readlink dd/d7c/d7d/d22/d2e/l79 0 2024-02-16T22:19:12.694 INFO:tasks.workunit.client.1.smithi173.stdout:8/430: dread dd/f31 [0,4194304] 0 2024-02-16T22:19:12.695 INFO:tasks.workunit.client.1.smithi173.stdout:8/431: truncate dd/d7c/d7d/f20 293530 0 2024-02-16T22:19:12.695 INFO:tasks.workunit.client.1.smithi173.stdout:8/432: fdatasync dd/d7c/d7d/d22/d28/f3c 0 2024-02-16T22:19:12.698 INFO:tasks.workunit.client.1.smithi173.stdout:4/258: write d7/d12/f17 [2624421,107100] 0 2024-02-16T22:19:12.698 INFO:tasks.workunit.client.1.smithi173.stdout:4/259: truncate d7/df/f23 9042813 0 2024-02-16T22:19:12.699 INFO:tasks.workunit.client.1.smithi173.stdout:2/395: truncate d2/d4/d8/d30/d44/f71 789445 0 2024-02-16T22:19:12.701 INFO:tasks.workunit.client.1.smithi173.stdout:4/260: rmdir d7/d28/d31/d33/d49 39 2024-02-16T22:19:12.702 INFO:tasks.workunit.client.1.smithi173.stdout:2/396: mkdir d2/d4/d57/d82 0 2024-02-16T22:19:12.703 INFO:tasks.workunit.client.1.smithi173.stdout:4/261: symlink d7/d28/d31/d33/d49/l57 0 2024-02-16T22:19:12.703 INFO:tasks.workunit.client.1.smithi173.stdout:4/262: stat d7/d12 0 2024-02-16T22:19:12.704 INFO:tasks.workunit.client.1.smithi173.stdout:2/397: mkdir d2/d4/d8/d30/d44/d83 0 2024-02-16T22:19:12.706 INFO:tasks.workunit.client.1.smithi173.stdout:4/263: creat d7/df/f58 x:0 0 0 2024-02-16T22:19:12.706 INFO:tasks.workunit.client.1.smithi173.stdout:2/398: mknod d2/d4/d8/d2d/c84 0 2024-02-16T22:19:12.706 INFO:tasks.workunit.client.1.smithi173.stdout:2/399: truncate d2/dc/d19/d1c/f68 182627 0 2024-02-16T22:19:12.706 INFO:tasks.workunit.client.1.smithi173.stdout:4/264: getdents d7/d12/d2d 0 2024-02-16T22:19:12.707 INFO:tasks.workunit.client.1.smithi173.stdout:4/265: truncate d7/df/f22 617430 0 2024-02-16T22:19:12.712 INFO:tasks.workunit.client.1.smithi173.stdout:8/433: dwrite dd/d9d/f75 [0,4194304] 0 2024-02-16T22:19:12.720 INFO:tasks.workunit.client.1.smithi173.stdout:8/434: write dd/d9d/f75 [4766730,21907] 0 2024-02-16T22:19:12.722 INFO:tasks.workunit.client.1.smithi173.stdout:8/435: link dd/d7c/d7d/f39 dd/d7c/d7d/d22/d28/d40/d51/f9e 0 2024-02-16T22:19:12.722 INFO:tasks.workunit.client.1.smithi173.stdout:8/436: truncate dd/d7c/d7d/d22/d2e/f94 1005769 0 2024-02-16T22:19:12.724 INFO:tasks.workunit.client.1.smithi173.stdout:8/437: rename dd/d7c/d7d/d22/d28/d40/l53 to dd/d7c/d7d/d89/l9f 0 2024-02-16T22:19:12.725 INFO:tasks.workunit.client.1.smithi173.stdout:8/438: read dd/d7c/d7d/f60 [584514,104567] 0 2024-02-16T22:19:12.727 INFO:tasks.workunit.client.1.smithi173.stdout:8/439: rename dd/c4b to dd/d7c/d7d/d22/ca0 0 2024-02-16T22:19:12.727 INFO:tasks.workunit.client.1.smithi173.stdout:8/440: chown dd/d7c/d7d/l83 11556608 1 2024-02-16T22:19:12.731 INFO:tasks.workunit.client.1.smithi173.stdout:8/441: dread dd/d7c/d7d/d22/d2e/d41/f56 [0,4194304] 0 2024-02-16T22:19:12.732 INFO:tasks.workunit.client.1.smithi173.stdout:8/442: getdents dd/d7c/d7d/d22/d5a 0 2024-02-16T22:19:12.734 INFO:tasks.workunit.client.1.smithi173.stdout:2/400: dwrite d2/d4/f59 [0,4194304] 0 2024-02-16T22:19:12.734 INFO:tasks.workunit.client.1.smithi173.stdout:2/401: truncate d2/dc/d5d/f24 420257 0 2024-02-16T22:19:12.735 INFO:tasks.workunit.client.1.smithi173.stdout:2/402: truncate d2/d4/d8/d30/f3b 1406855 0 2024-02-16T22:19:12.735 INFO:tasks.workunit.client.1.smithi173.stdout:2/403: write d2/d4/d8/d30/f37 [2735330,58111] 0 2024-02-16T22:19:12.736 INFO:tasks.workunit.client.1.smithi173.stdout:2/404: creat d2/d4/d8/d30/d44/d83/f85 x:0 0 0 2024-02-16T22:19:12.737 INFO:tasks.workunit.client.1.smithi173.stdout:2/405: unlink d2/dc/d19/d1c/c4a 0 2024-02-16T22:19:12.738 INFO:tasks.workunit.client.1.smithi173.stdout:4/266: dwrite d7/d12/f2b [4194304,4194304] 0 2024-02-16T22:19:12.739 INFO:tasks.workunit.client.1.smithi173.stdout:4/267: mknod d7/d28/c59 0 2024-02-16T22:19:12.741 INFO:tasks.workunit.client.1.smithi173.stdout:4/268: rename f5 to d7/df/d4f/d4e/f5a 0 2024-02-16T22:19:12.741 INFO:tasks.workunit.client.1.smithi173.stdout:4/269: dread - d7/d28/f3c zero size 2024-02-16T22:19:12.742 INFO:tasks.workunit.client.1.smithi173.stdout:4/270: creat d7/df/d4f/d3d/f5b x:0 0 0 2024-02-16T22:19:12.743 INFO:tasks.workunit.client.1.smithi173.stdout:8/443: getdents dd/d7c/d7d/d22/d28/d40 0 2024-02-16T22:19:12.743 INFO:tasks.workunit.client.1.smithi173.stdout:8/444: write dd/d7c/d7d/d22/d5a/f61 [4148966,67279] 0 2024-02-16T22:19:12.745 INFO:tasks.workunit.client.1.smithi173.stdout:4/271: creat d7/d12/d2d/f5c x:0 0 0 2024-02-16T22:19:12.745 INFO:tasks.workunit.client.1.smithi173.stdout:4/272: dread - d7/df/d4f/d3d/f5b zero size 2024-02-16T22:19:12.745 INFO:tasks.workunit.client.1.smithi173.stdout:4/273: chown d7/d12/d2d/f44 324893 1 2024-02-16T22:19:12.745 INFO:tasks.workunit.client.1.smithi173.stdout:4/274: truncate d7/d28/d14/f1f 4296808 0 2024-02-16T22:19:12.746 INFO:tasks.workunit.client.1.smithi173.stdout:2/406: dread d2/d4/d8/d30/f37 [0,4194304] 0 2024-02-16T22:19:12.750 INFO:tasks.workunit.client.1.smithi173.stdout:2/407: rename d2/f2e to d2/dc/f86 0 2024-02-16T22:19:12.752 INFO:tasks.workunit.client.1.smithi173.stdout:2/408: rmdir d2/dc/d19/d1c/d53 39 2024-02-16T22:19:12.753 INFO:tasks.workunit.client.1.smithi173.stdout:2/409: write d2/dc/d19/d1c/f68 [315549,30636] 0 2024-02-16T22:19:12.753 INFO:tasks.workunit.client.1.smithi173.stdout:8/445: dread dd/d7c/d7d/d22/d2e/d41/f4a [0,4194304] 0 2024-02-16T22:19:12.754 INFO:tasks.workunit.client.1.smithi173.stdout:2/410: dread d2/dc/d5d/f15 [0,4194304] 0 2024-02-16T22:19:12.754 INFO:tasks.workunit.client.1.smithi173.stdout:2/411: stat d2/d4/d57/d82 0 2024-02-16T22:19:12.754 INFO:tasks.workunit.client.1.smithi173.stdout:8/446: creat dd/d7c/d8f/fa1 x:0 0 0 2024-02-16T22:19:12.755 INFO:tasks.workunit.client.1.smithi173.stdout:2/412: mkdir d2/dc/d19/d1c/d87 0 2024-02-16T22:19:12.755 INFO:tasks.workunit.client.1.smithi173.stdout:2/413: readlink d2/d10/l42 0 2024-02-16T22:19:12.756 INFO:tasks.workunit.client.1.smithi173.stdout:8/447: link dd/c15 dd/d7c/d7d/d22/d5a/ca2 0 2024-02-16T22:19:12.756 INFO:tasks.workunit.client.1.smithi173.stdout:8/448: creat dd/d7c/d8f/fa3 x:0 0 0 2024-02-16T22:19:12.757 INFO:tasks.workunit.client.1.smithi173.stdout:2/414: unlink d2/d10/f32 0 2024-02-16T22:19:12.757 INFO:tasks.workunit.client.1.smithi173.stdout:2/415: readlink d2/l3 0 2024-02-16T22:19:12.759 INFO:tasks.workunit.client.1.smithi173.stdout:8/449: getdents dd/d7c 0 2024-02-16T22:19:12.759 INFO:tasks.workunit.client.1.smithi173.stdout:8/450: dread - dd/d7c/d7d/d22/d2e/f48 zero size 2024-02-16T22:19:12.759 INFO:tasks.workunit.client.1.smithi173.stdout:8/451: write dd/f31 [509979,20195] 0 2024-02-16T22:19:12.760 INFO:tasks.workunit.client.1.smithi173.stdout:8/452: chown dd/d7c/d7d/d22/d50/f6e 28 1 2024-02-16T22:19:12.760 INFO:tasks.workunit.client.1.smithi173.stdout:2/416: stat d2/d4/c7c 0 2024-02-16T22:19:12.760 INFO:tasks.workunit.client.1.smithi173.stdout:2/417: readlink d2/d10/l7b 0 2024-02-16T22:19:12.764 INFO:tasks.workunit.client.1.smithi173.stdout:4/275: dwrite d7/df/d4f/d4e/f54 [0,4194304] 0 2024-02-16T22:19:12.789 INFO:tasks.workunit.client.1.smithi173.stdout:2/418: dwrite d2/d10/f64 [0,4194304] 0 2024-02-16T22:19:12.790 INFO:tasks.workunit.client.1.smithi173.stdout:8/453: dwrite fc [4194304,4194304] 0 2024-02-16T22:19:12.792 INFO:tasks.workunit.client.1.smithi173.stdout:8/454: truncate dd/d7c/d7d/f39 3080590 0 2024-02-16T22:19:12.792 INFO:tasks.workunit.client.1.smithi173.stdout:8/455: truncate dd/d7c/d7d/d22/d28/d40/f64 17778 0 2024-02-16T22:19:12.833 INFO:tasks.workunit.client.1.smithi173.stdout:2/419: dwrite d2/d4/d8/d80/f72 [0,4194304] 0 2024-02-16T22:19:12.834 INFO:tasks.workunit.client.1.smithi173.stdout:2/420: rename d2/d4/d8/d80 to d2/d4/d8/d80/d88 22 2024-02-16T22:19:12.834 INFO:tasks.workunit.client.1.smithi173.stdout:8/456: dwrite dd/d7c/d7d/f13 [0,4194304] 0 2024-02-16T22:19:12.835 INFO:tasks.workunit.client.1.smithi173.stdout:2/421: getdents d2/d4 0 2024-02-16T22:19:12.835 INFO:tasks.workunit.client.1.smithi173.stdout:8/457: mknod dd/d7c/d7d/d22/d50/ca4 0 2024-02-16T22:19:12.837 INFO:tasks.workunit.client.1.smithi173.stdout:2/422: rename d2/dc/l21 to d2/d4/d8/d2d/l89 0 2024-02-16T22:19:12.838 INFO:tasks.workunit.client.1.smithi173.stdout:8/458: creat dd/d9d/fa5 x:0 0 0 2024-02-16T22:19:12.838 INFO:tasks.workunit.client.1.smithi173.stdout:8/459: read - dd/d9d/f70 zero size 2024-02-16T22:19:12.838 INFO:tasks.workunit.client.1.smithi173.stdout:8/460: readlink dd/le 0 2024-02-16T22:19:12.838 INFO:tasks.workunit.client.1.smithi173.stdout:8/461: dread - dd/d7c/d7d/d22/d2e/d41/d6b/f8e zero size 2024-02-16T22:19:12.838 INFO:tasks.workunit.client.1.smithi173.stdout:8/462: write dd/d7c/d7d/d58/f85 [1029706,122946] 0 2024-02-16T22:19:12.845 INFO:tasks.workunit.client.1.smithi173.stdout:8/463: dread dd/d7c/d7d/d22/d2e/d41/f4a [0,4194304] 0 2024-02-16T22:19:12.845 INFO:tasks.workunit.client.1.smithi173.stdout:2/423: write d2/d4/f70 [3038738,118800] 0 2024-02-16T22:19:12.849 INFO:tasks.workunit.client.1.smithi173.stdout:2/424: creat d2/dc/d19/d1c/d87/f8a x:0 0 0 2024-02-16T22:19:12.849 INFO:tasks.workunit.client.1.smithi173.stdout:2/425: write d2/d10/d62/f78 [1039406,127259] 0 2024-02-16T22:19:12.870 INFO:tasks.workunit.client.1.smithi173.stdout:6/345: sync 2024-02-16T22:19:12.871 INFO:tasks.workunit.client.1.smithi173.stdout:6/346: readlink d0/db/d2e/d2f/l43 0 2024-02-16T22:19:12.871 INFO:tasks.workunit.client.1.smithi173.stdout:6/347: chown d0/f44 761134 1 2024-02-16T22:19:12.872 INFO:tasks.workunit.client.1.smithi173.stdout:8/464: dwrite dd/d7c/d7d/d22/f32 [0,4194304] 0 2024-02-16T22:19:12.873 INFO:tasks.workunit.client.1.smithi173.stdout:8/465: creat dd/d7c/d7d/d22/d2e/d41/d73/fa6 x:0 0 0 2024-02-16T22:19:12.874 INFO:tasks.workunit.client.1.smithi173.stdout:8/466: rmdir dd 39 2024-02-16T22:19:12.875 INFO:tasks.workunit.client.1.smithi173.stdout:8/467: mkdir dd/d7c/d7d/d22/d28/d40/d69/da7 0 2024-02-16T22:19:12.876 INFO:tasks.workunit.client.1.smithi173.stdout:8/468: mknod dd/d7c/d7d/d22/d28/ca8 0 2024-02-16T22:19:12.876 INFO:tasks.workunit.client.1.smithi173.stdout:8/469: creat dd/d9d/fa9 x:0 0 0 2024-02-16T22:19:12.876 INFO:tasks.workunit.client.1.smithi173.stdout:2/426: dwrite d2/dc/d5d/f6a [0,4194304] 0 2024-02-16T22:19:12.878 INFO:tasks.workunit.client.1.smithi173.stdout:8/470: mkdir dd/d7c/d7d/d93/daa 0 2024-02-16T22:19:12.878 INFO:tasks.workunit.client.1.smithi173.stdout:8/471: write dd/d7c/d7d/d22/d2e/d41/d6b/f8e [373555,23736] 0 2024-02-16T22:19:12.879 INFO:tasks.workunit.client.1.smithi173.stdout:8/472: chown dd/d7c/d7d/d22/d2e/d41/f4a 770 1 2024-02-16T22:19:12.879 INFO:tasks.workunit.client.1.smithi173.stdout:2/427: link d2/dc/d19/f16 d2/d4/d8/d2d/f8b 0 2024-02-16T22:19:12.879 INFO:tasks.workunit.client.1.smithi173.stdout:2/428: write d2/d4/d8/d30/f38 [5016714,104775] 0 2024-02-16T22:19:12.879 INFO:tasks.workunit.client.1.smithi173.stdout:8/473: dread dd/d7c/d7d/d22/d2e/f71 [0,4194304] 0 2024-02-16T22:19:12.882 INFO:tasks.workunit.client.1.smithi173.stdout:2/429: unlink d2/d10/d62/f76 0 2024-02-16T22:19:12.895 INFO:tasks.workunit.client.1.smithi173.stdout:2/430: dwrite d2/d10/d62/f78 [0,4194304] 0 2024-02-16T22:19:12.897 INFO:tasks.workunit.client.1.smithi173.stdout:2/431: mknod d2/dc/d19/d1c/c8c 0 2024-02-16T22:19:12.897 INFO:tasks.workunit.client.1.smithi173.stdout:2/432: creat d2/dc/d19/d1c/d87/f8d x:0 0 0 2024-02-16T22:19:12.897 INFO:tasks.workunit.client.1.smithi173.stdout:2/433: fsync d2/dc/d5d/f6a 0 2024-02-16T22:19:12.899 INFO:tasks.workunit.client.1.smithi173.stdout:2/434: unlink d2/dc/d19/d1c/d53/c65 0 2024-02-16T22:19:12.902 INFO:tasks.workunit.client.1.smithi173.stdout:2/435: rename d2/d4/d8/d30/l6b to d2/dc/l8e 0 2024-02-16T22:19:12.902 INFO:tasks.workunit.client.1.smithi173.stdout:2/436: chown d2/dc/d19/d1c/d87 43 1 2024-02-16T22:19:12.902 INFO:tasks.workunit.client.1.smithi173.stdout:2/437: rmdir d2/d4/d8/d30 39 2024-02-16T22:19:12.903 INFO:tasks.workunit.client.1.smithi173.stdout:2/438: creat d2/dc/d5d/d7a/f8f x:0 0 0 2024-02-16T22:19:13.050 INFO:tasks.workunit.client.1.smithi173.stdout:0/303: sync 2024-02-16T22:19:13.052 INFO:tasks.workunit.client.1.smithi173.stdout:0/304: unlink d0/d4/d14/f16 0 2024-02-16T22:19:13.052 INFO:tasks.workunit.client.1.smithi173.stdout:0/305: truncate d0/d4/f7 6666349 0 2024-02-16T22:19:13.053 INFO:tasks.workunit.client.1.smithi173.stdout:0/306: readlink d0/d4/d14/d24/l30 0 2024-02-16T22:19:13.219 INFO:tasks.workunit.client.1.smithi173.stdout:1/546: sync 2024-02-16T22:19:13.219 INFO:tasks.workunit.client.1.smithi173.stdout:9/294: sync 2024-02-16T22:19:13.219 INFO:tasks.workunit.client.1.smithi173.stdout:9/295: readlink d1/d2/d10/l1d 0 2024-02-16T22:19:13.219 INFO:tasks.workunit.client.1.smithi173.stdout:3/371: sync 2024-02-16T22:19:13.220 INFO:tasks.workunit.client.1.smithi173.stdout:3/372: mknod d9/da/c86 0 2024-02-16T22:19:13.221 INFO:tasks.workunit.client.1.smithi173.stdout:3/373: creat d9/d1a/d2b/d45/d51/f87 x:0 0 0 2024-02-16T22:19:13.222 INFO:tasks.workunit.client.1.smithi173.stdout:3/374: stat d9/d18 0 2024-02-16T22:19:13.224 INFO:tasks.workunit.client.1.smithi173.stdout:1/547: write db/d30/f48 [3583191,43224] 0 2024-02-16T22:19:13.224 INFO:tasks.workunit.client.1.smithi173.stdout:1/548: fdatasync db/f15 0 2024-02-16T22:19:13.244 INFO:tasks.workunit.client.1.smithi173.stdout:3/375: dwrite d9/f4c [0,4194304] 0 2024-02-16T22:19:13.244 INFO:tasks.workunit.client.1.smithi173.stdout:9/296: dwrite d1/d2/d1a/f2b [0,4194304] 0 2024-02-16T22:19:13.244 INFO:tasks.workunit.client.1.smithi173.stdout:9/297: rename d1/d2/d1a to d1/d2/d1a/d1f/d34/d49/d5e 22 2024-02-16T22:19:13.247 INFO:tasks.workunit.client.1.smithi173.stdout:3/376: creat d9/d1a/d2b/d45/f88 x:0 0 0 2024-02-16T22:19:13.257 INFO:tasks.workunit.client.1.smithi173.stdout:3/377: write d9/f22 [2197114,61307] 0 2024-02-16T22:19:13.257 INFO:tasks.workunit.client.1.smithi173.stdout:3/378: creat d9/d1a/d2b/d4d/d5b/f89 x:0 0 0 2024-02-16T22:19:13.257 INFO:tasks.workunit.client.1.smithi173.stdout:3/379: stat d9/d1a/d2b/d4d 0 2024-02-16T22:19:13.257 INFO:tasks.workunit.client.1.smithi173.stdout:3/380: truncate d9/d17/f54 1274586 0 2024-02-16T22:19:13.258 INFO:tasks.workunit.client.1.smithi173.stdout:3/381: write d9/d1a/d2b/d4d/d5b/f7b [208440,42607] 0 2024-02-16T22:19:13.258 INFO:tasks.workunit.client.1.smithi173.stdout:9/298: dwrite d1/d2/d1a/d2f/d3b/f4b [0,4194304] 0 2024-02-16T22:19:13.258 INFO:tasks.workunit.client.1.smithi173.stdout:9/299: write d1/d2/d10/f33 [1310037,11802] 0 2024-02-16T22:19:13.258 INFO:tasks.workunit.client.1.smithi173.stdout:9/300: truncate d1/d2/d1a/d3e/f57 438640 0 2024-02-16T22:19:13.259 INFO:tasks.workunit.client.1.smithi173.stdout:3/382: creat d9/d1a/d2b/d49/d7a/f8a x:0 0 0 2024-02-16T22:19:13.262 INFO:tasks.workunit.client.1.smithi173.stdout:9/301: mkdir d1/d5f 0 2024-02-16T22:19:13.262 INFO:tasks.workunit.client.1.smithi173.stdout:9/302: readlink d1/d2/d1a/l42 0 2024-02-16T22:19:13.262 INFO:tasks.workunit.client.1.smithi173.stdout:9/303: creat d1/d2/d10/f60 x:0 0 0 2024-02-16T22:19:13.264 INFO:tasks.workunit.client.1.smithi173.stdout:9/304: mkdir d1/d5f/d61 0 2024-02-16T22:19:13.272 INFO:tasks.workunit.client.1.smithi173.stdout:3/383: dwrite d9/d1a/d2b/d4d/f4f [0,4194304] 0 2024-02-16T22:19:13.275 INFO:tasks.workunit.client.1.smithi173.stdout:3/384: mknod d9/d1a/d2b/d4d/c8b 0 2024-02-16T22:19:13.283 INFO:tasks.workunit.client.1.smithi173.stdout:9/305: dwrite d1/d2/f13 [0,4194304] 0 2024-02-16T22:19:13.283 INFO:tasks.workunit.client.1.smithi173.stdout:9/306: stat d1/f30 0 2024-02-16T22:19:13.287 INFO:tasks.workunit.client.1.smithi173.stdout:9/307: mknod d1/d2/d1a/d2f/c62 0 2024-02-16T22:19:13.287 INFO:tasks.workunit.client.1.smithi173.stdout:9/308: stat d1/d2/d1a/d1f/f2c 0 2024-02-16T22:19:13.288 INFO:tasks.workunit.client.1.smithi173.stdout:9/309: unlink d1/d2/c6 0 2024-02-16T22:19:13.289 INFO:tasks.workunit.client.1.smithi173.stdout:9/310: rename d1/d2/d1a/f31 to d1/d2/d10/f63 0 2024-02-16T22:19:13.289 INFO:tasks.workunit.client.1.smithi173.stdout:9/311: mknod d1/d2/c64 0 2024-02-16T22:19:13.292 INFO:tasks.workunit.client.1.smithi173.stdout:3/385: dwrite d9/da/f85 [4194304,4194304] 0 2024-02-16T22:19:13.292 INFO:tasks.workunit.client.1.smithi173.stdout:3/386: chown d9/d17/f54 197791636 1 2024-02-16T22:19:13.292 INFO:tasks.workunit.client.1.smithi173.stdout:3/387: chown d9/d17/d25 18742862 1 2024-02-16T22:19:13.292 INFO:tasks.workunit.client.1.smithi173.stdout:3/388: write d9/d1a/f34 [443180,33541] 0 2024-02-16T22:19:13.292 INFO:tasks.workunit.client.1.smithi173.stdout:3/389: fdatasync d9/d17/d25/f4a 0 2024-02-16T22:19:13.292 INFO:tasks.workunit.client.1.smithi173.stdout:3/390: chown d9/d1a 239 1 2024-02-16T22:19:13.309 INFO:tasks.workunit.client.1.smithi173.stdout:3/391: dwrite d9/d18/d5f/f69 [4194304,4194304] 0 2024-02-16T22:19:13.315 INFO:tasks.workunit.client.1.smithi173.stdout:3/392: write d9/f7c [1992031,71420] 0 2024-02-16T22:19:13.322 INFO:tasks.workunit.client.1.smithi173.stdout:3/393: dread d9/d1a/d2b/d4d/d5b/f76 [0,4194304] 0 2024-02-16T22:19:13.331 INFO:tasks.workunit.client.1.smithi173.stdout:3/394: dread d9/d1a/f44 [0,4194304] 0 2024-02-16T22:19:13.331 INFO:tasks.workunit.client.1.smithi173.stdout:3/395: chown d9/d1a/d2b/d45/d60/d6a/f6f 2027 1 2024-02-16T22:19:13.332 INFO:tasks.workunit.client.1.smithi173.stdout:3/396: creat d9/d1a/d2b/d4d/f8c x:0 0 0 2024-02-16T22:19:13.332 INFO:tasks.workunit.client.1.smithi173.stdout:3/397: stat d9/d18/d5f/d6e/c20 0 2024-02-16T22:19:13.335 INFO:tasks.workunit.client.1.smithi173.stdout:3/398: truncate d9/d18/d5f/f69 2764268 0 2024-02-16T22:19:13.336 INFO:tasks.workunit.client.1.smithi173.stdout:3/399: chown d9/d17/d25/f4a 66438 1 2024-02-16T22:19:13.336 INFO:tasks.workunit.client.1.smithi173.stdout:3/400: mknod d9/d17/d25/c8d 0 2024-02-16T22:19:13.336 INFO:tasks.workunit.client.1.smithi173.stdout:3/401: readlink d9/d1a/d2b/d45/d60/d6a/l32 0 2024-02-16T22:19:13.336 INFO:tasks.workunit.client.1.smithi173.stdout:3/402: chown d9/d1a/d2b/d45/d60/d6a/l32 1 1 2024-02-16T22:19:13.337 INFO:tasks.workunit.client.1.smithi173.stdout:3/403: chown d9 100527739 1 2024-02-16T22:19:13.337 INFO:tasks.workunit.client.1.smithi173.stdout:3/404: creat d9/d1a/f8e x:0 0 0 2024-02-16T22:19:13.346 INFO:tasks.workunit.client.1.smithi173.stdout:3/405: write d9/d18/d5f/f69 [1648366,61519] 0 2024-02-16T22:19:13.348 INFO:tasks.workunit.client.1.smithi173.stdout:3/406: unlink d9/d18/d5f/d6e/c31 0 2024-02-16T22:19:13.348 INFO:tasks.workunit.client.1.smithi173.stdout:3/407: link c0 d9/d18/d73/c8f 0 2024-02-16T22:19:13.349 INFO:tasks.workunit.client.1.smithi173.stdout:3/408: rmdir d9/d1a/d2b/d4d/d5b 39 2024-02-16T22:19:13.358 INFO:tasks.workunit.client.1.smithi173.stdout:3/409: dread d9/d17/d25/f39 [0,4194304] 0 2024-02-16T22:19:13.359 INFO:tasks.workunit.client.1.smithi173.stdout:3/410: chown d9/d1a/d2b/d4d/d5b/f89 155 1 2024-02-16T22:19:13.372 INFO:tasks.workunit.client.1.smithi173.stdout:3/411: dwrite d9/d17/f54 [0,4194304] 0 2024-02-16T22:19:13.372 INFO:tasks.workunit.client.1.smithi173.stdout:3/412: chown d9/d18/d5f/d6e/c41 407117607 1 2024-02-16T22:19:13.372 INFO:tasks.workunit.client.1.smithi173.stdout:3/413: readlink d9/d18/d73/l78 0 2024-02-16T22:19:13.374 INFO:tasks.workunit.client.1.smithi173.stdout:3/414: unlink d9/d1a/d2b/d4d/d5b/f76 0 2024-02-16T22:19:13.376 INFO:tasks.workunit.client.1.smithi173.stdout:3/415: rename d9/d1a/d2b/l37 to d9/d1a/d2b/d49/d81/l90 0 2024-02-16T22:19:13.382 INFO:tasks.workunit.client.1.smithi173.stdout:3/416: dread d9/d18/d5f/f69 [0,4194304] 0 2024-02-16T22:19:13.423 INFO:tasks.workunit.client.1.smithi173.stdout:3/417: dwrite d9/d18/f62 [0,4194304] 0 2024-02-16T22:19:13.428 INFO:tasks.workunit.client.1.smithi173.stdout:3/418: rename d9/da/cf to d9/d1a/c91 0 2024-02-16T22:19:13.429 INFO:tasks.workunit.client.1.smithi173.stdout:3/419: mkdir d9/d1a/d2b/d45/d51/d92 0 2024-02-16T22:19:13.429 INFO:tasks.workunit.client.1.smithi173.stdout:3/420: write d9/d1a/d2b/d4d/d5b/f89 [682277,20040] 0 2024-02-16T22:19:13.429 INFO:tasks.workunit.client.1.smithi173.stdout:3/421: getdents d9/d1a/d2b/d45/d60 0 2024-02-16T22:19:13.430 INFO:tasks.workunit.client.1.smithi173.stdout:3/422: chown d9/d1a/d2b/d49/d81/l90 0 1 2024-02-16T22:19:13.434 INFO:tasks.workunit.client.1.smithi173.stdout:3/423: dread d9/d1a/f34 [0,4194304] 0 2024-02-16T22:19:13.458 INFO:tasks.workunit.client.1.smithi173.stdout:3/424: dwrite d9/d18/d5f/d6e/f5a [0,4194304] 0 2024-02-16T22:19:13.458 INFO:tasks.workunit.client.1.smithi173.stdout:3/425: chown d9/d1a/d2b/d4d/f52 36088443 1 2024-02-16T22:19:13.459 INFO:tasks.workunit.client.1.smithi173.stdout:3/426: fsync d9/d17/f54 0 2024-02-16T22:19:13.459 INFO:tasks.workunit.client.1.smithi173.stdout:3/427: chown d9/d1a/d2b/d45/d51 4 1 2024-02-16T22:19:13.459 INFO:tasks.workunit.client.1.smithi173.stdout:3/428: rmdir d9/d1a/d2b/d49 39 2024-02-16T22:19:13.459 INFO:tasks.workunit.client.1.smithi173.stdout:3/429: mkdir d9/d17/d93 0 2024-02-16T22:19:13.460 INFO:tasks.workunit.client.1.smithi173.stdout:3/430: mkdir d9/d1a/d2b/d4d/d94 0 2024-02-16T22:19:13.460 INFO:tasks.workunit.client.1.smithi173.stdout:3/431: readlink d9/d17/l36 0 2024-02-16T22:19:13.461 INFO:tasks.workunit.client.1.smithi173.stdout:3/432: symlink d9/d1a/d2b/d49/l95 0 2024-02-16T22:19:13.462 INFO:tasks.workunit.client.1.smithi173.stdout:3/433: symlink d9/d18/d73/l96 0 2024-02-16T22:19:13.462 INFO:tasks.workunit.client.1.smithi173.stdout:3/434: readlink d9/d1a/d2b/d49/d81/l90 0 2024-02-16T22:19:13.462 INFO:tasks.workunit.client.1.smithi173.stdout:3/435: chown d9/d1a/d2b/d4d/f8c 5 1 2024-02-16T22:19:13.462 INFO:tasks.workunit.client.1.smithi173.stdout:3/436: chown d9/d18/d5f/d6e/c20 31654576 1 2024-02-16T22:19:13.462 INFO:tasks.workunit.client.1.smithi173.stdout:3/437: truncate d9/da/f7e 958747 0 2024-02-16T22:19:13.463 INFO:tasks.workunit.client.1.smithi173.stdout:3/438: write d9/d17/d25/f50 [273566,96901] 0 2024-02-16T22:19:13.463 INFO:tasks.workunit.client.1.smithi173.stdout:3/439: creat d9/d1a/d2b/d45/d60/f97 x:0 0 0 2024-02-16T22:19:13.464 INFO:tasks.workunit.client.1.smithi173.stdout:3/440: read d9/d18/d5f/d6e/f3d [819328,77779] 0 2024-02-16T22:19:13.464 INFO:tasks.workunit.client.1.smithi173.stdout:3/441: chown f8 261855 1 2024-02-16T22:19:13.464 INFO:tasks.workunit.client.1.smithi173.stdout:3/442: mkdir d9/d1a/d2b/d4d/d94/d98 0 2024-02-16T22:19:13.464 INFO:tasks.workunit.client.1.smithi173.stdout:3/443: chown d9/d17/d25/l3b 312537180 1 2024-02-16T22:19:13.464 INFO:tasks.workunit.client.1.smithi173.stdout:3/444: read - d9/f29 zero size 2024-02-16T22:19:13.467 INFO:tasks.workunit.client.1.smithi173.stdout:3/445: dread d9/da/f43 [0,4194304] 0 2024-02-16T22:19:13.467 INFO:tasks.workunit.client.1.smithi173.stdout:3/446: write d9/d18/d5f/d6e/f3d [1303719,44736] 0 2024-02-16T22:19:13.468 INFO:tasks.workunit.client.1.smithi173.stdout:3/447: creat d9/d18/d5f/d6e/d4e/f99 x:0 0 0 2024-02-16T22:19:13.468 INFO:tasks.workunit.client.1.smithi173.stdout:3/448: stat d9/d18/d5f/d6e/d4e/f99 0 2024-02-16T22:19:13.471 INFO:tasks.workunit.client.1.smithi173.stdout:3/449: dread d9/d17/d25/f39 [0,4194304] 0 2024-02-16T22:19:13.472 INFO:tasks.workunit.client.1.smithi173.stdout:3/450: unlink d9/d1a/c3f 0 2024-02-16T22:19:13.472 INFO:tasks.workunit.client.1.smithi173.stdout:3/451: readlink d9/l1f 0 2024-02-16T22:19:13.473 INFO:tasks.workunit.client.1.smithi173.stdout:7/347: sync 2024-02-16T22:19:13.473 INFO:tasks.workunit.client.1.smithi173.stdout:5/439: sync 2024-02-16T22:19:13.473 INFO:tasks.workunit.client.1.smithi173.stdout:5/440: rename d8/da/d1f/d33/f7e to d8/da/d1f/d33/f83 0 2024-02-16T22:19:13.474 INFO:tasks.workunit.client.1.smithi173.stdout:5/441: fsync d8/f29 0 2024-02-16T22:19:13.474 INFO:tasks.workunit.client.1.smithi173.stdout:7/348: creat d1/d1d/d4c/d63/d13/d36/d49/f68 x:0 0 0 2024-02-16T22:19:13.475 INFO:tasks.workunit.client.1.smithi173.stdout:5/442: dread d8/da/d2d/d36/f40 [0,4194304] 0 2024-02-16T22:19:13.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:13 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:19:13.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:13 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:19:13.481 INFO:tasks.workunit.client.1.smithi173.stdout:3/452: write d9/da/f70 [798841,126737] 0 2024-02-16T22:19:13.481 INFO:tasks.workunit.client.1.smithi173.stdout:3/453: fsync d9/d18/d5f/f69 0 2024-02-16T22:19:13.482 INFO:tasks.workunit.client.1.smithi173.stdout:3/454: symlink d9/d1a/d2b/d4d/d94/d98/l9a 0 2024-02-16T22:19:13.483 INFO:tasks.workunit.client.1.smithi173.stdout:3/455: symlink d9/d1a/l9b 0 2024-02-16T22:19:13.483 INFO:tasks.workunit.client.1.smithi173.stdout:3/456: rename d9/d1a to d9/d1a/d9c 22 2024-02-16T22:19:13.485 INFO:tasks.workunit.client.1.smithi173.stdout:7/349: rmdir d1/d1d/d4c/d63/d13 39 2024-02-16T22:19:13.485 INFO:tasks.workunit.client.1.smithi173.stdout:7/350: rename d1/d1d/d4c to d1/d1d/d4c/d69 22 2024-02-16T22:19:13.486 INFO:tasks.workunit.client.1.smithi173.stdout:7/351: mknod d1/d1d/d4c/d63/d13/c6a 0 2024-02-16T22:19:13.487 INFO:tasks.workunit.client.1.smithi173.stdout:7/352: rmdir d1/d1d/d4c/d63 39 2024-02-16T22:19:13.488 INFO:tasks.workunit.client.1.smithi173.stdout:3/457: dread d9/d1a/d2b/d45/d60/d6a/f6f [0,4194304] 0 2024-02-16T22:19:13.491 INFO:tasks.workunit.client.1.smithi173.stdout:7/353: write d1/d1d/f1e [597129,105383] 0 2024-02-16T22:19:13.491 INFO:tasks.workunit.client.1.smithi173.stdout:7/354: fdatasync d1/d1d/d44/f57 0 2024-02-16T22:19:13.501 INFO:tasks.workunit.client.1.smithi173.stdout:3/458: dread d9/d18/d5f/d6e/f5a [0,4194304] 0 2024-02-16T22:19:13.503 INFO:tasks.workunit.client.1.smithi173.stdout:3/459: mknod d9/d18/d5f/d6e/d4e/c9d 0 2024-02-16T22:19:13.503 INFO:tasks.workunit.client.1.smithi173.stdout:3/460: fsync d9/d1a/d2b/d4d/d5b/f77 0 2024-02-16T22:19:13.504 INFO:tasks.workunit.client.1.smithi173.stdout:3/461: creat d9/d18/d5f/f9e x:0 0 0 2024-02-16T22:19:13.504 INFO:tasks.workunit.client.1.smithi173.stdout:3/462: write d9/da/f70 [1522507,95898] 0 2024-02-16T22:19:13.504 INFO:tasks.workunit.client.1.smithi173.stdout:3/463: write d9/d18/d73/f75 [52802,72056] 0 2024-02-16T22:19:13.504 INFO:tasks.workunit.client.1.smithi173.stdout:3/464: rename d9 to d9/d18/d73/d9f 22 2024-02-16T22:19:13.505 INFO:tasks.workunit.client.1.smithi173.stdout:3/465: symlink d9/d1a/d2b/d4d/d94/la0 0 2024-02-16T22:19:13.505 INFO:tasks.workunit.client.1.smithi173.stdout:3/466: symlink d9/d18/d5f/d6e/d4e/la1 0 2024-02-16T22:19:13.506 INFO:tasks.workunit.client.1.smithi173.stdout:3/467: dread - d9/d1a/d2b/d49/d7a/f8a zero size 2024-02-16T22:19:13.506 INFO:tasks.workunit.client.1.smithi173.stdout:3/468: creat d9/d1a/d2b/d45/d51/fa2 x:0 0 0 2024-02-16T22:19:13.507 INFO:tasks.workunit.client.1.smithi173.stdout:3/469: mkdir d9/d18/da3 0 2024-02-16T22:19:13.507 INFO:tasks.workunit.client.1.smithi173.stdout:3/470: dread - d9/d1a/f8e zero size 2024-02-16T22:19:13.507 INFO:tasks.workunit.client.1.smithi173.stdout:3/471: read d9/d18/d73/f75 [78447,69542] 0 2024-02-16T22:19:13.507 INFO:tasks.workunit.client.1.smithi173.stdout:3/472: read d9/d1a/d2b/d4d/d5b/f7b [224783,57061] 0 2024-02-16T22:19:13.507 INFO:tasks.workunit.client.1.smithi173.stdout:3/473: creat d9/d18/d5f/fa4 x:0 0 0 2024-02-16T22:19:13.508 INFO:tasks.workunit.client.1.smithi173.stdout:3/474: rename d9/d17/d25/c8d to d9/d18/d5f/d6e/ca5 0 2024-02-16T22:19:13.510 INFO:tasks.workunit.client.1.smithi173.stdout:3/475: unlink d9/da/f70 0 2024-02-16T22:19:13.510 INFO:tasks.workunit.client.1.smithi173.stdout:3/476: write d9/d1a/f8e [253191,67933] 0 2024-02-16T22:19:13.510 INFO:tasks.workunit.client.1.smithi173.stdout:3/477: dread - d9/d18/d5f/f9e zero size 2024-02-16T22:19:13.510 INFO:tasks.workunit.client.1.smithi173.stdout:3/478: mkdir d9/d1a/d2b/da6 0 2024-02-16T22:19:13.513 INFO:tasks.workunit.client.1.smithi173.stdout:7/355: dwrite d1/d1d/f45 [0,4194304] 0 2024-02-16T22:19:13.518 INFO:tasks.workunit.client.1.smithi173.stdout:3/479: dread d9/d18/f62 [0,4194304] 0 2024-02-16T22:19:13.538 INFO:tasks.workunit.client.1.smithi173.stdout:4/276: sync 2024-02-16T22:19:13.539 INFO:tasks.workunit.client.1.smithi173.stdout:4/277: creat d7/df/d4f/f5d x:0 0 0 2024-02-16T22:19:13.540 INFO:tasks.workunit.client.1.smithi173.stdout:4/278: mknod d7/d12/d2d/c5e 0 2024-02-16T22:19:13.541 INFO:tasks.workunit.client.1.smithi173.stdout:4/279: read d7/d12/f19 [664350,86631] 0 2024-02-16T22:19:13.541 INFO:tasks.workunit.client.1.smithi173.stdout:4/280: write d7/df/f58 [799045,2306] 0 2024-02-16T22:19:13.543 INFO:tasks.workunit.client.1.smithi173.stdout:4/281: rmdir d7/df 39 2024-02-16T22:19:13.545 INFO:tasks.workunit.client.1.smithi173.stdout:4/282: rmdir d7/d28/d31/d33 39 2024-02-16T22:19:13.547 INFO:tasks.workunit.client.1.smithi173.stdout:4/283: creat d7/f5f x:0 0 0 2024-02-16T22:19:13.547 INFO:tasks.workunit.client.1.smithi173.stdout:4/284: truncate d7/df/d4f/d3d/f5b 974749 0 2024-02-16T22:19:13.547 INFO:tasks.workunit.client.1.smithi173.stdout:4/285: chown d7/df/l56 488 1 2024-02-16T22:19:13.547 INFO:tasks.workunit.client.1.smithi173.stdout:4/286: creat d7/d28/d52/f60 x:0 0 0 2024-02-16T22:19:13.555 INFO:tasks.workunit.client.1.smithi173.stdout:4/287: dread d7/d12/d2d/f44 [0,4194304] 0 2024-02-16T22:19:13.556 INFO:tasks.workunit.client.1.smithi173.stdout:4/288: write d7/d12/d2d/f5c [539631,111119] 0 2024-02-16T22:19:13.556 INFO:tasks.workunit.client.1.smithi173.stdout:4/289: write d7/d28/d14/f40 [32493,37126] 0 2024-02-16T22:19:13.556 INFO:tasks.workunit.client.1.smithi173.stdout:4/290: write d7/d12/f2b [3482809,87275] 0 2024-02-16T22:19:13.556 INFO:tasks.workunit.client.1.smithi173.stdout:4/291: getdents d7/df/d4f/d4e 0 2024-02-16T22:19:13.557 INFO:tasks.workunit.client.1.smithi173.stdout:4/292: symlink d7/d12/d2d/l61 0 2024-02-16T22:19:13.557 INFO:tasks.workunit.client.1.smithi173.stdout:4/293: mkdir d7/df/d62 0 2024-02-16T22:19:13.558 INFO:tasks.workunit.client.1.smithi173.stdout:4/294: write d7/d28/d52/f60 [23375,107946] 0 2024-02-16T22:19:13.558 INFO:tasks.workunit.client.1.smithi173.stdout:4/295: unlink d7/df/c20 0 2024-02-16T22:19:13.779 INFO:tasks.workunit.client.1.smithi173.stdout:8/474: sync 2024-02-16T22:19:13.779 INFO:tasks.workunit.client.1.smithi173.stdout:6/348: sync 2024-02-16T22:19:13.779 INFO:tasks.workunit.client.1.smithi173.stdout:8/475: fsync dd/d9d/f54 0 2024-02-16T22:19:13.780 INFO:tasks.workunit.client.1.smithi173.stdout:8/476: creat dd/fab x:0 0 0 2024-02-16T22:19:13.780 INFO:tasks.workunit.client.1.smithi173.stdout:8/477: chown dd/d7c/d7d/d22/d2e/l43 495 1 2024-02-16T22:19:13.780 INFO:tasks.workunit.client.1.smithi173.stdout:6/349: dread d0/db/d2e/d2f/d31/f39 [0,4194304] 0 2024-02-16T22:19:13.782 INFO:tasks.workunit.client.1.smithi173.stdout:8/478: dread dd/d7c/d7d/d22/d2e/d41/d6b/f8e [0,4194304] 0 2024-02-16T22:19:13.782 INFO:tasks.workunit.client.1.smithi173.stdout:8/479: stat dd/d7c/d7d/d22/d28/f90 0 2024-02-16T22:19:13.782 INFO:tasks.workunit.client.1.smithi173.stdout:8/480: creat dd/fac x:0 0 0 2024-02-16T22:19:13.782 INFO:tasks.workunit.client.1.smithi173.stdout:6/350: mkdir d0/db/d2e/d65/d73/d81 0 2024-02-16T22:19:13.783 INFO:tasks.workunit.client.1.smithi173.stdout:8/481: mkdir dd/d7c/d7d/d89/dad 0 2024-02-16T22:19:13.784 INFO:tasks.workunit.client.1.smithi173.stdout:8/482: mkdir dd/d7c/d7d/d22/d28/d40/d69/da7/dae 0 2024-02-16T22:19:13.785 INFO:tasks.workunit.client.1.smithi173.stdout:8/483: fsync dd/d7c/d7d/d22/d50/f6e 0 2024-02-16T22:19:13.785 INFO:tasks.workunit.client.1.smithi173.stdout:8/484: write dd/d7c/d7d/f27 [4918006,109392] 0 2024-02-16T22:19:13.785 INFO:tasks.workunit.client.1.smithi173.stdout:8/485: chown dd/fac 189520 1 2024-02-16T22:19:13.785 INFO:tasks.workunit.client.1.smithi173.stdout:6/351: rename d0/f1e to d0/db/d2e/d2f/f82 0 2024-02-16T22:19:13.800 INFO:tasks.workunit.client.1.smithi173.stdout:8/486: dwrite dd/d7c/d7d/d22/d28/f2f [0,4194304] 0 2024-02-16T22:19:13.800 INFO:tasks.workunit.client.1.smithi173.stdout:8/487: write dd/d7c/d7d/d22/d28/f90 [548784,50175] 0 2024-02-16T22:19:13.800 INFO:tasks.workunit.client.1.smithi173.stdout:8/488: readlink l8 0 2024-02-16T22:19:13.801 INFO:tasks.workunit.client.1.smithi173.stdout:8/489: write dd/d7c/d7d/d22/d2e/d41/d6b/f8e [58932,89377] 0 2024-02-16T22:19:13.801 INFO:tasks.workunit.client.1.smithi173.stdout:8/490: write dd/d7c/d7d/d22/d5a/f61 [3908343,47928] 0 2024-02-16T22:19:13.801 INFO:tasks.workunit.client.1.smithi173.stdout:8/491: write dd/d7c/d7d/d22/d2e/f48 [108953,49700] 0 2024-02-16T22:19:13.801 INFO:tasks.workunit.client.1.smithi173.stdout:8/492: getdents dd/d7c/d7d/d22/d5a 0 2024-02-16T22:19:13.816 INFO:tasks.workunit.client.1.smithi173.stdout:8/493: dwrite dd/d7c/d7d/d58/f91 [0,4194304] 0 2024-02-16T22:19:13.816 INFO:tasks.workunit.client.1.smithi173.stdout:8/494: truncate dd/d7c/d7d/d22/d2e/d41/d6b/f8e 1421718 0 2024-02-16T22:19:13.816 INFO:tasks.workunit.client.1.smithi173.stdout:8/495: fsync dd/d7c/d8f/fa1 0 2024-02-16T22:19:13.818 INFO:tasks.workunit.client.1.smithi173.stdout:8/496: getdents dd/d7c/d7d/d22/d28 0 2024-02-16T22:19:13.819 INFO:tasks.workunit.client.1.smithi173.stdout:8/497: truncate dd/d7c/d7d/f60 207973 0 2024-02-16T22:19:13.820 INFO:tasks.workunit.client.1.smithi173.stdout:8/498: rename dd/d7c/d7d/d22/d2e/d41/f56 to dd/d7c/d7d/d93/daa/faf 0 2024-02-16T22:19:13.836 INFO:tasks.workunit.client.1.smithi173.stdout:8/499: dwrite f2 [0,4194304] 0 2024-02-16T22:19:13.837 INFO:tasks.workunit.client.1.smithi173.stdout:8/500: getdents dd/d7c/d7d/d93 0 2024-02-16T22:19:13.845 INFO:tasks.workunit.client.1.smithi173.stdout:8/501: read dd/d7c/d7d/f13 [2121101,94017] 0 2024-02-16T22:19:13.846 INFO:tasks.workunit.client.1.smithi173.stdout:8/502: mkdir dd/d7c/d7d/d89/db0 0 2024-02-16T22:19:13.846 INFO:tasks.workunit.client.1.smithi173.stdout:8/503: readlink dd/d7c/d7d/d22/d28/d40/d51/l7f 0 2024-02-16T22:19:13.859 INFO:tasks.workunit.client.1.smithi173.stdout:8/504: dwrite dd/d7c/d7d/d22/d5a/f67 [0,4194304] 0 2024-02-16T22:19:13.861 INFO:tasks.workunit.client.1.smithi173.stdout:8/505: link dd/d7c/d7d/d22/d5a/l8d dd/d7c/d7d/d93/lb1 0 2024-02-16T22:19:13.875 INFO:tasks.workunit.client.1.smithi173.stdout:8/506: dwrite dd/d7c/d7d/d22/d28/f33 [0,4194304] 0 2024-02-16T22:19:13.876 INFO:tasks.workunit.client.1.smithi173.stdout:8/507: mkdir dd/d9d/db2 0 2024-02-16T22:19:13.876 INFO:tasks.workunit.client.1.smithi173.stdout:8/508: read dd/d7c/d7d/d22/d2e/f71 [23231,73503] 0 2024-02-16T22:19:13.877 INFO:tasks.workunit.client.1.smithi173.stdout:8/509: creat dd/d7c/d7d/d22/d50/fb3 x:0 0 0 2024-02-16T22:19:13.882 INFO:tasks.workunit.client.1.smithi173.stdout:8/510: dread dd/d7c/d7d/d22/d2e/f48 [0,4194304] 0 2024-02-16T22:19:13.883 INFO:tasks.workunit.client.1.smithi173.stdout:8/511: truncate dd/d7c/d7d/d22/d28/d40/f74 3753389 0 2024-02-16T22:19:13.884 INFO:tasks.workunit.client.1.smithi173.stdout:8/512: write dd/d7c/d7d/d22/d28/d40/f59 [434527,91676] 0 2024-02-16T22:19:13.886 INFO:tasks.workunit.client.1.smithi173.stdout:8/513: truncate dd/d7c/d7d/d22/f32 2665611 0 2024-02-16T22:19:13.886 INFO:tasks.workunit.client.1.smithi173.stdout:8/514: dread - dd/d7c/d7d/d22/d50/fb3 zero size 2024-02-16T22:19:13.886 INFO:tasks.workunit.client.1.smithi173.stdout:8/515: dread - dd/d7c/d7d/d22/d50/f62 zero size 2024-02-16T22:19:13.895 INFO:tasks.workunit.client.1.smithi173.stdout:8/516: write dd/d7c/d7d/d58/f91 [4179067,5909] 0 2024-02-16T22:19:13.896 INFO:tasks.workunit.client.1.smithi173.stdout:8/517: fsync f2 0 2024-02-16T22:19:13.917 INFO:tasks.workunit.client.1.smithi173.stdout:8/518: dwrite dd/f16 [0,4194304] 0 2024-02-16T22:19:13.917 INFO:tasks.workunit.client.1.smithi173.stdout:8/519: creat dd/d7c/d7d/d22/d2e/d41/fb4 x:0 0 0 2024-02-16T22:19:13.919 INFO:tasks.workunit.client.1.smithi173.stdout:8/520: creat dd/d7c/d7d/d22/d28/fb5 x:0 0 0 2024-02-16T22:19:13.919 INFO:tasks.workunit.client.1.smithi173.stdout:8/521: truncate dd/d7c/d7d/d22/d2e/d41/f4a 5143135 0 2024-02-16T22:19:13.919 INFO:tasks.workunit.client.1.smithi173.stdout:8/522: readlink dd/d7c/d7d/d22/d2e/l4d 0 2024-02-16T22:19:13.921 INFO:tasks.workunit.client.1.smithi173.stdout:8/523: unlink dd/d9d/f70 0 2024-02-16T22:19:13.927 INFO:tasks.workunit.client.1.smithi173.stdout:8/524: dread dd/d7c/d7d/d22/d2e/d41/f4a [0,4194304] 0 2024-02-16T22:19:13.927 INFO:tasks.workunit.client.1.smithi173.stdout:8/525: chown dd/d7c/d7d/d58 13034829 1 2024-02-16T22:19:13.928 INFO:tasks.workunit.client.1.smithi173.stdout:8/526: creat dd/d7c/d7d/d89/db0/fb6 x:0 0 0 2024-02-16T22:19:13.932 INFO:tasks.workunit.client.1.smithi173.stdout:8/527: mknod dd/d7c/d7d/d22/d2e/d41/cb7 0 2024-02-16T22:19:13.932 INFO:tasks.workunit.client.1.smithi173.stdout:8/528: chown dd/c6d 10 1 2024-02-16T22:19:13.932 INFO:tasks.workunit.client.1.smithi173.stdout:8/529: stat dd/f86 0 2024-02-16T22:19:13.932 INFO:tasks.workunit.client.1.smithi173.stdout:8/530: write dd/d7c/d7d/d22/d2e/d41/f4a [543208,87215] 0 2024-02-16T22:19:13.932 INFO:tasks.workunit.client.1.smithi173.stdout:8/531: write dd/d7c/d7d/f3d [1201262,72608] 0 2024-02-16T22:19:13.934 INFO:tasks.workunit.client.1.smithi173.stdout:2/439: sync 2024-02-16T22:19:13.935 INFO:tasks.workunit.client.1.smithi173.stdout:4/296: sync 2024-02-16T22:19:13.935 INFO:tasks.workunit.client.1.smithi173.stdout:4/297: chown d7/d12/d2d/c5e 15347466 1 2024-02-16T22:19:13.935 INFO:tasks.workunit.client.1.smithi173.stdout:7/356: sync 2024-02-16T22:19:13.936 INFO:tasks.workunit.client.1.smithi173.stdout:1/549: sync 2024-02-16T22:19:13.936 INFO:tasks.workunit.client.1.smithi173.stdout:5/443: sync 2024-02-16T22:19:13.936 INFO:tasks.workunit.client.1.smithi173.stdout:3/480: sync 2024-02-16T22:19:13.936 INFO:tasks.workunit.client.1.smithi173.stdout:0/307: sync 2024-02-16T22:19:13.936 INFO:tasks.workunit.client.1.smithi173.stdout:9/312: sync 2024-02-16T22:19:13.936 INFO:tasks.workunit.client.1.smithi173.stdout:9/313: write d1/d2/d1a/d3e/f57 [1281498,28443] 0 2024-02-16T22:19:13.937 INFO:tasks.workunit.client.1.smithi173.stdout:2/440: creat d2/dc/d19/d1a/d74/f90 x:0 0 0 2024-02-16T22:19:13.940 INFO:tasks.workunit.client.1.smithi173.stdout:1/550: symlink db/d5f/da9/lc0 0 2024-02-16T22:19:13.940 INFO:tasks.workunit.client.1.smithi173.stdout:7/357: dread d1/d1d/f1e [0,4194304] 0 2024-02-16T22:19:13.940 INFO:tasks.workunit.client.1.smithi173.stdout:5/444: creat d8/da/d2d/f84 x:0 0 0 2024-02-16T22:19:13.942 INFO:tasks.workunit.client.1.smithi173.stdout:3/481: mkdir d9/d18/d5f/d6e/da7 0 2024-02-16T22:19:13.943 INFO:tasks.workunit.client.1.smithi173.stdout:3/482: readlink d9/d1a/d2b/d49/l7f 0 2024-02-16T22:19:13.943 INFO:tasks.workunit.client.1.smithi173.stdout:8/532: write dd/d9d/f75 [2098055,58087] 0 2024-02-16T22:19:13.944 INFO:tasks.workunit.client.1.smithi173.stdout:0/308: rename d0/d4/d14/d24/d32/d39/c3f to d0/d4/d33/c62 0 2024-02-16T22:19:13.945 INFO:tasks.workunit.client.1.smithi173.stdout:3/483: dread d9/d18/d5f/d6e/f3d [0,4194304] 0 2024-02-16T22:19:13.948 INFO:tasks.workunit.client.1.smithi173.stdout:2/441: creat d2/d4/d57/f91 x:0 0 0 2024-02-16T22:19:13.949 INFO:tasks.workunit.client.1.smithi173.stdout:2/442: truncate d2/dc/d19/d1a/f52 1232966 0 2024-02-16T22:19:13.949 INFO:tasks.workunit.client.1.smithi173.stdout:4/298: rmdir d7/d28/d52 39 2024-02-16T22:19:13.949 INFO:tasks.workunit.client.1.smithi173.stdout:4/299: fsync d7/d28/f1d 0 2024-02-16T22:19:13.951 INFO:tasks.workunit.client.1.smithi173.stdout:1/551: truncate db/d30/f52 3491369 0 2024-02-16T22:19:13.956 INFO:tasks.workunit.client.1.smithi173.stdout:7/358: rename d1/d1d/d4c/d63/d13/d22/d53/d27/c2a to d1/d1d/d4c/c6b 0 2024-02-16T22:19:13.956 INFO:tasks.workunit.client.1.smithi173.stdout:7/359: chown d1/d1d/d4c/d63/d13/d36/d49 2 1 2024-02-16T22:19:13.957 INFO:tasks.workunit.client.1.smithi173.stdout:9/314: mkdir d1/d2/d1a/d3e/d4f/d65 0 2024-02-16T22:19:13.960 INFO:tasks.workunit.client.1.smithi173.stdout:8/533: write dd/f16 [3141365,116836] 0 2024-02-16T22:19:13.960 INFO:tasks.workunit.client.1.smithi173.stdout:5/445: getdents d8 0 2024-02-16T22:19:13.960 INFO:tasks.workunit.client.1.smithi173.stdout:5/446: fdatasync d8/da/d1f/d33/f83 0 2024-02-16T22:19:13.960 INFO:tasks.workunit.client.1.smithi173.stdout:5/447: getdents d8/da/d2d/d36/d50 0 2024-02-16T22:19:13.960 INFO:tasks.workunit.client.1.smithi173.stdout:2/443: write d2/dc/d19/f51 [1225160,3107] 0 2024-02-16T22:19:13.961 INFO:tasks.workunit.client.1.smithi173.stdout:7/360: rmdir d1/d1d 39 2024-02-16T22:19:13.961 INFO:tasks.workunit.client.1.smithi173.stdout:7/361: write d1/d1d/d4c/d63/d13/d22/d53/d27/f65 [309130,73339] 0 2024-02-16T22:19:13.961 INFO:tasks.workunit.client.1.smithi173.stdout:7/362: read - d1/d1d/f4e zero size 2024-02-16T22:19:13.963 INFO:tasks.workunit.client.1.smithi173.stdout:3/484: rename d9/d1a/d2b/c3a to d9/d1a/d2b/d4d/d5b/ca8 0 2024-02-16T22:19:13.964 INFO:tasks.workunit.client.1.smithi173.stdout:1/552: dread db/f18 [0,4194304] 0 2024-02-16T22:19:13.964 INFO:tasks.workunit.client.1.smithi173.stdout:1/553: creat db/d1c/d7f/d98/fc1 x:0 0 0 2024-02-16T22:19:13.964 INFO:tasks.workunit.client.1.smithi173.stdout:9/315: rmdir d1/d2/d10/d58 0 2024-02-16T22:19:13.966 INFO:tasks.workunit.client.1.smithi173.stdout:0/309: dwrite d0/d4/f18 [0,4194304] 0 2024-02-16T22:19:13.966 INFO:tasks.workunit.client.1.smithi173.stdout:5/448: truncate d8/d27/d28/f39 4033020 0 2024-02-16T22:19:13.969 INFO:tasks.workunit.client.1.smithi173.stdout:2/444: mknod d2/d4/d8/d80/c92 0 2024-02-16T22:19:13.969 INFO:tasks.workunit.client.1.smithi173.stdout:2/445: truncate d2/d10/d62/f63 764777 0 2024-02-16T22:19:13.970 INFO:tasks.workunit.client.1.smithi173.stdout:7/363: mkdir d1/d1d/d4c/d63/d6c 0 2024-02-16T22:19:13.972 INFO:tasks.workunit.client.1.smithi173.stdout:3/485: truncate d9/da/f15 372402 0 2024-02-16T22:19:13.975 INFO:tasks.workunit.client.1.smithi173.stdout:1/554: mkdir db/d29/d83/dc2 0 2024-02-16T22:19:13.978 INFO:tasks.workunit.client.1.smithi173.stdout:9/316: creat d1/d2/d1a/d3e/d4f/d65/f66 x:0 0 0 2024-02-16T22:19:13.978 INFO:tasks.workunit.client.1.smithi173.stdout:9/317: chown d1/f30 981154 1 2024-02-16T22:19:13.982 INFO:tasks.workunit.client.1.smithi173.stdout:8/534: read dd/d7c/d7d/d22/d2e/d41/f76 [2043543,725] 0 2024-02-16T22:19:13.982 INFO:tasks.workunit.client.1.smithi173.stdout:5/449: truncate d8/f29 407 0 2024-02-16T22:19:13.982 INFO:tasks.workunit.client.1.smithi173.stdout:2/446: mknod d2/dc/d19/d1a/d74/c93 0 2024-02-16T22:19:13.982 INFO:tasks.workunit.client.1.smithi173.stdout:5/450: write d8/f26 [1209572,127268] 0 2024-02-16T22:19:13.982 INFO:tasks.workunit.client.1.smithi173.stdout:3/486: mkdir d9/d1a/d2b/d4d/d5b/da9 0 2024-02-16T22:19:13.982 INFO:tasks.workunit.client.1.smithi173.stdout:3/487: truncate d9/d18/f62 4480331 0 2024-02-16T22:19:13.983 INFO:tasks.workunit.client.1.smithi173.stdout:1/555: creat db/d29/d57/fc3 x:0 0 0 2024-02-16T22:19:13.983 INFO:tasks.workunit.client.1.smithi173.stdout:1/556: truncate db/d1c/d7f/d98/fbd 591610 0 2024-02-16T22:19:13.983 INFO:tasks.workunit.client.1.smithi173.stdout:1/557: write db/d30/f4f [5869394,104908] 0 2024-02-16T22:19:13.983 INFO:tasks.workunit.client.1.smithi173.stdout:1/558: chown db/d30/l4c 366022 1 2024-02-16T22:19:13.983 INFO:tasks.workunit.client.1.smithi173.stdout:1/559: creat db/d1c/d25/d28/d3f/d4a/fc4 x:0 0 0 2024-02-16T22:19:13.984 INFO:tasks.workunit.client.1.smithi173.stdout:1/560: chown db/d1c/d5c/daf/cb4 183 1 2024-02-16T22:19:13.984 INFO:tasks.workunit.client.1.smithi173.stdout:6/352: sync 2024-02-16T22:19:13.984 INFO:tasks.workunit.client.1.smithi173.stdout:6/353: creat d0/db/d2e/f83 x:0 0 0 2024-02-16T22:19:13.984 INFO:tasks.workunit.client.1.smithi173.stdout:8/535: symlink dd/d7c/lb8 0 2024-02-16T22:19:13.985 INFO:tasks.workunit.client.1.smithi173.stdout:8/536: read dd/d7c/d7d/f20 [157882,43185] 0 2024-02-16T22:19:13.985 INFO:tasks.workunit.client.1.smithi173.stdout:8/537: truncate dd/d7c/d7d/d22/d2e/d41/d6b/f84 843036 0 2024-02-16T22:19:13.987 INFO:tasks.workunit.client.1.smithi173.stdout:5/451: mknod d8/d27/d28/c85 0 2024-02-16T22:19:13.988 INFO:tasks.workunit.client.1.smithi173.stdout:4/300: write d7/fd [1145893,18506] 0 2024-02-16T22:19:13.990 INFO:tasks.workunit.client.1.smithi173.stdout:3/488: mkdir d9/d18/daa 0 2024-02-16T22:19:13.993 INFO:tasks.workunit.client.1.smithi173.stdout:6/354: mknod d0/d7c/c84 0 2024-02-16T22:19:13.994 INFO:tasks.workunit.client.1.smithi173.stdout:8/538: mknod dd/d7c/d7d/d22/d2e/d41/cb9 0 2024-02-16T22:19:13.995 INFO:tasks.workunit.client.1.smithi173.stdout:5/452: mkdir d8/da/d2d/d36/d86 0 2024-02-16T22:19:13.995 INFO:tasks.workunit.client.1.smithi173.stdout:5/453: write d8/f26 [1918993,86319] 0 2024-02-16T22:19:13.995 INFO:tasks.workunit.client.1.smithi173.stdout:5/454: chown d8/d27/d35/f44 26601276 1 2024-02-16T22:19:13.995 INFO:tasks.workunit.client.1.smithi173.stdout:5/455: creat d8/d27/d62/f87 x:0 0 0 2024-02-16T22:19:13.996 INFO:tasks.workunit.client.1.smithi173.stdout:6/355: mknod d0/db/d2e/d2f/d31/d33/d6d/c85 0 2024-02-16T22:19:13.998 INFO:tasks.workunit.client.1.smithi173.stdout:2/447: dread d2/dc/d5d/f55 [0,4194304] 0 2024-02-16T22:19:13.998 INFO:tasks.workunit.client.1.smithi173.stdout:8/539: truncate dd/d7c/d7d/f14 2665088 0 2024-02-16T22:19:13.999 INFO:tasks.workunit.client.1.smithi173.stdout:5/456: truncate d8/da/f1d 43893 0 2024-02-16T22:19:14.000 INFO:tasks.workunit.client.1.smithi173.stdout:2/448: truncate d2/dc/d19/d1a/f46 568883 0 2024-02-16T22:19:14.000 INFO:tasks.workunit.client.1.smithi173.stdout:2/449: creat d2/d4/d8/d30/d44/d83/f94 x:0 0 0 2024-02-16T22:19:14.001 INFO:tasks.workunit.client.1.smithi173.stdout:8/540: mknod dd/d9d/db2/cba 0 2024-02-16T22:19:14.002 INFO:tasks.workunit.client.1.smithi173.stdout:5/457: getdents d8/da/d1f 0 2024-02-16T22:19:14.002 INFO:tasks.workunit.client.1.smithi173.stdout:5/458: truncate d8/d27/d62/f4a 4388888 0 2024-02-16T22:19:14.003 INFO:tasks.workunit.client.1.smithi173.stdout:2/450: getdents d2 0 2024-02-16T22:19:14.003 INFO:tasks.workunit.client.1.smithi173.stdout:5/459: mknod d8/da/d2d/c88 0 2024-02-16T22:19:14.005 INFO:tasks.workunit.client.1.smithi173.stdout:2/451: creat d2/d4/d8/f95 x:0 0 0 2024-02-16T22:19:14.005 INFO:tasks.workunit.client.1.smithi173.stdout:2/452: creat d2/dc/d19/d1c/f96 x:0 0 0 2024-02-16T22:19:14.005 INFO:tasks.workunit.client.1.smithi173.stdout:2/453: fdatasync d2/d4/f39 0 2024-02-16T22:19:14.006 INFO:tasks.workunit.client.1.smithi173.stdout:4/301: dread d7/d12/f17 [0,4194304] 0 2024-02-16T22:19:14.006 INFO:tasks.workunit.client.1.smithi173.stdout:4/302: chown d7/d12/d2d/l61 1809714 1 2024-02-16T22:19:14.006 INFO:tasks.workunit.client.1.smithi173.stdout:5/460: unlink d8/d27/c34 0 2024-02-16T22:19:14.006 INFO:tasks.workunit.client.1.smithi173.stdout:5/461: write d8/da/d1b/f64 [1446693,78250] 0 2024-02-16T22:19:14.006 INFO:tasks.workunit.client.1.smithi173.stdout:5/462: dread - d8/d27/d62/f68 zero size 2024-02-16T22:19:14.006 INFO:tasks.workunit.client.1.smithi173.stdout:5/463: read - d8/f7d zero size 2024-02-16T22:19:14.010 INFO:tasks.workunit.client.1.smithi173.stdout:4/303: rename d7/d12/d2d/l61 to d7/d28/d14/l63 0 2024-02-16T22:19:14.010 INFO:tasks.workunit.client.1.smithi173.stdout:4/304: stat d7/d28/d14/l1c 0 2024-02-16T22:19:14.011 INFO:tasks.workunit.client.1.smithi173.stdout:2/454: rmdir d2/d10 39 2024-02-16T22:19:14.011 INFO:tasks.workunit.client.1.smithi173.stdout:2/455: write d2/dc/d19/d1c/d53/f7e [585008,42785] 0 2024-02-16T22:19:14.011 INFO:tasks.workunit.client.1.smithi173.stdout:2/456: fsync d2/dc/d5d/f15 0 2024-02-16T22:19:14.011 INFO:tasks.workunit.client.1.smithi173.stdout:2/457: fsync d2/d4/d57/f91 0 2024-02-16T22:19:14.013 INFO:tasks.workunit.client.1.smithi173.stdout:5/464: dread f7 [0,4194304] 0 2024-02-16T22:19:14.013 INFO:tasks.workunit.client.1.smithi173.stdout:4/305: unlink d7/df/d4f/d4e/f54 0 2024-02-16T22:19:14.014 INFO:tasks.workunit.client.1.smithi173.stdout:2/458: creat d2/d4/d8/d30/f97 x:0 0 0 2024-02-16T22:19:14.017 INFO:tasks.workunit.client.1.smithi173.stdout:5/465: write f7 [1552347,103255] 0 2024-02-16T22:19:14.019 INFO:tasks.workunit.client.1.smithi173.stdout:5/466: rename d8/d27/d28/l7c to d8/d27/d35/l89 0 2024-02-16T22:19:14.020 INFO:tasks.workunit.client.1.smithi173.stdout:4/306: dread d7/d12/f19 [0,4194304] 0 2024-02-16T22:19:14.024 INFO:tasks.workunit.client.1.smithi173.stdout:0/310: dwrite d0/d4/d14/f23 [4194304,4194304] 0 2024-02-16T22:19:14.025 INFO:tasks.workunit.client.1.smithi173.stdout:0/311: write d0/d12/d15/f1c [170532,110548] 0 2024-02-16T22:19:14.025 INFO:tasks.workunit.client.1.smithi173.stdout:2/459: dread d2/d4/d8/d80/f72 [0,4194304] 0 2024-02-16T22:19:14.028 INFO:tasks.workunit.client.1.smithi173.stdout:2/460: rename f1 to d2/d4/d8/f98 0 2024-02-16T22:19:14.029 INFO:tasks.workunit.client.1.smithi173.stdout:7/364: dwrite d1/d1d/d4c/d63/d11/f42 [0,4194304] 0 2024-02-16T22:19:14.029 INFO:tasks.workunit.client.1.smithi173.stdout:0/312: symlink d0/d4/l63 0 2024-02-16T22:19:14.029 INFO:tasks.workunit.client.1.smithi173.stdout:0/313: fdatasync d0/f1 0 2024-02-16T22:19:14.033 INFO:tasks.workunit.client.1.smithi173.stdout:3/489: dwrite d9/d1a/d2b/d45/d60/d6a/f6f [0,4194304] 0 2024-02-16T22:19:14.033 INFO:tasks.workunit.client.1.smithi173.stdout:3/490: chown d9/d18/d5f/d6e/ca5 375 1 2024-02-16T22:19:14.033 INFO:tasks.workunit.client.1.smithi173.stdout:2/461: mkdir d2/d4/d8/d30/d44/d81/d99 0 2024-02-16T22:19:14.033 INFO:tasks.workunit.client.1.smithi173.stdout:1/561: dwrite db/f75 [4194304,4194304] 0 2024-02-16T22:19:14.033 INFO:tasks.workunit.client.1.smithi173.stdout:1/562: creat db/d29/d57/fc5 x:0 0 0 2024-02-16T22:19:14.036 INFO:tasks.workunit.client.1.smithi173.stdout:2/462: creat d2/d4/d8/d80/f9a x:0 0 0 2024-02-16T22:19:14.036 INFO:tasks.workunit.client.1.smithi173.stdout:5/467: write d8/d27/d28/f5b [940452,100571] 0 2024-02-16T22:19:14.042 INFO:tasks.workunit.client.1.smithi173.stdout:8/541: dwrite dd/d7c/d7d/d22/d28/d40/f78 [0,4194304] 0 2024-02-16T22:19:14.042 INFO:tasks.workunit.client.1.smithi173.stdout:8/542: chown dd/d7c/d7d/d58/c8a 5396 1 2024-02-16T22:19:14.046 INFO:tasks.workunit.client.1.smithi173.stdout:3/491: write f8 [5105135,20130] 0 2024-02-16T22:19:14.049 INFO:tasks.workunit.client.1.smithi173.stdout:8/543: link dd/d7c/d7d/d22/d28/d40/f64 dd/d7c/fbb 0 2024-02-16T22:19:14.051 INFO:tasks.workunit.client.1.smithi173.stdout:2/463: write d2/d10/f66 [4135224,61731] 0 2024-02-16T22:19:14.053 INFO:tasks.workunit.client.1.smithi173.stdout:9/318: dwrite d1/d2/d1a/f2b [4194304,4194304] 0 2024-02-16T22:19:14.053 INFO:tasks.workunit.client.1.smithi173.stdout:4/307: dwrite d7/d28/f1d [0,4194304] 0 2024-02-16T22:19:14.053 INFO:tasks.workunit.client.1.smithi173.stdout:4/308: readlink d7/d28/d31/l36 0 2024-02-16T22:19:14.053 INFO:tasks.workunit.client.1.smithi173.stdout:1/563: dread db/d1c/d25/d45/f90 [8388608,4194304] 0 2024-02-16T22:19:14.058 INFO:tasks.workunit.client.1.smithi173.stdout:2/464: link d2/l3 d2/d4/d8/d2d/l9b 0 2024-02-16T22:19:14.058 INFO:tasks.workunit.client.1.smithi173.stdout:2/465: creat d2/dc/d19/d1c/f9c x:0 0 0 2024-02-16T22:19:14.058 INFO:tasks.workunit.client.1.smithi173.stdout:3/492: creat d9/d17/d93/fab x:0 0 0 2024-02-16T22:19:14.059 INFO:tasks.workunit.client.1.smithi173.stdout:9/319: mknod d1/c67 0 2024-02-16T22:19:14.061 INFO:tasks.workunit.client.1.smithi173.stdout:4/309: link d7/df/l56 d7/df/d4f/d4e/l64 0 2024-02-16T22:19:14.061 INFO:tasks.workunit.client.1.smithi173.stdout:2/466: dread d2/d10/f4f [0,4194304] 0 2024-02-16T22:19:14.063 INFO:tasks.workunit.client.1.smithi173.stdout:8/544: dread dd/d7c/d7d/d22/d28/d40/f78 [0,4194304] 0 2024-02-16T22:19:14.064 INFO:tasks.workunit.client.1.smithi173.stdout:3/493: rename d9/da/c1e to d9/d17/cac 0 2024-02-16T22:19:14.066 INFO:tasks.workunit.client.1.smithi173.stdout:1/564: write db/d1c/f6b [1828850,26852] 0 2024-02-16T22:19:14.069 INFO:tasks.workunit.client.1.smithi173.stdout:9/320: creat d1/d2/d1a/d1f/f68 x:0 0 0 2024-02-16T22:19:14.069 INFO:tasks.workunit.client.1.smithi173.stdout:2/467: mknod d2/dc/d19/c9d 0 2024-02-16T22:19:14.069 INFO:tasks.workunit.client.1.smithi173.stdout:2/468: readlink d2/d4/d8/d2d/l89 0 2024-02-16T22:19:14.070 INFO:tasks.workunit.client.1.smithi173.stdout:3/494: mkdir d9/d18/d5f/dad 0 2024-02-16T22:19:14.070 INFO:tasks.workunit.client.1.smithi173.stdout:3/495: write d9/d17/d25/f39 [4656033,22721] 0 2024-02-16T22:19:14.074 INFO:tasks.workunit.client.1.smithi173.stdout:1/565: creat db/d29/d50/fc6 x:0 0 0 2024-02-16T22:19:14.074 INFO:tasks.workunit.client.1.smithi173.stdout:7/365: dwrite d1/f9 [0,4194304] 0 2024-02-16T22:19:14.074 INFO:tasks.workunit.client.1.smithi173.stdout:7/366: chown d1/d1d/d4c/d63/d13/d36 235 1 2024-02-16T22:19:14.074 INFO:tasks.workunit.client.1.smithi173.stdout:7/367: chown d1/d1d/d4c/d63/d13 310311 1 2024-02-16T22:19:14.075 INFO:tasks.workunit.client.1.smithi173.stdout:9/321: truncate d1/d2/d1a/d2f/f50 736887 0 2024-02-16T22:19:14.075 INFO:tasks.workunit.client.1.smithi173.stdout:9/322: chown d1/d2/d1a/l32 211013933 1 2024-02-16T22:19:14.076 INFO:tasks.workunit.client.1.smithi173.stdout:0/314: dwrite d0/d4/d14/d24/d32/d39/f2c [0,4194304] 0 2024-02-16T22:19:14.080 INFO:tasks.workunit.client.1.smithi173.stdout:3/496: mknod d9/d1a/d2b/d49/d7a/cae 0 2024-02-16T22:19:14.080 INFO:tasks.workunit.client.1.smithi173.stdout:1/566: dread db/d1d/f20 [0,4194304] 0 2024-02-16T22:19:14.081 INFO:tasks.workunit.client.1.smithi173.stdout:5/468: dwrite d8/da/d1f/d33/f83 [0,4194304] 0 2024-02-16T22:19:14.081 INFO:tasks.workunit.client.1.smithi173.stdout:5/469: creat d8/da/d2d/d36/f8a x:0 0 0 2024-02-16T22:19:14.083 INFO:tasks.workunit.client.1.smithi173.stdout:7/368: creat d1/d1d/d4c/d63/d13/d36/d49/f6d x:0 0 0 2024-02-16T22:19:14.083 INFO:tasks.workunit.client.1.smithi173.stdout:7/369: fdatasync d1/d1d/d4c/d63/d48/f5d 0 2024-02-16T22:19:14.083 INFO:tasks.workunit.client.1.smithi173.stdout:2/469: dread d2/d10/f64 [0,4194304] 0 2024-02-16T22:19:14.089 INFO:tasks.workunit.client.1.smithi173.stdout:0/315: rename d0/f1 to d0/d4/d14/d24/d32/d39/f64 0 2024-02-16T22:19:14.089 INFO:tasks.workunit.client.1.smithi173.stdout:9/323: read d1/d2/d1a/d2f/d3b/f4b [3212480,51650] 0 2024-02-16T22:19:14.089 INFO:tasks.workunit.client.1.smithi173.stdout:9/324: fsync d1/d2/d10/f33 0 2024-02-16T22:19:14.089 INFO:tasks.workunit.client.1.smithi173.stdout:9/325: chown d1/f18 1295 1 2024-02-16T22:19:14.090 INFO:tasks.workunit.client.1.smithi173.stdout:9/326: dread - d1/d2/d1a/d2f/f53 zero size 2024-02-16T22:19:14.092 INFO:tasks.workunit.client.1.smithi173.stdout:3/497: write d9/d1a/d2b/d49/f53 [515956,9549] 0 2024-02-16T22:19:14.093 INFO:tasks.workunit.client.1.smithi173.stdout:3/498: chown d9/d1a/l59 1110 1 2024-02-16T22:19:14.093 INFO:tasks.workunit.client.1.smithi173.stdout:4/310: dwrite d7/f9 [0,4194304] 0 2024-02-16T22:19:14.094 INFO:tasks.workunit.client.1.smithi173.stdout:4/311: fsync d7/df/d4f/f5d 0 2024-02-16T22:19:14.095 INFO:tasks.workunit.client.1.smithi173.stdout:8/545: dwrite dd/d7c/d7d/f2c [0,4194304] 0 2024-02-16T22:19:14.095 INFO:tasks.workunit.client.1.smithi173.stdout:8/546: readlink dd/d7c/d7d/d22/d2e/l43 0 2024-02-16T22:19:14.107 INFO:tasks.workunit.client.1.smithi173.stdout:1/567: symlink db/d29/d83/lc7 0 2024-02-16T22:19:14.113 INFO:tasks.workunit.client.1.smithi173.stdout:5/470: unlink d8/d27/d2f/c53 0 2024-02-16T22:19:14.115 INFO:tasks.workunit.client.1.smithi173.stdout:7/370: mknod d1/d1d/d4c/d63/d11/c6e 0 2024-02-16T22:19:14.119 INFO:tasks.workunit.client.1.smithi173.stdout:2/470: unlink d2/dc/d19/l49 0 2024-02-16T22:19:14.122 INFO:tasks.workunit.client.1.smithi173.stdout:0/316: creat d0/d12/d15/d3d/f65 x:0 0 0 2024-02-16T22:19:14.125 INFO:tasks.workunit.client.1.smithi173.stdout:3/499: creat d9/d1a/d2b/d4d/d5b/da9/faf x:0 0 0 2024-02-16T22:19:14.125 INFO:tasks.workunit.client.1.smithi173.stdout:0/317: dread d0/d4/d33/f3c [0,4194304] 0 2024-02-16T22:19:14.125 INFO:tasks.workunit.client.1.smithi173.stdout:0/318: chown d0/d4/d14/d38/f49 780 1 2024-02-16T22:19:14.126 INFO:tasks.workunit.client.1.smithi173.stdout:4/312: creat d7/df/d4f/d45/f65 x:0 0 0 2024-02-16T22:19:14.129 INFO:tasks.workunit.client.1.smithi173.stdout:3/500: dread d9/d18/d5f/d6e/f5a [0,4194304] 0 2024-02-16T22:19:14.130 INFO:tasks.workunit.client.1.smithi173.stdout:8/547: link dd/le dd/d7c/d7d/d89/db0/lbc 0 2024-02-16T22:19:14.131 INFO:tasks.workunit.client.1.smithi173.stdout:1/568: link f2 db/d1c/d25/d28/d3f/fc8 0 2024-02-16T22:19:14.132 INFO:tasks.workunit.client.1.smithi173.stdout:1/569: write db/d1c/d5c/f63 [1890807,44411] 0 2024-02-16T22:19:14.132 INFO:tasks.workunit.client.1.smithi173.stdout:7/371: getdents d1/d1d/d4c/d63/d11/d39 0 2024-02-16T22:19:14.132 INFO:tasks.workunit.client.1.smithi173.stdout:7/372: chown d1/d1d/d4c/d63/d13/d22/d53/c50 758153453 1 2024-02-16T22:19:14.133 INFO:tasks.workunit.client.1.smithi173.stdout:7/373: stat d1/d1d/f1e 0 2024-02-16T22:19:14.133 INFO:tasks.workunit.client.1.smithi173.stdout:7/374: creat d1/d1d/d4c/d63/d13/d36/d49/f6f x:0 0 0 2024-02-16T22:19:14.135 INFO:tasks.workunit.client.1.smithi173.stdout:9/327: link d1/d2/d10/f11 d1/d2/d1a/d3e/f69 0 2024-02-16T22:19:14.138 INFO:tasks.workunit.client.1.smithi173.stdout:0/319: creat d0/d4/d14/d24/d32/f66 x:0 0 0 2024-02-16T22:19:14.138 INFO:tasks.workunit.client.1.smithi173.stdout:0/320: creat d0/f67 x:0 0 0 2024-02-16T22:19:14.139 INFO:tasks.workunit.client.1.smithi173.stdout:5/471: dwrite d8/d27/d28/f5b [0,4194304] 0 2024-02-16T22:19:14.139 INFO:tasks.workunit.client.1.smithi173.stdout:4/313: link d7/d12/f30 d7/d28/d31/f66 0 2024-02-16T22:19:14.140 INFO:tasks.workunit.client.1.smithi173.stdout:4/314: write d7/d28/d31/f37 [705652,68175] 0 2024-02-16T22:19:14.143 INFO:tasks.workunit.client.1.smithi173.stdout:3/501: link d9/da/f7e d9/d1a/d2b/d49/fb0 0 2024-02-16T22:19:14.144 INFO:tasks.workunit.client.1.smithi173.stdout:3/502: creat d9/d18/fb1 x:0 0 0 2024-02-16T22:19:14.146 INFO:tasks.workunit.client.1.smithi173.stdout:8/548: creat dd/d7c/d7d/d93/daa/fbd x:0 0 0 2024-02-16T22:19:14.146 INFO:tasks.workunit.client.1.smithi173.stdout:8/549: truncate dd/d7c/d7d/d22/d2e/d41/fb4 1047009 0 2024-02-16T22:19:14.147 INFO:tasks.workunit.client.1.smithi173.stdout:7/375: rmdir d1/d1d/d4c/d63/d13/d22/d53/d27 39 2024-02-16T22:19:14.149 INFO:tasks.workunit.client.1.smithi173.stdout:2/471: getdents d2/d4/d8 0 2024-02-16T22:19:14.150 INFO:tasks.workunit.client.1.smithi173.stdout:2/472: readlink d2/dc/d5d/l23 0 2024-02-16T22:19:14.150 INFO:tasks.workunit.client.1.smithi173.stdout:0/321: dread d0/d4/fe [0,4194304] 0 2024-02-16T22:19:14.152 INFO:tasks.workunit.client.1.smithi173.stdout:5/472: mkdir d8/d27/d35/d8b 0 2024-02-16T22:19:14.153 INFO:tasks.workunit.client.1.smithi173.stdout:9/328: dwrite d1/d2/f13 [0,4194304] 0 2024-02-16T22:19:14.155 INFO:tasks.workunit.client.1.smithi173.stdout:4/315: link d7/df/d4f/d3d/f5b d7/df/d4f/f67 0 2024-02-16T22:19:14.155 INFO:tasks.workunit.client.1.smithi173.stdout:4/316: readlink d7/df/d4f/d4e/l64 0 2024-02-16T22:19:14.155 INFO:tasks.workunit.client.1.smithi173.stdout:4/317: read d7/d12/f19 [916319,74640] 0 2024-02-16T22:19:14.158 INFO:tasks.workunit.client.1.smithi173.stdout:3/503: unlink d9/d1a/d2b/d4d/d5b/f77 0 2024-02-16T22:19:14.158 INFO:tasks.workunit.client.1.smithi173.stdout:3/504: fsync d9/d1a/d2b/f2d 0 2024-02-16T22:19:14.158 INFO:tasks.workunit.client.1.smithi173.stdout:3/505: write d9/d1a/f8e [330229,46316] 0 2024-02-16T22:19:14.158 INFO:tasks.workunit.client.1.smithi173.stdout:3/506: truncate d9/d17/d93/fab 998381 0 2024-02-16T22:19:14.158 INFO:tasks.workunit.client.1.smithi173.stdout:3/507: chown d9/d18/d5f/d6e/d4e/f99 148841228 1 2024-02-16T22:19:14.159 INFO:tasks.workunit.client.1.smithi173.stdout:8/550: mknod dd/d7c/d7d/d89/db0/cbe 0 2024-02-16T22:19:14.159 INFO:tasks.workunit.client.1.smithi173.stdout:7/376: link d1/d1d/d4c/d63/d13/d36/d49/f68 d1/d1d/d4c/d63/d54/f70 0 2024-02-16T22:19:14.161 INFO:tasks.workunit.client.1.smithi173.stdout:2/473: unlink d2/dc/d19/d1a/d74/f90 0 2024-02-16T22:19:14.162 INFO:tasks.workunit.client.1.smithi173.stdout:5/473: mkdir d8/da/d1f/d8c 0 2024-02-16T22:19:14.162 INFO:tasks.workunit.client.1.smithi173.stdout:5/474: fdatasync d8/f2e 0 2024-02-16T22:19:14.163 INFO:tasks.workunit.client.1.smithi173.stdout:9/329: creat d1/d2/d1a/d3e/d4f/f6a x:0 0 0 2024-02-16T22:19:14.164 INFO:tasks.workunit.client.1.smithi173.stdout:4/318: dread d7/d28/d31/f3b [0,4194304] 0 2024-02-16T22:19:14.165 INFO:tasks.workunit.client.1.smithi173.stdout:4/319: write d7/d28/d31/f3b [5041736,94834] 0 2024-02-16T22:19:14.165 INFO:tasks.workunit.client.1.smithi173.stdout:3/508: unlink f7 0 2024-02-16T22:19:14.165 INFO:tasks.workunit.client.1.smithi173.stdout:3/509: write d9/f29 [709468,51483] 0 2024-02-16T22:19:14.167 INFO:tasks.workunit.client.1.smithi173.stdout:8/551: symlink dd/d7c/d7d/d22/d28/d40/d51/lbf 0 2024-02-16T22:19:14.167 INFO:tasks.workunit.client.1.smithi173.stdout:7/377: symlink d1/d1d/d4c/d63/d11/d39/l71 0 2024-02-16T22:19:14.167 INFO:tasks.workunit.client.1.smithi173.stdout:2/474: rmdir d2/d4/d8 39 2024-02-16T22:19:14.169 INFO:tasks.workunit.client.1.smithi173.stdout:5/475: symlink d8/da/d2d/d56/l8d 0 2024-02-16T22:19:14.169 INFO:tasks.workunit.client.1.smithi173.stdout:5/476: fsync d8/da/f47 0 2024-02-16T22:19:14.170 INFO:tasks.workunit.client.1.smithi173.stdout:9/330: truncate d1/d2/d1a/f20 2020584 0 2024-02-16T22:19:14.173 INFO:tasks.workunit.client.1.smithi173.stdout:8/552: rmdir dd/d9d/db2 39 2024-02-16T22:19:14.174 INFO:tasks.workunit.client.1.smithi173.stdout:8/553: truncate dd/f86 4489855 0 2024-02-16T22:19:14.174 INFO:tasks.workunit.client.1.smithi173.stdout:7/378: rmdir d1/d1d 39 2024-02-16T22:19:14.175 INFO:tasks.workunit.client.1.smithi173.stdout:3/510: read d9/da/fd [1283401,28479] 0 2024-02-16T22:19:14.176 INFO:tasks.workunit.client.1.smithi173.stdout:7/379: dread d1/d1d/f1e [0,4194304] 0 2024-02-16T22:19:14.176 INFO:tasks.workunit.client.1.smithi173.stdout:7/380: truncate d1/d1d/d44/f60 292224 0 2024-02-16T22:19:14.177 INFO:tasks.workunit.client.1.smithi173.stdout:5/477: link d8/d27/d2f/l5f d8/d27/d62/l8e 0 2024-02-16T22:19:14.178 INFO:tasks.workunit.client.1.smithi173.stdout:5/478: dread d8/da/d1b/f52 [0,4194304] 0 2024-02-16T22:19:14.178 INFO:tasks.workunit.client.1.smithi173.stdout:5/479: fsync d8/da/d2d/d36/f71 0 2024-02-16T22:19:14.178 INFO:tasks.workunit.client.1.smithi173.stdout:9/331: mkdir d1/d2/d1a/d3e/d4f/d65/d6b 0 2024-02-16T22:19:14.181 INFO:tasks.workunit.client.1.smithi173.stdout:8/554: symlink dd/d7c/d7d/d22/d28/lc0 0 2024-02-16T22:19:14.181 INFO:tasks.workunit.client.1.smithi173.stdout:8/555: chown dd/d7c/d7d/d22/d2e/d41/d6b/c80 5 1 2024-02-16T22:19:14.181 INFO:tasks.workunit.client.1.smithi173.stdout:8/556: creat dd/d7c/d7d/d22/d2e/d41/d73/fc1 x:0 0 0 2024-02-16T22:19:14.182 INFO:tasks.workunit.client.1.smithi173.stdout:8/557: dread - dd/d7c/d7d/d22/d2e/d41/d73/fc1 zero size 2024-02-16T22:19:14.182 INFO:tasks.workunit.client.1.smithi173.stdout:8/558: truncate dd/d7c/d7d/d22/d28/d40/f63 345473 0 2024-02-16T22:19:14.182 INFO:tasks.workunit.client.1.smithi173.stdout:4/320: dwrite d7/f9 [0,4194304] 0 2024-02-16T22:19:14.182 INFO:tasks.workunit.client.1.smithi173.stdout:3/511: symlink d9/d18/d5f/lb2 0 2024-02-16T22:19:14.184 INFO:tasks.workunit.client.1.smithi173.stdout:7/381: rename d1/d1d/d4c/c6b to d1/d1d/d4c/d63/d6c/c72 0 2024-02-16T22:19:14.185 INFO:tasks.workunit.client.1.smithi173.stdout:7/382: truncate d1/d1d/d4c/d63/d13/d36/f55 770289 0 2024-02-16T22:19:14.186 INFO:tasks.workunit.client.1.smithi173.stdout:5/480: link d8/da/d1b/c22 d8/da/d1f/d8c/c8f 0 2024-02-16T22:19:14.187 INFO:tasks.workunit.client.1.smithi173.stdout:5/481: chown d8/d27/d62 186 1 2024-02-16T22:19:14.190 INFO:tasks.workunit.client.1.smithi173.stdout:8/559: read dd/d7c/d7d/d22/d28/f47 [2128939,92485] 0 2024-02-16T22:19:14.191 INFO:tasks.workunit.client.1.smithi173.stdout:4/321: symlink d7/df/d4f/d4e/l68 0 2024-02-16T22:19:14.192 INFO:tasks.workunit.client.1.smithi173.stdout:3/512: truncate d9/da/f85 5251642 0 2024-02-16T22:19:14.195 INFO:tasks.workunit.client.1.smithi173.stdout:7/383: creat d1/d1d/d4c/d63/d13/d22/d53/d27/f73 x:0 0 0 2024-02-16T22:19:14.195 INFO:tasks.workunit.client.1.smithi173.stdout:7/384: creat d1/d1d/d4c/d63/d13/d36/d49/f74 x:0 0 0 2024-02-16T22:19:14.196 INFO:tasks.workunit.client.1.smithi173.stdout:7/385: dread d1/d1d/d4c/d63/d11/f14 [0,4194304] 0 2024-02-16T22:19:14.197 INFO:tasks.workunit.client.1.smithi173.stdout:5/482: rename d8/da/f60 to d8/da/d1b/f90 0 2024-02-16T22:19:14.199 INFO:tasks.workunit.client.1.smithi173.stdout:9/332: getdents d1/d2/d1a/d2f 0 2024-02-16T22:19:14.199 INFO:tasks.workunit.client.1.smithi173.stdout:9/333: chown d1/d2/d10/f33 28 1 2024-02-16T22:19:14.199 INFO:tasks.workunit.client.1.smithi173.stdout:9/334: dread - d1/d2/d1a/d3e/d4f/d65/f66 zero size 2024-02-16T22:19:14.201 INFO:tasks.workunit.client.1.smithi173.stdout:8/560: truncate dd/d7c/d7d/f39 1565237 0 2024-02-16T22:19:14.201 INFO:tasks.workunit.client.1.smithi173.stdout:8/561: chown dd/d7c/d7d/d22/d50/fb3 11496 1 2024-02-16T22:19:14.201 INFO:tasks.workunit.client.1.smithi173.stdout:8/562: read - dd/d7c/d8f/fa3 zero size 2024-02-16T22:19:14.202 INFO:tasks.workunit.client.1.smithi173.stdout:9/335: dread d1/d2/d10/f3f [0,4194304] 0 2024-02-16T22:19:14.202 INFO:tasks.workunit.client.1.smithi173.stdout:3/513: mknod d9/d1a/d2b/d4d/d94/d98/cb3 0 2024-02-16T22:19:14.202 INFO:tasks.workunit.client.1.smithi173.stdout:3/514: chown d9/d1a/d2b/d45/d60/d6a/c79 0 1 2024-02-16T22:19:14.204 INFO:tasks.workunit.client.1.smithi173.stdout:7/386: creat d1/d1d/d4c/d63/d48/f75 x:0 0 0 2024-02-16T22:19:14.206 INFO:tasks.workunit.client.1.smithi173.stdout:5/483: unlink d8/da/d2d/d36/l38 0 2024-02-16T22:19:14.208 INFO:tasks.workunit.client.1.smithi173.stdout:9/336: creat d1/d5f/d61/f6c x:0 0 0 2024-02-16T22:19:14.210 INFO:tasks.workunit.client.1.smithi173.stdout:7/387: creat d1/d1d/d4c/d63/d54/f76 x:0 0 0 2024-02-16T22:19:14.211 INFO:tasks.workunit.client.1.smithi173.stdout:9/337: truncate f0 355188 0 2024-02-16T22:19:14.214 INFO:tasks.workunit.client.1.smithi173.stdout:7/388: unlink d1/d1d/d4c/d63/d13/d36/d49/c29 0 2024-02-16T22:19:14.222 INFO:tasks.workunit.client.1.smithi173.stdout:5/484: write d8/da/d1f/d33/f4b [1768162,121435] 0 2024-02-16T22:19:14.222 INFO:tasks.workunit.client.1.smithi173.stdout:5/485: chown d8/da/d1f 9 1 2024-02-16T22:19:14.222 INFO:tasks.workunit.client.1.smithi173.stdout:5/486: chown c5 17084463 1 2024-02-16T22:19:14.224 INFO:tasks.workunit.client.1.smithi173.stdout:4/322: dwrite d7/d28/f1d [0,4194304] 0 2024-02-16T22:19:14.224 INFO:tasks.workunit.client.1.smithi173.stdout:8/563: dwrite dd/d9d/fa9 [0,4194304] 0 2024-02-16T22:19:14.224 INFO:tasks.workunit.client.1.smithi173.stdout:8/564: write dd/d7c/d7d/d22/d2e/d41/d6b/f8e [109642,91605] 0 2024-02-16T22:19:14.225 INFO:tasks.workunit.client.1.smithi173.stdout:5/487: rename d8/da/d2d/d36/d86 to d8/da/d1f/d6f/d91 0 2024-02-16T22:19:14.229 INFO:tasks.workunit.client.1.smithi173.stdout:4/323: write d7/d12/d2d/f44 [3792055,36811] 0 2024-02-16T22:19:14.229 INFO:tasks.workunit.client.1.smithi173.stdout:4/324: creat d7/df/d4f/d45/f69 x:0 0 0 2024-02-16T22:19:14.230 INFO:tasks.workunit.client.1.smithi173.stdout:8/565: truncate dd/d7c/d7d/d22/d28/d40/f59 210188 0 2024-02-16T22:19:14.230 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:14 smithi173 ceph-mon[37280]: pgmap v259: 65 pgs: 65 active+clean; 2.4 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 144 MiB/s rd, 177 MiB/s wr, 305 op/s 2024-02-16T22:19:14.234 INFO:tasks.workunit.client.1.smithi173.stdout:4/325: creat d7/df/d4f/d4e/f6a x:0 0 0 2024-02-16T22:19:14.235 INFO:tasks.workunit.client.1.smithi173.stdout:4/326: truncate d7/d28/d14/f1f 3938282 0 2024-02-16T22:19:14.235 INFO:tasks.workunit.client.1.smithi173.stdout:4/327: creat d7/df/d4f/d45/f6b x:0 0 0 2024-02-16T22:19:14.238 INFO:tasks.workunit.client.1.smithi173.stdout:4/328: creat d7/df/d4f/d3d/f6c x:0 0 0 2024-02-16T22:19:14.244 INFO:tasks.workunit.client.1.smithi173.stdout:8/566: dread dd/d7c/d7d/d22/d28/f33 [0,4194304] 0 2024-02-16T22:19:14.244 INFO:tasks.workunit.client.1.smithi173.stdout:3/515: dwrite d9/d1a/d2b/d4d/d5b/f89 [0,4194304] 0 2024-02-16T22:19:14.246 INFO:tasks.workunit.client.1.smithi173.stdout:8/567: rename dd/d7c/d7d/d22/d2e/l43 to dd/d7c/d7d/d89/lc2 0 2024-02-16T22:19:14.249 INFO:tasks.workunit.client.1.smithi173.stdout:7/389: dwrite d1/d1d/d4c/d63/d13/d36/d49/f68 [0,4194304] 0 2024-02-16T22:19:14.249 INFO:tasks.workunit.client.1.smithi173.stdout:3/516: rename d9/d18/d5f/dad to d9/d1a/d2b/d4d/d5b/da9/db4 0 2024-02-16T22:19:14.249 INFO:tasks.workunit.client.1.smithi173.stdout:9/338: dwrite d1/d2/d1a/d1f/f29 [0,4194304] 0 2024-02-16T22:19:14.250 INFO:tasks.workunit.client.1.smithi173.stdout:8/568: mknod dd/d7c/d7d/d22/d28/cc3 0 2024-02-16T22:19:14.251 INFO:tasks.workunit.client.1.smithi173.stdout:5/488: dwrite d8/da/d2d/d36/f43 [0,4194304] 0 2024-02-16T22:19:14.251 INFO:tasks.workunit.client.1.smithi173.stdout:4/329: dread d7/df/d4f/f47 [0,4194304] 0 2024-02-16T22:19:14.251 INFO:tasks.workunit.client.1.smithi173.stdout:5/489: write d8/da/d2d/d3a/f82 [755421,83513] 0 2024-02-16T22:19:14.254 INFO:tasks.workunit.client.1.smithi173.stdout:7/390: creat d1/d1d/d4c/d63/d6c/f77 x:0 0 0 2024-02-16T22:19:14.254 INFO:tasks.workunit.client.1.smithi173.stdout:7/391: creat d1/d1d/d4c/d63/d54/f78 x:0 0 0 2024-02-16T22:19:14.256 INFO:tasks.workunit.client.1.smithi173.stdout:9/339: mkdir d1/d5f/d6d 0 2024-02-16T22:19:14.257 INFO:tasks.workunit.client.1.smithi173.stdout:4/330: unlink d7/d28/d14/l35 0 2024-02-16T22:19:14.260 INFO:tasks.workunit.client.1.smithi173.stdout:9/340: symlink d1/d5f/d6d/l6e 0 2024-02-16T22:19:14.260 INFO:tasks.workunit.client.1.smithi173.stdout:9/341: write d1/d2/d1a/f5d [279349,111010] 0 2024-02-16T22:19:14.260 INFO:tasks.workunit.client.1.smithi173.stdout:8/569: dread fc [0,4194304] 0 2024-02-16T22:19:14.261 INFO:tasks.workunit.client.1.smithi173.stdout:8/570: fsync dd/d7c/d7d/f20 0 2024-02-16T22:19:14.261 INFO:tasks.workunit.client.1.smithi173.stdout:8/571: write dd/f16 [4257896,36983] 0 2024-02-16T22:19:14.261 INFO:tasks.workunit.client.1.smithi173.stdout:8/572: write dd/d7c/d7d/d22/d28/fb5 [702484,59189] 0 2024-02-16T22:19:14.261 INFO:tasks.workunit.client.1.smithi173.stdout:3/517: dread d9/d17/f54 [0,4194304] 0 2024-02-16T22:19:14.265 INFO:tasks.workunit.client.1.smithi173.stdout:9/342: unlink d1/d2/l3 0 2024-02-16T22:19:14.265 INFO:tasks.workunit.client.1.smithi173.stdout:9/343: write d1/f5a [295797,33320] 0 2024-02-16T22:19:14.267 INFO:tasks.workunit.client.1.smithi173.stdout:8/573: mknod dd/d7c/d7d/d22/d28/cc4 0 2024-02-16T22:19:14.269 INFO:tasks.workunit.client.1.smithi173.stdout:3/518: unlink d9/d18/d5f/lb2 0 2024-02-16T22:19:14.271 INFO:tasks.workunit.client.1.smithi173.stdout:3/519: mknod d9/d1a/d2b/d4d/d94/d98/cb5 0 2024-02-16T22:19:14.275 INFO:tasks.workunit.client.1.smithi173.stdout:3/520: unlink d9/d17/f54 0 2024-02-16T22:19:14.278 INFO:tasks.workunit.client.1.smithi173.stdout:4/331: rmdir d7/d28/d14 39 2024-02-16T22:19:14.279 INFO:tasks.workunit.client.1.smithi173.stdout:4/332: dread d7/d28/f1a [0,4194304] 0 2024-02-16T22:19:14.281 INFO:tasks.workunit.client.1.smithi173.stdout:4/333: symlink d7/df/d4f/d45/l6d 0 2024-02-16T22:19:14.282 INFO:tasks.workunit.client.1.smithi173.stdout:4/334: chown d7/d28/c46 0 1 2024-02-16T22:19:14.282 INFO:tasks.workunit.client.1.smithi173.stdout:4/335: dread - d7/df/d4f/d4e/f6a zero size 2024-02-16T22:19:14.282 INFO:tasks.workunit.client.1.smithi173.stdout:4/336: stat d7/df/d4f/d4e/l64 0 2024-02-16T22:19:14.282 INFO:tasks.workunit.client.1.smithi173.stdout:4/337: chown d7/d28/c43 1694997 1 2024-02-16T22:19:14.285 INFO:tasks.workunit.client.1.smithi173.stdout:4/338: mknod d7/d28/d14/c6e 0 2024-02-16T22:19:14.285 INFO:tasks.workunit.client.1.smithi173.stdout:4/339: dread - d7/df/d4f/d4e/f6a zero size 2024-02-16T22:19:14.285 INFO:tasks.workunit.client.1.smithi173.stdout:4/340: stat d7/df/d4f/f5d 0 2024-02-16T22:19:14.285 INFO:tasks.workunit.client.1.smithi173.stdout:4/341: chown d7/d28/d31/f66 5367 1 2024-02-16T22:19:14.286 INFO:tasks.workunit.client.1.smithi173.stdout:4/342: creat d7/df/d62/f6f x:0 0 0 2024-02-16T22:19:14.288 INFO:tasks.workunit.client.1.smithi173.stdout:4/343: rmdir d7/d28 39 2024-02-16T22:19:14.288 INFO:tasks.workunit.client.1.smithi173.stdout:4/344: readlink d7/d28/l1e 0 2024-02-16T22:19:14.288 INFO:tasks.workunit.client.1.smithi173.stdout:4/345: creat d7/df/d4f/d45/f70 x:0 0 0 2024-02-16T22:19:14.288 INFO:tasks.workunit.client.1.smithi173.stdout:4/346: write d7/d12/f30 [944575,25176] 0 2024-02-16T22:19:14.288 INFO:tasks.workunit.client.1.smithi173.stdout:4/347: chown d7/c8 2 1 2024-02-16T22:19:14.288 INFO:tasks.workunit.client.1.smithi173.stdout:4/348: fdatasync d7/df/d4f/f67 0 2024-02-16T22:19:14.295 INFO:tasks.workunit.client.1.smithi173.stdout:9/344: dwrite d1/d2/d1a/d1f/f29 [4194304,4194304] 0 2024-02-16T22:19:14.304 INFO:tasks.workunit.client.1.smithi173.stdout:8/574: dwrite dd/d7c/d7d/d22/f4e [0,4194304] 0 2024-02-16T22:19:14.305 INFO:tasks.workunit.client.1.smithi173.stdout:3/521: dwrite d9/d1a/d2b/d4d/f6b [0,4194304] 0 2024-02-16T22:19:14.305 INFO:tasks.workunit.client.1.smithi173.stdout:4/349: dwrite d7/d12/d2d/f5c [0,4194304] 0 2024-02-16T22:19:14.305 INFO:tasks.workunit.client.1.smithi173.stdout:4/350: creat d7/df/d62/f71 x:0 0 0 2024-02-16T22:19:14.307 INFO:tasks.workunit.client.1.smithi173.stdout:8/575: creat dd/d7c/d7d/d22/d28/d40/d69/da7/fc5 x:0 0 0 2024-02-16T22:19:14.308 INFO:tasks.workunit.client.1.smithi173.stdout:9/345: dread d1/d2/d1a/d1f/f29 [4194304,4194304] 0 2024-02-16T22:19:14.313 INFO:tasks.workunit.client.1.smithi173.stdout:8/576: rename dd/d7c/d7d/d22/d28/l5e to dd/d7c/d7d/d22/d5a/lc6 0 2024-02-16T22:19:14.313 INFO:tasks.workunit.client.1.smithi173.stdout:8/577: write dd/d7c/d7d/d22/d28/f47 [4296792,67198] 0 2024-02-16T22:19:14.313 INFO:tasks.workunit.client.1.smithi173.stdout:8/578: chown dd/c6d 321 1 2024-02-16T22:19:14.313 INFO:tasks.workunit.client.1.smithi173.stdout:8/579: readlink dd/d7c/d7d/d22/d5a/l72 0 2024-02-16T22:19:14.315 INFO:tasks.workunit.client.1.smithi173.stdout:9/346: mknod d1/d2/d1a/d2f/c6f 0 2024-02-16T22:19:14.315 INFO:tasks.workunit.client.1.smithi173.stdout:9/347: write d1/f30 [825634,120214] 0 2024-02-16T22:19:14.317 INFO:tasks.workunit.client.1.smithi173.stdout:9/348: truncate d1/d2/f4c 1449173 0 2024-02-16T22:19:14.317 INFO:tasks.workunit.client.1.smithi173.stdout:9/349: chown d1/d2/d1a/d3e 86 1 2024-02-16T22:19:14.319 INFO:tasks.workunit.client.1.smithi173.stdout:9/350: symlink d1/d2/d1a/l70 0 2024-02-16T22:19:14.319 INFO:tasks.workunit.client.1.smithi173.stdout:9/351: creat d1/d2/d1a/f71 x:0 0 0 2024-02-16T22:19:14.322 INFO:tasks.workunit.client.1.smithi173.stdout:9/352: creat d1/d2/d1a/d2f/d3b/f72 x:0 0 0 2024-02-16T22:19:14.324 INFO:tasks.workunit.client.1.smithi173.stdout:9/353: dread d1/d2/d10/f63 [0,4194304] 0 2024-02-16T22:19:14.326 INFO:tasks.workunit.client.1.smithi173.stdout:9/354: symlink d1/d2/d1a/d2f/l73 0 2024-02-16T22:19:14.326 INFO:tasks.workunit.client.1.smithi173.stdout:9/355: fsync d1/d2/d1a/d1f/f4d 0 2024-02-16T22:19:14.327 INFO:tasks.workunit.client.1.smithi173.stdout:9/356: creat d1/d5f/d6d/f74 x:0 0 0 2024-02-16T22:19:14.328 INFO:tasks.workunit.client.1.smithi173.stdout:9/357: mkdir d1/d2/d1a/d2f/d3b/d75 0 2024-02-16T22:19:14.328 INFO:tasks.workunit.client.1.smithi173.stdout:9/358: write d1/d2/d1a/d1f/d34/f5b [462901,45164] 0 2024-02-16T22:19:14.335 INFO:tasks.workunit.client.1.smithi173.stdout:4/351: dwrite d7/df/d4f/d4e/f6a [0,4194304] 0 2024-02-16T22:19:14.335 INFO:tasks.workunit.client.1.smithi173.stdout:4/352: readlink d7/df/l56 0 2024-02-16T22:19:14.335 INFO:tasks.workunit.client.1.smithi173.stdout:3/522: dwrite d9/f7c [0,4194304] 0 2024-02-16T22:19:14.337 INFO:tasks.workunit.client.1.smithi173.stdout:3/523: unlink d9/d18/d5f/d6e/f5a 0 2024-02-16T22:19:14.337 INFO:tasks.workunit.client.1.smithi173.stdout:3/524: creat d9/d1a/fb6 x:0 0 0 2024-02-16T22:19:14.337 INFO:tasks.workunit.client.1.smithi173.stdout:3/525: chown d9/d18/d73/l96 26919516 1 2024-02-16T22:19:14.339 INFO:tasks.workunit.client.1.smithi173.stdout:8/580: dwrite dd/d7c/d7d/d22/d2e/d41/d73/fc1 [0,4194304] 0 2024-02-16T22:19:14.339 INFO:tasks.workunit.client.1.smithi173.stdout:8/581: fsync dd/d7c/d7d/d22/f4e 0 2024-02-16T22:19:14.339 INFO:tasks.workunit.client.1.smithi173.stdout:8/582: chown dd/d7c/d7d/d22/d28/f90 0 1 2024-02-16T22:19:14.343 INFO:tasks.workunit.client.1.smithi173.stdout:8/583: dread dd/f31 [0,4194304] 0 2024-02-16T22:19:14.344 INFO:tasks.workunit.client.1.smithi173.stdout:9/359: rmdir d1/d5f/d6d 39 2024-02-16T22:19:14.346 INFO:tasks.workunit.client.1.smithi173.stdout:8/584: mkdir dd/d7c/d7d/d22/d5a/dc7 0 2024-02-16T22:19:14.346 INFO:tasks.workunit.client.1.smithi173.stdout:8/585: truncate dd/d7c/d7d/d22/d2e/f57 642790 0 2024-02-16T22:19:14.346 INFO:tasks.workunit.client.1.smithi173.stdout:8/586: write dd/d7c/d7d/d22/d28/d40/f78 [5072858,21982] 0 2024-02-16T22:19:14.346 INFO:tasks.workunit.client.1.smithi173.stdout:8/587: fdatasync dd/d7c/d7d/d22/f37 0 2024-02-16T22:19:14.346 INFO:tasks.workunit.client.1.smithi173.stdout:9/360: symlink d1/d2/d1a/l76 0 2024-02-16T22:19:14.347 INFO:tasks.workunit.client.1.smithi173.stdout:8/588: mknod dd/d7c/d8f/cc8 0 2024-02-16T22:19:14.348 INFO:tasks.workunit.client.1.smithi173.stdout:8/589: chown dd/d7c/d7d/d22/d2e/l5c 0 1 2024-02-16T22:19:14.348 INFO:tasks.workunit.client.1.smithi173.stdout:3/526: dread d9/d1a/d2b/d4d/f4f [0,4194304] 0 2024-02-16T22:19:14.349 INFO:tasks.workunit.client.1.smithi173.stdout:4/353: write d7/df/f22 [6872,49012] 0 2024-02-16T22:19:14.351 INFO:tasks.workunit.client.1.smithi173.stdout:9/361: mknod d1/d2/d1a/c77 0 2024-02-16T22:19:14.353 INFO:tasks.workunit.client.1.smithi173.stdout:8/590: rename dd/d7c/d7d/d22/d2e/l5c to dd/d7c/d7d/d22/d2e/lc9 0 2024-02-16T22:19:14.353 INFO:tasks.workunit.client.1.smithi173.stdout:8/591: fdatasync dd/d9d/f75 0 2024-02-16T22:19:14.355 INFO:tasks.workunit.client.1.smithi173.stdout:8/592: dread dd/d7c/d7d/f20 [0,4194304] 0 2024-02-16T22:19:14.355 INFO:tasks.workunit.client.1.smithi173.stdout:8/593: stat f2 0 2024-02-16T22:19:14.361 INFO:tasks.workunit.client.1.smithi173.stdout:8/594: dread dd/d7c/d7d/d22/d28/f2f [0,4194304] 0 2024-02-16T22:19:14.361 INFO:tasks.workunit.client.1.smithi173.stdout:4/354: mkdir d7/d28/d31/d72 0 2024-02-16T22:19:14.363 INFO:tasks.workunit.client.1.smithi173.stdout:9/362: mknod d1/d2/d1a/c78 0 2024-02-16T22:19:14.363 INFO:tasks.workunit.client.1.smithi173.stdout:9/363: readlink d1/d2/d1a/d3e/d4f/l54 0 2024-02-16T22:19:14.363 INFO:tasks.workunit.client.1.smithi173.stdout:9/364: readlink d1/d2/d10/l1d 0 2024-02-16T22:19:14.363 INFO:tasks.workunit.client.1.smithi173.stdout:9/365: truncate d1/d2/d1a/d1f/d34/f5b 515026 0 2024-02-16T22:19:14.364 INFO:tasks.workunit.client.1.smithi173.stdout:3/527: rename d9/d1a/d2b/d49 to d9/d18/d73/db7 0 2024-02-16T22:19:14.365 INFO:tasks.workunit.client.1.smithi173.stdout:8/595: mkdir dd/d7c/d7d/d58/dca 0 2024-02-16T22:19:14.365 INFO:tasks.workunit.client.1.smithi173.stdout:8/596: write dd/d7c/d7d/d22/d2e/f48 [1094605,47940] 0 2024-02-16T22:19:14.365 INFO:tasks.workunit.client.1.smithi173.stdout:8/597: chown dd/d7c/d7d/d22/d2e 556 1 2024-02-16T22:19:14.370 INFO:tasks.workunit.client.1.smithi173.stdout:9/366: mkdir d1/d2/d1a/d3e/d79 0 2024-02-16T22:19:14.371 INFO:tasks.workunit.client.1.smithi173.stdout:3/528: getdents d9/d17 0 2024-02-16T22:19:14.371 INFO:tasks.workunit.client.1.smithi173.stdout:3/529: read - d9/d1a/d2b/d45/d51/f87 zero size 2024-02-16T22:19:14.373 INFO:tasks.workunit.client.1.smithi173.stdout:3/530: creat d9/d17/fb8 x:0 0 0 2024-02-16T22:19:14.373 INFO:tasks.workunit.client.1.smithi173.stdout:3/531: write d9/d1a/d2b/d45/d51/fa2 [667122,110179] 0 2024-02-16T22:19:14.374 INFO:tasks.workunit.client.1.smithi173.stdout:8/598: rename dd/d7c/d8f to dd/d7c/dcb 0 2024-02-16T22:19:14.374 INFO:tasks.workunit.client.1.smithi173.stdout:3/532: fsync d9/d17/f48 0 2024-02-16T22:19:14.375 INFO:tasks.workunit.client.1.smithi173.stdout:3/533: creat d9/d18/daa/fb9 x:0 0 0 2024-02-16T22:19:14.377 INFO:tasks.workunit.client.1.smithi173.stdout:3/534: creat d9/d1a/d2b/d45/d51/d92/fba x:0 0 0 2024-02-16T22:19:14.379 INFO:tasks.workunit.client.1.smithi173.stdout:3/535: rename d9/d18/daa/fb9 to d9/d1a/d2b/d4d/d94/d98/fbb 0 2024-02-16T22:19:14.379 INFO:tasks.workunit.client.1.smithi173.stdout:3/536: fdatasync d9/d1a/d2b/d4d/d5b/da9/faf 0 2024-02-16T22:19:14.379 INFO:tasks.workunit.client.1.smithi173.stdout:3/537: fdatasync d9/d1a/fb6 0 2024-02-16T22:19:14.379 INFO:tasks.workunit.client.1.smithi173.stdout:3/538: fdatasync d9/d1a/d2b/d4d/d5b/da9/faf 0 2024-02-16T22:19:14.382 INFO:tasks.workunit.client.1.smithi173.stdout:4/355: dwrite d7/d28/d52/f60 [0,4194304] 0 2024-02-16T22:19:14.386 INFO:tasks.workunit.client.1.smithi173.stdout:4/356: rename d7/d28/f3c to d7/d12/f73 0 2024-02-16T22:19:14.387 INFO:tasks.workunit.client.1.smithi173.stdout:4/357: symlink d7/df/d4f/d4e/l74 0 2024-02-16T22:19:14.389 INFO:tasks.workunit.client.1.smithi173.stdout:4/358: creat d7/d28/f75 x:0 0 0 2024-02-16T22:19:14.389 INFO:tasks.workunit.client.1.smithi173.stdout:4/359: truncate d7/d28/f1a 781277 0 2024-02-16T22:19:14.389 INFO:tasks.workunit.client.1.smithi173.stdout:4/360: chown d7/fd 6651 1 2024-02-16T22:19:14.389 INFO:tasks.workunit.client.1.smithi173.stdout:4/361: truncate d7/d12/f73 794524 0 2024-02-16T22:19:14.390 INFO:tasks.workunit.client.1.smithi173.stdout:9/367: dread d1/d2/d1a/f2b [0,4194304] 0 2024-02-16T22:19:14.391 INFO:tasks.workunit.client.1.smithi173.stdout:4/362: mknod d7/df/d4f/d45/c76 0 2024-02-16T22:19:14.393 INFO:tasks.workunit.client.1.smithi173.stdout:9/368: rename d1/f22 to d1/d2/d1a/d2f/d51/f7a 0 2024-02-16T22:19:14.393 INFO:tasks.workunit.client.1.smithi173.stdout:9/369: read d1/f23 [3611673,51479] 0 2024-02-16T22:19:14.393 INFO:tasks.workunit.client.1.smithi173.stdout:9/370: fsync d1/d2/d1a/d3e/d4f/f6a 0 2024-02-16T22:19:14.393 INFO:tasks.workunit.client.1.smithi173.stdout:3/539: write d9/f7c [573276,86000] 0 2024-02-16T22:19:14.394 INFO:tasks.workunit.client.1.smithi173.stdout:9/371: unlink d1/d2/d1a/d3e/d4f/l54 0 2024-02-16T22:19:14.396 INFO:tasks.workunit.client.1.smithi173.stdout:3/540: mknod d9/cbc 0 2024-02-16T22:19:14.396 INFO:tasks.workunit.client.1.smithi173.stdout:9/372: truncate d1/d2/d1a/d2f/d51/f7a 472003 0 2024-02-16T22:19:14.397 INFO:tasks.workunit.client.1.smithi173.stdout:3/541: mknod d9/cbd 0 2024-02-16T22:19:14.397 INFO:tasks.workunit.client.1.smithi173.stdout:9/373: getdents d1/d5f 0 2024-02-16T22:19:14.399 INFO:tasks.workunit.client.1.smithi173.stdout:3/542: mknod d9/d1a/d2b/d45/cbe 0 2024-02-16T22:19:14.399 INFO:tasks.workunit.client.1.smithi173.stdout:4/363: dread d7/df/f1b [0,4194304] 0 2024-02-16T22:19:14.400 INFO:tasks.workunit.client.1.smithi173.stdout:9/374: unlink d1/d2/d1a/d1f/f45 0 2024-02-16T22:19:14.402 INFO:tasks.workunit.client.1.smithi173.stdout:3/543: dread d9/d1a/f8e [0,4194304] 0 2024-02-16T22:19:14.406 INFO:tasks.workunit.client.1.smithi173.stdout:8/599: dwrite dd/d7c/d7d/d89/db0/fb6 [0,4194304] 0 2024-02-16T22:19:14.411 INFO:tasks.workunit.client.1.smithi173.stdout:4/364: write d7/d28/d14/f1f [239277,38308] 0 2024-02-16T22:19:14.412 INFO:tasks.workunit.client.1.smithi173.stdout:4/365: write d7/fd [1107363,44290] 0 2024-02-16T22:19:14.417 INFO:tasks.workunit.client.1.smithi173.stdout:8/600: symlink dd/d7c/d7d/d22/d28/d40/lcc 0 2024-02-16T22:19:14.418 INFO:tasks.workunit.client.1.smithi173.stdout:3/544: dwrite d9/d1a/f2c [4194304,4194304] 0 2024-02-16T22:19:14.418 INFO:tasks.workunit.client.1.smithi173.stdout:4/366: creat d7/d28/d31/f77 x:0 0 0 2024-02-16T22:19:14.419 INFO:tasks.workunit.client.1.smithi173.stdout:4/367: readlink d7/d28/d31/d33/d49/l57 0 2024-02-16T22:19:14.419 INFO:tasks.workunit.client.1.smithi173.stdout:4/368: fsync d7/d28/d31/f37 0 2024-02-16T22:19:14.420 INFO:tasks.workunit.client.1.smithi173.stdout:8/601: creat dd/d7c/d7d/d22/fcd x:0 0 0 2024-02-16T22:19:14.421 INFO:tasks.workunit.client.1.smithi173.stdout:8/602: dread dd/d7c/d7d/d22/d28/d40/f63 [0,4194304] 0 2024-02-16T22:19:14.421 INFO:tasks.workunit.client.1.smithi173.stdout:4/369: mknod d7/df/d4f/d45/c78 0 2024-02-16T22:19:14.444 INFO:tasks.workunit.client.1.smithi173.stdout:3/545: dwrite d9/d1a/f34 [0,4194304] 0 2024-02-16T22:19:14.444 INFO:tasks.workunit.client.1.smithi173.stdout:8/603: dwrite dd/d7c/d7d/d22/f37 [0,4194304] 0 2024-02-16T22:19:14.445 INFO:tasks.workunit.client.1.smithi173.stdout:8/604: readlink dd/d7c/d7d/d22/d2e/lc9 0 2024-02-16T22:19:14.445 INFO:tasks.workunit.client.1.smithi173.stdout:8/605: chown dd/d7c/d7d/f3d 84174 1 2024-02-16T22:19:14.445 INFO:tasks.workunit.client.1.smithi173.stdout:8/606: chown dd/d7c/d7d/d89/db0/fb6 178769 1 2024-02-16T22:19:14.447 INFO:tasks.workunit.client.1.smithi173.stdout:3/546: write d9/d17/d25/f46 [1289536,26838] 0 2024-02-16T22:19:14.448 INFO:tasks.workunit.client.1.smithi173.stdout:3/547: rmdir d9/d18/d73/db7/d7a 39 2024-02-16T22:19:14.449 INFO:tasks.workunit.client.1.smithi173.stdout:3/548: truncate d9/d18/f62 3180666 0 2024-02-16T22:19:14.465 INFO:tasks.workunit.client.1.smithi173.stdout:3/549: dwrite d9/d17/d25/f50 [0,4194304] 0 2024-02-16T22:19:14.465 INFO:tasks.workunit.client.1.smithi173.stdout:3/550: chown d9/d18/d5f/d6e 385863 1 2024-02-16T22:19:14.466 INFO:tasks.workunit.client.1.smithi173.stdout:3/551: rename d9/d1a/d2b/d45/d60/l80 to d9/d1a/d2b/d4d/d5b/lbf 0 2024-02-16T22:19:14.468 INFO:tasks.workunit.client.1.smithi173.stdout:3/552: rename d9/d1a/d2b/d4d/d5b/f7b to d9/d1a/d2b/d45/fc0 0 2024-02-16T22:19:14.468 INFO:tasks.workunit.client.1.smithi173.stdout:3/553: write d9/d18/d5f/fa4 [710042,88722] 0 2024-02-16T22:19:14.468 INFO:tasks.workunit.client.1.smithi173.stdout:3/554: mknod d9/d18/d5f/d6e/d4e/cc1 0 2024-02-16T22:19:14.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:14 smithi134 ceph-mon[28869]: pgmap v259: 65 pgs: 65 active+clean; 2.4 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 144 MiB/s rd, 177 MiB/s wr, 305 op/s 2024-02-16T22:19:14.483 INFO:tasks.workunit.client.1.smithi173.stdout:3/555: dwrite d9/d18/fb1 [0,4194304] 0 2024-02-16T22:19:14.483 INFO:tasks.workunit.client.1.smithi173.stdout:3/556: write d9/d18/d5f/fa4 [776917,20595] 0 2024-02-16T22:19:14.485 INFO:tasks.workunit.client.1.smithi173.stdout:3/557: getdents d9/d17/d25 0 2024-02-16T22:19:14.488 INFO:tasks.workunit.client.1.smithi173.stdout:3/558: link d9/d18/d73/db7/f53 d9/d18/d5f/fc2 0 2024-02-16T22:19:14.488 INFO:tasks.workunit.client.1.smithi173.stdout:3/559: write d9/d1a/d2b/f2d [5355678,125068] 0 2024-02-16T22:19:14.489 INFO:tasks.workunit.client.1.smithi173.stdout:3/560: creat d9/d1a/d2b/d4d/d5b/fc3 x:0 0 0 2024-02-16T22:19:14.491 INFO:tasks.workunit.client.1.smithi173.stdout:3/561: truncate d9/d1a/d2b/d4d/d5b/f89 619891 0 2024-02-16T22:19:14.491 INFO:tasks.workunit.client.1.smithi173.stdout:3/562: write d9/d1a/d2b/d4d/d5b/f7d [212267,14740] 0 2024-02-16T22:19:14.493 INFO:tasks.workunit.client.1.smithi173.stdout:3/563: mknod d9/d18/d73/db7/cc4 0 2024-02-16T22:19:14.493 INFO:tasks.workunit.client.1.smithi173.stdout:3/564: readlink d9/d1a/d2b/d4d/d94/d98/l9a 0 2024-02-16T22:19:14.493 INFO:tasks.workunit.client.1.smithi173.stdout:3/565: truncate d9/d1a/d2b/d4d/d94/d98/fbb 593132 0 2024-02-16T22:19:14.493 INFO:tasks.workunit.client.1.smithi173.stdout:3/566: chown d9/d1a/d2b/d4d/f52 430034 1 2024-02-16T22:19:14.493 INFO:tasks.workunit.client.1.smithi173.stdout:3/567: creat d9/d1a/d2b/d4d/d5b/fc5 x:0 0 0 2024-02-16T22:19:14.494 INFO:tasks.workunit.client.1.smithi173.stdout:3/568: creat d9/d1a/d2b/d4d/d5b/da9/db4/fc6 x:0 0 0 2024-02-16T22:19:14.500 INFO:tasks.workunit.client.1.smithi173.stdout:3/569: rmdir d9/d1a/d2b/d4d 39 2024-02-16T22:19:14.500 INFO:tasks.workunit.client.1.smithi173.stdout:3/570: chown d9/d18/d5f/c63 121448 1 2024-02-16T22:19:14.503 INFO:tasks.workunit.client.1.smithi173.stdout:3/571: dread d9/d1a/d2b/d4d/f4f [0,4194304] 0 2024-02-16T22:19:14.503 INFO:tasks.workunit.client.1.smithi173.stdout:3/572: truncate d9/d1a/d2b/d4d/d5b/da9/db4/fc6 39564 0 2024-02-16T22:19:14.504 INFO:tasks.workunit.client.1.smithi173.stdout:3/573: truncate d9/d17/f48 2532783 0 2024-02-16T22:19:14.505 INFO:tasks.workunit.client.1.smithi173.stdout:3/574: symlink d9/d18/lc7 0 2024-02-16T22:19:14.507 INFO:tasks.workunit.client.1.smithi173.stdout:3/575: link d9/d1a/d2b/d4d/d94/d98/fbb d9/d18/d73/fc8 0 2024-02-16T22:19:14.507 INFO:tasks.workunit.client.1.smithi173.stdout:3/576: write d9/d1a/d2b/d45/fc0 [784311,55358] 0 2024-02-16T22:19:14.507 INFO:tasks.workunit.client.1.smithi173.stdout:3/577: chown d9/d18/f62 17945 1 2024-02-16T22:19:14.508 INFO:tasks.workunit.client.1.smithi173.stdout:3/578: mknod d9/d1a/d2b/d4d/cc9 0 2024-02-16T22:19:14.511 INFO:tasks.workunit.client.1.smithi173.stdout:3/579: getdents d9/d18/d5f/d6e/d4e 0 2024-02-16T22:19:14.511 INFO:tasks.workunit.client.1.smithi173.stdout:3/580: creat d9/d18/d73/db7/fca x:0 0 0 2024-02-16T22:19:14.526 INFO:tasks.workunit.client.1.smithi173.stdout:3/581: dwrite d9/d1a/d2b/d4d/f8c [0,4194304] 0 2024-02-16T22:19:14.535 INFO:tasks.workunit.client.1.smithi173.stdout:6/356: sync 2024-02-16T22:19:14.547 INFO:tasks.workunit.client.1.smithi173.stdout:1/570: sync 2024-02-16T22:19:14.549 INFO:tasks.workunit.client.1.smithi173.stdout:1/571: getdents db/d1c/d25/d28/d3f/d4a 0 2024-02-16T22:19:14.549 INFO:tasks.workunit.client.1.smithi173.stdout:1/572: creat db/d1c/d25/d28/fc9 x:0 0 0 2024-02-16T22:19:14.549 INFO:tasks.workunit.client.1.smithi173.stdout:1/573: chown db/d1c/d25/d28/f6c 807160 1 2024-02-16T22:19:14.549 INFO:tasks.workunit.client.1.smithi173.stdout:1/574: creat db/d29/d50/fca x:0 0 0 2024-02-16T22:19:14.551 INFO:tasks.workunit.client.1.smithi173.stdout:1/575: link db/d1c/d5c/f63 db/d1c/d7f/d98/fcb 0 2024-02-16T22:19:14.551 INFO:tasks.workunit.client.1.smithi173.stdout:1/576: fdatasync db/f15 0 2024-02-16T22:19:14.551 INFO:tasks.workunit.client.1.smithi173.stdout:1/577: stat db/d1c/l6e 0 2024-02-16T22:19:14.567 INFO:tasks.workunit.client.1.smithi173.stdout:6/357: dwrite d0/db/f2a [0,4194304] 0 2024-02-16T22:19:14.569 INFO:tasks.workunit.client.1.smithi173.stdout:6/358: creat d0/db/d2e/d2f/d31/d7a/f86 x:0 0 0 2024-02-16T22:19:14.570 INFO:tasks.workunit.client.1.smithi173.stdout:6/359: write d0/db/d2e/d2f/d31/d33/f79 [4618101,23377] 0 2024-02-16T22:19:14.570 INFO:tasks.workunit.client.1.smithi173.stdout:6/360: readlink d0/l2 0 2024-02-16T22:19:14.570 INFO:tasks.workunit.client.1.smithi173.stdout:6/361: truncate d0/db/d2e/f56 2071001 0 2024-02-16T22:19:14.571 INFO:tasks.workunit.client.1.smithi173.stdout:6/362: truncate d0/db/f1a 3367379 0 2024-02-16T22:19:14.571 INFO:tasks.workunit.client.1.smithi173.stdout:6/363: creat d0/db/d2e/f87 x:0 0 0 2024-02-16T22:19:14.571 INFO:tasks.workunit.client.1.smithi173.stdout:6/364: fsync d0/db/d2e/f83 0 2024-02-16T22:19:14.571 INFO:tasks.workunit.client.1.smithi173.stdout:1/578: dwrite db/d1d/f33 [4194304,4194304] 0 2024-02-16T22:19:14.572 INFO:tasks.workunit.client.1.smithi173.stdout:6/365: truncate d0/db/d2e/d2f/f4e 1631790 0 2024-02-16T22:19:14.591 INFO:tasks.workunit.client.1.smithi173.stdout:1/579: dwrite db/d29/d57/f71 [4194304,4194304] 0 2024-02-16T22:19:14.599 INFO:tasks.workunit.client.1.smithi173.stdout:6/366: dwrite d0/db/f12 [4194304,4194304] 0 2024-02-16T22:19:14.599 INFO:tasks.workunit.client.1.smithi173.stdout:6/367: creat d0/db/d2e/f88 x:0 0 0 2024-02-16T22:19:14.600 INFO:tasks.workunit.client.1.smithi173.stdout:6/368: stat d0/db/l59 0 2024-02-16T22:19:14.601 INFO:tasks.workunit.client.1.smithi173.stdout:6/369: symlink d0/db/d4d/l89 0 2024-02-16T22:19:14.601 INFO:tasks.workunit.client.1.smithi173.stdout:6/370: chown d0/db/d2e/d2f/f4b 10393328 1 2024-02-16T22:19:14.602 INFO:tasks.workunit.client.1.smithi173.stdout:6/371: rename d0/f19 to d0/db/d2e/d61/f8a 0 2024-02-16T22:19:14.608 INFO:tasks.workunit.client.1.smithi173.stdout:1/580: dwrite db/d1c/d25/d28/d3f/d4a/f99 [0,4194304] 0 2024-02-16T22:19:14.614 INFO:tasks.workunit.client.1.smithi173.stdout:6/372: dread d0/fa [0,4194304] 0 2024-02-16T22:19:14.614 INFO:tasks.workunit.client.1.smithi173.stdout:6/373: chown d0/ce 0 1 2024-02-16T22:19:14.614 INFO:tasks.workunit.client.1.smithi173.stdout:6/374: write d0/db/d2e/d2f/d31/f35 [198678,28632] 0 2024-02-16T22:19:14.614 INFO:tasks.workunit.client.1.smithi173.stdout:6/375: readlink d0/db/d2e/d65/l68 0 2024-02-16T22:19:14.615 INFO:tasks.workunit.client.1.smithi173.stdout:6/376: link d0/db/d2e/d2f/d31/d7a/l7f d0/db/d2e/d2f/l8b 0 2024-02-16T22:19:14.615 INFO:tasks.workunit.client.1.smithi173.stdout:6/377: write d0/db/d2e/d2f/f4c [804542,123388] 0 2024-02-16T22:19:14.616 INFO:tasks.workunit.client.1.smithi173.stdout:6/378: mkdir d0/db/d2e/d2f/d31/d5d/d8c 0 2024-02-16T22:19:14.635 INFO:tasks.workunit.client.1.smithi173.stdout:6/379: dwrite d0/db/d2e/d2f/d31/f62 [0,4194304] 0 2024-02-16T22:19:14.635 INFO:tasks.workunit.client.1.smithi173.stdout:6/380: dread d0/db/d2e/f46 [0,4194304] 0 2024-02-16T22:19:14.637 INFO:tasks.workunit.client.1.smithi173.stdout:6/381: creat d0/db/d2e/d2f/f8d x:0 0 0 2024-02-16T22:19:14.638 INFO:tasks.workunit.client.1.smithi173.stdout:6/382: symlink d0/db/d2e/d2f/d31/d33/d6d/l8e 0 2024-02-16T22:19:14.651 INFO:tasks.workunit.client.1.smithi173.stdout:6/383: dwrite d0/db/d2e/d65/f6b [0,4194304] 0 2024-02-16T22:19:14.651 INFO:tasks.workunit.client.1.smithi173.stdout:6/384: write d0/db/d2e/f52 [4215591,99757] 0 2024-02-16T22:19:14.670 INFO:tasks.workunit.client.1.smithi173.stdout:6/385: dwrite d0/f5c [0,4194304] 0 2024-02-16T22:19:14.672 INFO:tasks.workunit.client.1.smithi173.stdout:6/386: mknod d0/db/d2e/d65/d73/d81/c8f 0 2024-02-16T22:19:14.672 INFO:tasks.workunit.client.1.smithi173.stdout:6/387: getdents d0/db/d2e/d2f/d31/d5d 0 2024-02-16T22:19:14.672 INFO:tasks.workunit.client.1.smithi173.stdout:6/388: stat d0/db/d2e/d2f/d31/d5d/c60 0 2024-02-16T22:19:14.673 INFO:tasks.workunit.client.1.smithi173.stdout:6/389: mknod d0/db/d2e/c90 0 2024-02-16T22:19:14.681 INFO:tasks.workunit.client.1.smithi173.stdout:6/390: write d0/db/d2e/d2f/d31/d33/f36 [2988024,114126] 0 2024-02-16T22:19:14.700 INFO:tasks.workunit.client.1.smithi173.stdout:6/391: dwrite d0/db/d2e/d2f/d31/d5d/f74 [0,4194304] 0 2024-02-16T22:19:14.701 INFO:tasks.workunit.client.1.smithi173.stdout:6/392: dread d0/fa [4194304,4194304] 0 2024-02-16T22:19:14.717 INFO:tasks.workunit.client.1.smithi173.stdout:6/393: dwrite d0/db/d2e/d2f/f4e [0,4194304] 0 2024-02-16T22:19:14.718 INFO:tasks.workunit.client.1.smithi173.stdout:6/394: rename d0/db/d2e/d2f/d31/d33/l38 to d0/db/d2e/d2f/d31/d33/l91 0 2024-02-16T22:19:14.719 INFO:tasks.workunit.client.1.smithi173.stdout:6/395: write d0/db/d2e/d2f/d31/d7a/f86 [817292,124431] 0 2024-02-16T22:19:14.719 INFO:tasks.workunit.client.1.smithi173.stdout:6/396: readlink d0/l2 0 2024-02-16T22:19:14.732 INFO:tasks.workunit.client.1.smithi173.stdout:6/397: dwrite d0/db/d2e/f52 [4194304,4194304] 0 2024-02-16T22:19:14.733 INFO:tasks.workunit.client.1.smithi173.stdout:6/398: mkdir d0/db/d2e/d2f/d31/d5d/d8c/d92 0 2024-02-16T22:19:14.733 INFO:tasks.workunit.client.1.smithi173.stdout:6/399: chown d0/d7c 38059635 1 2024-02-16T22:19:14.733 INFO:tasks.workunit.client.1.smithi173.stdout:6/400: getdents d0/db/d2e/d65/d67/d78 0 2024-02-16T22:19:14.734 INFO:tasks.workunit.client.1.smithi173.stdout:6/401: mknod d0/db/d2e/d65/d67/d78/c93 0 2024-02-16T22:19:14.734 INFO:tasks.workunit.client.1.smithi173.stdout:6/402: mknod d0/db/d2e/d65/d67/d78/c94 0 2024-02-16T22:19:14.757 INFO:tasks.workunit.client.1.smithi173.stdout:6/403: dwrite d0/db/f77 [0,4194304] 0 2024-02-16T22:19:14.766 INFO:tasks.workunit.client.1.smithi173.stdout:6/404: dread d0/db/f12 [0,4194304] 0 2024-02-16T22:19:14.767 INFO:tasks.workunit.client.1.smithi173.stdout:6/405: rmdir d0/db/d2e/d2f/d31/d33 39 2024-02-16T22:19:14.768 INFO:tasks.workunit.client.1.smithi173.stdout:6/406: symlink d0/db/d2e/d2f/d31/d33/l95 0 2024-02-16T22:19:14.780 INFO:tasks.workunit.client.1.smithi173.stdout:6/407: dwrite d0/db/d2e/f3c [0,4194304] 0 2024-02-16T22:19:14.782 INFO:tasks.workunit.client.1.smithi173.stdout:6/408: mknod d0/db/c96 0 2024-02-16T22:19:14.797 INFO:tasks.workunit.client.1.smithi173.stdout:6/409: dwrite d0/db/d2e/d2f/f4b [0,4194304] 0 2024-02-16T22:19:14.799 INFO:tasks.workunit.client.1.smithi173.stdout:6/410: mkdir d0/db/d2e/d2f/d31/d33/d97 0 2024-02-16T22:19:14.800 INFO:tasks.workunit.client.1.smithi173.stdout:6/411: unlink d0/d7c/c84 0 2024-02-16T22:19:14.801 INFO:tasks.workunit.client.1.smithi173.stdout:6/412: read d0/db/f1a [2197051,2766] 0 2024-02-16T22:19:14.801 INFO:tasks.workunit.client.1.smithi173.stdout:6/413: write d0/db/d2e/d65/f6b [4751383,68915] 0 2024-02-16T22:19:14.803 INFO:tasks.workunit.client.1.smithi173.stdout:6/414: link d0/db/d2e/d65/d67/d78/c93 d0/db/d2e/d2f/d31/d5d/d8c/c98 0 2024-02-16T22:19:14.803 INFO:tasks.workunit.client.1.smithi173.stdout:6/415: fsync d0/db/d2e/f52 0 2024-02-16T22:19:14.803 INFO:tasks.workunit.client.1.smithi173.stdout:6/416: fdatasync d0/db/d2e/f88 0 2024-02-16T22:19:14.803 INFO:tasks.workunit.client.1.smithi173.stdout:6/417: truncate d0/db/d4d/f6f 1142969 0 2024-02-16T22:19:14.805 INFO:tasks.workunit.client.1.smithi173.stdout:6/418: creat d0/db/d2e/d2f/d31/f99 x:0 0 0 2024-02-16T22:19:14.807 INFO:tasks.workunit.client.1.smithi173.stdout:6/419: link d0/db/d2e/d2f/l8b d0/db/d2e/d2f/d31/d5d/d8c/d92/l9a 0 2024-02-16T22:19:14.809 INFO:tasks.workunit.client.1.smithi173.stdout:6/420: mkdir d0/db/d2e/d2f/d31/d5d/d8c/d9b 0 2024-02-16T22:19:14.809 INFO:tasks.workunit.client.1.smithi173.stdout:6/421: write d0/db/d2e/f88 [594579,79702] 0 2024-02-16T22:19:14.809 INFO:tasks.workunit.client.1.smithi173.stdout:6/422: chown d0/db/c49 16930 1 2024-02-16T22:19:14.814 INFO:tasks.workunit.client.1.smithi173.stdout:6/423: rmdir d0/db/d2e 39 2024-02-16T22:19:14.815 INFO:tasks.workunit.client.1.smithi173.stdout:6/424: creat d0/db/d2e/d2f/d31/d33/f9c x:0 0 0 2024-02-16T22:19:14.828 INFO:tasks.workunit.client.1.smithi173.stdout:6/425: dwrite d0/db/d2e/f37 [0,4194304] 0 2024-02-16T22:19:14.830 INFO:tasks.workunit.client.1.smithi173.stdout:6/426: write d0/db/d2e/f37 [5075838,38675] 0 2024-02-16T22:19:14.839 INFO:tasks.workunit.client.1.smithi173.stdout:6/427: write d0/db/f2a [3494033,32816] 0 2024-02-16T22:19:14.841 INFO:tasks.workunit.client.1.smithi173.stdout:0/322: sync 2024-02-16T22:19:14.841 INFO:tasks.workunit.client.1.smithi173.stdout:2/475: sync 2024-02-16T22:19:14.841 INFO:tasks.workunit.client.1.smithi173.stdout:7/392: sync 2024-02-16T22:19:14.841 INFO:tasks.workunit.client.1.smithi173.stdout:0/323: dread - d0/d4/f3e zero size 2024-02-16T22:19:14.841 INFO:tasks.workunit.client.1.smithi173.stdout:7/393: write d1/d1d/d4c/d63/d48/f5d [708054,42558] 0 2024-02-16T22:19:14.844 INFO:tasks.workunit.client.1.smithi173.stdout:7/394: unlink d1/d1d/d4c/d63/d13/d36/d49/l51 0 2024-02-16T22:19:14.844 INFO:tasks.workunit.client.1.smithi173.stdout:2/476: getdents d2/d4/d8/d30 0 2024-02-16T22:19:14.851 INFO:tasks.workunit.client.1.smithi173.stdout:0/324: dread d0/f11 [0,4194304] 0 2024-02-16T22:19:14.851 INFO:tasks.workunit.client.1.smithi173.stdout:0/325: truncate d0/d12/d15/d3d/f65 755044 0 2024-02-16T22:19:14.851 INFO:tasks.workunit.client.1.smithi173.stdout:0/326: chown d0/d4/d14/d24/d32/d39/l56 12 1 2024-02-16T22:19:14.853 INFO:tasks.workunit.client.1.smithi173.stdout:0/327: link d0/d4/d14/d24/l43 d0/d4/l68 0 2024-02-16T22:19:14.853 INFO:tasks.workunit.client.1.smithi173.stdout:2/477: dread d2/d4/d8/d80/f72 [0,4194304] 0 2024-02-16T22:19:14.853 INFO:tasks.workunit.client.1.smithi173.stdout:2/478: chown d2/dc/d19/d1a/f3f 147769157 1 2024-02-16T22:19:14.853 INFO:tasks.workunit.client.1.smithi173.stdout:2/479: fdatasync d2/d4/d8/d80/f9a 0 2024-02-16T22:19:14.854 INFO:tasks.workunit.client.1.smithi173.stdout:7/395: write d1/d1d/d4c/d63/d54/f70 [3882879,71180] 0 2024-02-16T22:19:14.854 INFO:tasks.workunit.client.1.smithi173.stdout:2/480: mkdir d2/d10/d9e 0 2024-02-16T22:19:14.854 INFO:tasks.workunit.client.1.smithi173.stdout:0/328: dread d0/fb [0,4194304] 0 2024-02-16T22:19:14.856 INFO:tasks.workunit.client.1.smithi173.stdout:0/329: creat d0/d4/d14/d24/d2e/f69 x:0 0 0 2024-02-16T22:19:14.857 INFO:tasks.workunit.client.1.smithi173.stdout:7/396: getdents d1/d1d/d44 0 2024-02-16T22:19:14.857 INFO:tasks.workunit.client.1.smithi173.stdout:6/428: dwrite d0/db/d2e/d2f/f4c [0,4194304] 0 2024-02-16T22:19:14.858 INFO:tasks.workunit.client.1.smithi173.stdout:0/330: link d0/d4/d14/d24/d32/l41 d0/d4/d33/d54/l6a 0 2024-02-16T22:19:14.858 INFO:tasks.workunit.client.1.smithi173.stdout:0/331: chown d0/c5d 24950 1 2024-02-16T22:19:14.859 INFO:tasks.workunit.client.1.smithi173.stdout:7/397: dread d1/d1d/d4c/d63/d48/f5c [0,4194304] 0 2024-02-16T22:19:14.859 INFO:tasks.workunit.client.1.smithi173.stdout:7/398: creat d1/d1d/d4c/d63/d48/f79 x:0 0 0 2024-02-16T22:19:14.860 INFO:tasks.workunit.client.1.smithi173.stdout:7/399: read d1/d1d/d4c/d63/d13/d36/f4d [1678847,60950] 0 2024-02-16T22:19:14.861 INFO:tasks.workunit.client.1.smithi173.stdout:6/429: truncate d0/db/d2e/d2f/d31/f62 1157538 0 2024-02-16T22:19:14.862 INFO:tasks.workunit.client.1.smithi173.stdout:0/332: mkdir d0/d4/d14/d24/d2e/d6b 0 2024-02-16T22:19:14.862 INFO:tasks.workunit.client.1.smithi173.stdout:0/333: read d0/d4/d27/f5a [461330,24328] 0 2024-02-16T22:19:14.864 INFO:tasks.workunit.client.1.smithi173.stdout:7/400: mknod d1/d1d/d4c/d63/d13/d22/c7a 0 2024-02-16T22:19:14.864 INFO:tasks.workunit.client.1.smithi173.stdout:7/401: truncate d1/d1d/d4c/d63/d6c/f77 964759 0 2024-02-16T22:19:14.865 INFO:tasks.workunit.client.1.smithi173.stdout:6/430: creat d0/db/d2e/d2f/d31/d5d/d8c/f9d x:0 0 0 2024-02-16T22:19:14.866 INFO:tasks.workunit.client.1.smithi173.stdout:6/431: read d0/f5c [2941464,118580] 0 2024-02-16T22:19:14.867 INFO:tasks.workunit.client.1.smithi173.stdout:7/402: symlink d1/d1d/d4c/d63/d48/l7b 0 2024-02-16T22:19:14.869 INFO:tasks.workunit.client.1.smithi173.stdout:6/432: creat d0/db/d2e/d2f/d31/d33/d6d/f9e x:0 0 0 2024-02-16T22:19:14.871 INFO:tasks.workunit.client.1.smithi173.stdout:0/334: getdents d0/d4/d14/d24/d2e 0 2024-02-16T22:19:14.888 INFO:tasks.workunit.client.1.smithi173.stdout:6/433: dwrite d0/db/d2e/f54 [0,4194304] 0 2024-02-16T22:19:14.893 INFO:tasks.workunit.client.1.smithi173.stdout:0/335: dwrite d0/d4/d14/f23 [4194304,4194304] 0 2024-02-16T22:19:14.893 INFO:tasks.workunit.client.1.smithi173.stdout:0/336: truncate d0/d4/d27/f57 4788981 0 2024-02-16T22:19:14.894 INFO:tasks.workunit.client.1.smithi173.stdout:0/337: mknod d0/d4/d33/d54/c6c 0 2024-02-16T22:19:14.894 INFO:tasks.workunit.client.1.smithi173.stdout:0/338: getdents d0/d12 0 2024-02-16T22:19:14.895 INFO:tasks.workunit.client.1.smithi173.stdout:0/339: mkdir d0/d6d 0 2024-02-16T22:19:14.896 INFO:tasks.workunit.client.1.smithi173.stdout:0/340: creat d0/d4/d14/d50/f6e x:0 0 0 2024-02-16T22:19:14.897 INFO:tasks.workunit.client.1.smithi173.stdout:0/341: mkdir d0/d12/d15/d3d/d6f 0 2024-02-16T22:19:14.900 INFO:tasks.workunit.client.1.smithi173.stdout:6/434: read d0/db/d2e/f37 [729238,81265] 0 2024-02-16T22:19:14.902 INFO:tasks.workunit.client.1.smithi173.stdout:6/435: mkdir d0/db/d2e/d65/d9f 0 2024-02-16T22:19:14.903 INFO:tasks.workunit.client.1.smithi173.stdout:6/436: symlink d0/db/d2e/d65/d67/d78/la0 0 2024-02-16T22:19:14.903 INFO:tasks.workunit.client.1.smithi173.stdout:6/437: write d0/db/d2e/d2f/d31/d33/f36 [1607317,21656] 0 2024-02-16T22:19:14.903 INFO:tasks.workunit.client.1.smithi173.stdout:6/438: write d0/db/f72 [770695,79371] 0 2024-02-16T22:19:14.904 INFO:tasks.workunit.client.1.smithi173.stdout:6/439: mknod d0/db/d2e/ca1 0 2024-02-16T22:19:14.906 INFO:tasks.workunit.client.1.smithi173.stdout:0/342: dread d0/d4/d14/f23 [4194304,4194304] 0 2024-02-16T22:19:14.907 INFO:tasks.workunit.client.1.smithi173.stdout:0/343: mkdir d0/d4/d14/d24/d70 0 2024-02-16T22:19:14.911 INFO:tasks.workunit.client.1.smithi173.stdout:0/344: getdents d0 0 2024-02-16T22:19:14.911 INFO:tasks.workunit.client.1.smithi173.stdout:0/345: stat d0/d4/d14/l2f 0 2024-02-16T22:19:14.925 INFO:tasks.workunit.client.1.smithi173.stdout:0/346: dwrite d0/f10 [0,4194304] 0 2024-02-16T22:19:14.933 INFO:tasks.workunit.client.1.smithi173.stdout:4/370: sync 2024-02-16T22:19:14.933 INFO:tasks.workunit.client.1.smithi173.stdout:9/375: sync 2024-02-16T22:19:14.933 INFO:tasks.workunit.client.1.smithi173.stdout:9/376: write d1/d2/d10/f46 [2319108,83346] 0 2024-02-16T22:19:14.933 INFO:tasks.workunit.client.1.smithi173.stdout:5/490: sync 2024-02-16T22:19:14.935 INFO:tasks.workunit.client.1.smithi173.stdout:9/377: mknod d1/d2/d1a/d3e/d4f/d65/c7b 0 2024-02-16T22:19:14.935 INFO:tasks.workunit.client.1.smithi173.stdout:5/491: truncate d8/da/d1f/f51 3508534 0 2024-02-16T22:19:14.938 INFO:tasks.workunit.client.1.smithi173.stdout:5/492: dread d8/f29 [0,4194304] 0 2024-02-16T22:19:14.940 INFO:tasks.workunit.client.1.smithi173.stdout:5/493: mkdir d8/da/d1f/d33/d92 0 2024-02-16T22:19:14.943 INFO:tasks.workunit.client.1.smithi173.stdout:5/494: creat d8/f93 x:0 0 0 2024-02-16T22:19:14.945 INFO:tasks.workunit.client.1.smithi173.stdout:4/371: dread d7/d28/d14/f40 [0,4194304] 0 2024-02-16T22:19:14.945 INFO:tasks.workunit.client.1.smithi173.stdout:4/372: write d7/d28/d31/d33/f50 [886689,37277] 0 2024-02-16T22:19:14.946 INFO:tasks.workunit.client.1.smithi173.stdout:4/373: getdents d7/d28/d14 0 2024-02-16T22:19:14.958 INFO:tasks.workunit.client.1.smithi173.stdout:5/495: read d8/da/fc [1143774,68537] 0 2024-02-16T22:19:14.959 INFO:tasks.workunit.client.1.smithi173.stdout:5/496: dread d8/f29 [0,4194304] 0 2024-02-16T22:19:14.959 INFO:tasks.workunit.client.1.smithi173.stdout:5/497: dread - d8/da/d1b/d57/f75 zero size 2024-02-16T22:19:14.960 INFO:tasks.workunit.client.1.smithi173.stdout:0/347: dwrite d0/f5e [0,4194304] 0 2024-02-16T22:19:14.960 INFO:tasks.workunit.client.1.smithi173.stdout:0/348: write d0/d4/fe [3226142,93436] 0 2024-02-16T22:19:14.960 INFO:tasks.workunit.client.1.smithi173.stdout:9/378: dwrite d1/d2/d10/f48 [0,4194304] 0 2024-02-16T22:19:14.961 INFO:tasks.workunit.client.1.smithi173.stdout:5/498: mknod d8/da/d2d/d3a/c94 0 2024-02-16T22:19:14.962 INFO:tasks.workunit.client.1.smithi173.stdout:4/374: dread d7/d28/d52/f60 [0,4194304] 0 2024-02-16T22:19:14.966 INFO:tasks.workunit.client.1.smithi173.stdout:4/375: dread d7/df/f1b [0,4194304] 0 2024-02-16T22:19:14.967 INFO:tasks.workunit.client.1.smithi173.stdout:0/349: truncate d0/d12/d15/f1c 2301952 0 2024-02-16T22:19:14.970 INFO:tasks.workunit.client.1.smithi173.stdout:0/350: creat d0/d4/d14/f71 x:0 0 0 2024-02-16T22:19:14.971 INFO:tasks.workunit.client.1.smithi173.stdout:4/376: getdents d7/df 0 2024-02-16T22:19:14.972 INFO:tasks.workunit.client.1.smithi173.stdout:0/351: mknod d0/d4/d14/d24/d2e/c72 0 2024-02-16T22:19:14.972 INFO:tasks.workunit.client.1.smithi173.stdout:0/352: creat d0/d4/d27/f73 x:0 0 0 2024-02-16T22:19:14.981 INFO:tasks.workunit.client.1.smithi173.stdout:4/377: dread d7/d28/d14/f2a [0,4194304] 0 2024-02-16T22:19:14.982 INFO:tasks.workunit.client.1.smithi173.stdout:9/379: dwrite d1/d2/d1a/d2f/d51/f7a [0,4194304] 0 2024-02-16T22:19:14.982 INFO:tasks.workunit.client.1.smithi173.stdout:9/380: write d1/d2/d1a/d1f/f43 [2013669,35868] 0 2024-02-16T22:19:14.982 INFO:tasks.workunit.client.1.smithi173.stdout:9/381: creat d1/d2/d1a/d2f/d3b/f7c x:0 0 0 2024-02-16T22:19:14.982 INFO:tasks.workunit.client.1.smithi173.stdout:9/382: write d1/d2/d1a/d3e/f57 [3201018,14881] 0 2024-02-16T22:19:14.984 INFO:tasks.workunit.client.1.smithi173.stdout:4/378: rmdir d7/d12 39 2024-02-16T22:19:14.985 INFO:tasks.workunit.client.1.smithi173.stdout:0/353: dread d0/d4/f18 [0,4194304] 0 2024-02-16T22:19:14.985 INFO:tasks.workunit.client.1.smithi173.stdout:4/379: rmdir d7/d12 39 2024-02-16T22:19:14.987 INFO:tasks.workunit.client.1.smithi173.stdout:0/354: creat d0/d4/d14/d24/d58/f74 x:0 0 0 2024-02-16T22:19:14.988 INFO:tasks.workunit.client.1.smithi173.stdout:4/380: truncate d7/df/f1b 1531802 0 2024-02-16T22:19:14.988 INFO:tasks.workunit.client.1.smithi173.stdout:4/381: truncate d7/df/d4f/d3d/f6c 966605 0 2024-02-16T22:19:14.988 INFO:tasks.workunit.client.1.smithi173.stdout:4/382: chown d7/d12/f30 5171755 1 2024-02-16T22:19:14.988 INFO:tasks.workunit.client.1.smithi173.stdout:4/383: stat d7/df/d4f/d4e/f5a 0 2024-02-16T22:19:14.988 INFO:tasks.workunit.client.1.smithi173.stdout:4/384: creat d7/df/d4f/d45/f79 x:0 0 0 2024-02-16T22:19:14.989 INFO:tasks.workunit.client.1.smithi173.stdout:0/355: write d0/d4/d14/d24/d32/d39/f42 [554009,81816] 0 2024-02-16T22:19:14.990 INFO:tasks.workunit.client.1.smithi173.stdout:4/385: mknod d7/d12/c7a 0 2024-02-16T22:19:14.990 INFO:tasks.workunit.client.1.smithi173.stdout:4/386: rename d7/d28/d31 to d7/d28/d31/d33/d7b 22 2024-02-16T22:19:14.990 INFO:tasks.workunit.client.1.smithi173.stdout:4/387: stat d7/d12/d2d 0 2024-02-16T22:19:14.992 INFO:tasks.workunit.client.1.smithi173.stdout:0/356: creat d0/d4/d14/d24/d32/d39/f75 x:0 0 0 2024-02-16T22:19:14.992 INFO:tasks.workunit.client.1.smithi173.stdout:4/388: mknod d7/df/d62/c7c 0 2024-02-16T22:19:14.996 INFO:tasks.workunit.client.1.smithi173.stdout:9/383: dread d1/f23 [0,4194304] 0 2024-02-16T22:19:14.996 INFO:tasks.workunit.client.1.smithi173.stdout:9/384: truncate d1/d2/d1a/d2f/f50 1654014 0 2024-02-16T22:19:15.000 INFO:tasks.workunit.client.1.smithi173.stdout:4/389: rename d7/df/d4f to d7/d28/d31/d33/d7d 0 2024-02-16T22:19:15.001 INFO:tasks.workunit.client.1.smithi173.stdout:0/357: dread d0/d4/d14/d24/d32/d39/f64 [0,4194304] 0 2024-02-16T22:19:15.001 INFO:tasks.workunit.client.1.smithi173.stdout:0/358: read - d0/d4/d14/d38/f49 zero size 2024-02-16T22:19:15.001 INFO:tasks.workunit.client.1.smithi173.stdout:0/359: creat d0/d4/d14/d50/f76 x:0 0 0 2024-02-16T22:19:15.001 INFO:tasks.workunit.client.1.smithi173.stdout:0/360: chown d0/d4/d14/d24/d2e/c55 53 1 2024-02-16T22:19:15.003 INFO:tasks.workunit.client.1.smithi173.stdout:4/390: mkdir d7/d12/d7e 0 2024-02-16T22:19:15.007 INFO:tasks.workunit.client.1.smithi173.stdout:0/361: symlink d0/d12/l77 0 2024-02-16T22:19:15.008 INFO:tasks.workunit.client.1.smithi173.stdout:4/391: creat d7/d28/d31/d72/f7f x:0 0 0 2024-02-16T22:19:15.009 INFO:tasks.workunit.client.1.smithi173.stdout:0/362: unlink d0/d4/d27/c28 0 2024-02-16T22:19:15.010 INFO:tasks.workunit.client.1.smithi173.stdout:0/363: getdents d0/d4/d14/d24 0 2024-02-16T22:19:15.011 INFO:tasks.workunit.client.1.smithi173.stdout:0/364: read d0/d4/d14/d24/d32/d39/f2c [4485918,114085] 0 2024-02-16T22:19:15.011 INFO:tasks.workunit.client.1.smithi173.stdout:0/365: chown d0/f67 221702 1 2024-02-16T22:19:15.020 INFO:tasks.workunit.client.1.smithi173.stdout:0/366: getdents d0/d4/d27 0 2024-02-16T22:19:15.020 INFO:tasks.workunit.client.1.smithi173.stdout:0/367: stat d0/d4/d14/d24/d58/f74 0 2024-02-16T22:19:15.027 INFO:tasks.workunit.client.1.smithi173.stdout:4/392: dwrite d7/d28/d31/d33/d7d/d4e/f6a [0,4194304] 0 2024-02-16T22:19:15.038 INFO:tasks.workunit.client.1.smithi173.stdout:4/393: dread d7/d12/f2b [0,4194304] 0 2024-02-16T22:19:15.047 INFO:tasks.workunit.client.1.smithi173.stdout:0/368: dwrite d0/d4/d14/d50/f6e [0,4194304] 0 2024-02-16T22:19:15.047 INFO:tasks.workunit.client.1.smithi173.stdout:0/369: chown d0/d4/f2a 30360049 1 2024-02-16T22:19:15.047 INFO:tasks.workunit.client.1.smithi173.stdout:0/370: write d0/f67 [827640,23147] 0 2024-02-16T22:19:15.050 INFO:tasks.workunit.client.1.smithi173.stdout:0/371: read d0/d4/f18 [114252,31798] 0 2024-02-16T22:19:15.053 INFO:tasks.workunit.client.1.smithi173.stdout:0/372: mknod d0/d12/d15/d3d/c78 0 2024-02-16T22:19:15.053 INFO:tasks.workunit.client.1.smithi173.stdout:0/373: read - d0/d4/f3e zero size 2024-02-16T22:19:15.060 INFO:tasks.workunit.client.1.smithi173.stdout:4/394: dwrite d7/d28/d31/f37 [0,4194304] 0 2024-02-16T22:19:15.060 INFO:tasks.workunit.client.1.smithi173.stdout:4/395: fdatasync d7/d28/d31/f66 0 2024-02-16T22:19:15.062 INFO:tasks.workunit.client.1.smithi173.stdout:4/396: getdents d7/d28 0 2024-02-16T22:19:15.063 INFO:tasks.workunit.client.1.smithi173.stdout:4/397: link d7/d28/d31/d33/d7d/f67 d7/df/f80 0 2024-02-16T22:19:15.064 INFO:tasks.workunit.client.1.smithi173.stdout:4/398: symlink d7/d28/d31/d33/l81 0 2024-02-16T22:19:15.065 INFO:tasks.workunit.client.1.smithi173.stdout:4/399: mknod d7/d28/c82 0 2024-02-16T22:19:15.066 INFO:tasks.workunit.client.1.smithi173.stdout:4/400: creat d7/d28/d31/d33/d7d/d4e/f83 x:0 0 0 2024-02-16T22:19:15.066 INFO:tasks.workunit.client.1.smithi173.stdout:4/401: write d7/f9 [4769166,55474] 0 2024-02-16T22:19:15.067 INFO:tasks.workunit.client.1.smithi173.stdout:4/402: rmdir d7/d28 39 2024-02-16T22:19:15.067 INFO:tasks.workunit.client.1.smithi173.stdout:4/403: write d7/d28/d31/d33/d7d/f67 [1764472,70016] 0 2024-02-16T22:19:15.067 INFO:tasks.workunit.client.1.smithi173.stdout:4/404: readlink d7/d28/d31/d33/d7d/d4e/l64 0 2024-02-16T22:19:15.068 INFO:tasks.workunit.client.1.smithi173.stdout:4/405: symlink d7/d28/d31/d33/d49/l84 0 2024-02-16T22:19:15.068 INFO:tasks.workunit.client.1.smithi173.stdout:4/406: creat d7/d28/d31/d33/f85 x:0 0 0 2024-02-16T22:19:15.081 INFO:tasks.workunit.client.1.smithi173.stdout:4/407: dwrite d7/d28/d31/f37 [4194304,4194304] 0 2024-02-16T22:19:15.087 INFO:tasks.workunit.client.1.smithi173.stdout:4/408: dread d7/f15 [8388608,4194304] 0 2024-02-16T22:19:15.088 INFO:tasks.workunit.client.1.smithi173.stdout:4/409: truncate d7/d28/d31/d33/f85 618003 0 2024-02-16T22:19:15.105 INFO:tasks.workunit.client.1.smithi173.stdout:8/607: sync 2024-02-16T22:19:15.105 INFO:tasks.workunit.client.1.smithi173.stdout:3/582: sync 2024-02-16T22:19:15.107 INFO:tasks.workunit.client.1.smithi173.stdout:3/583: rmdir d9/d1a/d2b/da6 0 2024-02-16T22:19:15.107 INFO:tasks.workunit.client.1.smithi173.stdout:8/608: mknod dd/d7c/d7d/d22/d28/d40/d69/da7/cce 0 2024-02-16T22:19:15.107 INFO:tasks.workunit.client.1.smithi173.stdout:8/609: write dd/f31 [1486278,72379] 0 2024-02-16T22:19:15.107 INFO:tasks.workunit.client.1.smithi173.stdout:8/610: read - dd/d7c/dcb/fa1 zero size 2024-02-16T22:19:15.108 INFO:tasks.workunit.client.1.smithi173.stdout:3/584: creat d9/fcb x:0 0 0 2024-02-16T22:19:15.108 INFO:tasks.workunit.client.1.smithi173.stdout:8/611: dread dd/d7c/d7d/d22/d2e/f57 [0,4194304] 0 2024-02-16T22:19:15.109 INFO:tasks.workunit.client.1.smithi173.stdout:8/612: symlink dd/d7c/d7d/d22/d28/d40/d69/lcf 0 2024-02-16T22:19:15.110 INFO:tasks.workunit.client.1.smithi173.stdout:8/613: stat dd/d7c/d7d/d22/c34 0 2024-02-16T22:19:15.110 INFO:tasks.workunit.client.1.smithi173.stdout:8/614: stat dd/f31 0 2024-02-16T22:19:15.112 INFO:tasks.workunit.client.1.smithi173.stdout:8/615: unlink dd/d7c/d7d/d22/d2e/d41/f4a 0 2024-02-16T22:19:15.112 INFO:tasks.workunit.client.1.smithi173.stdout:8/616: chown l8 789290 1 2024-02-16T22:19:15.112 INFO:tasks.workunit.client.1.smithi173.stdout:8/617: dread dd/d7c/d7d/d22/d28/d40/f64 [0,4194304] 0 2024-02-16T22:19:15.115 INFO:tasks.workunit.client.1.smithi173.stdout:8/618: rename f5 to dd/d7c/dcb/fd0 0 2024-02-16T22:19:15.123 INFO:tasks.workunit.client.1.smithi173.stdout:8/619: write dd/d7c/d7d/f27 [3304967,28028] 0 2024-02-16T22:19:15.123 INFO:tasks.workunit.client.1.smithi173.stdout:8/620: dread dd/d7c/d7d/f20 [0,4194304] 0 2024-02-16T22:19:15.123 INFO:tasks.workunit.client.1.smithi173.stdout:8/621: write dd/d7c/d7d/d58/f91 [2659510,70265] 0 2024-02-16T22:19:15.124 INFO:tasks.workunit.client.1.smithi173.stdout:8/622: mknod dd/d7c/d7d/d22/d28/d40/d51/cd1 0 2024-02-16T22:19:15.124 INFO:tasks.workunit.client.1.smithi173.stdout:8/623: chown dd/d9d/c77 30 1 2024-02-16T22:19:15.125 INFO:tasks.workunit.client.1.smithi173.stdout:3/585: dwrite d9/d1a/f44 [0,4194304] 0 2024-02-16T22:19:15.125 INFO:tasks.workunit.client.1.smithi173.stdout:8/624: symlink dd/d9d/db2/ld2 0 2024-02-16T22:19:15.126 INFO:tasks.workunit.client.1.smithi173.stdout:3/586: mknod d9/d18/d5f/ccc 0 2024-02-16T22:19:15.128 INFO:tasks.workunit.client.1.smithi173.stdout:8/625: mknod dd/d7c/cd3 0 2024-02-16T22:19:15.129 INFO:tasks.workunit.client.1.smithi173.stdout:3/587: unlink d9/d18/d5f/f9e 0 2024-02-16T22:19:15.141 INFO:tasks.workunit.client.1.smithi173.stdout:3/588: dread d9/da/f43 [0,4194304] 0 2024-02-16T22:19:15.141 INFO:tasks.workunit.client.1.smithi173.stdout:3/589: dread d9/d1a/d2b/d4d/d94/d98/fbb [0,4194304] 0 2024-02-16T22:19:15.142 INFO:tasks.workunit.client.1.smithi173.stdout:3/590: symlink d9/d18/daa/lcd 0 2024-02-16T22:19:15.143 INFO:tasks.workunit.client.1.smithi173.stdout:3/591: symlink d9/d1a/d2b/d45/d51/d92/lce 0 2024-02-16T22:19:15.148 INFO:tasks.workunit.client.1.smithi173.stdout:8/626: dwrite dd/fab [0,4194304] 0 2024-02-16T22:19:15.148 INFO:tasks.workunit.client.1.smithi173.stdout:8/627: read dd/d9d/f75 [3623311,9320] 0 2024-02-16T22:19:15.152 INFO:tasks.workunit.client.1.smithi173.stdout:8/628: mknod dd/d7c/d7d/d89/cd4 0 2024-02-16T22:19:15.153 INFO:tasks.workunit.client.1.smithi173.stdout:8/629: mkdir dd/d7c/d7d/d58/dd5 0 2024-02-16T22:19:15.163 INFO:tasks.workunit.client.1.smithi173.stdout:3/592: dwrite d9/d18/d73/db7/fb0 [0,4194304] 0 2024-02-16T22:19:15.164 INFO:tasks.workunit.client.1.smithi173.stdout:8/630: write dd/d7c/d7d/d22/d28/f3c [1683837,36262] 0 2024-02-16T22:19:15.167 INFO:tasks.workunit.client.1.smithi173.stdout:8/631: creat dd/d7c/d7d/d89/dad/fd6 x:0 0 0 2024-02-16T22:19:15.167 INFO:tasks.workunit.client.1.smithi173.stdout:8/632: dread - dd/d7c/dcb/fa1 zero size 2024-02-16T22:19:15.168 INFO:tasks.workunit.client.1.smithi173.stdout:8/633: dread dd/d7c/d7d/f20 [0,4194304] 0 2024-02-16T22:19:15.168 INFO:tasks.workunit.client.1.smithi173.stdout:3/593: unlink d9/d17/l36 0 2024-02-16T22:19:15.170 INFO:tasks.workunit.client.1.smithi173.stdout:8/634: mknod dd/d7c/d7d/d89/dad/cd7 0 2024-02-16T22:19:15.172 INFO:tasks.workunit.client.1.smithi173.stdout:8/635: mkdir dd/d7c/dcb/dd8 0 2024-02-16T22:19:15.189 INFO:tasks.workunit.client.1.smithi173.stdout:3/594: dwrite d9/d18/d73/f75 [0,4194304] 0 2024-02-16T22:19:15.191 INFO:tasks.workunit.client.1.smithi173.stdout:3/595: mkdir d9/d17/d25/dcf 0 2024-02-16T22:19:15.191 INFO:tasks.workunit.client.1.smithi173.stdout:3/596: readlink d9/d18/d5f/d6e/d4e/la1 0 2024-02-16T22:19:15.191 INFO:tasks.workunit.client.1.smithi173.stdout:3/597: truncate d9/d1a/d2b/d4d/d5b/f7d 501976 0 2024-02-16T22:19:15.193 INFO:tasks.workunit.client.1.smithi173.stdout:8/636: dwrite dd/d7c/d7d/d22/d2e/d41/d6b/f8e [0,4194304] 0 2024-02-16T22:19:15.204 INFO:tasks.workunit.client.1.smithi173.stdout:8/637: write dd/d7c/d7d/d22/f37 [4048371,13702] 0 2024-02-16T22:19:15.205 INFO:tasks.workunit.client.1.smithi173.stdout:8/638: mkdir dd/dd9 0 2024-02-16T22:19:15.206 INFO:tasks.workunit.client.1.smithi173.stdout:8/639: unlink dd/d7c/d7d/d22/d2e/d41/l68 0 2024-02-16T22:19:15.207 INFO:tasks.workunit.client.1.smithi173.stdout:8/640: fdatasync dd/d7c/d7d/d22/d2e/d41/d73/fa6 0 2024-02-16T22:19:15.207 INFO:tasks.workunit.client.1.smithi173.stdout:8/641: stat dd/d7c/d7d/d22/d28/d40/d69/da7/cce 0 2024-02-16T22:19:15.207 INFO:tasks.workunit.client.1.smithi173.stdout:8/642: stat dd/c6d 0 2024-02-16T22:19:15.207 INFO:tasks.workunit.client.1.smithi173.stdout:8/643: symlink dd/d9d/db2/lda 0 2024-02-16T22:19:15.208 INFO:tasks.workunit.client.1.smithi173.stdout:8/644: creat dd/d7c/d7d/fdb x:0 0 0 2024-02-16T22:19:15.209 INFO:tasks.workunit.client.1.smithi173.stdout:8/645: symlink dd/d7c/d7d/d22/d28/d40/d69/da7/dae/ldc 0 2024-02-16T22:19:15.209 INFO:tasks.workunit.client.1.smithi173.stdout:8/646: stat dd/d7c/d7d/f2c 0 2024-02-16T22:19:15.218 INFO:tasks.workunit.client.1.smithi173.stdout:8/647: dread dd/d7c/d7d/d22/d28/f47 [0,4194304] 0 2024-02-16T22:19:15.219 INFO:tasks.workunit.client.1.smithi173.stdout:8/648: rename dd/c9a to dd/d7c/d7d/d89/cdd 0 2024-02-16T22:19:15.226 INFO:tasks.workunit.client.1.smithi173.stdout:8/649: dread dd/d7c/d7d/d58/f91 [0,4194304] 0 2024-02-16T22:19:15.242 INFO:tasks.workunit.client.1.smithi173.stdout:8/650: dwrite dd/d7c/d7d/d22/d28/d40/f74 [0,4194304] 0 2024-02-16T22:19:15.242 INFO:tasks.workunit.client.1.smithi173.stdout:8/651: write dd/d7c/d7d/f13 [4003162,14420] 0 2024-02-16T22:19:15.244 INFO:tasks.workunit.client.1.smithi173.stdout:8/652: symlink dd/d7c/d7d/d22/lde 0 2024-02-16T22:19:15.248 INFO:tasks.workunit.client.1.smithi173.stdout:8/653: dread dd/d7c/d7d/d22/d28/fb5 [0,4194304] 0 2024-02-16T22:19:15.254 INFO:tasks.workunit.client.1.smithi173.stdout:8/654: getdents dd/d7c/d7d 0 2024-02-16T22:19:15.254 INFO:tasks.workunit.client.1.smithi173.stdout:8/655: fdatasync dd/d9d/f54 0 2024-02-16T22:19:15.272 INFO:tasks.workunit.client.1.smithi173.stdout:8/656: dwrite dd/d7c/d7d/f39 [0,4194304] 0 2024-02-16T22:19:15.285 INFO:tasks.workunit.client.1.smithi173.stdout:8/657: dwrite dd/d7c/d7d/d93/daa/fbd [0,4194304] 0 2024-02-16T22:19:15.286 INFO:tasks.workunit.client.1.smithi173.stdout:8/658: write dd/d7c/d7d/d22/d2e/f57 [395843,73976] 0 2024-02-16T22:19:15.286 INFO:tasks.workunit.client.1.smithi173.stdout:8/659: stat dd/c6d 0 2024-02-16T22:19:15.288 INFO:tasks.workunit.client.1.smithi173.stdout:8/660: truncate dd/d7c/d7d/f14 480915 0 2024-02-16T22:19:15.291 INFO:tasks.workunit.client.1.smithi173.stdout:8/661: dread dd/d7c/d7d/d58/f91 [0,4194304] 0 2024-02-16T22:19:15.293 INFO:tasks.workunit.client.1.smithi173.stdout:8/662: mknod dd/cdf 0 2024-02-16T22:19:15.294 INFO:tasks.workunit.client.1.smithi173.stdout:8/663: mknod dd/dd9/ce0 0 2024-02-16T22:19:15.294 INFO:tasks.workunit.client.1.smithi173.stdout:8/664: chown dd/d7c/d7d/d22/d2e/f94 0 1 2024-02-16T22:19:15.294 INFO:tasks.workunit.client.1.smithi173.stdout:8/665: write dd/d7c/d7d/d22/d28/f90 [1550625,47573] 0 2024-02-16T22:19:15.295 INFO:tasks.workunit.client.1.smithi173.stdout:8/666: rmdir dd/d9d/db2 39 2024-02-16T22:19:15.295 INFO:tasks.workunit.client.1.smithi173.stdout:8/667: fsync dd/d7c/d7d/d22/d2e/d41/d6b/f8e 0 2024-02-16T22:19:15.302 INFO:tasks.workunit.client.1.smithi173.stdout:8/668: read dd/d9d/fa9 [2203704,96710] 0 2024-02-16T22:19:15.303 INFO:tasks.workunit.client.1.smithi173.stdout:8/669: creat dd/d7c/d7d/d22/d5a/fe1 x:0 0 0 2024-02-16T22:19:15.303 INFO:tasks.workunit.client.1.smithi173.stdout:8/670: chown dd/f16 15 1 2024-02-16T22:19:15.308 INFO:tasks.workunit.client.1.smithi173.stdout:1/581: sync 2024-02-16T22:19:15.308 INFO:tasks.workunit.client.1.smithi173.stdout:1/582: chown db/d1c/d25/d28/d3f/fc8 966343 1 2024-02-16T22:19:15.308 INFO:tasks.workunit.client.1.smithi173.stdout:1/583: write db/d1c/d7f/d98/fcb [2472656,7820] 0 2024-02-16T22:19:15.311 INFO:tasks.workunit.client.1.smithi173.stdout:1/584: dread db/d1c/d25/d28/f49 [0,4194304] 0 2024-02-16T22:19:15.311 INFO:tasks.workunit.client.1.smithi173.stdout:1/585: readlink db/d1c/d25/lbb 0 2024-02-16T22:19:15.311 INFO:tasks.workunit.client.1.smithi173.stdout:8/671: dread dd/d7c/d7d/f39 [0,4194304] 0 2024-02-16T22:19:15.312 INFO:tasks.workunit.client.1.smithi173.stdout:1/586: creat db/d1c/d5c/dac/dae/fcc x:0 0 0 2024-02-16T22:19:15.315 INFO:tasks.workunit.client.1.smithi173.stdout:8/672: rmdir dd/d7c/d7d/d93/daa 39 2024-02-16T22:19:15.316 INFO:tasks.workunit.client.1.smithi173.stdout:8/673: chown dd/d7c/d7d/l83 237 1 2024-02-16T22:19:15.316 INFO:tasks.workunit.client.1.smithi173.stdout:8/674: write dd/d7c/d7d/f13 [4439893,63745] 0 2024-02-16T22:19:15.316 INFO:tasks.workunit.client.1.smithi173.stdout:8/675: stat dd/d7c/d7d/d22/fcd 0 2024-02-16T22:19:15.321 INFO:tasks.workunit.client.1.smithi173.stdout:8/676: dread dd/f86 [0,4194304] 0 2024-02-16T22:19:15.323 INFO:tasks.workunit.client.1.smithi173.stdout:8/677: unlink dd/d7c/d7d/d22/d50/f6e 0 2024-02-16T22:19:15.323 INFO:tasks.workunit.client.1.smithi173.stdout:8/678: write dd/d7c/d7d/d22/d50/f62 [727096,86209] 0 2024-02-16T22:19:15.323 INFO:tasks.workunit.client.1.smithi173.stdout:8/679: read dd/d7c/d7d/d22/d28/f3c [139843,16478] 0 2024-02-16T22:19:15.327 INFO:tasks.workunit.client.1.smithi173.stdout:8/680: rename dd/d7c/d7d/d22/ca0 to dd/d7c/d7d/d22/d2e/d41/d6b/ce2 0 2024-02-16T22:19:15.327 INFO:tasks.workunit.client.1.smithi173.stdout:8/681: fsync dd/d7c/d7d/d93/daa/fbd 0 2024-02-16T22:19:15.327 INFO:tasks.workunit.client.1.smithi173.stdout:8/682: rmdir dd/d7c/d7d/d22/d2e/d41/d6b 39 2024-02-16T22:19:15.328 INFO:tasks.workunit.client.1.smithi173.stdout:8/683: mknod dd/d7c/d7d/d22/d2e/ce3 0 2024-02-16T22:19:15.328 INFO:tasks.workunit.client.1.smithi173.stdout:8/684: truncate dd/d7c/d7d/d22/d50/fb3 166405 0 2024-02-16T22:19:15.329 INFO:tasks.workunit.client.1.smithi173.stdout:8/685: mknod dd/d7c/dcb/ce4 0 2024-02-16T22:19:15.330 INFO:tasks.workunit.client.1.smithi173.stdout:8/686: unlink dd/d7c/lb8 0 2024-02-16T22:19:15.331 INFO:tasks.workunit.client.1.smithi173.stdout:8/687: mkdir dd/d7c/d7d/d22/d28/d40/de5 0 2024-02-16T22:19:15.331 INFO:tasks.workunit.client.1.smithi173.stdout:8/688: write dd/d7c/d7d/d22/f37 [5049352,3648] 0 2024-02-16T22:19:15.331 INFO:tasks.workunit.client.1.smithi173.stdout:8/689: chown dd/d7c/d7d/d22/c2b 854992 1 2024-02-16T22:19:15.348 INFO:tasks.workunit.client.1.smithi173.stdout:8/690: dwrite dd/d7c/d7d/f39 [0,4194304] 0 2024-02-16T22:19:15.350 INFO:tasks.workunit.client.1.smithi173.stdout:8/691: read dd/d7c/d7d/d22/d28/f90 [315345,122275] 0 2024-02-16T22:19:15.372 INFO:tasks.workunit.client.1.smithi173.stdout:8/692: dwrite dd/d7c/d7d/d22/d28/f2f [0,4194304] 0 2024-02-16T22:19:15.372 INFO:tasks.workunit.client.1.smithi173.stdout:8/693: getdents dd/d7c/d7d/d93/daa 0 2024-02-16T22:19:15.373 INFO:tasks.workunit.client.1.smithi173.stdout:8/694: mknod dd/d7c/dcb/ce6 0 2024-02-16T22:19:15.417 INFO:tasks.workunit.client.1.smithi173.stdout:7/403: sync 2024-02-16T22:19:15.420 INFO:tasks.workunit.client.1.smithi173.stdout:7/404: dread d1/d1d/d4c/d63/d48/f5d [0,4194304] 0 2024-02-16T22:19:15.437 INFO:tasks.workunit.client.1.smithi173.stdout:7/405: dwrite d1/d1d/d4c/d63/d54/f76 [0,4194304] 0 2024-02-16T22:19:15.454 INFO:tasks.workunit.client.1.smithi173.stdout:7/406: dwrite d1/d1d/d4c/d63/d13/d22/d53/f24 [0,4194304] 0 2024-02-16T22:19:15.456 INFO:tasks.workunit.client.1.smithi173.stdout:7/407: unlink d1/d1d/d4c/d63/f2b 0 2024-02-16T22:19:15.456 INFO:tasks.workunit.client.1.smithi173.stdout:7/408: chown d1/d1d/d4c/d63/d13/d22/d53/d27/c40 261 1 2024-02-16T22:19:15.456 INFO:tasks.workunit.client.1.smithi173.stdout:7/409: write d1/d1d/d4c/d63/d13/d36/d49/f68 [3366771,92436] 0 2024-02-16T22:19:15.458 INFO:tasks.workunit.client.1.smithi173.stdout:7/410: creat d1/d1d/d44/f7c x:0 0 0 2024-02-16T22:19:15.458 INFO:tasks.workunit.client.1.smithi173.stdout:7/411: fdatasync d1/d1d/d44/f57 0 2024-02-16T22:19:15.458 INFO:tasks.workunit.client.1.smithi173.stdout:7/412: creat d1/d1d/d4c/d63/d13/d36/d49/f7d x:0 0 0 2024-02-16T22:19:15.474 INFO:tasks.workunit.client.1.smithi173.stdout:2/481: sync 2024-02-16T22:19:15.474 INFO:tasks.workunit.client.1.smithi173.stdout:6/440: sync 2024-02-16T22:19:15.474 INFO:tasks.workunit.client.1.smithi173.stdout:5/499: sync 2024-02-16T22:19:15.474 INFO:tasks.workunit.client.1.smithi173.stdout:9/385: sync 2024-02-16T22:19:15.474 INFO:tasks.workunit.client.1.smithi173.stdout:6/441: dread - d0/db/d2e/d2f/d31/d33/d6d/f9e zero size 2024-02-16T22:19:15.474 INFO:tasks.workunit.client.1.smithi173.stdout:5/500: creat d8/da/d1b/f95 x:0 0 0 2024-02-16T22:19:15.475 INFO:tasks.workunit.client.1.smithi173.stdout:9/386: mknod d1/d2/d1a/d3e/d79/c7d 0 2024-02-16T22:19:15.475 INFO:tasks.workunit.client.1.smithi173.stdout:9/387: chown d1/d2/d1a/l76 7 1 2024-02-16T22:19:15.480 INFO:tasks.workunit.client.1.smithi173.stdout:2/482: link d2/d4/d8/d2d/c84 d2/d4/d8/d30/d44/d83/c9f 0 2024-02-16T22:19:15.480 INFO:tasks.workunit.client.1.smithi173.stdout:2/483: write d2/d4/d8/d30/d44/f71 [1029800,84688] 0 2024-02-16T22:19:15.482 INFO:tasks.workunit.client.1.smithi173.stdout:5/501: dread d8/fd [0,4194304] 0 2024-02-16T22:19:15.482 INFO:tasks.workunit.client.1.smithi173.stdout:5/502: write d8/f7d [112071,70510] 0 2024-02-16T22:19:15.482 INFO:tasks.workunit.client.1.smithi173.stdout:6/442: link d0/db/f3d d0/db/d2e/d65/d67/d78/fa2 0 2024-02-16T22:19:15.483 INFO:tasks.workunit.client.1.smithi173.stdout:9/388: creat d1/d2/d1a/d3e/d4f/d65/d6b/f7e x:0 0 0 2024-02-16T22:19:15.484 INFO:tasks.workunit.client.1.smithi173.stdout:5/503: mknod d8/da/d1f/c96 0 2024-02-16T22:19:15.485 INFO:tasks.workunit.client.1.smithi173.stdout:6/443: symlink d0/db/d2e/d2f/d31/d7a/la3 0 2024-02-16T22:19:15.485 INFO:tasks.workunit.client.1.smithi173.stdout:6/444: readlink d0/db/d2e/d2f/l43 0 2024-02-16T22:19:15.485 INFO:tasks.workunit.client.1.smithi173.stdout:9/389: symlink d1/d2/d1a/d2f/l7f 0 2024-02-16T22:19:15.486 INFO:tasks.workunit.client.1.smithi173.stdout:5/504: truncate d8/da/d1f/d33/f4b 2191367 0 2024-02-16T22:19:15.487 INFO:tasks.workunit.client.1.smithi173.stdout:6/445: mknod d0/db/d2e/d65/d73/d7d/ca4 0 2024-02-16T22:19:15.487 INFO:tasks.workunit.client.1.smithi173.stdout:6/446: chown d0/db/d2e/l3a 28341270 1 2024-02-16T22:19:15.490 INFO:tasks.workunit.client.1.smithi173.stdout:5/505: unlink d8/f29 0 2024-02-16T22:19:15.492 INFO:tasks.workunit.client.1.smithi173.stdout:6/447: mknod d0/db/d2e/d2f/d31/ca5 0 2024-02-16T22:19:15.498 INFO:tasks.workunit.client.1.smithi173.stdout:2/484: dwrite d2/dc/f2b [0,4194304] 0 2024-02-16T22:19:15.503 INFO:tasks.workunit.client.1.smithi173.stdout:9/390: rmdir d1 39 2024-02-16T22:19:15.505 INFO:tasks.workunit.client.1.smithi173.stdout:6/448: dread d0/db/d2e/d2f/f4c [0,4194304] 0 2024-02-16T22:19:15.505 INFO:tasks.workunit.client.1.smithi173.stdout:9/391: rename d1/d2/d1a/d3e/d4f/d65 to d1/d5f/d61/d80 0 2024-02-16T22:19:15.506 INFO:tasks.workunit.client.1.smithi173.stdout:9/392: rmdir d1/d5f/d61/d80/d6b 39 2024-02-16T22:19:15.507 INFO:tasks.workunit.client.1.smithi173.stdout:2/485: dread d2/d10/d62/f78 [0,4194304] 0 2024-02-16T22:19:15.508 INFO:tasks.workunit.client.1.smithi173.stdout:9/393: rename d1/d2/d1a/d2f/d3b/f4b to d1/d2/d1a/d1f/f81 0 2024-02-16T22:19:15.510 INFO:tasks.workunit.client.1.smithi173.stdout:2/486: symlink d2/d4/d8/d30/d44/d81/d99/la0 0 2024-02-16T22:19:15.511 INFO:tasks.workunit.client.1.smithi173.stdout:9/394: truncate d1/d2/f24 507595 0 2024-02-16T22:19:15.511 INFO:tasks.workunit.client.1.smithi173.stdout:5/506: dwrite d8/da/f47 [0,4194304] 0 2024-02-16T22:19:15.512 INFO:tasks.workunit.client.1.smithi173.stdout:2/487: mkdir d2/d4/d8/d80/da1 0 2024-02-16T22:19:15.512 INFO:tasks.workunit.client.1.smithi173.stdout:2/488: stat d2/d4/c61 0 2024-02-16T22:19:15.512 INFO:tasks.workunit.client.1.smithi173.stdout:2/489: chown d2/d4/d8/d80/da1 333 1 2024-02-16T22:19:15.513 INFO:tasks.workunit.client.1.smithi173.stdout:5/507: mkdir d8/da/d1b/d57/d97 0 2024-02-16T22:19:15.515 INFO:tasks.workunit.client.1.smithi173.stdout:2/490: unlink d2/dc/d5d/f55 0 2024-02-16T22:19:15.516 INFO:tasks.workunit.client.1.smithi173.stdout:2/491: read d2/dc/d5d/f15 [38033,73107] 0 2024-02-16T22:19:15.524 INFO:tasks.workunit.client.1.smithi173.stdout:5/508: dread d8/d27/d28/f5b [0,4194304] 0 2024-02-16T22:19:15.524 INFO:tasks.workunit.client.1.smithi173.stdout:6/449: dwrite d0/db/d2e/f3c [0,4194304] 0 2024-02-16T22:19:15.524 INFO:tasks.workunit.client.1.smithi173.stdout:6/450: dread - d0/f70 zero size 2024-02-16T22:19:15.525 INFO:tasks.workunit.client.1.smithi173.stdout:5/509: creat d8/da/d1f/d8c/f98 x:0 0 0 2024-02-16T22:19:15.526 INFO:tasks.workunit.client.1.smithi173.stdout:5/510: truncate d8/da/d1f/f51 1544879 0 2024-02-16T22:19:15.526 INFO:tasks.workunit.client.1.smithi173.stdout:5/511: chown d8/da/d1b/f90 200 1 2024-02-16T22:19:15.527 INFO:tasks.workunit.client.1.smithi173.stdout:6/451: mkdir d0/db/d2e/d2f/da6 0 2024-02-16T22:19:15.544 INFO:tasks.workunit.client.1.smithi173.stdout:9/395: dwrite d1/f23 [0,4194304] 0 2024-02-16T22:19:15.545 INFO:tasks.workunit.client.1.smithi173.stdout:9/396: mknod d1/d2/d1a/d2f/d3b/d75/c82 0 2024-02-16T22:19:15.548 INFO:tasks.workunit.client.1.smithi173.stdout:2/492: dwrite d2/dc/d19/d1a/f5f [0,4194304] 0 2024-02-16T22:19:15.548 INFO:tasks.workunit.client.1.smithi173.stdout:2/493: fdatasync d2/dc/d19/f29 0 2024-02-16T22:19:15.548 INFO:tasks.workunit.client.1.smithi173.stdout:2/494: chown d2/d4/d8/d2d/f8b 6893 1 2024-02-16T22:19:15.548 INFO:tasks.workunit.client.1.smithi173.stdout:2/495: stat d2/d4/d8/d80/c7d 0 2024-02-16T22:19:15.549 INFO:tasks.workunit.client.1.smithi173.stdout:5/512: dwrite d8/d27/d28/f39 [0,4194304] 0 2024-02-16T22:19:15.550 INFO:tasks.workunit.client.1.smithi173.stdout:6/452: dwrite d0/db/d2e/d61/f6a [0,4194304] 0 2024-02-16T22:19:15.550 INFO:tasks.workunit.client.1.smithi173.stdout:6/453: chown d0/db/d2e/d61/c6e 1552 1 2024-02-16T22:19:15.550 INFO:tasks.workunit.client.1.smithi173.stdout:2/496: rename d2/d10/f4f to d2/dc/d19/d69/fa2 0 2024-02-16T22:19:15.550 INFO:tasks.workunit.client.1.smithi173.stdout:2/497: write d2/d10/f66 [1534806,84287] 0 2024-02-16T22:19:15.553 INFO:tasks.workunit.client.1.smithi173.stdout:2/498: dread d2/dc/d19/d1a/f52 [0,4194304] 0 2024-02-16T22:19:15.554 INFO:tasks.workunit.client.1.smithi173.stdout:5/513: mknod d8/d27/d62/c99 0 2024-02-16T22:19:15.556 INFO:tasks.workunit.client.1.smithi173.stdout:6/454: mknod d0/db/d2e/d2f/d31/d7a/ca7 0 2024-02-16T22:19:15.557 INFO:tasks.workunit.client.1.smithi173.stdout:2/499: mkdir d2/dc/d19/da3 0 2024-02-16T22:19:15.559 INFO:tasks.workunit.client.1.smithi173.stdout:6/455: rename d0/db/f77 to d0/db/d2e/d2f/d31/d33/d97/fa8 0 2024-02-16T22:19:15.560 INFO:tasks.workunit.client.1.smithi173.stdout:2/500: mkdir d2/dc/d19/da3/da4 0 2024-02-16T22:19:15.563 INFO:tasks.workunit.client.1.smithi173.stdout:2/501: unlink d2/dc/d5d/c1d 0 2024-02-16T22:19:15.563 INFO:tasks.workunit.client.1.smithi173.stdout:2/502: write d2/dc/d19/f51 [1337646,29326] 0 2024-02-16T22:19:15.563 INFO:tasks.workunit.client.1.smithi173.stdout:2/503: truncate d2/dc/d5d/f6a 4833465 0 2024-02-16T22:19:15.569 INFO:tasks.workunit.client.1.smithi173.stdout:5/514: dwrite d8/d27/d62/f87 [0,4194304] 0 2024-02-16T22:19:15.574 INFO:tasks.workunit.client.1.smithi173.stdout:5/515: creat d8/da/d2d/d36/d50/f9a x:0 0 0 2024-02-16T22:19:15.574 INFO:tasks.workunit.client.1.smithi173.stdout:6/456: dread d0/db/d2e/d2f/f45 [4194304,4194304] 0 2024-02-16T22:19:15.575 INFO:tasks.workunit.client.1.smithi173.stdout:5/516: mkdir d8/da/d1f/d30/d9b 0 2024-02-16T22:19:15.583 INFO:tasks.workunit.client.1.smithi173.stdout:6/457: dread d0/f5b [0,4194304] 0 2024-02-16T22:19:15.583 INFO:tasks.workunit.client.1.smithi173.stdout:6/458: stat d0/ce 0 2024-02-16T22:19:15.584 INFO:tasks.workunit.client.1.smithi173.stdout:6/459: mkdir d0/db/d2e/d65/d73/da9 0 2024-02-16T22:19:15.585 INFO:tasks.workunit.client.1.smithi173.stdout:6/460: rmdir d0/db/d2e/d2f 39 2024-02-16T22:19:15.589 INFO:tasks.workunit.client.1.smithi173.stdout:5/517: dwrite d8/da/d1b/f90 [0,4194304] 0 2024-02-16T22:19:15.592 INFO:tasks.workunit.client.1.smithi173.stdout:5/518: link d8/da/d2d/d3a/f74 d8/da/d1f/d30/d9b/f9c 0 2024-02-16T22:19:15.592 INFO:tasks.workunit.client.1.smithi173.stdout:5/519: read d8/da/f23 [173227,22095] 0 2024-02-16T22:19:15.592 INFO:tasks.workunit.client.1.smithi173.stdout:6/461: write d0/fd [656753,42396] 0 2024-02-16T22:19:15.592 INFO:tasks.workunit.client.1.smithi173.stdout:6/462: fsync d0/db/d2e/d65/f6b 0 2024-02-16T22:19:15.593 INFO:tasks.workunit.client.1.smithi173.stdout:6/463: mkdir d0/db/d2e/d2f/da6/daa 0 2024-02-16T22:19:15.593 INFO:tasks.workunit.client.1.smithi173.stdout:6/464: creat d0/db/d2e/d2f/d31/d33/fab x:0 0 0 2024-02-16T22:19:15.596 INFO:tasks.workunit.client.1.smithi173.stdout:6/465: creat d0/db/d2e/d2f/fac x:0 0 0 2024-02-16T22:19:15.616 INFO:tasks.workunit.client.1.smithi173.stdout:5/520: dwrite d8/d27/d70/f77 [0,4194304] 0 2024-02-16T22:19:15.617 INFO:tasks.workunit.client.1.smithi173.stdout:6/466: dwrite d0/db/d2e/d2f/f4e [0,4194304] 0 2024-02-16T22:19:15.618 INFO:tasks.workunit.client.1.smithi173.stdout:5/521: unlink d8/l78 0 2024-02-16T22:19:15.620 INFO:tasks.workunit.client.1.smithi173.stdout:6/467: unlink d0/c23 0 2024-02-16T22:19:15.621 INFO:tasks.workunit.client.1.smithi173.stdout:3/598: sync 2024-02-16T22:19:15.621 INFO:tasks.workunit.client.1.smithi173.stdout:4/410: sync 2024-02-16T22:19:15.621 INFO:tasks.workunit.client.1.smithi173.stdout:0/374: sync 2024-02-16T22:19:15.621 INFO:tasks.workunit.client.1.smithi173.stdout:4/411: readlink d7/d28/d31/d33/d7d/d4e/l64 0 2024-02-16T22:19:15.621 INFO:tasks.workunit.client.1.smithi173.stdout:3/599: readlink d9/d18/d73/db7/l95 0 2024-02-16T22:19:15.621 INFO:tasks.workunit.client.1.smithi173.stdout:0/375: fdatasync d0/d4/d14/d24/d32/d39/f64 0 2024-02-16T22:19:15.622 INFO:tasks.workunit.client.1.smithi173.stdout:6/468: rmdir d0/db/d4d 39 2024-02-16T22:19:15.622 INFO:tasks.workunit.client.1.smithi173.stdout:6/469: truncate d0/db/d2e/d2f/f45 9196959 0 2024-02-16T22:19:15.629 INFO:tasks.workunit.client.1.smithi173.stdout:6/470: dread d0/db/d2e/d65/d67/d78/fa2 [0,4194304] 0 2024-02-16T22:19:15.636 INFO:tasks.workunit.client.1.smithi173.stdout:3/600: read d9/d1a/d2b/d4d/f8c [1261534,38128] 0 2024-02-16T22:19:15.636 INFO:tasks.workunit.client.1.smithi173.stdout:3/601: write d9/d1a/d2b/d45/f88 [503630,73280] 0 2024-02-16T22:19:15.639 INFO:tasks.workunit.client.1.smithi173.stdout:3/602: creat d9/d17/d93/fd0 x:0 0 0 2024-02-16T22:19:15.640 INFO:tasks.workunit.client.1.smithi173.stdout:3/603: chown d9/d1a/d2b/d45/d51/f87 15246 1 2024-02-16T22:19:15.640 INFO:tasks.workunit.client.1.smithi173.stdout:3/604: stat d9/d18/d73/fc8 0 2024-02-16T22:19:15.640 INFO:tasks.workunit.client.1.smithi173.stdout:3/605: truncate d9/da/f15 575270 0 2024-02-16T22:19:15.640 INFO:tasks.workunit.client.1.smithi173.stdout:3/606: dread - d9/d1a/d2b/d45/d51/d92/fba zero size 2024-02-16T22:19:15.640 INFO:tasks.workunit.client.1.smithi173.stdout:3/607: chown d9/d18/d5f/fa4 1345 1 2024-02-16T22:19:15.641 INFO:tasks.workunit.client.1.smithi173.stdout:3/608: creat d9/d1a/d2b/d45/d60/d6a/fd1 x:0 0 0 2024-02-16T22:19:15.642 INFO:tasks.workunit.client.1.smithi173.stdout:3/609: mknod d9/d18/d73/db7/d7a/cd2 0 2024-02-16T22:19:15.642 INFO:tasks.workunit.client.1.smithi173.stdout:4/412: read d7/df/f23 [2031536,70791] 0 2024-02-16T22:19:15.643 INFO:tasks.workunit.client.1.smithi173.stdout:6/471: write d0/db/d2e/d2f/f4e [996802,108556] 0 2024-02-16T22:19:15.644 INFO:tasks.workunit.client.1.smithi173.stdout:3/610: link d9/d1a/l9b d9/d1a/d2b/d4d/d94/ld3 0 2024-02-16T22:19:15.644 INFO:tasks.workunit.client.1.smithi173.stdout:3/611: chown d9/d1a/d2b/l40 54581 1 2024-02-16T22:19:15.644 INFO:tasks.workunit.client.1.smithi173.stdout:3/612: chown d9/d1a/d2b/f2d 312935115 1 2024-02-16T22:19:15.644 INFO:tasks.workunit.client.1.smithi173.stdout:4/413: truncate d7/df/f23 3743842 0 2024-02-16T22:19:15.645 INFO:tasks.workunit.client.1.smithi173.stdout:6/472: rename d0/db/d2e/f52 to d0/db/d2e/d65/d73/d7d/fad 0 2024-02-16T22:19:15.645 INFO:tasks.workunit.client.1.smithi173.stdout:3/613: stat d9/d1a/c91 0 2024-02-16T22:19:15.646 INFO:tasks.workunit.client.1.smithi173.stdout:4/414: symlink d7/d12/d2d/l86 0 2024-02-16T22:19:15.647 INFO:tasks.workunit.client.1.smithi173.stdout:6/473: mknod d0/db/d2e/d2f/d31/d7a/cae 0 2024-02-16T22:19:15.647 INFO:tasks.workunit.client.1.smithi173.stdout:6/474: dread - d0/db/d2e/d2f/d31/d5d/d8c/f9d zero size 2024-02-16T22:19:15.648 INFO:tasks.workunit.client.1.smithi173.stdout:0/376: dwrite d0/d4/d27/f57 [4194304,4194304] 0 2024-02-16T22:19:15.648 INFO:tasks.workunit.client.1.smithi173.stdout:5/522: dwrite d8/d27/d28/f5b [0,4194304] 0 2024-02-16T22:19:15.649 INFO:tasks.workunit.client.1.smithi173.stdout:4/415: symlink d7/d28/d31/d33/d7d/l87 0 2024-02-16T22:19:15.649 INFO:tasks.workunit.client.1.smithi173.stdout:4/416: dread - d7/d28/f75 zero size 2024-02-16T22:19:15.650 INFO:tasks.workunit.client.1.smithi173.stdout:6/475: symlink d0/db/d2e/d61/laf 0 2024-02-16T22:19:15.651 INFO:tasks.workunit.client.1.smithi173.stdout:3/614: rmdir d9/d18/daa 39 2024-02-16T22:19:15.651 INFO:tasks.workunit.client.1.smithi173.stdout:3/615: chown d9/d1a/d2b/d4d/d5b/f89 7546305 1 2024-02-16T22:19:15.652 INFO:tasks.workunit.client.1.smithi173.stdout:4/417: symlink d7/d12/d7e/l88 0 2024-02-16T22:19:15.654 INFO:tasks.workunit.client.1.smithi173.stdout:3/616: mknod d9/d18/da3/cd4 0 2024-02-16T22:19:15.654 INFO:tasks.workunit.client.1.smithi173.stdout:3/617: write d9/d1a/f8e [97779,41946] 0 2024-02-16T22:19:15.655 INFO:tasks.workunit.client.1.smithi173.stdout:4/418: mkdir d7/d28/d52/d89 0 2024-02-16T22:19:15.657 INFO:tasks.workunit.client.1.smithi173.stdout:3/618: creat d9/d18/da3/fd5 x:0 0 0 2024-02-16T22:19:15.657 INFO:tasks.workunit.client.1.smithi173.stdout:3/619: fsync d9/d17/d93/fd0 0 2024-02-16T22:19:15.660 INFO:tasks.workunit.client.1.smithi173.stdout:3/620: mknod d9/d1a/d2b/d45/d60/cd6 0 2024-02-16T22:19:15.660 INFO:tasks.workunit.client.1.smithi173.stdout:3/621: chown d9/d18/d5f/d6e/c41 87 1 2024-02-16T22:19:15.662 INFO:tasks.workunit.client.1.smithi173.stdout:6/476: dread d0/db/d2e/d2f/f45 [0,4194304] 0 2024-02-16T22:19:15.663 INFO:tasks.workunit.client.1.smithi173.stdout:5/523: write d8/da/d1b/f90 [235415,18926] 0 2024-02-16T22:19:15.663 INFO:tasks.workunit.client.1.smithi173.stdout:0/377: dwrite d0/d4/f60 [0,4194304] 0 2024-02-16T22:19:15.666 INFO:tasks.workunit.client.1.smithi173.stdout:5/524: mknod d8/da/d2d/d3a/c9d 0 2024-02-16T22:19:15.666 INFO:tasks.workunit.client.1.smithi173.stdout:5/525: chown d8/da/d1f/d33/f5a 239141 1 2024-02-16T22:19:15.668 INFO:tasks.workunit.client.1.smithi173.stdout:6/477: write d0/db/d4d/f6f [1130748,85126] 0 2024-02-16T22:19:15.668 INFO:tasks.workunit.client.1.smithi173.stdout:6/478: fsync d0/f5b 0 2024-02-16T22:19:15.669 INFO:tasks.workunit.client.1.smithi173.stdout:0/378: symlink d0/d12/d15/d3d/d6f/l79 0 2024-02-16T22:19:15.670 INFO:tasks.workunit.client.1.smithi173.stdout:5/526: getdents d8/da/d1f/d30/d9b 0 2024-02-16T22:19:15.671 INFO:tasks.workunit.client.1.smithi173.stdout:6/479: creat d0/d7c/fb0 x:0 0 0 2024-02-16T22:19:15.672 INFO:tasks.workunit.client.1.smithi173.stdout:0/379: symlink d0/d12/d15/d3d/l7a 0 2024-02-16T22:19:15.673 INFO:tasks.workunit.client.1.smithi173.stdout:5/527: creat d8/d27/f9e x:0 0 0 2024-02-16T22:19:15.673 INFO:tasks.workunit.client.1.smithi173.stdout:5/528: fdatasync d8/d27/d28/f39 0 2024-02-16T22:19:15.674 INFO:tasks.workunit.client.1.smithi173.stdout:0/380: symlink d0/d12/d15/d3d/d6f/l7b 0 2024-02-16T22:19:15.675 INFO:tasks.workunit.client.1.smithi173.stdout:5/529: creat d8/d27/d35/d8b/f9f x:0 0 0 2024-02-16T22:19:15.675 INFO:tasks.workunit.client.1.smithi173.stdout:5/530: creat d8/d27/d28/fa0 x:0 0 0 2024-02-16T22:19:15.676 INFO:tasks.workunit.client.1.smithi173.stdout:6/480: getdents d0/db/d2e/d2f 0 2024-02-16T22:19:15.676 INFO:tasks.workunit.client.1.smithi173.stdout:6/481: chown d0/db/d2e/d2f/d31/d33/fab 34 1 2024-02-16T22:19:15.676 INFO:tasks.workunit.client.1.smithi173.stdout:6/482: fsync d0/db/d2e/d2f/d31/f39 0 2024-02-16T22:19:15.678 INFO:tasks.workunit.client.1.smithi173.stdout:5/531: rename d8/da/ff to d8/da/d1f/d33/d92/fa1 0 2024-02-16T22:19:15.679 INFO:tasks.workunit.client.1.smithi173.stdout:5/532: mknod d8/da/d1f/d6f/d91/ca2 0 2024-02-16T22:19:15.679 INFO:tasks.workunit.client.1.smithi173.stdout:5/533: chown d8/da/d1f/d30 102082202 1 2024-02-16T22:19:15.679 INFO:tasks.workunit.client.1.smithi173.stdout:5/534: creat d8/fa3 x:0 0 0 2024-02-16T22:19:15.680 INFO:tasks.workunit.client.1.smithi173.stdout:4/419: dwrite d7/d28/f75 [0,4194304] 0 2024-02-16T22:19:15.680 INFO:tasks.workunit.client.1.smithi173.stdout:4/420: stat d7/d28/d31/d33/d7d/d4e/l68 0 2024-02-16T22:19:15.681 INFO:tasks.workunit.client.1.smithi173.stdout:5/535: mknod d8/ca4 0 2024-02-16T22:19:15.681 INFO:tasks.workunit.client.1.smithi173.stdout:5/536: write d8/da/d1b/f52 [1231363,21359] 0 2024-02-16T22:19:15.684 INFO:tasks.workunit.client.1.smithi173.stdout:3/622: dwrite d9/d1a/f2c [0,4194304] 0 2024-02-16T22:19:15.684 INFO:tasks.workunit.client.1.smithi173.stdout:3/623: creat d9/d18/d5f/fd7 x:0 0 0 2024-02-16T22:19:15.686 INFO:tasks.workunit.client.1.smithi173.stdout:4/421: rename d7/d28/d14/l1c to d7/d28/d52/d89/l8a 0 2024-02-16T22:19:15.686 INFO:tasks.workunit.client.1.smithi173.stdout:4/422: write d7/d28/d31/d33/d7d/d4e/f5a [2107797,1274] 0 2024-02-16T22:19:15.696 INFO:tasks.workunit.client.1.smithi173.stdout:4/423: read d7/d28/d31/f3b [3751039,129616] 0 2024-02-16T22:19:15.698 INFO:tasks.workunit.client.1.smithi173.stdout:4/424: rename d7/d28/d31/d33/d49 to d7/df/d8b 0 2024-02-16T22:19:15.703 INFO:tasks.workunit.client.1.smithi173.stdout:0/381: dwrite d0/d4/d14/f2d [8388608,4194304] 0 2024-02-16T22:19:15.703 INFO:tasks.workunit.client.1.smithi173.stdout:3/624: dread d9/d18/d73/f75 [0,4194304] 0 2024-02-16T22:19:15.704 INFO:tasks.workunit.client.1.smithi173.stdout:3/625: chown d9/d17/d25/f4a 1899 1 2024-02-16T22:19:15.707 INFO:tasks.workunit.client.1.smithi173.stdout:6/483: dwrite d0/db/f72 [0,4194304] 0 2024-02-16T22:19:15.707 INFO:tasks.workunit.client.1.smithi173.stdout:6/484: chown d0/db/d2e/d2f/d31/d7a/l7f 292241 1 2024-02-16T22:19:15.707 INFO:tasks.workunit.client.1.smithi173.stdout:6/485: chown d0/db/d2e/d2f/f82 1612 1 2024-02-16T22:19:15.708 INFO:tasks.workunit.client.1.smithi173.stdout:0/382: rename d0/d4/d33/c62 to d0/d12/d15/d3d/c7c 0 2024-02-16T22:19:15.714 INFO:tasks.workunit.client.1.smithi173.stdout:5/537: dwrite d8/da/d2d/d3a/f82 [0,4194304] 0 2024-02-16T22:19:15.714 INFO:tasks.workunit.client.1.smithi173.stdout:6/486: symlink d0/lb1 0 2024-02-16T22:19:15.714 INFO:tasks.workunit.client.1.smithi173.stdout:6/487: readlink d0/db/d2e/d2f/d31/d7a/l7f 0 2024-02-16T22:19:15.716 INFO:tasks.workunit.client.1.smithi173.stdout:0/383: getdents d0/d4 0 2024-02-16T22:19:15.718 INFO:tasks.workunit.client.1.smithi173.stdout:5/538: unlink d8/da/d1b/f64 0 2024-02-16T22:19:15.719 INFO:tasks.workunit.client.1.smithi173.stdout:6/488: creat d0/db/fb2 x:0 0 0 2024-02-16T22:19:15.720 INFO:tasks.workunit.client.1.smithi173.stdout:0/384: symlink d0/d4/d27/l7d 0 2024-02-16T22:19:15.721 INFO:tasks.workunit.client.1.smithi173.stdout:5/539: creat d8/da/d2d/d56/fa5 x:0 0 0 2024-02-16T22:19:15.722 INFO:tasks.workunit.client.1.smithi173.stdout:6/489: link d0/db/d2e/d2f/d31/f55 d0/db/d2e/d2f/d31/d5d/d8c/d92/fb3 0 2024-02-16T22:19:15.723 INFO:tasks.workunit.client.1.smithi173.stdout:6/490: readlink d0/db/d2e/d2f/l4f 0 2024-02-16T22:19:15.724 INFO:tasks.workunit.client.1.smithi173.stdout:5/540: creat d8/da/d1f/d30/d9b/fa6 x:0 0 0 2024-02-16T22:19:15.724 INFO:tasks.workunit.client.1.smithi173.stdout:5/541: readlink d8/d27/d28/l48 0 2024-02-16T22:19:15.728 INFO:tasks.workunit.client.1.smithi173.stdout:5/542: rename d8/d27/d70 to d8/da/d2d/d3a/da7 0 2024-02-16T22:19:15.728 INFO:tasks.workunit.client.1.smithi173.stdout:5/543: write d8/f6a [306971,47588] 0 2024-02-16T22:19:15.729 INFO:tasks.workunit.client.1.smithi173.stdout:5/544: symlink d8/d27/d62/la8 0 2024-02-16T22:19:15.729 INFO:tasks.workunit.client.1.smithi173.stdout:5/545: chown d8/d27/d35/d8b/f9f 1 1 2024-02-16T22:19:15.731 INFO:tasks.workunit.client.1.smithi173.stdout:5/546: mkdir d8/d27/d35/d8b/da9 0 2024-02-16T22:19:15.731 INFO:tasks.workunit.client.1.smithi173.stdout:5/547: truncate d8/fd 4360655 0 2024-02-16T22:19:15.732 INFO:tasks.workunit.client.1.smithi173.stdout:5/548: chown d8/da/d2d/f84 3169048 1 2024-02-16T22:19:15.732 INFO:tasks.workunit.client.1.smithi173.stdout:5/549: creat d8/da/d1b/faa x:0 0 0 2024-02-16T22:19:15.732 INFO:tasks.workunit.client.1.smithi173.stdout:3/626: dwrite f8 [4194304,4194304] 0 2024-02-16T22:19:15.735 INFO:tasks.workunit.client.1.smithi173.stdout:5/550: truncate d8/da/d1f/d33/f83 3880228 0 2024-02-16T22:19:15.735 INFO:tasks.workunit.client.1.smithi173.stdout:4/425: dwrite d7/d12/d2d/f44 [0,4194304] 0 2024-02-16T22:19:15.736 INFO:tasks.workunit.client.1.smithi173.stdout:3/627: truncate d9/d1a/d2b/d4d/f4f 63594 0 2024-02-16T22:19:15.736 INFO:tasks.workunit.client.1.smithi173.stdout:0/385: write d0/d12/f4d [1059387,32707] 0 2024-02-16T22:19:15.739 INFO:tasks.workunit.client.1.smithi173.stdout:6/491: write d0/db/f12 [5418181,117206] 0 2024-02-16T22:19:15.739 INFO:tasks.workunit.client.1.smithi173.stdout:6/492: stat d0/db/d2e/d2f/d31/d33/f9c 0 2024-02-16T22:19:15.740 INFO:tasks.workunit.client.1.smithi173.stdout:5/551: link d8/da/d2d/d36/f8a d8/da/fab 0 2024-02-16T22:19:15.758 INFO:tasks.workunit.client.1.smithi173.stdout:5/552: dwrite d8/da/d2d/d36/d50/f9a [0,4194304] 0 2024-02-16T22:19:15.763 INFO:tasks.workunit.client.1.smithi173.stdout:3/628: unlink d9/d1a/d2b/d45/d60/d6a/f6f 0 2024-02-16T22:19:15.766 INFO:tasks.workunit.client.1.smithi173.stdout:0/386: unlink d0/d4/d14/d24/d2e/f69 0 2024-02-16T22:19:15.774 INFO:tasks.workunit.client.1.smithi173.stdout:5/553: symlink d8/da/d2d/d36/lac 0 2024-02-16T22:19:15.776 INFO:tasks.workunit.client.1.smithi173.stdout:4/426: getdents d7/d28/d31 0 2024-02-16T22:19:15.776 INFO:tasks.workunit.client.1.smithi173.stdout:4/427: truncate d7/d28/d52/f60 5049455 0 2024-02-16T22:19:15.776 INFO:tasks.workunit.client.1.smithi173.stdout:3/629: write d9/da/fd [1736246,57263] 0 2024-02-16T22:19:15.778 INFO:tasks.workunit.client.1.smithi173.stdout:0/387: unlink d0/d4/d33/d54/l61 0 2024-02-16T22:19:15.779 INFO:tasks.workunit.client.1.smithi173.stdout:6/493: mknod d0/cb4 0 2024-02-16T22:19:15.781 INFO:tasks.workunit.client.1.smithi173.stdout:5/554: symlink d8/da/d1b/d57/lad 0 2024-02-16T22:19:15.782 INFO:tasks.workunit.client.1.smithi173.stdout:4/428: symlink d7/l8c 0 2024-02-16T22:19:15.785 INFO:tasks.workunit.client.1.smithi173.stdout:5/555: rmdir d8/d27/d35/d8b/da9 0 2024-02-16T22:19:15.786 INFO:tasks.workunit.client.1.smithi173.stdout:4/429: creat d7/d28/d31/d33/d7d/d3d/f8d x:0 0 0 2024-02-16T22:19:15.790 INFO:tasks.workunit.client.1.smithi173.stdout:0/388: dread d0/d4/f8 [0,4194304] 0 2024-02-16T22:19:15.793 INFO:tasks.workunit.client.1.smithi173.stdout:1/587: sync 2024-02-16T22:19:15.793 INFO:tasks.workunit.client.1.smithi173.stdout:1/588: readlink db/d1c/d25/d28/lb3 0 2024-02-16T22:19:15.793 INFO:tasks.workunit.client.1.smithi173.stdout:7/413: sync 2024-02-16T22:19:15.793 INFO:tasks.workunit.client.1.smithi173.stdout:8/695: sync 2024-02-16T22:19:15.795 INFO:tasks.workunit.client.1.smithi173.stdout:9/397: sync 2024-02-16T22:19:15.795 INFO:tasks.workunit.client.1.smithi173.stdout:9/398: stat d1/d2/f13 0 2024-02-16T22:19:15.795 INFO:tasks.workunit.client.1.smithi173.stdout:9/399: fdatasync d1/f12 0 2024-02-16T22:19:15.797 INFO:tasks.workunit.client.1.smithi173.stdout:2/504: sync 2024-02-16T22:19:15.797 INFO:tasks.workunit.client.1.smithi173.stdout:2/505: write d2/d4/d8/d3a/f47 [859907,7202] 0 2024-02-16T22:19:15.798 INFO:tasks.workunit.client.1.smithi173.stdout:0/389: write d0/d4/fe [8231144,105425] 0 2024-02-16T22:19:15.798 INFO:tasks.workunit.client.1.smithi173.stdout:5/556: mknod d8/da/d1f/d33/cae 0 2024-02-16T22:19:15.798 INFO:tasks.workunit.client.1.smithi173.stdout:5/557: chown d8/da/d2d/d3a 728071 1 2024-02-16T22:19:15.798 INFO:tasks.workunit.client.1.smithi173.stdout:5/558: creat d8/da/d2d/faf x:0 0 0 2024-02-16T22:19:15.799 INFO:tasks.workunit.client.1.smithi173.stdout:6/494: rmdir d0 39 2024-02-16T22:19:15.799 INFO:tasks.workunit.client.1.smithi173.stdout:6/495: chown d0/db/fb2 35 1 2024-02-16T22:19:15.799 INFO:tasks.workunit.client.1.smithi173.stdout:6/496: chown d0/db/d2e/d2f/d31/d33/d97/fa8 212 1 2024-02-16T22:19:15.800 INFO:tasks.workunit.client.1.smithi173.stdout:1/589: dread db/d29/f3b [0,4194304] 0 2024-02-16T22:19:15.800 INFO:tasks.workunit.client.1.smithi173.stdout:4/430: creat d7/d12/d2d/f8e x:0 0 0 2024-02-16T22:19:15.800 INFO:tasks.workunit.client.1.smithi173.stdout:4/431: write d7/d28/d31/d33/d7d/f5d [787115,30405] 0 2024-02-16T22:19:15.802 INFO:tasks.workunit.client.1.smithi173.stdout:8/696: symlink dd/d7c/d7d/d93/daa/le7 0 2024-02-16T22:19:15.803 INFO:tasks.workunit.client.1.smithi173.stdout:2/506: mkdir d2/dc/d19/d69/da5 0 2024-02-16T22:19:15.805 INFO:tasks.workunit.client.1.smithi173.stdout:4/432: symlink d7/d28/d52/l8f 0 2024-02-16T22:19:15.806 INFO:tasks.workunit.client.1.smithi173.stdout:4/433: creat d7/d28/d52/f90 x:0 0 0 2024-02-16T22:19:15.808 INFO:tasks.workunit.client.1.smithi173.stdout:8/697: dread dd/d7c/d7d/d22/d28/d40/f78 [0,4194304] 0 2024-02-16T22:19:15.808 INFO:tasks.workunit.client.1.smithi173.stdout:8/698: write dd/d7c/d7d/f13 [5098146,66293] 0 2024-02-16T22:19:15.808 INFO:tasks.workunit.client.1.smithi173.stdout:8/699: fdatasync dd/d7c/dcb/fa1 0 2024-02-16T22:19:15.808 INFO:tasks.workunit.client.1.smithi173.stdout:4/434: symlink d7/d28/d52/l91 0 2024-02-16T22:19:15.810 INFO:tasks.workunit.client.1.smithi173.stdout:4/435: symlink d7/l92 0 2024-02-16T22:19:15.812 INFO:tasks.workunit.client.1.smithi173.stdout:0/390: read d0/d4/d14/d24/d32/d39/f2c [2405463,37748] 0 2024-02-16T22:19:15.812 INFO:tasks.workunit.client.1.smithi173.stdout:4/436: mkdir d7/d28/d31/d72/d93 0 2024-02-16T22:19:15.812 INFO:tasks.workunit.client.1.smithi173.stdout:0/391: read d0/d12/d15/d3d/f65 [665753,128509] 0 2024-02-16T22:19:15.815 INFO:tasks.workunit.client.1.smithi173.stdout:4/437: creat d7/d28/d31/d33/d7d/d45/f94 x:0 0 0 2024-02-16T22:19:15.815 INFO:tasks.workunit.client.1.smithi173.stdout:4/438: truncate d7/d28/d31/d33/d7d/d45/f69 300191 0 2024-02-16T22:19:15.815 INFO:tasks.workunit.client.1.smithi173.stdout:4/439: readlink d7/df/d8b/l84 0 2024-02-16T22:19:15.815 INFO:tasks.workunit.client.1.smithi173.stdout:4/440: dread - d7/d28/d31/d33/d7d/d45/f65 zero size 2024-02-16T22:19:15.816 INFO:tasks.workunit.client.1.smithi173.stdout:1/590: dread db/d1d/f1e [0,4194304] 0 2024-02-16T22:19:15.816 INFO:tasks.workunit.client.1.smithi173.stdout:1/591: creat db/d1c/d5c/dac/fcd x:0 0 0 2024-02-16T22:19:15.817 INFO:tasks.workunit.client.1.smithi173.stdout:0/392: truncate d0/d4/d14/d50/f6e 2983095 0 2024-02-16T22:19:15.817 INFO:tasks.workunit.client.1.smithi173.stdout:0/393: read d0/d4/d14/d24/d32/d39/f64 [3554849,28127] 0 2024-02-16T22:19:15.818 INFO:tasks.workunit.client.1.smithi173.stdout:9/400: write d1/d2/d1a/d1f/f43 [143280,63548] 0 2024-02-16T22:19:15.820 INFO:tasks.workunit.client.1.smithi173.stdout:1/592: truncate f2 3607443 0 2024-02-16T22:19:15.820 INFO:tasks.workunit.client.1.smithi173.stdout:8/700: dread f9 [0,4194304] 0 2024-02-16T22:19:15.820 INFO:tasks.workunit.client.1.smithi173.stdout:8/701: creat dd/fe8 x:0 0 0 2024-02-16T22:19:15.820 INFO:tasks.workunit.client.1.smithi173.stdout:8/702: chown dd/d7c/d7d/d22/d5a 3416017 1 2024-02-16T22:19:15.820 INFO:tasks.workunit.client.1.smithi173.stdout:8/703: write dd/d7c/d7d/f3d [2225841,56387] 0 2024-02-16T22:19:15.820 INFO:tasks.workunit.client.1.smithi173.stdout:8/704: write dd/f31 [720457,5131] 0 2024-02-16T22:19:15.821 INFO:tasks.workunit.client.1.smithi173.stdout:8/705: write dd/d7c/fbb [43006,820] 0 2024-02-16T22:19:15.821 INFO:tasks.workunit.client.1.smithi173.stdout:9/401: unlink d1/d2/d1a/l70 0 2024-02-16T22:19:15.821 INFO:tasks.workunit.client.1.smithi173.stdout:4/441: dread d7/d12/f30 [0,4194304] 0 2024-02-16T22:19:15.822 INFO:tasks.workunit.client.1.smithi173.stdout:1/593: symlink db/d29/db5/lce 0 2024-02-16T22:19:15.822 INFO:tasks.workunit.client.1.smithi173.stdout:1/594: dread db/d1c/d7f/d98/fbd [0,4194304] 0 2024-02-16T22:19:15.825 INFO:tasks.workunit.client.1.smithi173.stdout:8/706: rename dd/d9d/db2/cba to dd/d7c/d7d/d22/d28/ce9 0 2024-02-16T22:19:15.825 INFO:tasks.workunit.client.1.smithi173.stdout:8/707: chown dd/d7c/d7d/l83 762332762 1 2024-02-16T22:19:15.825 INFO:tasks.workunit.client.1.smithi173.stdout:7/414: dwrite d1/d1d/d4c/d63/d13/d36/f4a [4194304,4194304] 0 2024-02-16T22:19:15.826 INFO:tasks.workunit.client.1.smithi173.stdout:7/415: fsync d1/d1d/d4c/d63/d13/d36/f4a 0 2024-02-16T22:19:15.826 INFO:tasks.workunit.client.1.smithi173.stdout:7/416: stat d1/d1d/d44/f59 0 2024-02-16T22:19:15.826 INFO:tasks.workunit.client.1.smithi173.stdout:9/402: symlink d1/d5f/l83 0 2024-02-16T22:19:15.828 INFO:tasks.workunit.client.1.smithi173.stdout:4/442: mkdir d7/d28/d31/d72/d93/d95 0 2024-02-16T22:19:15.828 INFO:tasks.workunit.client.1.smithi173.stdout:1/595: mkdir db/d1d/dcf 0 2024-02-16T22:19:15.828 INFO:tasks.workunit.client.1.smithi173.stdout:6/497: dwrite d0/db/d2e/d2f/d31/f62 [0,4194304] 0 2024-02-16T22:19:15.828 INFO:tasks.workunit.client.1.smithi173.stdout:0/394: dread d0/d4/fe [0,4194304] 0 2024-02-16T22:19:15.829 INFO:tasks.workunit.client.1.smithi173.stdout:7/417: mkdir d1/d1d/d4c/d63/d13/d22/d7e 0 2024-02-16T22:19:15.831 INFO:tasks.workunit.client.1.smithi173.stdout:1/596: write f9 [2222323,24875] 0 2024-02-16T22:19:15.831 INFO:tasks.workunit.client.1.smithi173.stdout:1/597: readlink db/d1c/l9d 0 2024-02-16T22:19:15.833 INFO:tasks.workunit.client.1.smithi173.stdout:9/403: creat d1/d2/d1a/d2f/d3b/f84 x:0 0 0 2024-02-16T22:19:15.833 INFO:tasks.workunit.client.1.smithi173.stdout:9/404: chown d1/f30 29 1 2024-02-16T22:19:15.833 INFO:tasks.workunit.client.1.smithi173.stdout:4/443: creat d7/d12/f96 x:0 0 0 2024-02-16T22:19:15.833 INFO:tasks.workunit.client.1.smithi173.stdout:4/444: stat d7/d28/c59 0 2024-02-16T22:19:15.836 INFO:tasks.workunit.client.1.smithi173.stdout:6/498: symlink d0/db/d2e/d65/d73/lb5 0 2024-02-16T22:19:15.838 INFO:tasks.workunit.client.1.smithi173.stdout:1/598: unlink db/d5f/l8b 0 2024-02-16T22:19:15.838 INFO:tasks.workunit.client.1.smithi173.stdout:1/599: truncate db/d29/d57/d8c/fb6 350844 0 2024-02-16T22:19:15.840 INFO:tasks.workunit.client.1.smithi173.stdout:9/405: creat d1/d5f/f85 x:0 0 0 2024-02-16T22:19:15.840 INFO:tasks.workunit.client.1.smithi173.stdout:9/406: truncate d1/d2/d1a/d1f/f68 589709 0 2024-02-16T22:19:15.840 INFO:tasks.workunit.client.1.smithi173.stdout:9/407: chown d1/d5f/d6d/l6e 0 1 2024-02-16T22:19:15.843 INFO:tasks.workunit.client.1.smithi173.stdout:7/418: dread d1/d1d/d4c/d63/d13/f26 [0,4194304] 0 2024-02-16T22:19:15.843 INFO:tasks.workunit.client.1.smithi173.stdout:6/499: symlink d0/db/d2e/d2f/d31/d33/lb6 0 2024-02-16T22:19:15.844 INFO:tasks.workunit.client.1.smithi173.stdout:4/445: dread d7/d28/d14/f2a [0,4194304] 0 2024-02-16T22:19:15.844 INFO:tasks.workunit.client.1.smithi173.stdout:4/446: stat d7/df/d62/c7c 0 2024-02-16T22:19:15.845 INFO:tasks.workunit.client.1.smithi173.stdout:9/408: creat d1/d2/d1a/d2f/f86 x:0 0 0 2024-02-16T22:19:15.845 INFO:tasks.workunit.client.1.smithi173.stdout:8/708: dwrite dd/d7c/d7d/d22/d50/f5d [0,4194304] 0 2024-02-16T22:19:15.846 INFO:tasks.workunit.client.1.smithi173.stdout:8/709: write dd/d7c/d7d/d22/d28/f2f [4569018,108449] 0 2024-02-16T22:19:15.846 INFO:tasks.workunit.client.1.smithi173.stdout:8/710: readlink dd/d7c/d7d/d22/d2e/l4d 0 2024-02-16T22:19:15.847 INFO:tasks.workunit.client.1.smithi173.stdout:2/507: truncate d2/dc/d19/d1a/f26 125576 0 2024-02-16T22:19:15.847 INFO:tasks.workunit.client.1.smithi173.stdout:2/508: dread - d2/dc/d19/d1c/f96 zero size 2024-02-16T22:19:15.847 INFO:tasks.workunit.client.1.smithi173.stdout:2/509: chown d2/dc/d19/d69/fa2 472401 1 2024-02-16T22:19:15.848 INFO:tasks.workunit.client.1.smithi173.stdout:6/500: creat d0/db/d2e/d2f/d31/d7a/fb7 x:0 0 0 2024-02-16T22:19:15.853 INFO:tasks.workunit.client.1.smithi173.stdout:7/419: rename d1/d1d/d4c/d63/d13/d36/f4a to d1/d1d/d4c/d63/d13/d36/d49/f7f 0 2024-02-16T22:19:15.856 INFO:tasks.workunit.client.1.smithi173.stdout:2/510: truncate d2/d4/d8/d30/f3b 353348 0 2024-02-16T22:19:15.857 INFO:tasks.workunit.client.1.smithi173.stdout:6/501: mkdir d0/db/d2e/d65/db8 0 2024-02-16T22:19:15.857 INFO:tasks.workunit.client.1.smithi173.stdout:6/502: stat d0/db/d2e/d65 0 2024-02-16T22:19:15.859 INFO:tasks.workunit.client.1.smithi173.stdout:7/420: fsync d1/d1d/d4c/d63/d13/d36/d49/f68 0 2024-02-16T22:19:15.859 INFO:tasks.workunit.client.1.smithi173.stdout:4/447: dread d7/d12/d2d/f44 [0,4194304] 0 2024-02-16T22:19:15.859 INFO:tasks.workunit.client.1.smithi173.stdout:4/448: readlink d7/d12/l51 0 2024-02-16T22:19:15.860 INFO:tasks.workunit.client.1.smithi173.stdout:2/511: mknod d2/d4/d8/ca6 0 2024-02-16T22:19:15.869 INFO:tasks.workunit.client.1.smithi173.stdout:7/421: truncate d1/d1d/d4c/d63/d13/d36/d49/f7f 7060051 0 2024-02-16T22:19:15.870 INFO:tasks.workunit.client.1.smithi173.stdout:1/600: dwrite db/d1c/d25/d45/f90 [0,4194304] 0 2024-02-16T22:19:15.872 INFO:tasks.workunit.client.1.smithi173.stdout:7/422: getdents d1/d1d/d4c/d63 0 2024-02-16T22:19:15.874 INFO:tasks.workunit.client.1.smithi173.stdout:4/449: read d7/d12/d2d/f5c [2878815,82670] 0 2024-02-16T22:19:15.875 INFO:tasks.workunit.client.1.smithi173.stdout:4/450: symlink d7/d28/d31/d72/d93/l97 0 2024-02-16T22:19:15.876 INFO:tasks.workunit.client.1.smithi173.stdout:4/451: creat d7/d28/d31/d33/d7d/f98 x:0 0 0 2024-02-16T22:19:15.877 INFO:tasks.workunit.client.1.smithi173.stdout:4/452: symlink d7/d12/d2d/l99 0 2024-02-16T22:19:15.878 INFO:tasks.workunit.client.1.smithi173.stdout:4/453: write d7/df/f58 [297719,95529] 0 2024-02-16T22:19:15.882 INFO:tasks.workunit.client.1.smithi173.stdout:9/409: dwrite d1/d2/d10/f2e [0,4194304] 0 2024-02-16T22:19:15.885 INFO:tasks.workunit.client.1.smithi173.stdout:6/503: dwrite d0/db/d2e/d2f/d31/d5d/d8c/d92/fb3 [0,4194304] 0 2024-02-16T22:19:15.885 INFO:tasks.workunit.client.1.smithi173.stdout:2/512: dwrite d2/d4/f39 [0,4194304] 0 2024-02-16T22:19:15.885 INFO:tasks.workunit.client.1.smithi173.stdout:2/513: read - d2/d4/d8/d30/f97 zero size 2024-02-16T22:19:15.887 INFO:tasks.workunit.client.1.smithi173.stdout:8/711: dwrite dd/d7c/d7d/d22/d28/f47 [4194304,4194304] 0 2024-02-16T22:19:15.889 INFO:tasks.workunit.client.1.smithi173.stdout:7/423: write d1/d1d/d4c/d63/d13/d36/d49/f35 [1744335,74033] 0 2024-02-16T22:19:15.891 INFO:tasks.workunit.client.1.smithi173.stdout:2/514: unlink d2/d4/d8/d30/f97 0 2024-02-16T22:19:15.891 INFO:tasks.workunit.client.1.smithi173.stdout:2/515: write d2/dc/d19/d1c/f68 [987854,65329] 0 2024-02-16T22:19:15.893 INFO:tasks.workunit.client.1.smithi173.stdout:6/504: link d0/db/d2e/f3c d0/fb9 0 2024-02-16T22:19:15.894 INFO:tasks.workunit.client.1.smithi173.stdout:7/424: mkdir d1/d1d/d4c/d80 0 2024-02-16T22:19:15.894 INFO:tasks.workunit.client.1.smithi173.stdout:9/410: write d1/d2/f13 [3490178,14051] 0 2024-02-16T22:19:15.895 INFO:tasks.workunit.client.1.smithi173.stdout:7/425: write d1/d1d/d4c/d63/d13/d36/f55 [478115,6174] 0 2024-02-16T22:19:15.895 INFO:tasks.workunit.client.1.smithi173.stdout:2/516: creat d2/d4/d8/d80/da1/fa7 x:0 0 0 2024-02-16T22:19:15.896 INFO:tasks.workunit.client.1.smithi173.stdout:6/505: truncate d0/db/d2e/d2f/f4b 2428210 0 2024-02-16T22:19:15.897 INFO:tasks.workunit.client.1.smithi173.stdout:7/426: getdents d1/d1d/d4c/d63/d13/d22/d53 0 2024-02-16T22:19:15.898 INFO:tasks.workunit.client.1.smithi173.stdout:7/427: dread - d1/d1d/d4c/d63/d48/f79 zero size 2024-02-16T22:19:15.899 INFO:tasks.workunit.client.1.smithi173.stdout:8/712: read dd/d7c/d7d/d93/daa/fbd [1107596,72226] 0 2024-02-16T22:19:15.899 INFO:tasks.workunit.client.1.smithi173.stdout:2/517: dread d2/dc/d19/d1c/d53/f7e [0,4194304] 0 2024-02-16T22:19:15.899 INFO:tasks.workunit.client.1.smithi173.stdout:6/506: creat d0/db/d2e/d2f/da6/fba x:0 0 0 2024-02-16T22:19:15.900 INFO:tasks.workunit.client.1.smithi173.stdout:7/428: mkdir d1/d1d/d4c/d63/d11/d39/d81 0 2024-02-16T22:19:15.900 INFO:tasks.workunit.client.1.smithi173.stdout:7/429: stat d1/l1b 0 2024-02-16T22:19:15.901 INFO:tasks.workunit.client.1.smithi173.stdout:9/411: write d1/d2/d1a/f20 [437448,89788] 0 2024-02-16T22:19:15.901 INFO:tasks.workunit.client.1.smithi173.stdout:4/454: dwrite d7/d28/d31/d33/f85 [0,4194304] 0 2024-02-16T22:19:15.902 INFO:tasks.workunit.client.1.smithi173.stdout:8/713: symlink dd/d7c/dcb/dd8/lea 0 2024-02-16T22:19:15.902 INFO:tasks.workunit.client.1.smithi173.stdout:8/714: fsync dd/d7c/d7d/d22/d2e/f71 0 2024-02-16T22:19:15.903 INFO:tasks.workunit.client.1.smithi173.stdout:8/715: write dd/d7c/d7d/f27 [2207147,106013] 0 2024-02-16T22:19:15.904 INFO:tasks.workunit.client.1.smithi173.stdout:2/518: dread d2/d4/d8/d30/f37 [0,4194304] 0 2024-02-16T22:19:15.906 INFO:tasks.workunit.client.1.smithi173.stdout:6/507: rename d0/db/d2e/d2f/d31/d33/f79 to d0/db/d2e/d65/fbb 0 2024-02-16T22:19:15.906 INFO:tasks.workunit.client.1.smithi173.stdout:7/430: creat d1/f82 x:0 0 0 2024-02-16T22:19:15.911 INFO:tasks.workunit.client.1.smithi173.stdout:4/455: mkdir d7/d9a 0 2024-02-16T22:19:15.915 INFO:tasks.workunit.client.1.smithi173.stdout:2/519: mkdir d2/d4/d8/d30/d4d/da8 0 2024-02-16T22:19:15.915 INFO:tasks.workunit.client.1.smithi173.stdout:2/520: chown d2/dc/d19/d1c/d53/d6e 1 1 2024-02-16T22:19:15.915 INFO:tasks.workunit.client.1.smithi173.stdout:2/521: write d2/d4/d8/d80/f9a [602418,1464] 0 2024-02-16T22:19:15.917 INFO:tasks.workunit.client.1.smithi173.stdout:6/508: mknod d0/cbc 0 2024-02-16T22:19:15.917 INFO:tasks.workunit.client.1.smithi173.stdout:6/509: getdents d0/db/d2e/d2f 0 2024-02-16T22:19:15.919 INFO:tasks.workunit.client.1.smithi173.stdout:2/522: mknod d2/dc/d5d/d7a/ca9 0 2024-02-16T22:19:15.919 INFO:tasks.workunit.client.1.smithi173.stdout:2/523: creat d2/d4/d57/faa x:0 0 0 2024-02-16T22:19:15.919 INFO:tasks.workunit.client.1.smithi173.stdout:2/524: stat d2/d10/l7b 0 2024-02-16T22:19:15.919 INFO:tasks.workunit.client.1.smithi173.stdout:2/525: dread - d2/dc/d19/d1c/f96 zero size 2024-02-16T22:19:15.920 INFO:tasks.workunit.client.1.smithi173.stdout:2/526: write d2/f3c [4460205,89721] 0 2024-02-16T22:19:15.920 INFO:tasks.workunit.client.1.smithi173.stdout:2/527: chown d2/dc/d19/d1a/f26 0 1 2024-02-16T22:19:15.920 INFO:tasks.workunit.client.1.smithi173.stdout:7/431: getdents d1/d1d/d44 0 2024-02-16T22:19:15.921 INFO:tasks.workunit.client.1.smithi173.stdout:6/510: creat d0/db/d2e/fbd x:0 0 0 2024-02-16T22:19:15.922 INFO:tasks.workunit.client.1.smithi173.stdout:2/528: dread d2/d4/d8/d30/f45 [0,4194304] 0 2024-02-16T22:19:15.925 INFO:tasks.workunit.client.1.smithi173.stdout:7/432: mknod d1/d1d/d4c/d63/d6c/c83 0 2024-02-16T22:19:15.926 INFO:tasks.workunit.client.1.smithi173.stdout:6/511: symlink d0/db/lbe 0 2024-02-16T22:19:15.929 INFO:tasks.workunit.client.1.smithi173.stdout:2/529: mkdir d2/dc/d19/d69/dab 0 2024-02-16T22:19:15.930 INFO:tasks.workunit.client.1.smithi173.stdout:7/433: mknod d1/d1d/c84 0 2024-02-16T22:19:15.933 INFO:tasks.workunit.client.1.smithi173.stdout:8/716: dwrite dd/d7c/d7d/d22/d5a/f61 [4194304,4194304] 0 2024-02-16T22:19:15.933 INFO:tasks.workunit.client.1.smithi173.stdout:9/412: dwrite d1/d2/d1a/f28 [0,4194304] 0 2024-02-16T22:19:15.938 INFO:tasks.workunit.client.1.smithi173.stdout:2/530: rename d2/dc/d19/d1c/f96 to d2/dc/d19/d69/dab/fac 0 2024-02-16T22:19:15.939 INFO:tasks.workunit.client.1.smithi173.stdout:6/512: dread d0/db/d4d/f5f [0,4194304] 0 2024-02-16T22:19:15.940 INFO:tasks.workunit.client.1.smithi173.stdout:7/434: truncate d1/d1d/d4c/d63/d13/d22/d53/f24 3558980 0 2024-02-16T22:19:15.943 INFO:tasks.workunit.client.1.smithi173.stdout:6/513: creat d0/db/fbf x:0 0 0 2024-02-16T22:19:15.946 INFO:tasks.workunit.client.1.smithi173.stdout:9/413: write d1/d2/d1a/f28 [3674371,85821] 0 2024-02-16T22:19:15.947 INFO:tasks.workunit.client.1.smithi173.stdout:9/414: stat d1/d2/d10/f48 0 2024-02-16T22:19:15.947 INFO:tasks.workunit.client.1.smithi173.stdout:6/514: rename d0/db/d2e/d2f/d31/c51 to d0/d7c/cc0 0 2024-02-16T22:19:15.947 INFO:tasks.workunit.client.1.smithi173.stdout:9/415: write d1/d2/d10/f46 [1681569,12661] 0 2024-02-16T22:19:15.951 INFO:tasks.workunit.client.1.smithi173.stdout:6/515: creat d0/db/d2e/d2f/fc1 x:0 0 0 2024-02-16T22:19:15.952 INFO:tasks.workunit.client.1.smithi173.stdout:2/531: write d2/d4/f1b [5967840,22562] 0 2024-02-16T22:19:15.953 INFO:tasks.workunit.client.1.smithi173.stdout:2/532: fsync d2/dc/d19/f25 0 2024-02-16T22:19:15.954 INFO:tasks.workunit.client.1.smithi173.stdout:9/416: rename d1/d2/d1a/d1f/f68 to d1/d5f/d61/d80/f87 0 2024-02-16T22:19:15.956 INFO:tasks.workunit.client.1.smithi173.stdout:6/516: creat d0/db/d2e/d65/d73/d81/fc2 x:0 0 0 2024-02-16T22:19:15.957 INFO:tasks.workunit.client.1.smithi173.stdout:7/435: dread d1/d1d/d4c/d63/d13/d36/f52 [0,4194304] 0 2024-02-16T22:19:15.957 INFO:tasks.workunit.client.1.smithi173.stdout:7/436: write d1/d1d/f45 [4868870,38267] 0 2024-02-16T22:19:15.958 INFO:tasks.workunit.client.1.smithi173.stdout:2/533: creat d2/d4/d8/d30/d44/fad x:0 0 0 2024-02-16T22:19:15.960 INFO:tasks.workunit.client.1.smithi173.stdout:9/417: mkdir d1/d2/d1a/d1f/d34/d49/d88 0 2024-02-16T22:19:15.961 INFO:tasks.workunit.client.1.smithi173.stdout:2/534: mknod d2/d4/d8/d30/d44/d81/cae 0 2024-02-16T22:19:15.962 INFO:tasks.workunit.client.1.smithi173.stdout:6/517: dread d0/db/d2e/d2f/f4b [0,4194304] 0 2024-02-16T22:19:15.962 INFO:tasks.workunit.client.1.smithi173.stdout:9/418: creat d1/d5f/d61/d80/f89 x:0 0 0 2024-02-16T22:19:15.964 INFO:tasks.workunit.client.1.smithi173.stdout:2/535: mkdir d2/d4/d8/d30/daf 0 2024-02-16T22:19:15.964 INFO:tasks.workunit.client.1.smithi173.stdout:2/536: read - d2/dc/d19/d1c/d87/f8d zero size 2024-02-16T22:19:15.964 INFO:tasks.workunit.client.1.smithi173.stdout:2/537: creat d2/dc/d19/d1c/fb0 x:0 0 0 2024-02-16T22:19:15.965 INFO:tasks.workunit.client.1.smithi173.stdout:6/518: symlink d0/db/d2e/d2f/lc3 0 2024-02-16T22:19:15.965 INFO:tasks.workunit.client.1.smithi173.stdout:6/519: chown d0/db/d2e/d65 7 1 2024-02-16T22:19:15.968 INFO:tasks.workunit.client.1.smithi173.stdout:2/538: creat d2/dc/d19/d1c/d53/fb1 x:0 0 0 2024-02-16T22:19:15.970 INFO:tasks.workunit.client.1.smithi173.stdout:7/437: dread d1/d1d/d4c/d63/d11/f42 [0,4194304] 0 2024-02-16T22:19:15.970 INFO:tasks.workunit.client.1.smithi173.stdout:7/438: chown d1/d1d/d4c/d63/c33 51 1 2024-02-16T22:19:15.970 INFO:tasks.workunit.client.1.smithi173.stdout:7/439: write d1/d1d/d4c/d63/d48/f5d [1660287,46548] 0 2024-02-16T22:19:15.984 INFO:tasks.workunit.client.1.smithi173.stdout:7/440: write d1/d1d/f20 [2469300,123708] 0 2024-02-16T22:19:15.984 INFO:tasks.workunit.client.1.smithi173.stdout:2/539: rmdir d2/d4/d8/d30 39 2024-02-16T22:19:15.985 INFO:tasks.workunit.client.1.smithi173.stdout:2/540: mkdir d2/dc/d19/d1a/d74/db2 0 2024-02-16T22:19:15.985 INFO:tasks.workunit.client.1.smithi173.stdout:2/541: readlink d2/dc/l8e 0 2024-02-16T22:19:15.988 INFO:tasks.workunit.client.1.smithi173.stdout:7/441: dread d1/d1d/d4c/d63/f4 [0,4194304] 0 2024-02-16T22:19:15.988 INFO:tasks.workunit.client.1.smithi173.stdout:7/442: fdatasync d1/f41 0 2024-02-16T22:19:15.989 INFO:tasks.workunit.client.1.smithi173.stdout:9/419: dwrite d1/d2/d1a/f5d [0,4194304] 0 2024-02-16T22:19:15.989 INFO:tasks.workunit.client.1.smithi173.stdout:9/420: read - d1/d2/d1a/d2f/d3b/f84 zero size 2024-02-16T22:19:15.989 INFO:tasks.workunit.client.1.smithi173.stdout:9/421: fdatasync d1/d2/d1a/d1f/f81 0 2024-02-16T22:19:15.992 INFO:tasks.workunit.client.1.smithi173.stdout:6/520: dwrite d0/db/d2e/d2f/d31/f35 [0,4194304] 0 2024-02-16T22:19:15.992 INFO:tasks.workunit.client.1.smithi173.stdout:6/521: write d0/db/d2e/d65/fbb [3578797,77368] 0 2024-02-16T22:19:15.994 INFO:tasks.workunit.client.1.smithi173.stdout:9/422: creat d1/d5f/d6d/f8a x:0 0 0 2024-02-16T22:19:15.999 INFO:tasks.workunit.client.1.smithi173.stdout:6/522: truncate d0/fb9 2364004 0 2024-02-16T22:19:16.002 INFO:tasks.workunit.client.1.smithi173.stdout:9/423: dread d1/d2/d1a/d1f/f81 [0,4194304] 0 2024-02-16T22:19:16.003 INFO:tasks.workunit.client.1.smithi173.stdout:9/424: mkdir d1/d2/d1a/d8b 0 2024-02-16T22:19:16.005 INFO:tasks.workunit.client.1.smithi173.stdout:9/425: mkdir d1/d2/d1a/d3e/d4f/d8c 0 2024-02-16T22:19:16.006 INFO:tasks.workunit.client.1.smithi173.stdout:9/426: mknod d1/c8d 0 2024-02-16T22:19:16.006 INFO:tasks.workunit.client.1.smithi173.stdout:9/427: creat d1/d2/d1a/d2f/f8e x:0 0 0 2024-02-16T22:19:16.033 INFO:tasks.workunit.client.1.smithi173.stdout:9/428: dwrite d1/d2/d10/f59 [0,4194304] 0 2024-02-16T22:19:16.033 INFO:tasks.workunit.client.1.smithi173.stdout:7/443: dwrite d1/d1d/d4c/d63/ff [0,4194304] 0 2024-02-16T22:19:16.033 INFO:tasks.workunit.client.1.smithi173.stdout:9/429: truncate d1/d2/d1a/d2f/d3b/f72 315346 0 2024-02-16T22:19:16.033 INFO:tasks.workunit.client.1.smithi173.stdout:9/430: chown d1/f18 50 1 2024-02-16T22:19:16.033 INFO:tasks.workunit.client.1.smithi173.stdout:7/444: truncate d1/d1d/d4c/d63/d13/d36/f4d 2303209 0 2024-02-16T22:19:16.033 INFO:tasks.workunit.client.1.smithi173.stdout:9/431: write d1/d5f/f85 [700617,69874] 0 2024-02-16T22:19:16.033 INFO:tasks.workunit.client.1.smithi173.stdout:2/542: dwrite d2/d4/d8/d30/f37 [0,4194304] 0 2024-02-16T22:19:16.034 INFO:tasks.workunit.client.1.smithi173.stdout:6/523: dwrite d0/db/d2e/f54 [0,4194304] 0 2024-02-16T22:19:16.039 INFO:tasks.workunit.client.1.smithi173.stdout:2/543: rename d2/d4/f1b to d2/dc/d19/d1a/fb3 0 2024-02-16T22:19:16.039 INFO:tasks.workunit.client.1.smithi173.stdout:2/544: chown d2/d4/f59 25090503 1 2024-02-16T22:19:16.042 INFO:tasks.workunit.client.1.smithi173.stdout:6/524: mkdir d0/db/d2e/d65/d67/dc4 0 2024-02-16T22:19:16.055 INFO:tasks.workunit.client.1.smithi173.stdout:9/432: dwrite d1/d2/d1a/f2b [4194304,4194304] 0 2024-02-16T22:19:16.055 INFO:tasks.workunit.client.1.smithi173.stdout:9/433: write d1/f23 [1311073,76218] 0 2024-02-16T22:19:16.059 INFO:tasks.workunit.client.1.smithi173.stdout:7/445: rmdir d1/d1d/d4c/d63/d13/d22/d53/d27 39 2024-02-16T22:19:16.061 INFO:tasks.workunit.client.1.smithi173.stdout:6/525: rename d0/db/d2e/d2f/d31/d5d/d8c to d0/d7c/dc5 0 2024-02-16T22:19:16.062 INFO:tasks.workunit.client.1.smithi173.stdout:7/446: truncate d1/d1d/d4c/d63/d13/d36/d49/f74 407073 0 2024-02-16T22:19:16.064 INFO:tasks.workunit.client.1.smithi173.stdout:2/545: getdents d2/d4/d57 0 2024-02-16T22:19:16.066 INFO:tasks.workunit.client.1.smithi173.stdout:6/526: getdents d0/db/d2e/d2f/d31/d33/d97 0 2024-02-16T22:19:16.067 INFO:tasks.workunit.client.1.smithi173.stdout:7/447: rmdir d1/d1d/d4c/d63/d11 39 2024-02-16T22:19:16.067 INFO:tasks.workunit.client.1.smithi173.stdout:7/448: stat d1/d1d/d4c/d63/d13/d36/l3a 0 2024-02-16T22:19:16.071 INFO:tasks.workunit.client.1.smithi173.stdout:7/449: rename d1/d1d/d4c/d63/d13/d36/d49/f35 to d1/d1d/d4c/d63/d13/d22/d53/f85 0 2024-02-16T22:19:16.071 INFO:tasks.workunit.client.1.smithi173.stdout:9/434: write d1/f12 [3403577,67929] 0 2024-02-16T22:19:16.077 INFO:tasks.workunit.client.1.smithi173.stdout:7/450: creat d1/d1d/d4c/d63/d13/d36/d49/f86 x:0 0 0 2024-02-16T22:19:16.077 INFO:tasks.workunit.client.1.smithi173.stdout:9/435: getdents d1/d2/d1a/d1f/d34/d49 0 2024-02-16T22:19:16.079 INFO:tasks.workunit.client.1.smithi173.stdout:7/451: creat d1/d1d/d4c/d63/d13/d36/f87 x:0 0 0 2024-02-16T22:19:16.081 INFO:tasks.workunit.client.1.smithi173.stdout:9/436: symlink d1/d2/d1a/d1f/d34/d49/l8f 0 2024-02-16T22:19:16.081 INFO:tasks.workunit.client.1.smithi173.stdout:9/437: chown d1/d2/d1a/d2f/d51 1995004 1 2024-02-16T22:19:16.081 INFO:tasks.workunit.client.1.smithi173.stdout:9/438: chown d1/d2/d1a/d2f/d3b/f84 419801 1 2024-02-16T22:19:16.082 INFO:tasks.workunit.client.1.smithi173.stdout:7/452: symlink d1/d1d/l88 0 2024-02-16T22:19:16.082 INFO:tasks.workunit.client.1.smithi173.stdout:7/453: dread - d1/d1d/d4c/d63/d48/f79 zero size 2024-02-16T22:19:16.083 INFO:tasks.workunit.client.1.smithi173.stdout:9/439: creat d1/d2/d1a/d2f/d3b/d75/f90 x:0 0 0 2024-02-16T22:19:16.084 INFO:tasks.workunit.client.1.smithi173.stdout:7/454: unlink d1/d1d/f1e 0 2024-02-16T22:19:16.085 INFO:tasks.workunit.client.1.smithi173.stdout:7/455: truncate d1/d1d/d4c/d63/d48/f5d 1306318 0 2024-02-16T22:19:16.086 INFO:tasks.workunit.client.1.smithi173.stdout:7/456: symlink d1/d1d/d4c/d63/l89 0 2024-02-16T22:19:16.087 INFO:tasks.workunit.client.1.smithi173.stdout:7/457: link d1/d1d/d4c/d63/d48/l7b d1/d1d/d4c/d63/d11/l8a 0 2024-02-16T22:19:16.098 INFO:tasks.workunit.client.1.smithi173.stdout:6/527: dwrite d0/f11 [0,4194304] 0 2024-02-16T22:19:16.101 INFO:tasks.workunit.client.1.smithi173.stdout:2/546: dwrite d2/d4/f59 [0,4194304] 0 2024-02-16T22:19:16.101 INFO:tasks.workunit.client.1.smithi173.stdout:2/547: fsync d2/dc/d19/d1a/f26 0 2024-02-16T22:19:16.101 INFO:tasks.workunit.client.1.smithi173.stdout:9/440: dread d1/d2/d1a/f2b [4194304,4194304] 0 2024-02-16T22:19:16.103 INFO:tasks.workunit.client.1.smithi173.stdout:9/441: getdents d1/d2/d10 0 2024-02-16T22:19:16.103 INFO:tasks.workunit.client.1.smithi173.stdout:9/442: chown d1/d2/d1a/d3e/d4f/f6a 59570165 1 2024-02-16T22:19:16.107 INFO:tasks.workunit.client.1.smithi173.stdout:7/458: dwrite d1/d1d/d4c/d63/d48/f75 [0,4194304] 0 2024-02-16T22:19:16.113 INFO:tasks.workunit.client.1.smithi173.stdout:6/528: dread d0/db/d2e/f37 [0,4194304] 0 2024-02-16T22:19:16.113 INFO:tasks.workunit.client.1.smithi173.stdout:7/459: symlink d1/l8b 0 2024-02-16T22:19:16.131 INFO:tasks.workunit.client.1.smithi173.stdout:7/460: rmdir d1/d1d/d4c/d63/d13/d22/d53 39 2024-02-16T22:19:16.132 INFO:tasks.workunit.client.1.smithi173.stdout:7/461: rmdir d1/d1d/d44 39 2024-02-16T22:19:16.134 INFO:tasks.workunit.client.1.smithi173.stdout:7/462: dread - d1/d1d/d4c/d63/d13/d36/d49/f6f zero size 2024-02-16T22:19:16.134 INFO:tasks.workunit.client.1.smithi173.stdout:7/463: chown d1/d1d/d44/f60 1813639 1 2024-02-16T22:19:16.134 INFO:tasks.workunit.client.1.smithi173.stdout:7/464: symlink d1/d1d/l8c 0 2024-02-16T22:19:16.138 INFO:tasks.workunit.client.1.smithi173.stdout:2/548: dwrite d2/d4/d57/faa [0,4194304] 0 2024-02-16T22:19:16.144 INFO:tasks.workunit.client.1.smithi173.stdout:2/549: dread d2/dc/d19/f16 [0,4194304] 0 2024-02-16T22:19:16.149 INFO:tasks.workunit.client.1.smithi173.stdout:9/443: dwrite d1/d2/d1a/d1f/f2c [0,4194304] 0 2024-02-16T22:19:16.177 INFO:tasks.workunit.client.1.smithi173.stdout:2/550: dwrite d2/dc/d5d/f15 [0,4194304] 0 2024-02-16T22:19:16.177 INFO:tasks.workunit.client.1.smithi173.stdout:2/551: fdatasync d2/d4/d8/d30/f45 0 2024-02-16T22:19:16.177 INFO:tasks.workunit.client.1.smithi173.stdout:9/444: dwrite d1/d2/d1a/d1f/d34/f5b [0,4194304] 0 2024-02-16T22:19:16.177 INFO:tasks.workunit.client.1.smithi173.stdout:9/445: getdents d1/d2/d1a/d8b 0 2024-02-16T22:19:16.178 INFO:tasks.workunit.client.1.smithi173.stdout:7/465: dwrite d1/d1d/d4c/d63/d13/d22/d53/f24 [0,4194304] 0 2024-02-16T22:19:16.178 INFO:tasks.workunit.client.1.smithi173.stdout:9/446: fdatasync d1/d2/d1a/d3e/f69 0 2024-02-16T22:19:16.178 INFO:tasks.workunit.client.1.smithi173.stdout:9/447: chown d1/d2/d1a/d2f/d3b/c5c 56111 1 2024-02-16T22:19:16.180 INFO:tasks.workunit.client.1.smithi173.stdout:7/466: stat d1/d1d/d4c/d63/d13/d22/d53/d27/c30 0 2024-02-16T22:19:16.180 INFO:tasks.workunit.client.1.smithi173.stdout:7/467: rmdir d1/d1d/d4c/d63/d11 39 2024-02-16T22:19:16.181 INFO:tasks.workunit.client.1.smithi173.stdout:7/468: fdatasync d1/d1d/d4c/d63/d11/f14 0 2024-02-16T22:19:16.182 INFO:tasks.workunit.client.1.smithi173.stdout:7/469: truncate d1/d1d/d4c/d63/d13/d22/d53/f85 4187391 0 2024-02-16T22:19:16.182 INFO:tasks.workunit.client.1.smithi173.stdout:7/470: write d1/d1d/d4c/d63/d13/d36/f38 [1023592,50446] 0 2024-02-16T22:19:16.182 INFO:tasks.workunit.client.1.smithi173.stdout:7/471: write d1/d1d/d4c/d63/d13/d36/d49/f7f [734885,109492] 0 2024-02-16T22:19:16.189 INFO:tasks.workunit.client.1.smithi173.stdout:2/552: read d2/dc/d5d/f15 [693886,51335] 0 2024-02-16T22:19:16.189 INFO:tasks.workunit.client.1.smithi173.stdout:2/553: truncate d2/dc/d5d/d7a/f8f 836163 0 2024-02-16T22:19:16.189 INFO:tasks.workunit.client.1.smithi173.stdout:2/554: write d2/d4/d8/d30/f45 [651645,33988] 0 2024-02-16T22:19:16.190 INFO:tasks.workunit.client.1.smithi173.stdout:2/555: creat d2/dc/d19/d1a/d74/db2/fb4 x:0 0 0 2024-02-16T22:19:16.190 INFO:tasks.workunit.client.1.smithi173.stdout:2/556: truncate d2/d4/d8/d30/d44/fad 612846 0 2024-02-16T22:19:16.194 INFO:tasks.workunit.client.1.smithi173.stdout:2/557: dread d2/d10/d62/f78 [0,4194304] 0 2024-02-16T22:19:16.194 INFO:tasks.workunit.client.1.smithi173.stdout:2/558: symlink d2/dc/lb5 0 2024-02-16T22:19:16.195 INFO:tasks.workunit.client.1.smithi173.stdout:2/559: symlink d2/d10/lb6 0 2024-02-16T22:19:16.202 INFO:tasks.workunit.client.1.smithi173.stdout:9/448: dwrite d1/d2/d10/f60 [0,4194304] 0 2024-02-16T22:19:16.202 INFO:tasks.workunit.client.1.smithi173.stdout:7/472: dwrite d1/d1d/d4c/d63/d13/d36/d49/f6d [0,4194304] 0 2024-02-16T22:19:16.204 INFO:tasks.workunit.client.1.smithi173.stdout:9/449: mkdir d1/d5f/d6d/d91 0 2024-02-16T22:19:16.206 INFO:tasks.workunit.client.1.smithi173.stdout:9/450: mkdir d1/d2/d1a/d3e/d4f/d8c/d92 0 2024-02-16T22:19:16.207 INFO:tasks.workunit.client.1.smithi173.stdout:9/451: mknod d1/d2/d1a/d3e/d4f/d8c/c93 0 2024-02-16T22:19:16.207 INFO:tasks.workunit.client.1.smithi173.stdout:9/452: stat d1/d2/d10/f63 0 2024-02-16T22:19:16.207 INFO:tasks.workunit.client.1.smithi173.stdout:9/453: write d1/d2/d1a/d1f/f43 [3656227,121681] 0 2024-02-16T22:19:16.207 INFO:tasks.workunit.client.1.smithi173.stdout:9/454: chown d1/f18 148 1 2024-02-16T22:19:16.207 INFO:tasks.workunit.client.1.smithi173.stdout:9/455: creat d1/d5f/f94 x:0 0 0 2024-02-16T22:19:16.210 INFO:tasks.workunit.client.1.smithi173.stdout:9/456: link d1/d2/d1a/f20 d1/d2/d1a/f95 0 2024-02-16T22:19:16.211 INFO:tasks.workunit.client.1.smithi173.stdout:9/457: mkdir d1/d2/d1a/d2f/d51/d96 0 2024-02-16T22:19:16.211 INFO:tasks.workunit.client.1.smithi173.stdout:9/458: read d1/f30 [906373,15241] 0 2024-02-16T22:19:16.211 INFO:tasks.workunit.client.1.smithi173.stdout:2/560: dwrite d2/d4/f4c [0,4194304] 0 2024-02-16T22:19:16.211 INFO:tasks.workunit.client.1.smithi173.stdout:2/561: chown d2/d4/d8/d30/f37 22 1 2024-02-16T22:19:16.212 INFO:tasks.workunit.client.1.smithi173.stdout:9/459: mkdir d1/d5f/d6d/d97 0 2024-02-16T22:19:16.214 INFO:tasks.workunit.client.1.smithi173.stdout:2/562: symlink d2/dc/d19/d1a/lb7 0 2024-02-16T22:19:16.214 INFO:tasks.workunit.client.1.smithi173.stdout:2/563: truncate d2/dc/d5d/f24 441852 0 2024-02-16T22:19:16.215 INFO:tasks.workunit.client.1.smithi173.stdout:2/564: write d2/dc/d19/d1c/d87/f8a [561529,115567] 0 2024-02-16T22:19:16.215 INFO:tasks.workunit.client.1.smithi173.stdout:2/565: chown d2/d4/d8/d30/f38 20825 1 2024-02-16T22:19:16.215 INFO:tasks.workunit.client.1.smithi173.stdout:9/460: symlink d1/d2/d10/l98 0 2024-02-16T22:19:16.215 INFO:tasks.workunit.client.1.smithi173.stdout:9/461: read - d1/d2/d1a/f71 zero size 2024-02-16T22:19:16.216 INFO:tasks.workunit.client.1.smithi173.stdout:2/566: creat d2/d4/d8/d2d/fb8 x:0 0 0 2024-02-16T22:19:16.217 INFO:tasks.workunit.client.1.smithi173.stdout:7/473: dwrite d1/d1d/d4c/d63/d6c/f77 [0,4194304] 0 2024-02-16T22:19:16.217 INFO:tasks.workunit.client.1.smithi173.stdout:7/474: getdents d1/d1d/d4c/d80 0 2024-02-16T22:19:16.218 INFO:tasks.workunit.client.1.smithi173.stdout:9/462: rename d1/d2/d1a/d1f/c4a to d1/d5f/c99 0 2024-02-16T22:19:16.218 INFO:tasks.workunit.client.1.smithi173.stdout:9/463: fdatasync d1/d2/d10/f48 0 2024-02-16T22:19:16.220 INFO:tasks.workunit.client.1.smithi173.stdout:2/567: unlink d2/l3 0 2024-02-16T22:19:16.224 INFO:tasks.workunit.client.1.smithi173.stdout:2/568: symlink d2/dc/d19/da3/da4/lb9 0 2024-02-16T22:19:16.224 INFO:tasks.workunit.client.1.smithi173.stdout:2/569: creat d2/d4/d8/d2d/fba x:0 0 0 2024-02-16T22:19:16.226 INFO:tasks.workunit.client.1.smithi173.stdout:2/570: write d2/dc/d19/d1c/f20 [2823350,36157] 0 2024-02-16T22:19:16.228 INFO:tasks.workunit.client.1.smithi173.stdout:2/571: rename d2/dc/d19/d1a/l40 to d2/lbb 0 2024-02-16T22:19:16.228 INFO:tasks.workunit.client.1.smithi173.stdout:2/572: chown d2/dc/d19/d69 3123495 1 2024-02-16T22:19:16.229 INFO:tasks.workunit.client.1.smithi173.stdout:7/475: write d1/d1d/d4c/d63/d13/d22/d53/f24 [2461638,80426] 0 2024-02-16T22:19:16.230 INFO:tasks.workunit.client.1.smithi173.stdout:7/476: stat d1/d1d/d4c/d63/d11/l4f 0 2024-02-16T22:19:16.231 INFO:tasks.workunit.client.1.smithi173.stdout:7/477: fsync d1/d1d/d4c/d63/d13/d36/f4d 0 2024-02-16T22:19:16.232 INFO:tasks.workunit.client.1.smithi173.stdout:7/478: creat d1/d1d/d4c/d63/d13/d22/d53/d27/f8d x:0 0 0 2024-02-16T22:19:16.233 INFO:tasks.workunit.client.1.smithi173.stdout:7/479: chown d1/d1d/d4c/d63/d13/d22 1 1 2024-02-16T22:19:16.233 INFO:tasks.workunit.client.1.smithi173.stdout:7/480: creat d1/d1d/d4c/d63/d48/f8e x:0 0 0 2024-02-16T22:19:16.235 INFO:tasks.workunit.client.1.smithi173.stdout:9/464: dwrite d1/f30 [0,4194304] 0 2024-02-16T22:19:16.236 INFO:tasks.workunit.client.1.smithi173.stdout:9/465: fdatasync d1/d2/d1a/d3e/d4f/f6a 0 2024-02-16T22:19:16.236 INFO:tasks.workunit.client.1.smithi173.stdout:9/466: write d1/d2/d1a/f95 [800973,85971] 0 2024-02-16T22:19:16.238 INFO:tasks.workunit.client.1.smithi173.stdout:9/467: dread d1/d2/d1a/d3e/f69 [4194304,4194304] 0 2024-02-16T22:19:16.239 INFO:tasks.workunit.client.1.smithi173.stdout:9/468: mknod d1/d2/d1a/d2f/d51/d96/c9a 0 2024-02-16T22:19:16.242 INFO:tasks.workunit.client.1.smithi173.stdout:2/573: write d2/dc/d19/f25 [3733157,94764] 0 2024-02-16T22:19:16.242 INFO:tasks.workunit.client.1.smithi173.stdout:2/574: truncate d2/d4/d8/d30/f3b 704297 0 2024-02-16T22:19:16.260 INFO:tasks.workunit.client.1.smithi173.stdout:7/481: dwrite d1/d1d/d4c/d63/d13/d22/d53/f24 [0,4194304] 0 2024-02-16T22:19:16.261 INFO:tasks.workunit.client.1.smithi173.stdout:7/482: creat d1/d1d/d4c/d63/d11/d39/d81/f8f x:0 0 0 2024-02-16T22:19:16.262 INFO:tasks.workunit.client.1.smithi173.stdout:7/483: dread - d1/f41 zero size 2024-02-16T22:19:16.263 INFO:tasks.workunit.client.1.smithi173.stdout:9/469: dwrite d1/d2/d10/f48 [4194304,4194304] 0 2024-02-16T22:19:16.269 INFO:tasks.workunit.client.1.smithi173.stdout:7/484: dread d1/d1d/d4c/d63/d13/d36/d49/f68 [0,4194304] 0 2024-02-16T22:19:16.270 INFO:tasks.workunit.client.1.smithi173.stdout:7/485: mknod d1/d1d/d4c/c90 0 2024-02-16T22:19:16.270 INFO:tasks.workunit.client.1.smithi173.stdout:7/486: write d1/d1d/d4c/d63/d13/d22/d53/d27/f73 [697112,944] 0 2024-02-16T22:19:16.278 INFO:tasks.workunit.client.1.smithi173.stdout:7/487: write d1/d1d/f45 [2737825,98000] 0 2024-02-16T22:19:16.278 INFO:tasks.workunit.client.1.smithi173.stdout:7/488: dread - d1/d1d/d4c/d63/d48/f79 zero size 2024-02-16T22:19:16.280 INFO:tasks.workunit.client.1.smithi173.stdout:7/489: rename d1/d1d/d4c/d63/d11/d39 to d1/d1d/d4c/d91 0 2024-02-16T22:19:16.281 INFO:tasks.workunit.client.1.smithi173.stdout:7/490: rmdir d1/d1d/d4c/d63/d13/d22/d53 39 2024-02-16T22:19:16.282 INFO:tasks.workunit.client.1.smithi173.stdout:7/491: creat d1/d1d/d4c/d63/d13/d22/f92 x:0 0 0 2024-02-16T22:19:16.283 INFO:tasks.workunit.client.1.smithi173.stdout:9/470: dwrite d1/d2/d1a/d2f/f50 [0,4194304] 0 2024-02-16T22:19:16.283 INFO:tasks.workunit.client.1.smithi173.stdout:7/492: link d1/d1d/d4c/d63/d13/d22/d53/d27/f65 d1/d1d/f93 0 2024-02-16T22:19:16.285 INFO:tasks.workunit.client.1.smithi173.stdout:9/471: creat d1/d2/d1a/d2f/d51/d96/f9b x:0 0 0 2024-02-16T22:19:16.286 INFO:tasks.workunit.client.1.smithi173.stdout:9/472: symlink d1/d2/d1a/d8b/l9c 0 2024-02-16T22:19:16.286 INFO:tasks.workunit.client.1.smithi173.stdout:9/473: write d1/d5f/d61/d80/f66 [785129,25752] 0 2024-02-16T22:19:16.287 INFO:tasks.workunit.client.1.smithi173.stdout:9/474: readlink d1/d2/d10/l1d 0 2024-02-16T22:19:16.287 INFO:tasks.workunit.client.1.smithi173.stdout:7/493: rmdir d1/d1d/d4c/d63/d6c 39 2024-02-16T22:19:16.288 INFO:tasks.workunit.client.1.smithi173.stdout:9/475: creat d1/d2/d1a/d3e/d4f/d8c/f9d x:0 0 0 2024-02-16T22:19:16.289 INFO:tasks.workunit.client.1.smithi173.stdout:9/476: link d1/d2/d1a/d2f/d51/d96/c9a d1/d2/d10/c9e 0 2024-02-16T22:19:16.290 INFO:tasks.workunit.client.1.smithi173.stdout:9/477: unlink d1/c8d 0 2024-02-16T22:19:16.325 INFO:tasks.workunit.client.1.smithi173.stdout:7/494: read d1/d1d/d4c/d63/d13/d22/d53/d27/f65 [116002,105123] 0 2024-02-16T22:19:16.326 INFO:tasks.workunit.client.1.smithi173.stdout:7/495: rmdir d1/d1d/d4c/d63 39 2024-02-16T22:19:16.328 INFO:tasks.workunit.client.1.smithi173.stdout:7/496: rmdir d1/d1d/d4c/d91 39 2024-02-16T22:19:16.329 INFO:tasks.workunit.client.1.smithi173.stdout:7/497: fdatasync d1/d1d/d4c/d63/d54/f78 0 2024-02-16T22:19:16.329 INFO:tasks.workunit.client.1.smithi173.stdout:7/498: write d1/d1d/d4c/d63/d13/d36/d49/f86 [347025,90910] 0 2024-02-16T22:19:16.330 INFO:tasks.workunit.client.1.smithi173.stdout:7/499: dread d1/d1d/d4c/d63/f4 [0,4194304] 0 2024-02-16T22:19:16.330 INFO:tasks.workunit.client.1.smithi173.stdout:7/500: read - d1/d1d/d4c/d63/d13/d36/f87 zero size 2024-02-16T22:19:16.330 INFO:tasks.workunit.client.1.smithi173.stdout:7/501: chown d1/d1d/d4c/d63/d13/d22/l4b 30 1 2024-02-16T22:19:16.334 INFO:tasks.workunit.client.1.smithi173.stdout:9/478: dwrite d1/d5f/f94 [0,4194304] 0 2024-02-16T22:19:16.338 INFO:tasks.workunit.client.1.smithi173.stdout:9/479: rename d1/d2/d1a/d2f/c62 to d1/d2/d1a/d2f/d51/c9f 0 2024-02-16T22:19:16.338 INFO:tasks.workunit.client.1.smithi173.stdout:9/480: fdatasync d1/d2/d1a/d1f/d34/f55 0 2024-02-16T22:19:16.344 INFO:tasks.workunit.client.1.smithi173.stdout:6/529: dread d0/db/f1a [0,4194304] 0 2024-02-16T22:19:16.351 INFO:tasks.workunit.client.1.smithi173.stdout:6/530: mknod d0/d7c/cc6 0 2024-02-16T22:19:16.351 INFO:tasks.workunit.client.1.smithi173.stdout:6/531: creat d0/db/d2e/d2f/d31/fc7 x:0 0 0 2024-02-16T22:19:16.356 INFO:tasks.workunit.client.1.smithi173.stdout:9/481: dwrite d1/d2/d10/f48 [0,4194304] 0 2024-02-16T22:19:16.357 INFO:tasks.workunit.client.1.smithi173.stdout:6/532: read d0/db/f3d [2992412,50271] 0 2024-02-16T22:19:16.358 INFO:tasks.workunit.client.1.smithi173.stdout:9/482: rename d1/d2/d1a/f71 to d1/d5f/d6d/d91/fa0 0 2024-02-16T22:19:16.359 INFO:tasks.workunit.client.1.smithi173.stdout:6/533: creat d0/d7c/dc5/d92/fc8 x:0 0 0 2024-02-16T22:19:16.359 INFO:tasks.workunit.client.1.smithi173.stdout:5/559: sync 2024-02-16T22:19:16.359 INFO:tasks.workunit.client.1.smithi173.stdout:3/630: sync 2024-02-16T22:19:16.360 INFO:tasks.workunit.client.1.smithi173.stdout:3/631: fsync d9/d1a/f8e 0 2024-02-16T22:19:16.360 INFO:tasks.workunit.client.1.smithi173.stdout:9/483: rmdir d1/d2/d1a/d3e/d4f 39 2024-02-16T22:19:16.360 INFO:tasks.workunit.client.1.smithi173.stdout:5/560: mkdir d8/da/db0 0 2024-02-16T22:19:16.360 INFO:tasks.workunit.client.1.smithi173.stdout:5/561: fdatasync d8/fd 0 2024-02-16T22:19:16.361 INFO:tasks.workunit.client.1.smithi173.stdout:3/632: symlink d9/d18/daa/ld8 0 2024-02-16T22:19:16.361 INFO:tasks.workunit.client.1.smithi173.stdout:9/484: creat d1/d5f/d61/fa1 x:0 0 0 2024-02-16T22:19:16.362 INFO:tasks.workunit.client.1.smithi173.stdout:5/562: unlink d8/d27/d63/l69 0 2024-02-16T22:19:16.362 INFO:tasks.workunit.client.1.smithi173.stdout:5/563: write d8/da/d1b/f52 [1902365,55298] 0 2024-02-16T22:19:16.362 INFO:tasks.workunit.client.1.smithi173.stdout:3/633: dread d9/d1a/d2b/d4d/d5b/f7d [0,4194304] 0 2024-02-16T22:19:16.363 INFO:tasks.workunit.client.1.smithi173.stdout:5/564: rmdir d8/da/d1f/d6f/d91 39 2024-02-16T22:19:16.363 INFO:tasks.workunit.client.1.smithi173.stdout:5/565: dread - d8/da/d1f/d8c/f98 zero size 2024-02-16T22:19:16.363 INFO:tasks.workunit.client.1.smithi173.stdout:5/566: creat d8/da/d1f/d8c/fb1 x:0 0 0 2024-02-16T22:19:16.365 INFO:tasks.workunit.client.1.smithi173.stdout:3/634: rmdir d9/d18/da3 39 2024-02-16T22:19:16.365 INFO:tasks.workunit.client.1.smithi173.stdout:3/635: truncate d9/d18/d5f/fd7 341110 0 2024-02-16T22:19:16.365 INFO:tasks.workunit.client.1.smithi173.stdout:3/636: dread - d9/d1a/d2b/d4d/d5b/da9/faf zero size 2024-02-16T22:19:16.366 INFO:tasks.workunit.client.1.smithi173.stdout:3/637: creat d9/d18/d5f/d6e/da7/fd9 x:0 0 0 2024-02-16T22:19:16.367 INFO:tasks.workunit.client.1.smithi173.stdout:3/638: mknod d9/d18/d73/db7/d7a/cda 0 2024-02-16T22:19:16.368 INFO:tasks.workunit.client.1.smithi173.stdout:3/639: creat d9/d1a/d2b/d4d/d5b/da9/db4/fdb x:0 0 0 2024-02-16T22:19:16.370 INFO:tasks.workunit.client.1.smithi173.stdout:3/640: dread d9/d17/d25/f4a [0,4194304] 0 2024-02-16T22:19:16.372 INFO:tasks.workunit.client.1.smithi173.stdout:3/641: mkdir d9/d17/d25/ddc 0 2024-02-16T22:19:16.373 INFO:tasks.workunit.client.1.smithi173.stdout:3/642: link d9/da/f15 d9/d1a/d2b/d45/d51/fdd 0 2024-02-16T22:19:16.373 INFO:tasks.workunit.client.1.smithi173.stdout:5/567: read d8/d27/d35/f44 [2918101,53060] 0 2024-02-16T22:19:16.374 INFO:tasks.workunit.client.1.smithi173.stdout:5/568: getdents d8/d27/d28 0 2024-02-16T22:19:16.374 INFO:tasks.workunit.client.1.smithi173.stdout:5/569: dread - d8/da/d1b/faa zero size 2024-02-16T22:19:16.375 INFO:tasks.workunit.client.1.smithi173.stdout:5/570: rmdir d8/d27/d35/d8b 39 2024-02-16T22:19:16.377 INFO:tasks.workunit.client.1.smithi173.stdout:5/571: unlink d8/da/d2d/d3a/c4d 0 2024-02-16T22:19:16.377 INFO:tasks.workunit.client.1.smithi173.stdout:5/572: fdatasync d8/f2e 0 2024-02-16T22:19:16.377 INFO:tasks.workunit.client.1.smithi173.stdout:5/573: read d8/da/d2d/d36/f3d [3372024,111105] 0 2024-02-16T22:19:16.378 INFO:tasks.workunit.client.1.smithi173.stdout:5/574: link d8/da/f47 d8/da/d2d/d36/fb2 0 2024-02-16T22:19:16.379 INFO:tasks.workunit.client.1.smithi173.stdout:5/575: mkdir d8/d27/d2f/db3 0 2024-02-16T22:19:16.379 INFO:tasks.workunit.client.1.smithi173.stdout:5/576: fdatasync f7 0 2024-02-16T22:19:16.386 INFO:tasks.workunit.client.1.smithi173.stdout:5/577: write d8/da/d2d/d36/d50/f9a [1318036,82477] 0 2024-02-16T22:19:16.387 INFO:tasks.workunit.client.1.smithi173.stdout:5/578: symlink d8/da/d1f/d33/d92/lb4 0 2024-02-16T22:19:16.455 INFO:tasks.workunit.client.1.smithi173.stdout:6/534: dread d0/db/d2e/d2f/f82 [0,4194304] 0 2024-02-16T22:19:16.457 INFO:tasks.workunit.client.1.smithi173.stdout:6/535: mknod d0/db/d2e/d65/d73/d7d/cc9 0 2024-02-16T22:19:16.457 INFO:tasks.workunit.client.1.smithi173.stdout:6/536: fdatasync d0/db/d2e/f3c 0 2024-02-16T22:19:16.458 INFO:tasks.workunit.client.1.smithi173.stdout:6/537: creat d0/db/d2e/d65/db8/fca x:0 0 0 2024-02-16T22:19:16.460 INFO:tasks.workunit.client.1.smithi173.stdout:6/538: symlink d0/db/d4d/lcb 0 2024-02-16T22:19:16.463 INFO:tasks.workunit.client.1.smithi173.stdout:6/539: rmdir d0/db/d2e/d65/d67/dc4 0 2024-02-16T22:19:16.463 INFO:tasks.workunit.client.1.smithi173.stdout:6/540: chown d0/db/d2e/d61/f8a 155 1 2024-02-16T22:19:16.463 INFO:tasks.workunit.client.1.smithi173.stdout:6/541: write d0/db/d2e/d2f/d31/d33/fab [76698,37540] 0 2024-02-16T22:19:16.463 INFO:tasks.workunit.client.1.smithi173.stdout:6/542: write d0/db/d2e/f88 [850550,53910] 0 2024-02-16T22:19:16.463 INFO:tasks.workunit.client.1.smithi173.stdout:6/543: chown d0/d7c/dc5/d9b 385786 1 2024-02-16T22:19:16.464 INFO:tasks.workunit.client.1.smithi173.stdout:6/544: unlink d0/fa 0 2024-02-16T22:19:16.465 INFO:tasks.workunit.client.1.smithi173.stdout:6/545: unlink d0/db/d2e/d61/f6a 0 2024-02-16T22:19:16.467 INFO:tasks.workunit.client.1.smithi173.stdout:6/546: creat d0/db/d2e/d65/d73/fcc x:0 0 0 2024-02-16T22:19:16.469 INFO:tasks.workunit.client.1.smithi173.stdout:9/485: dwrite d1/d5f/d6d/f8a [0,4194304] 0 2024-02-16T22:19:16.470 INFO:tasks.workunit.client.1.smithi173.stdout:3/643: dwrite d9/da/f85 [0,4194304] 0 2024-02-16T22:19:16.472 INFO:tasks.workunit.client.1.smithi173.stdout:3/644: mkdir d9/d17/d25/dde 0 2024-02-16T22:19:16.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:16 smithi134 ceph-mon[28869]: pgmap v260: 65 pgs: 65 active+clean; 2.3 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 153 MiB/s rd, 183 MiB/s wr, 340 op/s 2024-02-16T22:19:16.480 INFO:tasks.workunit.client.1.smithi173.stdout:3/645: dread d9/d1a/d2b/d4d/f52 [0,4194304] 0 2024-02-16T22:19:16.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:16 smithi173 ceph-mon[37280]: pgmap v260: 65 pgs: 65 active+clean; 2.3 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 153 MiB/s rd, 183 MiB/s wr, 340 op/s 2024-02-16T22:19:16.482 INFO:tasks.workunit.client.1.smithi173.stdout:3/646: rmdir d9/d1a/d2b/d4d/d5b/da9 39 2024-02-16T22:19:16.482 INFO:tasks.workunit.client.1.smithi173.stdout:3/647: chown d9/d18/d73/db7/l95 131966715 1 2024-02-16T22:19:16.482 INFO:tasks.workunit.client.1.smithi173.stdout:9/486: dread d1/d2/d1a/f2b [0,4194304] 0 2024-02-16T22:19:16.482 INFO:tasks.workunit.client.1.smithi173.stdout:9/487: dread - d1/d2/d1a/d2f/d3b/f84 zero size 2024-02-16T22:19:16.482 INFO:tasks.workunit.client.1.smithi173.stdout:9/488: write d1/f5a [346882,66098] 0 2024-02-16T22:19:16.483 INFO:tasks.workunit.client.1.smithi173.stdout:3/648: mkdir d9/d18/d73/db7/d81/ddf 0 2024-02-16T22:19:16.483 INFO:tasks.workunit.client.1.smithi173.stdout:3/649: fsync d9/da/f7e 0 2024-02-16T22:19:16.483 INFO:tasks.workunit.client.1.smithi173.stdout:9/489: mkdir d1/d2/da2 0 2024-02-16T22:19:16.486 INFO:tasks.workunit.client.1.smithi173.stdout:3/650: rename d9/d17/d25/dde to d9/d17/de0 0 2024-02-16T22:19:16.486 INFO:tasks.workunit.client.1.smithi173.stdout:3/651: fdatasync d9/fcb 0 2024-02-16T22:19:16.488 INFO:tasks.workunit.client.1.smithi173.stdout:6/547: dwrite d0/db/d2e/d2f/d31/f39 [0,4194304] 0 2024-02-16T22:19:16.488 INFO:tasks.workunit.client.1.smithi173.stdout:6/548: write d0/f70 [789133,59308] 0 2024-02-16T22:19:16.488 INFO:tasks.workunit.client.1.smithi173.stdout:6/549: fsync d0/d7c/dc5/f9d 0 2024-02-16T22:19:16.488 INFO:tasks.workunit.client.1.smithi173.stdout:6/550: dread - d0/db/d2e/fbd zero size 2024-02-16T22:19:16.489 INFO:tasks.workunit.client.1.smithi173.stdout:3/652: mkdir d9/d18/d73/db7/d81/de1 0 2024-02-16T22:19:16.493 INFO:tasks.workunit.client.1.smithi173.stdout:6/551: creat d0/db/d2e/d65/d73/d7d/fcd x:0 0 0 2024-02-16T22:19:16.493 INFO:tasks.workunit.client.1.smithi173.stdout:6/552: chown d0/db/d2e/f46 182740 1 2024-02-16T22:19:16.493 INFO:tasks.workunit.client.1.smithi173.stdout:6/553: chown d0/db/d2e/d2f/d31/d33/f69 176656 1 2024-02-16T22:19:16.494 INFO:tasks.workunit.client.1.smithi173.stdout:3/653: mkdir d9/d1a/d2b/d4d/d5b/da9/db4/de2 0 2024-02-16T22:19:16.494 INFO:tasks.workunit.client.1.smithi173.stdout:9/490: truncate d1/d5f/d6d/f8a 2116153 0 2024-02-16T22:19:16.495 INFO:tasks.workunit.client.1.smithi173.stdout:6/554: getdents d0/db/d2e/d65/d67 0 2024-02-16T22:19:16.499 INFO:tasks.workunit.client.1.smithi173.stdout:3/654: unlink d9/d18/d73/db7/fb0 0 2024-02-16T22:19:16.502 INFO:tasks.workunit.client.1.smithi173.stdout:9/491: symlink d1/la3 0 2024-02-16T22:19:16.502 INFO:tasks.workunit.client.1.smithi173.stdout:9/492: fdatasync d1/d2/d1a/d1f/d34/f55 0 2024-02-16T22:19:16.506 INFO:tasks.workunit.client.1.smithi173.stdout:9/493: truncate d1/d2/d1a/f28 3321504 0 2024-02-16T22:19:16.508 INFO:tasks.workunit.client.1.smithi173.stdout:9/494: getdents d1/d2 0 2024-02-16T22:19:16.508 INFO:tasks.workunit.client.1.smithi173.stdout:9/495: chown d1/d2/d1a/d2f/d51/c9f 2 1 2024-02-16T22:19:16.528 INFO:tasks.workunit.client.1.smithi173.stdout:3/655: dwrite d9/da/f66 [0,4194304] 0 2024-02-16T22:19:16.528 INFO:tasks.workunit.client.1.smithi173.stdout:3/656: write d9/d18/fb1 [4508521,23957] 0 2024-02-16T22:19:16.529 INFO:tasks.workunit.client.1.smithi173.stdout:3/657: symlink d9/d18/d5f/le3 0 2024-02-16T22:19:16.530 INFO:tasks.workunit.client.1.smithi173.stdout:9/496: dread d1/d5f/f94 [0,4194304] 0 2024-02-16T22:19:16.530 INFO:tasks.workunit.client.1.smithi173.stdout:9/497: truncate d1/d2/d1a/d2f/f8e 449068 0 2024-02-16T22:19:16.531 INFO:tasks.workunit.client.1.smithi173.stdout:9/498: symlink d1/d5f/la4 0 2024-02-16T22:19:16.540 INFO:tasks.workunit.client.1.smithi173.stdout:3/658: dread d9/f7c [0,4194304] 0 2024-02-16T22:19:16.541 INFO:tasks.workunit.client.1.smithi173.stdout:3/659: symlink d9/d1a/d2b/d45/d60/le4 0 2024-02-16T22:19:16.541 INFO:tasks.workunit.client.1.smithi173.stdout:3/660: write d9/d18/d73/db7/d7a/f8a [78121,125852] 0 2024-02-16T22:19:16.542 INFO:tasks.workunit.client.1.smithi173.stdout:3/661: chown d9/d17/d25/f4a 28099577 1 2024-02-16T22:19:16.542 INFO:tasks.workunit.client.1.smithi173.stdout:3/662: dread - d9/d17/fb8 zero size 2024-02-16T22:19:16.542 INFO:tasks.workunit.client.1.smithi173.stdout:3/663: mkdir d9/d1a/d2b/de5 0 2024-02-16T22:19:16.544 INFO:tasks.workunit.client.1.smithi173.stdout:3/664: dread d9/d1a/d2b/d45/fc0 [0,4194304] 0 2024-02-16T22:19:16.546 INFO:tasks.workunit.client.1.smithi173.stdout:3/665: unlink d9/d18/d5f/c63 0 2024-02-16T22:19:16.546 INFO:tasks.workunit.client.1.smithi173.stdout:3/666: truncate d9/d1a/d2b/d4d/d5b/da9/faf 683123 0 2024-02-16T22:19:16.546 INFO:tasks.workunit.client.1.smithi173.stdout:3/667: chown d9/d1a/d2b/d4d/f8c 4759 1 2024-02-16T22:19:16.546 INFO:tasks.workunit.client.1.smithi173.stdout:3/668: mkdir d9/d18/d5f/d6e/da7/de6 0 2024-02-16T22:19:16.546 INFO:tasks.workunit.client.1.smithi173.stdout:3/669: read d9/d1a/d2b/d4d/d5b/da9/faf [22968,66357] 0 2024-02-16T22:19:16.551 INFO:tasks.workunit.client.1.smithi173.stdout:9/499: dwrite d1/d2/d1a/d2f/f53 [0,4194304] 0 2024-02-16T22:19:16.551 INFO:tasks.workunit.client.1.smithi173.stdout:9/500: stat d1/d2/c64 0 2024-02-16T22:19:16.565 INFO:tasks.workunit.client.1.smithi173.stdout:3/670: dwrite d9/d1a/d2b/d4d/f52 [0,4194304] 0 2024-02-16T22:19:16.580 INFO:tasks.workunit.client.1.smithi173.stdout:3/671: dwrite d9/d1a/f34 [0,4194304] 0 2024-02-16T22:19:16.581 INFO:tasks.workunit.client.1.smithi173.stdout:3/672: dread d9/d18/d5f/fd7 [0,4194304] 0 2024-02-16T22:19:16.582 INFO:tasks.workunit.client.1.smithi173.stdout:3/673: getdents d9/d1a/d2b/d45 0 2024-02-16T22:19:16.584 INFO:tasks.workunit.client.1.smithi173.stdout:3/674: mknod d9/d1a/d2b/d45/d51/ce7 0 2024-02-16T22:19:16.599 INFO:tasks.workunit.client.1.smithi173.stdout:3/675: dwrite d9/d1a/fb6 [0,4194304] 0 2024-02-16T22:19:16.599 INFO:tasks.workunit.client.1.smithi173.stdout:3/676: chown d9/d1a/d2b/c84 12180 1 2024-02-16T22:19:16.599 INFO:tasks.workunit.client.1.smithi173.stdout:3/677: rename d9/d18/daa to d9/d18/daa/de8 22 2024-02-16T22:19:16.599 INFO:tasks.workunit.client.1.smithi173.stdout:3/678: stat d9/d18/d5f/d6e/da7 0 2024-02-16T22:19:16.601 INFO:tasks.workunit.client.1.smithi173.stdout:3/679: mknod d9/d17/ce9 0 2024-02-16T22:19:16.601 INFO:tasks.workunit.client.1.smithi173.stdout:3/680: creat d9/d18/d5f/fea x:0 0 0 2024-02-16T22:19:16.601 INFO:tasks.workunit.client.1.smithi173.stdout:3/681: creat d9/da/feb x:0 0 0 2024-02-16T22:19:16.609 INFO:tasks.workunit.client.1.smithi173.stdout:3/682: dread d9/d1a/f34 [0,4194304] 0 2024-02-16T22:19:16.610 INFO:tasks.workunit.client.1.smithi173.stdout:3/683: creat d9/d18/da3/fec x:0 0 0 2024-02-16T22:19:16.610 INFO:tasks.workunit.client.1.smithi173.stdout:3/684: chown d9/d18/d5f/d6e/da7 965368478 1 2024-02-16T22:19:16.610 INFO:tasks.workunit.client.1.smithi173.stdout:3/685: rmdir d9/d17/d25 39 2024-02-16T22:19:16.627 INFO:tasks.workunit.client.1.smithi173.stdout:3/686: dwrite d9/d18/f3c [0,4194304] 0 2024-02-16T22:19:16.627 INFO:tasks.workunit.client.1.smithi173.stdout:3/687: write d9/d18/da3/fd5 [575736,60898] 0 2024-02-16T22:19:16.627 INFO:tasks.workunit.client.1.smithi173.stdout:3/688: write d9/d1a/d2b/d45/d51/d92/fba [907238,16887] 0 2024-02-16T22:19:16.627 INFO:tasks.workunit.client.1.smithi173.stdout:3/689: write d9/d18/d73/db7/f53 [4743149,117234] 0 2024-02-16T22:19:16.628 INFO:tasks.workunit.client.1.smithi173.stdout:3/690: read - d9/d18/da3/fec zero size 2024-02-16T22:19:16.628 INFO:tasks.workunit.client.1.smithi173.stdout:3/691: dread - d9/d1a/d2b/d4d/d5b/fc3 zero size 2024-02-16T22:19:16.628 INFO:tasks.workunit.client.1.smithi173.stdout:3/692: fsync d9/da/f85 0 2024-02-16T22:19:16.628 INFO:tasks.workunit.client.1.smithi173.stdout:3/693: fsync d9/d1a/d2b/d45/f88 0 2024-02-16T22:19:16.628 INFO:tasks.workunit.client.1.smithi173.stdout:3/694: chown d9/d18/l30 104437572 1 2024-02-16T22:19:16.628 INFO:tasks.workunit.client.1.smithi173.stdout:3/695: creat d9/d1a/d2b/d45/d51/d92/fed x:0 0 0 2024-02-16T22:19:16.629 INFO:tasks.workunit.client.1.smithi173.stdout:3/696: mkdir d9/d18/dee 0 2024-02-16T22:19:16.631 INFO:tasks.workunit.client.1.smithi173.stdout:3/697: rename d9/d1a/c6d to d9/da/cef 0 2024-02-16T22:19:16.632 INFO:tasks.workunit.client.1.smithi173.stdout:3/698: mkdir d9/d18/daa/df0 0 2024-02-16T22:19:16.632 INFO:tasks.workunit.client.1.smithi173.stdout:3/699: read - d9/d1a/d2b/d45/d51/d92/fed zero size 2024-02-16T22:19:16.647 INFO:tasks.workunit.client.1.smithi173.stdout:3/700: dwrite d9/d1a/d2b/d45/d51/fa2 [0,4194304] 0 2024-02-16T22:19:16.647 INFO:tasks.workunit.client.1.smithi173.stdout:3/701: fsync d9/d1a/d2b/d4d/d5b/f89 0 2024-02-16T22:19:16.656 INFO:tasks.workunit.client.1.smithi173.stdout:3/702: dread d9/f4c [0,4194304] 0 2024-02-16T22:19:16.667 INFO:tasks.workunit.client.1.smithi173.stdout:3/703: write d9/d17/d25/f50 [2156362,71588] 0 2024-02-16T22:19:16.667 INFO:tasks.workunit.client.1.smithi173.stdout:3/704: symlink d9/d18/d5f/d6e/da7/lf1 0 2024-02-16T22:19:16.668 INFO:tasks.workunit.client.1.smithi173.stdout:3/705: write d9/d1a/d2b/d45/d60/d6a/fd1 [179669,23208] 0 2024-02-16T22:19:16.676 INFO:tasks.workunit.client.1.smithi173.stdout:3/706: write d9/d18/f3c [292317,30532] 0 2024-02-16T22:19:16.677 INFO:tasks.workunit.client.1.smithi173.stdout:3/707: mkdir d9/d18/d5f/d6e/df2 0 2024-02-16T22:19:16.679 INFO:tasks.workunit.client.1.smithi173.stdout:3/708: dread d9/d1a/d2b/d45/d51/fdd [0,4194304] 0 2024-02-16T22:19:16.680 INFO:tasks.workunit.client.1.smithi173.stdout:3/709: mkdir d9/d18/d73/df3 0 2024-02-16T22:19:16.680 INFO:tasks.workunit.client.1.smithi173.stdout:3/710: fsync d9/d18/f62 0 2024-02-16T22:19:16.697 INFO:tasks.workunit.client.1.smithi173.stdout:8/717: sync 2024-02-16T22:19:16.697 INFO:tasks.workunit.client.1.smithi173.stdout:4/456: sync 2024-02-16T22:19:16.697 INFO:tasks.workunit.client.1.smithi173.stdout:1/601: sync 2024-02-16T22:19:16.697 INFO:tasks.workunit.client.1.smithi173.stdout:0/395: sync 2024-02-16T22:19:16.697 INFO:tasks.workunit.client.1.smithi173.stdout:1/602: dread - db/d1c/d5c/dac/fbe zero size 2024-02-16T22:19:16.697 INFO:tasks.workunit.client.1.smithi173.stdout:0/396: dread - d0/d4/d14/d24/d32/f66 zero size 2024-02-16T22:19:16.697 INFO:tasks.workunit.client.1.smithi173.stdout:1/603: chown db/d1c/f6b 6407 1 2024-02-16T22:19:16.697 INFO:tasks.workunit.client.1.smithi173.stdout:4/457: write d7/df/d62/f6f [605162,3800] 0 2024-02-16T22:19:16.697 INFO:tasks.workunit.client.1.smithi173.stdout:1/604: creat db/d1c/fd0 x:0 0 0 2024-02-16T22:19:16.697 INFO:tasks.workunit.client.1.smithi173.stdout:0/397: write d0/d4/d14/d24/d32/d39/f42 [1226497,80401] 0 2024-02-16T22:19:16.701 INFO:tasks.workunit.client.1.smithi173.stdout:3/711: dwrite d9/d1a/d2b/d45/d60/d6a/fd1 [0,4194304] 0 2024-02-16T22:19:16.705 INFO:tasks.workunit.client.1.smithi173.stdout:3/712: creat d9/d18/dee/ff4 x:0 0 0 2024-02-16T22:19:16.710 INFO:tasks.workunit.client.1.smithi173.stdout:0/398: dread d0/f1e [8388608,4194304] 0 2024-02-16T22:19:16.714 INFO:tasks.workunit.client.1.smithi173.stdout:8/718: dread f2 [0,4194304] 0 2024-02-16T22:19:16.716 INFO:tasks.workunit.client.1.smithi173.stdout:8/719: truncate dd/f86 1343410 0 2024-02-16T22:19:16.720 INFO:tasks.workunit.client.1.smithi173.stdout:0/399: dread d0/d4/d14/d50/f6e [0,4194304] 0 2024-02-16T22:19:16.727 INFO:tasks.workunit.client.1.smithi173.stdout:4/458: dwrite d7/d28/d31/d33/d7d/d45/f79 [0,4194304] 0 2024-02-16T22:19:16.727 INFO:tasks.workunit.client.1.smithi173.stdout:4/459: chown d7/d28/d31/d33/d7d/d45/l6d 2 1 2024-02-16T22:19:16.728 INFO:tasks.workunit.client.1.smithi173.stdout:3/713: dwrite d9/d17/d25/f46 [0,4194304] 0 2024-02-16T22:19:16.729 INFO:tasks.workunit.client.1.smithi173.stdout:1/605: dwrite db/d1c/d25/d28/fc9 [0,4194304] 0 2024-02-16T22:19:16.730 INFO:tasks.workunit.client.1.smithi173.stdout:1/606: chown f9 14552 1 2024-02-16T22:19:16.733 INFO:tasks.workunit.client.1.smithi173.stdout:8/720: dread dd/d7c/d7d/d22/d2e/d41/f76 [0,4194304] 0 2024-02-16T22:19:16.733 INFO:tasks.workunit.client.1.smithi173.stdout:8/721: chown dd/d7c/d7d/f5b 1021 1 2024-02-16T22:19:16.733 INFO:tasks.workunit.client.1.smithi173.stdout:8/722: creat dd/feb x:0 0 0 2024-02-16T22:19:16.733 INFO:tasks.workunit.client.1.smithi173.stdout:4/460: rmdir d7/df/d62 39 2024-02-16T22:19:16.734 INFO:tasks.workunit.client.1.smithi173.stdout:3/714: getdents d9/d1a/d2b/d45/d51 0 2024-02-16T22:19:16.736 INFO:tasks.workunit.client.1.smithi173.stdout:4/461: link d7/d28/f1d d7/d28/d31/d33/d7d/d4e/f9b 0 2024-02-16T22:19:16.736 INFO:tasks.workunit.client.1.smithi173.stdout:4/462: write d7/f5f [78082,40490] 0 2024-02-16T22:19:16.738 INFO:tasks.workunit.client.1.smithi173.stdout:3/715: rename f8 to d9/d1a/d2b/d45/d60/ff5 0 2024-02-16T22:19:16.739 INFO:tasks.workunit.client.1.smithi173.stdout:4/463: creat d7/d28/d52/d89/f9c x:0 0 0 2024-02-16T22:19:16.739 INFO:tasks.workunit.client.1.smithi173.stdout:4/464: read - d7/d28/d31/d33/d7d/d45/f65 zero size 2024-02-16T22:19:16.741 INFO:tasks.workunit.client.1.smithi173.stdout:3/716: rename d9/d18/d73/df3 to d9/d18/dee/df6 0 2024-02-16T22:19:16.741 INFO:tasks.workunit.client.1.smithi173.stdout:3/717: creat d9/d18/d5f/d6e/da7/ff7 x:0 0 0 2024-02-16T22:19:16.741 INFO:tasks.workunit.client.1.smithi173.stdout:3/718: write d9/d18/d5f/d6e/da7/fd9 [428309,16785] 0 2024-02-16T22:19:16.742 INFO:tasks.workunit.client.1.smithi173.stdout:0/400: dwrite d0/d4/fe [0,4194304] 0 2024-02-16T22:19:16.742 INFO:tasks.workunit.client.1.smithi173.stdout:4/465: creat d7/d12/d7e/f9d x:0 0 0 2024-02-16T22:19:16.747 INFO:tasks.workunit.client.1.smithi173.stdout:3/719: link d9/d1a/d2b/d4d/d5b/f5e d9/da/ff8 0 2024-02-16T22:19:16.749 INFO:tasks.workunit.client.1.smithi173.stdout:4/466: rename d7/d28/d31/d33/l81 to d7/d28/d31/d33/d7d/d3d/l9e 0 2024-02-16T22:19:16.749 INFO:tasks.workunit.client.1.smithi173.stdout:4/467: chown d7/d28/d14/c6e 4214636 1 2024-02-16T22:19:16.751 INFO:tasks.workunit.client.1.smithi173.stdout:4/468: mknod d7/d28/d31/d33/d7d/d45/c9f 0 2024-02-16T22:19:16.754 INFO:tasks.workunit.client.1.smithi173.stdout:0/401: write d0/d4/fe [1587876,104395] 0 2024-02-16T22:19:16.756 INFO:tasks.workunit.client.1.smithi173.stdout:0/402: write d0/f67 [560150,104189] 0 2024-02-16T22:19:16.762 INFO:tasks.workunit.client.1.smithi173.stdout:8/723: dwrite dd/d7c/d7d/f2c [0,4194304] 0 2024-02-16T22:19:16.763 INFO:tasks.workunit.client.1.smithi173.stdout:1/607: dwrite db/f4b [0,4194304] 0 2024-02-16T22:19:16.763 INFO:tasks.workunit.client.1.smithi173.stdout:1/608: stat db/d1c 0 2024-02-16T22:19:16.763 INFO:tasks.workunit.client.1.smithi173.stdout:1/609: creat db/d1c/d5c/dac/dae/fd1 x:0 0 0 2024-02-16T22:19:16.764 INFO:tasks.workunit.client.1.smithi173.stdout:1/610: chown db/d29/d8f 272107 1 2024-02-16T22:19:16.764 INFO:tasks.workunit.client.1.smithi173.stdout:8/724: mkdir dd/d7c/d7d/d22/d28/dec 0 2024-02-16T22:19:16.765 INFO:tasks.workunit.client.1.smithi173.stdout:3/720: dread d9/d18/d5f/d6e/da7/fd9 [0,4194304] 0 2024-02-16T22:19:16.765 INFO:tasks.workunit.client.1.smithi173.stdout:3/721: write d9/d18/d5f/d6e/d4e/f99 [114123,105659] 0 2024-02-16T22:19:16.765 INFO:tasks.workunit.client.1.smithi173.stdout:4/469: dread d7/d28/d31/d33/d7d/d4e/f5a [0,4194304] 0 2024-02-16T22:19:16.767 INFO:tasks.workunit.client.1.smithi173.stdout:0/403: dread d0/f10 [0,4194304] 0 2024-02-16T22:19:16.767 INFO:tasks.workunit.client.1.smithi173.stdout:0/404: fdatasync d0/d4/f8 0 2024-02-16T22:19:16.775 INFO:tasks.workunit.client.1.smithi173.stdout:4/470: write d7/d28/f1d [1825793,61255] 0 2024-02-16T22:19:16.775 INFO:tasks.workunit.client.1.smithi173.stdout:8/725: creat dd/d7c/d7d/d22/d28/d40/d69/da7/dae/fed x:0 0 0 2024-02-16T22:19:16.775 INFO:tasks.workunit.client.1.smithi173.stdout:8/726: fsync dd/d7c/d7d/d22/d2e/f71 0 2024-02-16T22:19:16.776 INFO:tasks.workunit.client.1.smithi173.stdout:3/722: mkdir d9/d18/d5f/d6e/df9 0 2024-02-16T22:19:16.779 INFO:tasks.workunit.client.1.smithi173.stdout:0/405: creat d0/d4/d14/d24/d5f/f7e x:0 0 0 2024-02-16T22:19:16.780 INFO:tasks.workunit.client.1.smithi173.stdout:1/611: rmdir db/d1c/d7f 39 2024-02-16T22:19:16.782 INFO:tasks.workunit.client.1.smithi173.stdout:4/471: creat d7/df/d8b/fa0 x:0 0 0 2024-02-16T22:19:16.782 INFO:tasks.workunit.client.1.smithi173.stdout:6/555: sync 2024-02-16T22:19:16.782 INFO:tasks.workunit.client.1.smithi173.stdout:5/579: sync 2024-02-16T22:19:16.782 INFO:tasks.workunit.client.1.smithi173.stdout:2/575: sync 2024-02-16T22:19:16.782 INFO:tasks.workunit.client.1.smithi173.stdout:7/502: sync 2024-02-16T22:19:16.784 INFO:tasks.workunit.client.1.smithi173.stdout:1/612: creat db/fd2 x:0 0 0 2024-02-16T22:19:16.784 INFO:tasks.workunit.client.1.smithi173.stdout:9/501: sync 2024-02-16T22:19:16.784 INFO:tasks.workunit.client.1.smithi173.stdout:6/556: dread d0/db/d2e/d2f/d31/d33/fab [0,4194304] 0 2024-02-16T22:19:16.785 INFO:tasks.workunit.client.1.smithi173.stdout:2/576: write d2/d4/f7 [350905,62024] 0 2024-02-16T22:19:16.787 INFO:tasks.workunit.client.1.smithi173.stdout:2/577: dread d2/d4/d8/d30/f45 [0,4194304] 0 2024-02-16T22:19:16.792 INFO:tasks.workunit.client.1.smithi173.stdout:0/406: write d0/f1e [860027,20289] 0 2024-02-16T22:19:16.794 INFO:tasks.workunit.client.1.smithi173.stdout:3/723: dwrite d9/f4c [4194304,4194304] 0 2024-02-16T22:19:16.797 INFO:tasks.workunit.client.1.smithi173.stdout:5/580: mknod d8/da/d1b/cb5 0 2024-02-16T22:19:16.797 INFO:tasks.workunit.client.1.smithi173.stdout:4/472: mkdir d7/df/d8b/da1 0 2024-02-16T22:19:16.797 INFO:tasks.workunit.client.1.smithi173.stdout:5/581: chown d8/d27/d62/f68 2213716 1 2024-02-16T22:19:16.797 INFO:tasks.workunit.client.1.smithi173.stdout:9/502: rename d1/d5f/f94 to d1/d2/d1a/d1f/d34/d49/fa5 0 2024-02-16T22:19:16.797 INFO:tasks.workunit.client.1.smithi173.stdout:4/473: write d7/d12/f19 [507720,26983] 0 2024-02-16T22:19:16.797 INFO:tasks.workunit.client.1.smithi173.stdout:1/613: symlink db/d1c/d25/d28/ld3 0 2024-02-16T22:19:16.797 INFO:tasks.workunit.client.1.smithi173.stdout:2/578: mknod d2/d4/d8/d30/d44/d81/cbc 0 2024-02-16T22:19:16.801 INFO:tasks.workunit.client.1.smithi173.stdout:9/503: mkdir d1/d2/d1a/d2f/d3b/da6 0 2024-02-16T22:19:16.801 INFO:tasks.workunit.client.1.smithi173.stdout:5/582: dread d8/da/d1f/d33/f3e [0,4194304] 0 2024-02-16T22:19:16.801 INFO:tasks.workunit.client.1.smithi173.stdout:5/583: chown d8/da/d2d/d36/f3d 932 1 2024-02-16T22:19:16.802 INFO:tasks.workunit.client.1.smithi173.stdout:0/407: rename d0/d4/f60 to d0/d6d/f7f 0 2024-02-16T22:19:16.802 INFO:tasks.workunit.client.1.smithi173.stdout:0/408: read d0/d4/f7 [1104273,29392] 0 2024-02-16T22:19:16.802 INFO:tasks.workunit.client.1.smithi173.stdout:1/614: truncate db/f75 747817 0 2024-02-16T22:19:16.804 INFO:tasks.workunit.client.1.smithi173.stdout:2/579: creat d2/d4/d57/d82/fbd x:0 0 0 2024-02-16T22:19:16.806 INFO:tasks.workunit.client.1.smithi173.stdout:7/503: write d1/d1d/d4c/d63/d13/d36/d49/f7d [473068,57313] 0 2024-02-16T22:19:16.806 INFO:tasks.workunit.client.1.smithi173.stdout:7/504: getdents d1/d1d/d44 0 2024-02-16T22:19:16.806 INFO:tasks.workunit.client.1.smithi173.stdout:7/505: fsync d1/d1d/d4c/d63/d13/d36/d49/f7f 0 2024-02-16T22:19:16.807 INFO:tasks.workunit.client.1.smithi173.stdout:6/557: dwrite d0/db/d2e/d2f/d31/d33/d6d/f9e [0,4194304] 0 2024-02-16T22:19:16.807 INFO:tasks.workunit.client.1.smithi173.stdout:6/558: chown d0/db/d2e/d2f/d31/d7a/la3 3 1 2024-02-16T22:19:16.807 INFO:tasks.workunit.client.1.smithi173.stdout:6/559: creat d0/db/d2e/d65/d73/d81/fce x:0 0 0 2024-02-16T22:19:16.808 INFO:tasks.workunit.client.1.smithi173.stdout:9/504: mkdir d1/d5f/d6d/d91/da7 0 2024-02-16T22:19:16.809 INFO:tasks.workunit.client.1.smithi173.stdout:4/474: dread d7/d28/d31/d33/f85 [0,4194304] 0 2024-02-16T22:19:16.810 INFO:tasks.workunit.client.1.smithi173.stdout:4/475: creat d7/d28/d31/d33/d7d/d45/fa2 x:0 0 0 2024-02-16T22:19:16.812 INFO:tasks.workunit.client.1.smithi173.stdout:0/409: mknod d0/d12/d15/d3d/d6f/c80 0 2024-02-16T22:19:16.816 INFO:tasks.workunit.client.1.smithi173.stdout:7/506: dread d1/d1d/d4c/d63/d48/f75 [0,4194304] 0 2024-02-16T22:19:16.817 INFO:tasks.workunit.client.1.smithi173.stdout:6/560: dread d0/f5b [0,4194304] 0 2024-02-16T22:19:16.826 INFO:tasks.workunit.client.1.smithi173.stdout:1/615: creat db/d29/d57/d8c/fd4 x:0 0 0 2024-02-16T22:19:16.826 INFO:tasks.workunit.client.1.smithi173.stdout:2/580: rmdir d2/d4 39 2024-02-16T22:19:16.826 INFO:tasks.workunit.client.1.smithi173.stdout:4/476: mknod d7/d28/d31/d33/d7d/d4e/ca3 0 2024-02-16T22:19:16.826 INFO:tasks.workunit.client.1.smithi173.stdout:0/410: mknod d0/d12/d15/d4f/c81 0 2024-02-16T22:19:16.827 INFO:tasks.workunit.client.1.smithi173.stdout:5/584: dwrite d8/fb [0,4194304] 0 2024-02-16T22:19:16.828 INFO:tasks.workunit.client.1.smithi173.stdout:7/507: symlink d1/d1d/d4c/d91/d81/l94 0 2024-02-16T22:19:16.828 INFO:tasks.workunit.client.1.smithi173.stdout:7/508: dread - d1/d1d/d4c/d63/d13/d36/f87 zero size 2024-02-16T22:19:16.828 INFO:tasks.workunit.client.1.smithi173.stdout:7/509: fdatasync d1/d1d/d4c/d63/d13/d36/f38 0 2024-02-16T22:19:16.828 INFO:tasks.workunit.client.1.smithi173.stdout:2/581: write d2/dc/d19/d1c/d87/f8a [238031,57065] 0 2024-02-16T22:19:16.828 INFO:tasks.workunit.client.1.smithi173.stdout:2/582: write d2/dc/d19/d1a/d74/db2/fb4 [443927,130577] 0 2024-02-16T22:19:16.828 INFO:tasks.workunit.client.1.smithi173.stdout:2/583: truncate d2/dc/d19/f16 4088633 0 2024-02-16T22:19:16.829 INFO:tasks.workunit.client.1.smithi173.stdout:1/616: dread db/d1c/d25/d28/f49 [0,4194304] 0 2024-02-16T22:19:16.829 INFO:tasks.workunit.client.1.smithi173.stdout:0/411: symlink d0/d4/d14/d24/d58/l82 0 2024-02-16T22:19:16.829 INFO:tasks.workunit.client.1.smithi173.stdout:0/412: read d0/d4/fe [1656837,68434] 0 2024-02-16T22:19:16.830 INFO:tasks.workunit.client.1.smithi173.stdout:2/584: mknod d2/dc/d19/d1a/d74/cbe 0 2024-02-16T22:19:16.832 INFO:tasks.workunit.client.1.smithi173.stdout:6/561: getdents d0/db/d2e/d2f 0 2024-02-16T22:19:16.832 INFO:tasks.workunit.client.1.smithi173.stdout:7/510: dread d1/d1d/f93 [0,4194304] 0 2024-02-16T22:19:16.833 INFO:tasks.workunit.client.1.smithi173.stdout:6/562: write d0/f44 [468833,25928] 0 2024-02-16T22:19:16.833 INFO:tasks.workunit.client.1.smithi173.stdout:0/413: creat d0/d4/d14/d24/d2e/f83 x:0 0 0 2024-02-16T22:19:16.833 INFO:tasks.workunit.client.1.smithi173.stdout:0/414: chown d0/c5d 1668567 1 2024-02-16T22:19:16.834 INFO:tasks.workunit.client.1.smithi173.stdout:2/585: symlink d2/d10/d62/lbf 0 2024-02-16T22:19:16.835 INFO:tasks.workunit.client.1.smithi173.stdout:7/511: truncate d1/d1d/d4c/d63/d13/d36/f4d 1212795 0 2024-02-16T22:19:16.837 INFO:tasks.workunit.client.1.smithi173.stdout:0/415: mkdir d0/d84 0 2024-02-16T22:19:16.839 INFO:tasks.workunit.client.1.smithi173.stdout:2/586: creat d2/d4/d8/d30/d44/d81/d99/fc0 x:0 0 0 2024-02-16T22:19:16.839 INFO:tasks.workunit.client.1.smithi173.stdout:6/563: creat d0/db/d2e/d65/d67/d78/fcf x:0 0 0 2024-02-16T22:19:16.839 INFO:tasks.workunit.client.1.smithi173.stdout:2/587: creat d2/d4/d8/d80/fc1 x:0 0 0 2024-02-16T22:19:16.840 INFO:tasks.workunit.client.1.smithi173.stdout:0/416: truncate d0/d4/d14/d24/d32/d39/f2c 2265554 0 2024-02-16T22:19:16.843 INFO:tasks.workunit.client.1.smithi173.stdout:9/505: dwrite d1/d2/d1a/d2f/f53 [0,4194304] 0 2024-02-16T22:19:16.844 INFO:tasks.workunit.client.1.smithi173.stdout:1/617: dread db/d30/f48 [0,4194304] 0 2024-02-16T22:19:16.845 INFO:tasks.workunit.client.1.smithi173.stdout:0/417: creat d0/d12/d15/f85 x:0 0 0 2024-02-16T22:19:16.845 INFO:tasks.workunit.client.1.smithi173.stdout:2/588: rename d2/d4/d8/d80/da1/fa7 to d2/dc/d19/d1a/fc2 0 2024-02-16T22:19:16.847 INFO:tasks.workunit.client.1.smithi173.stdout:4/477: write d7/f9 [3384029,98179] 0 2024-02-16T22:19:16.847 INFO:tasks.workunit.client.1.smithi173.stdout:4/478: chown d7/d28/d31/d33/d7d/d45/f70 2680521 1 2024-02-16T22:19:16.847 INFO:tasks.workunit.client.1.smithi173.stdout:4/479: write d7/d28/d31/d33/d7d/d3d/f8d [408720,65208] 0 2024-02-16T22:19:16.847 INFO:tasks.workunit.client.1.smithi173.stdout:4/480: creat d7/d28/d31/d33/d7d/d4e/fa4 x:0 0 0 2024-02-16T22:19:16.851 INFO:tasks.workunit.client.1.smithi173.stdout:1/618: dread f9 [0,4194304] 0 2024-02-16T22:19:16.851 INFO:tasks.workunit.client.1.smithi173.stdout:0/418: mkdir d0/d12/d15/d86 0 2024-02-16T22:19:16.851 INFO:tasks.workunit.client.1.smithi173.stdout:1/619: write db/d1c/d25/d28/d3f/d4a/f5b [488060,45537] 0 2024-02-16T22:19:16.851 INFO:tasks.workunit.client.1.smithi173.stdout:1/620: stat f2 0 2024-02-16T22:19:16.851 INFO:tasks.workunit.client.1.smithi173.stdout:0/419: write d0/d4/d14/d24/d58/f74 [270681,80036] 0 2024-02-16T22:19:16.851 INFO:tasks.workunit.client.1.smithi173.stdout:9/506: getdents d1/d2/d1a/d3e 0 2024-02-16T22:19:16.851 INFO:tasks.workunit.client.1.smithi173.stdout:9/507: write d1/d2/d1a/d3e/d4f/d8c/f9d [387172,30261] 0 2024-02-16T22:19:16.851 INFO:tasks.workunit.client.1.smithi173.stdout:0/420: write d0/d4/f8 [2210186,113891] 0 2024-02-16T22:19:16.851 INFO:tasks.workunit.client.1.smithi173.stdout:9/508: getdents d1/d5f/d6d/d97 0 2024-02-16T22:19:16.851 INFO:tasks.workunit.client.1.smithi173.stdout:9/509: chown d1/d2/d10 7265 1 2024-02-16T22:19:16.852 INFO:tasks.workunit.client.1.smithi173.stdout:9/510: write d1/d2/d1a/d3e/d4f/d8c/f9d [214139,36379] 0 2024-02-16T22:19:16.853 INFO:tasks.workunit.client.1.smithi173.stdout:4/481: mknod d7/d28/d31/d33/d7d/d4e/ca5 0 2024-02-16T22:19:16.854 INFO:tasks.workunit.client.1.smithi173.stdout:1/621: getdents db/d29/db5 0 2024-02-16T22:19:16.855 INFO:tasks.workunit.client.1.smithi173.stdout:0/421: mknod d0/d4/d14/d24/d32/d39/c87 0 2024-02-16T22:19:16.857 INFO:tasks.workunit.client.1.smithi173.stdout:1/622: mkdir db/d1c/d25/d28/d3f/dd5 0 2024-02-16T22:19:16.858 INFO:tasks.workunit.client.1.smithi173.stdout:7/512: dwrite d1/d1d/f45 [4194304,4194304] 0 2024-02-16T22:19:16.858 INFO:tasks.workunit.client.1.smithi173.stdout:7/513: write d1/d1d/d4c/d63/d54/f70 [1751521,6425] 0 2024-02-16T22:19:16.863 INFO:tasks.workunit.client.1.smithi173.stdout:2/589: dread d2/d4/d8/d30/f37 [0,4194304] 0 2024-02-16T22:19:16.863 INFO:tasks.workunit.client.1.smithi173.stdout:1/623: truncate db/f24 623696 0 2024-02-16T22:19:16.864 INFO:tasks.workunit.client.1.smithi173.stdout:6/564: dwrite d0/db/d2e/f37 [0,4194304] 0 2024-02-16T22:19:16.867 INFO:tasks.workunit.client.1.smithi173.stdout:1/624: creat db/d1c/d5c/daf/fd6 x:0 0 0 2024-02-16T22:19:16.869 INFO:tasks.workunit.client.1.smithi173.stdout:6/565: truncate d0/db/f72 654948 0 2024-02-16T22:19:16.869 INFO:tasks.workunit.client.1.smithi173.stdout:6/566: fsync d0/db/d2e/d65/d73/d7d/fcd 0 2024-02-16T22:19:16.871 INFO:tasks.workunit.client.1.smithi173.stdout:1/625: mknod db/d1c/d5c/daf/cd7 0 2024-02-16T22:19:16.872 INFO:tasks.workunit.client.1.smithi173.stdout:1/626: creat db/d5f/d97/fd8 x:0 0 0 2024-02-16T22:19:16.872 INFO:tasks.workunit.client.1.smithi173.stdout:1/627: dread - db/d29/d8f/f93 zero size 2024-02-16T22:19:16.872 INFO:tasks.workunit.client.1.smithi173.stdout:4/482: dread d7/d28/d52/f60 [0,4194304] 0 2024-02-16T22:19:16.872 INFO:tasks.workunit.client.1.smithi173.stdout:4/483: fsync d7/d12/d2d/f44 0 2024-02-16T22:19:16.873 INFO:tasks.workunit.client.1.smithi173.stdout:6/567: mknod d0/db/d4d/cd0 0 2024-02-16T22:19:16.873 INFO:tasks.workunit.client.1.smithi173.stdout:6/568: readlink d0/db/d2e/d65/d73/lb5 0 2024-02-16T22:19:16.873 INFO:tasks.workunit.client.1.smithi173.stdout:7/514: write d1/d1d/d4c/d63/d6c/f77 [3052987,116786] 0 2024-02-16T22:19:16.876 INFO:tasks.workunit.client.1.smithi173.stdout:1/628: mknod db/d1c/d25/d28/d3f/cd9 0 2024-02-16T22:19:16.876 INFO:tasks.workunit.client.1.smithi173.stdout:1/629: write db/d29/f36 [4788812,18468] 0 2024-02-16T22:19:16.877 INFO:tasks.workunit.client.1.smithi173.stdout:4/484: truncate d7/d28/f75 2801117 0 2024-02-16T22:19:16.877 INFO:tasks.workunit.client.1.smithi173.stdout:2/590: write d2/d4/f4c [3400933,59086] 0 2024-02-16T22:19:16.879 INFO:tasks.workunit.client.1.smithi173.stdout:6/569: mknod d0/db/d2e/d65/d73/cd1 0 2024-02-16T22:19:16.879 INFO:tasks.workunit.client.1.smithi173.stdout:1/630: dread db/f75 [0,4194304] 0 2024-02-16T22:19:16.882 INFO:tasks.workunit.client.1.smithi173.stdout:7/515: dread d1/d1d/d4c/d63/d13/d36/d49/f7f [4194304,4194304] 0 2024-02-16T22:19:16.883 INFO:tasks.workunit.client.1.smithi173.stdout:9/511: dwrite d1/d5f/d6d/d91/fa0 [0,4194304] 0 2024-02-16T22:19:16.885 INFO:tasks.workunit.client.1.smithi173.stdout:6/570: rename d0/db/d2e/f46 to d0/db/d2e/d61/fd2 0 2024-02-16T22:19:16.887 INFO:tasks.workunit.client.1.smithi173.stdout:1/631: mkdir db/d1c/d25/d28/d3f/d4a/dda 0 2024-02-16T22:19:16.891 INFO:tasks.workunit.client.1.smithi173.stdout:4/485: rmdir d7/d28/d31/d33/d7d 39 2024-02-16T22:19:16.891 INFO:tasks.workunit.client.1.smithi173.stdout:4/486: creat d7/d28/d31/d33/fa6 x:0 0 0 2024-02-16T22:19:16.891 INFO:tasks.workunit.client.1.smithi173.stdout:4/487: getdents d7/d28/d31 0 2024-02-16T22:19:16.894 INFO:tasks.workunit.client.1.smithi173.stdout:7/516: creat d1/d1d/d4c/d91/f95 x:0 0 0 2024-02-16T22:19:16.899 INFO:tasks.workunit.client.1.smithi173.stdout:9/512: symlink d1/d2/d1a/d2f/d51/la8 0 2024-02-16T22:19:16.901 INFO:tasks.workunit.client.1.smithi173.stdout:1/632: symlink db/d29/d57/ldb 0 2024-02-16T22:19:16.901 INFO:tasks.workunit.client.1.smithi173.stdout:1/633: write db/f15 [1329888,69131] 0 2024-02-16T22:19:16.902 INFO:tasks.workunit.client.1.smithi173.stdout:1/634: dread - db/d29/d57/d73/f87 zero size 2024-02-16T22:19:16.903 INFO:tasks.workunit.client.1.smithi173.stdout:6/571: dwrite d0/db/f29 [0,4194304] 0 2024-02-16T22:19:16.903 INFO:tasks.workunit.client.1.smithi173.stdout:6/572: fsync d0/db/d2e/f30 0 2024-02-16T22:19:16.903 INFO:tasks.workunit.client.1.smithi173.stdout:6/573: stat d0/db/c49 0 2024-02-16T22:19:16.907 INFO:tasks.workunit.client.1.smithi173.stdout:4/488: link d7/d12/c7a d7/d9a/ca7 0 2024-02-16T22:19:16.909 INFO:tasks.workunit.client.1.smithi173.stdout:7/517: unlink d1/d1d/d4c/d63/d13/d22/f92 0 2024-02-16T22:19:16.910 INFO:tasks.workunit.client.1.smithi173.stdout:9/513: creat d1/d2/d1a/d3e/fa9 x:0 0 0 2024-02-16T22:19:16.910 INFO:tasks.workunit.client.1.smithi173.stdout:9/514: write d1/d2/d1a/d3e/f57 [1358545,80919] 0 2024-02-16T22:19:16.912 INFO:tasks.workunit.client.1.smithi173.stdout:1/635: unlink db/d1c/d25/d28/f2f 0 2024-02-16T22:19:16.914 INFO:tasks.workunit.client.1.smithi173.stdout:6/574: creat d0/db/d2e/d61/fd3 x:0 0 0 2024-02-16T22:19:16.914 INFO:tasks.workunit.client.1.smithi173.stdout:6/575: fdatasync d0/db/d2e/d65/d73/d81/fce 0 2024-02-16T22:19:16.914 INFO:tasks.workunit.client.1.smithi173.stdout:6/576: write d0/db/d2e/d2f/da6/fba [678757,72036] 0 2024-02-16T22:19:16.915 INFO:tasks.workunit.client.1.smithi173.stdout:4/489: link d7/d28/d31/d33/d7d/d4e/f9b d7/d9a/fa8 0 2024-02-16T22:19:16.916 INFO:tasks.workunit.client.1.smithi173.stdout:4/490: dread d7/d28/d31/d33/d7d/d3d/f6c [0,4194304] 0 2024-02-16T22:19:16.916 INFO:tasks.workunit.client.1.smithi173.stdout:7/518: mknod d1/d1d/d4c/d63/d54/c96 0 2024-02-16T22:19:16.919 INFO:tasks.workunit.client.1.smithi173.stdout:6/577: write d0/db/d2e/f56 [338882,120055] 0 2024-02-16T22:19:16.919 INFO:tasks.workunit.client.1.smithi173.stdout:4/491: creat d7/d9a/fa9 x:0 0 0 2024-02-16T22:19:16.920 INFO:tasks.workunit.client.1.smithi173.stdout:1/636: dread db/d1d/f26 [4194304,4194304] 0 2024-02-16T22:19:16.921 INFO:tasks.workunit.client.1.smithi173.stdout:7/519: mknod d1/d1d/d4c/d63/d13/d22/d7e/c97 0 2024-02-16T22:19:16.921 INFO:tasks.workunit.client.1.smithi173.stdout:7/520: dread - d1/d1d/d44/f7c zero size 2024-02-16T22:19:16.921 INFO:tasks.workunit.client.1.smithi173.stdout:7/521: stat d1/d1d/d4c/d63/d13/d36/f87 0 2024-02-16T22:19:16.922 INFO:tasks.workunit.client.1.smithi173.stdout:4/492: rename d7/d28/d31/d33/d7d/d4e/f9b to d7/d28/d52/d89/faa 0 2024-02-16T22:19:16.925 INFO:tasks.workunit.client.1.smithi173.stdout:1/637: unlink db/d1c/d25/d28/lb3 0 2024-02-16T22:19:16.925 INFO:tasks.workunit.client.1.smithi173.stdout:1/638: dread - db/d29/d57/d73/fb7 zero size 2024-02-16T22:19:16.925 INFO:tasks.workunit.client.1.smithi173.stdout:1/639: write db/d1c/f6b [911594,2264] 0 2024-02-16T22:19:16.925 INFO:tasks.workunit.client.1.smithi173.stdout:6/578: write d0/db/d2e/d2f/f4b [792818,13006] 0 2024-02-16T22:19:16.925 INFO:tasks.workunit.client.1.smithi173.stdout:1/640: fdatasync db/f75 0 2024-02-16T22:19:16.925 INFO:tasks.workunit.client.1.smithi173.stdout:6/579: write d0/db/d2e/d2f/fac [630344,87809] 0 2024-02-16T22:19:16.927 INFO:tasks.workunit.client.1.smithi173.stdout:6/580: dread d0/db/d2e/f88 [0,4194304] 0 2024-02-16T22:19:16.930 INFO:tasks.workunit.client.1.smithi173.stdout:1/641: symlink db/d1c/d5c/daf/ldc 0 2024-02-16T22:19:16.930 INFO:tasks.workunit.client.1.smithi173.stdout:1/642: dread - db/d1c/d7f/d98/fc1 zero size 2024-02-16T22:19:16.930 INFO:tasks.workunit.client.1.smithi173.stdout:7/522: symlink d1/d1d/d4c/d63/d13/d22/d53/l98 0 2024-02-16T22:19:16.930 INFO:tasks.workunit.client.1.smithi173.stdout:7/523: fdatasync d1/d1d/d4c/d63/d13/d22/d53/d27/f65 0 2024-02-16T22:19:16.933 INFO:tasks.workunit.client.1.smithi173.stdout:4/493: getdents d7 0 2024-02-16T22:19:16.934 INFO:tasks.workunit.client.1.smithi173.stdout:6/581: mknod d0/d7c/dc5/cd4 0 2024-02-16T22:19:16.935 INFO:tasks.workunit.client.1.smithi173.stdout:7/524: link d1/d1d/d44/f7c d1/d1d/d4c/d91/d81/f99 0 2024-02-16T22:19:16.937 INFO:tasks.workunit.client.1.smithi173.stdout:4/494: rename d7/df/f23 to d7/d12/fab 0 2024-02-16T22:19:16.939 INFO:tasks.workunit.client.1.smithi173.stdout:7/525: mkdir d1/d1d/d4c/d63/d48/d9a 0 2024-02-16T22:19:16.940 INFO:tasks.workunit.client.1.smithi173.stdout:4/495: mkdir d7/d28/dac 0 2024-02-16T22:19:16.940 INFO:tasks.workunit.client.1.smithi173.stdout:4/496: chown d7/d28/c11 733 1 2024-02-16T22:19:16.942 INFO:tasks.workunit.client.1.smithi173.stdout:6/582: dread d0/db/d2e/f56 [0,4194304] 0 2024-02-16T22:19:16.951 INFO:tasks.workunit.client.1.smithi173.stdout:1/643: write db/f18 [4046765,11400] 0 2024-02-16T22:19:16.954 INFO:tasks.workunit.client.1.smithi173.stdout:1/644: rmdir db/d29 39 2024-02-16T22:19:16.972 INFO:tasks.workunit.client.1.smithi173.stdout:1/645: dwrite db/d1c/d5c/f6d [0,4194304] 0 2024-02-16T22:19:16.972 INFO:tasks.workunit.client.1.smithi173.stdout:1/646: creat db/fdd x:0 0 0 2024-02-16T22:19:16.976 INFO:tasks.workunit.client.1.smithi173.stdout:1/647: mkdir db/d29/d50/d85/dde 0 2024-02-16T22:19:16.976 INFO:tasks.workunit.client.1.smithi173.stdout:1/648: write db/d29/f39 [3613324,24690] 0 2024-02-16T22:19:16.978 INFO:tasks.workunit.client.1.smithi173.stdout:1/649: rename db/f4b to db/d1c/d25/d45/fdf 0 2024-02-16T22:19:16.979 INFO:tasks.workunit.client.1.smithi173.stdout:1/650: symlink db/d29/db5/le0 0 2024-02-16T22:19:16.979 INFO:tasks.workunit.client.1.smithi173.stdout:1/651: creat db/d5f/d97/fe1 x:0 0 0 2024-02-16T22:19:16.979 INFO:tasks.workunit.client.1.smithi173.stdout:1/652: fsync db/d1c/d25/d28/f6c 0 2024-02-16T22:19:16.981 INFO:tasks.workunit.client.1.smithi173.stdout:1/653: unlink db/d1c/d25/d28/d3f/c81 0 2024-02-16T22:19:16.982 INFO:tasks.workunit.client.1.smithi173.stdout:1/654: mknod db/d1c/d25/d28/ce2 0 2024-02-16T22:19:16.984 INFO:tasks.workunit.client.1.smithi173.stdout:1/655: rename db/d1c/d7f/d98/fcb to db/d1c/d25/fe3 0 2024-02-16T22:19:16.996 INFO:tasks.workunit.client.1.smithi173.stdout:1/656: rmdir db/d1c/d25/d28/d3f 39 2024-02-16T22:19:16.996 INFO:tasks.workunit.client.1.smithi173.stdout:1/657: read - db/d5f/d97/fba zero size 2024-02-16T22:19:16.998 INFO:tasks.workunit.client.1.smithi173.stdout:1/658: mknod db/d1c/d7f/ce4 0 2024-02-16T22:19:17.000 INFO:tasks.workunit.client.1.smithi173.stdout:1/659: creat db/d29/d83/fe5 x:0 0 0 2024-02-16T22:19:17.002 INFO:tasks.workunit.client.1.smithi173.stdout:1/660: link db/d29/d57/ldb db/d1c/d25/d28/d3f/le6 0 2024-02-16T22:19:17.014 INFO:tasks.workunit.client.1.smithi173.stdout:1/661: dread db/d1c/d25/d28/f3a [4194304,4194304] 0 2024-02-16T22:19:17.014 INFO:tasks.workunit.client.1.smithi173.stdout:1/662: chown db/d1d/f84 9297766 1 2024-02-16T22:19:17.016 INFO:tasks.workunit.client.1.smithi173.stdout:1/663: mknod db/d29/db5/ce7 0 2024-02-16T22:19:17.028 INFO:tasks.workunit.client.1.smithi173.stdout:1/664: write db/d1c/d25/d45/fdf [993614,66742] 0 2024-02-16T22:19:17.050 INFO:tasks.workunit.client.1.smithi173.stdout:1/665: dwrite db/d29/d50/f70 [0,4194304] 0 2024-02-16T22:19:17.053 INFO:tasks.workunit.client.1.smithi173.stdout:1/666: symlink db/d5f/da9/le8 0 2024-02-16T22:19:17.054 INFO:tasks.workunit.client.1.smithi173.stdout:1/667: creat db/d29/fe9 x:0 0 0 2024-02-16T22:19:17.056 INFO:tasks.workunit.client.1.smithi173.stdout:1/668: truncate db/d29/d57/d8c/fb6 158174 0 2024-02-16T22:19:17.058 INFO:tasks.workunit.client.1.smithi173.stdout:1/669: creat db/d1c/d7f/d98/fea x:0 0 0 2024-02-16T22:19:17.213 INFO:tasks.workunit.client.1.smithi173.stdout:8/727: sync 2024-02-16T22:19:17.214 INFO:tasks.workunit.client.1.smithi173.stdout:8/728: dread dd/d7c/d7d/f60 [0,4194304] 0 2024-02-16T22:19:17.234 INFO:tasks.workunit.client.1.smithi173.stdout:8/729: dwrite dd/d7c/d7d/d22/d2e/f7b [4194304,4194304] 0 2024-02-16T22:19:17.234 INFO:tasks.workunit.client.1.smithi173.stdout:8/730: write dd/d7c/d7d/d22/d2e/f57 [1547511,89459] 0 2024-02-16T22:19:17.252 INFO:tasks.workunit.client.1.smithi173.stdout:8/731: dwrite dd/d7c/d7d/d22/d2e/f57 [0,4194304] 0 2024-02-16T22:19:17.252 INFO:tasks.workunit.client.1.smithi173.stdout:8/732: write dd/d7c/d7d/f14 [272689,6347] 0 2024-02-16T22:19:17.254 INFO:tasks.workunit.client.1.smithi173.stdout:8/733: link dd/d9d/fa9 dd/dd9/fee 0 2024-02-16T22:19:17.273 INFO:tasks.workunit.client.1.smithi173.stdout:8/734: dwrite dd/d7c/d7d/d22/f3f [0,4194304] 0 2024-02-16T22:19:17.273 INFO:tasks.workunit.client.1.smithi173.stdout:8/735: chown dd/d7c/d7d/d22/d2e/d41 0 1 2024-02-16T22:19:17.274 INFO:tasks.workunit.client.1.smithi173.stdout:8/736: mknod dd/d7c/d7d/d22/d28/d40/de5/cef 0 2024-02-16T22:19:17.291 INFO:tasks.workunit.client.1.smithi173.stdout:8/737: dwrite dd/d7c/d7d/d22/d28/d40/f59 [0,4194304] 0 2024-02-16T22:19:17.294 INFO:tasks.workunit.client.1.smithi173.stdout:8/738: truncate dd/d7c/d7d/d22/d2e/d41/fb4 784748 0 2024-02-16T22:19:17.294 INFO:tasks.workunit.client.1.smithi173.stdout:8/739: chown fc 1770347 1 2024-02-16T22:19:17.301 INFO:tasks.workunit.client.1.smithi173.stdout:8/740: dread dd/d7c/d7d/d22/f32 [0,4194304] 0 2024-02-16T22:19:17.324 INFO:tasks.workunit.client.1.smithi173.stdout:8/741: dwrite dd/d7c/d7d/d22/f4e [0,4194304] 0 2024-02-16T22:19:17.382 INFO:tasks.workunit.client.1.smithi173.stdout:8/742: rmdir dd/d7c/d7d 39 2024-02-16T22:19:17.383 INFO:tasks.workunit.client.1.smithi173.stdout:8/743: truncate dd/fab 3699369 0 2024-02-16T22:19:17.385 INFO:tasks.workunit.client.1.smithi173.stdout:8/744: dread dd/d7c/d7d/d22/d2e/d41/d6b/f84 [0,4194304] 0 2024-02-16T22:19:17.386 INFO:tasks.workunit.client.1.smithi173.stdout:8/745: dread dd/d7c/d7d/d22/d50/fb3 [0,4194304] 0 2024-02-16T22:19:17.401 INFO:tasks.workunit.client.1.smithi173.stdout:8/746: dwrite dd/dd9/fee [0,4194304] 0 2024-02-16T22:19:17.403 INFO:tasks.workunit.client.1.smithi173.stdout:8/747: creat dd/d7c/d7d/d22/d2e/d41/ff0 x:0 0 0 2024-02-16T22:19:17.404 INFO:tasks.workunit.client.1.smithi173.stdout:8/748: rmdir dd/d7c/d7d/d89/dad 39 2024-02-16T22:19:17.404 INFO:tasks.workunit.client.1.smithi173.stdout:8/749: write fc [2767506,2900] 0 2024-02-16T22:19:17.428 INFO:tasks.workunit.client.1.smithi173.stdout:3/724: sync 2024-02-16T22:19:17.429 INFO:tasks.workunit.client.1.smithi173.stdout:3/725: dread - d9/d1a/d2b/d4d/d5b/fc5 zero size 2024-02-16T22:19:17.430 INFO:tasks.workunit.client.1.smithi173.stdout:3/726: link d9/d1a/l9b d9/d17/d93/lfa 0 2024-02-16T22:19:17.430 INFO:tasks.workunit.client.1.smithi173.stdout:3/727: write d9/d17/d25/f4a [2156493,60809] 0 2024-02-16T22:19:17.430 INFO:tasks.workunit.client.1.smithi173.stdout:3/728: stat d9/d18/d5f/d6e/f3d 0 2024-02-16T22:19:17.431 INFO:tasks.workunit.client.1.smithi173.stdout:3/729: dread d9/d18/d5f/d6e/d4e/f99 [0,4194304] 0 2024-02-16T22:19:17.432 INFO:tasks.workunit.client.1.smithi173.stdout:3/730: creat d9/d1a/d2b/d45/d60/ffb x:0 0 0 2024-02-16T22:19:17.433 INFO:tasks.workunit.client.1.smithi173.stdout:3/731: dread d9/d1a/f8e [0,4194304] 0 2024-02-16T22:19:17.450 INFO:tasks.workunit.client.1.smithi173.stdout:3/732: dwrite d9/d18/d5f/fea [0,4194304] 0 2024-02-16T22:19:17.451 INFO:tasks.workunit.client.1.smithi173.stdout:3/733: symlink d9/d18/d73/db7/d81/de1/lfc 0 2024-02-16T22:19:17.468 INFO:tasks.workunit.client.1.smithi173.stdout:3/734: dwrite d9/d1a/d2b/d45/d51/fdd [0,4194304] 0 2024-02-16T22:19:17.631 INFO:tasks.workunit.client.1.smithi173.stdout:2/591: sync 2024-02-16T22:19:17.631 INFO:tasks.workunit.client.1.smithi173.stdout:4/497: sync 2024-02-16T22:19:17.631 INFO:tasks.workunit.client.1.smithi173.stdout:9/515: sync 2024-02-16T22:19:17.631 INFO:tasks.workunit.client.1.smithi173.stdout:5/585: sync 2024-02-16T22:19:17.631 INFO:tasks.workunit.client.1.smithi173.stdout:9/516: chown d1/c1c 27196 1 2024-02-16T22:19:17.631 INFO:tasks.workunit.client.1.smithi173.stdout:0/422: sync 2024-02-16T22:19:17.631 INFO:tasks.workunit.client.1.smithi173.stdout:6/583: sync 2024-02-16T22:19:17.631 INFO:tasks.workunit.client.1.smithi173.stdout:1/670: sync 2024-02-16T22:19:17.632 INFO:tasks.workunit.client.1.smithi173.stdout:7/526: sync 2024-02-16T22:19:17.632 INFO:tasks.workunit.client.1.smithi173.stdout:2/592: mknod d2/dc/d19/d69/cc3 0 2024-02-16T22:19:17.632 INFO:tasks.workunit.client.1.smithi173.stdout:2/593: write d2/dc/d19/d1c/d53/fb1 [307312,48649] 0 2024-02-16T22:19:17.632 INFO:tasks.workunit.client.1.smithi173.stdout:2/594: chown d2/dc/d5d/d7a 4999688 1 2024-02-16T22:19:17.633 INFO:tasks.workunit.client.1.smithi173.stdout:2/595: chown d2/dc/d5d/d7a 6500 1 2024-02-16T22:19:17.635 INFO:tasks.workunit.client.1.smithi173.stdout:1/671: dread db/d1c/d25/d28/d3f/d4a/f54 [0,4194304] 0 2024-02-16T22:19:17.635 INFO:tasks.workunit.client.1.smithi173.stdout:9/517: rename d1/d2/f13 to d1/d2/d1a/d1f/d34/d49/faa 0 2024-02-16T22:19:17.635 INFO:tasks.workunit.client.1.smithi173.stdout:5/586: mkdir d8/da/d2d/d36/d50/db6 0 2024-02-16T22:19:17.636 INFO:tasks.workunit.client.1.smithi173.stdout:0/423: mknod d0/d4/d14/d50/c88 0 2024-02-16T22:19:17.637 INFO:tasks.workunit.client.1.smithi173.stdout:6/584: symlink d0/db/d2e/ld5 0 2024-02-16T22:19:17.637 INFO:tasks.workunit.client.1.smithi173.stdout:7/527: getdents d1/d1d/d4c/d63/d6c 0 2024-02-16T22:19:17.638 INFO:tasks.workunit.client.1.smithi173.stdout:7/528: dread - d1/d1d/d4c/d91/d81/f99 zero size 2024-02-16T22:19:17.638 INFO:tasks.workunit.client.1.smithi173.stdout:7/529: truncate d1/d1d/d4c/d63/d13/d36/d49/f6f 388716 0 2024-02-16T22:19:17.640 INFO:tasks.workunit.client.1.smithi173.stdout:9/518: mknod d1/d2/d1a/d3e/d4f/d8c/cab 0 2024-02-16T22:19:17.640 INFO:tasks.workunit.client.1.smithi173.stdout:9/519: read - d1/d5f/d61/d80/d6b/f7e zero size 2024-02-16T22:19:17.640 INFO:tasks.workunit.client.1.smithi173.stdout:6/585: mknod d0/db/d2e/d65/d9f/cd6 0 2024-02-16T22:19:17.640 INFO:tasks.workunit.client.1.smithi173.stdout:6/586: truncate d0/db/d2e/f3c 3168392 0 2024-02-16T22:19:17.642 INFO:tasks.workunit.client.1.smithi173.stdout:5/587: rmdir d8/da/d1f/d33 39 2024-02-16T22:19:17.645 INFO:tasks.workunit.client.1.smithi173.stdout:6/587: unlink d0/db/d2e/f3c 0 2024-02-16T22:19:17.645 INFO:tasks.workunit.client.1.smithi173.stdout:6/588: write d0/db/d2e/d65/db8/fca [374243,20676] 0 2024-02-16T22:19:17.646 INFO:tasks.workunit.client.1.smithi173.stdout:1/672: read db/d1c/d25/d28/f6c [3454169,73825] 0 2024-02-16T22:19:17.646 INFO:tasks.workunit.client.1.smithi173.stdout:5/588: mkdir d8/da/d1f/db7 0 2024-02-16T22:19:17.646 INFO:tasks.workunit.client.1.smithi173.stdout:1/673: write db/d1c/d5c/f6d [4819569,8056] 0 2024-02-16T22:19:17.648 INFO:tasks.workunit.client.1.smithi173.stdout:5/589: creat d8/da/d1f/fb8 x:0 0 0 2024-02-16T22:19:17.648 INFO:tasks.workunit.client.1.smithi173.stdout:5/590: dread - d8/da/d1b/faa zero size 2024-02-16T22:19:17.650 INFO:tasks.workunit.client.1.smithi173.stdout:9/520: dread d1/d2/d1a/d3e/f57 [0,4194304] 0 2024-02-16T22:19:17.651 INFO:tasks.workunit.client.1.smithi173.stdout:1/674: symlink db/d1c/d25/d28/d3f/d4a/leb 0 2024-02-16T22:19:17.651 INFO:tasks.workunit.client.1.smithi173.stdout:0/424: read d0/d4/d27/f57 [4735828,71910] 0 2024-02-16T22:19:17.651 INFO:tasks.workunit.client.1.smithi173.stdout:0/425: chown d0/d4/d33/d54/f5c 91630 1 2024-02-16T22:19:17.652 INFO:tasks.workunit.client.1.smithi173.stdout:6/589: getdents d0/db/d2e/d65/d73/d81 0 2024-02-16T22:19:17.654 INFO:tasks.workunit.client.1.smithi173.stdout:5/591: symlink d8/da/d1f/d8c/lb9 0 2024-02-16T22:19:17.654 INFO:tasks.workunit.client.1.smithi173.stdout:4/498: dwrite d7/d28/d14/f2a [0,4194304] 0 2024-02-16T22:19:17.654 INFO:tasks.workunit.client.1.smithi173.stdout:4/499: chown d7/d28/d31/d33/d7d/f5d 1317726 1 2024-02-16T22:19:17.656 INFO:tasks.workunit.client.1.smithi173.stdout:0/426: getdents d0/d4/d14/d50 0 2024-02-16T22:19:17.668 INFO:tasks.workunit.client.1.smithi173.stdout:2/596: dwrite d2/dc/d19/d1c/d87/f8a [0,4194304] 0 2024-02-16T22:19:17.671 INFO:tasks.workunit.client.1.smithi173.stdout:2/597: mkdir d2/dc/d19/dc4 0 2024-02-16T22:19:17.671 INFO:tasks.workunit.client.1.smithi173.stdout:7/530: dwrite d1/f2f [0,4194304] 0 2024-02-16T22:19:17.671 INFO:tasks.workunit.client.1.smithi173.stdout:4/500: dread d7/d9a/fa8 [0,4194304] 0 2024-02-16T22:19:17.671 INFO:tasks.workunit.client.1.smithi173.stdout:4/501: chown d7/d28/f1d 136874 1 2024-02-16T22:19:17.671 INFO:tasks.workunit.client.1.smithi173.stdout:4/502: truncate d7/d12/d2d/f8e 651921 0 2024-02-16T22:19:17.671 INFO:tasks.workunit.client.1.smithi173.stdout:7/531: write d1/d1d/d4c/d63/d13/d36/d49/f6f [1326035,28192] 0 2024-02-16T22:19:17.672 INFO:tasks.workunit.client.1.smithi173.stdout:2/598: creat d2/dc/d19/d1a/fc5 x:0 0 0 2024-02-16T22:19:17.672 INFO:tasks.workunit.client.1.smithi173.stdout:2/599: chown d2/dc/d5d/d7a/f8f 17227792 1 2024-02-16T22:19:17.675 INFO:tasks.workunit.client.1.smithi173.stdout:9/521: read d1/d2/d1a/f5d [1301051,82255] 0 2024-02-16T22:19:17.675 INFO:tasks.workunit.client.1.smithi173.stdout:9/522: read d1/d2/d1a/f26 [4639487,105368] 0 2024-02-16T22:19:17.676 INFO:tasks.workunit.client.1.smithi173.stdout:9/523: read - d1/d2/d1a/d2f/d3b/f84 zero size 2024-02-16T22:19:17.676 INFO:tasks.workunit.client.1.smithi173.stdout:9/524: chown d1/d2/d1a/d2f/f86 12388241 1 2024-02-16T22:19:17.677 INFO:tasks.workunit.client.1.smithi173.stdout:1/675: dread db/d1c/d25/d45/fdf [0,4194304] 0 2024-02-16T22:19:17.677 INFO:tasks.workunit.client.1.smithi173.stdout:1/676: chown db/d1c/d25/d28/ld3 121 1 2024-02-16T22:19:17.677 INFO:tasks.workunit.client.1.smithi173.stdout:1/677: chown db/d29/d50/fa6 6 1 2024-02-16T22:19:17.677 INFO:tasks.workunit.client.1.smithi173.stdout:9/525: mkdir d1/d2/d1a/d1f/d34/d49/dac 0 2024-02-16T22:19:17.677 INFO:tasks.workunit.client.1.smithi173.stdout:9/526: chown d1/f5a 152256 1 2024-02-16T22:19:17.677 INFO:tasks.workunit.client.1.smithi173.stdout:9/527: getdents d1/d2/da2 0 2024-02-16T22:19:17.677 INFO:tasks.workunit.client.1.smithi173.stdout:9/528: write d1/d2/d1a/d2f/d51/f7a [4233272,101858] 0 2024-02-16T22:19:17.678 INFO:tasks.workunit.client.1.smithi173.stdout:1/678: creat db/d29/d50/d85/fec x:0 0 0 2024-02-16T22:19:17.678 INFO:tasks.workunit.client.1.smithi173.stdout:7/532: write d1/d1d/d4c/d63/d13/d22/d53/d27/f73 [613024,50212] 0 2024-02-16T22:19:17.682 INFO:tasks.workunit.client.1.smithi173.stdout:9/529: rmdir d1/d2/d1a/d2f/d3b/d75 39 2024-02-16T22:19:17.683 INFO:tasks.workunit.client.1.smithi173.stdout:2/600: write d2/dc/d19/d1a/f34 [1719723,31596] 0 2024-02-16T22:19:17.687 INFO:tasks.workunit.client.1.smithi173.stdout:9/530: creat d1/d5f/d6d/d91/fad x:0 0 0 2024-02-16T22:19:17.688 INFO:tasks.workunit.client.1.smithi173.stdout:5/592: dwrite d8/f6a [0,4194304] 0 2024-02-16T22:19:17.688 INFO:tasks.workunit.client.1.smithi173.stdout:0/427: dwrite d0/d4/f2a [0,4194304] 0 2024-02-16T22:19:17.688 INFO:tasks.workunit.client.1.smithi173.stdout:0/428: readlink d0/d4/d14/d24/d32/d39/l56 0 2024-02-16T22:19:17.690 INFO:tasks.workunit.client.1.smithi173.stdout:5/593: creat d8/da/d2d/d56/fba x:0 0 0 2024-02-16T22:19:17.690 INFO:tasks.workunit.client.1.smithi173.stdout:5/594: creat d8/d27/d35/fbb x:0 0 0 2024-02-16T22:19:17.690 INFO:tasks.workunit.client.1.smithi173.stdout:9/531: rename d1/d2/d10/f59 to d1/d2/d1a/d1f/d34/fae 0 2024-02-16T22:19:17.690 INFO:tasks.workunit.client.1.smithi173.stdout:6/590: dwrite d0/db/d2e/d2f/d31/d33/f66 [0,4194304] 0 2024-02-16T22:19:17.693 INFO:tasks.workunit.client.1.smithi173.stdout:9/532: dread d1/d5f/f85 [0,4194304] 0 2024-02-16T22:19:17.695 INFO:tasks.workunit.client.1.smithi173.stdout:0/429: creat d0/d4/f89 x:0 0 0 2024-02-16T22:19:17.695 INFO:tasks.workunit.client.1.smithi173.stdout:0/430: chown d0/d4/f18 14 1 2024-02-16T22:19:17.695 INFO:tasks.workunit.client.1.smithi173.stdout:0/431: stat d0/d4/d27/l7d 0 2024-02-16T22:19:17.701 INFO:tasks.workunit.client.1.smithi173.stdout:0/432: dread d0/d4/d33/f3c [0,4194304] 0 2024-02-16T22:19:17.701 INFO:tasks.workunit.client.1.smithi173.stdout:5/595: mkdir d8/da/d1f/d33/d92/dbc 0 2024-02-16T22:19:17.701 INFO:tasks.workunit.client.1.smithi173.stdout:5/596: truncate d8/d27/d62/f68 745340 0 2024-02-16T22:19:17.708 INFO:tasks.workunit.client.1.smithi173.stdout:9/533: mknod d1/d2/d1a/d8b/caf 0 2024-02-16T22:19:17.709 INFO:tasks.workunit.client.1.smithi173.stdout:9/534: write d1/d2/f24 [129211,112181] 0 2024-02-16T22:19:17.709 INFO:tasks.workunit.client.1.smithi173.stdout:0/433: mkdir d0/d4/d33/d8a 0 2024-02-16T22:19:17.709 INFO:tasks.workunit.client.1.smithi173.stdout:0/434: chown d0/f5 9651199 1 2024-02-16T22:19:17.709 INFO:tasks.workunit.client.1.smithi173.stdout:6/591: creat d0/db/d2e/fd7 x:0 0 0 2024-02-16T22:19:17.711 INFO:tasks.workunit.client.1.smithi173.stdout:9/535: mkdir d1/d2/d1a/d1f/d34/db0 0 2024-02-16T22:19:17.711 INFO:tasks.workunit.client.1.smithi173.stdout:0/435: mknod d0/d84/c8b 0 2024-02-16T22:19:17.711 INFO:tasks.workunit.client.1.smithi173.stdout:0/436: chown d0/d4/d14/d50/f76 19 1 2024-02-16T22:19:17.711 INFO:tasks.workunit.client.1.smithi173.stdout:0/437: write d0/d4/d14/f2d [12908521,110788] 0 2024-02-16T22:19:17.712 INFO:tasks.workunit.client.1.smithi173.stdout:6/592: creat d0/db/d2e/d2f/d31/d33/d97/fd8 x:0 0 0 2024-02-16T22:19:17.713 INFO:tasks.workunit.client.1.smithi173.stdout:9/536: mkdir d1/d2/d1a/d2f/d3b/d75/db1 0 2024-02-16T22:19:17.715 INFO:tasks.workunit.client.1.smithi173.stdout:0/438: mkdir d0/d84/d8c 0 2024-02-16T22:19:17.715 INFO:tasks.workunit.client.1.smithi173.stdout:1/679: dwrite db/d30/f8d [0,4194304] 0 2024-02-16T22:19:17.716 INFO:tasks.workunit.client.1.smithi173.stdout:6/593: rename d0/db/d2e/d2f/l4f to d0/db/d2e/d2f/d31/ld9 0 2024-02-16T22:19:17.716 INFO:tasks.workunit.client.1.smithi173.stdout:6/594: chown d0/db/d2e/d2f/d31/d7a/cae 838291200 1 2024-02-16T22:19:17.717 INFO:tasks.workunit.client.1.smithi173.stdout:9/537: creat d1/d2/d1a/d1f/d34/fb2 x:0 0 0 2024-02-16T22:19:17.720 INFO:tasks.workunit.client.1.smithi173.stdout:7/533: dwrite d1/d1d/d4c/d63/d6c/f77 [0,4194304] 0 2024-02-16T22:19:17.722 INFO:tasks.workunit.client.1.smithi173.stdout:5/597: write d8/da/f24 [1848789,32840] 0 2024-02-16T22:19:17.722 INFO:tasks.workunit.client.1.smithi173.stdout:2/601: dwrite d2/d4/d8/d80/f9a [0,4194304] 0 2024-02-16T22:19:17.722 INFO:tasks.workunit.client.1.smithi173.stdout:2/602: stat d2/d4/d8/d30/d44/d83/f85 0 2024-02-16T22:19:17.722 INFO:tasks.workunit.client.1.smithi173.stdout:2/603: write d2/d4/d8/d30/f38 [918158,17915] 0 2024-02-16T22:19:17.722 INFO:tasks.workunit.client.1.smithi173.stdout:4/503: dwrite d7/d28/d52/d89/faa [0,4194304] 0 2024-02-16T22:19:17.725 INFO:tasks.workunit.client.1.smithi173.stdout:7/534: getdents d1/d1d/d4c/d63/d13/d22 0 2024-02-16T22:19:17.725 INFO:tasks.workunit.client.1.smithi173.stdout:7/535: fdatasync d1/d1d/d4c/d91/f95 0 2024-02-16T22:19:17.728 INFO:tasks.workunit.client.1.smithi173.stdout:5/598: mkdir d8/da/d2d/dbd 0 2024-02-16T22:19:17.734 INFO:tasks.workunit.client.1.smithi173.stdout:2/604: rename d2/dc/d19/d1c/f20 to d2/dc/d19/d1a/fc6 0 2024-02-16T22:19:17.735 INFO:tasks.workunit.client.1.smithi173.stdout:1/680: truncate db/d29/d57/f5d 595697 0 2024-02-16T22:19:17.736 INFO:tasks.workunit.client.1.smithi173.stdout:7/536: mknod d1/d1d/d4c/d63/d11/c9b 0 2024-02-16T22:19:17.737 INFO:tasks.workunit.client.1.smithi173.stdout:5/599: unlink d8/da/d1b/d57/c6e 0 2024-02-16T22:19:17.738 INFO:tasks.workunit.client.1.smithi173.stdout:2/605: rename d2/dc/l77 to d2/d4/d57/d82/lc7 0 2024-02-16T22:19:17.739 INFO:tasks.workunit.client.1.smithi173.stdout:1/681: stat db/d29/d57/d73/c96 0 2024-02-16T22:19:17.740 INFO:tasks.workunit.client.1.smithi173.stdout:5/600: creat d8/da/d1f/d30/fbe x:0 0 0 2024-02-16T22:19:17.740 INFO:tasks.workunit.client.1.smithi173.stdout:5/601: chown d8 818836968 1 2024-02-16T22:19:17.740 INFO:tasks.workunit.client.1.smithi173.stdout:5/602: write d8/da/fc [3433500,129466] 0 2024-02-16T22:19:17.742 INFO:tasks.workunit.client.1.smithi173.stdout:7/537: rename d1/f2f to d1/d1d/d4c/d63/d13/d22/f9c 0 2024-02-16T22:19:17.743 INFO:tasks.workunit.client.1.smithi173.stdout:2/606: unlink d2/dc/d5d/f15 0 2024-02-16T22:19:17.746 INFO:tasks.workunit.client.1.smithi173.stdout:1/682: rename db/d1c/d25/fe3 to db/d1c/d7f/fed 0 2024-02-16T22:19:17.749 INFO:tasks.workunit.client.1.smithi173.stdout:2/607: mkdir d2/d4/d57/dc8 0 2024-02-16T22:19:17.749 INFO:tasks.workunit.client.1.smithi173.stdout:2/608: truncate d2/dc/d19/d1c/f9c 222425 0 2024-02-16T22:19:17.749 INFO:tasks.workunit.client.1.smithi173.stdout:2/609: truncate d2/dc/d19/d69/dab/fac 653985 0 2024-02-16T22:19:17.749 INFO:tasks.workunit.client.1.smithi173.stdout:2/610: read d2/dc/d19/f16 [1608605,20386] 0 2024-02-16T22:19:17.751 INFO:tasks.workunit.client.1.smithi173.stdout:1/683: rename db/d1c/d5c/f86 to db/d30/fee 0 2024-02-16T22:19:17.751 INFO:tasks.workunit.client.1.smithi173.stdout:1/684: read - db/d1c/d5c/dac/dae/fcc zero size 2024-02-16T22:19:17.751 INFO:tasks.workunit.client.1.smithi173.stdout:1/685: stat db/d1c/d5c/dac/fcd 0 2024-02-16T22:19:17.752 INFO:tasks.workunit.client.1.smithi173.stdout:7/538: getdents d1/d1d/d4c/d91 0 2024-02-16T22:19:17.753 INFO:tasks.workunit.client.1.smithi173.stdout:2/611: symlink d2/dc/d19/da3/lc9 0 2024-02-16T22:19:17.754 INFO:tasks.workunit.client.1.smithi173.stdout:7/539: mkdir d1/d1d/d4c/d63/d48/d9a/d9d 0 2024-02-16T22:19:17.756 INFO:tasks.workunit.client.1.smithi173.stdout:2/612: rename d2/dc/d5d/d7a/ca9 to d2/cca 0 2024-02-16T22:19:17.760 INFO:tasks.workunit.client.1.smithi173.stdout:7/540: creat d1/d1d/d4c/d63/d13/d22/d7e/f9e x:0 0 0 2024-02-16T22:19:17.760 INFO:tasks.workunit.client.1.smithi173.stdout:7/541: write d1/d1d/d4c/d63/d13/d36/d49/f6f [1747802,20821] 0 2024-02-16T22:19:17.760 INFO:tasks.workunit.client.1.smithi173.stdout:7/542: chown d1/d1d/l88 487862017 1 2024-02-16T22:19:17.760 INFO:tasks.workunit.client.1.smithi173.stdout:8/750: sync 2024-02-16T22:19:17.760 INFO:tasks.workunit.client.1.smithi173.stdout:3/735: sync 2024-02-16T22:19:17.761 INFO:tasks.workunit.client.1.smithi173.stdout:7/543: mkdir d1/d1d/d4c/d91/d9f 0 2024-02-16T22:19:17.763 INFO:tasks.workunit.client.1.smithi173.stdout:3/736: truncate d9/d1a/d2b/d45/f88 575668 0 2024-02-16T22:19:17.763 INFO:tasks.workunit.client.1.smithi173.stdout:3/737: chown d9/d1a/d2b/d45/d51/c58 0 1 2024-02-16T22:19:17.763 INFO:tasks.workunit.client.1.smithi173.stdout:3/738: chown d9/d1a/d2b/d45/c64 14590 1 2024-02-16T22:19:17.765 INFO:tasks.workunit.client.1.smithi173.stdout:7/544: unlink d1/d1d/d4c/d91/d81/f8f 0 2024-02-16T22:19:17.765 INFO:tasks.workunit.client.1.smithi173.stdout:6/595: dwrite d0/db/d2e/d65/db8/fca [0,4194304] 0 2024-02-16T22:19:17.765 INFO:tasks.workunit.client.1.smithi173.stdout:6/596: rename d0/db/d2e/d2f/da6 to d0/db/d2e/d2f/da6/dda 22 2024-02-16T22:19:17.767 INFO:tasks.workunit.client.1.smithi173.stdout:8/751: getdents dd/d7c/d7d/d22/d5a 0 2024-02-16T22:19:17.768 INFO:tasks.workunit.client.1.smithi173.stdout:3/739: rmdir d9/d1a/d2b/d4d/d5b/da9/db4 39 2024-02-16T22:19:17.771 INFO:tasks.workunit.client.1.smithi173.stdout:8/752: link dd/d7c/d7d/d22/d2e/d41/fb4 dd/d7c/d7d/d89/dad/ff1 0 2024-02-16T22:19:17.772 INFO:tasks.workunit.client.1.smithi173.stdout:4/504: dwrite d7/d12/f30 [0,4194304] 0 2024-02-16T22:19:17.777 INFO:tasks.workunit.client.1.smithi173.stdout:4/505: mkdir d7/d12/d2d/dad 0 2024-02-16T22:19:17.777 INFO:tasks.workunit.client.1.smithi173.stdout:4/506: creat d7/d12/d2d/fae x:0 0 0 2024-02-16T22:19:17.779 INFO:tasks.workunit.client.1.smithi173.stdout:0/439: dwrite d0/ff [0,4194304] 0 2024-02-16T22:19:17.779 INFO:tasks.workunit.client.1.smithi173.stdout:9/538: dwrite d1/d2/d1a/d2f/d3b/f7c [0,4194304] 0 2024-02-16T22:19:17.781 INFO:tasks.workunit.client.1.smithi173.stdout:1/686: dwrite db/d29/d57/d8c/fd4 [0,4194304] 0 2024-02-16T22:19:17.782 INFO:tasks.workunit.client.1.smithi173.stdout:5/603: dwrite d8/da/d1b/f95 [0,4194304] 0 2024-02-16T22:19:17.783 INFO:tasks.workunit.client.1.smithi173.stdout:9/539: mkdir d1/d2/d1a/d2f/d51/d96/db3 0 2024-02-16T22:19:17.787 INFO:tasks.workunit.client.1.smithi173.stdout:5/604: mknod d8/da/d2d/d3a/cbf 0 2024-02-16T22:19:17.787 INFO:tasks.workunit.client.1.smithi173.stdout:1/687: creat db/d1c/d25/d45/fef x:0 0 0 2024-02-16T22:19:17.789 INFO:tasks.workunit.client.1.smithi173.stdout:1/688: mknod db/d1c/d5c/dac/dae/cf0 0 2024-02-16T22:19:17.792 INFO:tasks.workunit.client.1.smithi173.stdout:1/689: mkdir db/d1c/d25/d45/df1 0 2024-02-16T22:19:17.792 INFO:tasks.workunit.client.1.smithi173.stdout:2/613: dwrite d2/d10/d62/f78 [0,4194304] 0 2024-02-16T22:19:17.795 INFO:tasks.workunit.client.1.smithi173.stdout:0/440: write d0/d4/f2a [4109290,60638] 0 2024-02-16T22:19:17.796 INFO:tasks.workunit.client.1.smithi173.stdout:1/690: link ca db/d1c/d25/d28/d3f/d4a/cf2 0 2024-02-16T22:19:17.796 INFO:tasks.workunit.client.1.smithi173.stdout:1/691: readlink db/d5f/da9/le8 0 2024-02-16T22:19:17.796 INFO:tasks.workunit.client.1.smithi173.stdout:1/692: chown db/d5f/d97/fe1 1747 1 2024-02-16T22:19:17.796 INFO:tasks.workunit.client.1.smithi173.stdout:1/693: chown db/d1c/c22 2900315 1 2024-02-16T22:19:17.796 INFO:tasks.workunit.client.1.smithi173.stdout:1/694: chown db/d1d/c7e 183071 1 2024-02-16T22:19:17.799 INFO:tasks.workunit.client.1.smithi173.stdout:2/614: symlink d2/d4/d57/lcb 0 2024-02-16T22:19:17.803 INFO:tasks.workunit.client.1.smithi173.stdout:1/695: rename db/f24 to db/d1c/d25/d45/df1/ff3 0 2024-02-16T22:19:17.804 INFO:tasks.workunit.client.1.smithi173.stdout:1/696: chown db/d30/ca4 14162074 1 2024-02-16T22:19:17.805 INFO:tasks.workunit.client.1.smithi173.stdout:2/615: rename d2/c36 to d2/ccc 0 2024-02-16T22:19:17.805 INFO:tasks.workunit.client.1.smithi173.stdout:2/616: write d2/dc/d19/d1a/fc2 [86156,71811] 0 2024-02-16T22:19:17.805 INFO:tasks.workunit.client.1.smithi173.stdout:2/617: chown d2/dc/d19/d1a/d74 343 1 2024-02-16T22:19:17.806 INFO:tasks.workunit.client.1.smithi173.stdout:5/605: write d8/da/d2d/d3a/da7/f77 [1791175,5805] 0 2024-02-16T22:19:17.807 INFO:tasks.workunit.client.1.smithi173.stdout:1/697: rename db/d1c/d25/d45/fef to db/d29/db5/ff4 0 2024-02-16T22:19:17.810 INFO:tasks.workunit.client.1.smithi173.stdout:5/606: rmdir d8/d27/d2f/db3 0 2024-02-16T22:19:17.813 INFO:tasks.workunit.client.1.smithi173.stdout:6/597: dwrite d0/db/f3d [0,4194304] 0 2024-02-16T22:19:17.816 INFO:tasks.workunit.client.1.smithi173.stdout:3/740: dwrite d9/da/f43 [0,4194304] 0 2024-02-16T22:19:17.816 INFO:tasks.workunit.client.1.smithi173.stdout:5/607: fdatasync d8/da/d2d/d3a/da7/f77 0 2024-02-16T22:19:17.816 INFO:tasks.workunit.client.1.smithi173.stdout:6/598: mknod d0/db/d2e/d2f/da6/daa/cdb 0 2024-02-16T22:19:17.816 INFO:tasks.workunit.client.1.smithi173.stdout:4/507: dwrite d7/f9 [0,4194304] 0 2024-02-16T22:19:17.817 INFO:tasks.workunit.client.1.smithi173.stdout:4/508: write d7/d9a/fa9 [514745,51000] 0 2024-02-16T22:19:17.817 INFO:tasks.workunit.client.1.smithi173.stdout:2/618: read d2/dc/d19/d1c/d53/fb1 [240600,47100] 0 2024-02-16T22:19:17.817 INFO:tasks.workunit.client.1.smithi173.stdout:7/545: dwrite d1/d1d/d4c/d63/d13/d36/d49/f7f [0,4194304] 0 2024-02-16T22:19:17.817 INFO:tasks.workunit.client.1.smithi173.stdout:7/546: write d1/d1d/d4c/d63/f4 [5374,25319] 0 2024-02-16T22:19:17.817 INFO:tasks.workunit.client.1.smithi173.stdout:8/753: fsync dd/d7c/d7d/d22/d2e/d41/fb4 0 2024-02-16T22:19:17.817 INFO:tasks.workunit.client.1.smithi173.stdout:8/754: write dd/d7c/dcb/fa1 [871177,118251] 0 2024-02-16T22:19:17.820 INFO:tasks.workunit.client.1.smithi173.stdout:1/698: dread db/d1c/d5c/f88 [0,4194304] 0 2024-02-16T22:19:17.820 INFO:tasks.workunit.client.1.smithi173.stdout:9/540: dwrite d1/d2/d1a/d1f/d34/f55 [0,4194304] 0 2024-02-16T22:19:17.820 INFO:tasks.workunit.client.1.smithi173.stdout:3/741: dread d9/d1a/d2b/d4d/d5b/f89 [0,4194304] 0 2024-02-16T22:19:17.823 INFO:tasks.workunit.client.1.smithi173.stdout:4/509: mknod d7/d28/d31/d72/caf 0 2024-02-16T22:19:17.824 INFO:tasks.workunit.client.1.smithi173.stdout:8/755: creat dd/d7c/d7d/d58/dd5/ff2 x:0 0 0 2024-02-16T22:19:17.825 INFO:tasks.workunit.client.1.smithi173.stdout:5/608: getdents d8/da/d1b/d57 0 2024-02-16T22:19:17.826 INFO:tasks.workunit.client.1.smithi173.stdout:5/609: write d8/da/d1f/d33/f83 [4349855,4592] 0 2024-02-16T22:19:17.828 INFO:tasks.workunit.client.1.smithi173.stdout:1/699: unlink db/d30/f8d 0 2024-02-16T22:19:17.831 INFO:tasks.workunit.client.1.smithi173.stdout:3/742: symlink d9/lfd 0 2024-02-16T22:19:17.832 INFO:tasks.workunit.client.1.smithi173.stdout:4/510: unlink d7/d28/d31/d33/d7d/f98 0 2024-02-16T22:19:17.833 INFO:tasks.workunit.client.1.smithi173.stdout:8/756: mkdir dd/d7c/d7d/d89/df3 0 2024-02-16T22:19:17.835 INFO:tasks.workunit.client.1.smithi173.stdout:5/610: rmdir d8/da/d1b 39 2024-02-16T22:19:17.836 INFO:tasks.workunit.client.1.smithi173.stdout:3/743: dread d9/d1a/d2b/d4d/d5b/f5e [0,4194304] 0 2024-02-16T22:19:17.837 INFO:tasks.workunit.client.1.smithi173.stdout:3/744: dread d9/d1a/d2b/d4d/f4f [0,4194304] 0 2024-02-16T22:19:17.838 INFO:tasks.workunit.client.1.smithi173.stdout:3/745: chown d9/d1a/d2b/d4d/c55 48747758 1 2024-02-16T22:19:17.838 INFO:tasks.workunit.client.1.smithi173.stdout:4/511: mknod d7/d28/d31/d33/d7d/d45/cb0 0 2024-02-16T22:19:17.839 INFO:tasks.workunit.client.1.smithi173.stdout:8/757: mkdir dd/d7c/d7d/d22/d28/d40/d69/df4 0 2024-02-16T22:19:17.839 INFO:tasks.workunit.client.1.smithi173.stdout:8/758: dread - dd/feb zero size 2024-02-16T22:19:17.839 INFO:tasks.workunit.client.1.smithi173.stdout:8/759: write dd/d7c/d7d/d22/d2e/d41/d6b/f8e [5000468,79201] 0 2024-02-16T22:19:17.840 INFO:tasks.workunit.client.1.smithi173.stdout:5/611: symlink d8/lc0 0 2024-02-16T22:19:17.840 INFO:tasks.workunit.client.1.smithi173.stdout:5/612: write d8/da/d1b/f52 [2481939,36905] 0 2024-02-16T22:19:17.841 INFO:tasks.workunit.client.1.smithi173.stdout:5/613: write d8/d27/d62/f68 [394002,92491] 0 2024-02-16T22:19:17.841 INFO:tasks.workunit.client.1.smithi173.stdout:5/614: truncate d8/da/d1f/d8c/f98 42629 0 2024-02-16T22:19:17.841 INFO:tasks.workunit.client.1.smithi173.stdout:5/615: fsync d8/da/d1f/fb8 0 2024-02-16T22:19:17.841 INFO:tasks.workunit.client.1.smithi173.stdout:5/616: write d8/da/d1f/d30/fbe [382458,75700] 0 2024-02-16T22:19:17.841 INFO:tasks.workunit.client.1.smithi173.stdout:4/512: mknod d7/df/d8b/da1/cb1 0 2024-02-16T22:19:17.841 INFO:tasks.workunit.client.1.smithi173.stdout:4/513: chown d7/df/l56 2948862 1 2024-02-16T22:19:17.844 INFO:tasks.workunit.client.1.smithi173.stdout:5/617: symlink d8/d27/d35/d8b/lc1 0 2024-02-16T22:19:17.844 INFO:tasks.workunit.client.1.smithi173.stdout:5/618: read - d8/da/d2d/d56/fa5 zero size 2024-02-16T22:19:17.847 INFO:tasks.workunit.client.1.smithi173.stdout:4/514: rename d7/d28/d31/d33/d7d/d3d/f5b to d7/d28/fb2 0 2024-02-16T22:19:17.847 INFO:tasks.workunit.client.1.smithi173.stdout:4/515: chown d7/d28/d52/d89 340332 1 2024-02-16T22:19:17.848 INFO:tasks.workunit.client.1.smithi173.stdout:7/547: dwrite d1/f9 [0,4194304] 0 2024-02-16T22:19:17.848 INFO:tasks.workunit.client.1.smithi173.stdout:9/541: dwrite d1/f12 [4194304,4194304] 0 2024-02-16T22:19:17.848 INFO:tasks.workunit.client.1.smithi173.stdout:7/548: stat d1/d1d/d4c/d63/ff 0 2024-02-16T22:19:17.848 INFO:tasks.workunit.client.1.smithi173.stdout:5/619: mkdir d8/da/d2d/d36/dc2 0 2024-02-16T22:19:17.849 INFO:tasks.workunit.client.1.smithi173.stdout:3/746: dread d9/d1a/f2c [0,4194304] 0 2024-02-16T22:19:17.849 INFO:tasks.workunit.client.1.smithi173.stdout:3/747: chown d9/d1a/d2b/d4d/f83 3573344 1 2024-02-16T22:19:17.849 INFO:tasks.workunit.client.1.smithi173.stdout:3/748: stat d9/da/l19 0 2024-02-16T22:19:17.849 INFO:tasks.workunit.client.1.smithi173.stdout:4/516: symlink d7/d28/d31/d33/d7d/d4e/lb3 0 2024-02-16T22:19:17.850 INFO:tasks.workunit.client.1.smithi173.stdout:6/599: getdents d0/db/d2e/d2f/da6/daa 0 2024-02-16T22:19:17.852 INFO:tasks.workunit.client.1.smithi173.stdout:7/549: creat d1/d1d/d4c/d63/d13/fa0 x:0 0 0 2024-02-16T22:19:17.852 INFO:tasks.workunit.client.1.smithi173.stdout:7/550: readlink d1/d1d/d4c/d91/d81/l94 0 2024-02-16T22:19:17.853 INFO:tasks.workunit.client.1.smithi173.stdout:9/542: creat d1/d2/fb4 x:0 0 0 2024-02-16T22:19:17.854 INFO:tasks.workunit.client.1.smithi173.stdout:9/543: dread - d1/d5f/d6d/f74 zero size 2024-02-16T22:19:17.856 INFO:tasks.workunit.client.1.smithi173.stdout:5/620: unlink d8/da/d1f/d8c/f98 0 2024-02-16T22:19:17.856 INFO:tasks.workunit.client.1.smithi173.stdout:5/621: creat d8/fc3 x:0 0 0 2024-02-16T22:19:17.856 INFO:tasks.workunit.client.1.smithi173.stdout:3/749: link d9/d18/d5f/d6e/f3d d9/d1a/d2b/d4d/d5b/da9/db4/ffe 0 2024-02-16T22:19:17.858 INFO:tasks.workunit.client.1.smithi173.stdout:3/750: write d9/d1a/d2b/d4d/d5b/f5e [1120571,36640] 0 2024-02-16T22:19:17.858 INFO:tasks.workunit.client.1.smithi173.stdout:6/600: rmdir d0 39 2024-02-16T22:19:17.860 INFO:tasks.workunit.client.1.smithi173.stdout:7/551: creat d1/d1d/fa1 x:0 0 0 2024-02-16T22:19:17.862 INFO:tasks.workunit.client.1.smithi173.stdout:5/622: unlink d8/d27/d28/c85 0 2024-02-16T22:19:17.865 INFO:tasks.workunit.client.1.smithi173.stdout:3/751: rename d9/da/cef to d9/d17/d25/dcf/cff 0 2024-02-16T22:19:17.867 INFO:tasks.workunit.client.1.smithi173.stdout:5/623: unlink d8/da/d1b/f95 0 2024-02-16T22:19:17.869 INFO:tasks.workunit.client.1.smithi173.stdout:3/752: mknod d9/d18/d5f/d6e/da7/de6/c100 0 2024-02-16T22:19:17.871 INFO:tasks.workunit.client.1.smithi173.stdout:6/601: unlink d0/f70 0 2024-02-16T22:19:17.872 INFO:tasks.workunit.client.1.smithi173.stdout:5/624: link d8/da/d2d/d3a/f74 d8/da/d1f/d6f/fc4 0 2024-02-16T22:19:17.872 INFO:tasks.workunit.client.1.smithi173.stdout:5/625: stat d8/da/d1f/d33/f5a 0 2024-02-16T22:19:17.875 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:17 smithi173 ceph-mon[37280]: pgmap v261: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 139 MiB/s rd, 164 MiB/s wr, 300 op/s 2024-02-16T22:19:17.877 INFO:tasks.workunit.client.1.smithi173.stdout:9/544: dwrite d1/d2/d1a/d2f/d51/d96/f9b [0,4194304] 0 2024-02-16T22:19:17.877 INFO:tasks.workunit.client.1.smithi173.stdout:9/545: chown d1/d2/d1a/d2f/d51 144650 1 2024-02-16T22:19:17.879 INFO:tasks.workunit.client.1.smithi173.stdout:4/517: rmdir d7/d28/d31/d33/d7d 39 2024-02-16T22:19:17.879 INFO:tasks.workunit.client.1.smithi173.stdout:4/518: dread - d7/d28/d31/d33/d7d/d45/f94 zero size 2024-02-16T22:19:17.880 INFO:tasks.workunit.client.1.smithi173.stdout:7/552: dwrite d1/d1d/d4c/d63/d54/f70 [4194304,4194304] 0 2024-02-16T22:19:17.884 INFO:tasks.workunit.client.1.smithi173.stdout:6/602: write d0/fb9 [1940954,210] 0 2024-02-16T22:19:17.885 INFO:tasks.workunit.client.1.smithi173.stdout:4/519: mkdir d7/d28/d31/d72/d93/d95/db4 0 2024-02-16T22:19:17.886 INFO:tasks.workunit.client.1.smithi173.stdout:7/553: truncate d1/d1d/d4c/d63/d48/f5c 312666 0 2024-02-16T22:19:17.888 INFO:tasks.workunit.client.1.smithi173.stdout:6/603: unlink d0/db/d2e/f87 0 2024-02-16T22:19:17.889 INFO:tasks.workunit.client.1.smithi173.stdout:7/554: symlink d1/d1d/d4c/d91/la2 0 2024-02-16T22:19:17.891 INFO:tasks.workunit.client.1.smithi173.stdout:7/555: symlink d1/d1d/d4c/d63/d48/la3 0 2024-02-16T22:19:17.893 INFO:tasks.workunit.client.1.smithi173.stdout:7/556: symlink d1/d1d/d4c/d63/d13/d36/d49/la4 0 2024-02-16T22:19:17.894 INFO:tasks.workunit.client.1.smithi173.stdout:7/557: creat d1/d1d/d4c/d63/fa5 x:0 0 0 2024-02-16T22:19:17.894 INFO:tasks.workunit.client.1.smithi173.stdout:5/626: dwrite d8/da/d2d/faf [0,4194304] 0 2024-02-16T22:19:17.896 INFO:tasks.workunit.client.1.smithi173.stdout:7/558: rmdir d1/d1d/d4c/d63/d48/d9a/d9d 0 2024-02-16T22:19:17.896 INFO:tasks.workunit.client.1.smithi173.stdout:7/559: chown d1/d1d/f93 990242142 1 2024-02-16T22:19:17.896 INFO:tasks.workunit.client.1.smithi173.stdout:7/560: truncate d1/d1d/d4c/d63/d13/d36/d49/f6f 1937979 0 2024-02-16T22:19:17.901 INFO:tasks.workunit.client.1.smithi173.stdout:5/627: link d8/da/fc d8/da/d1f/d8c/fc5 0 2024-02-16T22:19:17.909 INFO:tasks.workunit.client.1.smithi173.stdout:4/520: dwrite d7/df/f58 [0,4194304] 0 2024-02-16T22:19:17.909 INFO:tasks.workunit.client.1.smithi173.stdout:4/521: stat d7/d28/d31/d33/d7d/d4e/lb3 0 2024-02-16T22:19:17.909 INFO:tasks.workunit.client.1.smithi173.stdout:4/522: truncate d7/d12/d2d/fae 746948 0 2024-02-16T22:19:17.909 INFO:tasks.workunit.client.1.smithi173.stdout:4/523: write d7/d28/d31/f37 [8915218,29095] 0 2024-02-16T22:19:17.913 INFO:tasks.workunit.client.1.smithi173.stdout:7/561: symlink d1/d1d/d4c/d63/d13/d36/la6 0 2024-02-16T22:19:17.915 INFO:tasks.workunit.client.1.smithi173.stdout:9/546: dwrite d1/f23 [4194304,4194304] 0 2024-02-16T22:19:17.915 INFO:tasks.workunit.client.1.smithi173.stdout:9/547: truncate d1/d5f/d6d/d91/fad 971899 0 2024-02-16T22:19:17.915 INFO:tasks.workunit.client.1.smithi173.stdout:9/548: dread - d1/d2/d1a/d2f/f86 zero size 2024-02-16T22:19:17.915 INFO:tasks.workunit.client.1.smithi173.stdout:5/628: dread d8/d27/d62/f4a [0,4194304] 0 2024-02-16T22:19:17.916 INFO:tasks.workunit.client.1.smithi173.stdout:5/629: chown d8/da/d2d/d36 7 1 2024-02-16T22:19:17.917 INFO:tasks.workunit.client.1.smithi173.stdout:4/524: getdents d7/df/d8b/da1 0 2024-02-16T22:19:17.919 INFO:tasks.workunit.client.1.smithi173.stdout:9/549: rename d1/d2/fb4 to d1/d2/d1a/d3e/d4f/fb5 0 2024-02-16T22:19:17.919 INFO:tasks.workunit.client.1.smithi173.stdout:9/550: readlink d1/d2/d1a/l32 0 2024-02-16T22:19:17.919 INFO:tasks.workunit.client.1.smithi173.stdout:9/551: chown d1/d5f/d6d/d91/fa0 0 1 2024-02-16T22:19:17.919 INFO:tasks.workunit.client.1.smithi173.stdout:9/552: chown d1/d2/d1a/d3e/d4f/fb5 489 1 2024-02-16T22:19:17.921 INFO:tasks.workunit.client.1.smithi173.stdout:5/630: creat d8/da/d1b/d57/d97/fc6 x:0 0 0 2024-02-16T22:19:17.921 INFO:tasks.workunit.client.1.smithi173.stdout:5/631: read - d8/da/d1f/d30/d9b/f9c zero size 2024-02-16T22:19:17.924 INFO:tasks.workunit.client.1.smithi173.stdout:4/525: creat d7/fb5 x:0 0 0 2024-02-16T22:19:17.924 INFO:tasks.workunit.client.1.smithi173.stdout:4/526: symlink d7/d28/d52/d89/lb6 0 2024-02-16T22:19:17.926 INFO:tasks.workunit.client.1.smithi173.stdout:4/527: rename d7/d28/d31/d33/d7d/d3d/f8d to d7/d28/d52/fb7 0 2024-02-16T22:19:17.932 INFO:tasks.workunit.client.1.smithi173.stdout:9/553: read d1/d2/d1a/d1f/d34/f55 [781170,109451] 0 2024-02-16T22:19:17.932 INFO:tasks.workunit.client.1.smithi173.stdout:9/554: readlink d1/d2/d10/l98 0 2024-02-16T22:19:17.932 INFO:tasks.workunit.client.1.smithi173.stdout:9/555: write d1/f18 [27,28948] 0 2024-02-16T22:19:17.932 INFO:tasks.workunit.client.1.smithi173.stdout:9/556: creat d1/d2/d1a/d3e/d4f/d8c/fb6 x:0 0 0 2024-02-16T22:19:17.933 INFO:tasks.workunit.client.1.smithi173.stdout:7/562: dwrite d1/d1d/d4c/d63/d13/d22/d53/d27/f65 [0,4194304] 0 2024-02-16T22:19:17.934 INFO:tasks.workunit.client.1.smithi173.stdout:9/557: creat d1/d2/d1a/d1f/d34/d49/fb7 x:0 0 0 2024-02-16T22:19:17.936 INFO:tasks.workunit.client.1.smithi173.stdout:9/558: write d1/d2/d10/f46 [505052,38476] 0 2024-02-16T22:19:17.936 INFO:tasks.workunit.client.1.smithi173.stdout:7/563: mknod d1/d1d/d4c/ca7 0 2024-02-16T22:19:17.939 INFO:tasks.workunit.client.1.smithi173.stdout:4/528: dread d7/d12/d2d/f5c [0,4194304] 0 2024-02-16T22:19:17.940 INFO:tasks.workunit.client.1.smithi173.stdout:4/529: symlink d7/d28/d31/d33/d7d/lb8 0 2024-02-16T22:19:17.941 INFO:tasks.workunit.client.1.smithi173.stdout:4/530: fsync d7/d28/d31/d33/d7d/d45/f79 0 2024-02-16T22:19:17.941 INFO:tasks.workunit.client.1.smithi173.stdout:5/632: dwrite d8/da/d1f/d33/f83 [0,4194304] 0 2024-02-16T22:19:17.941 INFO:tasks.workunit.client.1.smithi173.stdout:5/633: dread - d8/d27/d35/fbb zero size 2024-02-16T22:19:17.941 INFO:tasks.workunit.client.1.smithi173.stdout:5/634: write f7 [3323017,97085] 0 2024-02-16T22:19:17.943 INFO:tasks.workunit.client.1.smithi173.stdout:4/531: rename d7/d12/f19 to d7/d28/d52/d89/fb9 0 2024-02-16T22:19:17.946 INFO:tasks.workunit.client.1.smithi173.stdout:4/532: mknod d7/d12/cba 0 2024-02-16T22:19:17.946 INFO:tasks.workunit.client.1.smithi173.stdout:4/533: creat d7/d12/d7e/fbb x:0 0 0 2024-02-16T22:19:17.946 INFO:tasks.workunit.client.1.smithi173.stdout:4/534: chown d7/df/f22 4 1 2024-02-16T22:19:17.950 INFO:tasks.workunit.client.1.smithi173.stdout:5/635: dread d8/da/d1f/d8c/fc5 [0,4194304] 0 2024-02-16T22:19:17.950 INFO:tasks.workunit.client.1.smithi173.stdout:7/564: read d1/d1d/d4c/d63/d13/d22/f9c [2769818,47258] 0 2024-02-16T22:19:17.952 INFO:tasks.workunit.client.1.smithi173.stdout:7/565: link d1/d1d/d4c/d63/d13/c16 d1/d1d/d4c/d63/d13/d22/d53/d27/ca8 0 2024-02-16T22:19:17.955 INFO:tasks.workunit.client.1.smithi173.stdout:7/566: rename d1/d1d/d4c/d63/d13/d36/la6 to d1/d1d/d4c/d63/d6c/la9 0 2024-02-16T22:19:17.955 INFO:tasks.workunit.client.1.smithi173.stdout:7/567: creat d1/d1d/d4c/d63/d48/faa x:0 0 0 2024-02-16T22:19:17.955 INFO:tasks.workunit.client.1.smithi173.stdout:9/559: dwrite d1/d2/d1a/d3e/d4f/d8c/fb6 [0,4194304] 0 2024-02-16T22:19:17.955 INFO:tasks.workunit.client.1.smithi173.stdout:9/560: readlink d1/d2/d1a/l32 0 2024-02-16T22:19:17.956 INFO:tasks.workunit.client.1.smithi173.stdout:4/535: write d7/d28/d31/d33/d7d/f47 [291108,47456] 0 2024-02-16T22:19:17.956 INFO:tasks.workunit.client.1.smithi173.stdout:4/536: dread - d7/d28/d31/d33/d7d/d4e/f83 zero size 2024-02-16T22:19:17.957 INFO:tasks.workunit.client.1.smithi173.stdout:7/568: mknod d1/d1d/d4c/d63/d48/cab 0 2024-02-16T22:19:17.957 INFO:tasks.workunit.client.1.smithi173.stdout:7/569: chown d1/l7 13951 1 2024-02-16T22:19:17.958 INFO:tasks.workunit.client.1.smithi173.stdout:7/570: truncate d1/d1d/d4c/d63/d13/d36/d49/f86 441691 0 2024-02-16T22:19:17.959 INFO:tasks.workunit.client.1.smithi173.stdout:9/561: dread d1/d5f/d61/d80/f66 [0,4194304] 0 2024-02-16T22:19:17.960 INFO:tasks.workunit.client.1.smithi173.stdout:7/571: mknod d1/d1d/d4c/d63/d13/d22/d53/d27/cac 0 2024-02-16T22:19:17.960 INFO:tasks.workunit.client.1.smithi173.stdout:7/572: fsync d1/d1d/d4c/d63/fa5 0 2024-02-16T22:19:17.960 INFO:tasks.workunit.client.1.smithi173.stdout:9/562: mknod d1/cb8 0 2024-02-16T22:19:17.962 INFO:tasks.workunit.client.1.smithi173.stdout:7/573: link d1/d1d/d4c/d63/d48/cab d1/d1d/d4c/d91/d9f/cad 0 2024-02-16T22:19:17.964 INFO:tasks.workunit.client.1.smithi173.stdout:7/574: unlink d1/d1d/d4c/d63/d13/f67 0 2024-02-16T22:19:17.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:17 smithi134 ceph-mon[28869]: pgmap v261: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 139 MiB/s rd, 164 MiB/s wr, 300 op/s 2024-02-16T22:19:17.977 INFO:tasks.workunit.client.1.smithi173.stdout:9/563: read d1/f23 [6395682,47820] 0 2024-02-16T22:19:17.977 INFO:tasks.workunit.client.1.smithi173.stdout:9/564: write d1/d2/d1a/d3e/d4f/d8c/f9d [1047823,4431] 0 2024-02-16T22:19:17.978 INFO:tasks.workunit.client.1.smithi173.stdout:9/565: stat d1/d2/d10/c9e 0 2024-02-16T22:19:17.978 INFO:tasks.workunit.client.1.smithi173.stdout:5/636: dwrite d8/da/d1f/d33/f83 [4194304,4194304] 0 2024-02-16T22:19:17.979 INFO:tasks.workunit.client.1.smithi173.stdout:7/575: dread d1/d1d/d4c/d63/d6c/f77 [0,4194304] 0 2024-02-16T22:19:17.980 INFO:tasks.workunit.client.1.smithi173.stdout:9/566: rename d1/d5f/d61/f6c to d1/d5f/fb9 0 2024-02-16T22:19:17.980 INFO:tasks.workunit.client.1.smithi173.stdout:9/567: truncate f0 784759 0 2024-02-16T22:19:17.981 INFO:tasks.workunit.client.1.smithi173.stdout:4/537: dwrite d7/d12/d2d/f5c [0,4194304] 0 2024-02-16T22:19:17.984 INFO:tasks.workunit.client.1.smithi173.stdout:5/637: unlink d8/d27/c41 0 2024-02-16T22:19:17.984 INFO:tasks.workunit.client.1.smithi173.stdout:9/568: write d1/d2/d1a/d2f/f8e [91781,69075] 0 2024-02-16T22:19:17.986 INFO:tasks.workunit.client.1.smithi173.stdout:7/576: unlink d1/d1d/d4c/d63/d11/f42 0 2024-02-16T22:19:17.988 INFO:tasks.workunit.client.1.smithi173.stdout:5/638: symlink d8/da/d2d/d56/lc7 0 2024-02-16T22:19:17.989 INFO:tasks.workunit.client.1.smithi173.stdout:7/577: dread d1/d1d/d4c/d63/d11/f14 [0,4194304] 0 2024-02-16T22:19:17.997 INFO:tasks.workunit.client.1.smithi173.stdout:7/578: creat d1/d1d/d4c/d63/d13/d36/d49/fae x:0 0 0 2024-02-16T22:19:17.998 INFO:tasks.workunit.client.1.smithi173.stdout:5/639: rename d8/d27/d62/l3c to d8/da/d1f/d30/lc8 0 2024-02-16T22:19:17.999 INFO:tasks.workunit.client.1.smithi173.stdout:7/579: symlink d1/d1d/d4c/d80/laf 0 2024-02-16T22:19:17.999 INFO:tasks.workunit.client.1.smithi173.stdout:7/580: readlink d1/l7 0 2024-02-16T22:19:17.999 INFO:tasks.workunit.client.1.smithi173.stdout:7/581: chown d1/d1d/d4c/d63/ff 31 1 2024-02-16T22:19:18.001 INFO:tasks.workunit.client.1.smithi173.stdout:5/640: rename d8/da/d1f/d33 to d8/da/d1b/d57/dc9 0 2024-02-16T22:19:18.001 INFO:tasks.workunit.client.1.smithi173.stdout:9/569: dwrite d1/d2/d1a/d1f/f2c [4194304,4194304] 0 2024-02-16T22:19:18.003 INFO:tasks.workunit.client.1.smithi173.stdout:7/582: rename d1/d1d/d44/f57 to d1/d1d/d4c/d63/d11/fb0 0 2024-02-16T22:19:18.005 INFO:tasks.workunit.client.1.smithi173.stdout:5/641: link d8/f26 d8/da/d1b/d57/dc9/d92/fca 0 2024-02-16T22:19:18.009 INFO:tasks.workunit.client.1.smithi173.stdout:9/570: mknod d1/d5f/d61/d80/d6b/cba 0 2024-02-16T22:19:18.011 INFO:tasks.workunit.client.1.smithi173.stdout:7/583: truncate d1/d1d/d4c/d63/d13/d36/d49/f68 3154265 0 2024-02-16T22:19:18.011 INFO:tasks.workunit.client.1.smithi173.stdout:7/584: chown d1/f41 14 1 2024-02-16T22:19:18.013 INFO:tasks.workunit.client.1.smithi173.stdout:5/642: getdents d8/da/d2d 0 2024-02-16T22:19:18.018 INFO:tasks.workunit.client.1.smithi173.stdout:9/571: mkdir d1/d2/d1a/d1f/d34/dbb 0 2024-02-16T22:19:18.018 INFO:tasks.workunit.client.1.smithi173.stdout:9/572: fdatasync d1/d2/d1a/f95 0 2024-02-16T22:19:18.018 INFO:tasks.workunit.client.1.smithi173.stdout:9/573: fsync d1/d2/f4c 0 2024-02-16T22:19:18.018 INFO:tasks.workunit.client.1.smithi173.stdout:9/574: write d1/d2/d1a/d3e/fa9 [743422,130515] 0 2024-02-16T22:19:18.020 INFO:tasks.workunit.client.1.smithi173.stdout:7/585: creat d1/d1d/d4c/d91/d9f/fb1 x:0 0 0 2024-02-16T22:19:18.020 INFO:tasks.workunit.client.1.smithi173.stdout:7/586: write d1/d1d/d4c/d63/d13/d36/d49/f7d [1035485,43134] 0 2024-02-16T22:19:18.021 INFO:tasks.workunit.client.1.smithi173.stdout:9/575: creat d1/d5f/d6d/d97/fbc x:0 0 0 2024-02-16T22:19:18.021 INFO:tasks.workunit.client.1.smithi173.stdout:9/576: stat d1/d2/d1a/d1f/d34/d49 0 2024-02-16T22:19:18.021 INFO:tasks.workunit.client.1.smithi173.stdout:9/577: chown d1/d2/d1a/d1f/f43 291180 1 2024-02-16T22:19:18.025 INFO:tasks.workunit.client.1.smithi173.stdout:9/578: rename d1/d2/d10/l98 to d1/d2/d1a/d2f/d3b/lbd 0 2024-02-16T22:19:18.025 INFO:tasks.workunit.client.1.smithi173.stdout:9/579: write d1/d2/d1a/d2f/f50 [330781,41261] 0 2024-02-16T22:19:18.026 INFO:tasks.workunit.client.1.smithi173.stdout:9/580: truncate d1/d2/d10/f63 1297995 0 2024-02-16T22:19:18.028 INFO:tasks.workunit.client.1.smithi173.stdout:5/643: write d8/da/d2d/d36/fb2 [1075065,114362] 0 2024-02-16T22:19:18.029 INFO:tasks.workunit.client.1.smithi173.stdout:7/587: write d1/d1d/d4c/d63/d6c/f77 [188112,117619] 0 2024-02-16T22:19:18.029 INFO:tasks.workunit.client.1.smithi173.stdout:5/644: truncate d8/da/d1b/d57/dc9/f5a 1251505 0 2024-02-16T22:19:18.038 INFO:tasks.workunit.client.1.smithi173.stdout:9/581: rename d1/d5f/d61/d80/d6b to d1/d2/d1a/d1f/d34/dbb/dbe 0 2024-02-16T22:19:18.040 INFO:tasks.workunit.client.1.smithi173.stdout:5/645: write d8/d27/d35/f5e [1739089,120164] 0 2024-02-16T22:19:18.040 INFO:tasks.workunit.client.1.smithi173.stdout:5/646: fsync d8/d27/d35/f44 0 2024-02-16T22:19:18.040 INFO:tasks.workunit.client.1.smithi173.stdout:5/647: readlink d8/da/d1f/d30/l66 0 2024-02-16T22:19:18.041 INFO:tasks.workunit.client.1.smithi173.stdout:9/582: creat d1/d2/d1a/d1f/d34/dbb/dbe/fbf x:0 0 0 2024-02-16T22:19:18.044 INFO:tasks.workunit.client.1.smithi173.stdout:5/648: getdents d8/da/d2d/d36/d50 0 2024-02-16T22:19:18.046 INFO:tasks.workunit.client.1.smithi173.stdout:5/649: mkdir d8/da/d1b/d57/dcb 0 2024-02-16T22:19:18.046 INFO:tasks.workunit.client.1.smithi173.stdout:9/583: dread d1/d2/d1a/d3e/d4f/d8c/f9d [0,4194304] 0 2024-02-16T22:19:18.046 INFO:tasks.workunit.client.1.smithi173.stdout:9/584: chown d1/d2/f4c 917247259 1 2024-02-16T22:19:18.046 INFO:tasks.workunit.client.1.smithi173.stdout:9/585: chown d1/f18 34 1 2024-02-16T22:19:18.047 INFO:tasks.workunit.client.1.smithi173.stdout:5/650: truncate d8/d27/d35/f44 3541447 0 2024-02-16T22:19:18.051 INFO:tasks.workunit.client.1.smithi173.stdout:9/586: link d1/d2/d1a/d2f/d3b/f7c d1/d2/d10/fc0 0 2024-02-16T22:19:18.053 INFO:tasks.workunit.client.1.smithi173.stdout:7/588: dwrite d1/d1d/f20 [4194304,4194304] 0 2024-02-16T22:19:18.054 INFO:tasks.workunit.client.1.smithi173.stdout:9/587: creat d1/d2/d1a/d1f/d34/dbb/dbe/fc1 x:0 0 0 2024-02-16T22:19:18.057 INFO:tasks.workunit.client.1.smithi173.stdout:9/588: creat d1/d5f/d6d/d91/da7/fc2 x:0 0 0 2024-02-16T22:19:18.061 INFO:tasks.workunit.client.1.smithi173.stdout:7/589: rename d1/d1d/d4c/d63/d11/c6e to d1/d1d/d4c/d63/d13/d22/d53/cb2 0 2024-02-16T22:19:18.061 INFO:tasks.workunit.client.1.smithi173.stdout:7/590: chown d1/d1d/d4c/d63/d48 4592 1 2024-02-16T22:19:18.064 INFO:tasks.workunit.client.1.smithi173.stdout:7/591: getdents d1/d1d/d4c/d63/d48/d9a 0 2024-02-16T22:19:18.070 INFO:tasks.workunit.client.1.smithi173.stdout:5/651: dwrite d8/da/f47 [0,4194304] 0 2024-02-16T22:19:18.073 INFO:tasks.workunit.client.1.smithi173.stdout:9/589: rmdir d1/d2 39 2024-02-16T22:19:18.073 INFO:tasks.workunit.client.1.smithi173.stdout:9/590: write d1/d2/d1a/f28 [4234660,30412] 0 2024-02-16T22:19:18.083 INFO:tasks.workunit.client.1.smithi173.stdout:0/441: sync 2024-02-16T22:19:18.085 INFO:tasks.workunit.client.1.smithi173.stdout:0/442: unlink d0/f11 0 2024-02-16T22:19:18.087 INFO:tasks.workunit.client.1.smithi173.stdout:0/443: getdents d0/d4/d14/d24/d5f 0 2024-02-16T22:19:18.087 INFO:tasks.workunit.client.1.smithi173.stdout:0/444: chown d0/d4/f8 361483513 1 2024-02-16T22:19:18.087 INFO:tasks.workunit.client.1.smithi173.stdout:0/445: write d0/d12/d15/d3d/f65 [1737596,38575] 0 2024-02-16T22:19:18.087 INFO:tasks.workunit.client.1.smithi173.stdout:0/446: write d0/d4/d14/d24/d32/d39/f75 [241480,26290] 0 2024-02-16T22:19:18.087 INFO:tasks.workunit.client.1.smithi173.stdout:0/447: creat d0/d4/d14/f8d x:0 0 0 2024-02-16T22:19:18.087 INFO:tasks.workunit.client.1.smithi173.stdout:0/448: read d0/d12/d15/f1c [895172,7622] 0 2024-02-16T22:19:18.088 INFO:tasks.workunit.client.1.smithi173.stdout:0/449: mkdir d0/d4/d14/d24/d2e/d6b/d8e 0 2024-02-16T22:19:18.088 INFO:tasks.workunit.client.1.smithi173.stdout:0/450: write d0/d4/d27/f5a [1258065,33781] 0 2024-02-16T22:19:18.089 INFO:tasks.workunit.client.1.smithi173.stdout:0/451: mknod d0/d4/d27/c8f 0 2024-02-16T22:19:18.092 INFO:tasks.workunit.client.1.smithi173.stdout:7/592: dwrite d1/d1d/d4c/d63/d13/d36/f4d [0,4194304] 0 2024-02-16T22:19:18.095 INFO:tasks.workunit.client.1.smithi173.stdout:7/593: creat d1/d1d/d4c/d63/d48/d9a/fb3 x:0 0 0 2024-02-16T22:19:18.096 INFO:tasks.workunit.client.1.smithi173.stdout:7/594: dread - d1/d1d/d44/f7c zero size 2024-02-16T22:19:18.096 INFO:tasks.workunit.client.1.smithi173.stdout:7/595: readlink d1/d1d/d4c/d91/l5a 0 2024-02-16T22:19:18.097 INFO:tasks.workunit.client.1.smithi173.stdout:7/596: rename d1/d1d/f93 to d1/d1d/fb4 0 2024-02-16T22:19:18.098 INFO:tasks.workunit.client.1.smithi173.stdout:9/591: dwrite d1/d2/d1a/d1f/f43 [0,4194304] 0 2024-02-16T22:19:18.099 INFO:tasks.workunit.client.1.smithi173.stdout:7/597: mkdir d1/d1d/d4c/d63/d13/d22/d7e/db5 0 2024-02-16T22:19:18.099 INFO:tasks.workunit.client.1.smithi173.stdout:7/598: fsync d1/d1d/d4c/d63/d48/f75 0 2024-02-16T22:19:18.099 INFO:tasks.workunit.client.1.smithi173.stdout:9/592: getdents d1/d2/d1a/d3e 0 2024-02-16T22:19:18.099 INFO:tasks.workunit.client.1.smithi173.stdout:9/593: fdatasync d1/d2/d10/f48 0 2024-02-16T22:19:18.100 INFO:tasks.workunit.client.1.smithi173.stdout:7/599: mknod d1/d1d/d4c/d63/d54/cb6 0 2024-02-16T22:19:18.100 INFO:tasks.workunit.client.1.smithi173.stdout:7/600: readlink d1/d1d/d4c/d63/d13/d22/l66 0 2024-02-16T22:19:18.101 INFO:tasks.workunit.client.1.smithi173.stdout:5/652: dwrite d8/da/f23 [0,4194304] 0 2024-02-16T22:19:18.101 INFO:tasks.workunit.client.1.smithi173.stdout:9/594: symlink d1/d2/d1a/d3e/d4f/d8c/d92/lc3 0 2024-02-16T22:19:18.102 INFO:tasks.workunit.client.1.smithi173.stdout:9/595: write d1/d2/d1a/f95 [1730928,32596] 0 2024-02-16T22:19:18.102 INFO:tasks.workunit.client.1.smithi173.stdout:9/596: chown d1/d2/d1a/d2f/d51/c9f 0 1 2024-02-16T22:19:18.104 INFO:tasks.workunit.client.1.smithi173.stdout:7/601: mkdir d1/d1d/d4c/d91/db7 0 2024-02-16T22:19:18.104 INFO:tasks.workunit.client.1.smithi173.stdout:7/602: stat d1/d1d/d4c/d63/d13/d22/l66 0 2024-02-16T22:19:18.107 INFO:tasks.workunit.client.1.smithi173.stdout:5/653: mkdir d8/da/d1f/d8c/dcc 0 2024-02-16T22:19:18.107 INFO:tasks.workunit.client.1.smithi173.stdout:5/654: read d8/d27/d35/f5e [2011642,16071] 0 2024-02-16T22:19:18.107 INFO:tasks.workunit.client.1.smithi173.stdout:5/655: write d8/da/d2d/d36/f8a [23095,24117] 0 2024-02-16T22:19:18.108 INFO:tasks.workunit.client.1.smithi173.stdout:7/603: symlink d1/d1d/d4c/d91/d81/lb8 0 2024-02-16T22:19:18.112 INFO:tasks.workunit.client.1.smithi173.stdout:5/656: mkdir d8/da/d1b/d57/dc9/d92/dbc/dcd 0 2024-02-16T22:19:18.112 INFO:tasks.workunit.client.1.smithi173.stdout:5/657: write d8/f2e [2769048,76925] 0 2024-02-16T22:19:18.112 INFO:tasks.workunit.client.1.smithi173.stdout:5/658: getdents d8/da/d1f/d8c/dcc 0 2024-02-16T22:19:18.112 INFO:tasks.workunit.client.1.smithi173.stdout:5/659: stat d8/d27/d62/c99 0 2024-02-16T22:19:18.116 INFO:tasks.workunit.client.1.smithi173.stdout:0/452: dwrite d0/f1e [8388608,4194304] 0 2024-02-16T22:19:18.116 INFO:tasks.workunit.client.1.smithi173.stdout:7/604: dread d1/d1d/f20 [0,4194304] 0 2024-02-16T22:19:18.117 INFO:tasks.workunit.client.1.smithi173.stdout:0/453: fdatasync d0/d4/d27/f73 0 2024-02-16T22:19:18.120 INFO:tasks.workunit.client.1.smithi173.stdout:7/605: mkdir d1/d1d/d4c/d63/d13/d22/d53/db9 0 2024-02-16T22:19:18.121 INFO:tasks.workunit.client.1.smithi173.stdout:7/606: symlink d1/d1d/d44/lba 0 2024-02-16T22:19:18.124 INFO:tasks.workunit.client.1.smithi173.stdout:7/607: symlink d1/d1d/d4c/d63/d6c/lbb 0 2024-02-16T22:19:18.124 INFO:tasks.workunit.client.1.smithi173.stdout:7/608: dread - d1/d1d/d4c/d91/d81/f99 zero size 2024-02-16T22:19:18.124 INFO:tasks.workunit.client.1.smithi173.stdout:7/609: readlink d1/d1d/d4c/d63/d48/la3 0 2024-02-16T22:19:18.125 INFO:tasks.workunit.client.1.smithi173.stdout:7/610: mkdir d1/d1d/d4c/d63/d13/d22/d53/db9/dbc 0 2024-02-16T22:19:18.125 INFO:tasks.workunit.client.1.smithi173.stdout:7/611: write d1/d1d/d4c/d63/d13/d36/f38 [1752746,25408] 0 2024-02-16T22:19:18.126 INFO:tasks.workunit.client.1.smithi173.stdout:7/612: truncate d1/d1d/d4c/d63/d13/d36/d49/f7f 5650225 0 2024-02-16T22:19:18.128 INFO:tasks.workunit.client.1.smithi173.stdout:7/613: mkdir d1/d1d/d4c/d63/d13/d22/d7e/dbd 0 2024-02-16T22:19:18.128 INFO:tasks.workunit.client.1.smithi173.stdout:7/614: write d1/d1d/d4c/d63/d13/d36/d49/f74 [13008,57807] 0 2024-02-16T22:19:18.130 INFO:tasks.workunit.client.1.smithi173.stdout:7/615: mknod d1/d1d/d4c/d63/d13/d22/d7e/dbd/cbe 0 2024-02-16T22:19:18.130 INFO:tasks.workunit.client.1.smithi173.stdout:7/616: write d1/d1d/d4c/d63/d48/faa [792694,86214] 0 2024-02-16T22:19:18.131 INFO:tasks.workunit.client.1.smithi173.stdout:7/617: creat d1/d1d/d4c/d91/fbf x:0 0 0 2024-02-16T22:19:18.131 INFO:tasks.workunit.client.1.smithi173.stdout:7/618: chown d1/d1d/f20 91170 1 2024-02-16T22:19:18.134 INFO:tasks.workunit.client.1.smithi173.stdout:9/597: dwrite d1/d2/d10/f46 [0,4194304] 0 2024-02-16T22:19:18.136 INFO:tasks.workunit.client.1.smithi173.stdout:9/598: mknod d1/d2/da2/cc4 0 2024-02-16T22:19:18.137 INFO:tasks.workunit.client.1.smithi173.stdout:9/599: rmdir d1/d2/d1a/d2f/d3b 39 2024-02-16T22:19:18.137 INFO:tasks.workunit.client.1.smithi173.stdout:5/660: dwrite d8/da/d2d/d3a/f74 [0,4194304] 0 2024-02-16T22:19:18.139 INFO:tasks.workunit.client.1.smithi173.stdout:9/600: creat d1/d2/da2/fc5 x:0 0 0 2024-02-16T22:19:18.143 INFO:tasks.workunit.client.1.smithi173.stdout:0/454: truncate d0/d4/d14/f2d 3298427 0 2024-02-16T22:19:18.155 INFO:tasks.workunit.client.1.smithi173.stdout:7/619: dwrite d1/d1d/d4c/d63/d13/d36/d49/f74 [0,4194304] 0 2024-02-16T22:19:18.159 INFO:tasks.workunit.client.1.smithi173.stdout:5/661: creat d8/da/d2d/fce x:0 0 0 2024-02-16T22:19:18.159 INFO:tasks.workunit.client.1.smithi173.stdout:5/662: chown d8/d27/d28/f5b 6 1 2024-02-16T22:19:18.159 INFO:tasks.workunit.client.1.smithi173.stdout:5/663: creat d8/d27/d62/fcf x:0 0 0 2024-02-16T22:19:18.159 INFO:tasks.workunit.client.1.smithi173.stdout:5/664: getdents d8/da/d2d/d36/d50/db6 0 2024-02-16T22:19:18.159 INFO:tasks.workunit.client.1.smithi173.stdout:5/665: dread - d8/da/d1f/d30/d9b/fa6 zero size 2024-02-16T22:19:18.159 INFO:tasks.workunit.client.1.smithi173.stdout:5/666: dread - d8/da/d1b/d57/f75 zero size 2024-02-16T22:19:18.159 INFO:tasks.workunit.client.1.smithi173.stdout:5/667: chown d8/da/d1b/l42 17881 1 2024-02-16T22:19:18.159 INFO:tasks.workunit.client.1.smithi173.stdout:5/668: getdents d8/da/d2d/d36/d50/db6 0 2024-02-16T22:19:18.160 INFO:tasks.workunit.client.1.smithi173.stdout:9/601: creat d1/d2/d1a/d1f/d34/dbb/dbe/fc6 x:0 0 0 2024-02-16T22:19:18.160 INFO:tasks.workunit.client.1.smithi173.stdout:9/602: getdents d1/d2/d1a/d2f/d3b/da6 0 2024-02-16T22:19:18.160 INFO:tasks.workunit.client.1.smithi173.stdout:9/603: write d1/d5f/d61/fa1 [274019,87251] 0 2024-02-16T22:19:18.166 INFO:tasks.workunit.client.1.smithi173.stdout:9/604: symlink d1/d5f/d61/lc7 0 2024-02-16T22:19:18.166 INFO:tasks.workunit.client.1.smithi173.stdout:9/605: chown d1/d5f/f85 662513 1 2024-02-16T22:19:18.167 INFO:tasks.workunit.client.1.smithi173.stdout:9/606: mkdir d1/d2/d1a/d3e/dc8 0 2024-02-16T22:19:18.169 INFO:tasks.workunit.client.1.smithi173.stdout:5/669: dread d8/da/f24 [0,4194304] 0 2024-02-16T22:19:18.169 INFO:tasks.workunit.client.1.smithi173.stdout:5/670: creat d8/da/d1b/d57/d97/fd0 x:0 0 0 2024-02-16T22:19:18.172 INFO:tasks.workunit.client.1.smithi173.stdout:5/671: mkdir d8/da/d1b/d57/dc9/d92/dbc/dcd/dd1 0 2024-02-16T22:19:18.172 INFO:tasks.workunit.client.1.smithi173.stdout:5/672: creat d8/d27/d35/fd2 x:0 0 0 2024-02-16T22:19:18.172 INFO:tasks.workunit.client.1.smithi173.stdout:5/673: creat d8/da/d2d/fd3 x:0 0 0 2024-02-16T22:19:18.172 INFO:tasks.workunit.client.1.smithi173.stdout:5/674: write d8/d27/d35/fbb [960124,69120] 0 2024-02-16T22:19:18.174 INFO:tasks.workunit.client.1.smithi173.stdout:5/675: symlink d8/da/d1f/d6f/ld4 0 2024-02-16T22:19:18.174 INFO:tasks.workunit.client.1.smithi173.stdout:5/676: stat d8/da/d1b/d57/dc9/f3e 0 2024-02-16T22:19:18.178 INFO:tasks.workunit.client.1.smithi173.stdout:2/619: sync 2024-02-16T22:19:18.179 INFO:tasks.workunit.client.1.smithi173.stdout:8/760: sync 2024-02-16T22:19:18.181 INFO:tasks.workunit.client.1.smithi173.stdout:1/700: sync 2024-02-16T22:19:18.181 INFO:tasks.workunit.client.1.smithi173.stdout:1/701: chown db/d29/d57/ldb 82 1 2024-02-16T22:19:18.182 INFO:tasks.workunit.client.1.smithi173.stdout:9/607: write d1/d2/d1a/d1f/f43 [1415979,113306] 0 2024-02-16T22:19:18.183 INFO:tasks.workunit.client.1.smithi173.stdout:9/608: read d1/f23 [4237828,62687] 0 2024-02-16T22:19:18.183 INFO:tasks.workunit.client.1.smithi173.stdout:9/609: read - d1/d2/d1a/d1f/d34/dbb/dbe/fc6 zero size 2024-02-16T22:19:18.183 INFO:tasks.workunit.client.1.smithi173.stdout:8/761: write dd/d7c/d7d/f3d [153559,60584] 0 2024-02-16T22:19:18.184 INFO:tasks.workunit.client.1.smithi173.stdout:7/620: dwrite d1/f82 [0,4194304] 0 2024-02-16T22:19:18.185 INFO:tasks.workunit.client.1.smithi173.stdout:1/702: rename db/d29/d50/fa6 to db/d1c/d25/d28/d3f/d4a/ff5 0 2024-02-16T22:19:18.186 INFO:tasks.workunit.client.1.smithi173.stdout:6/604: sync 2024-02-16T22:19:18.186 INFO:tasks.workunit.client.1.smithi173.stdout:4/538: sync 2024-02-16T22:19:18.186 INFO:tasks.workunit.client.1.smithi173.stdout:3/753: sync 2024-02-16T22:19:18.186 INFO:tasks.workunit.client.1.smithi173.stdout:4/539: stat d7/d12/cba 0 2024-02-16T22:19:18.187 INFO:tasks.workunit.client.1.smithi173.stdout:0/455: dwrite d0/d4/f7 [0,4194304] 0 2024-02-16T22:19:18.187 INFO:tasks.workunit.client.1.smithi173.stdout:9/610: creat d1/d2/fc9 x:0 0 0 2024-02-16T22:19:18.187 INFO:tasks.workunit.client.1.smithi173.stdout:9/611: creat d1/d5f/fca x:0 0 0 2024-02-16T22:19:18.188 INFO:tasks.workunit.client.1.smithi173.stdout:9/612: write d1/d2/d1a/d2f/d3b/f72 [795100,105414] 0 2024-02-16T22:19:18.188 INFO:tasks.workunit.client.1.smithi173.stdout:9/613: fsync d1/d2/d1a/f5d 0 2024-02-16T22:19:18.190 INFO:tasks.workunit.client.1.smithi173.stdout:8/762: link dd/d7c/d7d/d22/d2e/c38 dd/d7c/d7d/d22/d2e/cf5 0 2024-02-16T22:19:18.190 INFO:tasks.workunit.client.1.smithi173.stdout:4/540: dread d7/f5f [0,4194304] 0 2024-02-16T22:19:18.190 INFO:tasks.workunit.client.1.smithi173.stdout:4/541: dread - d7/d28/d31/d33/d7d/d4e/fa4 zero size 2024-02-16T22:19:18.190 INFO:tasks.workunit.client.1.smithi173.stdout:5/677: dread d8/da/d1b/d57/dc9/f83 [0,4194304] 0 2024-02-16T22:19:18.191 INFO:tasks.workunit.client.1.smithi173.stdout:7/621: unlink d1/d1d/d4c/d63/c46 0 2024-02-16T22:19:18.191 INFO:tasks.workunit.client.1.smithi173.stdout:9/614: dread d1/d2/d1a/d3e/fa9 [0,4194304] 0 2024-02-16T22:19:18.192 INFO:tasks.workunit.client.1.smithi173.stdout:9/615: readlink d1/d2/d1a/d1f/l37 0 2024-02-16T22:19:18.192 INFO:tasks.workunit.client.1.smithi173.stdout:1/703: creat db/d29/d8f/ff6 x:0 0 0 2024-02-16T22:19:18.193 INFO:tasks.workunit.client.1.smithi173.stdout:6/605: stat d0/d7c/dc5 0 2024-02-16T22:19:18.193 INFO:tasks.workunit.client.1.smithi173.stdout:6/606: chown d0/d7c/dc5/c98 9 1 2024-02-16T22:19:18.193 INFO:tasks.workunit.client.1.smithi173.stdout:6/607: chown d0/db/d2e/d2f/f45 1485 1 2024-02-16T22:19:18.195 INFO:tasks.workunit.client.1.smithi173.stdout:5/678: dread d8/da/d1b/f90 [0,4194304] 0 2024-02-16T22:19:18.196 INFO:tasks.workunit.client.1.smithi173.stdout:3/754: mknod d9/d18/d73/db7/d81/ddf/c101 0 2024-02-16T22:19:18.202 INFO:tasks.workunit.client.1.smithi173.stdout:4/542: unlink d7/d28/c4d 0 2024-02-16T22:19:18.202 INFO:tasks.workunit.client.1.smithi173.stdout:4/543: readlink d7/d12/d2d/l86 0 2024-02-16T22:19:18.204 INFO:tasks.workunit.client.1.smithi173.stdout:7/622: link d1/d1d/d4c/d63/d13/c19 d1/d1d/d4c/d63/d54/cc0 0 2024-02-16T22:19:18.205 INFO:tasks.workunit.client.1.smithi173.stdout:9/616: mknod d1/d5f/d6d/d97/ccb 0 2024-02-16T22:19:18.206 INFO:tasks.workunit.client.1.smithi173.stdout:1/704: mknod db/d1c/d7f/d98/cf7 0 2024-02-16T22:19:18.208 INFO:tasks.workunit.client.1.smithi173.stdout:6/608: mkdir d0/db/d2e/d2f/da6/ddc 0 2024-02-16T22:19:18.208 INFO:tasks.workunit.client.1.smithi173.stdout:5/679: mknod d8/da/d2d/cd5 0 2024-02-16T22:19:18.209 INFO:tasks.workunit.client.1.smithi173.stdout:5/680: write d8/da/d2d/d36/f40 [20426,60920] 0 2024-02-16T22:19:18.209 INFO:tasks.workunit.client.1.smithi173.stdout:8/763: getdents dd/d7c/d7d/d22/d28/d40/d69/da7/dae 0 2024-02-16T22:19:18.209 INFO:tasks.workunit.client.1.smithi173.stdout:8/764: chown dd/d7c/d7d/d93/daa 1030290 1 2024-02-16T22:19:18.211 INFO:tasks.workunit.client.1.smithi173.stdout:4/544: symlink d7/d28/d31/d72/lbc 0 2024-02-16T22:19:18.211 INFO:tasks.workunit.client.1.smithi173.stdout:4/545: write d7/d28/d14/f40 [87256,27648] 0 2024-02-16T22:19:18.213 INFO:tasks.workunit.client.1.smithi173.stdout:7/623: creat d1/d1d/d4c/d63/d13/d22/d7e/dbd/fc1 x:0 0 0 2024-02-16T22:19:18.213 INFO:tasks.workunit.client.1.smithi173.stdout:7/624: dread - d1/d1d/d4c/d63/d13/d36/d49/fae zero size 2024-02-16T22:19:18.213 INFO:tasks.workunit.client.1.smithi173.stdout:0/456: dwrite d0/d12/d15/f85 [0,4194304] 0 2024-02-16T22:19:18.213 INFO:tasks.workunit.client.1.smithi173.stdout:3/755: dwrite d9/d1a/d2b/d4d/d94/d98/fbb [0,4194304] 0 2024-02-16T22:19:18.215 INFO:tasks.workunit.client.1.smithi173.stdout:1/705: link db/d1c/d25/d28/ce2 db/cf8 0 2024-02-16T22:19:18.215 INFO:tasks.workunit.client.1.smithi173.stdout:1/706: write db/d29/d8f/f93 [967033,130415] 0 2024-02-16T22:19:18.216 INFO:tasks.workunit.client.1.smithi173.stdout:6/609: creat d0/db/d2e/d2f/da6/ddc/fdd x:0 0 0 2024-02-16T22:19:18.217 INFO:tasks.workunit.client.1.smithi173.stdout:5/681: mknod d8/da/d1b/d57/dc9/d92/cd6 0 2024-02-16T22:19:18.219 INFO:tasks.workunit.client.1.smithi173.stdout:1/707: dread db/f18 [0,4194304] 0 2024-02-16T22:19:18.219 INFO:tasks.workunit.client.1.smithi173.stdout:4/546: unlink d7/df/d8b/l84 0 2024-02-16T22:19:18.220 INFO:tasks.workunit.client.1.smithi173.stdout:4/547: stat d7/d28/d14/f1f 0 2024-02-16T22:19:18.222 INFO:tasks.workunit.client.1.smithi173.stdout:7/625: rename d1/d1d/d44 to d1/d1d/d4c/d63/d13/d22/d7e/dc2 0 2024-02-16T22:19:18.225 INFO:tasks.workunit.client.1.smithi173.stdout:9/617: dwrite d1/d2/d1a/f28 [0,4194304] 0 2024-02-16T22:19:18.225 INFO:tasks.workunit.client.1.smithi173.stdout:3/756: creat d9/d18/d5f/d6e/d4e/f102 x:0 0 0 2024-02-16T22:19:18.225 INFO:tasks.workunit.client.1.smithi173.stdout:3/757: chown d9/d1a/d2b/d45/d51/d92/lce 6405 1 2024-02-16T22:19:18.225 INFO:tasks.workunit.client.1.smithi173.stdout:3/758: creat d9/d18/d5f/d6e/da7/f103 x:0 0 0 2024-02-16T22:19:18.227 INFO:tasks.workunit.client.1.smithi173.stdout:8/765: getdents dd/d7c/d7d/d89/db0 0 2024-02-16T22:19:18.227 INFO:tasks.workunit.client.1.smithi173.stdout:8/766: readlink dd/d7c/d7d/d22/d28/d40/d51/l7f 0 2024-02-16T22:19:18.227 INFO:tasks.workunit.client.1.smithi173.stdout:8/767: stat dd/d7c/d7d/d58/f91 0 2024-02-16T22:19:18.230 INFO:tasks.workunit.client.1.smithi173.stdout:1/708: mkdir db/d1c/d7f/d98/df9 0 2024-02-16T22:19:18.232 INFO:tasks.workunit.client.1.smithi173.stdout:7/626: creat d1/d1d/d4c/d63/d6c/fc3 x:0 0 0 2024-02-16T22:19:18.232 INFO:tasks.workunit.client.1.smithi173.stdout:7/627: read - d1/d1d/d4c/d63/d13/d22/d53/d27/f62 zero size 2024-02-16T22:19:18.232 INFO:tasks.workunit.client.1.smithi173.stdout:7/628: read - d1/d1d/d4c/d63/d13/fa0 zero size 2024-02-16T22:19:18.235 INFO:tasks.workunit.client.1.smithi173.stdout:0/457: rename d0/d4/d14/d24/d32/d39/c87 to d0/d12/d15/c90 0 2024-02-16T22:19:18.239 INFO:tasks.workunit.client.1.smithi173.stdout:5/682: truncate d8/d27/d35/fbb 488435 0 2024-02-16T22:19:18.239 INFO:tasks.workunit.client.1.smithi173.stdout:5/683: fdatasync d8/da/d1b/d57/f79 0 2024-02-16T22:19:18.241 INFO:tasks.workunit.client.1.smithi173.stdout:1/709: creat db/d1c/d5c/ffa x:0 0 0 2024-02-16T22:19:18.241 INFO:tasks.workunit.client.1.smithi173.stdout:1/710: write db/d29/d50/fca [116396,74632] 0 2024-02-16T22:19:18.242 INFO:tasks.workunit.client.1.smithi173.stdout:7/629: symlink d1/d1d/d4c/d63/d13/lc4 0 2024-02-16T22:19:18.245 INFO:tasks.workunit.client.1.smithi173.stdout:9/618: rmdir d1/d5f/d61 39 2024-02-16T22:19:18.246 INFO:tasks.workunit.client.1.smithi173.stdout:6/610: dwrite d0/db/f12 [0,4194304] 0 2024-02-16T22:19:18.246 INFO:tasks.workunit.client.1.smithi173.stdout:9/619: write d1/d5f/f85 [1038795,124613] 0 2024-02-16T22:19:18.247 INFO:tasks.workunit.client.1.smithi173.stdout:5/684: symlink d8/da/d1b/d57/dc9/ld7 0 2024-02-16T22:19:18.248 INFO:tasks.workunit.client.1.smithi173.stdout:9/620: dread d1/d2/d10/f63 [0,4194304] 0 2024-02-16T22:19:18.248 INFO:tasks.workunit.client.1.smithi173.stdout:9/621: chown d1/d2/d1a/d1f/d34/dbb/dbe/f7e 2570 1 2024-02-16T22:19:18.250 INFO:tasks.workunit.client.1.smithi173.stdout:8/768: symlink dd/d7c/d7d/d22/d2e/d41/d73/lf6 0 2024-02-16T22:19:18.250 INFO:tasks.workunit.client.1.smithi173.stdout:8/769: fdatasync dd/d7c/d7d/d22/d50/f5d 0 2024-02-16T22:19:18.251 INFO:tasks.workunit.client.1.smithi173.stdout:7/630: creat d1/d1d/d4c/fc5 x:0 0 0 2024-02-16T22:19:18.252 INFO:tasks.workunit.client.1.smithi173.stdout:3/759: dwrite d9/d1a/d2b/d4d/d5b/da9/db4/fc6 [0,4194304] 0 2024-02-16T22:19:18.252 INFO:tasks.workunit.client.1.smithi173.stdout:3/760: stat d9/cbd 0 2024-02-16T22:19:18.255 INFO:tasks.workunit.client.1.smithi173.stdout:4/548: dwrite d7/d12/f2b [4194304,4194304] 0 2024-02-16T22:19:18.255 INFO:tasks.workunit.client.1.smithi173.stdout:5/685: symlink d8/d27/d35/ld8 0 2024-02-16T22:19:18.259 INFO:tasks.workunit.client.1.smithi173.stdout:1/711: dread db/d1c/d25/d45/fdf [0,4194304] 0 2024-02-16T22:19:18.259 INFO:tasks.workunit.client.1.smithi173.stdout:1/712: stat db/d1c/d25/d28/d3f 0 2024-02-16T22:19:18.259 INFO:tasks.workunit.client.1.smithi173.stdout:6/611: dread d0/db/d2e/f30 [0,4194304] 0 2024-02-16T22:19:18.262 INFO:tasks.workunit.client.1.smithi173.stdout:4/549: unlink d7/df/d8b/da1/cb1 0 2024-02-16T22:19:18.263 INFO:tasks.workunit.client.1.smithi173.stdout:5/686: symlink d8/d27/ld9 0 2024-02-16T22:19:18.266 INFO:tasks.workunit.client.1.smithi173.stdout:4/550: creat d7/d28/d31/fbd x:0 0 0 2024-02-16T22:19:18.266 INFO:tasks.workunit.client.1.smithi173.stdout:4/551: creat d7/d12/d7e/fbe x:0 0 0 2024-02-16T22:19:18.267 INFO:tasks.workunit.client.1.smithi173.stdout:6/612: symlink d0/db/d2e/d2f/d31/d5d/lde 0 2024-02-16T22:19:18.272 INFO:tasks.workunit.client.1.smithi173.stdout:3/761: dread d9/d1a/d2b/d4d/f8c [0,4194304] 0 2024-02-16T22:19:18.272 INFO:tasks.workunit.client.1.smithi173.stdout:3/762: write d9/f22 [2393687,44075] 0 2024-02-16T22:19:18.276 INFO:tasks.workunit.client.1.smithi173.stdout:1/713: write db/ff [2162936,58165] 0 2024-02-16T22:19:18.276 INFO:tasks.workunit.client.1.smithi173.stdout:6/613: rename d0/db/d2e/d2f/d31/f99 to d0/d7c/dc5/fdf 0 2024-02-16T22:19:18.276 INFO:tasks.workunit.client.1.smithi173.stdout:6/614: creat d0/db/d2e/d2f/d31/d7a/fe0 x:0 0 0 2024-02-16T22:19:18.276 INFO:tasks.workunit.client.1.smithi173.stdout:0/458: dwrite d0/d4/d33/f3c [0,4194304] 0 2024-02-16T22:19:18.277 INFO:tasks.workunit.client.1.smithi173.stdout:3/763: creat d9/d18/d73/db7/d81/ddf/f104 x:0 0 0 2024-02-16T22:19:18.278 INFO:tasks.workunit.client.1.smithi173.stdout:5/687: getdents d8/da/d2d/d3a 0 2024-02-16T22:19:18.278 INFO:tasks.workunit.client.1.smithi173.stdout:5/688: write d8/da/d1b/d57/dc9/d92/fca [2208079,77294] 0 2024-02-16T22:19:18.279 INFO:tasks.workunit.client.1.smithi173.stdout:9/622: dwrite d1/d5f/d61/d80/f66 [0,4194304] 0 2024-02-16T22:19:18.279 INFO:tasks.workunit.client.1.smithi173.stdout:9/623: dread - d1/d2/d1a/d3e/d4f/f6a zero size 2024-02-16T22:19:18.280 INFO:tasks.workunit.client.1.smithi173.stdout:4/552: rmdir d7/d28/d52 39 2024-02-16T22:19:18.284 INFO:tasks.workunit.client.1.smithi173.stdout:1/714: unlink db/d29/d57/d8c/fb6 0 2024-02-16T22:19:18.285 INFO:tasks.workunit.client.1.smithi173.stdout:8/770: dwrite dd/fe8 [0,4194304] 0 2024-02-16T22:19:18.288 INFO:tasks.workunit.client.1.smithi173.stdout:3/764: write d9/d1a/d2b/d45/d60/d6a/fd1 [2027958,634] 0 2024-02-16T22:19:18.289 INFO:tasks.workunit.client.1.smithi173.stdout:9/624: write d1/d2/d1a/d2f/d3b/f7c [744171,44068] 0 2024-02-16T22:19:18.289 INFO:tasks.workunit.client.1.smithi173.stdout:9/625: stat d1/d2/d1a/d2f/d3b/f84 0 2024-02-16T22:19:18.291 INFO:tasks.workunit.client.1.smithi173.stdout:5/689: link d8/l18 d8/da/d1f/d6f/d91/lda 0 2024-02-16T22:19:18.294 INFO:tasks.workunit.client.1.smithi173.stdout:0/459: dwrite d0/d4/d14/d38/f49 [0,4194304] 0 2024-02-16T22:19:18.295 INFO:tasks.workunit.client.1.smithi173.stdout:8/771: dread dd/d7c/d7d/d22/f32 [0,4194304] 0 2024-02-16T22:19:18.295 INFO:tasks.workunit.client.1.smithi173.stdout:8/772: readlink dd/d7c/d7d/d22/d2e/d41/d6b/l88 0 2024-02-16T22:19:18.296 INFO:tasks.workunit.client.1.smithi173.stdout:4/553: mkdir d7/d28/d31/d33/dbf 0 2024-02-16T22:19:18.296 INFO:tasks.workunit.client.1.smithi173.stdout:4/554: write d7/d28/d31/d33/d7d/d45/f69 [477030,20828] 0 2024-02-16T22:19:18.297 INFO:tasks.workunit.client.1.smithi173.stdout:8/773: dread dd/d7c/d7d/d22/f96 [0,4194304] 0 2024-02-16T22:19:18.297 INFO:tasks.workunit.client.1.smithi173.stdout:8/774: chown dd/d7c/d7d/d22/d2e/l4d 28040 1 2024-02-16T22:19:18.297 INFO:tasks.workunit.client.1.smithi173.stdout:8/775: chown dd/d7c/d7d/fdb 112774633 1 2024-02-16T22:19:18.297 INFO:tasks.workunit.client.1.smithi173.stdout:1/715: write db/d29/d57/fc5 [77944,96609] 0 2024-02-16T22:19:18.302 INFO:tasks.workunit.client.1.smithi173.stdout:3/765: mkdir d9/d1a/d2b/d4d/d5b/da9/d105 0 2024-02-16T22:19:18.303 INFO:tasks.workunit.client.1.smithi173.stdout:8/776: read dd/d7c/d7d/d22/f4e [226968,129446] 0 2024-02-16T22:19:18.304 INFO:tasks.workunit.client.1.smithi173.stdout:8/777: dread dd/d7c/fbb [0,4194304] 0 2024-02-16T22:19:18.305 INFO:tasks.workunit.client.1.smithi173.stdout:8/778: fsync dd/d7c/d7d/d22/fcd 0 2024-02-16T22:19:18.305 INFO:tasks.workunit.client.1.smithi173.stdout:9/626: creat d1/d2/d1a/d1f/d34/fcc x:0 0 0 2024-02-16T22:19:18.305 INFO:tasks.workunit.client.1.smithi173.stdout:9/627: read - d1/d2/fc9 zero size 2024-02-16T22:19:18.305 INFO:tasks.workunit.client.1.smithi173.stdout:5/690: truncate d8/da/f1d 293853 0 2024-02-16T22:19:18.306 INFO:tasks.workunit.client.1.smithi173.stdout:5/691: dread d8/fd [4194304,4194304] 0 2024-02-16T22:19:18.306 INFO:tasks.workunit.client.1.smithi173.stdout:5/692: creat d8/da/d1f/d30/d9b/fdb x:0 0 0 2024-02-16T22:19:18.309 INFO:tasks.workunit.client.1.smithi173.stdout:0/460: creat d0/d6d/f91 x:0 0 0 2024-02-16T22:19:18.310 INFO:tasks.workunit.client.1.smithi173.stdout:4/555: creat d7/d28/d52/d89/fc0 x:0 0 0 2024-02-16T22:19:18.311 INFO:tasks.workunit.client.1.smithi173.stdout:1/716: creat db/d1c/d7f/d98/df9/ffb x:0 0 0 2024-02-16T22:19:18.311 INFO:tasks.workunit.client.1.smithi173.stdout:1/717: fdatasync db/d30/fee 0 2024-02-16T22:19:18.311 INFO:tasks.workunit.client.1.smithi173.stdout:1/718: dread - db/d29/d50/fc6 zero size 2024-02-16T22:19:18.311 INFO:tasks.workunit.client.1.smithi173.stdout:6/615: rename d0/db/d2e/d2f/da6/ddc to d0/db/d2e/d65/db8/de1 0 2024-02-16T22:19:18.312 INFO:tasks.workunit.client.1.smithi173.stdout:3/766: creat d9/d17/d25/dcf/f106 x:0 0 0 2024-02-16T22:19:18.313 INFO:tasks.workunit.client.1.smithi173.stdout:4/556: mknod d7/d12/cc1 0 2024-02-16T22:19:18.315 INFO:tasks.workunit.client.1.smithi173.stdout:9/628: write d1/d2/d1a/d3e/d4f/d8c/fb6 [2484294,52772] 0 2024-02-16T22:19:18.315 INFO:tasks.workunit.client.1.smithi173.stdout:9/629: fdatasync d1/d2/d1a/d2f/f53 0 2024-02-16T22:19:18.315 INFO:tasks.workunit.client.1.smithi173.stdout:3/767: mknod d9/d18/d5f/d6e/d4e/c107 0 2024-02-16T22:19:18.317 INFO:tasks.workunit.client.1.smithi173.stdout:4/557: mknod d7/d12/d2d/cc2 0 2024-02-16T22:19:18.317 INFO:tasks.workunit.client.1.smithi173.stdout:4/558: truncate d7/d28/f75 3787552 0 2024-02-16T22:19:18.318 INFO:tasks.workunit.client.1.smithi173.stdout:9/630: symlink d1/d2/d1a/d1f/d34/d49/d88/lcd 0 2024-02-16T22:19:18.319 INFO:tasks.workunit.client.1.smithi173.stdout:9/631: truncate f0 1666385 0 2024-02-16T22:19:18.319 INFO:tasks.workunit.client.1.smithi173.stdout:5/693: rename d8/da/d1f/d30/d9b/fdb to d8/da/d1b/d57/dc9/d92/dbc/fdc 0 2024-02-16T22:19:18.319 INFO:tasks.workunit.client.1.smithi173.stdout:5/694: write d8/da/fab [1035948,17031] 0 2024-02-16T22:19:18.322 INFO:tasks.workunit.client.1.smithi173.stdout:3/768: link d9/d17/d25/dcf/f106 d9/d18/d5f/d6e/df9/f108 0 2024-02-16T22:19:18.323 INFO:tasks.workunit.client.1.smithi173.stdout:9/632: truncate d1/f23 3068074 0 2024-02-16T22:19:18.323 INFO:tasks.workunit.client.1.smithi173.stdout:9/633: readlink d1/d2/d1a/d2f/d3b/l3c 0 2024-02-16T22:19:18.324 INFO:tasks.workunit.client.1.smithi173.stdout:1/719: rename db/d29/f94 to db/d1c/d5c/dac/dae/ffc 0 2024-02-16T22:19:18.324 INFO:tasks.workunit.client.1.smithi173.stdout:1/720: readlink db/d1c/l9d 0 2024-02-16T22:19:18.327 INFO:tasks.workunit.client.1.smithi173.stdout:9/634: mkdir d1/d2/d1a/d2f/d51/d96/db3/dce 0 2024-02-16T22:19:18.327 INFO:tasks.workunit.client.1.smithi173.stdout:9/635: chown d1/d2/d1a/d1f/d34/c44 2925 1 2024-02-16T22:19:18.327 INFO:tasks.workunit.client.1.smithi173.stdout:9/636: truncate d1/d2/d10/f63 2289272 0 2024-02-16T22:19:18.327 INFO:tasks.workunit.client.1.smithi173.stdout:9/637: dread - d1/d5f/d6d/d91/da7/fc2 zero size 2024-02-16T22:19:18.328 INFO:tasks.workunit.client.1.smithi173.stdout:9/638: chown d1/d2/d10/f46 0 1 2024-02-16T22:19:18.328 INFO:tasks.workunit.client.1.smithi173.stdout:6/616: dread d0/db/d2e/d2f/d31/d33/f66 [0,4194304] 0 2024-02-16T22:19:18.330 INFO:tasks.workunit.client.1.smithi173.stdout:1/721: unlink db/d1c/c27 0 2024-02-16T22:19:18.330 INFO:tasks.workunit.client.1.smithi173.stdout:1/722: write db/d29/d8f/f93 [2066404,114303] 0 2024-02-16T22:19:18.330 INFO:tasks.workunit.client.1.smithi173.stdout:1/723: write db/d29/d8f/ff6 [541015,64302] 0 2024-02-16T22:19:18.332 INFO:tasks.workunit.client.1.smithi173.stdout:9/639: rename d1/d2/d1a/d2f/d51/d96/db3/dce to d1/dcf 0 2024-02-16T22:19:18.332 INFO:tasks.workunit.client.1.smithi173.stdout:9/640: read - d1/d2/fc9 zero size 2024-02-16T22:19:18.333 INFO:tasks.workunit.client.1.smithi173.stdout:1/724: symlink db/lfd 0 2024-02-16T22:19:18.333 INFO:tasks.workunit.client.1.smithi173.stdout:1/725: fdatasync db/d1c/d25/d28/d3f/d4a/fc4 0 2024-02-16T22:19:18.334 INFO:tasks.workunit.client.1.smithi173.stdout:9/641: creat d1/d2/d1a/d3e/fd0 x:0 0 0 2024-02-16T22:19:18.336 INFO:tasks.workunit.client.1.smithi173.stdout:8/779: dwrite dd/d7c/d7d/d22/d5a/f67 [0,4194304] 0 2024-02-16T22:19:18.337 INFO:tasks.workunit.client.1.smithi173.stdout:1/726: link db/d1c/d5c/l66 db/d29/d50/d85/lfe 0 2024-02-16T22:19:18.337 INFO:tasks.workunit.client.1.smithi173.stdout:0/461: dwrite d0/d4/d27/f73 [0,4194304] 0 2024-02-16T22:19:18.337 INFO:tasks.workunit.client.1.smithi173.stdout:0/462: write d0/f1e [4815809,53148] 0 2024-02-16T22:19:18.339 INFO:tasks.workunit.client.1.smithi173.stdout:3/769: dread d9/d18/f3c [0,4194304] 0 2024-02-16T22:19:18.339 INFO:tasks.workunit.client.1.smithi173.stdout:3/770: fdatasync d9/d18/fb1 0 2024-02-16T22:19:18.339 INFO:tasks.workunit.client.1.smithi173.stdout:8/780: creat dd/d7c/d7d/d22/d5a/dc7/ff7 x:0 0 0 2024-02-16T22:19:18.340 INFO:tasks.workunit.client.1.smithi173.stdout:8/781: dread - dd/d7c/d7d/d22/d28/d40/d69/da7/fc5 zero size 2024-02-16T22:19:18.341 INFO:tasks.workunit.client.1.smithi173.stdout:1/727: mknod db/d1c/d25/d28/d3f/d4a/cff 0 2024-02-16T22:19:18.347 INFO:tasks.workunit.client.1.smithi173.stdout:4/559: dwrite d7/d28/d31/d33/fa6 [0,4194304] 0 2024-02-16T22:19:18.347 INFO:tasks.workunit.client.1.smithi173.stdout:4/560: write d7/fb5 [565685,41196] 0 2024-02-16T22:19:18.349 INFO:tasks.workunit.client.1.smithi173.stdout:0/463: mkdir d0/d12/d15/d4f/d92 0 2024-02-16T22:19:18.349 INFO:tasks.workunit.client.1.smithi173.stdout:0/464: creat d0/d4/d14/d24/d58/f93 x:0 0 0 2024-02-16T22:19:18.349 INFO:tasks.workunit.client.1.smithi173.stdout:3/771: rename d9/f22 to d9/d17/d93/f109 0 2024-02-16T22:19:18.351 INFO:tasks.workunit.client.1.smithi173.stdout:8/782: truncate dd/d7c/d7d/f39 516694 0 2024-02-16T22:19:18.351 INFO:tasks.workunit.client.1.smithi173.stdout:8/783: chown dd/d7c/d7d/d22/d28/d40/d69/lcf 208096600 1 2024-02-16T22:19:18.356 INFO:tasks.workunit.client.1.smithi173.stdout:1/728: symlink db/d29/d57/l100 0 2024-02-16T22:19:18.356 INFO:tasks.workunit.client.1.smithi173.stdout:1/729: stat db/d1c/d5c/daf/cd7 0 2024-02-16T22:19:18.356 INFO:tasks.workunit.client.1.smithi173.stdout:5/695: dwrite d8/da/d1b/faa [0,4194304] 0 2024-02-16T22:19:18.358 INFO:tasks.workunit.client.1.smithi173.stdout:8/784: rmdir dd/d7c/d7d/d22/d28/d40/de5 39 2024-02-16T22:19:18.364 INFO:tasks.workunit.client.1.smithi173.stdout:5/696: mkdir d8/da/d1f/d8c/ddd 0 2024-02-16T22:19:18.364 INFO:tasks.workunit.client.1.smithi173.stdout:5/697: write d8/da/d2d/d3a/da7/f77 [1340226,127952] 0 2024-02-16T22:19:18.365 INFO:tasks.workunit.client.1.smithi173.stdout:5/698: write d8/da/d1b/f52 [202902,89696] 0 2024-02-16T22:19:18.365 INFO:tasks.workunit.client.1.smithi173.stdout:5/699: chown c5 7298 1 2024-02-16T22:19:18.365 INFO:tasks.workunit.client.1.smithi173.stdout:5/700: chown d8/da/d1b/d57/dc9/f83 2217398 1 2024-02-16T22:19:18.365 INFO:tasks.workunit.client.1.smithi173.stdout:8/785: link dd/d7c/d7d/d22/d2e/d41/d6b/c80 dd/d7c/cf8 0 2024-02-16T22:19:18.366 INFO:tasks.workunit.client.1.smithi173.stdout:0/465: dread d0/d4/d27/f73 [0,4194304] 0 2024-02-16T22:19:18.368 INFO:tasks.workunit.client.1.smithi173.stdout:8/786: mkdir dd/d7c/dcb/dd8/df9 0 2024-02-16T22:19:18.370 INFO:tasks.workunit.client.1.smithi173.stdout:0/466: unlink d0/d4/d14/d24/d58/l5b 0 2024-02-16T22:19:18.370 INFO:tasks.workunit.client.1.smithi173.stdout:0/467: fdatasync d0/d4/d14/d24/d32/f66 0 2024-02-16T22:19:18.372 INFO:tasks.workunit.client.1.smithi173.stdout:8/787: truncate dd/d7c/d7d/d22/d5a/f61 844662 0 2024-02-16T22:19:18.373 INFO:tasks.workunit.client.1.smithi173.stdout:0/468: symlink d0/d4/d14/l94 0 2024-02-16T22:19:18.375 INFO:tasks.workunit.client.1.smithi173.stdout:8/788: rename dd/d7c/d7d/d22/d28/f90 to dd/d7c/d7d/d22/d28/d40/d69/ffa 0 2024-02-16T22:19:18.375 INFO:tasks.workunit.client.1.smithi173.stdout:8/789: chown dd/d7c/d7d/d22/d2e 4 1 2024-02-16T22:19:18.375 INFO:tasks.workunit.client.1.smithi173.stdout:8/790: truncate dd/d7c/d7d/d22/d28/fb5 502777 0 2024-02-16T22:19:18.377 INFO:tasks.workunit.client.1.smithi173.stdout:8/791: rename dd/d7c/dcb/ce4 to dd/d7c/d7d/d89/db0/cfb 0 2024-02-16T22:19:18.379 INFO:tasks.workunit.client.1.smithi173.stdout:9/642: dwrite d1/d2/d1a/d1f/d34/d49/faa [4194304,4194304] 0 2024-02-16T22:19:18.381 INFO:tasks.workunit.client.1.smithi173.stdout:9/643: rename d1/d2/d1a/d1f/d34/dbb/dbe/f7e to d1/d2/d1a/d3e/dc8/fd1 0 2024-02-16T22:19:18.382 INFO:tasks.workunit.client.1.smithi173.stdout:0/469: dread d0/d4/d14/d24/d32/d39/f2c [0,4194304] 0 2024-02-16T22:19:18.382 INFO:tasks.workunit.client.1.smithi173.stdout:0/470: chown d0/d4/d14/d38 2449092 1 2024-02-16T22:19:18.382 INFO:tasks.workunit.client.1.smithi173.stdout:9/644: creat d1/d2/d1a/d3e/dc8/fd2 x:0 0 0 2024-02-16T22:19:18.385 INFO:tasks.workunit.client.1.smithi173.stdout:3/772: dwrite d9/d18/d5f/d6e/d4e/f102 [0,4194304] 0 2024-02-16T22:19:18.385 INFO:tasks.workunit.client.1.smithi173.stdout:6/617: dwrite d0/db/d2e/fd7 [0,4194304] 0 2024-02-16T22:19:18.386 INFO:tasks.workunit.client.1.smithi173.stdout:6/618: write d0/db/f57 [1757344,97593] 0 2024-02-16T22:19:18.386 INFO:tasks.workunit.client.1.smithi173.stdout:6/619: write d0/db/d2e/d2f/d31/d33/f36 [163296,43120] 0 2024-02-16T22:19:18.386 INFO:tasks.workunit.client.1.smithi173.stdout:6/620: truncate d0/db/d2e/f88 1310375 0 2024-02-16T22:19:18.386 INFO:tasks.workunit.client.1.smithi173.stdout:1/730: dwrite db/d1c/d5c/f6d [0,4194304] 0 2024-02-16T22:19:18.386 INFO:tasks.workunit.client.1.smithi173.stdout:1/731: fsync db/d1c/d25/d45/fdf 0 2024-02-16T22:19:18.387 INFO:tasks.workunit.client.1.smithi173.stdout:5/701: fdatasync d8/da/d2d/d36/f8a 0 2024-02-16T22:19:18.387 INFO:tasks.workunit.client.1.smithi173.stdout:5/702: readlink d8/da/d1b/d57/dc9/l6b 0 2024-02-16T22:19:18.387 INFO:tasks.workunit.client.1.smithi173.stdout:4/561: dwrite d7/d28/d31/d33/d7d/d45/f6b [0,4194304] 0 2024-02-16T22:19:18.388 INFO:tasks.workunit.client.1.smithi173.stdout:3/773: creat d9/d1a/d2b/f10a x:0 0 0 2024-02-16T22:19:18.388 INFO:tasks.workunit.client.1.smithi173.stdout:3/774: truncate d9/d18/d5f/fc2 5729127 0 2024-02-16T22:19:18.396 INFO:tasks.workunit.client.1.smithi173.stdout:6/621: mkdir d0/db/d2e/d65/d9f/de2 0 2024-02-16T22:19:18.403 INFO:tasks.workunit.client.1.smithi173.stdout:1/732: rmdir db/d1c/d25/d28/d3f/d4a/dda 0 2024-02-16T22:19:18.407 INFO:tasks.workunit.client.1.smithi173.stdout:0/471: dwrite d0/d4/d27/f73 [4194304,4194304] 0 2024-02-16T22:19:18.411 INFO:tasks.workunit.client.1.smithi173.stdout:8/792: getdents dd/d7c/d7d/d22/d28 0 2024-02-16T22:19:18.411 INFO:tasks.workunit.client.1.smithi173.stdout:8/793: stat dd/d7c/dcb/dd8/df9 0 2024-02-16T22:19:18.411 INFO:tasks.workunit.client.1.smithi173.stdout:8/794: fdatasync dd/d7c/d7d/d22/d28/d40/d51/f9e 0 2024-02-16T22:19:18.412 INFO:tasks.workunit.client.1.smithi173.stdout:8/795: truncate dd/fe8 5024896 0 2024-02-16T22:19:18.412 INFO:tasks.workunit.client.1.smithi173.stdout:5/703: mkdir d8/da/d1b/d57/dde 0 2024-02-16T22:19:18.415 INFO:tasks.workunit.client.1.smithi173.stdout:3/775: dwrite d9/d1a/d2b/d4d/f6b [0,4194304] 0 2024-02-16T22:19:18.415 INFO:tasks.workunit.client.1.smithi173.stdout:3/776: write d9/d18/d73/db7/fca [440255,51855] 0 2024-02-16T22:19:18.415 INFO:tasks.workunit.client.1.smithi173.stdout:4/562: mknod d7/d28/d31/d33/d7d/cc3 0 2024-02-16T22:19:18.415 INFO:tasks.workunit.client.1.smithi173.stdout:4/563: creat d7/d28/d31/fc4 x:0 0 0 2024-02-16T22:19:18.416 INFO:tasks.workunit.client.1.smithi173.stdout:4/564: write d7/d9a/fa9 [783683,18637] 0 2024-02-16T22:19:18.416 INFO:tasks.workunit.client.1.smithi173.stdout:6/622: dwrite d0/db/f3d [4194304,4194304] 0 2024-02-16T22:19:18.417 INFO:tasks.workunit.client.1.smithi173.stdout:9/645: fsync d1/d2/d1a/d3e/dc8/fd1 0 2024-02-16T22:19:18.426 INFO:tasks.workunit.client.1.smithi173.stdout:0/472: creat d0/f95 x:0 0 0 2024-02-16T22:19:18.426 INFO:tasks.workunit.client.1.smithi173.stdout:8/796: truncate dd/d7c/d7d/d22/d28/d40/f74 158147 0 2024-02-16T22:19:18.428 INFO:tasks.workunit.client.1.smithi173.stdout:5/704: creat d8/da/d2d/d3a/fdf x:0 0 0 2024-02-16T22:19:18.428 INFO:tasks.workunit.client.1.smithi173.stdout:3/777: dread d9/da/f43 [0,4194304] 0 2024-02-16T22:19:18.429 INFO:tasks.workunit.client.1.smithi173.stdout:4/565: symlink d7/d9a/lc5 0 2024-02-16T22:19:18.432 INFO:tasks.workunit.client.1.smithi173.stdout:6/623: mknod d0/db/d2e/ce3 0 2024-02-16T22:19:18.432 INFO:tasks.workunit.client.1.smithi173.stdout:6/624: write d0/db/d2e/d65/d67/f80 [827546,55989] 0 2024-02-16T22:19:18.434 INFO:tasks.workunit.client.1.smithi173.stdout:9/646: creat d1/d2/d1a/d3e/d4f/d8c/d92/fd3 x:0 0 0 2024-02-16T22:19:18.434 INFO:tasks.workunit.client.1.smithi173.stdout:9/647: dread - d1/d2/d1a/d3e/d4f/f6a zero size 2024-02-16T22:19:18.434 INFO:tasks.workunit.client.1.smithi173.stdout:9/648: stat d1/d2/d1a/d1f/d34/d49/fa5 0 2024-02-16T22:19:18.436 INFO:tasks.workunit.client.1.smithi173.stdout:0/473: truncate d0/d4/f7 1721436 0 2024-02-16T22:19:18.440 INFO:tasks.workunit.client.1.smithi173.stdout:9/649: rename d1/d2/d1a/d2f/d3b/lbd to d1/d5f/ld4 0 2024-02-16T22:19:18.442 INFO:tasks.workunit.client.1.smithi173.stdout:9/650: write f0 [1134930,44229] 0 2024-02-16T22:19:18.442 INFO:tasks.workunit.client.1.smithi173.stdout:9/651: chown d1/d2/d1a/d2f/d51 11 1 2024-02-16T22:19:18.442 INFO:tasks.workunit.client.1.smithi173.stdout:9/652: dread - d1/d5f/d6d/d91/da7/fc2 zero size 2024-02-16T22:19:18.442 INFO:tasks.workunit.client.1.smithi173.stdout:9/653: write d1/d2/d1a/d1f/f43 [3814724,126240] 0 2024-02-16T22:19:18.445 INFO:tasks.workunit.client.1.smithi173.stdout:6/625: dread d0/db/f3d [0,4194304] 0 2024-02-16T22:19:18.445 INFO:tasks.workunit.client.1.smithi173.stdout:6/626: stat d0/db/d2e/f88 0 2024-02-16T22:19:18.448 INFO:tasks.workunit.client.1.smithi173.stdout:0/474: unlink d0/d12/d15/d3d/l4b 0 2024-02-16T22:19:18.449 INFO:tasks.workunit.client.1.smithi173.stdout:9/654: mkdir d1/d2/d1a/d3e/d4f/d8c/d92/dd5 0 2024-02-16T22:19:18.450 INFO:tasks.workunit.client.1.smithi173.stdout:6/627: write d0/db/d2e/d2f/d31/d5d/f74 [4333342,28984] 0 2024-02-16T22:19:18.451 INFO:tasks.workunit.client.1.smithi173.stdout:0/475: mknod d0/d4/d14/d24/d32/d39/c96 0 2024-02-16T22:19:18.453 INFO:tasks.workunit.client.1.smithi173.stdout:9/655: unlink d1/f18 0 2024-02-16T22:19:18.454 INFO:tasks.workunit.client.1.smithi173.stdout:0/476: truncate d0/d4/d14/d50/f6e 1254321 0 2024-02-16T22:19:18.456 INFO:tasks.workunit.client.1.smithi173.stdout:5/705: dwrite d8/da/d2d/d36/f8a [0,4194304] 0 2024-02-16T22:19:18.456 INFO:tasks.workunit.client.1.smithi173.stdout:5/706: chown d8/da/d2d/cd5 206785316 1 2024-02-16T22:19:18.461 INFO:tasks.workunit.client.1.smithi173.stdout:4/566: dwrite d7/d28/d31/d33/d7d/d3d/f6c [0,4194304] 0 2024-02-16T22:19:18.461 INFO:tasks.workunit.client.1.smithi173.stdout:4/567: fdatasync d7/df/f22 0 2024-02-16T22:19:18.461 INFO:tasks.workunit.client.1.smithi173.stdout:5/707: link d8/da/d1f/d30/d9b/f9c d8/da/d1f/d8c/fe0 0 2024-02-16T22:19:18.463 INFO:tasks.workunit.client.1.smithi173.stdout:9/656: dread f0 [0,4194304] 0 2024-02-16T22:19:18.464 INFO:tasks.workunit.client.1.smithi173.stdout:3/778: dwrite d9/d18/d73/fc8 [0,4194304] 0 2024-02-16T22:19:18.464 INFO:tasks.workunit.client.1.smithi173.stdout:3/779: fsync d9/d18/d5f/d6e/df9/f108 0 2024-02-16T22:19:18.465 INFO:tasks.workunit.client.1.smithi173.stdout:4/568: rename d7/d28/d31/d33/d7d/d45/cb0 to d7/df/d8b/da1/cc6 0 2024-02-16T22:19:18.467 INFO:tasks.workunit.client.1.smithi173.stdout:5/708: unlink d8/da/d1f/d6f/d91/ca2 0 2024-02-16T22:19:18.467 INFO:tasks.workunit.client.1.smithi173.stdout:5/709: readlink d8/d27/d62/la8 0 2024-02-16T22:19:18.469 INFO:tasks.workunit.client.1.smithi173.stdout:3/780: mkdir d9/d18/daa/df0/d10b 0 2024-02-16T22:19:18.470 INFO:tasks.workunit.client.1.smithi173.stdout:3/781: chown d9/da/f85 5252 1 2024-02-16T22:19:18.470 INFO:tasks.workunit.client.1.smithi173.stdout:3/782: readlink d9/l1f 0 2024-02-16T22:19:18.470 INFO:tasks.workunit.client.1.smithi173.stdout:4/569: symlink d7/d12/d7e/lc7 0 2024-02-16T22:19:18.472 INFO:tasks.workunit.client.1.smithi173.stdout:6/628: dwrite d0/db/d2e/d2f/d31/f39 [0,4194304] 0 2024-02-16T22:19:18.472 INFO:tasks.workunit.client.1.smithi173.stdout:6/629: creat d0/d7c/dc5/d92/fe4 x:0 0 0 2024-02-16T22:19:18.473 INFO:tasks.workunit.client.1.smithi173.stdout:5/710: truncate d8/da/d2d/faf 1189583 0 2024-02-16T22:19:18.474 INFO:tasks.workunit.client.1.smithi173.stdout:4/570: rename d7/d28/d14/f40 to d7/d12/d7e/fc8 0 2024-02-16T22:19:18.474 INFO:tasks.workunit.client.1.smithi173.stdout:4/571: chown d7/d9a/ca7 1838 1 2024-02-16T22:19:18.474 INFO:tasks.workunit.client.1.smithi173.stdout:4/572: write d7/d28/d52/d89/fb9 [1440985,76200] 0 2024-02-16T22:19:18.477 INFO:tasks.workunit.client.1.smithi173.stdout:6/630: creat d0/db/d2e/d65/fe5 x:0 0 0 2024-02-16T22:19:18.478 INFO:tasks.workunit.client.1.smithi173.stdout:4/573: creat d7/d28/dac/fc9 x:0 0 0 2024-02-16T22:19:18.478 INFO:tasks.workunit.client.1.smithi173.stdout:4/574: write d7/d28/d31/fbd [846820,123519] 0 2024-02-16T22:19:18.479 INFO:tasks.workunit.client.1.smithi173.stdout:6/631: unlink d0/db/d2e/f71 0 2024-02-16T22:19:18.480 INFO:tasks.workunit.client.1.smithi173.stdout:4/575: mkdir d7/d28/d31/d33/dca 0 2024-02-16T22:19:18.482 INFO:tasks.workunit.client.1.smithi173.stdout:4/576: mkdir d7/d28/d31/d33/dcb 0 2024-02-16T22:19:18.482 INFO:tasks.workunit.client.1.smithi173.stdout:4/577: readlink d7/d12/d2d/l86 0 2024-02-16T22:19:18.482 INFO:tasks.workunit.client.1.smithi173.stdout:4/578: write d7/d9a/fa9 [922610,75821] 0 2024-02-16T22:19:18.482 INFO:tasks.workunit.client.1.smithi173.stdout:4/579: chown d7/d28/d31/d33/d7d/f47 84343355 1 2024-02-16T22:19:18.483 INFO:tasks.workunit.client.1.smithi173.stdout:9/657: dwrite d1/d2/d10/f63 [0,4194304] 0 2024-02-16T22:19:18.483 INFO:tasks.workunit.client.1.smithi173.stdout:9/658: write d1/d2/d1a/d1f/f43 [2291429,69573] 0 2024-02-16T22:19:18.483 INFO:tasks.workunit.client.1.smithi173.stdout:9/659: chown d1/d2/d1a/d1f/f81 109032 1 2024-02-16T22:19:18.485 INFO:tasks.workunit.client.1.smithi173.stdout:4/580: unlink d7/d12/cc1 0 2024-02-16T22:19:18.487 INFO:tasks.workunit.client.1.smithi173.stdout:9/660: mkdir d1/d2/d1a/d2f/d51/d96/db3/dd6 0 2024-02-16T22:19:18.487 INFO:tasks.workunit.client.1.smithi173.stdout:9/661: chown d1/d2/d1a/d1f/d34/d49/fa5 49759 1 2024-02-16T22:19:18.487 INFO:tasks.workunit.client.1.smithi173.stdout:9/662: write d1/d2/d1a/d2f/f50 [4288378,10359] 0 2024-02-16T22:19:18.489 INFO:tasks.workunit.client.1.smithi173.stdout:9/663: mkdir d1/dd7 0 2024-02-16T22:19:18.489 INFO:tasks.workunit.client.1.smithi173.stdout:9/664: read d1/d2/d1a/d1f/f4d [773428,78536] 0 2024-02-16T22:19:18.489 INFO:tasks.workunit.client.1.smithi173.stdout:9/665: chown d1/d2/d1a/d3e/d4f/d8c/f9d 5090 1 2024-02-16T22:19:18.495 INFO:tasks.workunit.client.1.smithi173.stdout:3/783: dwrite d9/d1a/d2b/d45/d51/f87 [0,4194304] 0 2024-02-16T22:19:18.495 INFO:tasks.workunit.client.1.smithi173.stdout:3/784: chown d9/d1a/d2b/d4d/f6b 40413933 1 2024-02-16T22:19:18.496 INFO:tasks.workunit.client.1.smithi173.stdout:3/785: creat d9/d17/d25/f10c x:0 0 0 2024-02-16T22:19:18.505 INFO:tasks.workunit.client.1.smithi173.stdout:0/477: dwrite d0/d4/f7 [0,4194304] 0 2024-02-16T22:19:18.505 INFO:tasks.workunit.client.1.smithi173.stdout:0/478: write d0/f95 [255772,39608] 0 2024-02-16T22:19:18.507 INFO:tasks.workunit.client.1.smithi173.stdout:0/479: truncate d0/f67 150545 0 2024-02-16T22:19:18.507 INFO:tasks.workunit.client.1.smithi173.stdout:0/480: chown d0/d4/d14/d24/d32/d39/f75 811262 1 2024-02-16T22:19:18.507 INFO:tasks.workunit.client.1.smithi173.stdout:0/481: getdents d0/d12/d15/d86 0 2024-02-16T22:19:18.507 INFO:tasks.workunit.client.1.smithi173.stdout:6/632: truncate d0/db/d2e/d2f/d31/d5d/f74 1242007 0 2024-02-16T22:19:18.508 INFO:tasks.workunit.client.1.smithi173.stdout:0/482: creat d0/d84/d8c/f97 x:0 0 0 2024-02-16T22:19:18.508 INFO:tasks.workunit.client.1.smithi173.stdout:0/483: write d0/d4/d14/d50/f6e [2097320,103279] 0 2024-02-16T22:19:18.508 INFO:tasks.workunit.client.1.smithi173.stdout:0/484: fdatasync d0/d4/d14/d24/d32/f66 0 2024-02-16T22:19:18.508 INFO:tasks.workunit.client.1.smithi173.stdout:3/786: write d9/d1a/d2b/d4d/f52 [1067475,25577] 0 2024-02-16T22:19:18.509 INFO:tasks.workunit.client.1.smithi173.stdout:9/666: dwrite d1/d2/d1a/d2f/d51/d96/f9b [0,4194304] 0 2024-02-16T22:19:18.509 INFO:tasks.workunit.client.1.smithi173.stdout:9/667: readlink d1/d2/d1a/d2f/d3b/l3c 0 2024-02-16T22:19:18.509 INFO:tasks.workunit.client.1.smithi173.stdout:9/668: truncate d1/d2/d1a/d1f/d34/dbb/dbe/fc6 483494 0 2024-02-16T22:19:18.510 INFO:tasks.workunit.client.1.smithi173.stdout:4/581: dread d7/d28/d52/d89/fb9 [0,4194304] 0 2024-02-16T22:19:18.510 INFO:tasks.workunit.client.1.smithi173.stdout:6/633: getdents d0/d7c/dc5/d92 0 2024-02-16T22:19:18.511 INFO:tasks.workunit.client.1.smithi173.stdout:3/787: mknod d9/d17/d25/ddc/c10d 0 2024-02-16T22:19:18.513 INFO:tasks.workunit.client.1.smithi173.stdout:9/669: mknod d1/cd8 0 2024-02-16T22:19:18.515 INFO:tasks.workunit.client.1.smithi173.stdout:4/582: dread d7/df/f1b [0,4194304] 0 2024-02-16T22:19:18.515 INFO:tasks.workunit.client.1.smithi173.stdout:4/583: fdatasync d7/d28/d31/d33/d7d/d4e/fa4 0 2024-02-16T22:19:18.518 INFO:tasks.workunit.client.1.smithi173.stdout:0/485: rename d0/d4 to d0/d12/d15/d3d/d98 0 2024-02-16T22:19:18.519 INFO:tasks.workunit.client.1.smithi173.stdout:6/634: write d0/f11 [5089095,8152] 0 2024-02-16T22:19:18.521 INFO:tasks.workunit.client.1.smithi173.stdout:3/788: creat d9/d18/daa/df0/d10b/f10e x:0 0 0 2024-02-16T22:19:18.522 INFO:tasks.workunit.client.1.smithi173.stdout:9/670: creat d1/d5f/d61/d80/fd9 x:0 0 0 2024-02-16T22:19:18.523 INFO:tasks.workunit.client.1.smithi173.stdout:4/584: mkdir d7/d28/d31/d33/d7d/d4e/dcc 0 2024-02-16T22:19:18.528 INFO:tasks.workunit.client.1.smithi173.stdout:6/635: unlink d0/db/d2e/d65/d73/d7d/ca4 0 2024-02-16T22:19:18.528 INFO:tasks.workunit.client.1.smithi173.stdout:6/636: chown d0/db/d2e/d65/fbb 2023815 1 2024-02-16T22:19:18.531 INFO:tasks.workunit.client.1.smithi173.stdout:3/789: rename d9/d18/daa/ld8 to d9/d1a/d2b/d4d/d5b/da9/l10f 0 2024-02-16T22:19:18.532 INFO:tasks.workunit.client.1.smithi173.stdout:4/585: mknod d7/d28/d31/d72/d93/d95/db4/ccd 0 2024-02-16T22:19:18.533 INFO:tasks.workunit.client.1.smithi173.stdout:3/790: write d9/d17/d25/f4a [262953,83278] 0 2024-02-16T22:19:18.533 INFO:tasks.workunit.client.1.smithi173.stdout:0/486: rmdir d0/d84/d8c 39 2024-02-16T22:19:18.533 INFO:tasks.workunit.client.1.smithi173.stdout:9/671: write d1/d2/d1a/d2f/d51/f7a [1186349,64251] 0 2024-02-16T22:19:18.533 INFO:tasks.workunit.client.1.smithi173.stdout:9/672: truncate d1/d2/d1a/d3e/d4f/d8c/d92/fd3 996323 0 2024-02-16T22:19:18.533 INFO:tasks.workunit.client.1.smithi173.stdout:9/673: write d1/d2/d1a/d1f/d34/dbb/dbe/fc1 [717754,19643] 0 2024-02-16T22:19:18.535 INFO:tasks.workunit.client.1.smithi173.stdout:0/487: dread d0/d12/d15/d3d/d98/d14/d24/d58/f74 [0,4194304] 0 2024-02-16T22:19:18.535 INFO:tasks.workunit.client.1.smithi173.stdout:0/488: chown d0/d6d/f91 3904 1 2024-02-16T22:19:18.539 INFO:tasks.workunit.client.1.smithi173.stdout:4/586: unlink d7/d12/fab 0 2024-02-16T22:19:18.541 INFO:tasks.workunit.client.1.smithi173.stdout:3/791: link d9/d17/d25/f39 d9/d18/d73/db7/d81/ddf/f110 0 2024-02-16T22:19:18.547 INFO:tasks.workunit.client.1.smithi173.stdout:0/489: getdents d0/d12/d15/d3d/d98/d14/d24/d32/d39 0 2024-02-16T22:19:18.547 INFO:tasks.workunit.client.1.smithi173.stdout:0/490: stat d0/d12/d15/d3d/d98/d14/d24/d32/d39/f2c 0 2024-02-16T22:19:18.548 INFO:tasks.workunit.client.1.smithi173.stdout:4/587: creat d7/d28/d31/d33/d7d/d3d/fce x:0 0 0 2024-02-16T22:19:18.548 INFO:tasks.workunit.client.1.smithi173.stdout:4/588: truncate d7/d28/d31/d33/d7d/d3d/fce 279080 0 2024-02-16T22:19:18.548 INFO:tasks.workunit.client.1.smithi173.stdout:4/589: getdents d7/d28/d31/d33/d7d/d4e/dcc 0 2024-02-16T22:19:18.549 INFO:tasks.workunit.client.1.smithi173.stdout:3/792: link d9/d18/d73/db7/f53 d9/d1a/d2b/d45/d51/d92/f111 0 2024-02-16T22:19:18.549 INFO:tasks.workunit.client.1.smithi173.stdout:3/793: truncate d9/f29 1111077 0 2024-02-16T22:19:18.550 INFO:tasks.workunit.client.1.smithi173.stdout:3/794: write d9/d1a/d2b/d45/d60/d6a/fd1 [1125431,39170] 0 2024-02-16T22:19:18.550 INFO:tasks.workunit.client.1.smithi173.stdout:3/795: chown d9/d17/d25/f50 213 1 2024-02-16T22:19:18.550 INFO:tasks.workunit.client.1.smithi173.stdout:0/491: mkdir d0/d12/d15/d99 0 2024-02-16T22:19:18.551 INFO:tasks.workunit.client.1.smithi173.stdout:0/492: mkdir d0/d12/d15/d9a 0 2024-02-16T22:19:18.552 INFO:tasks.workunit.client.1.smithi173.stdout:0/493: symlink d0/d12/d15/d3d/d98/d14/d24/l9b 0 2024-02-16T22:19:18.552 INFO:tasks.workunit.client.1.smithi173.stdout:0/494: dread - d0/d12/d15/d3d/d98/d14/d24/d58/f93 zero size 2024-02-16T22:19:18.554 INFO:tasks.workunit.client.1.smithi173.stdout:0/495: link d0/fb d0/d12/d15/d3d/d6f/f9c 0 2024-02-16T22:19:18.562 INFO:tasks.workunit.client.1.smithi173.stdout:4/590: dread d7/d28/d31/d33/d7d/d3d/f6c [0,4194304] 0 2024-02-16T22:19:18.563 INFO:tasks.workunit.client.1.smithi173.stdout:4/591: rmdir d7/d28/d14 39 2024-02-16T22:19:18.569 INFO:tasks.workunit.client.1.smithi173.stdout:6/637: dwrite d0/db/d2e/d65/d67/d78/fcf [0,4194304] 0 2024-02-16T22:19:18.571 INFO:tasks.workunit.client.1.smithi173.stdout:9/674: dwrite d1/d2/d10/f2e [0,4194304] 0 2024-02-16T22:19:18.571 INFO:tasks.workunit.client.1.smithi173.stdout:9/675: creat d1/d2/d1a/d3e/dc8/fda x:0 0 0 2024-02-16T22:19:18.571 INFO:tasks.workunit.client.1.smithi173.stdout:9/676: chown d1/d2/d1a/d2f/d3b/d75/db1 0 1 2024-02-16T22:19:18.571 INFO:tasks.workunit.client.1.smithi173.stdout:9/677: write d1/d5f/d6d/d97/fbc [200597,109159] 0 2024-02-16T22:19:18.576 INFO:tasks.workunit.client.1.smithi173.stdout:3/796: dwrite d9/d18/d5f/d6e/df9/f108 [0,4194304] 0 2024-02-16T22:19:18.577 INFO:tasks.workunit.client.1.smithi173.stdout:0/496: dwrite d0/d12/d15/d3d/d98/f2a [0,4194304] 0 2024-02-16T22:19:18.577 INFO:tasks.workunit.client.1.smithi173.stdout:0/497: stat d0/d12/d15/d3d/d98/d14/d24/l9b 0 2024-02-16T22:19:18.578 INFO:tasks.workunit.client.1.smithi173.stdout:3/797: symlink d9/d1a/d2b/d4d/d94/d98/l112 0 2024-02-16T22:19:18.580 INFO:tasks.workunit.client.1.smithi173.stdout:0/498: creat d0/d12/d15/d4f/f9d x:0 0 0 2024-02-16T22:19:18.580 INFO:tasks.workunit.client.1.smithi173.stdout:0/499: fdatasync d0/d6d/f7f 0 2024-02-16T22:19:18.581 INFO:tasks.workunit.client.1.smithi173.stdout:0/500: mknod d0/d84/c9e 0 2024-02-16T22:19:18.582 INFO:tasks.workunit.client.1.smithi173.stdout:3/798: rename d9/d1a/d2b/d4d/d5b/da9/faf to d9/d17/f113 0 2024-02-16T22:19:18.584 INFO:tasks.workunit.client.1.smithi173.stdout:0/501: symlink d0/d12/d15/d3d/d98/d33/d8a/l9f 0 2024-02-16T22:19:18.584 INFO:tasks.workunit.client.1.smithi173.stdout:3/799: rmdir d9/d18/d73/db7/d81/de1 39 2024-02-16T22:19:18.584 INFO:tasks.workunit.client.1.smithi173.stdout:3/800: creat d9/d18/d5f/d6e/d4e/f114 x:0 0 0 2024-02-16T22:19:18.585 INFO:tasks.workunit.client.1.smithi173.stdout:0/502: mknod d0/d84/d8c/ca0 0 2024-02-16T22:19:18.587 INFO:tasks.workunit.client.1.smithi173.stdout:0/503: unlink d0/d12/d15/d3d/d98/d14/d24/d32/d39/c96 0 2024-02-16T22:19:18.588 INFO:tasks.workunit.client.1.smithi173.stdout:3/801: getdents d9/d18/d73/db7 0 2024-02-16T22:19:18.590 INFO:tasks.workunit.client.1.smithi173.stdout:0/504: rename d0/d12/d15/d3d/d98/d14/d50/f6e to d0/d12/d15/d3d/fa1 0 2024-02-16T22:19:18.592 INFO:tasks.workunit.client.1.smithi173.stdout:0/505: creat d0/d12/d15/d3d/d98/d14/d24/d2e/d6b/d8e/fa2 x:0 0 0 2024-02-16T22:19:18.592 INFO:tasks.workunit.client.1.smithi173.stdout:0/506: dread - d0/d12/d15/d4f/f9d zero size 2024-02-16T22:19:18.593 INFO:tasks.workunit.client.1.smithi173.stdout:0/507: truncate d0/d12/d15/f1c 743649 0 2024-02-16T22:19:18.594 INFO:tasks.workunit.client.1.smithi173.stdout:0/508: symlink d0/d84/d8c/la3 0 2024-02-16T22:19:18.595 INFO:tasks.workunit.client.1.smithi173.stdout:0/509: symlink d0/la4 0 2024-02-16T22:19:18.596 INFO:tasks.workunit.client.1.smithi173.stdout:9/678: dwrite d1/d2/d10/f3f [0,4194304] 0 2024-02-16T22:19:18.597 INFO:tasks.workunit.client.1.smithi173.stdout:9/679: rename d1/d2/d1a/d3e/d4f/d8c/c93 to d1/d2/d10/cdb 0 2024-02-16T22:19:18.600 INFO:tasks.workunit.client.1.smithi173.stdout:6/638: dwrite d0/db/d2e/d61/f8a [0,4194304] 0 2024-02-16T22:19:18.600 INFO:tasks.workunit.client.1.smithi173.stdout:6/639: write d0/db/d4d/f6f [2130561,109922] 0 2024-02-16T22:19:18.604 INFO:tasks.workunit.client.1.smithi173.stdout:3/802: dwrite d9/d18/d5f/d6e/da7/ff7 [0,4194304] 0 2024-02-16T22:19:18.607 INFO:tasks.workunit.client.1.smithi173.stdout:6/640: symlink d0/db/d2e/d65/d73/le6 0 2024-02-16T22:19:18.612 INFO:tasks.workunit.client.1.smithi173.stdout:6/641: dread d0/db/d2e/f37 [4194304,4194304] 0 2024-02-16T22:19:18.613 INFO:tasks.workunit.client.1.smithi173.stdout:6/642: mknod d0/db/d2e/d65/ce7 0 2024-02-16T22:19:18.614 INFO:tasks.workunit.client.1.smithi173.stdout:9/680: dwrite d1/d2/d1a/d1f/d34/fae [4194304,4194304] 0 2024-02-16T22:19:18.614 INFO:tasks.workunit.client.1.smithi173.stdout:9/681: chown d1/d2/d1a/f20 7292 1 2024-02-16T22:19:18.616 INFO:tasks.workunit.client.1.smithi173.stdout:9/682: creat d1/d2/d1a/d2f/d51/fdc x:0 0 0 2024-02-16T22:19:18.616 INFO:tasks.workunit.client.1.smithi173.stdout:9/683: write d1/d5f/d6d/f74 [999555,3984] 0 2024-02-16T22:19:18.616 INFO:tasks.workunit.client.1.smithi173.stdout:9/684: chown d1/d2/d1a/l42 127658 1 2024-02-16T22:19:18.618 INFO:tasks.workunit.client.1.smithi173.stdout:9/685: creat d1/d2/d1a/d2f/d51/d96/fdd x:0 0 0 2024-02-16T22:19:18.620 INFO:tasks.workunit.client.1.smithi173.stdout:6/643: truncate d0/db/d4d/f6f 223533 0 2024-02-16T22:19:18.622 INFO:tasks.workunit.client.1.smithi173.stdout:6/644: rename d0/db/d2e/d2f/d31/d33/d6d to d0/db/d2e/d2f/da6/daa/de8 0 2024-02-16T22:19:18.624 INFO:tasks.workunit.client.1.smithi173.stdout:6/645: link d0/d7c/dc5/c98 d0/db/d2e/d65/d73/ce9 0 2024-02-16T22:19:18.626 INFO:tasks.workunit.client.1.smithi173.stdout:6/646: unlink d0/db/d2e/d2f/f4c 0 2024-02-16T22:19:18.626 INFO:tasks.workunit.client.1.smithi173.stdout:6/647: chown d0/db/d2e/d65/db8 3133 1 2024-02-16T22:19:18.626 INFO:tasks.workunit.client.1.smithi173.stdout:6/648: chown d0/db/d2e/d2f/d31/d7a/l7f 11066739 1 2024-02-16T22:19:18.643 INFO:tasks.workunit.client.1.smithi173.stdout:9/686: dwrite d1/d2/d1a/d1f/f29 [0,4194304] 0 2024-02-16T22:19:18.644 INFO:tasks.workunit.client.1.smithi173.stdout:6/649: dwrite d0/db/d2e/d2f/d31/fc7 [0,4194304] 0 2024-02-16T22:19:18.644 INFO:tasks.workunit.client.1.smithi173.stdout:9/687: link d1/d2/d1a/d2f/d51/d96/c9a d1/d2/d1a/d1f/d34/dbb/dbe/cde 0 2024-02-16T22:19:18.648 INFO:tasks.workunit.client.1.smithi173.stdout:6/650: symlink d0/db/d2e/d65/d67/lea 0 2024-02-16T22:19:18.648 INFO:tasks.workunit.client.1.smithi173.stdout:6/651: stat d0/db/d2e/d65/d67/d78/la0 0 2024-02-16T22:19:18.649 INFO:tasks.workunit.client.1.smithi173.stdout:9/688: mknod d1/d2/d1a/d2f/d51/d96/cdf 0 2024-02-16T22:19:18.649 INFO:tasks.workunit.client.1.smithi173.stdout:6/652: dread d0/db/d2e/d2f/f3b [0,4194304] 0 2024-02-16T22:19:18.649 INFO:tasks.workunit.client.1.smithi173.stdout:6/653: creat d0/db/d2e/d65/db8/feb x:0 0 0 2024-02-16T22:19:18.650 INFO:tasks.workunit.client.1.smithi173.stdout:2/620: sync 2024-02-16T22:19:18.650 INFO:tasks.workunit.client.1.smithi173.stdout:9/689: rename d1/d2/d1a/d1f/f43 to d1/d5f/d61/d80/fe0 0 2024-02-16T22:19:18.652 INFO:tasks.workunit.client.1.smithi173.stdout:6/654: mknod d0/db/cec 0 2024-02-16T22:19:18.652 INFO:tasks.workunit.client.1.smithi173.stdout:2/621: mkdir d2/d10/d62/d6c/dcd 0 2024-02-16T22:19:18.654 INFO:tasks.workunit.client.1.smithi173.stdout:6/655: link d0/f5b d0/db/d2e/d2f/fed 0 2024-02-16T22:19:18.655 INFO:tasks.workunit.client.1.smithi173.stdout:6/656: symlink d0/d7c/dc5/d92/lee 0 2024-02-16T22:19:18.666 INFO:tasks.workunit.client.1.smithi173.stdout:6/657: write d0/db/d2e/d65/d67/d78/fcf [565028,65015] 0 2024-02-16T22:19:18.667 INFO:tasks.workunit.client.1.smithi173.stdout:6/658: chown d0/l3 1164 1 2024-02-16T22:19:18.668 INFO:tasks.workunit.client.1.smithi173.stdout:6/659: creat d0/db/d2e/d65/d9f/fef x:0 0 0 2024-02-16T22:19:18.675 INFO:tasks.workunit.client.1.smithi173.stdout:2/622: dwrite d2/d4/f4c [0,4194304] 0 2024-02-16T22:19:18.675 INFO:tasks.workunit.client.1.smithi173.stdout:2/623: fdatasync d2/dc/d5d/f6a 0 2024-02-16T22:19:18.675 INFO:tasks.workunit.client.1.smithi173.stdout:2/624: chown d2/d4/d8/d30/d4d/f4e 1497572479 1 2024-02-16T22:19:18.675 INFO:tasks.workunit.client.1.smithi173.stdout:2/625: stat d2/dc/d19/d1a/fc5 0 2024-02-16T22:19:18.675 INFO:tasks.workunit.client.1.smithi173.stdout:2/626: write d2/dc/d19/d1c/d53/d6e/f73 [443026,48539] 0 2024-02-16T22:19:18.675 INFO:tasks.workunit.client.1.smithi173.stdout:9/690: dwrite d1/f12 [8388608,4194304] 0 2024-02-16T22:19:18.683 INFO:tasks.workunit.client.1.smithi173.stdout:6/660: dwrite d0/db/fbf [0,4194304] 0 2024-02-16T22:19:18.683 INFO:tasks.workunit.client.1.smithi173.stdout:6/661: truncate d0/d7c/fb0 988247 0 2024-02-16T22:19:18.711 INFO:tasks.workunit.client.1.smithi173.stdout:6/662: dwrite d0/db/d2e/d2f/d31/d7a/fe0 [0,4194304] 0 2024-02-16T22:19:18.711 INFO:tasks.workunit.client.1.smithi173.stdout:2/627: dwrite d2/dc/d5d/f18 [0,4194304] 0 2024-02-16T22:19:18.711 INFO:tasks.workunit.client.1.smithi173.stdout:2/628: creat d2/d4/d8/d80/fce x:0 0 0 2024-02-16T22:19:18.711 INFO:tasks.workunit.client.1.smithi173.stdout:9/691: dwrite d1/d5f/d6d/d91/fad [0,4194304] 0 2024-02-16T22:19:18.713 INFO:tasks.workunit.client.1.smithi173.stdout:6/663: getdents d0/db/d2e/d2f/d31 0 2024-02-16T22:19:18.713 INFO:tasks.workunit.client.1.smithi173.stdout:6/664: chown d0/db/d2e/d65/d73/d7d/fad 2438 1 2024-02-16T22:19:18.713 INFO:tasks.workunit.client.1.smithi173.stdout:9/692: dread d1/d2/d1a/d2f/d3b/f72 [0,4194304] 0 2024-02-16T22:19:18.716 INFO:tasks.workunit.client.1.smithi173.stdout:2/629: truncate d2/d10/f66 3763144 0 2024-02-16T22:19:18.717 INFO:tasks.workunit.client.1.smithi173.stdout:2/630: chown d2/dc/d19/d1c/fb0 2 1 2024-02-16T22:19:18.724 INFO:tasks.workunit.client.1.smithi173.stdout:6/665: write d0/db/d2e/d2f/d31/f55 [1585424,88065] 0 2024-02-16T22:19:18.728 INFO:tasks.workunit.client.1.smithi173.stdout:6/666: mkdir d0/db/df0 0 2024-02-16T22:19:18.729 INFO:tasks.workunit.client.1.smithi173.stdout:6/667: readlink d0/db/d4d/lcb 0 2024-02-16T22:19:18.729 INFO:tasks.workunit.client.1.smithi173.stdout:6/668: mkdir d0/db/d2e/d65/d67/d78/df1 0 2024-02-16T22:19:18.729 INFO:tasks.workunit.client.1.smithi173.stdout:6/669: getdents d0/db/d2e/d65/d73/da9 0 2024-02-16T22:19:18.742 INFO:tasks.workunit.client.1.smithi173.stdout:9/693: dwrite d1/f30 [0,4194304] 0 2024-02-16T22:19:18.743 INFO:tasks.workunit.client.1.smithi173.stdout:6/670: read d0/f11 [4132993,9098] 0 2024-02-16T22:19:18.743 INFO:tasks.workunit.client.1.smithi173.stdout:2/631: dwrite d2/d4/d8/d30/f3b [0,4194304] 0 2024-02-16T22:19:18.743 INFO:tasks.workunit.client.1.smithi173.stdout:6/671: write d0/db/d2e/d65/d73/d7d/fcd [381420,74287] 0 2024-02-16T22:19:18.745 INFO:tasks.workunit.client.1.smithi173.stdout:2/632: creat d2/d10/d62/fcf x:0 0 0 2024-02-16T22:19:18.747 INFO:tasks.workunit.client.1.smithi173.stdout:2/633: truncate d2/dc/d19/d1a/f3f 1633463 0 2024-02-16T22:19:18.761 INFO:tasks.workunit.client.1.smithi173.stdout:1/733: sync 2024-02-16T22:19:18.761 INFO:tasks.workunit.client.1.smithi173.stdout:1/734: chown db/f1b 517 1 2024-02-16T22:19:18.761 INFO:tasks.workunit.client.1.smithi173.stdout:7/631: sync 2024-02-16T22:19:18.762 INFO:tasks.workunit.client.1.smithi173.stdout:1/735: write db/d1c/d5c/f6d [4761866,29416] 0 2024-02-16T22:19:18.762 INFO:tasks.workunit.client.1.smithi173.stdout:1/736: write db/d1c/d25/d28/d3f/d4a/f5b [903333,39612] 0 2024-02-16T22:19:18.762 INFO:tasks.workunit.client.1.smithi173.stdout:7/632: dread d1/d1d/d4c/d63/f4 [0,4194304] 0 2024-02-16T22:19:18.763 INFO:tasks.workunit.client.1.smithi173.stdout:1/737: rmdir db/d5f/da9 39 2024-02-16T22:19:18.764 INFO:tasks.workunit.client.1.smithi173.stdout:7/633: symlink d1/d1d/d4c/d63/d13/d22/d53/db9/dbc/lc6 0 2024-02-16T22:19:18.764 INFO:tasks.workunit.client.1.smithi173.stdout:7/634: write d1/d1d/d4c/d63/d13/d22/f9c [1079282,23391] 0 2024-02-16T22:19:18.764 INFO:tasks.workunit.client.1.smithi173.stdout:7/635: chown d1/d1d/d4c/d63/d13/d22/d53/d27/cac 6128 1 2024-02-16T22:19:18.765 INFO:tasks.workunit.client.1.smithi173.stdout:9/694: dwrite d1/d2/d1a/d1f/d34/dbb/dbe/fc6 [0,4194304] 0 2024-02-16T22:19:18.765 INFO:tasks.workunit.client.1.smithi173.stdout:7/636: rmdir d1/d1d/d4c/d63/d13/d22/d53 39 2024-02-16T22:19:18.765 INFO:tasks.workunit.client.1.smithi173.stdout:7/637: read - d1/d1d/d4c/d91/d9f/fb1 zero size 2024-02-16T22:19:18.765 INFO:tasks.workunit.client.1.smithi173.stdout:7/638: dread - d1/d1d/d4c/d63/d54/f78 zero size 2024-02-16T22:19:18.766 INFO:tasks.workunit.client.1.smithi173.stdout:6/672: dwrite d0/db/d2e/d61/fd2 [0,4194304] 0 2024-02-16T22:19:18.768 INFO:tasks.workunit.client.1.smithi173.stdout:9/695: mkdir d1/d2/d1a/de1 0 2024-02-16T22:19:18.774 INFO:tasks.workunit.client.1.smithi173.stdout:6/673: truncate d0/db/d2e/f56 1448943 0 2024-02-16T22:19:18.781 INFO:tasks.workunit.client.1.smithi173.stdout:9/696: dread d1/d2/d1a/d2f/f53 [0,4194304] 0 2024-02-16T22:19:18.782 INFO:tasks.workunit.client.1.smithi173.stdout:9/697: rename d1/d2/d1a/d2f/d3b/c40 to d1/d2/d1a/d2f/d3b/d75/db1/ce2 0 2024-02-16T22:19:18.788 INFO:tasks.workunit.client.1.smithi173.stdout:7/639: dwrite d1/d1d/d4c/d63/d13/d36/d49/f68 [0,4194304] 0 2024-02-16T22:19:18.788 INFO:tasks.workunit.client.1.smithi173.stdout:7/640: fsync d1/d1d/d4c/d91/d81/f99 0 2024-02-16T22:19:18.788 INFO:tasks.workunit.client.1.smithi173.stdout:1/738: dwrite db/d1c/d5c/dac/fcd [0,4194304] 0 2024-02-16T22:19:18.789 INFO:tasks.workunit.client.1.smithi173.stdout:7/641: mkdir d1/d1d/d4c/d63/d11/dc7 0 2024-02-16T22:19:18.790 INFO:tasks.workunit.client.1.smithi173.stdout:9/698: dread d1/d2/f4c [0,4194304] 0 2024-02-16T22:19:18.790 INFO:tasks.workunit.client.1.smithi173.stdout:9/699: write d1/d2/d1a/d3e/d4f/d8c/f9d [167858,129551] 0 2024-02-16T22:19:18.794 INFO:tasks.workunit.client.1.smithi173.stdout:7/642: getdents d1/d1d/d4c 0 2024-02-16T22:19:18.798 INFO:tasks.workunit.client.1.smithi173.stdout:7/643: link d1/d1d/d4c/d63/d13/d22/d53/d27/cac d1/cc8 0 2024-02-16T22:19:18.800 INFO:tasks.workunit.client.1.smithi173.stdout:7/644: creat d1/d1d/d4c/d63/d13/d22/d7e/db5/fc9 x:0 0 0 2024-02-16T22:19:18.800 INFO:tasks.workunit.client.1.smithi173.stdout:7/645: chown d1/d1d/d4c/d63/d13/d22/d7e/f9e 281513 1 2024-02-16T22:19:18.805 INFO:tasks.workunit.client.1.smithi173.stdout:7/646: dread d1/d1d/d4c/d63/d13/f26 [0,4194304] 0 2024-02-16T22:19:18.806 INFO:tasks.workunit.client.1.smithi173.stdout:7/647: mkdir d1/d1d/d4c/d63/d6c/dca 0 2024-02-16T22:19:18.819 INFO:tasks.workunit.client.1.smithi173.stdout:7/648: dwrite d1/d1d/d4c/d63/d13/d22/d53/f24 [4194304,4194304] 0 2024-02-16T22:19:18.819 INFO:tasks.workunit.client.1.smithi173.stdout:7/649: dread - d1/d1d/d4c/d91/f95 zero size 2024-02-16T22:19:18.820 INFO:tasks.workunit.client.1.smithi173.stdout:7/650: symlink d1/d1d/lcb 0 2024-02-16T22:19:18.821 INFO:tasks.workunit.client.1.smithi173.stdout:7/651: creat d1/d1d/d4c/d63/d11/fcc x:0 0 0 2024-02-16T22:19:18.826 INFO:tasks.workunit.client.1.smithi173.stdout:8/797: sync 2024-02-16T22:19:18.826 INFO:tasks.workunit.client.1.smithi173.stdout:5/711: sync 2024-02-16T22:19:18.826 INFO:tasks.workunit.client.1.smithi173.stdout:4/592: sync 2024-02-16T22:19:18.826 INFO:tasks.workunit.client.1.smithi173.stdout:8/798: chown dd/d7c/d7d/d22/d2e/d41/d6b/f84 401374288 1 2024-02-16T22:19:18.827 INFO:tasks.workunit.client.1.smithi173.stdout:5/712: creat d8/da/d2d/d36/d50/fe1 x:0 0 0 2024-02-16T22:19:18.828 INFO:tasks.workunit.client.1.smithi173.stdout:4/593: mkdir d7/d12/d2d/dcf 0 2024-02-16T22:19:18.828 INFO:tasks.workunit.client.1.smithi173.stdout:4/594: fsync d7/d28/d14/f1f 0 2024-02-16T22:19:18.828 INFO:tasks.workunit.client.1.smithi173.stdout:8/799: dread dd/d7c/d7d/d22/d50/f62 [0,4194304] 0 2024-02-16T22:19:18.829 INFO:tasks.workunit.client.1.smithi173.stdout:5/713: unlink d8/da/d2d/d3a/da7/f77 0 2024-02-16T22:19:18.830 INFO:tasks.workunit.client.1.smithi173.stdout:4/595: rename d7/d28/d31/d33/d7d/d3d/c48 to d7/d28/d31/d33/d7d/d45/cd0 0 2024-02-16T22:19:18.831 INFO:tasks.workunit.client.1.smithi173.stdout:4/596: rmdir d7/d28/dac 39 2024-02-16T22:19:18.831 INFO:tasks.workunit.client.1.smithi173.stdout:4/597: chown d7/c8 330034384 1 2024-02-16T22:19:18.836 INFO:tasks.workunit.client.1.smithi173.stdout:8/800: write dd/d9d/fa9 [1327648,103927] 0 2024-02-16T22:19:18.851 INFO:tasks.workunit.client.1.smithi173.stdout:8/801: dwrite dd/d7c/d7d/d22/d5a/dc7/ff7 [0,4194304] 0 2024-02-16T22:19:18.853 INFO:tasks.workunit.client.1.smithi173.stdout:8/802: mknod dd/d7c/d7d/d22/d28/d40/de5/cfc 0 2024-02-16T22:19:18.853 INFO:tasks.workunit.client.1.smithi173.stdout:8/803: rmdir dd/d7c/dcb 39 2024-02-16T22:19:18.854 INFO:tasks.workunit.client.1.smithi173.stdout:8/804: mknod dd/d7c/d7d/d22/d2e/cfd 0 2024-02-16T22:19:18.854 INFO:tasks.workunit.client.1.smithi173.stdout:8/805: chown dd/d7c/d7d/d22/d5a/lc6 13004 1 2024-02-16T22:19:18.855 INFO:tasks.workunit.client.1.smithi173.stdout:8/806: creat dd/d7c/d7d/d22/ffe x:0 0 0 2024-02-16T22:19:18.856 INFO:tasks.workunit.client.1.smithi173.stdout:8/807: mkdir dd/d7c/d7d/d22/d28/d40/d69/df4/dff 0 2024-02-16T22:19:18.859 INFO:tasks.workunit.client.1.smithi173.stdout:8/808: dread dd/d7c/d7d/d22/f32 [0,4194304] 0 2024-02-16T22:19:18.862 INFO:tasks.workunit.client.1.smithi173.stdout:8/809: dread dd/f31 [0,4194304] 0 2024-02-16T22:19:18.862 INFO:tasks.workunit.client.1.smithi173.stdout:8/810: write dd/d7c/d7d/d22/d50/fb3 [693020,106853] 0 2024-02-16T22:19:18.869 INFO:tasks.workunit.client.1.smithi173.stdout:8/811: write dd/d7c/d7d/d22/d5a/dc7/ff7 [1549967,70261] 0 2024-02-16T22:19:18.877 INFO:tasks.workunit.client.1.smithi173.stdout:8/812: dread dd/d7c/d7d/d22/d28/f47 [4194304,4194304] 0 2024-02-16T22:19:18.878 INFO:tasks.workunit.client.1.smithi173.stdout:8/813: symlink dd/d7c/l100 0 2024-02-16T22:19:18.878 INFO:tasks.workunit.client.1.smithi173.stdout:8/814: write dd/d7c/d7d/d89/dad/fd6 [817381,23195] 0 2024-02-16T22:19:18.878 INFO:tasks.workunit.client.1.smithi173.stdout:8/815: readlink dd/d7c/d7d/d22/d5a/lc6 0 2024-02-16T22:19:18.878 INFO:tasks.workunit.client.1.smithi173.stdout:8/816: stat dd/d7c/d7d/d22/d28/d40/d69 0 2024-02-16T22:19:18.879 INFO:tasks.workunit.client.1.smithi173.stdout:8/817: rmdir dd/d7c/d7d/d22/d2e/d41 39 2024-02-16T22:19:18.882 INFO:tasks.workunit.client.1.smithi173.stdout:8/818: dread dd/d7c/d7d/d22/d5a/f61 [0,4194304] 0 2024-02-16T22:19:18.882 INFO:tasks.workunit.client.1.smithi173.stdout:8/819: write dd/d7c/d7d/d22/d5a/dc7/ff7 [601409,48664] 0 2024-02-16T22:19:19.010 INFO:tasks.workunit.client.1.smithi173.stdout:0/510: sync 2024-02-16T22:19:19.010 INFO:tasks.workunit.client.1.smithi173.stdout:3/803: sync 2024-02-16T22:19:19.011 INFO:tasks.workunit.client.1.smithi173.stdout:3/804: chown d9/d18/d5f/fc2 169738716 1 2024-02-16T22:19:19.011 INFO:tasks.workunit.client.1.smithi173.stdout:0/511: truncate d0/f5 510137 0 2024-02-16T22:19:19.020 INFO:tasks.workunit.client.1.smithi173.stdout:0/512: dread d0/d12/d15/d3d/d98/d14/f2d [0,4194304] 0 2024-02-16T22:19:19.022 INFO:tasks.workunit.client.1.smithi173.stdout:0/513: link d0/d12/d15/d3d/d98/d27/c44 d0/d12/d15/d3d/d98/d14/d24/d32/d39/ca5 0 2024-02-16T22:19:19.022 INFO:tasks.workunit.client.1.smithi173.stdout:0/514: truncate d0/d12/d15/d3d/d98/d14/d24/d32/d39/f2c 2250815 0 2024-02-16T22:19:19.024 INFO:tasks.workunit.client.1.smithi173.stdout:0/515: rename d0/f1e to d0/d12/d15/d86/fa6 0 2024-02-16T22:19:19.028 INFO:tasks.workunit.client.1.smithi173.stdout:0/516: dread d0/f95 [0,4194304] 0 2024-02-16T22:19:19.028 INFO:tasks.workunit.client.1.smithi173.stdout:0/517: fsync d0/d12/d15/d3d/fa1 0 2024-02-16T22:19:19.028 INFO:tasks.workunit.client.1.smithi173.stdout:3/805: dwrite d9/d1a/f34 [0,4194304] 0 2024-02-16T22:19:19.047 INFO:tasks.workunit.client.1.smithi173.stdout:0/518: dwrite d0/f67 [0,4194304] 0 2024-02-16T22:19:19.050 INFO:tasks.workunit.client.1.smithi173.stdout:0/519: rename d0/d12/d15/d3d/d98/d33/l51 to d0/d12/d15/d4f/d92/la7 0 2024-02-16T22:19:19.050 INFO:tasks.workunit.client.1.smithi173.stdout:0/520: symlink d0/d84/d8c/la8 0 2024-02-16T22:19:19.050 INFO:tasks.workunit.client.1.smithi173.stdout:0/521: dread - d0/d12/d15/d3d/d98/d14/d24/d58/f93 zero size 2024-02-16T22:19:19.051 INFO:tasks.workunit.client.1.smithi173.stdout:0/522: symlink d0/d12/d15/d99/la9 0 2024-02-16T22:19:19.051 INFO:tasks.workunit.client.1.smithi173.stdout:0/523: write d0/d12/d15/d3d/d98/d14/d24/d58/f93 [512474,88494] 0 2024-02-16T22:19:19.054 INFO:tasks.workunit.client.1.smithi173.stdout:0/524: write d0/d12/d15/d3d/d98/d14/f2d [936368,71872] 0 2024-02-16T22:19:19.055 INFO:tasks.workunit.client.1.smithi173.stdout:0/525: mknod d0/d12/d15/d4f/d92/caa 0 2024-02-16T22:19:19.056 INFO:tasks.workunit.client.1.smithi173.stdout:0/526: mkdir d0/d12/d15/d3d/dab 0 2024-02-16T22:19:19.057 INFO:tasks.workunit.client.1.smithi173.stdout:0/527: getdents d0/d12/d15/d3d/d98/d14/d24/d2e/d6b/d8e 0 2024-02-16T22:19:19.071 INFO:tasks.workunit.client.1.smithi173.stdout:0/528: dwrite d0/d12/d15/d3d/f65 [0,4194304] 0 2024-02-16T22:19:19.071 INFO:tasks.workunit.client.1.smithi173.stdout:0/529: read - d0/d12/d15/d3d/d98/d14/d50/f76 zero size 2024-02-16T22:19:19.071 INFO:tasks.workunit.client.1.smithi173.stdout:0/530: fsync d0/d12/d15/d3d/d98/d14/d50/f76 0 2024-02-16T22:19:19.073 INFO:tasks.workunit.client.1.smithi173.stdout:0/531: rename d0/l9 to d0/d12/d15/d86/lac 0 2024-02-16T22:19:19.074 INFO:tasks.workunit.client.1.smithi173.stdout:0/532: getdents d0/d12/d15/d4f 0 2024-02-16T22:19:19.075 INFO:tasks.workunit.client.1.smithi173.stdout:0/533: chown d0/d12/d15/d3d/d98/d14/d24/d5f 3724 1 2024-02-16T22:19:19.075 INFO:tasks.workunit.client.1.smithi173.stdout:0/534: chown d0/d12/d15/d3d/d98/d14/f8d 407058 1 2024-02-16T22:19:19.075 INFO:tasks.workunit.client.1.smithi173.stdout:0/535: chown d0/d12/d15/d3d/d98/d14/l1a 25556 1 2024-02-16T22:19:19.075 INFO:tasks.workunit.client.1.smithi173.stdout:0/536: mkdir d0/dad 0 2024-02-16T22:19:19.076 INFO:tasks.workunit.client.1.smithi173.stdout:0/537: symlink d0/d12/d15/d3d/d98/d14/d24/d32/lae 0 2024-02-16T22:19:19.076 INFO:tasks.workunit.client.1.smithi173.stdout:0/538: chown d0/d12/d15/d3d/d98/d27/f57 252875 1 2024-02-16T22:19:19.077 INFO:tasks.workunit.client.1.smithi173.stdout:0/539: mknod d0/d12/d15/d3d/d98/d14/d24/d2e/d6b/d8e/caf 0 2024-02-16T22:19:19.096 INFO:tasks.workunit.client.1.smithi173.stdout:0/540: dwrite d0/d12/d15/d4f/f9d [0,4194304] 0 2024-02-16T22:19:19.096 INFO:tasks.workunit.client.1.smithi173.stdout:0/541: chown d0/d12/d15/d3d/d98/d33/d54 20 1 2024-02-16T22:19:19.111 INFO:tasks.workunit.client.1.smithi173.stdout:0/542: dwrite d0/d12/d15/d3d/f65 [0,4194304] 0 2024-02-16T22:19:19.134 INFO:tasks.workunit.client.1.smithi173.stdout:0/543: dwrite d0/f5 [0,4194304] 0 2024-02-16T22:19:19.137 INFO:tasks.workunit.client.1.smithi173.stdout:0/544: symlink d0/d12/d15/d3d/d98/d14/lb0 0 2024-02-16T22:19:19.148 INFO:tasks.workunit.client.1.smithi173.stdout:0/545: dread d0/d12/d15/d3d/f65 [0,4194304] 0 2024-02-16T22:19:19.150 INFO:tasks.workunit.client.1.smithi173.stdout:0/546: mknod d0/d12/d15/cb1 0 2024-02-16T22:19:19.151 INFO:tasks.workunit.client.1.smithi173.stdout:0/547: mknod d0/d6d/cb2 0 2024-02-16T22:19:19.152 INFO:tasks.workunit.client.1.smithi173.stdout:0/548: creat d0/d12/d15/d3d/d98/d14/d24/d32/d39/fb3 x:0 0 0 2024-02-16T22:19:19.152 INFO:tasks.workunit.client.1.smithi173.stdout:0/549: write d0/d12/d15/d3d/d6f/f9c [736011,85575] 0 2024-02-16T22:19:19.152 INFO:tasks.workunit.client.1.smithi173.stdout:0/550: write d0/d12/d15/d3d/d98/d14/d50/f76 [746027,61089] 0 2024-02-16T22:19:19.152 INFO:tasks.workunit.client.1.smithi173.stdout:0/551: chown d0/d12/d15 1252 1 2024-02-16T22:19:19.154 INFO:tasks.workunit.client.1.smithi173.stdout:0/552: creat d0/d12/d15/d3d/d98/d14/d24/d32/fb4 x:0 0 0 2024-02-16T22:19:19.156 INFO:tasks.workunit.client.1.smithi173.stdout:0/553: rename d0/d12/d15/d3d/d98/d33/d8a to d0/d12/d15/d3d/db5 0 2024-02-16T22:19:19.158 INFO:tasks.workunit.client.1.smithi173.stdout:0/554: rmdir d0/d12/d15/d9a 0 2024-02-16T22:19:19.165 INFO:tasks.workunit.client.1.smithi173.stdout:0/555: dread d0/d12/f4d [0,4194304] 0 2024-02-16T22:19:19.172 INFO:tasks.workunit.client.1.smithi173.stdout:0/556: fdatasync d0/d12/d15/d3d/d6f/f9c 0 2024-02-16T22:19:19.174 INFO:tasks.workunit.client.1.smithi173.stdout:0/557: creat d0/d84/fb6 x:0 0 0 2024-02-16T22:19:19.174 INFO:tasks.workunit.client.1.smithi173.stdout:0/558: creat d0/d12/d15/d3d/d98/d14/d24/d32/d39/fb7 x:0 0 0 2024-02-16T22:19:19.183 INFO:tasks.workunit.client.1.smithi173.stdout:2/634: sync 2024-02-16T22:19:19.185 INFO:tasks.workunit.client.1.smithi173.stdout:2/635: unlink d2/dc/d5d/f24 0 2024-02-16T22:19:19.185 INFO:tasks.workunit.client.1.smithi173.stdout:2/636: truncate d2/dc/d19/d1c/d87/f8d 78446 0 2024-02-16T22:19:19.186 INFO:tasks.workunit.client.1.smithi173.stdout:2/637: creat d2/d4/d8/d3a/fd0 x:0 0 0 2024-02-16T22:19:19.186 INFO:tasks.workunit.client.1.smithi173.stdout:2/638: fdatasync d2/d4/d8/f95 0 2024-02-16T22:19:19.186 INFO:tasks.workunit.client.1.smithi173.stdout:2/639: fsync d2/d10/d62/f78 0 2024-02-16T22:19:19.186 INFO:tasks.workunit.client.1.smithi173.stdout:2/640: symlink d2/dc/d19/da3/da4/ld1 0 2024-02-16T22:19:19.188 INFO:tasks.workunit.client.1.smithi173.stdout:0/559: dwrite d0/d12/d15/d3d/d98/f7 [4194304,4194304] 0 2024-02-16T22:19:19.189 INFO:tasks.workunit.client.1.smithi173.stdout:0/560: creat d0/d12/d15/d3d/dab/fb8 x:0 0 0 2024-02-16T22:19:19.190 INFO:tasks.workunit.client.1.smithi173.stdout:0/561: symlink d0/d84/d8c/lb9 0 2024-02-16T22:19:19.190 INFO:tasks.workunit.client.1.smithi173.stdout:0/562: fdatasync d0/d12/d15/d3d/d98/f3e 0 2024-02-16T22:19:19.192 INFO:tasks.workunit.client.1.smithi173.stdout:0/563: creat d0/d12/d15/d3d/d98/d14/d24/d5f/fba x:0 0 0 2024-02-16T22:19:19.192 INFO:tasks.workunit.client.1.smithi173.stdout:0/564: symlink d0/d12/d15/d3d/d98/d14/d24/d58/lbb 0 2024-02-16T22:19:19.194 INFO:tasks.workunit.client.1.smithi173.stdout:0/565: rename d0/d12/d15/d3d/d98/d14/d24/l43 to d0/d84/d8c/lbc 0 2024-02-16T22:19:19.194 INFO:tasks.workunit.client.1.smithi173.stdout:2/641: dread d2/dc/f2b [0,4194304] 0 2024-02-16T22:19:19.194 INFO:tasks.workunit.client.1.smithi173.stdout:2/642: write d2/d4/d8/d30/d44/fad [1156152,100084] 0 2024-02-16T22:19:19.195 INFO:tasks.workunit.client.1.smithi173.stdout:0/566: write d0/d12/d15/d3d/d98/f18 [1406995,84718] 0 2024-02-16T22:19:19.197 INFO:tasks.workunit.client.1.smithi173.stdout:0/567: creat d0/d12/d15/d3d/d98/d14/d24/d2e/d6b/fbd x:0 0 0 2024-02-16T22:19:19.197 INFO:tasks.workunit.client.1.smithi173.stdout:0/568: dread - d0/d84/fb6 zero size 2024-02-16T22:19:19.197 INFO:tasks.workunit.client.1.smithi173.stdout:0/569: chown d0/d12/d15/d3d/d98/d14/d24/d2e/d6b 100022 1 2024-02-16T22:19:19.198 INFO:tasks.workunit.client.1.smithi173.stdout:0/570: creat d0/d12/d15/d4f/d92/fbe x:0 0 0 2024-02-16T22:19:19.200 INFO:tasks.workunit.client.1.smithi173.stdout:0/571: rename d0/d12/d15/d3d/d6f to d0/d12/d15/d3d/db5/dbf 0 2024-02-16T22:19:19.200 INFO:tasks.workunit.client.1.smithi173.stdout:0/572: fsync d0/d12/d15/d3d/d98/d14/d24/d32/d39/f64 0 2024-02-16T22:19:19.200 INFO:tasks.workunit.client.1.smithi173.stdout:0/573: dread - d0/d84/fb6 zero size 2024-02-16T22:19:19.212 INFO:tasks.workunit.client.1.smithi173.stdout:2/643: dwrite d2/d4/d8/d30/d4d/f75 [0,4194304] 0 2024-02-16T22:19:19.216 INFO:tasks.workunit.client.1.smithi173.stdout:2/644: truncate d2/dc/d19/d1a/f3f 1513679 0 2024-02-16T22:19:19.217 INFO:tasks.workunit.client.1.smithi173.stdout:2/645: rename d2/d10/d62/f63 to d2/dc/d19/d69/dab/fd2 0 2024-02-16T22:19:19.221 INFO:tasks.workunit.client.1.smithi173.stdout:0/574: dwrite d0/d12/d15/d3d/d98/d14/d24/d32/d39/f64 [0,4194304] 0 2024-02-16T22:19:19.221 INFO:tasks.workunit.client.1.smithi173.stdout:0/575: chown d0/d12/d15/d99 55555 1 2024-02-16T22:19:19.221 INFO:tasks.workunit.client.1.smithi173.stdout:0/576: fdatasync d0/d12/d15/d3d/d98/d14/d24/d5f/f7e 0 2024-02-16T22:19:19.237 INFO:tasks.workunit.client.1.smithi173.stdout:0/577: dwrite d0/d12/d15/d3d/d98/d14/d24/d32/f66 [0,4194304] 0 2024-02-16T22:19:19.239 INFO:tasks.workunit.client.1.smithi173.stdout:0/578: getdents d0/d12/d15/d3d/d98/d14/d24 0 2024-02-16T22:19:19.243 INFO:tasks.workunit.client.1.smithi173.stdout:0/579: dread d0/d12/d15/d3d/d98/d14/d24/d32/d39/f42 [0,4194304] 0 2024-02-16T22:19:19.244 INFO:tasks.workunit.client.1.smithi173.stdout:0/580: rename d0/d6d/cb2 to d0/d12/d15/cc0 0 2024-02-16T22:19:19.244 INFO:tasks.workunit.client.1.smithi173.stdout:0/581: symlink d0/dad/lc1 0 2024-02-16T22:19:19.246 INFO:tasks.workunit.client.1.smithi173.stdout:0/582: write d0/d12/d15/d3d/d98/d14/d50/f76 [17923,11400] 0 2024-02-16T22:19:19.247 INFO:tasks.workunit.client.1.smithi173.stdout:0/583: mkdir d0/d12/d15/d3d/d98/d33/dc2 0 2024-02-16T22:19:19.247 INFO:tasks.workunit.client.1.smithi173.stdout:0/584: fsync d0/d12/d15/d86/fa6 0 2024-02-16T22:19:19.260 INFO:tasks.workunit.client.1.smithi173.stdout:0/585: dwrite d0/d12/d15/d3d/d98/d14/f71 [0,4194304] 0 2024-02-16T22:19:19.263 INFO:tasks.workunit.client.1.smithi173.stdout:0/586: rename d0/d12/d15/d3d/d98/d14/l1a to d0/d12/d15/d3d/d98/d14/d50/lc3 0 2024-02-16T22:19:19.264 INFO:tasks.workunit.client.1.smithi173.stdout:0/587: creat d0/d84/d8c/fc4 x:0 0 0 2024-02-16T22:19:19.265 INFO:tasks.workunit.client.1.smithi173.stdout:0/588: mknod d0/d12/d15/d4f/d92/cc5 0 2024-02-16T22:19:19.268 INFO:tasks.workunit.client.1.smithi173.stdout:0/589: dread d0/d12/d15/d86/fa6 [0,4194304] 0 2024-02-16T22:19:19.269 INFO:tasks.workunit.client.1.smithi173.stdout:0/590: readlink d0/d12/d15/l46 0 2024-02-16T22:19:19.270 INFO:tasks.workunit.client.1.smithi173.stdout:0/591: symlink d0/d12/d15/d3d/d98/d14/d24/d32/lc6 0 2024-02-16T22:19:19.270 INFO:tasks.workunit.client.1.smithi173.stdout:0/592: stat d0/d12/d15/d3d/l7a 0 2024-02-16T22:19:19.270 INFO:tasks.workunit.client.1.smithi173.stdout:0/593: write d0/d12/d15/d3d/d98/d14/f8d [421392,104345] 0 2024-02-16T22:19:19.270 INFO:tasks.workunit.client.1.smithi173.stdout:0/594: symlink d0/d12/d15/d3d/d98/d33/d54/lc7 0 2024-02-16T22:19:19.271 INFO:tasks.workunit.client.1.smithi173.stdout:0/595: truncate d0/d12/d15/d3d/d98/d27/f73 2689752 0 2024-02-16T22:19:19.271 INFO:tasks.workunit.client.1.smithi173.stdout:0/596: readlink d0/d12/d15/d86/lac 0 2024-02-16T22:19:19.271 INFO:tasks.workunit.client.1.smithi173.stdout:0/597: dread - d0/d84/d8c/f97 zero size 2024-02-16T22:19:19.272 INFO:tasks.workunit.client.1.smithi173.stdout:0/598: link d0/d12/d15/cb1 d0/d12/d15/d86/cc8 0 2024-02-16T22:19:19.272 INFO:tasks.workunit.client.1.smithi173.stdout:0/599: fdatasync d0/d12/d15/d3d/d98/d14/d24/d32/d39/f75 0 2024-02-16T22:19:19.273 INFO:tasks.workunit.client.1.smithi173.stdout:0/600: rename d0/dad to d0/d6d/dc9 0 2024-02-16T22:19:19.293 INFO:tasks.workunit.client.1.smithi173.stdout:0/601: dwrite d0/d12/d15/d86/fa6 [0,4194304] 0 2024-02-16T22:19:19.293 INFO:tasks.workunit.client.1.smithi173.stdout:0/602: chown d0/d6d 6 1 2024-02-16T22:19:19.293 INFO:tasks.workunit.client.1.smithi173.stdout:0/603: readlink d0/d12/d15/d3d/d98/d14/l2f 0 2024-02-16T22:19:19.295 INFO:tasks.workunit.client.1.smithi173.stdout:0/604: mknod d0/d12/d15/d3d/d98/d14/d50/cca 0 2024-02-16T22:19:19.295 INFO:tasks.workunit.client.1.smithi173.stdout:0/605: chown d0/d12/d15/d3d/d98/d14/d24/d70 923 1 2024-02-16T22:19:19.311 INFO:tasks.workunit.client.1.smithi173.stdout:0/606: dwrite d0/d12/d15/d3d/d98/d14/d24/d32/d39/f42 [0,4194304] 0 2024-02-16T22:19:19.311 INFO:tasks.workunit.client.1.smithi173.stdout:0/607: creat d0/d84/fcb x:0 0 0 2024-02-16T22:19:19.313 INFO:tasks.workunit.client.1.smithi173.stdout:0/608: mknod d0/d12/d15/d3d/d98/d33/ccc 0 2024-02-16T22:19:19.314 INFO:tasks.workunit.client.1.smithi173.stdout:0/609: chown d0/d12/d15/cb1 5360720 1 2024-02-16T22:19:19.316 INFO:tasks.workunit.client.1.smithi173.stdout:0/610: dread d0/d12/d15/d3d/db5/dbf/f9c [0,4194304] 0 2024-02-16T22:19:19.316 INFO:tasks.workunit.client.1.smithi173.stdout:0/611: dread - d0/d84/fb6 zero size 2024-02-16T22:19:19.317 INFO:tasks.workunit.client.1.smithi173.stdout:0/612: creat d0/d12/d15/d3d/d98/d33/fcd x:0 0 0 2024-02-16T22:19:19.317 INFO:tasks.workunit.client.1.smithi173.stdout:0/613: mkdir d0/d12/dce 0 2024-02-16T22:19:19.318 INFO:tasks.workunit.client.1.smithi173.stdout:0/614: stat d0/l20 0 2024-02-16T22:19:19.319 INFO:tasks.workunit.client.1.smithi173.stdout:0/615: mknod d0/d12/d15/d3d/d98/d14/ccf 0 2024-02-16T22:19:19.319 INFO:tasks.workunit.client.1.smithi173.stdout:0/616: fdatasync d0/d12/f4d 0 2024-02-16T22:19:19.319 INFO:tasks.workunit.client.1.smithi173.stdout:0/617: mkdir d0/d12/d15/d3d/d98/d14/d50/dd0 0 2024-02-16T22:19:19.320 INFO:tasks.workunit.client.1.smithi173.stdout:0/618: creat d0/d12/d15/d3d/d98/d14/d24/d2e/d6b/d8e/fd1 x:0 0 0 2024-02-16T22:19:19.321 INFO:tasks.workunit.client.1.smithi173.stdout:0/619: unlink d0/d12/d15/d3d/d98/d14/d24/d58/f74 0 2024-02-16T22:19:19.329 INFO:tasks.workunit.client.1.smithi173.stdout:0/620: dread d0/f5 [0,4194304] 0 2024-02-16T22:19:19.330 INFO:tasks.workunit.client.1.smithi173.stdout:0/621: write d0/d12/f4d [4470355,24583] 0 2024-02-16T22:19:19.345 INFO:tasks.workunit.client.1.smithi173.stdout:0/622: dwrite d0/d12/d15/d3d/d98/d14/d24/d32/d39/f75 [0,4194304] 0 2024-02-16T22:19:19.348 INFO:tasks.workunit.client.1.smithi173.stdout:0/623: rename d0/d12/d15/d3d/d98/d14/d24/d2e/c72 to d0/d12/d15/d3d/d98/d33/cd2 0 2024-02-16T22:19:19.351 INFO:tasks.workunit.client.1.smithi173.stdout:0/624: truncate d0/d12/d15/d3d/d98/d14/d24/d32/d39/f42 2511133 0 2024-02-16T22:19:19.352 INFO:tasks.workunit.client.1.smithi173.stdout:0/625: link d0/d12/d15/d3d/d98/d27/f5a d0/d12/d15/d3d/d98/d27/fd3 0 2024-02-16T22:19:19.352 INFO:tasks.workunit.client.1.smithi173.stdout:0/626: write d0/d12/d15/d3d/d98/d14/d24/d32/d39/f2c [780411,4975] 0 2024-02-16T22:19:19.354 INFO:tasks.workunit.client.1.smithi173.stdout:0/627: mknod d0/d12/d15/d3d/d98/d14/d38/cd4 0 2024-02-16T22:19:19.354 INFO:tasks.workunit.client.1.smithi173.stdout:0/628: fsync d0/f5e 0 2024-02-16T22:19:19.356 INFO:tasks.workunit.client.1.smithi173.stdout:0/629: rename d0/d12/d15/d3d/d98/d14/d24/d32/lae to d0/d12/d15/d3d/d98/d33/d54/ld5 0 2024-02-16T22:19:19.365 INFO:tasks.workunit.client.1.smithi173.stdout:0/630: dread d0/d12/d15/d4f/f9d [0,4194304] 0 2024-02-16T22:19:19.380 INFO:tasks.workunit.client.1.smithi173.stdout:0/631: dwrite d0/d12/d15/d3d/d98/f18 [0,4194304] 0 2024-02-16T22:19:19.382 INFO:tasks.workunit.client.1.smithi173.stdout:0/632: creat d0/d12/d15/d3d/d98/d14/d24/d2e/fd6 x:0 0 0 2024-02-16T22:19:19.382 INFO:tasks.workunit.client.1.smithi173.stdout:0/633: write d0/d12/d15/d3d/d98/d14/d24/d5f/f7e [970520,55623] 0 2024-02-16T22:19:19.384 INFO:tasks.workunit.client.1.smithi173.stdout:0/634: rename d0/d12/d15/d3d/d98/f18 to d0/d12/d15/d3d/d98/d14/d24/d5f/fd7 0 2024-02-16T22:19:19.384 INFO:tasks.workunit.client.1.smithi173.stdout:0/635: stat d0/d12/d15/d3d/c78 0 2024-02-16T22:19:19.384 INFO:tasks.workunit.client.1.smithi173.stdout:0/636: chown d0/d12/d15/d3d/d98/f2a 94155080 1 2024-02-16T22:19:19.384 INFO:tasks.workunit.client.1.smithi173.stdout:0/637: chown d0/d84 0 1 2024-02-16T22:19:19.384 INFO:tasks.workunit.client.1.smithi173.stdout:0/638: getdents d0/d12/d15/d3d/dab 0 2024-02-16T22:19:19.386 INFO:tasks.workunit.client.1.smithi173.stdout:0/639: unlink d0/d12/f4d 0 2024-02-16T22:19:19.400 INFO:tasks.workunit.client.1.smithi173.stdout:0/640: dwrite d0/d12/d15/d3d/d98/f2a [0,4194304] 0 2024-02-16T22:19:19.412 INFO:tasks.workunit.client.1.smithi173.stdout:0/641: dread d0/d12/d15/d86/fa6 [0,4194304] 0 2024-02-16T22:19:19.412 INFO:tasks.workunit.client.1.smithi173.stdout:1/739: sync 2024-02-16T22:19:19.412 INFO:tasks.workunit.client.1.smithi173.stdout:6/674: sync 2024-02-16T22:19:19.414 INFO:tasks.workunit.client.1.smithi173.stdout:0/642: symlink d0/d12/ld8 0 2024-02-16T22:19:19.414 INFO:tasks.workunit.client.1.smithi173.stdout:0/643: chown d0/d12/d15/d3d/d98/d14/d24/d32/l41 122238 1 2024-02-16T22:19:19.414 INFO:tasks.workunit.client.1.smithi173.stdout:0/644: fsync d0/d12/d15/d86/fa6 0 2024-02-16T22:19:19.414 INFO:tasks.workunit.client.1.smithi173.stdout:0/645: write d0/d12/d15/d3d/dab/fb8 [206282,15967] 0 2024-02-16T22:19:19.414 INFO:tasks.workunit.client.1.smithi173.stdout:0/646: write d0/d12/d15/d3d/d98/d14/f8d [791501,93666] 0 2024-02-16T22:19:19.414 INFO:tasks.workunit.client.1.smithi173.stdout:6/675: read d0/f44 [399086,78204] 0 2024-02-16T22:19:19.415 INFO:tasks.workunit.client.1.smithi173.stdout:7/652: sync 2024-02-16T22:19:19.415 INFO:tasks.workunit.client.1.smithi173.stdout:2/646: sync 2024-02-16T22:19:19.415 INFO:tasks.workunit.client.1.smithi173.stdout:9/700: sync 2024-02-16T22:19:19.415 INFO:tasks.workunit.client.1.smithi173.stdout:5/714: sync 2024-02-16T22:19:19.415 INFO:tasks.workunit.client.1.smithi173.stdout:8/820: sync 2024-02-16T22:19:19.415 INFO:tasks.workunit.client.1.smithi173.stdout:9/701: truncate d1/d2/d1a/d2f/d51/d96/fdd 490073 0 2024-02-16T22:19:19.415 INFO:tasks.workunit.client.1.smithi173.stdout:8/821: chown dd/dd9/ce0 397 1 2024-02-16T22:19:19.416 INFO:tasks.workunit.client.1.smithi173.stdout:2/647: creat d2/dc/d19/d1a/d74/db2/fd3 x:0 0 0 2024-02-16T22:19:19.416 INFO:tasks.workunit.client.1.smithi173.stdout:3/806: sync 2024-02-16T22:19:19.416 INFO:tasks.workunit.client.1.smithi173.stdout:4/598: sync 2024-02-16T22:19:19.416 INFO:tasks.workunit.client.1.smithi173.stdout:4/599: readlink d7/df/l21 0 2024-02-16T22:19:19.416 INFO:tasks.workunit.client.1.smithi173.stdout:4/600: fsync d7/d28/dac/fc9 0 2024-02-16T22:19:19.417 INFO:tasks.workunit.client.1.smithi173.stdout:1/740: link db/d29/d50/c6a db/d5f/d97/c101 0 2024-02-16T22:19:19.418 INFO:tasks.workunit.client.1.smithi173.stdout:0/647: creat d0/d12/d15/d3d/d98/d27/fd9 x:0 0 0 2024-02-16T22:19:19.418 INFO:tasks.workunit.client.1.smithi173.stdout:6/676: dread d0/db/d2e/d2f/f4b [0,4194304] 0 2024-02-16T22:19:19.418 INFO:tasks.workunit.client.1.smithi173.stdout:5/715: mknod d8/da/d2d/dbd/ce2 0 2024-02-16T22:19:19.418 INFO:tasks.workunit.client.1.smithi173.stdout:5/716: chown d8/d27 40 1 2024-02-16T22:19:19.420 INFO:tasks.workunit.client.1.smithi173.stdout:8/822: symlink dd/d7c/d7d/d93/l101 0 2024-02-16T22:19:19.420 INFO:tasks.workunit.client.1.smithi173.stdout:8/823: dread - dd/d7c/d7d/d22/d28/d40/d69/da7/dae/fed zero size 2024-02-16T22:19:19.420 INFO:tasks.workunit.client.1.smithi173.stdout:8/824: chown dd/d7c/d7d/d22/d2e/f48 51 1 2024-02-16T22:19:19.422 INFO:tasks.workunit.client.1.smithi173.stdout:0/648: read d0/d12/d15/d3d/d98/d27/f73 [338289,71995] 0 2024-02-16T22:19:19.422 INFO:tasks.workunit.client.1.smithi173.stdout:3/807: creat d9/d1a/d2b/d4d/d5b/da9/db4/de2/f115 x:0 0 0 2024-02-16T22:19:19.422 INFO:tasks.workunit.client.1.smithi173.stdout:3/808: creat d9/d1a/d2b/d45/d51/d92/f116 x:0 0 0 2024-02-16T22:19:19.424 INFO:tasks.workunit.client.1.smithi173.stdout:4/601: rename d7/d28/d52/d89/faa to d7/d28/d31/d33/fd1 0 2024-02-16T22:19:19.425 INFO:tasks.workunit.client.1.smithi173.stdout:6/677: mknod d0/db/d2e/d65/d67/d78/df1/cf2 0 2024-02-16T22:19:19.429 INFO:tasks.workunit.client.1.smithi173.stdout:1/741: rename db/d1c/f9e to db/d1c/d25/d28/f102 0 2024-02-16T22:19:19.431 INFO:tasks.workunit.client.1.smithi173.stdout:2/648: dread d2/dc/d19/d1a/fc6 [0,4194304] 0 2024-02-16T22:19:19.431 INFO:tasks.workunit.client.1.smithi173.stdout:5/717: dread d8/da/fc [0,4194304] 0 2024-02-16T22:19:19.431 INFO:tasks.workunit.client.1.smithi173.stdout:4/602: mknod d7/d28/d31/d72/d93/cd2 0 2024-02-16T22:19:19.431 INFO:tasks.workunit.client.1.smithi173.stdout:5/718: truncate d8/d27/d35/fbb 1339494 0 2024-02-16T22:19:19.431 INFO:tasks.workunit.client.1.smithi173.stdout:5/719: creat d8/da/d2d/d36/d50/fe3 x:0 0 0 2024-02-16T22:19:19.432 INFO:tasks.workunit.client.1.smithi173.stdout:5/720: chown d8/da/d1b/d57/dde 1 1 2024-02-16T22:19:19.433 INFO:tasks.workunit.client.1.smithi173.stdout:1/742: creat db/d29/d50/d85/dde/f103 x:0 0 0 2024-02-16T22:19:19.433 INFO:tasks.workunit.client.1.smithi173.stdout:2/649: stat d2/cca 0 2024-02-16T22:19:19.434 INFO:tasks.workunit.client.1.smithi173.stdout:3/809: write d9/da/f85 [6486909,30733] 0 2024-02-16T22:19:19.434 INFO:tasks.workunit.client.1.smithi173.stdout:4/603: mknod d7/d12/d7e/cd3 0 2024-02-16T22:19:19.435 INFO:tasks.workunit.client.1.smithi173.stdout:8/825: dread dd/d7c/d7d/d58/f91 [0,4194304] 0 2024-02-16T22:19:19.435 INFO:tasks.workunit.client.1.smithi173.stdout:3/810: write d9/d17/d25/f50 [4857201,126293] 0 2024-02-16T22:19:19.439 INFO:tasks.workunit.client.1.smithi173.stdout:3/811: link d9/d1a/d2b/d45/d60/cd6 d9/d18/d5f/d6e/df9/c117 0 2024-02-16T22:19:19.439 INFO:tasks.workunit.client.1.smithi173.stdout:3/812: chown d9/d1a/d2b/d4d/d5b/f7d 96707 1 2024-02-16T22:19:19.439 INFO:tasks.workunit.client.1.smithi173.stdout:3/813: fdatasync d9/d1a/d2b/d4d/f8c 0 2024-02-16T22:19:19.439 INFO:tasks.workunit.client.1.smithi173.stdout:1/743: getdents db/d1c/d7f/d98 0 2024-02-16T22:19:19.442 INFO:tasks.workunit.client.1.smithi173.stdout:7/653: dwrite d1/d1d/d4c/d63/d54/f70 [4194304,4194304] 0 2024-02-16T22:19:19.443 INFO:tasks.workunit.client.1.smithi173.stdout:8/826: dread dd/d7c/d7d/d22/d50/f5d [0,4194304] 0 2024-02-16T22:19:19.443 INFO:tasks.workunit.client.1.smithi173.stdout:8/827: readlink dd/d7c/d7d/d22/d28/d40/d69/da7/dae/ldc 0 2024-02-16T22:19:19.443 INFO:tasks.workunit.client.1.smithi173.stdout:8/828: readlink l8 0 2024-02-16T22:19:19.443 INFO:tasks.workunit.client.1.smithi173.stdout:8/829: rename dd/d7c/d7d/d22 to dd/d7c/d7d/d22/d50/d102 22 2024-02-16T22:19:19.443 INFO:tasks.workunit.client.1.smithi173.stdout:3/814: mkdir d9/d1a/d2b/d4d/d118 0 2024-02-16T22:19:19.443 INFO:tasks.workunit.client.1.smithi173.stdout:6/678: write d0/db/d2e/d2f/d31/f35 [1071242,93775] 0 2024-02-16T22:19:19.444 INFO:tasks.workunit.client.1.smithi173.stdout:6/679: creat d0/db/d2e/d2f/d31/d33/d97/ff3 x:0 0 0 2024-02-16T22:19:19.444 INFO:tasks.workunit.client.1.smithi173.stdout:6/680: chown d0/db/d2e/fbd 41092835 1 2024-02-16T22:19:19.444 INFO:tasks.workunit.client.1.smithi173.stdout:6/681: truncate d0/db/d2e/d2f/d31/fc7 4473122 0 2024-02-16T22:19:19.444 INFO:tasks.workunit.client.1.smithi173.stdout:6/682: fdatasync d0/f5b 0 2024-02-16T22:19:19.444 INFO:tasks.workunit.client.1.smithi173.stdout:8/830: mkdir dd/d7c/d7d/d93/daa/d103 0 2024-02-16T22:19:19.445 INFO:tasks.workunit.client.1.smithi173.stdout:8/831: chown dd/d7c/d7d/d58/dd5/ff2 2947630 1 2024-02-16T22:19:19.445 INFO:tasks.workunit.client.1.smithi173.stdout:8/832: chown dd/l1b 935571576 1 2024-02-16T22:19:19.447 INFO:tasks.workunit.client.1.smithi173.stdout:3/815: link d9/d18/f62 d9/d18/d5f/d6e/df9/f119 0 2024-02-16T22:19:19.447 INFO:tasks.workunit.client.1.smithi173.stdout:3/816: truncate d9/d1a/d2b/d4d/f4f 705056 0 2024-02-16T22:19:19.448 INFO:tasks.workunit.client.1.smithi173.stdout:1/744: symlink db/d29/d57/l104 0 2024-02-16T22:19:19.448 INFO:tasks.workunit.client.1.smithi173.stdout:1/745: dread - db/d29/d83/fe5 zero size 2024-02-16T22:19:19.448 INFO:tasks.workunit.client.1.smithi173.stdout:1/746: stat db/d1c/d5c/l76 0 2024-02-16T22:19:19.449 INFO:tasks.workunit.client.1.smithi173.stdout:1/747: stat db/d1c/d25/d28 0 2024-02-16T22:19:19.449 INFO:tasks.workunit.client.1.smithi173.stdout:1/748: write db/d29/d50/fc6 [999512,83745] 0 2024-02-16T22:19:19.449 INFO:tasks.workunit.client.1.smithi173.stdout:1/749: chown db/d30/fee 22 1 2024-02-16T22:19:19.449 INFO:tasks.workunit.client.1.smithi173.stdout:1/750: dread - db/fd2 zero size 2024-02-16T22:19:19.449 INFO:tasks.workunit.client.1.smithi173.stdout:6/683: getdents d0/db/d2e/d2f/d31/d33 0 2024-02-16T22:19:19.451 INFO:tasks.workunit.client.1.smithi173.stdout:8/833: creat dd/dd9/f104 x:0 0 0 2024-02-16T22:19:19.451 INFO:tasks.workunit.client.1.smithi173.stdout:4/604: dread d7/d28/d31/d33/d7d/d4e/f6a [0,4194304] 0 2024-02-16T22:19:19.451 INFO:tasks.workunit.client.1.smithi173.stdout:4/605: chown d7/fb5 44 1 2024-02-16T22:19:19.451 INFO:tasks.workunit.client.1.smithi173.stdout:4/606: creat d7/d28/d31/d33/d7d/d3d/fd4 x:0 0 0 2024-02-16T22:19:19.452 INFO:tasks.workunit.client.1.smithi173.stdout:3/817: mknod d9/d1a/d2b/d4d/d5b/da9/d105/c11a 0 2024-02-16T22:19:19.453 INFO:tasks.workunit.client.1.smithi173.stdout:1/751: mkdir db/d29/db5/d105 0 2024-02-16T22:19:19.453 INFO:tasks.workunit.client.1.smithi173.stdout:1/752: fsync db/d1c/d5c/dac/fcd 0 2024-02-16T22:19:19.453 INFO:tasks.workunit.client.1.smithi173.stdout:1/753: chown db/d1c/d5c/daf/cd7 27 1 2024-02-16T22:19:19.455 INFO:tasks.workunit.client.1.smithi173.stdout:8/834: rename dd/f16 to dd/d7c/d7d/d22/d28/f105 0 2024-02-16T22:19:19.457 INFO:tasks.workunit.client.1.smithi173.stdout:9/702: dwrite d1/d2/d1a/d3e/dc8/fda [0,4194304] 0 2024-02-16T22:19:19.457 INFO:tasks.workunit.client.1.smithi173.stdout:3/818: creat d9/d1a/d2b/de5/f11b x:0 0 0 2024-02-16T22:19:19.457 INFO:tasks.workunit.client.1.smithi173.stdout:3/819: write d9/d18/d5f/d6e/da7/fd9 [1414700,120055] 0 2024-02-16T22:19:19.458 INFO:tasks.workunit.client.1.smithi173.stdout:1/754: unlink db/d29/d57/d73/c96 0 2024-02-16T22:19:19.458 INFO:tasks.workunit.client.1.smithi173.stdout:1/755: truncate db/d30/f43 1341739 0 2024-02-16T22:19:19.458 INFO:tasks.workunit.client.1.smithi173.stdout:1/756: truncate db/d1c/d25/d28/d3f/d4a/ff5 165287 0 2024-02-16T22:19:19.460 INFO:tasks.workunit.client.1.smithi173.stdout:6/684: dread d0/db/d2e/d65/fbb [0,4194304] 0 2024-02-16T22:19:19.462 INFO:tasks.workunit.client.1.smithi173.stdout:8/835: rename dd/d7c/d7d/d22/d2e/f7b to dd/d7c/d7d/f106 0 2024-02-16T22:19:19.463 INFO:tasks.workunit.client.1.smithi173.stdout:8/836: readlink dd/d7c/d7d/l83 0 2024-02-16T22:19:19.466 INFO:tasks.workunit.client.1.smithi173.stdout:2/650: dwrite d2/dc/d19/f25 [0,4194304] 0 2024-02-16T22:19:19.467 INFO:tasks.workunit.client.1.smithi173.stdout:3/820: creat d9/d1a/d2b/d4d/d118/f11c x:0 0 0 2024-02-16T22:19:19.469 INFO:tasks.workunit.client.1.smithi173.stdout:1/757: symlink db/d1c/d25/d28/l106 0 2024-02-16T22:19:19.470 INFO:tasks.workunit.client.1.smithi173.stdout:6/685: creat d0/db/d2e/d65/d73/da9/ff4 x:0 0 0 2024-02-16T22:19:19.470 INFO:tasks.workunit.client.1.smithi173.stdout:6/686: write d0/db/d2e/d61/fd3 [919612,88754] 0 2024-02-16T22:19:19.470 INFO:tasks.workunit.client.1.smithi173.stdout:8/837: stat dd/d7c/cf8 0 2024-02-16T22:19:19.472 INFO:tasks.workunit.client.1.smithi173.stdout:3/821: link d9/d18/d73/db7/d81/ddf/f110 d9/d1a/d2b/d4d/d94/d98/f11d 0 2024-02-16T22:19:19.473 INFO:tasks.workunit.client.1.smithi173.stdout:1/758: symlink db/d5f/l107 0 2024-02-16T22:19:19.473 INFO:tasks.workunit.client.1.smithi173.stdout:1/759: write db/d1c/d25/d28/d3f/d4a/ff5 [766683,55114] 0 2024-02-16T22:19:19.474 INFO:tasks.workunit.client.1.smithi173.stdout:8/838: mknod dd/d7c/d7d/d22/d28/d40/d69/c107 0 2024-02-16T22:19:19.477 INFO:tasks.workunit.client.1.smithi173.stdout:8/839: dread dd/d7c/d7d/d22/d5a/f61 [0,4194304] 0 2024-02-16T22:19:19.480 INFO:tasks.workunit.client.1.smithi173.stdout:8/840: chown cb 190788 1 2024-02-16T22:19:19.480 INFO:tasks.workunit.client.1.smithi173.stdout:8/841: readlink dd/l6a 0 2024-02-16T22:19:19.480 INFO:tasks.workunit.client.1.smithi173.stdout:5/721: dwrite d8/d27/d35/f44 [0,4194304] 0 2024-02-16T22:19:19.480 INFO:tasks.workunit.client.1.smithi173.stdout:4/607: dwrite d7/d28/d52/d89/fb9 [0,4194304] 0 2024-02-16T22:19:19.480 INFO:tasks.workunit.client.1.smithi173.stdout:5/722: chown d8/d27/d35/f6c 836 1 2024-02-16T22:19:19.481 INFO:tasks.workunit.client.1.smithi173.stdout:0/649: dwrite d0/d12/d15/d3d/d98/d14/d38/f49 [0,4194304] 0 2024-02-16T22:19:19.481 INFO:tasks.workunit.client.1.smithi173.stdout:7/654: dwrite d1/d1d/f20 [4194304,4194304] 0 2024-02-16T22:19:19.481 INFO:tasks.workunit.client.1.smithi173.stdout:7/655: stat d1/d1d/d4c/d63/d13/d36/f38 0 2024-02-16T22:19:19.489 INFO:tasks.workunit.client.1.smithi173.stdout:0/650: symlink d0/d12/d15/d3d/d98/d14/d38/lda 0 2024-02-16T22:19:19.494 INFO:tasks.workunit.client.1.smithi173.stdout:7/656: truncate d1/d1d/d4c/d63/d13/d36/d49/f86 257434 0 2024-02-16T22:19:19.503 INFO:tasks.workunit.client.1.smithi173.stdout:4/608: rmdir d7/df/d8b 39 2024-02-16T22:19:19.503 INFO:tasks.workunit.client.1.smithi173.stdout:0/651: mkdir d0/d12/dce/ddb 0 2024-02-16T22:19:19.503 INFO:tasks.workunit.client.1.smithi173.stdout:0/652: fdatasync d0/f5 0 2024-02-16T22:19:19.504 INFO:tasks.workunit.client.1.smithi173.stdout:0/653: fdatasync d0/ff 0 2024-02-16T22:19:19.504 INFO:tasks.workunit.client.1.smithi173.stdout:0/654: fsync d0/f95 0 2024-02-16T22:19:19.504 INFO:tasks.workunit.client.1.smithi173.stdout:0/655: readlink d0/d12/d15/d3d/d98/l63 0 2024-02-16T22:19:19.506 INFO:tasks.workunit.client.1.smithi173.stdout:2/651: dwrite d2/d4/d8/d3a/f47 [0,4194304] 0 2024-02-16T22:19:19.506 INFO:tasks.workunit.client.1.smithi173.stdout:2/652: getdents d2/d4/d8/d30/d4d/da8 0 2024-02-16T22:19:19.509 INFO:tasks.workunit.client.1.smithi173.stdout:2/653: link d2/d4/d57/d82/lc7 d2/dc/d19/d1a/ld4 0 2024-02-16T22:19:19.509 INFO:tasks.workunit.client.1.smithi173.stdout:2/654: creat d2/d4/d57/d82/fd5 x:0 0 0 2024-02-16T22:19:19.509 INFO:tasks.workunit.client.1.smithi173.stdout:3/822: dwrite d9/d1a/d2b/d4d/d94/d98/f11d [0,4194304] 0 2024-02-16T22:19:19.511 INFO:tasks.workunit.client.1.smithi173.stdout:2/655: creat d2/dc/d19/d69/fd6 x:0 0 0 2024-02-16T22:19:19.512 INFO:tasks.workunit.client.1.smithi173.stdout:3/823: rmdir d9/d17 39 2024-02-16T22:19:19.513 INFO:tasks.workunit.client.1.smithi173.stdout:2/656: getdents d2/d4/d8/d80 0 2024-02-16T22:19:19.514 INFO:tasks.workunit.client.1.smithi173.stdout:2/657: mknod d2/dc/d19/d69/cd7 0 2024-02-16T22:19:19.515 INFO:tasks.workunit.client.1.smithi173.stdout:6/687: dwrite d0/db/d2e/d2f/d31/f62 [0,4194304] 0 2024-02-16T22:19:19.515 INFO:tasks.workunit.client.1.smithi173.stdout:6/688: creat d0/db/d2e/d2f/da6/ff5 x:0 0 0 2024-02-16T22:19:19.515 INFO:tasks.workunit.client.1.smithi173.stdout:5/723: dwrite d8/da/d1b/d57/dc9/f3e [0,4194304] 0 2024-02-16T22:19:19.515 INFO:tasks.workunit.client.1.smithi173.stdout:5/724: chown d8/da/d1f/d30/fbe 175708 1 2024-02-16T22:19:19.515 INFO:tasks.workunit.client.1.smithi173.stdout:2/658: rmdir d2/d4/d8/d30/d44 39 2024-02-16T22:19:19.521 INFO:tasks.workunit.client.1.smithi173.stdout:8/842: dwrite dd/fe8 [4194304,4194304] 0 2024-02-16T22:19:19.521 INFO:tasks.workunit.client.1.smithi173.stdout:8/843: fdatasync dd/f86 0 2024-02-16T22:19:19.521 INFO:tasks.workunit.client.1.smithi173.stdout:8/844: chown dd/dd9/ce0 1871 1 2024-02-16T22:19:19.521 INFO:tasks.workunit.client.1.smithi173.stdout:8/845: fdatasync dd/d7c/dcb/fa1 0 2024-02-16T22:19:19.521 INFO:tasks.workunit.client.1.smithi173.stdout:8/846: chown dd/d7c/d7d/d22/d5a/l8d 269925 1 2024-02-16T22:19:19.523 INFO:tasks.workunit.client.1.smithi173.stdout:3/824: dread d9/f4c [4194304,4194304] 0 2024-02-16T22:19:19.523 INFO:tasks.workunit.client.1.smithi173.stdout:3/825: write d9/d1a/d2b/d45/d51/d92/f116 [988156,66979] 0 2024-02-16T22:19:19.532 INFO:tasks.workunit.client.1.smithi173.stdout:6/689: creat d0/db/d2e/d65/d9f/de2/ff6 x:0 0 0 2024-02-16T22:19:19.533 INFO:tasks.workunit.client.1.smithi173.stdout:2/659: rmdir d2/dc/d5d/d7a 39 2024-02-16T22:19:19.537 INFO:tasks.workunit.client.1.smithi173.stdout:8/847: rename dd/d7c/d7d/d22/d5a/c99 to dd/d7c/d7d/d93/daa/d103/c108 0 2024-02-16T22:19:19.537 INFO:tasks.workunit.client.1.smithi173.stdout:8/848: write dd/d7c/d7d/f27 [5814785,125157] 0 2024-02-16T22:19:19.537 INFO:tasks.workunit.client.1.smithi173.stdout:8/849: stat dd/d7c/d7d/d22/d28/f33 0 2024-02-16T22:19:19.537 INFO:tasks.workunit.client.1.smithi173.stdout:8/850: truncate dd/d7c/d7d/d22/d2e/f71 759460 0 2024-02-16T22:19:19.537 INFO:tasks.workunit.client.1.smithi173.stdout:4/609: dwrite d7/d28/d31/d33/d7d/f5d [0,4194304] 0 2024-02-16T22:19:19.538 INFO:tasks.workunit.client.1.smithi173.stdout:0/656: dwrite d0/d84/d8c/f97 [0,4194304] 0 2024-02-16T22:19:19.538 INFO:tasks.workunit.client.1.smithi173.stdout:0/657: write d0/d12/d15/d4f/d92/fbe [525587,77027] 0 2024-02-16T22:19:19.538 INFO:tasks.workunit.client.1.smithi173.stdout:2/660: mkdir d2/dc/d5d/dd8 0 2024-02-16T22:19:19.543 INFO:tasks.workunit.client.1.smithi173.stdout:8/851: unlink dd/d7c/d7d/d22/d2e/d41/d6b/l88 0 2024-02-16T22:19:19.543 INFO:tasks.workunit.client.1.smithi173.stdout:8/852: fdatasync dd/d7c/d7d/f2c 0 2024-02-16T22:19:19.545 INFO:tasks.workunit.client.1.smithi173.stdout:5/725: dwrite d8/fb [0,4194304] 0 2024-02-16T22:19:19.545 INFO:tasks.workunit.client.1.smithi173.stdout:5/726: chown d8/da/d1b/f52 0 1 2024-02-16T22:19:19.547 INFO:tasks.workunit.client.1.smithi173.stdout:0/658: symlink d0/d12/d15/d4f/d92/ldc 0 2024-02-16T22:19:19.547 INFO:tasks.workunit.client.1.smithi173.stdout:0/659: chown d0/la4 5585541 1 2024-02-16T22:19:19.548 INFO:tasks.workunit.client.1.smithi173.stdout:0/660: readlink d0/l20 0 2024-02-16T22:19:19.548 INFO:tasks.workunit.client.1.smithi173.stdout:0/661: write d0/d84/d8c/fc4 [397354,73994] 0 2024-02-16T22:19:19.548 INFO:tasks.workunit.client.1.smithi173.stdout:8/853: rmdir dd/d7c/d7d/d89 39 2024-02-16T22:19:19.549 INFO:tasks.workunit.client.1.smithi173.stdout:8/854: dread dd/d7c/d7d/f60 [0,4194304] 0 2024-02-16T22:19:19.549 INFO:tasks.workunit.client.1.smithi173.stdout:3/826: dwrite d9/d1a/d2b/d45/d51/d92/fba [0,4194304] 0 2024-02-16T22:19:19.554 INFO:tasks.workunit.client.1.smithi173.stdout:8/855: write dd/d7c/d7d/d22/f32 [1107092,55558] 0 2024-02-16T22:19:19.557 INFO:tasks.workunit.client.1.smithi173.stdout:0/662: mkdir d0/d12/d15/d3d/d98/d14/d24/ddd 0 2024-02-16T22:19:19.558 INFO:tasks.workunit.client.1.smithi173.stdout:0/663: stat d0/d6d 0 2024-02-16T22:19:19.559 INFO:tasks.workunit.client.1.smithi173.stdout:6/690: dwrite d0/db/f2a [0,4194304] 0 2024-02-16T22:19:19.560 INFO:tasks.workunit.client.1.smithi173.stdout:3/827: mknod d9/d18/daa/df0/c11e 0 2024-02-16T22:19:19.561 INFO:tasks.workunit.client.1.smithi173.stdout:8/856: mkdir dd/d7c/d7d/d22/d28/d40/d69/df4/dff/d109 0 2024-02-16T22:19:19.564 INFO:tasks.workunit.client.1.smithi173.stdout:4/610: rename d7/d12/d2d to d7/dd5 0 2024-02-16T22:19:19.564 INFO:tasks.workunit.client.1.smithi173.stdout:4/611: fsync d7/f5f 0 2024-02-16T22:19:19.564 INFO:tasks.workunit.client.1.smithi173.stdout:0/664: symlink d0/d12/d15/d3d/d98/d14/d24/d2e/d6b/d8e/lde 0 2024-02-16T22:19:19.567 INFO:tasks.workunit.client.1.smithi173.stdout:8/857: mkdir dd/d7c/d10a 0 2024-02-16T22:19:19.569 INFO:tasks.workunit.client.1.smithi173.stdout:2/661: rename d2/d4/d57/d82/lc7 to d2/dc/d19/da3/ld9 0 2024-02-16T22:19:19.571 INFO:tasks.workunit.client.1.smithi173.stdout:4/612: creat d7/d28/d31/d33/dbf/fd6 x:0 0 0 2024-02-16T22:19:19.571 INFO:tasks.workunit.client.1.smithi173.stdout:4/613: write d7/d28/d31/f37 [9076383,25666] 0 2024-02-16T22:19:19.573 INFO:tasks.workunit.client.1.smithi173.stdout:6/691: rmdir d0/db/d2e/d65/d73/d7d 39 2024-02-16T22:19:19.573 INFO:tasks.workunit.client.1.smithi173.stdout:6/692: write d0/db/d2e/d2f/d31/f5e [651112,55004] 0 2024-02-16T22:19:19.573 INFO:tasks.workunit.client.1.smithi173.stdout:6/693: readlink d0/db/d2e/d2f/d31/d33/l95 0 2024-02-16T22:19:19.573 INFO:tasks.workunit.client.1.smithi173.stdout:6/694: write d0/db/d2e/d65/d9f/de2/ff6 [320269,106232] 0 2024-02-16T22:19:19.574 INFO:tasks.workunit.client.1.smithi173.stdout:5/727: dwrite d8/d27/d35/f44 [0,4194304] 0 2024-02-16T22:19:19.574 INFO:tasks.workunit.client.1.smithi173.stdout:8/858: unlink dd/d7c/d7d/d22/d28/d40/d69/da7/cce 0 2024-02-16T22:19:19.577 INFO:tasks.workunit.client.1.smithi173.stdout:4/614: mkdir d7/d28/d31/d33/d7d/d4e/dd7 0 2024-02-16T22:19:19.577 INFO:tasks.workunit.client.1.smithi173.stdout:4/615: readlink d7/dd5/l99 0 2024-02-16T22:19:19.577 INFO:tasks.workunit.client.1.smithi173.stdout:4/616: write d7/df/f1b [2213816,49701] 0 2024-02-16T22:19:19.578 INFO:tasks.workunit.client.1.smithi173.stdout:5/728: mknod d8/ce4 0 2024-02-16T22:19:19.579 INFO:tasks.workunit.client.1.smithi173.stdout:8/859: symlink dd/d7c/d7d/d22/d28/d40/l10b 0 2024-02-16T22:19:19.581 INFO:tasks.workunit.client.1.smithi173.stdout:2/662: rename d2/d4/d8/d80/da1 to d2/d4/d8/d30/d44/d81/d99/dda 0 2024-02-16T22:19:19.583 INFO:tasks.workunit.client.1.smithi173.stdout:5/729: rename d8/da/d2d/d3a/f74 to d8/da/d1f/d30/d9b/fe5 0 2024-02-16T22:19:19.584 INFO:tasks.workunit.client.1.smithi173.stdout:5/730: truncate d8/da/d1f/fb8 427228 0 2024-02-16T22:19:19.584 INFO:tasks.workunit.client.1.smithi173.stdout:5/731: fsync d8/da/d1b/d57/d97/fd0 0 2024-02-16T22:19:19.584 INFO:tasks.workunit.client.1.smithi173.stdout:6/695: read d0/db/d2e/d65/db8/fca [3584490,75974] 0 2024-02-16T22:19:19.584 INFO:tasks.workunit.client.1.smithi173.stdout:3/828: dwrite d9/d1a/d2b/f10a [0,4194304] 0 2024-02-16T22:19:19.584 INFO:tasks.workunit.client.1.smithi173.stdout:2/663: creat d2/dc/d19/d1a/d74/fdb x:0 0 0 2024-02-16T22:19:19.585 INFO:tasks.workunit.client.1.smithi173.stdout:5/732: mkdir d8/d27/d63/de6 0 2024-02-16T22:19:19.585 INFO:tasks.workunit.client.1.smithi173.stdout:5/733: write d8/da/d1b/d57/dc9/f3e [5253818,11066] 0 2024-02-16T22:19:19.587 INFO:tasks.workunit.client.1.smithi173.stdout:3/829: stat d9/d1a/d2b/d4d/d5b/da9/l10f 0 2024-02-16T22:19:19.587 INFO:tasks.workunit.client.1.smithi173.stdout:3/830: dread - d9/d1a/d2b/d4d/d5b/fc3 zero size 2024-02-16T22:19:19.589 INFO:tasks.workunit.client.1.smithi173.stdout:2/664: mkdir d2/dc/d19/d1a/d74/db2/ddc 0 2024-02-16T22:19:19.590 INFO:tasks.workunit.client.1.smithi173.stdout:2/665: rename d2/dc/d19/f16 to d2/dc/d19/dc4/fdd 0 2024-02-16T22:19:19.593 INFO:tasks.workunit.client.1.smithi173.stdout:2/666: creat d2/d4/d8/d30/d44/d81/fde x:0 0 0 2024-02-16T22:19:19.596 INFO:tasks.workunit.client.1.smithi173.stdout:2/667: dread d2/dc/d19/f29 [0,4194304] 0 2024-02-16T22:19:19.596 INFO:tasks.workunit.client.1.smithi173.stdout:2/668: write d2/dc/d19/d1a/fb3 [6681466,25540] 0 2024-02-16T22:19:19.596 INFO:tasks.workunit.client.1.smithi173.stdout:2/669: mknod d2/d4/d8/d30/d4d/da8/cdf 0 2024-02-16T22:19:19.598 INFO:tasks.workunit.client.1.smithi173.stdout:8/860: dread dd/d7c/d7d/f27 [0,4194304] 0 2024-02-16T22:19:19.598 INFO:tasks.workunit.client.1.smithi173.stdout:8/861: write dd/d7c/d7d/d22/d28/f3c [942704,1369] 0 2024-02-16T22:19:19.598 INFO:tasks.workunit.client.1.smithi173.stdout:2/670: link d2/d4/d8/ca6 d2/d4/d8/d3a/ce0 0 2024-02-16T22:19:19.598 INFO:tasks.workunit.client.1.smithi173.stdout:8/862: mknod dd/d7c/d7d/d22/d28/dec/c10c 0 2024-02-16T22:19:19.599 INFO:tasks.workunit.client.1.smithi173.stdout:2/671: rmdir d2/dc/d19/d1c/d53/d6e 39 2024-02-16T22:19:19.599 INFO:tasks.workunit.client.1.smithi173.stdout:3/831: dread d9/d18/d5f/d6e/df9/f119 [0,4194304] 0 2024-02-16T22:19:19.605 INFO:tasks.workunit.client.1.smithi173.stdout:8/863: dread dd/d7c/d7d/f14 [0,4194304] 0 2024-02-16T22:19:19.605 INFO:tasks.workunit.client.1.smithi173.stdout:8/864: write dd/d7c/d7d/d93/daa/faf [555133,98240] 0 2024-02-16T22:19:19.606 INFO:tasks.workunit.client.1.smithi173.stdout:4/617: dwrite d7/d12/f96 [0,4194304] 0 2024-02-16T22:19:19.607 INFO:tasks.workunit.client.1.smithi173.stdout:4/618: write d7/d28/d31/d33/d7d/d45/fa2 [936164,25324] 0 2024-02-16T22:19:19.609 INFO:tasks.workunit.client.1.smithi173.stdout:4/619: dread d7/df/d62/f6f [0,4194304] 0 2024-02-16T22:19:19.609 INFO:tasks.workunit.client.1.smithi173.stdout:4/620: dread - d7/d28/d52/f90 zero size 2024-02-16T22:19:19.610 INFO:tasks.workunit.client.1.smithi173.stdout:6/696: dwrite d0/db/f2a [4194304,4194304] 0 2024-02-16T22:19:19.611 INFO:tasks.workunit.client.1.smithi173.stdout:6/697: chown d0/db/d2e/d65/ce7 1364160 1 2024-02-16T22:19:19.611 INFO:tasks.workunit.client.1.smithi173.stdout:6/698: fsync d0/db/f57 0 2024-02-16T22:19:19.611 INFO:tasks.workunit.client.1.smithi173.stdout:6/699: creat d0/db/d2e/d65/d67/d78/ff7 x:0 0 0 2024-02-16T22:19:19.611 INFO:tasks.workunit.client.1.smithi173.stdout:6/700: write d0/db/d2e/d2f/f3b [1034293,94407] 0 2024-02-16T22:19:19.611 INFO:tasks.workunit.client.1.smithi173.stdout:5/734: dwrite d8/da/d1f/d30/f59 [0,4194304] 0 2024-02-16T22:19:19.619 INFO:tasks.workunit.client.1.smithi173.stdout:8/865: write dd/d7c/d7d/f2c [381663,40862] 0 2024-02-16T22:19:19.622 INFO:tasks.workunit.client.1.smithi173.stdout:6/701: write d0/db/fbf [348359,103797] 0 2024-02-16T22:19:19.623 INFO:tasks.workunit.client.1.smithi173.stdout:6/702: fsync d0/db/f57 0 2024-02-16T22:19:19.623 INFO:tasks.workunit.client.1.smithi173.stdout:6/703: dread - d0/d7c/dc5/d92/fc8 zero size 2024-02-16T22:19:19.625 INFO:tasks.workunit.client.1.smithi173.stdout:8/866: truncate dd/d7c/d7d/d22/f37 3000278 0 2024-02-16T22:19:19.626 INFO:tasks.workunit.client.1.smithi173.stdout:2/672: dwrite d2/d4/d8/d80/f9a [0,4194304] 0 2024-02-16T22:19:19.626 INFO:tasks.workunit.client.1.smithi173.stdout:5/735: write d8/da/d1b/d57/dc9/f83 [5403635,106768] 0 2024-02-16T22:19:19.626 INFO:tasks.workunit.client.1.smithi173.stdout:2/673: fdatasync d2/dc/d19/d1a/f34 0 2024-02-16T22:19:19.626 INFO:tasks.workunit.client.1.smithi173.stdout:6/704: mknod d0/db/d2e/d2f/d31/d33/d97/cf8 0 2024-02-16T22:19:19.627 INFO:tasks.workunit.client.1.smithi173.stdout:4/621: dwrite d7/df/d8b/fa0 [0,4194304] 0 2024-02-16T22:19:19.628 INFO:tasks.workunit.client.1.smithi173.stdout:8/867: creat dd/d7c/d7d/d22/d28/d40/d69/df4/dff/d109/f10d x:0 0 0 2024-02-16T22:19:19.628 INFO:tasks.workunit.client.1.smithi173.stdout:2/674: dread d2/dc/d19/d1a/f46 [0,4194304] 0 2024-02-16T22:19:19.628 INFO:tasks.workunit.client.1.smithi173.stdout:5/736: write d8/da/f45 [883612,103671] 0 2024-02-16T22:19:19.630 INFO:tasks.workunit.client.1.smithi173.stdout:5/737: write d8/da/d1b/f52 [504479,102423] 0 2024-02-16T22:19:19.631 INFO:tasks.workunit.client.1.smithi173.stdout:6/705: rename d0/db/d2e/d2f/d31/f35 to d0/db/d2e/d65/d73/ff9 0 2024-02-16T22:19:19.641 INFO:tasks.workunit.client.1.smithi173.stdout:2/675: mkdir d2/d4/d8/d3a/de1 0 2024-02-16T22:19:19.642 INFO:tasks.workunit.client.1.smithi173.stdout:5/738: mkdir d8/da/d2d/d3a/da7/de7 0 2024-02-16T22:19:19.643 INFO:tasks.workunit.client.1.smithi173.stdout:6/706: dread d0/db/f12 [4194304,4194304] 0 2024-02-16T22:19:19.644 INFO:tasks.workunit.client.1.smithi173.stdout:8/868: rename dd/d7c/d7d/d22/ffe to dd/dd9/f10e 0 2024-02-16T22:19:19.644 INFO:tasks.workunit.client.1.smithi173.stdout:5/739: mkdir d8/da/d1b/d57/dcb/de8 0 2024-02-16T22:19:19.647 INFO:tasks.workunit.client.1.smithi173.stdout:5/740: unlink d8/da/d2d/fce 0 2024-02-16T22:19:19.649 INFO:tasks.workunit.client.1.smithi173.stdout:5/741: getdents d8/da/d1f/d8c 0 2024-02-16T22:19:19.650 INFO:tasks.workunit.client.1.smithi173.stdout:5/742: readlink d8/d27/d62/la8 0 2024-02-16T22:19:19.656 INFO:tasks.workunit.client.1.smithi173.stdout:2/676: write d2/f3c [3796561,94674] 0 2024-02-16T22:19:19.657 INFO:tasks.workunit.client.1.smithi173.stdout:4/622: dwrite d7/d28/d31/d33/d7d/f5d [0,4194304] 0 2024-02-16T22:19:19.660 INFO:tasks.workunit.client.1.smithi173.stdout:4/623: mkdir d7/df/d62/dd8 0 2024-02-16T22:19:19.660 INFO:tasks.workunit.client.1.smithi173.stdout:4/624: chown d7/d28/d31/d33/dbf/fd6 1021635 1 2024-02-16T22:19:19.661 INFO:tasks.workunit.client.1.smithi173.stdout:2/677: dread d2/dc/d19/d1a/f34 [0,4194304] 0 2024-02-16T22:19:19.661 INFO:tasks.workunit.client.1.smithi173.stdout:2/678: fdatasync d2/d4/d8/f95 0 2024-02-16T22:19:19.683 INFO:tasks.workunit.client.1.smithi173.stdout:4/625: dread d7/d28/d31/d33/f85 [0,4194304] 0 2024-02-16T22:19:19.683 INFO:tasks.workunit.client.1.smithi173.stdout:4/626: chown d7/l92 6416 1 2024-02-16T22:19:19.683 INFO:tasks.workunit.client.1.smithi173.stdout:4/627: dread - d7/d28/d52/d89/fc0 zero size 2024-02-16T22:19:19.684 INFO:tasks.workunit.client.1.smithi173.stdout:4/628: dread d7/d28/d52/fb7 [0,4194304] 0 2024-02-16T22:19:19.684 INFO:tasks.workunit.client.1.smithi173.stdout:4/629: dread - d7/d28/d31/f77 zero size 2024-02-16T22:19:19.685 INFO:tasks.workunit.client.1.smithi173.stdout:4/630: dread d7/df/d62/f6f [0,4194304] 0 2024-02-16T22:19:19.687 INFO:tasks.workunit.client.1.smithi173.stdout:6/707: dwrite d0/db/d2e/d2f/d31/fc7 [4194304,4194304] 0 2024-02-16T22:19:19.687 INFO:tasks.workunit.client.1.smithi173.stdout:6/708: creat d0/db/d2e/d2f/d31/d7a/ffa x:0 0 0 2024-02-16T22:19:19.687 INFO:tasks.workunit.client.1.smithi173.stdout:6/709: dread - d0/db/d2e/d2f/fc1 zero size 2024-02-16T22:19:19.687 INFO:tasks.workunit.client.1.smithi173.stdout:4/631: link d7/d28/fb2 d7/fd9 0 2024-02-16T22:19:19.691 INFO:tasks.workunit.client.1.smithi173.stdout:4/632: dread d7/d28/d31/d33/f85 [0,4194304] 0 2024-02-16T22:19:19.692 INFO:tasks.workunit.client.1.smithi173.stdout:8/869: dwrite dd/f31 [0,4194304] 0 2024-02-16T22:19:19.692 INFO:tasks.workunit.client.1.smithi173.stdout:5/743: dwrite d8/d27/d35/fbb [0,4194304] 0 2024-02-16T22:19:19.693 INFO:tasks.workunit.client.1.smithi173.stdout:5/744: chown d8/da/d1f/d6f 423671934 1 2024-02-16T22:19:19.693 INFO:tasks.workunit.client.1.smithi173.stdout:2/679: dwrite d2/dc/d5d/d7a/f8f [0,4194304] 0 2024-02-16T22:19:19.695 INFO:tasks.workunit.client.1.smithi173.stdout:8/870: creat dd/d7c/d7d/d22/d28/d40/d69/df4/f10f x:0 0 0 2024-02-16T22:19:19.695 INFO:tasks.workunit.client.1.smithi173.stdout:8/871: dread - dd/d7c/d7d/d22/d28/d40/d69/da7/dae/fed zero size 2024-02-16T22:19:19.699 INFO:tasks.workunit.client.1.smithi173.stdout:5/745: rename d8/da/f23 to d8/d27/d62/fe9 0 2024-02-16T22:19:19.699 INFO:tasks.workunit.client.1.smithi173.stdout:5/746: chown d8/d27/d28/fa0 495131 1 2024-02-16T22:19:19.699 INFO:tasks.workunit.client.1.smithi173.stdout:5/747: fsync d8/da/d1b/faa 0 2024-02-16T22:19:19.699 INFO:tasks.workunit.client.1.smithi173.stdout:5/748: fsync d8/f93 0 2024-02-16T22:19:19.702 INFO:tasks.workunit.client.1.smithi173.stdout:2/680: link d2/dc/d19/da3/lc9 d2/d4/d8/d30/daf/le2 0 2024-02-16T22:19:19.705 INFO:tasks.workunit.client.1.smithi173.stdout:8/872: unlink dd/d7c/d7d/d22/f37 0 2024-02-16T22:19:19.705 INFO:tasks.workunit.client.1.smithi173.stdout:8/873: write dd/d7c/d7d/d22/d28/d40/d69/da7/dae/fed [324603,99115] 0 2024-02-16T22:19:19.706 INFO:tasks.workunit.client.1.smithi173.stdout:2/681: creat d2/d10/d62/d6c/dcd/fe3 x:0 0 0 2024-02-16T22:19:19.706 INFO:tasks.workunit.client.1.smithi173.stdout:2/682: getdents d2/d4/d57/dc8 0 2024-02-16T22:19:19.706 INFO:tasks.workunit.client.1.smithi173.stdout:2/683: chown d2/dc/d5d/f18 154184832 1 2024-02-16T22:19:19.707 INFO:tasks.workunit.client.1.smithi173.stdout:8/874: truncate dd/d7c/d7d/d22/d5a/dc7/ff7 4193379 0 2024-02-16T22:19:19.707 INFO:tasks.workunit.client.1.smithi173.stdout:5/749: rmdir d8/d27/d2f 39 2024-02-16T22:19:19.709 INFO:tasks.workunit.client.1.smithi173.stdout:8/875: creat dd/d9d/db2/f110 x:0 0 0 2024-02-16T22:19:19.711 INFO:tasks.workunit.client.1.smithi173.stdout:8/876: rename dd/d7c/d7d/d22/d50/fb3 to dd/d9d/db2/f111 0 2024-02-16T22:19:19.712 INFO:tasks.workunit.client.1.smithi173.stdout:8/877: chown dd/d7c/d7d/d22/d28/d40/d69/da7 2583 1 2024-02-16T22:19:19.712 INFO:tasks.workunit.client.1.smithi173.stdout:8/878: stat dd/d7c/d7d/d22/d28/d40/d69/df4/dff/d109 0 2024-02-16T22:19:19.715 INFO:tasks.workunit.client.1.smithi173.stdout:6/710: dwrite d0/db/d2e/d2f/d31/d33/fab [0,4194304] 0 2024-02-16T22:19:19.715 INFO:tasks.workunit.client.1.smithi173.stdout:6/711: chown d0/db/d2e/d2f/c3f 10561407 1 2024-02-16T22:19:19.715 INFO:tasks.workunit.client.1.smithi173.stdout:6/712: stat d0/d7c/dc5/d92 0 2024-02-16T22:19:19.720 INFO:tasks.workunit.client.1.smithi173.stdout:5/750: dread d8/da/d2d/d36/d50/f9a [0,4194304] 0 2024-02-16T22:19:19.720 INFO:tasks.workunit.client.1.smithi173.stdout:4/633: dwrite d7/df/d62/f71 [0,4194304] 0 2024-02-16T22:19:19.723 INFO:tasks.workunit.client.1.smithi173.stdout:4/634: write d7/df/f80 [468295,57365] 0 2024-02-16T22:19:19.723 INFO:tasks.workunit.client.1.smithi173.stdout:4/635: truncate d7/d28/d31/d33/d7d/d45/f70 694318 0 2024-02-16T22:19:19.730 INFO:tasks.workunit.client.1.smithi173.stdout:6/713: dread d0/db/d2e/d65/f6b [0,4194304] 0 2024-02-16T22:19:19.731 INFO:tasks.workunit.client.1.smithi173.stdout:4/636: mkdir d7/d12/dda 0 2024-02-16T22:19:19.732 INFO:tasks.workunit.client.1.smithi173.stdout:8/879: rmdir dd 39 2024-02-16T22:19:19.733 INFO:tasks.workunit.client.1.smithi173.stdout:6/714: symlink d0/db/d2e/d65/d9f/de2/lfb 0 2024-02-16T22:19:19.735 INFO:tasks.workunit.client.1.smithi173.stdout:8/880: rename dd/d7c/d7d/d93/daa/le7 to dd/d7c/d7d/d22/d28/d40/d69/l112 0 2024-02-16T22:19:19.736 INFO:tasks.workunit.client.1.smithi173.stdout:6/715: symlink d0/db/d2e/d2f/lfc 0 2024-02-16T22:19:19.736 INFO:tasks.workunit.client.1.smithi173.stdout:4/637: getdents d7/d12/d7e 0 2024-02-16T22:19:19.737 INFO:tasks.workunit.client.1.smithi173.stdout:8/881: mkdir dd/d7c/d7d/d89/db0/d113 0 2024-02-16T22:19:19.737 INFO:tasks.workunit.client.1.smithi173.stdout:8/882: read dd/d7c/d7d/f3d [28227,65503] 0 2024-02-16T22:19:19.737 INFO:tasks.workunit.client.1.smithi173.stdout:8/883: fsync dd/dd9/fee 0 2024-02-16T22:19:19.738 INFO:tasks.workunit.client.1.smithi173.stdout:2/684: dwrite d2/dc/d5d/f6a [4194304,4194304] 0 2024-02-16T22:19:19.738 INFO:tasks.workunit.client.1.smithi173.stdout:2/685: chown d2/d4/f39 42027 1 2024-02-16T22:19:19.738 INFO:tasks.workunit.client.1.smithi173.stdout:2/686: chown d2/dc/d5d/l23 15 1 2024-02-16T22:19:19.738 INFO:tasks.workunit.client.1.smithi173.stdout:6/716: creat d0/db/d2e/d2f/d31/d5d/ffd x:0 0 0 2024-02-16T22:19:19.739 INFO:tasks.workunit.client.1.smithi173.stdout:2/687: write d2/dc/d19/d1c/f68 [777537,46937] 0 2024-02-16T22:19:19.739 INFO:tasks.workunit.client.1.smithi173.stdout:8/884: creat dd/d7c/d7d/d58/f114 x:0 0 0 2024-02-16T22:19:19.739 INFO:tasks.workunit.client.1.smithi173.stdout:8/885: creat dd/d7c/d7d/d58/f115 x:0 0 0 2024-02-16T22:19:19.739 INFO:tasks.workunit.client.1.smithi173.stdout:8/886: fdatasync fc 0 2024-02-16T22:19:19.739 INFO:tasks.workunit.client.1.smithi173.stdout:8/887: write dd/d9d/db2/f110 [415120,123472] 0 2024-02-16T22:19:19.740 INFO:tasks.workunit.client.1.smithi173.stdout:6/717: rename d0/d7c/cc0 to d0/db/d2e/d65/d67/d78/df1/cfe 0 2024-02-16T22:19:19.741 INFO:tasks.workunit.client.1.smithi173.stdout:2/688: creat d2/dc/d19/fe4 x:0 0 0 2024-02-16T22:19:19.742 INFO:tasks.workunit.client.1.smithi173.stdout:8/888: mknod dd/d7c/d7d/d89/db0/d113/c116 0 2024-02-16T22:19:19.742 INFO:tasks.workunit.client.1.smithi173.stdout:6/718: mkdir d0/db/d2e/d2f/da6/daa/dff 0 2024-02-16T22:19:19.743 INFO:tasks.workunit.client.1.smithi173.stdout:2/689: mknod d2/d4/d57/ce5 0 2024-02-16T22:19:19.744 INFO:tasks.workunit.client.1.smithi173.stdout:6/719: mkdir d0/db/d2e/d65/d73/d100 0 2024-02-16T22:19:19.752 INFO:tasks.workunit.client.1.smithi173.stdout:4/638: write d7/df/f58 [581025,42091] 0 2024-02-16T22:19:19.752 INFO:tasks.workunit.client.1.smithi173.stdout:5/751: dwrite d8/f26 [0,4194304] 0 2024-02-16T22:19:19.752 INFO:tasks.workunit.client.1.smithi173.stdout:4/639: readlink d7/d28/d31/d72/d93/l97 0 2024-02-16T22:19:19.752 INFO:tasks.workunit.client.1.smithi173.stdout:5/752: write d8/da/d1b/d57/f79 [4811758,1288] 0 2024-02-16T22:19:19.754 INFO:tasks.workunit.client.1.smithi173.stdout:4/640: mknod d7/d28/d14/cdb 0 2024-02-16T22:19:19.757 INFO:tasks.workunit.client.1.smithi173.stdout:9/703: sync 2024-02-16T22:19:19.757 INFO:tasks.workunit.client.1.smithi173.stdout:7/657: sync 2024-02-16T22:19:19.757 INFO:tasks.workunit.client.1.smithi173.stdout:1/760: sync 2024-02-16T22:19:19.757 INFO:tasks.workunit.client.1.smithi173.stdout:0/665: sync 2024-02-16T22:19:19.757 INFO:tasks.workunit.client.1.smithi173.stdout:3/832: sync 2024-02-16T22:19:19.757 INFO:tasks.workunit.client.1.smithi173.stdout:7/658: write d1/d1d/fa1 [875233,66011] 0 2024-02-16T22:19:19.757 INFO:tasks.workunit.client.1.smithi173.stdout:7/659: write d1/d1d/d4c/d63/d48/f79 [764080,93912] 0 2024-02-16T22:19:19.759 INFO:tasks.workunit.client.1.smithi173.stdout:9/704: mkdir d1/d2/d1a/d2f/d3b/da6/de3 0 2024-02-16T22:19:19.761 INFO:tasks.workunit.client.1.smithi173.stdout:4/641: dread d7/d28/fb2 [0,4194304] 0 2024-02-16T22:19:19.761 INFO:tasks.workunit.client.1.smithi173.stdout:4/642: truncate d7/d28/d31/fc4 475207 0 2024-02-16T22:19:19.761 INFO:tasks.workunit.client.1.smithi173.stdout:3/833: symlink d9/d1a/d2b/d4d/d94/d98/l11f 0 2024-02-16T22:19:19.761 INFO:tasks.workunit.client.1.smithi173.stdout:3/834: stat d9/f7c 0 2024-02-16T22:19:19.762 INFO:tasks.workunit.client.1.smithi173.stdout:5/753: write d8/da/d1f/f51 [795127,32250] 0 2024-02-16T22:19:19.762 INFO:tasks.workunit.client.1.smithi173.stdout:5/754: write d8/f93 [269928,111074] 0 2024-02-16T22:19:19.763 INFO:tasks.workunit.client.1.smithi173.stdout:3/835: getdents d9/d1a 0 2024-02-16T22:19:19.767 INFO:tasks.workunit.client.1.smithi173.stdout:0/666: dread d0/d12/d15/d3d/d98/f2a [0,4194304] 0 2024-02-16T22:19:19.767 INFO:tasks.workunit.client.1.smithi173.stdout:0/667: dread - d0/d12/d15/d3d/d98/d14/d24/d2e/f83 zero size 2024-02-16T22:19:19.767 INFO:tasks.workunit.client.1.smithi173.stdout:0/668: chown d0/d12/d15/d99 535369615 1 2024-02-16T22:19:19.770 INFO:tasks.workunit.client.1.smithi173.stdout:5/755: rmdir d8/d27/d28 39 2024-02-16T22:19:19.771 INFO:tasks.workunit.client.1.smithi173.stdout:0/669: symlink d0/d12/d15/d3d/d98/d14/d50/dd0/ldf 0 2024-02-16T22:19:19.772 INFO:tasks.workunit.client.1.smithi173.stdout:3/836: rmdir d9/d1a/d2b/d4d/d118 39 2024-02-16T22:19:19.773 INFO:tasks.workunit.client.1.smithi173.stdout:5/756: unlink d8/da/d2d/d3a/fdf 0 2024-02-16T22:19:19.774 INFO:tasks.workunit.client.1.smithi173.stdout:3/837: link d9/d1a/d2b/f2d d9/d1a/d2b/d4d/d5b/f120 0 2024-02-16T22:19:19.775 INFO:tasks.workunit.client.1.smithi173.stdout:5/757: symlink d8/d27/d28/lea 0 2024-02-16T22:19:19.776 INFO:tasks.workunit.client.1.smithi173.stdout:3/838: mkdir d9/d18/d5f/d6e/df9/d121 0 2024-02-16T22:19:19.777 INFO:tasks.workunit.client.1.smithi173.stdout:5/758: rename d8/da/d1b/c22 to d8/da/d2d/d3a/ceb 0 2024-02-16T22:19:19.777 INFO:tasks.workunit.client.1.smithi173.stdout:5/759: creat d8/da/d2d/fec x:0 0 0 2024-02-16T22:19:19.779 INFO:tasks.workunit.client.1.smithi173.stdout:3/839: rename d9/d18/d5f/fc2 to d9/d1a/f122 0 2024-02-16T22:19:19.780 INFO:tasks.workunit.client.1.smithi173.stdout:5/760: mknod d8/da/d1f/d6f/d91/ced 0 2024-02-16T22:19:19.780 INFO:tasks.workunit.client.1.smithi173.stdout:5/761: chown d8/da/d1f/d8c/lb9 54 1 2024-02-16T22:19:19.781 INFO:tasks.workunit.client.1.smithi173.stdout:5/762: creat d8/da/d1f/d8c/dcc/fee x:0 0 0 2024-02-16T22:19:19.781 INFO:tasks.workunit.client.1.smithi173.stdout:5/763: chown d8/da/d1f/d8c/fb1 369296 1 2024-02-16T22:19:19.782 INFO:tasks.workunit.client.1.smithi173.stdout:5/764: creat d8/d27/d35/d8b/fef x:0 0 0 2024-02-16T22:19:19.782 INFO:tasks.workunit.client.1.smithi173.stdout:5/765: fdatasync d8/da/d2d/d36/f3d 0 2024-02-16T22:19:19.789 INFO:tasks.workunit.client.1.smithi173.stdout:8/889: dwrite dd/d7c/d7d/f2c [0,4194304] 0 2024-02-16T22:19:19.792 INFO:tasks.workunit.client.1.smithi173.stdout:8/890: link dd/d7c/d7d/d22/d5a/dc7/ff7 dd/d7c/d7d/d93/f117 0 2024-02-16T22:19:19.794 INFO:tasks.workunit.client.1.smithi173.stdout:8/891: mkdir dd/d7c/d7d/d22/d28/d40/d69/df4/d118 0 2024-02-16T22:19:19.794 INFO:tasks.workunit.client.1.smithi173.stdout:5/766: dread d8/da/d1b/d57/dc9/f3e [0,4194304] 0 2024-02-16T22:19:19.795 INFO:tasks.workunit.client.1.smithi173.stdout:8/892: creat dd/d7c/d7d/d22/d28/d40/d69/df4/d118/f119 x:0 0 0 2024-02-16T22:19:19.795 INFO:tasks.workunit.client.1.smithi173.stdout:5/767: truncate d8/da/d1b/faa 194026 0 2024-02-16T22:19:19.812 INFO:tasks.workunit.client.1.smithi173.stdout:6/720: dwrite d0/db/d2e/d65/d67/d78/ff7 [0,4194304] 0 2024-02-16T22:19:19.814 INFO:tasks.workunit.client.1.smithi173.stdout:6/721: rename d0/db/d2e/d61/fd3 to d0/db/d2e/d65/d73/d7d/f101 0 2024-02-16T22:19:19.815 INFO:tasks.workunit.client.1.smithi173.stdout:6/722: creat d0/d7c/f102 x:0 0 0 2024-02-16T22:19:19.815 INFO:tasks.workunit.client.1.smithi173.stdout:6/723: write d0/db/d2e/d65/d9f/fef [250611,74455] 0 2024-02-16T22:19:19.815 INFO:tasks.workunit.client.1.smithi173.stdout:6/724: fdatasync d0/db/d2e/d2f/f4b 0 2024-02-16T22:19:19.816 INFO:tasks.workunit.client.1.smithi173.stdout:6/725: symlink d0/db/d2e/d2f/l103 0 2024-02-16T22:19:19.816 INFO:tasks.workunit.client.1.smithi173.stdout:6/726: chown d0/d7c/dc5/d92/l9a 126 1 2024-02-16T22:19:19.816 INFO:tasks.workunit.client.1.smithi173.stdout:6/727: readlink d0/db/d4d/l89 0 2024-02-16T22:19:19.818 INFO:tasks.workunit.client.1.smithi173.stdout:5/768: dread d8/da/d1b/d57/dc9/d92/fca [0,4194304] 0 2024-02-16T22:19:19.818 INFO:tasks.workunit.client.1.smithi173.stdout:5/769: read d8/da/f24 [1524161,41713] 0 2024-02-16T22:19:19.818 INFO:tasks.workunit.client.1.smithi173.stdout:5/770: write d8/da/d1b/d57/dc9/d92/dbc/fdc [53787,50712] 0 2024-02-16T22:19:19.823 INFO:tasks.workunit.client.1.smithi173.stdout:9/705: dwrite d1/d2/d1a/d2f/d51/f7a [0,4194304] 0 2024-02-16T22:19:19.823 INFO:tasks.workunit.client.1.smithi173.stdout:7/660: dwrite d1/d1d/d4c/d63/d11/fcc [0,4194304] 0 2024-02-16T22:19:19.823 INFO:tasks.workunit.client.1.smithi173.stdout:7/661: write d1/d1d/d4c/d63/d13/d22/d53/d27/f8d [762190,74551] 0 2024-02-16T22:19:19.823 INFO:tasks.workunit.client.1.smithi173.stdout:7/662: truncate d1/d1d/d4c/d63/fa5 851401 0 2024-02-16T22:19:19.823 INFO:tasks.workunit.client.1.smithi173.stdout:7/663: creat d1/d1d/d4c/d63/d13/d22/d7e/db5/fcd x:0 0 0 2024-02-16T22:19:19.825 INFO:tasks.workunit.client.1.smithi173.stdout:3/840: dwrite d9/d18/d5f/d6e/df9/f119 [0,4194304] 0 2024-02-16T22:19:19.825 INFO:tasks.workunit.client.1.smithi173.stdout:3/841: write d9/d18/d73/db7/d81/ddf/f104 [682408,95654] 0 2024-02-16T22:19:19.825 INFO:tasks.workunit.client.1.smithi173.stdout:3/842: fdatasync d9/d18/d73/f75 0 2024-02-16T22:19:19.825 INFO:tasks.workunit.client.1.smithi173.stdout:3/843: truncate d9/d1a/d2b/d4d/d5b/f89 871904 0 2024-02-16T22:19:19.826 INFO:tasks.workunit.client.1.smithi173.stdout:3/844: fsync d9/d18/d5f/d6e/d4e/f102 0 2024-02-16T22:19:19.826 INFO:tasks.workunit.client.1.smithi173.stdout:4/643: dwrite d7/d28/d14/f2a [0,4194304] 0 2024-02-16T22:19:19.826 INFO:tasks.workunit.client.1.smithi173.stdout:4/644: chown d7/d12/d7e/cd3 27713227 1 2024-02-16T22:19:19.826 INFO:tasks.workunit.client.1.smithi173.stdout:8/893: dwrite dd/d7c/d7d/f60 [0,4194304] 0 2024-02-16T22:19:19.835 INFO:tasks.workunit.client.1.smithi173.stdout:7/664: mkdir d1/d1d/d4c/d63/d13/dce 0 2024-02-16T22:19:19.835 INFO:tasks.workunit.client.1.smithi173.stdout:7/665: write d1/d1d/d4c/d63/d13/d22/d53/d27/f62 [603760,117459] 0 2024-02-16T22:19:19.839 INFO:tasks.workunit.client.1.smithi173.stdout:3/845: mknod d9/d18/d5f/d6e/df2/c123 0 2024-02-16T22:19:19.841 INFO:tasks.workunit.client.1.smithi173.stdout:8/894: mknod dd/d7c/d7d/d22/c11a 0 2024-02-16T22:19:19.843 INFO:tasks.workunit.client.1.smithi173.stdout:7/666: mkdir d1/d1d/d4c/d63/d13/d22/d53/db9/dbc/dcf 0 2024-02-16T22:19:19.844 INFO:tasks.workunit.client.1.smithi173.stdout:7/667: creat d1/d1d/d4c/d63/d13/fd0 x:0 0 0 2024-02-16T22:19:19.844 INFO:tasks.workunit.client.1.smithi173.stdout:7/668: creat d1/fd1 x:0 0 0 2024-02-16T22:19:19.844 INFO:tasks.workunit.client.1.smithi173.stdout:7/669: truncate d1/d1d/d4c/d63/d13/d36/d49/fae 470467 0 2024-02-16T22:19:19.844 INFO:tasks.workunit.client.1.smithi173.stdout:7/670: chown d1/fd1 50 1 2024-02-16T22:19:19.845 INFO:tasks.workunit.client.1.smithi173.stdout:3/846: creat d9/d1a/d2b/d4d/d94/f124 x:0 0 0 2024-02-16T22:19:19.848 INFO:tasks.workunit.client.1.smithi173.stdout:7/671: getdents d1/d1d/d4c/d63/d13/d36 0 2024-02-16T22:19:19.849 INFO:tasks.workunit.client.1.smithi173.stdout:6/728: dwrite d0/db/d2e/d2f/d31/d33/fab [0,4194304] 0 2024-02-16T22:19:19.850 INFO:tasks.workunit.client.1.smithi173.stdout:6/729: write d0/db/d2e/d2f/d31/d33/f9c [94497,37177] 0 2024-02-16T22:19:19.856 INFO:tasks.workunit.client.1.smithi173.stdout:5/771: dwrite d8/d27/d28/fa0 [0,4194304] 0 2024-02-16T22:19:19.861 INFO:tasks.workunit.client.1.smithi173.stdout:5/772: mkdir d8/da/db0/df0 0 2024-02-16T22:19:19.864 INFO:tasks.workunit.client.1.smithi173.stdout:9/706: dwrite d1/d2/d1a/d3e/dc8/fd1 [0,4194304] 0 2024-02-16T22:19:19.864 INFO:tasks.workunit.client.1.smithi173.stdout:4/645: dwrite d7/d12/d7e/fbe [0,4194304] 0 2024-02-16T22:19:19.864 INFO:tasks.workunit.client.1.smithi173.stdout:4/646: creat d7/d28/d52/d89/fdc x:0 0 0 2024-02-16T22:19:19.869 INFO:tasks.workunit.client.1.smithi173.stdout:6/730: write d0/db/d2e/d2f/d31/f62 [270454,3820] 0 2024-02-16T22:19:19.873 INFO:tasks.workunit.client.1.smithi173.stdout:8/895: dwrite dd/d9d/db2/f110 [0,4194304] 0 2024-02-16T22:19:19.878 INFO:tasks.workunit.client.1.smithi173.stdout:9/707: rename d1/d2/d1a/d1f/d34/dbb/dbe to d1/d2/d1a/d2f/d3b/da6/de4 0 2024-02-16T22:19:19.894 INFO:tasks.workunit.client.1.smithi173.stdout:7/672: dwrite d1/d1d/d4c/d63/d11/fcc [0,4194304] 0 2024-02-16T22:19:19.896 INFO:tasks.workunit.client.1.smithi173.stdout:7/673: mkdir d1/d1d/d4c/d63/d13/d22/d7e/dbd/dd2 0 2024-02-16T22:19:19.922 INFO:tasks.workunit.client.1.smithi173.stdout:3/847: dwrite d9/d1a/d2b/d4d/d5b/f7d [0,4194304] 0 2024-02-16T22:19:19.924 INFO:tasks.workunit.client.1.smithi173.stdout:5/773: dwrite d8/d27/d62/f68 [0,4194304] 0 2024-02-16T22:19:19.925 INFO:tasks.workunit.client.1.smithi173.stdout:8/896: dwrite dd/d9d/fa9 [0,4194304] 0 2024-02-16T22:19:19.925 INFO:tasks.workunit.client.1.smithi173.stdout:7/674: dwrite d1/d1d/d4c/fc5 [0,4194304] 0 2024-02-16T22:19:19.926 INFO:tasks.workunit.client.1.smithi173.stdout:6/731: dwrite d0/db/d2e/d61/f8a [0,4194304] 0 2024-02-16T22:19:19.926 INFO:tasks.workunit.client.1.smithi173.stdout:9/708: dwrite d1/d2/d1a/d1f/d34/d49/fa5 [0,4194304] 0 2024-02-16T22:19:19.930 INFO:tasks.workunit.client.1.smithi173.stdout:8/897: creat dd/d7c/d7d/d22/d28/d40/d69/df4/f11b x:0 0 0 2024-02-16T22:19:19.935 INFO:tasks.workunit.client.1.smithi173.stdout:8/898: mknod dd/d7c/d7d/d22/d28/c11c 0 2024-02-16T22:19:19.935 INFO:tasks.workunit.client.1.smithi173.stdout:8/899: fdatasync dd/d7c/d7d/d22/d28/f33 0 2024-02-16T22:19:19.935 INFO:tasks.workunit.client.1.smithi173.stdout:8/900: write dd/d7c/d7d/d22/d5a/f61 [1807928,78138] 0 2024-02-16T22:19:19.935 INFO:tasks.workunit.client.1.smithi173.stdout:7/675: mknod d1/d1d/d4c/d63/d13/d22/d7e/cd3 0 2024-02-16T22:19:19.936 INFO:tasks.workunit.client.1.smithi173.stdout:7/676: readlink d1/d1d/d4c/d63/d13/l17 0 2024-02-16T22:19:19.936 INFO:tasks.workunit.client.1.smithi173.stdout:5/774: dread d8/da/d1b/d57/dc9/f83 [0,4194304] 0 2024-02-16T22:19:19.936 INFO:tasks.workunit.client.1.smithi173.stdout:5/775: read - d8/d27/f9e zero size 2024-02-16T22:19:19.938 INFO:tasks.workunit.client.1.smithi173.stdout:5/776: mkdir d8/d27/d2f/df1 0 2024-02-16T22:19:19.939 INFO:tasks.workunit.client.1.smithi173.stdout:5/777: truncate d8/f6a 3007469 0 2024-02-16T22:19:19.957 INFO:tasks.workunit.client.1.smithi173.stdout:3/848: dwrite d9/d1a/d2b/d45/d51/d92/f116 [0,4194304] 0 2024-02-16T22:19:19.961 INFO:tasks.workunit.client.1.smithi173.stdout:3/849: rename d9/d1a/d2b/d45/c64 to d9/d17/c125 0 2024-02-16T22:19:19.968 INFO:tasks.workunit.client.1.smithi173.stdout:6/732: dwrite d0/db/d2e/d65/d73/d7d/fad [0,4194304] 0 2024-02-16T22:19:19.968 INFO:tasks.workunit.client.1.smithi173.stdout:6/733: creat d0/db/d2e/d2f/da6/f104 x:0 0 0 2024-02-16T22:19:19.968 INFO:tasks.workunit.client.1.smithi173.stdout:6/734: write d0/db/d2e/d2f/da6/fba [832785,52828] 0 2024-02-16T22:19:19.975 INFO:tasks.workunit.client.1.smithi173.stdout:3/850: dread d9/d1a/d2b/d4d/d94/d98/f11d [0,4194304] 0 2024-02-16T22:19:19.983 INFO:tasks.workunit.client.1.smithi173.stdout:9/709: dwrite d1/d2/d10/f63 [0,4194304] 0 2024-02-16T22:19:19.984 INFO:tasks.workunit.client.1.smithi173.stdout:9/710: mknod d1/d2/d1a/d2f/ce5 0 2024-02-16T22:19:19.986 INFO:tasks.workunit.client.1.smithi173.stdout:9/711: symlink d1/d2/d1a/d1f/d34/d49/d88/le6 0 2024-02-16T22:19:19.986 INFO:tasks.workunit.client.1.smithi173.stdout:9/712: fsync d1/d5f/d6d/d91/fad 0 2024-02-16T22:19:19.987 INFO:tasks.workunit.client.1.smithi173.stdout:7/677: dwrite d1/d1d/d4c/d63/d11/fcc [0,4194304] 0 2024-02-16T22:19:19.988 INFO:tasks.workunit.client.1.smithi173.stdout:7/678: fsync d1/d1d/d4c/d91/fbf 0 2024-02-16T22:19:19.988 INFO:tasks.workunit.client.1.smithi173.stdout:9/713: write d1/d5f/f85 [83257,17773] 0 2024-02-16T22:19:19.988 INFO:tasks.workunit.client.1.smithi173.stdout:8/901: dwrite dd/d7c/d7d/d22/d5a/f61 [0,4194304] 0 2024-02-16T22:19:19.988 INFO:tasks.workunit.client.1.smithi173.stdout:5/778: dwrite d8/da/d1f/d6f/fc4 [0,4194304] 0 2024-02-16T22:19:19.990 INFO:tasks.workunit.client.1.smithi173.stdout:9/714: rename d1/d2/c3a to d1/d2/da2/ce7 0 2024-02-16T22:19:19.992 INFO:tasks.workunit.client.1.smithi173.stdout:7/679: dread d1/d1d/f20 [0,4194304] 0 2024-02-16T22:19:19.994 INFO:tasks.workunit.client.1.smithi173.stdout:7/680: mkdir d1/dd4 0 2024-02-16T22:19:19.994 INFO:tasks.workunit.client.1.smithi173.stdout:8/902: dread dd/d7c/d7d/d22/d2e/f48 [0,4194304] 0 2024-02-16T22:19:19.994 INFO:tasks.workunit.client.1.smithi173.stdout:7/681: write d1/d1d/d4c/d63/f4 [1180108,102305] 0 2024-02-16T22:19:19.994 INFO:tasks.workunit.client.1.smithi173.stdout:8/903: getdents dd/d7c/d7d/d93 0 2024-02-16T22:19:19.994 INFO:tasks.workunit.client.1.smithi173.stdout:8/904: truncate dd/fab 3945450 0 2024-02-16T22:19:19.998 INFO:tasks.workunit.client.1.smithi173.stdout:6/735: dwrite d0/db/f3d [0,4194304] 0 2024-02-16T22:19:19.998 INFO:tasks.workunit.client.1.smithi173.stdout:6/736: creat d0/db/d2e/d65/d73/da9/f105 x:0 0 0 2024-02-16T22:19:20.002 INFO:tasks.workunit.client.1.smithi173.stdout:5/779: write d8/da/f1a [3948249,88630] 0 2024-02-16T22:19:20.004 INFO:tasks.workunit.client.1.smithi173.stdout:3/851: dwrite d9/d1a/d2b/d4d/d5b/fc5 [0,4194304] 0 2024-02-16T22:19:20.004 INFO:tasks.workunit.client.1.smithi173.stdout:6/737: stat d0/l50 0 2024-02-16T22:19:20.005 INFO:tasks.workunit.client.1.smithi173.stdout:5/780: rmdir d8/d27 39 2024-02-16T22:19:20.008 INFO:tasks.workunit.client.1.smithi173.stdout:3/852: creat d9/d18/d73/f126 x:0 0 0 2024-02-16T22:19:20.009 INFO:tasks.workunit.client.1.smithi173.stdout:6/738: symlink d0/db/d2e/d2f/da6/l106 0 2024-02-16T22:19:20.009 INFO:tasks.workunit.client.1.smithi173.stdout:6/739: read d0/db/d4d/f6f [82297,125291] 0 2024-02-16T22:19:20.011 INFO:tasks.workunit.client.1.smithi173.stdout:5/781: creat d8/da/d1f/db7/ff2 x:0 0 0 2024-02-16T22:19:20.012 INFO:tasks.workunit.client.1.smithi173.stdout:3/853: getdents d9/d1a/d2b/d45/d60 0 2024-02-16T22:19:20.014 INFO:tasks.workunit.client.1.smithi173.stdout:3/854: getdents d9/d1a/d2b/d45/d51/d92 0 2024-02-16T22:19:20.015 INFO:tasks.workunit.client.1.smithi173.stdout:3/855: symlink d9/d18/daa/df0/d10b/l127 0 2024-02-16T22:19:20.016 INFO:tasks.workunit.client.1.smithi173.stdout:7/682: dwrite d1/d1d/d4c/d63/d48/f79 [0,4194304] 0 2024-02-16T22:19:20.023 INFO:tasks.workunit.client.1.smithi173.stdout:7/683: symlink d1/d1d/d4c/d63/d11/ld5 0 2024-02-16T22:19:20.029 INFO:tasks.workunit.client.1.smithi173.stdout:5/782: dwrite d8/d27/d35/f44 [0,4194304] 0 2024-02-16T22:19:20.029 INFO:tasks.workunit.client.1.smithi173.stdout:5/783: readlink d8/d27/d35/d8b/lc1 0 2024-02-16T22:19:20.036 INFO:tasks.workunit.client.1.smithi173.stdout:5/784: link d8/da/d1b/d57/dc9/l6b d8/da/db0/df0/lf3 0 2024-02-16T22:19:20.036 INFO:tasks.workunit.client.1.smithi173.stdout:5/785: rmdir d8/da/d1f/d8c 39 2024-02-16T22:19:20.051 INFO:tasks.workunit.client.1.smithi173.stdout:5/786: dwrite d8/da/d1b/d57/d97/fd0 [0,4194304] 0 2024-02-16T22:19:20.054 INFO:tasks.workunit.client.1.smithi173.stdout:5/787: link d8/da/d1f/d8c/lb9 d8/da/d1f/db7/lf4 0 2024-02-16T22:19:20.054 INFO:tasks.workunit.client.1.smithi173.stdout:5/788: dread - d8/da/d2d/d56/fba zero size 2024-02-16T22:19:20.055 INFO:tasks.workunit.client.1.smithi173.stdout:5/789: mknod d8/da/d1b/d57/dc9/d92/cf5 0 2024-02-16T22:19:20.064 INFO:tasks.workunit.client.1.smithi173.stdout:5/790: dread d8/da/d2d/d36/f8a [0,4194304] 0 2024-02-16T22:19:20.065 INFO:tasks.workunit.client.1.smithi173.stdout:5/791: getdents d8/d27/d2f 0 2024-02-16T22:19:20.089 INFO:tasks.workunit.client.1.smithi173.stdout:5/792: dwrite d8/da/f47 [0,4194304] 0 2024-02-16T22:19:20.090 INFO:tasks.workunit.client.1.smithi173.stdout:7/684: dwrite d1/d1d/d4c/d63/d13/d22/d53/d27/f73 [0,4194304] 0 2024-02-16T22:19:20.090 INFO:tasks.workunit.client.1.smithi173.stdout:7/685: dread - d1/d1d/d4c/d63/d11/fb0 zero size 2024-02-16T22:19:20.092 INFO:tasks.workunit.client.1.smithi173.stdout:5/793: dread d8/f26 [0,4194304] 0 2024-02-16T22:19:20.092 INFO:tasks.workunit.client.1.smithi173.stdout:5/794: chown d8/ce4 299578 1 2024-02-16T22:19:20.092 INFO:tasks.workunit.client.1.smithi173.stdout:5/795: fsync d8/da/d1f/d8c/fb1 0 2024-02-16T22:19:20.092 INFO:tasks.workunit.client.1.smithi173.stdout:5/796: fsync d8/d27/d28/f5b 0 2024-02-16T22:19:20.093 INFO:tasks.workunit.client.1.smithi173.stdout:5/797: truncate d8/da/d2d/d36/d50/fe1 622772 0 2024-02-16T22:19:20.093 INFO:tasks.workunit.client.1.smithi173.stdout:7/686: mkdir d1/d1d/d4c/d63/d13/d36/dd6 0 2024-02-16T22:19:20.094 INFO:tasks.workunit.client.1.smithi173.stdout:7/687: symlink d1/d1d/ld7 0 2024-02-16T22:19:20.118 INFO:tasks.workunit.client.1.smithi173.stdout:5/798: dwrite d8/d27/d62/fcf [0,4194304] 0 2024-02-16T22:19:20.118 INFO:tasks.workunit.client.1.smithi173.stdout:5/799: getdents d8/da/d2d/d3a/da7/de7 0 2024-02-16T22:19:20.119 INFO:tasks.workunit.client.1.smithi173.stdout:7/688: dwrite d1/d1d/d4c/d91/d81/f99 [0,4194304] 0 2024-02-16T22:19:20.124 INFO:tasks.workunit.client.1.smithi173.stdout:7/689: mknod d1/d1d/d4c/d63/d48/cd8 0 2024-02-16T22:19:20.124 INFO:tasks.workunit.client.1.smithi173.stdout:7/690: truncate d1/d1d/d4c/d63/d54/f78 890512 0 2024-02-16T22:19:20.127 INFO:tasks.workunit.client.1.smithi173.stdout:7/691: dread d1/d1d/d4c/d63/d13/d22/d53/d27/f62 [0,4194304] 0 2024-02-16T22:19:20.127 INFO:tasks.workunit.client.1.smithi173.stdout:7/692: read - d1/d1d/d4c/d63/d13/d22/d7e/f9e zero size 2024-02-16T22:19:20.128 INFO:tasks.workunit.client.1.smithi173.stdout:7/693: mknod d1/d1d/d4c/d63/d6c/cd9 0 2024-02-16T22:19:20.130 INFO:tasks.workunit.client.1.smithi173.stdout:5/800: write d8/da/d1f/d30/f59 [3777102,16340] 0 2024-02-16T22:19:20.131 INFO:tasks.workunit.client.1.smithi173.stdout:7/694: rename d1/l61 to d1/d1d/d4c/d63/d11/lda 0 2024-02-16T22:19:20.133 INFO:tasks.workunit.client.1.smithi173.stdout:7/695: rename d1/d1d/d4c/d80/laf to d1/d1d/d4c/d63/d13/d22/d7e/ldb 0 2024-02-16T22:19:20.133 INFO:tasks.workunit.client.1.smithi173.stdout:7/696: creat d1/fdc x:0 0 0 2024-02-16T22:19:20.156 INFO:tasks.workunit.client.1.smithi173.stdout:5/801: dwrite d8/fa3 [0,4194304] 0 2024-02-16T22:19:20.168 INFO:tasks.workunit.client.1.smithi173.stdout:5/802: write d8/da/d1f/d30/d9b/fe5 [3431873,126244] 0 2024-02-16T22:19:20.170 INFO:tasks.workunit.client.1.smithi173.stdout:5/803: creat d8/da/d2d/dbd/ff6 x:0 0 0 2024-02-16T22:19:20.189 INFO:tasks.workunit.client.1.smithi173.stdout:5/804: dwrite d8/da/d2d/d36/f3d [4194304,4194304] 0 2024-02-16T22:19:20.192 INFO:tasks.workunit.client.1.smithi173.stdout:5/805: rename d8/da/d2d/faf to d8/da/d2d/d3a/da7/ff7 0 2024-02-16T22:19:20.192 INFO:tasks.workunit.client.1.smithi173.stdout:5/806: read d8/da/d1f/d8c/fc5 [1350169,68426] 0 2024-02-16T22:19:20.193 INFO:tasks.workunit.client.1.smithi173.stdout:5/807: link d8/da/d1f/d6f/d91/lda d8/d27/d28/lf8 0 2024-02-16T22:19:20.259 INFO:tasks.workunit.client.1.smithi173.stdout:1/761: sync 2024-02-16T22:19:20.259 INFO:tasks.workunit.client.1.smithi173.stdout:0/670: sync 2024-02-16T22:19:20.259 INFO:tasks.workunit.client.1.smithi173.stdout:2/690: sync 2024-02-16T22:19:20.260 INFO:tasks.workunit.client.1.smithi173.stdout:0/671: mknod d0/d12/d15/d3d/ce0 0 2024-02-16T22:19:20.269 INFO:tasks.workunit.client.1.smithi173.stdout:2/691: dread d2/d10/d62/f78 [0,4194304] 0 2024-02-16T22:19:20.269 INFO:tasks.workunit.client.1.smithi173.stdout:2/692: truncate d2/dc/d19/fe4 728325 0 2024-02-16T22:19:20.269 INFO:tasks.workunit.client.1.smithi173.stdout:2/693: chown d2/d4/d8/d30/d44/d81/cbc 31 1 2024-02-16T22:19:20.297 INFO:tasks.workunit.client.1.smithi173.stdout:0/672: dwrite d0/d12/d15/d3d/d98/d14/d24/d32/f66 [0,4194304] 0 2024-02-16T22:19:20.297 INFO:tasks.workunit.client.1.smithi173.stdout:0/673: truncate d0/d12/d15/d3d/d98/d14/d24/d5f/fba 366615 0 2024-02-16T22:19:20.297 INFO:tasks.workunit.client.1.smithi173.stdout:0/674: write d0/d12/d15/d3d/db5/dbf/f9c [331911,74966] 0 2024-02-16T22:19:20.298 INFO:tasks.workunit.client.1.smithi173.stdout:0/675: mkdir d0/d12/d15/d3d/d98/d14/d24/ddd/de1 0 2024-02-16T22:19:20.299 INFO:tasks.workunit.client.1.smithi173.stdout:0/676: getdents d0/d12/d15 0 2024-02-16T22:19:20.300 INFO:tasks.workunit.client.1.smithi173.stdout:0/677: rmdir d0/d12/d15/d3d/d98/d14/d24/ddd/de1 0 2024-02-16T22:19:20.301 INFO:tasks.workunit.client.1.smithi173.stdout:0/678: creat d0/d12/d15/d3d/d98/d14/d24/d2e/fe2 x:0 0 0 2024-02-16T22:19:20.302 INFO:tasks.workunit.client.1.smithi173.stdout:1/762: dwrite db/d1c/d25/d28/fc9 [0,4194304] 0 2024-02-16T22:19:20.302 INFO:tasks.workunit.client.1.smithi173.stdout:1/763: fdatasync db/d1c/d25/d45/df1/ff3 0 2024-02-16T22:19:20.305 INFO:tasks.workunit.client.1.smithi173.stdout:2/694: dwrite d2/d4/d8/d2d/f8b [0,4194304] 0 2024-02-16T22:19:20.305 INFO:tasks.workunit.client.1.smithi173.stdout:0/679: dread d0/d12/d15/d3d/fa1 [0,4194304] 0 2024-02-16T22:19:20.305 INFO:tasks.workunit.client.1.smithi173.stdout:0/680: write d0/d12/d15/d3d/d98/d33/d54/f5c [453703,12244] 0 2024-02-16T22:19:20.307 INFO:tasks.workunit.client.1.smithi173.stdout:0/681: symlink d0/d12/d15/d4f/d92/le3 0 2024-02-16T22:19:20.309 INFO:tasks.workunit.client.1.smithi173.stdout:2/695: mkdir d2/d4/d8/d2d/de6 0 2024-02-16T22:19:20.310 INFO:tasks.workunit.client.1.smithi173.stdout:0/682: mknod d0/d12/d15/d3d/d98/d27/ce4 0 2024-02-16T22:19:20.312 INFO:tasks.workunit.client.1.smithi173.stdout:2/696: rename d2/d4/f7 to d2/d4/d8/d3a/fe7 0 2024-02-16T22:19:20.312 INFO:tasks.workunit.client.1.smithi173.stdout:2/697: write d2/d4/d57/f91 [586751,122138] 0 2024-02-16T22:19:20.313 INFO:tasks.workunit.client.1.smithi173.stdout:0/683: mkdir d0/d12/d15/d99/de5 0 2024-02-16T22:19:20.314 INFO:tasks.workunit.client.1.smithi173.stdout:2/698: creat d2/d4/d8/fe8 x:0 0 0 2024-02-16T22:19:20.315 INFO:tasks.workunit.client.1.smithi173.stdout:2/699: chown d2/d4/d8/d80 82529 1 2024-02-16T22:19:20.316 INFO:tasks.workunit.client.1.smithi173.stdout:0/684: creat d0/d12/d15/d3d/d98/d14/d38/fe6 x:0 0 0 2024-02-16T22:19:20.316 INFO:tasks.workunit.client.1.smithi173.stdout:0/685: stat d0/d12/dce/ddb 0 2024-02-16T22:19:20.317 INFO:tasks.workunit.client.1.smithi173.stdout:2/700: creat d2/dc/d19/d69/dab/fe9 x:0 0 0 2024-02-16T22:19:20.317 INFO:tasks.workunit.client.1.smithi173.stdout:2/701: fsync d2/dc/d19/d1a/f26 0 2024-02-16T22:19:20.318 INFO:tasks.workunit.client.1.smithi173.stdout:2/702: rename d2/dc/d5d/f31 to d2/dc/d19/d1c/d53/fea 0 2024-02-16T22:19:20.323 INFO:tasks.workunit.client.1.smithi173.stdout:1/764: dwrite db/d1c/d25/d45/f90 [4194304,4194304] 0 2024-02-16T22:19:20.323 INFO:tasks.workunit.client.1.smithi173.stdout:1/765: chown db/d1c/d25/d45/df1 2403 1 2024-02-16T22:19:20.323 INFO:tasks.workunit.client.1.smithi173.stdout:1/766: write db/d1c/d25/d28/d3f/d4a/f54 [1086920,7490] 0 2024-02-16T22:19:20.323 INFO:tasks.workunit.client.1.smithi173.stdout:1/767: chown db/d1c/d25/d28/d3f/d4a/cf2 1925 1 2024-02-16T22:19:20.326 INFO:tasks.workunit.client.1.smithi173.stdout:1/768: unlink db/d5f/da9/lc0 0 2024-02-16T22:19:20.326 INFO:tasks.workunit.client.1.smithi173.stdout:1/769: fsync db/d1c/d25/d28/d3f/fc8 0 2024-02-16T22:19:20.326 INFO:tasks.workunit.client.1.smithi173.stdout:1/770: chown db/d29/d50/fca 695637 1 2024-02-16T22:19:20.346 INFO:tasks.workunit.client.1.smithi173.stdout:0/686: dwrite d0/d12/d15/d3d/d98/d14/d24/d32/d39/f75 [0,4194304] 0 2024-02-16T22:19:20.346 INFO:tasks.workunit.client.1.smithi173.stdout:2/703: dwrite d2/dc/d19/d69/dab/fe9 [0,4194304] 0 2024-02-16T22:19:20.347 INFO:tasks.workunit.client.1.smithi173.stdout:0/687: mkdir d0/d12/d15/d3d/d98/d14/d24/d58/de7 0 2024-02-16T22:19:20.359 INFO:tasks.workunit.client.1.smithi173.stdout:8/905: sync 2024-02-16T22:19:20.359 INFO:tasks.workunit.client.1.smithi173.stdout:4/647: sync 2024-02-16T22:19:20.359 INFO:tasks.workunit.client.1.smithi173.stdout:3/856: sync 2024-02-16T22:19:20.359 INFO:tasks.workunit.client.1.smithi173.stdout:6/740: sync 2024-02-16T22:19:20.359 INFO:tasks.workunit.client.1.smithi173.stdout:9/715: sync 2024-02-16T22:19:20.359 INFO:tasks.workunit.client.1.smithi173.stdout:8/906: chown dd/fe8 0 1 2024-02-16T22:19:20.359 INFO:tasks.workunit.client.1.smithi173.stdout:8/907: chown f4 43 1 2024-02-16T22:19:20.359 INFO:tasks.workunit.client.1.smithi173.stdout:6/741: write d0/db/d2e/d2f/f3b [1378312,8693] 0 2024-02-16T22:19:20.360 INFO:tasks.workunit.client.1.smithi173.stdout:4/648: symlink d7/d28/d52/ldd 0 2024-02-16T22:19:20.362 INFO:tasks.workunit.client.1.smithi173.stdout:6/742: symlink d0/db/df0/l107 0 2024-02-16T22:19:20.363 INFO:tasks.workunit.client.1.smithi173.stdout:6/743: readlink d0/db/d2e/d2f/d31/d7a/la3 0 2024-02-16T22:19:20.377 INFO:tasks.workunit.client.1.smithi173.stdout:9/716: dread d1/d2/d10/fc0 [0,4194304] 0 2024-02-16T22:19:20.377 INFO:tasks.workunit.client.1.smithi173.stdout:9/717: fdatasync d1/d2/d1a/d3e/dc8/fd2 0 2024-02-16T22:19:20.377 INFO:tasks.workunit.client.1.smithi173.stdout:9/718: readlink d1/la3 0 2024-02-16T22:19:20.392 INFO:tasks.workunit.client.1.smithi173.stdout:9/719: write d1/d2/d1a/d1f/d34/d49/faa [6287029,59420] 0 2024-02-16T22:19:20.410 INFO:tasks.workunit.client.1.smithi173.stdout:3/857: dwrite d9/f7c [0,4194304] 0 2024-02-16T22:19:20.413 INFO:tasks.workunit.client.1.smithi173.stdout:3/858: dread d9/d18/d73/db7/d81/ddf/f104 [0,4194304] 0 2024-02-16T22:19:20.413 INFO:tasks.workunit.client.1.smithi173.stdout:3/859: chown d9/d18/d73/db7/d81/l90 243184893 1 2024-02-16T22:19:20.414 INFO:tasks.workunit.client.1.smithi173.stdout:4/649: dwrite d7/d28/d31/d33/d7d/d45/f6b [0,4194304] 0 2024-02-16T22:19:20.414 INFO:tasks.workunit.client.1.smithi173.stdout:6/744: dwrite d0/d7c/dc5/d92/fe4 [0,4194304] 0 2024-02-16T22:19:20.414 INFO:tasks.workunit.client.1.smithi173.stdout:6/745: write d0/db/d2e/d2f/d31/d5d/ffd [799859,122544] 0 2024-02-16T22:19:20.414 INFO:tasks.workunit.client.1.smithi173.stdout:3/860: rmdir d9/d1a/d2b/d4d 39 2024-02-16T22:19:20.414 INFO:tasks.workunit.client.1.smithi173.stdout:6/746: write d0/db/d2e/d2f/f45 [8748558,29357] 0 2024-02-16T22:19:20.414 INFO:tasks.workunit.client.1.smithi173.stdout:4/650: truncate d7/df/f80 1411961 0 2024-02-16T22:19:20.415 INFO:tasks.workunit.client.1.smithi173.stdout:2/704: dwrite d2/dc/d19/d1a/f3f [0,4194304] 0 2024-02-16T22:19:20.415 INFO:tasks.workunit.client.1.smithi173.stdout:9/720: dwrite d1/d2/d1a/d2f/d3b/d75/f90 [0,4194304] 0 2024-02-16T22:19:20.417 INFO:tasks.workunit.client.1.smithi173.stdout:3/861: creat d9/d18/d73/db7/d81/de1/f128 x:0 0 0 2024-02-16T22:19:20.417 INFO:tasks.workunit.client.1.smithi173.stdout:6/747: mkdir d0/db/d2e/d2f/d108 0 2024-02-16T22:19:20.418 INFO:tasks.workunit.client.1.smithi173.stdout:4/651: mkdir d7/df/d62/dd8/dde 0 2024-02-16T22:19:20.418 INFO:tasks.workunit.client.1.smithi173.stdout:4/652: getdents d7/d28/d31/d33/d7d/d4e/dd7 0 2024-02-16T22:19:20.421 INFO:tasks.workunit.client.1.smithi173.stdout:2/705: mkdir d2/dc/d19/deb 0 2024-02-16T22:19:20.424 INFO:tasks.workunit.client.1.smithi173.stdout:9/721: link d1/d2/d1a/d8b/l9c d1/d2/d1a/d1f/d34/d49/dac/le8 0 2024-02-16T22:19:20.424 INFO:tasks.workunit.client.1.smithi173.stdout:9/722: write d1/d2/d1a/f5d [1006785,85845] 0 2024-02-16T22:19:20.424 INFO:tasks.workunit.client.1.smithi173.stdout:3/862: mkdir d9/d1a/d2b/d4d/d118/d129 0 2024-02-16T22:19:20.425 INFO:tasks.workunit.client.1.smithi173.stdout:4/653: truncate d7/df/f1b 687129 0 2024-02-16T22:19:20.427 INFO:tasks.workunit.client.1.smithi173.stdout:9/723: mknod d1/d2/d1a/ce9 0 2024-02-16T22:19:20.427 INFO:tasks.workunit.client.1.smithi173.stdout:3/863: rmdir d9/d1a/d2b/d45/d51 39 2024-02-16T22:19:20.430 INFO:tasks.workunit.client.1.smithi173.stdout:4/654: creat d7/d28/d31/d72/d93/fdf x:0 0 0 2024-02-16T22:19:20.430 INFO:tasks.workunit.client.1.smithi173.stdout:4/655: chown d7/d28/d31/fbd 7427 1 2024-02-16T22:19:20.430 INFO:tasks.workunit.client.1.smithi173.stdout:4/656: truncate d7/d28/d31/f77 813338 0 2024-02-16T22:19:20.430 INFO:tasks.workunit.client.1.smithi173.stdout:4/657: fdatasync d7/df/f80 0 2024-02-16T22:19:20.430 INFO:tasks.workunit.client.1.smithi173.stdout:6/748: write d0/db/d4d/f5f [3437235,15946] 0 2024-02-16T22:19:20.431 INFO:tasks.workunit.client.1.smithi173.stdout:9/724: unlink d1/d5f/d6d/d91/fad 0 2024-02-16T22:19:20.432 INFO:tasks.workunit.client.1.smithi173.stdout:4/658: getdents d7/d28/d31/d72/d93/d95/db4 0 2024-02-16T22:19:20.433 INFO:tasks.workunit.client.1.smithi173.stdout:6/749: mkdir d0/db/d4d/d109 0 2024-02-16T22:19:20.434 INFO:tasks.workunit.client.1.smithi173.stdout:2/706: write d2/d10/f64 [3169742,45124] 0 2024-02-16T22:19:20.436 INFO:tasks.workunit.client.1.smithi173.stdout:4/659: unlink d7/df/f58 0 2024-02-16T22:19:20.438 INFO:tasks.workunit.client.1.smithi173.stdout:6/750: link d0/db/fb2 d0/db/d2e/d2f/d31/d7a/f10a 0 2024-02-16T22:19:20.438 INFO:tasks.workunit.client.1.smithi173.stdout:6/751: truncate d0/db/d2e/d65/d73/ff9 4352599 0 2024-02-16T22:19:20.440 INFO:tasks.workunit.client.1.smithi173.stdout:2/707: mkdir d2/dc/d19/d1a/d74/db2/dec 0 2024-02-16T22:19:20.440 INFO:tasks.workunit.client.1.smithi173.stdout:2/708: write d2/d4/d8/d30/d44/d81/fde [525215,34790] 0 2024-02-16T22:19:20.440 INFO:tasks.workunit.client.1.smithi173.stdout:2/709: write d2/dc/d19/d69/dab/fd2 [1169879,62680] 0 2024-02-16T22:19:20.441 INFO:tasks.workunit.client.1.smithi173.stdout:4/660: rename d7/d28/d31/d33/d7d/d45/fa2 to d7/dd5/fe0 0 2024-02-16T22:19:20.442 INFO:tasks.workunit.client.1.smithi173.stdout:6/752: mkdir d0/db/d2e/d65/d9f/d10b 0 2024-02-16T22:19:20.442 INFO:tasks.workunit.client.1.smithi173.stdout:6/753: write d0/db/d2e/d65/d73/fcc [608151,103803] 0 2024-02-16T22:19:20.443 INFO:tasks.workunit.client.1.smithi173.stdout:6/754: creat d0/db/d2e/d65/d67/f10c x:0 0 0 2024-02-16T22:19:20.444 INFO:tasks.workunit.client.1.smithi173.stdout:6/755: read - d0/db/d2e/d2f/fc1 zero size 2024-02-16T22:19:20.444 INFO:tasks.workunit.client.1.smithi173.stdout:6/756: symlink d0/db/d2e/d2f/da6/daa/dff/l10d 0 2024-02-16T22:19:20.444 INFO:tasks.workunit.client.1.smithi173.stdout:6/757: mknod d0/db/df0/c10e 0 2024-02-16T22:19:20.446 INFO:tasks.workunit.client.1.smithi173.stdout:6/758: rmdir d0/db/d2e/d2f/d31/d33 39 2024-02-16T22:19:20.446 INFO:tasks.workunit.client.1.smithi173.stdout:6/759: getdents d0/db/d2e/d65/d73/d100 0 2024-02-16T22:19:20.446 INFO:tasks.workunit.client.1.smithi173.stdout:2/710: dread d2/dc/d19/d1c/d53/f7e [0,4194304] 0 2024-02-16T22:19:20.446 INFO:tasks.workunit.client.1.smithi173.stdout:3/864: dwrite d9/d1a/d2b/d4d/d5b/da9/db4/de2/f115 [0,4194304] 0 2024-02-16T22:19:20.447 INFO:tasks.workunit.client.1.smithi173.stdout:6/760: mkdir d0/db/d2e/d65/d67/d10f 0 2024-02-16T22:19:20.448 INFO:tasks.workunit.client.1.smithi173.stdout:2/711: mkdir d2/d4/d57/d82/ded 0 2024-02-16T22:19:20.449 INFO:tasks.workunit.client.1.smithi173.stdout:4/661: dread d7/d9a/fa8 [0,4194304] 0 2024-02-16T22:19:20.450 INFO:tasks.workunit.client.1.smithi173.stdout:6/761: mkdir d0/db/d2e/d65/d73/d100/d110 0 2024-02-16T22:19:20.451 INFO:tasks.workunit.client.1.smithi173.stdout:2/712: creat d2/dc/d19/d1a/d74/db2/ddc/fee x:0 0 0 2024-02-16T22:19:20.451 INFO:tasks.workunit.client.1.smithi173.stdout:2/713: chown d2 206 1 2024-02-16T22:19:20.451 INFO:tasks.workunit.client.1.smithi173.stdout:2/714: write d2/dc/d19/d1c/d53/d6e/f73 [643707,39009] 0 2024-02-16T22:19:20.451 INFO:tasks.workunit.client.1.smithi173.stdout:4/662: creat d7/d28/d31/d33/fe1 x:0 0 0 2024-02-16T22:19:20.452 INFO:tasks.workunit.client.1.smithi173.stdout:6/762: mknod d0/db/d2e/d2f/c111 0 2024-02-16T22:19:20.454 INFO:tasks.workunit.client.1.smithi173.stdout:3/865: write d9/f4c [1613061,34830] 0 2024-02-16T22:19:20.454 INFO:tasks.workunit.client.1.smithi173.stdout:3/866: write d9/d1a/d2b/f10a [5038632,3686] 0 2024-02-16T22:19:20.455 INFO:tasks.workunit.client.1.smithi173.stdout:2/715: creat d2/dc/d5d/d7a/fef x:0 0 0 2024-02-16T22:19:20.455 INFO:tasks.workunit.client.1.smithi173.stdout:2/716: getdents d2/d4/d57/d82/ded 0 2024-02-16T22:19:20.458 INFO:tasks.workunit.client.1.smithi173.stdout:6/763: mknod d0/db/d2e/d2f/d31/d33/c112 0 2024-02-16T22:19:20.461 INFO:tasks.workunit.client.1.smithi173.stdout:2/717: mkdir d2/dc/d19/d1c/d53/df0 0 2024-02-16T22:19:20.464 INFO:tasks.workunit.client.1.smithi173.stdout:2/718: mknod d2/dc/d19/d1c/d53/d6e/cf1 0 2024-02-16T22:19:20.464 INFO:tasks.workunit.client.1.smithi173.stdout:2/719: write d2/d4/d8/d30/d44/d81/d99/fc0 [49237,106079] 0 2024-02-16T22:19:20.465 INFO:tasks.workunit.client.1.smithi173.stdout:2/720: symlink d2/d4/d57/d82/lf2 0 2024-02-16T22:19:20.468 INFO:tasks.workunit.client.1.smithi173.stdout:2/721: mkdir d2/dc/d19/dc4/df3 0 2024-02-16T22:19:20.469 INFO:tasks.workunit.client.1.smithi173.stdout:2/722: symlink d2/d4/d8/d3a/de1/lf4 0 2024-02-16T22:19:20.469 INFO:tasks.workunit.client.1.smithi173.stdout:2/723: creat d2/d4/d8/d30/d44/d81/d99/ff5 x:0 0 0 2024-02-16T22:19:20.470 INFO:tasks.workunit.client.1.smithi173.stdout:4/663: dwrite d7/d28/d31/d33/f85 [0,4194304] 0 2024-02-16T22:19:20.470 INFO:tasks.workunit.client.1.smithi173.stdout:6/764: write d0/db/d2e/d2f/da6/daa/de8/f9e [1399542,42876] 0 2024-02-16T22:19:20.471 INFO:tasks.workunit.client.1.smithi173.stdout:2/724: symlink d2/d4/d8/d30/d4d/da8/lf6 0 2024-02-16T22:19:20.471 INFO:tasks.workunit.client.1.smithi173.stdout:2/725: fdatasync d2/d4/f4c 0 2024-02-16T22:19:20.471 INFO:tasks.workunit.client.1.smithi173.stdout:2/726: fdatasync d2/d4/d8/f95 0 2024-02-16T22:19:20.472 INFO:tasks.workunit.client.1.smithi173.stdout:4/664: mknod d7/df/d62/dd8/ce2 0 2024-02-16T22:19:20.473 INFO:tasks.workunit.client.1.smithi173.stdout:6/765: symlink d0/db/d2e/d65/d9f/d10b/l113 0 2024-02-16T22:19:20.475 INFO:tasks.workunit.client.1.smithi173.stdout:4/665: getdents d7/d28/d52/d89 0 2024-02-16T22:19:20.475 INFO:tasks.workunit.client.1.smithi173.stdout:4/666: fdatasync d7/d28/d31/d33/d7d/d4e/f5a 0 2024-02-16T22:19:20.475 INFO:tasks.workunit.client.1.smithi173.stdout:4/667: dread - d7/d12/d7e/f9d zero size 2024-02-16T22:19:20.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:19 smithi134 ceph-mon[28869]: pgmap v262: 65 pgs: 65 active+clean; 2.1 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 140 MiB/s rd, 169 MiB/s wr, 330 op/s 2024-02-16T22:19:20.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:19 smithi173 ceph-mon[37280]: pgmap v262: 65 pgs: 65 active+clean; 2.1 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 140 MiB/s rd, 169 MiB/s wr, 330 op/s 2024-02-16T22:19:20.483 INFO:tasks.workunit.client.1.smithi173.stdout:4/668: dread d7/d12/d7e/fbe [0,4194304] 0 2024-02-16T22:19:20.484 INFO:tasks.workunit.client.1.smithi173.stdout:4/669: mknod d7/d28/d31/d33/d7d/d45/ce3 0 2024-02-16T22:19:20.489 INFO:tasks.workunit.client.1.smithi173.stdout:7/697: sync 2024-02-16T22:19:20.489 INFO:tasks.workunit.client.1.smithi173.stdout:5/808: sync 2024-02-16T22:19:20.491 INFO:tasks.workunit.client.1.smithi173.stdout:5/809: mkdir d8/da/d1b/d57/d97/df9 0 2024-02-16T22:19:20.491 INFO:tasks.workunit.client.1.smithi173.stdout:5/810: write d8/da/d2d/fec [880434,23677] 0 2024-02-16T22:19:20.492 INFO:tasks.workunit.client.1.smithi173.stdout:7/698: mknod d1/d1d/d4c/d63/d13/d36/d49/cdd 0 2024-02-16T22:19:20.493 INFO:tasks.workunit.client.1.smithi173.stdout:5/811: mkdir d8/d27/d62/dfa 0 2024-02-16T22:19:20.495 INFO:tasks.workunit.client.1.smithi173.stdout:5/812: creat d8/d27/d62/dfa/ffb x:0 0 0 2024-02-16T22:19:20.496 INFO:tasks.workunit.client.1.smithi173.stdout:5/813: creat d8/da/d1f/d8c/ffc x:0 0 0 2024-02-16T22:19:20.498 INFO:tasks.workunit.client.1.smithi173.stdout:5/814: getdents d8 0 2024-02-16T22:19:20.498 INFO:tasks.workunit.client.1.smithi173.stdout:5/815: write d8/da/d1f/d6f/fc4 [4357317,30422] 0 2024-02-16T22:19:20.498 INFO:tasks.workunit.client.1.smithi173.stdout:5/816: write d8/da/d2d/d36/f8a [4701290,81031] 0 2024-02-16T22:19:20.508 INFO:tasks.workunit.client.1.smithi173.stdout:7/699: write d1/d1d/d4c/d63/d13/d36/d49/f7f [1159953,33567] 0 2024-02-16T22:19:20.508 INFO:tasks.workunit.client.1.smithi173.stdout:7/700: symlink d1/dd4/lde 0 2024-02-16T22:19:20.511 INFO:tasks.workunit.client.1.smithi173.stdout:7/701: rename d1/d1d/d4c/d63/d13/d36/f55 to d1/d1d/d4c/d63/d11/fdf 0 2024-02-16T22:19:20.511 INFO:tasks.workunit.client.1.smithi173.stdout:7/702: write d1/d1d/d4c/d63/d48/d9a/fb3 [458522,63631] 0 2024-02-16T22:19:20.511 INFO:tasks.workunit.client.1.smithi173.stdout:7/703: dread - d1/d1d/d4c/d63/d13/d22/d7e/dc2/f59 zero size 2024-02-16T22:19:20.512 INFO:tasks.workunit.client.1.smithi173.stdout:5/817: dread d8/fa3 [0,4194304] 0 2024-02-16T22:19:20.520 INFO:tasks.workunit.client.1.smithi173.stdout:6/766: dwrite d0/db/d2e/d2f/da6/daa/de8/f9e [0,4194304] 0 2024-02-16T22:19:20.521 INFO:tasks.workunit.client.1.smithi173.stdout:6/767: write d0/db/d2e/d2f/d31/d7a/ffa [868070,47015] 0 2024-02-16T22:19:20.521 INFO:tasks.workunit.client.1.smithi173.stdout:4/670: dwrite d7/d28/d31/d33/d7d/d45/f6b [0,4194304] 0 2024-02-16T22:19:20.521 INFO:tasks.workunit.client.1.smithi173.stdout:5/818: dread d8/da/d1b/d57/dc9/f4b [0,4194304] 0 2024-02-16T22:19:20.524 INFO:tasks.workunit.client.1.smithi173.stdout:4/671: creat d7/d28/d31/d72/d93/d95/db4/fe4 x:0 0 0 2024-02-16T22:19:20.525 INFO:tasks.workunit.client.1.smithi173.stdout:5/819: creat d8/d27/d2f/ffd x:0 0 0 2024-02-16T22:19:20.531 INFO:tasks.workunit.client.1.smithi173.stdout:6/768: rmdir d0 39 2024-02-16T22:19:20.534 INFO:tasks.workunit.client.1.smithi173.stdout:5/820: creat d8/d27/d28/ffe x:0 0 0 2024-02-16T22:19:20.534 INFO:tasks.workunit.client.1.smithi173.stdout:5/821: dread - d8/da/d2d/d56/fba zero size 2024-02-16T22:19:20.535 INFO:tasks.workunit.client.1.smithi173.stdout:5/822: symlink d8/da/d2d/d36/dc2/lff 0 2024-02-16T22:19:20.535 INFO:tasks.workunit.client.1.smithi173.stdout:5/823: write d8/da/d1f/d30/d9b/fe5 [346084,10161] 0 2024-02-16T22:19:20.543 INFO:tasks.workunit.client.1.smithi173.stdout:5/824: write d8/d27/d62/fcf [2262555,76853] 0 2024-02-16T22:19:20.543 INFO:tasks.workunit.client.1.smithi173.stdout:5/825: write d8/da/d2d/d36/d50/f9a [2388621,15836] 0 2024-02-16T22:19:20.543 INFO:tasks.workunit.client.1.smithi173.stdout:5/826: creat d8/da/d1f/f100 x:0 0 0 2024-02-16T22:19:20.548 INFO:tasks.workunit.client.1.smithi173.stdout:7/704: dwrite d1/d1d/d4c/d63/d13/d22/d53/d27/f8d [0,4194304] 0 2024-02-16T22:19:20.551 INFO:tasks.workunit.client.1.smithi173.stdout:7/705: creat d1/d1d/d4c/d63/d13/d36/dd6/fe0 x:0 0 0 2024-02-16T22:19:20.551 INFO:tasks.workunit.client.1.smithi173.stdout:5/827: dread d8/da/d1b/d57/dc9/f83 [4194304,4194304] 0 2024-02-16T22:19:20.551 INFO:tasks.workunit.client.1.smithi173.stdout:5/828: chown d8/da/d1f 64680048 1 2024-02-16T22:19:20.551 INFO:tasks.workunit.client.1.smithi173.stdout:5/829: chown d8/da/d1f/d8c/dcc 1143 1 2024-02-16T22:19:20.554 INFO:tasks.workunit.client.1.smithi173.stdout:4/672: getdents d7/d28/d31/d72/d93/d95/db4 0 2024-02-16T22:19:20.593 INFO:tasks.workunit.client.1.smithi173.stdout:7/706: dwrite d1/d1d/d4c/d63/d13/d22/d7e/db5/fc9 [0,4194304] 0 2024-02-16T22:19:20.594 INFO:tasks.workunit.client.1.smithi173.stdout:7/707: fsync d1/d1d/d4c/d63/d13/d36/f52 0 2024-02-16T22:19:20.594 INFO:tasks.workunit.client.1.smithi173.stdout:5/830: dwrite d8/d27/d35/fbb [0,4194304] 0 2024-02-16T22:19:20.594 INFO:tasks.workunit.client.1.smithi173.stdout:4/673: dwrite d7/dd5/f5c [0,4194304] 0 2024-02-16T22:19:20.594 INFO:tasks.workunit.client.1.smithi173.stdout:4/674: write d7/f5f [945226,23767] 0 2024-02-16T22:19:20.596 INFO:tasks.workunit.client.1.smithi173.stdout:7/708: mkdir d1/d1d/d4c/d63/d13/d22/d53/db9/de1 0 2024-02-16T22:19:20.597 INFO:tasks.workunit.client.1.smithi173.stdout:5/831: symlink d8/da/d1b/d57/dcb/de8/l101 0 2024-02-16T22:19:20.598 INFO:tasks.workunit.client.1.smithi173.stdout:7/709: symlink d1/dd4/le2 0 2024-02-16T22:19:20.599 INFO:tasks.workunit.client.1.smithi173.stdout:4/675: dread d7/d28/d31/d33/fd1 [0,4194304] 0 2024-02-16T22:19:20.602 INFO:tasks.workunit.client.1.smithi173.stdout:4/676: rename d7/d28/d52/d89/f9c to d7/fe5 0 2024-02-16T22:19:20.602 INFO:tasks.workunit.client.1.smithi173.stdout:4/677: fsync d7/d28/d52/f90 0 2024-02-16T22:19:20.602 INFO:tasks.workunit.client.1.smithi173.stdout:4/678: stat d7/d28/d52/d89/fdc 0 2024-02-16T22:19:20.602 INFO:tasks.workunit.client.1.smithi173.stdout:4/679: write d7/d12/f73 [1326651,31094] 0 2024-02-16T22:19:20.602 INFO:tasks.workunit.client.1.smithi173.stdout:4/680: truncate d7/dd5/fae 1617397 0 2024-02-16T22:19:20.603 INFO:tasks.workunit.client.1.smithi173.stdout:4/681: creat d7/df/d8b/da1/fe6 x:0 0 0 2024-02-16T22:19:20.606 INFO:tasks.workunit.client.1.smithi173.stdout:4/682: creat d7/d28/d31/d33/dca/fe7 x:0 0 0 2024-02-16T22:19:20.606 INFO:tasks.workunit.client.1.smithi173.stdout:4/683: fdatasync d7/d28/d31/d33/d7d/d4e/f6a 0 2024-02-16T22:19:20.606 INFO:tasks.workunit.client.1.smithi173.stdout:4/684: getdents d7/dd5/dcf 0 2024-02-16T22:19:20.606 INFO:tasks.workunit.client.1.smithi173.stdout:4/685: getdents d7/d12/d7e 0 2024-02-16T22:19:20.608 INFO:tasks.workunit.client.1.smithi173.stdout:4/686: creat d7/df/fe8 x:0 0 0 2024-02-16T22:19:20.610 INFO:tasks.workunit.client.1.smithi173.stdout:4/687: unlink d7/df/l56 0 2024-02-16T22:19:20.639 INFO:tasks.workunit.client.1.smithi173.stdout:5/832: dwrite d8/da/d2d/d56/fa5 [0,4194304] 0 2024-02-16T22:19:20.639 INFO:tasks.workunit.client.1.smithi173.stdout:5/833: write d8/da/d2d/d56/fba [456844,49419] 0 2024-02-16T22:19:20.639 INFO:tasks.workunit.client.1.smithi173.stdout:4/688: dwrite d7/d12/f2b [4194304,4194304] 0 2024-02-16T22:19:20.640 INFO:tasks.workunit.client.1.smithi173.stdout:5/834: write d8/da/d2d/d36/f40 [1412413,11710] 0 2024-02-16T22:19:20.640 INFO:tasks.workunit.client.1.smithi173.stdout:4/689: chown d7/dd5/fae 1898374 1 2024-02-16T22:19:20.640 INFO:tasks.workunit.client.1.smithi173.stdout:7/710: dwrite d1/d1d/d4c/fc5 [0,4194304] 0 2024-02-16T22:19:20.640 INFO:tasks.workunit.client.1.smithi173.stdout:7/711: chown d1/d1d/d4c/d63/d13/d36/d49/cdd 10 1 2024-02-16T22:19:20.640 INFO:tasks.workunit.client.1.smithi173.stdout:7/712: read d1/d1d/d4c/d63/d13/d36/d49/f86 [223030,68732] 0 2024-02-16T22:19:20.651 INFO:tasks.workunit.client.1.smithi173.stdout:5/835: dread d8/da/d1f/d6f/fc4 [0,4194304] 0 2024-02-16T22:19:20.651 INFO:tasks.workunit.client.1.smithi173.stdout:5/836: read - d8/d27/d35/d8b/f9f zero size 2024-02-16T22:19:20.654 INFO:tasks.workunit.client.1.smithi173.stdout:4/690: dwrite d7/fd [0,4194304] 0 2024-02-16T22:19:20.654 INFO:tasks.workunit.client.1.smithi173.stdout:7/713: dread d1/d1d/d4c/d63/d13/d22/d7e/dc2/f7c [0,4194304] 0 2024-02-16T22:19:20.655 INFO:tasks.workunit.client.1.smithi173.stdout:5/837: dread d8/da/d1b/faa [0,4194304] 0 2024-02-16T22:19:20.658 INFO:tasks.workunit.client.1.smithi173.stdout:4/691: rename d7/d28/d31/d33/d7d/d45/ce3 to d7/d28/d31/d72/d93/d95/db4/ce9 0 2024-02-16T22:19:20.659 INFO:tasks.workunit.client.1.smithi173.stdout:7/714: creat d1/d1d/d4c/d63/d13/d36/d49/fe3 x:0 0 0 2024-02-16T22:19:20.659 INFO:tasks.workunit.client.1.smithi173.stdout:5/838: mknod d8/da/d1b/d57/d97/df9/c102 0 2024-02-16T22:19:20.659 INFO:tasks.workunit.client.1.smithi173.stdout:5/839: creat d8/d27/d2f/f103 x:0 0 0 2024-02-16T22:19:20.664 INFO:tasks.workunit.client.1.smithi173.stdout:4/692: mkdir d7/df/d62/dea 0 2024-02-16T22:19:20.664 INFO:tasks.workunit.client.1.smithi173.stdout:4/693: write d7/d28/d31/d33/dca/fe7 [811381,87775] 0 2024-02-16T22:19:20.668 INFO:tasks.workunit.client.1.smithi173.stdout:4/694: dread d7/df/f22 [0,4194304] 0 2024-02-16T22:19:20.670 INFO:tasks.workunit.client.1.smithi173.stdout:4/695: unlink d7/d28/d31/d33/d7d/d45/c76 0 2024-02-16T22:19:20.671 INFO:tasks.workunit.client.1.smithi173.stdout:4/696: truncate d7/d28/d31/d33/d7d/f47 321186 0 2024-02-16T22:19:20.672 INFO:tasks.workunit.client.1.smithi173.stdout:4/697: symlink d7/dd5/dad/leb 0 2024-02-16T22:19:20.673 INFO:tasks.workunit.client.1.smithi173.stdout:4/698: dread d7/dd5/f8e [0,4194304] 0 2024-02-16T22:19:20.673 INFO:tasks.workunit.client.1.smithi173.stdout:4/699: dread - d7/d28/d31/d72/d93/d95/db4/fe4 zero size 2024-02-16T22:19:20.675 INFO:tasks.workunit.client.1.smithi173.stdout:4/700: mkdir d7/d28/d31/d33/d7d/d4e/dd7/dec 0 2024-02-16T22:19:20.675 INFO:tasks.workunit.client.1.smithi173.stdout:5/840: dread d8/da/d1b/d57/dc9/f83 [0,4194304] 0 2024-02-16T22:19:20.677 INFO:tasks.workunit.client.1.smithi173.stdout:5/841: rename d8/da/d2d/d36/d50/f9a to d8/da/d2d/d3a/da7/de7/f104 0 2024-02-16T22:19:20.678 INFO:tasks.workunit.client.1.smithi173.stdout:4/701: rmdir d7/d28/d31/d33/dbf 39 2024-02-16T22:19:20.680 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-16T22:19:20.680 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-16T22:19:20.685 INFO:tasks.workunit.client.1.smithi173.stdout:7/715: dwrite d1/f41 [0,4194304] 0 2024-02-16T22:19:20.686 INFO:tasks.workunit.client.1.smithi173.stdout:5/842: mkdir d8/da/d1b/d57/d105 0 2024-02-16T22:19:20.686 INFO:tasks.workunit.client.1.smithi173.stdout:4/702: mknod d7/ced 0 2024-02-16T22:19:20.689 INFO:tasks.workunit.client.1.smithi173.stdout:7/716: creat d1/d1d/d4c/d63/d13/d36/d49/fe4 x:0 0 0 2024-02-16T22:19:20.690 INFO:tasks.workunit.client.1.smithi173.stdout:5/843: rename d8/d27/d35/f6c to d8/da/d1b/d57/dde/f106 0 2024-02-16T22:19:20.691 INFO:tasks.workunit.client.1.smithi173.stdout:4/703: creat d7/d12/dda/fee x:0 0 0 2024-02-16T22:19:20.691 INFO:tasks.workunit.client.1.smithi173.stdout:4/704: chown d7/d28/d31/f3b 8 1 2024-02-16T22:19:20.692 INFO:tasks.workunit.client.1.smithi173.stdout:7/717: symlink d1/d1d/d4c/d91/db7/le5 0 2024-02-16T22:19:20.692 INFO:tasks.workunit.client.1.smithi173.stdout:7/718: chown d1/f9 150361 1 2024-02-16T22:19:20.693 INFO:tasks.workunit.client.1.smithi173.stdout:5/844: symlink d8/da/l107 0 2024-02-16T22:19:20.693 INFO:tasks.workunit.client.1.smithi173.stdout:5/845: write d8/da/d1b/d57/f75 [743034,26213] 0 2024-02-16T22:19:20.694 INFO:tasks.workunit.client.1.smithi173.stdout:4/705: unlink d7/d28/d31/d33/f85 0 2024-02-16T22:19:20.695 INFO:tasks.workunit.client.1.smithi173.stdout:7/719: mkdir d1/d1d/d4c/d63/d48/d9a/de6 0 2024-02-16T22:19:20.696 INFO:tasks.workunit.client.1.smithi173.stdout:5/846: mkdir d8/da/d1b/d108 0 2024-02-16T22:19:20.698 INFO:tasks.workunit.client.1.smithi173.stdout:4/706: creat d7/df/d8b/fef x:0 0 0 2024-02-16T22:19:20.698 INFO:tasks.workunit.client.1.smithi173.stdout:4/707: getdents d7/df/d62/dd8/dde 0 2024-02-16T22:19:20.698 INFO:tasks.workunit.client.1.smithi173.stdout:4/708: truncate d7/d12/f17 4466179 0 2024-02-16T22:19:20.699 INFO:tasks.workunit.client.1.smithi173.stdout:4/709: mknod d7/d28/d31/d33/d7d/d4e/cf0 0 2024-02-16T22:19:20.700 INFO:tasks.workunit.client.1.smithi173.stdout:4/710: readlink d7/d12/d7e/l88 0 2024-02-16T22:19:20.701 INFO:tasks.workunit.client.1.smithi173.stdout:4/711: link d7/d28/l41 d7/d28/d31/d72/d93/d95/db4/lf1 0 2024-02-16T22:19:20.702 INFO:tasks.workunit.client.1.smithi173.stdout:4/712: rmdir d7/d28/d31/d33/dbf 39 2024-02-16T22:19:20.703 INFO:tasks.workunit.client.1.smithi173.stdout:4/713: dread d7/d28/d31/f77 [0,4194304] 0 2024-02-16T22:19:20.704 INFO:tasks.workunit.client.1.smithi173.stdout:4/714: symlink d7/d28/d31/d33/d7d/d3d/lf2 0 2024-02-16T22:19:20.705 INFO:tasks.workunit.client.1.smithi173.stdout:4/715: mkdir d7/d28/d31/d33/d7d/d4e/dd7/dec/df3 0 2024-02-16T22:19:20.706 INFO:tasks.workunit.client.1.smithi173.stdout:4/716: chown d7/d28/l41 302 1 2024-02-16T22:19:20.709 INFO:tasks.workunit.client.1.smithi173.stdout:7/720: dread d1/d1d/d4c/d63/d13/d22/d7e/db5/fc9 [0,4194304] 0 2024-02-16T22:19:20.716 INFO:tasks.workunit.client.1.smithi173.stdout:4/717: write d7/d28/f75 [2721424,42003] 0 2024-02-16T22:19:20.716 INFO:tasks.workunit.client.1.smithi173.stdout:5/847: dwrite d8/da/d1b/d57/dc9/d92/dbc/fdc [0,4194304] 0 2024-02-16T22:19:20.717 INFO:tasks.workunit.client.1.smithi173.stdout:5/848: creat d8/da/d2d/d3a/f109 x:0 0 0 2024-02-16T22:19:20.718 INFO:tasks.workunit.client.1.smithi173.stdout:4/718: mkdir d7/d28/d31/d33/dca/df4 0 2024-02-16T22:19:20.721 INFO:tasks.workunit.client.1.smithi173.stdout:5/849: write d8/da/d1b/d57/dc9/d92/fca [942539,79350] 0 2024-02-16T22:19:20.735 INFO:tasks.workunit.client.1.smithi173.stdout:4/719: write d7/d28/d31/d33/d7d/d45/f79 [589723,15055] 0 2024-02-16T22:19:20.737 INFO:tasks.workunit.client.1.smithi173.stdout:4/720: creat d7/d28/d31/d33/d7d/d4e/dd7/dec/df3/ff5 x:0 0 0 2024-02-16T22:19:20.744 INFO:tasks.workunit.client.1.smithi173.stdout:0/688: sync 2024-02-16T22:19:20.744 INFO:tasks.workunit.client.1.smithi173.stdout:1/771: sync 2024-02-16T22:19:20.744 INFO:tasks.workunit.client.1.smithi173.stdout:1/772: chown db/d1c/d25/d28/d3f/cd9 0 1 2024-02-16T22:19:20.745 INFO:tasks.workunit.client.1.smithi173.stdout:5/850: dwrite d8/da/d1b/d57/dc9/d92/dbc/fdc [0,4194304] 0 2024-02-16T22:19:20.745 INFO:tasks.workunit.client.1.smithi173.stdout:7/721: dwrite d1/d1d/d4c/d63/d13/d36/d49/f7f [0,4194304] 0 2024-02-16T22:19:20.745 INFO:tasks.workunit.client.1.smithi173.stdout:7/722: readlink d1/d1d/d4c/d63/d13/d36/d49/la4 0 2024-02-16T22:19:20.745 INFO:tasks.workunit.client.1.smithi173.stdout:1/773: fsync db/d29/d57/f71 0 2024-02-16T22:19:20.748 INFO:tasks.workunit.client.1.smithi173.stdout:0/689: dread d0/d12/d15/d3d/d98/d14/d24/d32/d39/f2c [0,4194304] 0 2024-02-16T22:19:20.748 INFO:tasks.workunit.client.1.smithi173.stdout:0/690: chown d0/c5d 1141865 1 2024-02-16T22:19:20.748 INFO:tasks.workunit.client.1.smithi173.stdout:0/691: creat d0/d12/d15/d3d/d98/d14/d24/d5f/fe8 x:0 0 0 2024-02-16T22:19:20.753 INFO:tasks.workunit.client.1.smithi173.stdout:0/692: rename d0/d12/d15/d99/la9 to d0/d12/d15/d3d/d98/d14/d24/d70/le9 0 2024-02-16T22:19:20.753 INFO:tasks.workunit.client.1.smithi173.stdout:0/693: write d0/d12/d15/d3d/d98/d14/d24/d32/d39/f2c [1129373,47708] 0 2024-02-16T22:19:20.757 INFO:tasks.workunit.client.1.smithi173.stdout:0/694: dread d0/d12/d15/d3d/d98/f7 [0,4194304] 0 2024-02-16T22:19:20.759 INFO:tasks.workunit.client.1.smithi173.stdout:0/695: creat d0/d12/d15/d3d/d98/fea x:0 0 0 2024-02-16T22:19:20.766 INFO:tasks.workunit.client.1.smithi173.stdout:3/867: sync 2024-02-16T22:19:20.767 INFO:tasks.workunit.client.1.smithi173.stdout:8/908: sync 2024-02-16T22:19:20.767 INFO:tasks.workunit.client.1.smithi173.stdout:9/725: sync 2024-02-16T22:19:20.767 INFO:tasks.workunit.client.1.smithi173.stdout:9/726: creat d1/d5f/d6d/d91/fea x:0 0 0 2024-02-16T22:19:20.767 INFO:tasks.workunit.client.1.smithi173.stdout:2/727: sync 2024-02-16T22:19:20.767 INFO:tasks.workunit.client.1.smithi173.stdout:6/769: sync 2024-02-16T22:19:20.767 INFO:tasks.workunit.client.1.smithi173.stdout:2/728: write d2/d4/d8/d30/d44/d81/d99/fc0 [528621,75491] 0 2024-02-16T22:19:20.768 INFO:tasks.workunit.client.1.smithi173.stdout:3/868: creat d9/d1a/d2b/d4d/d5b/f12a x:0 0 0 2024-02-16T22:19:20.768 INFO:tasks.workunit.client.1.smithi173.stdout:3/869: stat d9/d17/d93/f109 0 2024-02-16T22:19:20.768 INFO:tasks.workunit.client.1.smithi173.stdout:3/870: fdatasync d9/f7c 0 2024-02-16T22:19:20.768 INFO:tasks.workunit.client.1.smithi173.stdout:3/871: readlink d9/d17/d93/lfa 0 2024-02-16T22:19:20.769 INFO:tasks.workunit.client.1.smithi173.stdout:6/770: mknod d0/db/c114 0 2024-02-16T22:19:20.770 INFO:tasks.workunit.client.1.smithi173.stdout:2/729: rename d2/dc/d19/d69/dab/fd2 to d2/dc/d19/d1a/d74/ff7 0 2024-02-16T22:19:20.771 INFO:tasks.workunit.client.1.smithi173.stdout:0/696: write d0/f10 [1531071,97031] 0 2024-02-16T22:19:20.771 INFO:tasks.workunit.client.1.smithi173.stdout:3/872: unlink d9/d1a/d2b/d4d/d5b/da9/db4/fdb 0 2024-02-16T22:19:20.772 INFO:tasks.workunit.client.1.smithi173.stdout:2/730: getdents d2/d4/d8/d30/d44/d83 0 2024-02-16T22:19:20.773 INFO:tasks.workunit.client.1.smithi173.stdout:0/697: unlink d0/d12/d15/d3d/d98/d33/ccc 0 2024-02-16T22:19:20.773 INFO:tasks.workunit.client.1.smithi173.stdout:0/698: truncate d0/d12/d15/d3d/db5/dbf/f9c 898536 0 2024-02-16T22:19:20.774 INFO:tasks.workunit.client.1.smithi173.stdout:0/699: getdents d0/d12 0 2024-02-16T22:19:20.774 INFO:tasks.workunit.client.1.smithi173.stdout:0/700: mkdir d0/d12/d15/d3d/deb 0 2024-02-16T22:19:20.776 INFO:tasks.workunit.client.1.smithi173.stdout:0/701: rename d0/d12/d15/d3d/d98/d14/d24/l31 to d0/d12/d15/d3d/d98/d33/d54/lec 0 2024-02-16T22:19:20.776 INFO:tasks.workunit.client.1.smithi173.stdout:0/702: write d0/d12/d15/d3d/d98/d14/d38/fe6 [1018246,110497] 0 2024-02-16T22:19:20.776 INFO:tasks.workunit.client.1.smithi173.stdout:0/703: dread - d0/d12/d15/d3d/d98/d14/d24/d2e/fd6 zero size 2024-02-16T22:19:20.777 INFO:tasks.workunit.client.1.smithi173.stdout:0/704: symlink d0/d12/d15/d86/led 0 2024-02-16T22:19:20.778 INFO:tasks.workunit.client.1.smithi173.stdout:0/705: mknod d0/d12/d15/d3d/d98/d14/d24/d5f/cee 0 2024-02-16T22:19:20.778 INFO:tasks.workunit.client.1.smithi173.stdout:0/706: truncate d0/d12/d15/d3d/d98/d14/d50/f76 1596237 0 2024-02-16T22:19:20.778 INFO:tasks.workunit.client.1.smithi173.stdout:0/707: chown d0/d12/d15/d3d/d98/d14/d24/l36 191 1 2024-02-16T22:19:20.778 INFO:tasks.workunit.client.1.smithi173.stdout:0/708: chown d0/d12/d15/d3d/l7a 659611 1 2024-02-16T22:19:20.778 INFO:tasks.workunit.client.1.smithi173.stdout:9/727: read d1/f30 [412444,11281] 0 2024-02-16T22:19:20.779 INFO:tasks.workunit.client.1.smithi173.stdout:0/709: mknod d0/d12/d15/d3d/d98/d14/d24/ddd/cef 0 2024-02-16T22:19:20.779 INFO:tasks.workunit.client.1.smithi173.stdout:0/710: truncate d0/d12/d15/d3d/d98/d14/d24/d32/fb4 496435 0 2024-02-16T22:19:20.779 INFO:tasks.workunit.client.1.smithi173.stdout:2/731: dread d2/dc/d19/d1c/d53/fb1 [0,4194304] 0 2024-02-16T22:19:20.779 INFO:tasks.workunit.client.1.smithi173.stdout:3/873: write d9/d17/d25/f46 [1932593,42981] 0 2024-02-16T22:19:20.780 INFO:tasks.workunit.client.1.smithi173.stdout:3/874: truncate d9/d18/d73/fc8 2302852 0 2024-02-16T22:19:20.782 INFO:tasks.workunit.client.1.smithi173.stdout:0/711: write d0/d12/d15/d3d/d98/f2a [3834329,26411] 0 2024-02-16T22:19:20.782 INFO:tasks.workunit.client.1.smithi173.stdout:0/712: readlink d0/d12/d15/d3d/d98/d14/d24/d32/l59 0 2024-02-16T22:19:20.785 INFO:tasks.workunit.client.1.smithi173.stdout:6/771: write d0/db/d2e/d61/fd2 [2242302,8164] 0 2024-02-16T22:19:20.788 INFO:tasks.workunit.client.1.smithi173.stdout:6/772: link d0/f18 d0/db/f115 0 2024-02-16T22:19:20.789 INFO:tasks.workunit.client.1.smithi173.stdout:6/773: mkdir d0/db/d2e/d65/db8/de1/d116 0 2024-02-16T22:19:20.789 INFO:tasks.workunit.client.1.smithi173.stdout:6/774: fsync d0/db/d2e/d2f/da6/f104 0 2024-02-16T22:19:20.789 INFO:tasks.workunit.client.1.smithi173.stdout:6/775: chown d0/d7c/dc5/d92/fe4 15322000 1 2024-02-16T22:19:20.790 INFO:tasks.workunit.client.1.smithi173.stdout:6/776: symlink d0/db/d4d/l117 0 2024-02-16T22:19:20.791 INFO:tasks.workunit.client.1.smithi173.stdout:6/777: write d0/db/d2e/d65/d73/fcc [1068848,18048] 0 2024-02-16T22:19:20.791 INFO:tasks.workunit.client.1.smithi173.stdout:6/778: rmdir d0/db/d2e/d65/d73/da9 39 2024-02-16T22:19:20.793 INFO:tasks.workunit.client.1.smithi173.stdout:6/779: mkdir d0/db/d2e/d65/d118 0 2024-02-16T22:19:20.794 INFO:tasks.workunit.client.1.smithi173.stdout:1/774: dwrite db/d1d/f1e [0,4194304] 0 2024-02-16T22:19:20.795 INFO:tasks.workunit.client.1.smithi173.stdout:1/775: chown db/d1c/d25/d28/fc9 0 1 2024-02-16T22:19:20.795 INFO:tasks.workunit.client.1.smithi173.stdout:6/780: link d0/db/d2e/d65/l68 d0/db/d2e/d61/l119 0 2024-02-16T22:19:20.795 INFO:tasks.workunit.client.1.smithi173.stdout:3/875: dread d9/d18/d5f/d6e/d4e/f99 [0,4194304] 0 2024-02-16T22:19:20.796 INFO:tasks.workunit.client.1.smithi173.stdout:9/728: write d1/d2/d10/f46 [1124888,43473] 0 2024-02-16T22:19:20.796 INFO:tasks.workunit.client.1.smithi173.stdout:5/851: dwrite d8/da/d2d/d36/d50/fe3 [0,4194304] 0 2024-02-16T22:19:20.796 INFO:tasks.workunit.client.1.smithi173.stdout:5/852: write d8/da/d1b/f90 [4910422,20769] 0 2024-02-16T22:19:20.800 INFO:tasks.workunit.client.1.smithi173.stdout:6/781: creat d0/db/d2e/d65/f11a x:0 0 0 2024-02-16T22:19:20.801 INFO:tasks.workunit.client.1.smithi173.stdout:2/732: dread d2/d4/f59 [0,4194304] 0 2024-02-16T22:19:20.808 INFO:tasks.workunit.client.1.smithi173.stdout:0/713: write d0/d84/d8c/f97 [3904096,19792] 0 2024-02-16T22:19:20.810 INFO:tasks.workunit.client.1.smithi173.stdout:1/776: rmdir db/d29/d8f 39 2024-02-16T22:19:20.813 INFO:tasks.workunit.client.1.smithi173.stdout:9/729: write d1/d2/d1a/d1f/f4d [1938333,51322] 0 2024-02-16T22:19:20.813 INFO:tasks.workunit.client.1.smithi173.stdout:9/730: fdatasync d1/d2/d1a/d1f/d34/f55 0 2024-02-16T22:19:20.813 INFO:tasks.workunit.client.1.smithi173.stdout:6/782: creat d0/db/d2e/d65/d73/da9/f11b x:0 0 0 2024-02-16T22:19:20.817 INFO:tasks.workunit.client.1.smithi173.stdout:5/853: symlink d8/da/d1f/d30/l10a 0 2024-02-16T22:19:20.821 INFO:tasks.workunit.client.1.smithi173.stdout:9/731: dread d1/d5f/d6d/f8a [0,4194304] 0 2024-02-16T22:19:20.821 INFO:tasks.workunit.client.1.smithi173.stdout:9/732: fdatasync d1/d2/d1a/d2f/d3b/f7c 0 2024-02-16T22:19:20.822 INFO:tasks.workunit.client.1.smithi173.stdout:1/777: mkdir db/d29/d83/d108 0 2024-02-16T22:19:20.822 INFO:tasks.workunit.client.1.smithi173.stdout:1/778: readlink db/d29/d57/l100 0 2024-02-16T22:19:20.822 INFO:tasks.workunit.client.1.smithi173.stdout:1/779: fdatasync db/d29/d57/f71 0 2024-02-16T22:19:20.824 INFO:tasks.workunit.client.1.smithi173.stdout:6/783: symlink d0/db/d2e/d65/d73/d7d/l11c 0 2024-02-16T22:19:20.824 INFO:tasks.workunit.client.1.smithi173.stdout:6/784: write d0/db/d2e/d65/db8/feb [865522,56093] 0 2024-02-16T22:19:20.826 INFO:tasks.workunit.client.1.smithi173.stdout:5/854: mknod d8/da/d2d/d56/c10b 0 2024-02-16T22:19:20.827 INFO:tasks.workunit.client.1.smithi173.stdout:4/721: dwrite d7/d28/d31/d33/d7d/d4e/fa4 [0,4194304] 0 2024-02-16T22:19:20.827 INFO:tasks.workunit.client.1.smithi173.stdout:4/722: write d7/d12/f96 [5196581,116085] 0 2024-02-16T22:19:20.829 INFO:tasks.workunit.client.1.smithi173.stdout:6/785: creat d0/db/d2e/d2f/f11d x:0 0 0 2024-02-16T22:19:20.833 INFO:tasks.workunit.client.1.smithi173.stdout:4/723: mknod d7/d28/d52/cf6 0 2024-02-16T22:19:20.833 INFO:tasks.workunit.client.1.smithi173.stdout:4/724: stat d7/fb5 0 2024-02-16T22:19:20.833 INFO:tasks.workunit.client.1.smithi173.stdout:4/725: stat d7/d28/d14/c6e 0 2024-02-16T22:19:20.835 INFO:tasks.workunit.client.1.smithi173.stdout:6/786: unlink d0/db/fbf 0 2024-02-16T22:19:20.836 INFO:tasks.workunit.client.1.smithi173.stdout:6/787: truncate d0/db/d2e/f37 2703084 0 2024-02-16T22:19:20.838 INFO:tasks.workunit.client.1.smithi173.stdout:6/788: mknod d0/db/d4d/d109/c11e 0 2024-02-16T22:19:20.839 INFO:tasks.workunit.client.1.smithi173.stdout:6/789: rename d0/db/c49 to d0/db/d2e/d65/d9f/d10b/c11f 0 2024-02-16T22:19:20.840 INFO:tasks.workunit.client.1.smithi173.stdout:5/855: write d8/da/d2d/d3a/f82 [3054838,84591] 0 2024-02-16T22:19:20.840 INFO:tasks.workunit.client.1.smithi173.stdout:5/856: chown d8/f6a 1 1 2024-02-16T22:19:20.842 INFO:tasks.workunit.client.1.smithi173.stdout:5/857: creat d8/da/d2d/d3a/da7/de7/f10c x:0 0 0 2024-02-16T22:19:20.844 INFO:tasks.workunit.client.1.smithi173.stdout:5/858: getdents d8/d27/d2f 0 2024-02-16T22:19:20.846 INFO:tasks.workunit.client.1.smithi173.stdout:5/859: symlink d8/da/d2d/d3a/da7/de7/l10d 0 2024-02-16T22:19:20.848 INFO:tasks.workunit.client.1.smithi173.stdout:5/860: truncate d8/da/d1f/d30/f59 4150348 0 2024-02-16T22:19:20.851 INFO:tasks.workunit.client.1.smithi173.stdout:5/861: truncate d8/da/d1b/d57/dc9/d92/fca 2184145 0 2024-02-16T22:19:20.851 INFO:tasks.workunit.client.1.smithi173.stdout:5/862: readlink d8/d27/d62/l8e 0 2024-02-16T22:19:20.852 INFO:tasks.workunit.client.1.smithi173.stdout:3/876: dwrite d9/d1a/d2b/d4d/d118/f11c [0,4194304] 0 2024-02-16T22:19:20.853 INFO:tasks.workunit.client.1.smithi173.stdout:6/790: write d0/db/d2e/d2f/d31/f39 [849596,62879] 0 2024-02-16T22:19:20.857 INFO:tasks.workunit.client.1.smithi173.stdout:5/863: mknod d8/da/c10e 0 2024-02-16T22:19:20.862 INFO:tasks.workunit.client.1.smithi173.stdout:2/733: dwrite d2/d4/d8/d30/f3b [0,4194304] 0 2024-02-16T22:19:20.862 INFO:tasks.workunit.client.1.smithi173.stdout:2/734: fdatasync d2/d4/d8/d30/d44/d83/f94 0 2024-02-16T22:19:20.862 INFO:tasks.workunit.client.1.smithi173.stdout:2/735: readlink d2/d10/lb6 0 2024-02-16T22:19:20.862 INFO:tasks.workunit.client.1.smithi173.stdout:2/736: getdents d2/dc/d5d/dd8 0 2024-02-16T22:19:20.862 INFO:tasks.workunit.client.1.smithi173.stdout:0/714: dwrite d0/d12/d15/d3d/d98/fea [0,4194304] 0 2024-02-16T22:19:20.862 INFO:tasks.workunit.client.1.smithi173.stdout:0/715: write d0/d12/d15/d3d/d98/d27/fd9 [840622,85387] 0 2024-02-16T22:19:20.862 INFO:tasks.workunit.client.1.smithi173.stdout:1/780: dwrite db/d1c/f6b [0,4194304] 0 2024-02-16T22:19:20.867 INFO:tasks.workunit.client.1.smithi173.stdout:2/737: dread d2/dc/f2b [0,4194304] 0 2024-02-16T22:19:20.867 INFO:tasks.workunit.client.1.smithi173.stdout:5/864: rename d8/da/d1b/d57/f75 to d8/da/d1b/d57/f10f 0 2024-02-16T22:19:20.867 INFO:tasks.workunit.client.1.smithi173.stdout:6/791: dread d0/db/f29 [0,4194304] 0 2024-02-16T22:19:20.867 INFO:tasks.workunit.client.1.smithi173.stdout:6/792: write d0/db/f72 [816569,25478] 0 2024-02-16T22:19:20.876 INFO:tasks.workunit.client.1.smithi173.stdout:2/738: write d2/dc/d5d/d7a/f8f [666904,86420] 0 2024-02-16T22:19:20.878 INFO:tasks.workunit.client.1.smithi173.stdout:1/781: mkdir db/d1d/dcf/d109 0 2024-02-16T22:19:20.887 INFO:tasks.workunit.client.1.smithi173.stdout:6/793: link d0/d7c/f102 d0/d7c/dc5/f120 0 2024-02-16T22:19:20.887 INFO:tasks.workunit.client.1.smithi173.stdout:1/782: dread db/d1c/d25/d28/d3f/f4e [0,4194304] 0 2024-02-16T22:19:20.887 INFO:tasks.workunit.client.1.smithi173.stdout:1/783: stat db/d1c/d25 0 2024-02-16T22:19:20.888 INFO:tasks.workunit.client.1.smithi173.stdout:0/716: rmdir d0/d12/d15/d3d/d98/d14/d24/d32 39 2024-02-16T22:19:20.888 INFO:tasks.workunit.client.1.smithi173.stdout:0/717: fsync d0/d84/fb6 0 2024-02-16T22:19:20.889 INFO:tasks.workunit.client.1.smithi173.stdout:1/784: write db/d29/d8f/f93 [67869,39952] 0 2024-02-16T22:19:20.889 INFO:tasks.workunit.client.1.smithi173.stdout:1/785: write db/d1c/d25/d45/fa7 [581520,84002] 0 2024-02-16T22:19:20.890 INFO:tasks.workunit.client.1.smithi173.stdout:1/786: chown db/f75 1350 1 2024-02-16T22:19:20.890 INFO:tasks.workunit.client.1.smithi173.stdout:2/739: rmdir d2/dc/d19/d1c/d53/df0 0 2024-02-16T22:19:20.890 INFO:tasks.workunit.client.1.smithi173.stdout:0/718: creat d0/d12/d15/d3d/d98/d14/d24/d32/d39/ff0 x:0 0 0 2024-02-16T22:19:20.890 INFO:tasks.workunit.client.1.smithi173.stdout:0/719: chown d0/d12/d15/d3d/fa1 3684552 1 2024-02-16T22:19:20.891 INFO:tasks.workunit.client.1.smithi173.stdout:1/787: mkdir db/d29/d83/d10a 0 2024-02-16T22:19:20.892 INFO:tasks.workunit.client.1.smithi173.stdout:2/740: rmdir d2/d4/d8/d30/d44 39 2024-02-16T22:19:20.892 INFO:tasks.workunit.client.1.smithi173.stdout:2/741: chown d2/d4/d8/d80/c92 55108 1 2024-02-16T22:19:20.892 INFO:tasks.workunit.client.1.smithi173.stdout:2/742: read d2/dc/d19/d1a/fc2 [151478,55099] 0 2024-02-16T22:19:20.894 INFO:tasks.workunit.client.1.smithi173.stdout:0/720: getdents d0/d12/d15/d3d/d98/d14/d50 0 2024-02-16T22:19:20.894 INFO:tasks.workunit.client.1.smithi173.stdout:0/721: fsync d0/f5 0 2024-02-16T22:19:20.894 INFO:tasks.workunit.client.1.smithi173.stdout:0/722: chown d0/f10 3 1 2024-02-16T22:19:20.894 INFO:tasks.workunit.client.1.smithi173.stdout:0/723: write d0/d12/d15/d3d/d98/d14/d24/d32/fb4 [1098649,109909] 0 2024-02-16T22:19:20.894 INFO:tasks.workunit.client.1.smithi173.stdout:0/724: fdatasync d0/d12/d15/d3d/d98/d33/f3c 0 2024-02-16T22:19:20.894 INFO:tasks.workunit.client.1.smithi173.stdout:0/725: stat d0/f95 0 2024-02-16T22:19:20.894 INFO:tasks.workunit.client.1.smithi173.stdout:1/788: chown db/d29/d57/c8e 62958 1 2024-02-16T22:19:20.896 INFO:tasks.workunit.client.1.smithi173.stdout:4/726: dread d7/d28/d52/d89/fb9 [0,4194304] 0 2024-02-16T22:19:20.898 INFO:tasks.workunit.client.1.smithi173.stdout:2/743: mknod d2/d4/d8/d30/d44/d81/cf8 0 2024-02-16T22:19:20.898 INFO:tasks.workunit.client.1.smithi173.stdout:2/744: chown d2/d4/d8/d30/d44/d81/d99/la0 748062761 1 2024-02-16T22:19:20.898 INFO:tasks.workunit.client.1.smithi173.stdout:9/733: dwrite d1/d2/d1a/d2f/f8e [0,4194304] 0 2024-02-16T22:19:20.900 INFO:tasks.workunit.client.1.smithi173.stdout:9/734: write d1/f5a [137166,52359] 0 2024-02-16T22:19:20.900 INFO:tasks.workunit.client.1.smithi173.stdout:6/794: dread d0/db/d2e/f30 [0,4194304] 0 2024-02-16T22:19:20.900 INFO:tasks.workunit.client.1.smithi173.stdout:6/795: fsync d0/db/d2e/f56 0 2024-02-16T22:19:20.900 INFO:tasks.workunit.client.1.smithi173.stdout:2/745: creat d2/ff9 x:0 0 0 2024-02-16T22:19:20.900 INFO:tasks.workunit.client.1.smithi173.stdout:2/746: chown d2/d10/d62/lbf 621468 1 2024-02-16T22:19:20.906 INFO:tasks.workunit.client.1.smithi173.stdout:5/865: dwrite d8/da/d1f/db7/ff2 [0,4194304] 0 2024-02-16T22:19:20.907 INFO:tasks.workunit.client.1.smithi173.stdout:6/796: symlink d0/db/d2e/d65/d67/d10f/l121 0 2024-02-16T22:19:20.907 INFO:tasks.workunit.client.1.smithi173.stdout:6/797: fdatasync d0/db/d2e/d61/fd2 0 2024-02-16T22:19:20.909 INFO:tasks.workunit.client.1.smithi173.stdout:0/726: dread d0/d12/d15/d3d/d98/d27/f57 [4194304,4194304] 0 2024-02-16T22:19:20.909 INFO:tasks.workunit.client.1.smithi173.stdout:2/747: truncate d2/d4/f70 1932187 0 2024-02-16T22:19:20.913 INFO:tasks.workunit.client.1.smithi173.stdout:5/866: dread d8/f26 [0,4194304] 0 2024-02-16T22:19:20.921 INFO:tasks.workunit.client.1.smithi173.stdout:1/789: dwrite db/d1c/d25/d28/d3f/d4a/fc4 [0,4194304] 0 2024-02-16T22:19:20.921 INFO:tasks.workunit.client.1.smithi173.stdout:1/790: chown db/d1c/d7f/cb9 17 1 2024-02-16T22:19:20.935 INFO:tasks.workunit.client.1.smithi173.stdout:5/867: truncate d8/da/d2d/d36/d50/fe1 524886 0 2024-02-16T22:19:20.938 INFO:tasks.workunit.client.1.smithi173.stdout:1/791: creat db/d29/d50/f10b x:0 0 0 2024-02-16T22:19:20.939 INFO:tasks.workunit.client.1.smithi173.stdout:1/792: fdatasync db/d1c/d7f/d98/fea 0 2024-02-16T22:19:20.940 INFO:tasks.workunit.client.1.smithi173.stdout:1/793: symlink db/d1d/dcf/d109/l10c 0 2024-02-16T22:19:20.943 INFO:tasks.workunit.client.1.smithi173.stdout:1/794: rename db/d29/d57/fc3 to db/d29/db5/d105/f10d 0 2024-02-16T22:19:20.945 INFO:tasks.workunit.client.1.smithi173.stdout:4/727: dwrite d7/df/fe8 [0,4194304] 0 2024-02-16T22:19:20.945 INFO:tasks.workunit.client.1.smithi173.stdout:9/735: dwrite d1/d2/d10/f2e [0,4194304] 0 2024-02-16T22:19:20.946 INFO:tasks.workunit.client.1.smithi173.stdout:0/727: dwrite d0/d12/d15/d3d/d98/d14/d24/d2e/fe2 [0,4194304] 0 2024-02-16T22:19:20.947 INFO:tasks.workunit.client.1.smithi173.stdout:4/728: link d7/d9a/fa9 d7/d12/dda/ff7 0 2024-02-16T22:19:20.948 INFO:tasks.workunit.client.1.smithi173.stdout:9/736: mknod d1/d2/d1a/d2f/d3b/d75/db1/ceb 0 2024-02-16T22:19:20.950 INFO:tasks.workunit.client.1.smithi173.stdout:0/728: symlink d0/d12/d15/d3d/d98/d14/d50/lf1 0 2024-02-16T22:19:20.952 INFO:tasks.workunit.client.1.smithi173.stdout:0/729: link d0/d12/d15/d3d/d98/d14/d24/l9b d0/d12/d15/d3d/d98/d14/d24/ddd/lf2 0 2024-02-16T22:19:20.953 INFO:tasks.workunit.client.1.smithi173.stdout:0/730: write d0/d12/d15/d4f/d92/fbe [455420,11078] 0 2024-02-16T22:19:20.953 INFO:tasks.workunit.client.1.smithi173.stdout:0/731: fsync d0/d12/d15/d3d/d98/d14/d24/d32/d39/f2c 0 2024-02-16T22:19:20.960 INFO:tasks.workunit.client.1.smithi173.stdout:2/748: dwrite d2/d4/d8/d30/f37 [0,4194304] 0 2024-02-16T22:19:20.960 INFO:tasks.workunit.client.1.smithi173.stdout:2/749: getdents d2/d4/d57/dc8 0 2024-02-16T22:19:20.962 INFO:tasks.workunit.client.1.smithi173.stdout:2/750: getdents d2/d4 0 2024-02-16T22:19:20.962 INFO:tasks.workunit.client.1.smithi173.stdout:2/751: write d2/ff9 [979658,12200] 0 2024-02-16T22:19:20.963 INFO:tasks.workunit.client.1.smithi173.stdout:4/729: dwrite d7/d12/d7e/fc8 [0,4194304] 0 2024-02-16T22:19:20.963 INFO:tasks.workunit.client.1.smithi173.stdout:5/868: dwrite d8/da/d1f/f51 [0,4194304] 0 2024-02-16T22:19:20.963 INFO:tasks.workunit.client.1.smithi173.stdout:5/869: chown d8/d27/d35/d8b 5311539 1 2024-02-16T22:19:20.966 INFO:tasks.workunit.client.1.smithi173.stdout:4/730: mkdir d7/d28/d31/d33/dcb/df8 0 2024-02-16T22:19:20.966 INFO:tasks.workunit.client.1.smithi173.stdout:4/731: chown d7/d28/d31/d33/d7d/d4e/dd7/dec 124828 1 2024-02-16T22:19:20.968 INFO:tasks.workunit.client.1.smithi173.stdout:4/732: mkdir d7/df9 0 2024-02-16T22:19:20.969 INFO:tasks.workunit.client.1.smithi173.stdout:2/752: dread d2/dc/d19/d1a/f34 [0,4194304] 0 2024-02-16T22:19:20.970 INFO:tasks.workunit.client.1.smithi173.stdout:5/870: rmdir d8/da/d1b 39 2024-02-16T22:19:20.972 INFO:tasks.workunit.client.1.smithi173.stdout:0/732: dwrite d0/d12/d15/d3d/d98/d14/d24/d32/f66 [0,4194304] 0 2024-02-16T22:19:20.972 INFO:tasks.workunit.client.1.smithi173.stdout:0/733: readlink d0/d12/d15/d3d/d98/d14/lb0 0 2024-02-16T22:19:20.972 INFO:tasks.workunit.client.1.smithi173.stdout:5/871: mknod d8/da/d2d/c110 0 2024-02-16T22:19:20.974 INFO:tasks.workunit.client.1.smithi173.stdout:0/734: mknod d0/d12/d15/d3d/d98/d33/dc2/cf3 0 2024-02-16T22:19:20.995 INFO:tasks.workunit.client.1.smithi173.stdout:0/735: dwrite d0/d12/d15/d3d/d98/d33/d54/f5c [0,4194304] 0 2024-02-16T22:19:20.998 INFO:tasks.workunit.client.1.smithi173.stdout:2/753: dwrite d2/dc/d19/f29 [0,4194304] 0 2024-02-16T22:19:20.999 INFO:tasks.workunit.client.1.smithi173.stdout:0/736: creat d0/d12/ff4 x:0 0 0 2024-02-16T22:19:20.999 INFO:tasks.workunit.client.1.smithi173.stdout:4/733: dwrite d7/dd5/fae [0,4194304] 0 2024-02-16T22:19:21.005 INFO:tasks.workunit.client.1.smithi173.stdout:2/754: creat d2/d10/d62/d6c/ffa x:0 0 0 2024-02-16T22:19:21.005 INFO:tasks.workunit.client.1.smithi173.stdout:2/755: dread - d2/d4/d8/d80/fce zero size 2024-02-16T22:19:21.005 INFO:tasks.workunit.client.1.smithi173.stdout:2/756: fsync d2/dc/d19/d1a/fc6 0 2024-02-16T22:19:21.005 INFO:tasks.workunit.client.1.smithi173.stdout:2/757: chown d2/d10/d62 5 1 2024-02-16T22:19:21.005 INFO:tasks.workunit.client.1.smithi173.stdout:2/758: readlink d2/d10/d62/l67 0 2024-02-16T22:19:21.005 INFO:tasks.workunit.client.1.smithi173.stdout:2/759: write d2/dc/d19/d1c/f9c [705917,109223] 0 2024-02-16T22:19:21.007 INFO:tasks.workunit.client.1.smithi173.stdout:0/737: rmdir d0/d12/d15/d99/de5 0 2024-02-16T22:19:21.014 INFO:tasks.workunit.client.1.smithi173.stdout:2/760: mkdir d2/dc/d19/d69/dfb 0 2024-02-16T22:19:21.016 INFO:tasks.workunit.client.1.smithi173.stdout:0/738: mkdir d0/d12/d15/d3d/d98/d14/d38/df5 0 2024-02-16T22:19:21.018 INFO:tasks.workunit.client.1.smithi173.stdout:4/734: mknod d7/d28/d31/d33/d7d/d4e/cfa 0 2024-02-16T22:19:21.018 INFO:tasks.workunit.client.1.smithi173.stdout:4/735: fdatasync d7/d28/fb2 0 2024-02-16T22:19:21.026 INFO:tasks.workunit.client.1.smithi173.stdout:2/761: stat d2/lbb 0 2024-02-16T22:19:21.027 INFO:tasks.workunit.client.1.smithi173.stdout:2/762: write d2/dc/d5d/d7a/f8f [5033383,100815] 0 2024-02-16T22:19:21.030 INFO:tasks.workunit.client.1.smithi173.stdout:0/739: link d0/d12/d15/d3d/d98/d14/f23 d0/d12/d15/d86/ff6 0 2024-02-16T22:19:21.034 INFO:tasks.workunit.client.1.smithi173.stdout:2/763: symlink d2/d4/d8/d30/lfc 0 2024-02-16T22:19:21.034 INFO:tasks.workunit.client.1.smithi173.stdout:2/764: fdatasync d2/d4/f59 0 2024-02-16T22:19:21.038 INFO:tasks.workunit.client.1.smithi173.stdout:0/740: creat d0/d12/d15/d3d/d98/d14/d24/ddd/ff7 x:0 0 0 2024-02-16T22:19:21.039 INFO:tasks.workunit.client.1.smithi173.stdout:0/741: fdatasync d0/d12/d15/d3d/d98/d14/d24/d2e/fe2 0 2024-02-16T22:19:21.042 INFO:tasks.workunit.client.1.smithi173.stdout:4/736: creat d7/d28/d31/d33/d7d/d4e/dcc/ffb x:0 0 0 2024-02-16T22:19:21.042 INFO:tasks.workunit.client.1.smithi173.stdout:4/737: fdatasync d7/d12/dda/fee 0 2024-02-16T22:19:21.044 INFO:tasks.workunit.client.1.smithi173.stdout:0/742: mknod d0/d12/d15/d3d/db5/dbf/cf8 0 2024-02-16T22:19:21.044 INFO:tasks.workunit.client.1.smithi173.stdout:0/743: truncate d0/d12/d15/d3d/d98/d14/d24/ddd/ff7 618917 0 2024-02-16T22:19:21.046 INFO:tasks.workunit.client.1.smithi173.stdout:4/738: rename d7/d28/d14/f1f to d7/d28/d31/d33/d7d/d45/ffc 0 2024-02-16T22:19:21.046 INFO:tasks.workunit.client.1.smithi173.stdout:4/739: write d7/df/d8b/da1/fe6 [965635,29014] 0 2024-02-16T22:19:21.048 INFO:tasks.workunit.client.1.smithi173.stdout:4/740: rename d7/d12/d7e/cd3 to d7/d28/d31/d72/d93/d95/db4/cfd 0 2024-02-16T22:19:21.050 INFO:tasks.workunit.client.1.smithi173.stdout:4/741: mkdir d7/d28/d31/d33/dbf/dfe 0 2024-02-16T22:19:21.051 INFO:tasks.workunit.client.1.smithi173.stdout:2/765: dwrite d2/dc/d19/d1a/f34 [0,4194304] 0 2024-02-16T22:19:21.052 INFO:tasks.workunit.client.1.smithi173.stdout:2/766: fdatasync d2/d4/d8/fe8 0 2024-02-16T22:19:21.052 INFO:tasks.workunit.client.1.smithi173.stdout:4/742: unlink d7/d28/d31/d33/fa6 0 2024-02-16T22:19:21.055 INFO:tasks.workunit.client.1.smithi173.stdout:4/743: read d7/d28/d31/d33/d7d/d3d/f6c [3258980,14375] 0 2024-02-16T22:19:21.063 INFO:tasks.workunit.client.1.smithi173.stdout:0/744: dwrite d0/d12/d15/d3d/d98/f2a [4194304,4194304] 0 2024-02-16T22:19:21.063 INFO:tasks.workunit.client.1.smithi173.stdout:0/745: chown d0/d12/d15/d3d/d98/d14/d24/d5f/fba 383566823 1 2024-02-16T22:19:21.068 INFO:tasks.workunit.client.1.smithi173.stdout:2/767: dread d2/d4/d8/d30/f3b [0,4194304] 0 2024-02-16T22:19:21.068 INFO:tasks.workunit.client.1.smithi173.stdout:2/768: chown d2/dc 177 1 2024-02-16T22:19:21.071 INFO:tasks.workunit.client.1.smithi173.stdout:0/746: dread d0/d12/d15/d3d/d98/d27/f73 [0,4194304] 0 2024-02-16T22:19:21.071 INFO:tasks.workunit.client.1.smithi173.stdout:2/769: read d2/dc/d19/d1a/f52 [304458,17223] 0 2024-02-16T22:19:21.071 INFO:tasks.workunit.client.1.smithi173.stdout:2/770: chown d2/d10/d9e 218659 1 2024-02-16T22:19:21.072 INFO:tasks.workunit.client.1.smithi173.stdout:2/771: write d2/d4/d8/d30/f45 [507080,35077] 0 2024-02-16T22:19:21.072 INFO:tasks.workunit.client.1.smithi173.stdout:2/772: fsync d2/d4/d8/fe8 0 2024-02-16T22:19:21.072 INFO:tasks.workunit.client.1.smithi173.stdout:2/773: rename d2/d4/d8 to d2/d4/d8/dfd 22 2024-02-16T22:19:21.073 INFO:tasks.workunit.client.1.smithi173.stdout:2/774: creat d2/d4/d57/d82/ffe x:0 0 0 2024-02-16T22:19:21.077 INFO:tasks.workunit.client.1.smithi173.stdout:4/744: dwrite d7/d28/f75 [0,4194304] 0 2024-02-16T22:19:21.083 INFO:tasks.workunit.client.1.smithi173.stdout:4/745: creat d7/d28/d31/d33/dca/df4/fff x:0 0 0 2024-02-16T22:19:21.084 INFO:tasks.workunit.client.1.smithi173.stdout:4/746: creat d7/df/d62/dd8/f100 x:0 0 0 2024-02-16T22:19:21.084 INFO:tasks.workunit.client.1.smithi173.stdout:2/775: write d2/dc/d5d/f6a [5957041,114786] 0 2024-02-16T22:19:21.086 INFO:tasks.workunit.client.1.smithi173.stdout:4/747: unlink d7/d28/d31/f77 0 2024-02-16T22:19:21.086 INFO:tasks.workunit.client.1.smithi173.stdout:4/748: write d7/fd9 [1842169,130076] 0 2024-02-16T22:19:21.086 INFO:tasks.workunit.client.1.smithi173.stdout:4/749: write d7/d28/d31/d33/fe1 [991075,87910] 0 2024-02-16T22:19:21.086 INFO:tasks.workunit.client.1.smithi173.stdout:0/747: dwrite d0/d12/d15/d3d/d98/d14/d24/d32/d39/f2c [0,4194304] 0 2024-02-16T22:19:21.088 INFO:tasks.workunit.client.1.smithi173.stdout:4/750: link d7/d28/f75 d7/d28/d31/d33/dca/df4/f101 0 2024-02-16T22:19:21.090 INFO:tasks.workunit.client.1.smithi173.stdout:2/776: dread d2/d4/d8/d30/d44/d81/d99/fc0 [0,4194304] 0 2024-02-16T22:19:21.091 INFO:tasks.workunit.client.1.smithi173.stdout:2/777: dread - d2/d4/d8/d2d/fb8 zero size 2024-02-16T22:19:21.094 INFO:tasks.workunit.client.1.smithi173.stdout:7/723: sync 2024-02-16T22:19:21.096 INFO:tasks.workunit.client.1.smithi173.stdout:2/778: rename d2/dc/d5d/d7a to d2/d10/d62/d6c/dcd/dff 0 2024-02-16T22:19:21.098 INFO:tasks.workunit.client.1.smithi173.stdout:2/779: link d2/d4/d8/d30/d44/d83/c9f d2/dc/d19/dc4/c100 0 2024-02-16T22:19:21.103 INFO:tasks.workunit.client.1.smithi173.stdout:2/780: unlink d2/d4/d8/d80/f72 0 2024-02-16T22:19:21.103 INFO:tasks.workunit.client.1.smithi173.stdout:2/781: chown d2/d4/d8/d80/c92 8147 1 2024-02-16T22:19:21.104 INFO:tasks.workunit.client.1.smithi173.stdout:7/724: dread d1/d1d/d4c/d63/d48/f75 [0,4194304] 0 2024-02-16T22:19:21.111 INFO:tasks.workunit.client.1.smithi173.stdout:4/751: dwrite d7/d28/d31/d33/d7d/d4e/f5a [0,4194304] 0 2024-02-16T22:19:21.111 INFO:tasks.workunit.client.1.smithi173.stdout:4/752: chown d7/d12/dda 28 1 2024-02-16T22:19:21.113 INFO:tasks.workunit.client.1.smithi173.stdout:4/753: symlink d7/d28/l102 0 2024-02-16T22:19:21.113 INFO:tasks.workunit.client.1.smithi173.stdout:4/754: readlink d7/d28/d52/l8f 0 2024-02-16T22:19:21.115 INFO:tasks.workunit.client.1.smithi173.stdout:4/755: dread d7/dd5/fe0 [0,4194304] 0 2024-02-16T22:19:21.115 INFO:tasks.workunit.client.1.smithi173.stdout:4/756: fdatasync d7/dd5/f44 0 2024-02-16T22:19:21.115 INFO:tasks.workunit.client.1.smithi173.stdout:4/757: fdatasync d7/d28/d31/d33/fe1 0 2024-02-16T22:19:21.116 INFO:tasks.workunit.client.1.smithi173.stdout:7/725: dread d1/d1d/d4c/d63/d13/d36/d49/f7f [0,4194304] 0 2024-02-16T22:19:21.118 INFO:tasks.workunit.client.1.smithi173.stdout:4/758: mkdir d7/d28/d31/d33/dca/df4/d103 0 2024-02-16T22:19:21.121 INFO:tasks.workunit.client.1.smithi173.stdout:4/759: rename d7/d28/dac to d7/df/d62/d104 0 2024-02-16T22:19:21.122 INFO:tasks.workunit.client.1.smithi173.stdout:4/760: truncate d7/d12/f2b 6731864 0 2024-02-16T22:19:21.122 INFO:tasks.workunit.client.1.smithi173.stdout:4/761: fdatasync d7/d28/d31/d33/dca/df4/fff 0 2024-02-16T22:19:21.123 INFO:tasks.workunit.client.1.smithi173.stdout:2/782: dwrite d2/dc/d19/d1a/f34 [0,4194304] 0 2024-02-16T22:19:21.123 INFO:tasks.workunit.client.1.smithi173.stdout:2/783: dread - d2/d10/d62/d6c/ffa zero size 2024-02-16T22:19:21.124 INFO:tasks.workunit.client.1.smithi173.stdout:4/762: creat d7/d28/d31/d33/dbf/f105 x:0 0 0 2024-02-16T22:19:21.126 INFO:tasks.workunit.client.1.smithi173.stdout:4/763: truncate d7/dd5/f8e 23492 0 2024-02-16T22:19:21.126 INFO:tasks.workunit.client.1.smithi173.stdout:4/764: truncate d7/d28/d31/d33/dca/df4/fff 78027 0 2024-02-16T22:19:21.127 INFO:tasks.workunit.client.1.smithi173.stdout:4/765: read d7/d12/dda/ff7 [290527,119359] 0 2024-02-16T22:19:21.132 INFO:tasks.workunit.client.1.smithi173.stdout:4/766: creat d7/d12/f106 x:0 0 0 2024-02-16T22:19:21.132 INFO:tasks.workunit.client.1.smithi173.stdout:7/726: dwrite d1/d1d/f32 [0,4194304] 0 2024-02-16T22:19:21.134 INFO:tasks.workunit.client.1.smithi173.stdout:7/727: dread d1/d1d/d4c/d63/d11/f14 [0,4194304] 0 2024-02-16T22:19:21.135 INFO:tasks.workunit.client.1.smithi173.stdout:2/784: read d2/dc/d19/d1c/d87/f8a [206161,119] 0 2024-02-16T22:19:21.141 INFO:tasks.workunit.client.1.smithi173.stdout:2/785: rmdir d2/d10/d62/d6c/dcd 39 2024-02-16T22:19:21.141 INFO:tasks.workunit.client.1.smithi173.stdout:2/786: truncate d2/d4/d8/f95 280813 0 2024-02-16T22:19:21.146 INFO:tasks.workunit.client.1.smithi173.stdout:2/787: getdents d2/d4/d8/d30/d44 0 2024-02-16T22:19:21.150 INFO:tasks.workunit.client.1.smithi173.stdout:8/909: sync 2024-02-16T22:19:21.150 INFO:tasks.workunit.client.1.smithi173.stdout:8/910: stat dd/d7c/d7d/d89/df3 0 2024-02-16T22:19:21.150 INFO:tasks.workunit.client.1.smithi173.stdout:2/788: rmdir d2/dc/d5d/dd8 0 2024-02-16T22:19:21.152 INFO:tasks.workunit.client.1.smithi173.stdout:8/911: unlink dd/d9d/db2/lda 0 2024-02-16T22:19:21.152 INFO:tasks.workunit.client.1.smithi173.stdout:2/789: symlink d2/dc/d19/d1c/d53/l101 0 2024-02-16T22:19:21.154 INFO:tasks.workunit.client.1.smithi173.stdout:2/790: rename d2/dc/d19/d1c/f68 to d2/dc/d19/d69/da5/f102 0 2024-02-16T22:19:21.158 INFO:tasks.workunit.client.1.smithi173.stdout:2/791: mknod d2/dc/c103 0 2024-02-16T22:19:21.158 INFO:tasks.workunit.client.1.smithi173.stdout:2/792: truncate d2/dc/d19/fe4 821941 0 2024-02-16T22:19:21.158 INFO:tasks.workunit.client.1.smithi173.stdout:2/793: fsync d2/dc/f2b 0 2024-02-16T22:19:21.159 INFO:tasks.workunit.client.1.smithi173.stdout:4/767: dwrite d7/dd5/f44 [4194304,4194304] 0 2024-02-16T22:19:21.160 INFO:tasks.workunit.client.1.smithi173.stdout:2/794: symlink d2/d4/d8/d30/d44/d81/d99/dda/l104 0 2024-02-16T22:19:21.160 INFO:tasks.workunit.client.1.smithi173.stdout:2/795: stat d2/d4/d8/d30/d44/d81 0 2024-02-16T22:19:21.160 INFO:tasks.workunit.client.1.smithi173.stdout:2/796: write d2/dc/d19/d69/dab/fac [76114,117179] 0 2024-02-16T22:19:21.162 INFO:tasks.workunit.client.1.smithi173.stdout:4/768: stat d7/d28/d31/d72/d93/d95/db4/cfd 0 2024-02-16T22:19:21.164 INFO:tasks.workunit.client.1.smithi173.stdout:4/769: truncate d7/d28/fb2 1393567 0 2024-02-16T22:19:21.165 INFO:tasks.workunit.client.1.smithi173.stdout:7/728: dwrite d1/d1d/d4c/d63/d48/f5d [0,4194304] 0 2024-02-16T22:19:21.166 INFO:tasks.workunit.client.1.smithi173.stdout:4/770: getdents d7/dd5 0 2024-02-16T22:19:21.167 INFO:tasks.workunit.client.1.smithi173.stdout:8/912: dwrite dd/d7c/d7d/d58/f85 [0,4194304] 0 2024-02-16T22:19:21.167 INFO:tasks.workunit.client.1.smithi173.stdout:2/797: dread d2/f3c [0,4194304] 0 2024-02-16T22:19:21.167 INFO:tasks.workunit.client.1.smithi173.stdout:2/798: fdatasync d2/dc/d19/d69/da5/f102 0 2024-02-16T22:19:21.170 INFO:tasks.workunit.client.1.smithi173.stdout:4/771: symlink d7/d28/d52/d89/l107 0 2024-02-16T22:19:21.170 INFO:tasks.workunit.client.1.smithi173.stdout:4/772: read d7/d28/d31/d33/d7d/d3d/f6c [2823780,96896] 0 2024-02-16T22:19:21.170 INFO:tasks.workunit.client.1.smithi173.stdout:4/773: chown d7/d28/d31/d33/d7d/d4e/dd7/dec/df3 466660171 1 2024-02-16T22:19:21.176 INFO:tasks.workunit.client.1.smithi173.stdout:8/913: mkdir dd/d7c/d7d/d58/d11d 0 2024-02-16T22:19:21.176 INFO:tasks.workunit.client.1.smithi173.stdout:8/914: chown dd/d7c/d7d/d22/d28/d40/de5/cfc 24231 1 2024-02-16T22:19:21.176 INFO:tasks.workunit.client.1.smithi173.stdout:8/915: stat dd/d7c/d7d/d22/d5a/l72 0 2024-02-16T22:19:21.177 INFO:tasks.workunit.client.1.smithi173.stdout:4/774: mknod d7/d28/d31/d33/d7d/d4e/dd7/dec/df3/c108 0 2024-02-16T22:19:21.180 INFO:tasks.workunit.client.1.smithi173.stdout:8/916: mkdir dd/d7c/d7d/d22/d28/d40/d69/da7/dae/d11e 0 2024-02-16T22:19:21.182 INFO:tasks.workunit.client.1.smithi173.stdout:8/917: mknod dd/d7c/d7d/d89/db0/d113/c11f 0 2024-02-16T22:19:21.183 INFO:tasks.workunit.client.1.smithi173.stdout:8/918: stat dd/d7c/dcb/ce6 0 2024-02-16T22:19:21.193 INFO:tasks.workunit.client.1.smithi173.stdout:7/729: dwrite d1/d1d/d4c/d63/d13/d22/d53/f24 [0,4194304] 0 2024-02-16T22:19:21.194 INFO:tasks.workunit.client.1.smithi173.stdout:4/775: dwrite d7/d28/d31/d72/d93/fdf [0,4194304] 0 2024-02-16T22:19:21.201 INFO:tasks.workunit.client.1.smithi173.stdout:8/919: dwrite dd/d7c/d7d/d22/d28/d40/f63 [0,4194304] 0 2024-02-16T22:19:21.202 INFO:tasks.workunit.client.1.smithi173.stdout:7/730: mkdir d1/d1d/d4c/d63/d6c/dca/de7 0 2024-02-16T22:19:21.203 INFO:tasks.workunit.client.1.smithi173.stdout:7/731: read d1/d1d/d4c/d63/d13/d36/d49/f86 [208062,66825] 0 2024-02-16T22:19:21.206 INFO:tasks.workunit.client.1.smithi173.stdout:0/748: sync 2024-02-16T22:19:21.206 INFO:tasks.workunit.client.1.smithi173.stdout:9/737: sync 2024-02-16T22:19:21.206 INFO:tasks.workunit.client.1.smithi173.stdout:1/795: sync 2024-02-16T22:19:21.206 INFO:tasks.workunit.client.1.smithi173.stdout:1/796: dread - db/d29/d83/fe5 zero size 2024-02-16T22:19:21.206 INFO:tasks.workunit.client.1.smithi173.stdout:3/877: sync 2024-02-16T22:19:21.206 INFO:tasks.workunit.client.1.smithi173.stdout:6/798: sync 2024-02-16T22:19:21.206 INFO:tasks.workunit.client.1.smithi173.stdout:5/872: sync 2024-02-16T22:19:21.206 INFO:tasks.workunit.client.1.smithi173.stdout:5/873: chown d8/d27/d35/ld8 667808203 1 2024-02-16T22:19:21.209 INFO:tasks.workunit.client.1.smithi173.stdout:8/920: symlink dd/d7c/d7d/d22/d28/d40/d69/l120 0 2024-02-16T22:19:21.209 INFO:tasks.workunit.client.1.smithi173.stdout:9/738: mkdir d1/d2/dec 0 2024-02-16T22:19:21.209 INFO:tasks.workunit.client.1.smithi173.stdout:9/739: fsync d1/d2/d1a/d2f/f53 0 2024-02-16T22:19:21.209 INFO:tasks.workunit.client.1.smithi173.stdout:3/878: creat d9/d17/d25/ddc/f12b x:0 0 0 2024-02-16T22:19:21.211 INFO:tasks.workunit.client.1.smithi173.stdout:6/799: creat d0/db/d2e/d2f/d31/d5d/f122 x:0 0 0 2024-02-16T22:19:21.213 INFO:tasks.workunit.client.1.smithi173.stdout:3/879: truncate d9/d1a/f2c 8095620 0 2024-02-16T22:19:21.213 INFO:tasks.workunit.client.1.smithi173.stdout:3/880: fdatasync d9/d18/daa/df0/d10b/f10e 0 2024-02-16T22:19:21.213 INFO:tasks.workunit.client.1.smithi173.stdout:6/800: write d0/db/d2e/d2f/d31/d5d/ffd [88375,109856] 0 2024-02-16T22:19:21.213 INFO:tasks.workunit.client.1.smithi173.stdout:3/881: write d9/d1a/d2b/f2d [6035733,15589] 0 2024-02-16T22:19:21.213 INFO:tasks.workunit.client.1.smithi173.stdout:3/882: chown d9/d18/d5f/d6e/c20 0 1 2024-02-16T22:19:21.214 INFO:tasks.workunit.client.1.smithi173.stdout:1/797: read db/d29/d57/f71 [6554246,121552] 0 2024-02-16T22:19:21.214 INFO:tasks.workunit.client.1.smithi173.stdout:8/921: mkdir dd/d7c/d7d/d22/d2e/d41/d121 0 2024-02-16T22:19:21.215 INFO:tasks.workunit.client.1.smithi173.stdout:5/874: dread d8/da/d1b/d57/f10f [0,4194304] 0 2024-02-16T22:19:21.215 INFO:tasks.workunit.client.1.smithi173.stdout:6/801: chown d0/db/d2e/d2f/d31/d5d/c60 47841395 1 2024-02-16T22:19:21.216 INFO:tasks.workunit.client.1.smithi173.stdout:9/740: dread f0 [0,4194304] 0 2024-02-16T22:19:21.218 INFO:tasks.workunit.client.1.smithi173.stdout:3/883: rename c6 to d9/d18/da3/c12c 0 2024-02-16T22:19:21.218 INFO:tasks.workunit.client.1.smithi173.stdout:4/776: dwrite d7/d28/d31/d33/dbf/f105 [0,4194304] 0 2024-02-16T22:19:21.218 INFO:tasks.workunit.client.1.smithi173.stdout:4/777: truncate d7/df/d62/d104/fc9 733650 0 2024-02-16T22:19:21.219 INFO:tasks.workunit.client.1.smithi173.stdout:1/798: creat db/d1c/d25/f10e x:0 0 0 2024-02-16T22:19:21.219 INFO:tasks.workunit.client.1.smithi173.stdout:1/799: chown db/f1b 30407125 1 2024-02-16T22:19:21.219 INFO:tasks.workunit.client.1.smithi173.stdout:1/800: write db/d29/d57/d73/f87 [452492,29556] 0 2024-02-16T22:19:21.219 INFO:tasks.workunit.client.1.smithi173.stdout:1/801: stat db/d29/f9a 0 2024-02-16T22:19:21.219 INFO:tasks.workunit.client.1.smithi173.stdout:1/802: fsync db/d1c/d25/d45/fa7 0 2024-02-16T22:19:21.220 INFO:tasks.workunit.client.1.smithi173.stdout:1/803: write db/d5f/d97/fe1 [219622,47566] 0 2024-02-16T22:19:21.222 INFO:tasks.workunit.client.1.smithi173.stdout:5/875: creat d8/da/db0/f111 x:0 0 0 2024-02-16T22:19:21.222 INFO:tasks.workunit.client.1.smithi173.stdout:5/876: truncate d8/da/d1f/d30/f59 4423799 0 2024-02-16T22:19:21.222 INFO:tasks.workunit.client.1.smithi173.stdout:5/877: dread - d8/da/d2d/d3a/da7/de7/f10c zero size 2024-02-16T22:19:21.223 INFO:tasks.workunit.client.1.smithi173.stdout:6/802: symlink d0/db/d2e/d65/d73/l123 0 2024-02-16T22:19:21.223 INFO:tasks.workunit.client.1.smithi173.stdout:6/803: write d0/db/d2e/d65/d67/f80 [1412001,42374] 0 2024-02-16T22:19:21.223 INFO:tasks.workunit.client.1.smithi173.stdout:9/741: creat d1/dd7/fed x:0 0 0 2024-02-16T22:19:21.223 INFO:tasks.workunit.client.1.smithi173.stdout:9/742: chown d1/d2/d1a/d2f/d3b/c3d 56761 1 2024-02-16T22:19:21.225 INFO:tasks.workunit.client.1.smithi173.stdout:1/804: symlink db/d29/d8f/l10f 0 2024-02-16T22:19:21.225 INFO:tasks.workunit.client.1.smithi173.stdout:1/805: write db/d29/d57/fc5 [851867,29346] 0 2024-02-16T22:19:21.225 INFO:tasks.workunit.client.1.smithi173.stdout:5/878: getdents d8/da/db0/df0 0 2024-02-16T22:19:21.227 INFO:tasks.workunit.client.1.smithi173.stdout:6/804: link d0/db/d2e/d61/c6e d0/db/d2e/d2f/d31/d33/c124 0 2024-02-16T22:19:21.227 INFO:tasks.workunit.client.1.smithi173.stdout:6/805: read d0/db/d2e/d65/fbb [3254275,28211] 0 2024-02-16T22:19:21.227 INFO:tasks.workunit.client.1.smithi173.stdout:6/806: dread - d0/db/d2e/d65/fe5 zero size 2024-02-16T22:19:21.228 INFO:tasks.workunit.client.1.smithi173.stdout:6/807: chown d0/db/d2e/d65/d73/d7d/cc9 191 1 2024-02-16T22:19:21.228 INFO:tasks.workunit.client.1.smithi173.stdout:6/808: dread - d0/d7c/dc5/d92/fc8 zero size 2024-02-16T22:19:21.228 INFO:tasks.workunit.client.1.smithi173.stdout:9/743: symlink d1/d2/d1a/d2f/d51/d96/lee 0 2024-02-16T22:19:21.228 INFO:tasks.workunit.client.1.smithi173.stdout:9/744: chown d1/d2/d1a/d2f/d51/d96/c9a 251358312 1 2024-02-16T22:19:21.229 INFO:tasks.workunit.client.1.smithi173.stdout:9/745: creat d1/d5f/d6d/d91/fef x:0 0 0 2024-02-16T22:19:21.229 INFO:tasks.workunit.client.1.smithi173.stdout:1/806: mknod db/d5f/c110 0 2024-02-16T22:19:21.229 INFO:tasks.workunit.client.1.smithi173.stdout:1/807: write db/d29/db5/ff4 [668432,105326] 0 2024-02-16T22:19:21.229 INFO:tasks.workunit.client.1.smithi173.stdout:3/884: dread d9/d1a/d2b/d45/d51/d92/f116 [0,4194304] 0 2024-02-16T22:19:21.229 INFO:tasks.workunit.client.1.smithi173.stdout:6/809: mkdir d0/d7c/d125 0 2024-02-16T22:19:21.231 INFO:tasks.workunit.client.1.smithi173.stdout:7/732: dwrite d1/d1d/d4c/d63/d13/d22/d53/d27/f62 [0,4194304] 0 2024-02-16T22:19:21.232 INFO:tasks.workunit.client.1.smithi173.stdout:1/808: rename ca to db/d29/d83/d10a/c111 0 2024-02-16T22:19:21.235 INFO:tasks.workunit.client.1.smithi173.stdout:0/749: dwrite d0/d12/d15/d3d/d98/d14/d24/d32/d39/fb7 [0,4194304] 0 2024-02-16T22:19:21.235 INFO:tasks.workunit.client.1.smithi173.stdout:0/750: write d0/d84/fcb [618055,15146] 0 2024-02-16T22:19:21.235 INFO:tasks.workunit.client.1.smithi173.stdout:0/751: readlink d0/d12/d15/d3d/d98/d14/d24/d32/d39/l22 0 2024-02-16T22:19:21.235 INFO:tasks.workunit.client.1.smithi173.stdout:0/752: stat d0/d12/d15/d3d/d98/d14/d24/d32/d39/f75 0 2024-02-16T22:19:21.235 INFO:tasks.workunit.client.1.smithi173.stdout:0/753: creat d0/d12/d15/d3d/d98/d14/d24/d2e/d6b/ff9 x:0 0 0 2024-02-16T22:19:21.235 INFO:tasks.workunit.client.1.smithi173.stdout:3/885: truncate d9/d18/d5f/d6e/d4e/f102 1296192 0 2024-02-16T22:19:21.237 INFO:tasks.workunit.client.1.smithi173.stdout:3/886: write d9/d1a/d2b/d45/fc0 [16735,38547] 0 2024-02-16T22:19:21.238 INFO:tasks.workunit.client.1.smithi173.stdout:6/810: creat d0/db/d2e/d65/d73/d100/d110/f126 x:0 0 0 2024-02-16T22:19:21.240 INFO:tasks.workunit.client.1.smithi173.stdout:7/733: getdents d1/dd4 0 2024-02-16T22:19:21.245 INFO:tasks.workunit.client.1.smithi173.stdout:8/922: dwrite dd/fab [0,4194304] 0 2024-02-16T22:19:21.245 INFO:tasks.workunit.client.1.smithi173.stdout:5/879: dread d8/da/d1f/d30/d9b/fe5 [0,4194304] 0 2024-02-16T22:19:21.245 INFO:tasks.workunit.client.1.smithi173.stdout:5/880: readlink d8/d27/d28/lf8 0 2024-02-16T22:19:21.245 INFO:tasks.workunit.client.1.smithi173.stdout:8/923: write dd/fab [4692279,112950] 0 2024-02-16T22:19:21.247 INFO:tasks.workunit.client.1.smithi173.stdout:4/778: dwrite d7/d28/d31/d33/fe1 [0,4194304] 0 2024-02-16T22:19:21.248 INFO:tasks.workunit.client.1.smithi173.stdout:0/754: mknod d0/d12/d15/d3d/d98/d14/d24/d70/cfa 0 2024-02-16T22:19:21.249 INFO:tasks.workunit.client.1.smithi173.stdout:3/887: symlink d9/d18/daa/df0/l12d 0 2024-02-16T22:19:21.249 INFO:tasks.workunit.client.1.smithi173.stdout:3/888: creat d9/d1a/d2b/de5/f12e x:0 0 0 2024-02-16T22:19:21.249 INFO:tasks.workunit.client.1.smithi173.stdout:3/889: stat d9/cbc 0 2024-02-16T22:19:21.250 INFO:tasks.workunit.client.1.smithi173.stdout:6/811: mkdir d0/d7c/dc5/d9b/d127 0 2024-02-16T22:19:21.255 INFO:tasks.workunit.client.1.smithi173.stdout:1/809: dwrite db/f2b [0,4194304] 0 2024-02-16T22:19:21.256 INFO:tasks.workunit.client.1.smithi173.stdout:7/734: creat d1/d1d/d4c/d63/d13/d22/d53/db9/dbc/dcf/fe8 x:0 0 0 2024-02-16T22:19:21.258 INFO:tasks.workunit.client.1.smithi173.stdout:0/755: write d0/d12/d15/d3d/d98/d14/d24/d32/d39/f42 [2034745,98392] 0 2024-02-16T22:19:21.258 INFO:tasks.workunit.client.1.smithi173.stdout:9/746: dwrite d1/d2/fc9 [0,4194304] 0 2024-02-16T22:19:21.258 INFO:tasks.workunit.client.1.smithi173.stdout:0/756: chown d0/d12/d15/d3d/d98/d33/d54 59 1 2024-02-16T22:19:21.258 INFO:tasks.workunit.client.1.smithi173.stdout:0/757: chown d0/l48 0 1 2024-02-16T22:19:21.258 INFO:tasks.workunit.client.1.smithi173.stdout:0/758: readlink d0/d12/d15/d3d/d98/d27/l2b 0 2024-02-16T22:19:21.258 INFO:tasks.workunit.client.1.smithi173.stdout:0/759: readlink d0/d84/d8c/la8 0 2024-02-16T22:19:21.260 INFO:tasks.workunit.client.1.smithi173.stdout:5/881: link d8/da/d1b/d57/dc9/d92/fa1 d8/da/d1b/d57/d105/f112 0 2024-02-16T22:19:21.265 INFO:tasks.workunit.client.1.smithi173.stdout:8/924: link dd/d7c/d7d/d22/d2e/c7a dd/d7c/d7d/d22/d2e/c122 0 2024-02-16T22:19:21.265 INFO:tasks.workunit.client.1.smithi173.stdout:5/882: dread d8/da/d1f/d30/fbe [0,4194304] 0 2024-02-16T22:19:21.269 INFO:tasks.workunit.client.1.smithi173.stdout:8/925: dread dd/d7c/d7d/d22/f96 [0,4194304] 0 2024-02-16T22:19:21.269 INFO:tasks.workunit.client.1.smithi173.stdout:4/779: dwrite d7/f15 [8388608,4194304] 0 2024-02-16T22:19:21.269 INFO:tasks.workunit.client.1.smithi173.stdout:4/780: creat d7/d28/d31/d72/d93/f109 x:0 0 0 2024-02-16T22:19:21.279 INFO:tasks.workunit.client.1.smithi173.stdout:3/890: symlink d9/d18/d5f/d6e/df9/d121/l12f 0 2024-02-16T22:19:21.282 INFO:tasks.workunit.client.1.smithi173.stdout:6/812: dwrite d0/db/d2e/d65/db8/de1/fdd [0,4194304] 0 2024-02-16T22:19:21.282 INFO:tasks.workunit.client.1.smithi173.stdout:1/810: dwrite db/d29/d50/f10b [0,4194304] 0 2024-02-16T22:19:21.282 INFO:tasks.workunit.client.1.smithi173.stdout:1/811: fsync db/d1c/d7f/d98/fc1 0 2024-02-16T22:19:21.282 INFO:tasks.workunit.client.1.smithi173.stdout:4/781: write d7/d28/d31/d72/d93/fdf [1890147,12389] 0 2024-02-16T22:19:21.286 INFO:tasks.workunit.client.1.smithi173.stdout:9/747: creat d1/d2/dec/ff0 x:0 0 0 2024-02-16T22:19:21.287 INFO:tasks.workunit.client.1.smithi173.stdout:0/760: dread - d0/d12/d15/d3d/d98/f89 zero size 2024-02-16T22:19:21.292 INFO:tasks.workunit.client.1.smithi173.stdout:4/782: write d7/f9 [1726555,113754] 0 2024-02-16T22:19:21.292 INFO:tasks.workunit.client.1.smithi173.stdout:4/783: truncate d7/d12/d7e/fbb 457718 0 2024-02-16T22:19:21.292 INFO:tasks.workunit.client.1.smithi173.stdout:5/883: unlink d8/da/d2d/d36/lac 0 2024-02-16T22:19:21.294 INFO:tasks.workunit.client.1.smithi173.stdout:8/926: creat dd/d7c/d7d/d22/d28/d40/d69/da7/dae/f123 x:0 0 0 2024-02-16T22:19:21.297 INFO:tasks.workunit.client.1.smithi173.stdout:3/891: mkdir d9/d18/d73/db7/d130 0 2024-02-16T22:19:21.300 INFO:tasks.workunit.client.1.smithi173.stdout:6/813: creat d0/db/d2e/d2f/da6/daa/f128 x:0 0 0 2024-02-16T22:19:21.301 INFO:tasks.workunit.client.1.smithi173.stdout:3/892: write d9/d18/d73/fc8 [990385,95858] 0 2024-02-16T22:19:21.303 INFO:tasks.workunit.client.1.smithi173.stdout:0/761: dwrite d0/d6d/f91 [0,4194304] 0 2024-02-16T22:19:21.304 INFO:tasks.workunit.client.1.smithi173.stdout:3/893: write d9/d18/d5f/fa4 [573214,79075] 0 2024-02-16T22:19:21.304 INFO:tasks.workunit.client.1.smithi173.stdout:3/894: fsync d9/d18/d5f/d6e/df9/f108 0 2024-02-16T22:19:21.304 INFO:tasks.workunit.client.1.smithi173.stdout:1/812: creat db/d29/db5/d105/f112 x:0 0 0 2024-02-16T22:19:21.308 INFO:tasks.workunit.client.1.smithi173.stdout:7/735: rmdir d1/d1d/d4c/d63/d48/d9a 39 2024-02-16T22:19:21.308 INFO:tasks.workunit.client.1.smithi173.stdout:7/736: chown d1/d1d/d4c/d63/d13/d36/d49/fae 29538 1 2024-02-16T22:19:21.308 INFO:tasks.workunit.client.1.smithi173.stdout:7/737: write d1/d1d/d4c/d63/d13/d36/d49/fe3 [526731,29337] 0 2024-02-16T22:19:21.308 INFO:tasks.workunit.client.1.smithi173.stdout:7/738: chown d1/d1d/d4c/d63/d13/d22/d7e 1363395 1 2024-02-16T22:19:21.309 INFO:tasks.workunit.client.1.smithi173.stdout:9/748: symlink d1/dd7/lf1 0 2024-02-16T22:19:21.311 INFO:tasks.workunit.client.1.smithi173.stdout:4/784: mkdir d7/d28/d10a 0 2024-02-16T22:19:21.312 INFO:tasks.workunit.client.1.smithi173.stdout:8/927: dwrite dd/d7c/d7d/f14 [0,4194304] 0 2024-02-16T22:19:21.313 INFO:tasks.workunit.client.1.smithi173.stdout:5/884: mknod d8/da/d1b/d108/c113 0 2024-02-16T22:19:21.316 INFO:tasks.workunit.client.1.smithi173.stdout:6/814: symlink d0/db/d2e/d2f/d31/l129 0 2024-02-16T22:19:21.316 INFO:tasks.workunit.client.1.smithi173.stdout:6/815: dread - d0/db/d2e/d2f/da6/daa/f128 zero size 2024-02-16T22:19:21.316 INFO:tasks.workunit.client.1.smithi173.stdout:6/816: write d0/fb9 [2559682,115102] 0 2024-02-16T22:19:21.322 INFO:tasks.workunit.client.1.smithi173.stdout:4/785: dread d7/f15 [8388608,4194304] 0 2024-02-16T22:19:21.322 INFO:tasks.workunit.client.1.smithi173.stdout:4/786: truncate d7/d28/d31/d72/d93/fdf 5166209 0 2024-02-16T22:19:21.324 INFO:tasks.workunit.client.1.smithi173.stdout:1/813: mknod db/d29/d83/d108/c113 0 2024-02-16T22:19:21.325 INFO:tasks.workunit.client.1.smithi173.stdout:7/739: mknod d1/d1d/d4c/d63/d13/d22/d53/db9/de1/ce9 0 2024-02-16T22:19:21.327 INFO:tasks.workunit.client.1.smithi173.stdout:8/928: creat dd/d7c/d7d/d89/dad/f124 x:0 0 0 2024-02-16T22:19:21.327 INFO:tasks.workunit.client.1.smithi173.stdout:8/929: chown dd/d7c/d7d/d89/dad/cd7 3 1 2024-02-16T22:19:21.328 INFO:tasks.workunit.client.1.smithi173.stdout:6/817: truncate d0/db/d2e/d2f/d31/d33/d97/fa8 2063876 0 2024-02-16T22:19:21.328 INFO:tasks.workunit.client.1.smithi173.stdout:0/762: dwrite d0/f67 [0,4194304] 0 2024-02-16T22:19:21.334 INFO:tasks.workunit.client.1.smithi173.stdout:3/895: mknod d9/d17/c131 0 2024-02-16T22:19:21.334 INFO:tasks.workunit.client.1.smithi173.stdout:4/787: link d7/l8c d7/d12/d7e/l10b 0 2024-02-16T22:19:21.336 INFO:tasks.workunit.client.1.smithi173.stdout:9/749: dwrite d1/d2/f4c [0,4194304] 0 2024-02-16T22:19:21.338 INFO:tasks.workunit.client.1.smithi173.stdout:1/814: creat db/d1c/d25/d28/f114 x:0 0 0 2024-02-16T22:19:21.338 INFO:tasks.workunit.client.1.smithi173.stdout:1/815: write db/d30/f48 [3042469,40586] 0 2024-02-16T22:19:21.340 INFO:tasks.workunit.client.1.smithi173.stdout:6/818: truncate d0/db/d2e/d2f/d31/f39 2544237 0 2024-02-16T22:19:21.342 INFO:tasks.workunit.client.1.smithi173.stdout:3/896: truncate d9/d1a/d2b/d4d/d5b/f5e 900558 0 2024-02-16T22:19:21.342 INFO:tasks.workunit.client.1.smithi173.stdout:3/897: fsync d9/da/f66 0 2024-02-16T22:19:21.342 INFO:tasks.workunit.client.1.smithi173.stdout:3/898: fdatasync d9/d17/d25/f50 0 2024-02-16T22:19:21.344 INFO:tasks.workunit.client.1.smithi173.stdout:4/788: creat d7/dd5/dad/f10c x:0 0 0 2024-02-16T22:19:21.345 INFO:tasks.workunit.client.1.smithi173.stdout:9/750: creat d1/d2/d1a/d2f/d3b/da6/de3/ff2 x:0 0 0 2024-02-16T22:19:21.347 INFO:tasks.workunit.client.1.smithi173.stdout:6/819: mkdir d0/db/d2e/d2f/d31/d7a/d12a 0 2024-02-16T22:19:21.350 INFO:tasks.workunit.client.1.smithi173.stdout:9/751: symlink d1/d5f/d6d/d91/lf3 0 2024-02-16T22:19:21.351 INFO:tasks.workunit.client.1.smithi173.stdout:6/820: creat d0/db/d2e/d2f/d31/d7a/f12b x:0 0 0 2024-02-16T22:19:21.351 INFO:tasks.workunit.client.1.smithi173.stdout:6/821: fdatasync d0/db/f29 0 2024-02-16T22:19:21.351 INFO:tasks.workunit.client.1.smithi173.stdout:6/822: chown d0/db/d2e/d65/fbb 2023137 1 2024-02-16T22:19:21.352 INFO:tasks.workunit.client.1.smithi173.stdout:7/740: dwrite d1/d1d/d4c/d63/d13/d22/d7e/db5/fc9 [0,4194304] 0 2024-02-16T22:19:21.353 INFO:tasks.workunit.client.1.smithi173.stdout:3/899: rename d9/d18/da3 to d9/d1a/d2b/d4d/d118/d132 0 2024-02-16T22:19:21.353 INFO:tasks.workunit.client.1.smithi173.stdout:7/741: mkdir d1/d1d/d4c/d63/d48/d9a/dea 0 2024-02-16T22:19:21.355 INFO:tasks.workunit.client.1.smithi173.stdout:4/789: dread d7/d28/d31/f37 [4194304,4194304] 0 2024-02-16T22:19:21.355 INFO:tasks.workunit.client.1.smithi173.stdout:4/790: dread - d7/d28/d31/d33/d7d/d4e/dd7/dec/df3/ff5 zero size 2024-02-16T22:19:21.356 INFO:tasks.workunit.client.1.smithi173.stdout:3/900: creat d9/d1a/d2b/d4d/f133 x:0 0 0 2024-02-16T22:19:21.358 INFO:tasks.workunit.client.1.smithi173.stdout:9/752: rename d1/d2/d1a/d3e/d4f to d1/d2/d1a/d2f/df4 0 2024-02-16T22:19:21.358 INFO:tasks.workunit.client.1.smithi173.stdout:9/753: creat d1/d2/d1a/d2f/d51/d96/ff5 x:0 0 0 2024-02-16T22:19:21.360 INFO:tasks.workunit.client.1.smithi173.stdout:4/791: symlink d7/d28/d31/d72/d93/d95/db4/l10d 0 2024-02-16T22:19:21.361 INFO:tasks.workunit.client.1.smithi173.stdout:3/901: symlink d9/d1a/d2b/d4d/d5b/l134 0 2024-02-16T22:19:21.363 INFO:tasks.workunit.client.1.smithi173.stdout:7/742: rmdir d1/d1d/d4c/d91/d9f 39 2024-02-16T22:19:21.363 INFO:tasks.workunit.client.1.smithi173.stdout:7/743: stat d1/d1d/d4c/d91/d81/lb8 0 2024-02-16T22:19:21.363 INFO:tasks.workunit.client.1.smithi173.stdout:7/744: write d1/d1d/d4c/d63/d13/d22/d7e/dc2/f59 [170740,86263] 0 2024-02-16T22:19:21.363 INFO:tasks.workunit.client.1.smithi173.stdout:7/745: write d1/d1d/d4c/d63/d13/d22/d7e/db5/fc9 [4959774,62064] 0 2024-02-16T22:19:21.363 INFO:tasks.workunit.client.1.smithi173.stdout:7/746: dread - d1/d1d/d4c/d63/d13/d22/d7e/dbd/fc1 zero size 2024-02-16T22:19:21.369 INFO:tasks.workunit.client.1.smithi173.stdout:4/792: rename d7/d12/d7e/fbe to d7/d28/d31/d33/d7d/d4e/dd7/dec/f10e 0 2024-02-16T22:19:21.371 INFO:tasks.workunit.client.1.smithi173.stdout:3/902: creat d9/d18/dee/df6/f135 x:0 0 0 2024-02-16T22:19:21.371 INFO:tasks.workunit.client.1.smithi173.stdout:9/754: dread d1/d2/fc9 [0,4194304] 0 2024-02-16T22:19:21.373 INFO:tasks.workunit.client.1.smithi173.stdout:7/747: symlink d1/d1d/d4c/d63/d54/leb 0 2024-02-16T22:19:21.377 INFO:tasks.workunit.client.1.smithi173.stdout:4/793: rename d7/d28/d31/d33/dca/df4/fff to d7/dd5/dad/f10f 0 2024-02-16T22:19:21.378 INFO:tasks.workunit.client.1.smithi173.stdout:3/903: symlink d9/d1a/d2b/l136 0 2024-02-16T22:19:21.381 INFO:tasks.workunit.client.1.smithi173.stdout:7/748: creat d1/d1d/d4c/d63/d13/d22/d53/fec x:0 0 0 2024-02-16T22:19:21.384 INFO:tasks.workunit.client.1.smithi173.stdout:4/794: mkdir d7/df/d110 0 2024-02-16T22:19:21.384 INFO:tasks.workunit.client.1.smithi173.stdout:4/795: fsync d7/d12/f73 0 2024-02-16T22:19:21.387 INFO:tasks.workunit.client.1.smithi173.stdout:2/799: sync 2024-02-16T22:19:21.387 INFO:tasks.workunit.client.1.smithi173.stdout:2/800: readlink d2/d4/d8/d30/daf/le2 0 2024-02-16T22:19:21.387 INFO:tasks.workunit.client.1.smithi173.stdout:2/801: write d2/dc/d19/d69/da5/f102 [512792,38745] 0 2024-02-16T22:19:21.389 INFO:tasks.workunit.client.1.smithi173.stdout:3/904: rename d9/d1a/d2b/d4d/d94/d98/cb3 to d9/d18/d5f/d6e/df9/c137 0 2024-02-16T22:19:21.390 INFO:tasks.workunit.client.1.smithi173.stdout:4/796: mknod d7/dd5/dad/c111 0 2024-02-16T22:19:21.394 INFO:tasks.workunit.client.1.smithi173.stdout:3/905: mkdir d9/d17/d93/d138 0 2024-02-16T22:19:21.398 INFO:tasks.workunit.client.1.smithi173.stdout:4/797: rename d7/dd5/c5e to d7/d28/d52/d89/c112 0 2024-02-16T22:19:21.398 INFO:tasks.workunit.client.1.smithi173.stdout:4/798: read d7/d28/d31/d72/d93/fdf [1151789,26857] 0 2024-02-16T22:19:21.400 INFO:tasks.workunit.client.1.smithi173.stdout:3/906: unlink d9/d18/d73/l78 0 2024-02-16T22:19:21.401 INFO:tasks.workunit.client.1.smithi173.stdout:6/823: write d0/db/d2e/d2f/d31/d33/fab [3950285,85057] 0 2024-02-16T22:19:21.404 INFO:tasks.workunit.client.1.smithi173.stdout:4/799: creat d7/df/d62/f113 x:0 0 0 2024-02-16T22:19:21.405 INFO:tasks.workunit.client.1.smithi173.stdout:9/755: dread d1/d2/d1a/d2f/d3b/d75/f90 [0,4194304] 0 2024-02-16T22:19:21.405 INFO:tasks.workunit.client.1.smithi173.stdout:9/756: creat d1/d2/da2/ff6 x:0 0 0 2024-02-16T22:19:21.406 INFO:tasks.workunit.client.1.smithi173.stdout:9/757: dread - d1/d2/d1a/d2f/d3b/da6/de3/ff2 zero size 2024-02-16T22:19:21.408 INFO:tasks.workunit.client.1.smithi173.stdout:3/907: rename d9/d18/dee/df6 to d9/d1a/d2b/d4d/d5b/da9/d139 0 2024-02-16T22:19:21.408 INFO:tasks.workunit.client.1.smithi173.stdout:3/908: dread - d9/d17/d25/ddc/f12b zero size 2024-02-16T22:19:21.408 INFO:tasks.workunit.client.1.smithi173.stdout:6/824: dread d0/db/d2e/d2f/d31/d5d/ffd [0,4194304] 0 2024-02-16T22:19:21.411 INFO:tasks.workunit.client.1.smithi173.stdout:4/800: mkdir d7/df/d8b/da1/d114 0 2024-02-16T22:19:21.411 INFO:tasks.workunit.client.1.smithi173.stdout:4/801: write d7/d28/d31/d33/d7d/d4e/dcc/ffb [238564,128561] 0 2024-02-16T22:19:21.413 INFO:tasks.workunit.client.1.smithi173.stdout:4/802: dread d7/d28/d52/f60 [4194304,4194304] 0 2024-02-16T22:19:21.413 INFO:tasks.workunit.client.1.smithi173.stdout:4/803: fsync d7/d28/d31/d33/d7d/d45/f70 0 2024-02-16T22:19:21.414 INFO:tasks.workunit.client.1.smithi173.stdout:9/758: mknod d1/d2/d1a/d2f/d51/cf7 0 2024-02-16T22:19:21.415 INFO:tasks.workunit.client.1.smithi173.stdout:9/759: write f0 [1590132,23163] 0 2024-02-16T22:19:21.415 INFO:tasks.workunit.client.1.smithi173.stdout:9/760: fdatasync d1/d2/d10/f46 0 2024-02-16T22:19:21.416 INFO:tasks.workunit.client.1.smithi173.stdout:2/802: dwrite d2/dc/d19/d1c/fb0 [0,4194304] 0 2024-02-16T22:19:21.416 INFO:tasks.workunit.client.1.smithi173.stdout:2/803: fdatasync d2/dc/d5d/f18 0 2024-02-16T22:19:21.416 INFO:tasks.workunit.client.1.smithi173.stdout:2/804: chown d2/d4/d8/d30/d4d/da8/cdf 0 1 2024-02-16T22:19:21.416 INFO:tasks.workunit.client.1.smithi173.stdout:5/885: dwrite d8/da/d2d/fec [0,4194304] 0 2024-02-16T22:19:21.416 INFO:tasks.workunit.client.1.smithi173.stdout:5/886: creat d8/da/d2d/d36/d50/f114 x:0 0 0 2024-02-16T22:19:21.416 INFO:tasks.workunit.client.1.smithi173.stdout:0/763: dwrite d0/d12/d15/d3d/d98/d27/f57 [0,4194304] 0 2024-02-16T22:19:21.416 INFO:tasks.workunit.client.1.smithi173.stdout:0/764: creat d0/d12/d15/d3d/d98/d27/ffb x:0 0 0 2024-02-16T22:19:21.416 INFO:tasks.workunit.client.1.smithi173.stdout:1/816: dwrite db/d1c/d5c/dac/dae/fcc [0,4194304] 0 2024-02-16T22:19:21.417 INFO:tasks.workunit.client.1.smithi173.stdout:9/761: mknod d1/d2/da2/cf8 0 2024-02-16T22:19:21.418 INFO:tasks.workunit.client.1.smithi173.stdout:2/805: dread d2/dc/d19/d1c/d53/d6e/f73 [0,4194304] 0 2024-02-16T22:19:21.421 INFO:tasks.workunit.client.1.smithi173.stdout:3/909: write d9/d18/d5f/d6e/df9/f119 [1635115,57878] 0 2024-02-16T22:19:21.426 INFO:tasks.workunit.client.1.smithi173.stdout:5/887: symlink d8/da/d2d/d36/d50/l115 0 2024-02-16T22:19:21.426 INFO:tasks.workunit.client.1.smithi173.stdout:5/888: write d8/da/d1f/d8c/fb1 [438525,38478] 0 2024-02-16T22:19:21.426 INFO:tasks.workunit.client.1.smithi173.stdout:5/889: fdatasync d8/f26 0 2024-02-16T22:19:21.428 INFO:tasks.workunit.client.1.smithi173.stdout:7/749: dwrite d1/d1d/d4c/d63/d54/f76 [4194304,4194304] 0 2024-02-16T22:19:21.429 INFO:tasks.workunit.client.1.smithi173.stdout:0/765: dread d0/d12/d15/d3d/d98/d33/d54/f5c [0,4194304] 0 2024-02-16T22:19:21.431 INFO:tasks.workunit.client.1.smithi173.stdout:1/817: mknod db/d29/d83/d10a/c115 0 2024-02-16T22:19:21.431 INFO:tasks.workunit.client.1.smithi173.stdout:1/818: creat db/d1c/d25/f116 x:0 0 0 2024-02-16T22:19:21.431 INFO:tasks.workunit.client.1.smithi173.stdout:1/819: truncate db/fd2 581704 0 2024-02-16T22:19:21.432 INFO:tasks.workunit.client.1.smithi173.stdout:6/825: dwrite d0/db/d2e/d65/d67/d78/fa2 [0,4194304] 0 2024-02-16T22:19:21.432 INFO:tasks.workunit.client.1.smithi173.stdout:9/762: creat d1/d2/d1a/d2f/df4/d8c/ff9 x:0 0 0 2024-02-16T22:19:21.433 INFO:tasks.workunit.client.1.smithi173.stdout:9/763: chown d1/d2/d1a/d3e/dc8/fda 349323490 1 2024-02-16T22:19:21.433 INFO:tasks.workunit.client.1.smithi173.stdout:6/826: write d0/db/d2e/fbd [183142,111946] 0 2024-02-16T22:19:21.433 INFO:tasks.workunit.client.1.smithi173.stdout:6/827: dread - d0/d7c/dc5/f9d zero size 2024-02-16T22:19:21.435 INFO:tasks.workunit.client.1.smithi173.stdout:3/910: write d9/d18/fb1 [494206,6559] 0 2024-02-16T22:19:21.435 INFO:tasks.workunit.client.1.smithi173.stdout:3/911: creat d9/d1a/d2b/d4d/d94/f13a x:0 0 0 2024-02-16T22:19:21.436 INFO:tasks.workunit.client.1.smithi173.stdout:2/806: rename d2/d4/d8/d30/f45 to d2/d4/d8/d3a/de1/f105 0 2024-02-16T22:19:21.436 INFO:tasks.workunit.client.1.smithi173.stdout:4/804: dwrite d7/df/fe8 [0,4194304] 0 2024-02-16T22:19:21.439 INFO:tasks.workunit.client.1.smithi173.stdout:5/890: creat d8/da/d1b/d57/d97/df9/f116 x:0 0 0 2024-02-16T22:19:21.457 INFO:tasks.workunit.client.1.smithi173.stdout:0/766: unlink d0/d12/d15/d3d/d98/d14/d24/d2e/d6b/ff9 0 2024-02-16T22:19:21.457 INFO:tasks.workunit.client.1.smithi173.stdout:0/767: chown d0/d12/d15/d3d/dab 1022 1 2024-02-16T22:19:21.459 INFO:tasks.workunit.client.1.smithi173.stdout:9/764: mknod d1/d2/d1a/d2f/d51/d96/db3/dd6/cfa 0 2024-02-16T22:19:21.461 INFO:tasks.workunit.client.1.smithi173.stdout:3/912: creat d9/d17/d93/d138/f13b x:0 0 0 2024-02-16T22:19:21.461 INFO:tasks.workunit.client.1.smithi173.stdout:3/913: fdatasync d9/d1a/d2b/d4d/f8c 0 2024-02-16T22:19:21.465 INFO:tasks.workunit.client.1.smithi173.stdout:4/805: creat d7/df/d62/dd8/dde/f115 x:0 0 0 2024-02-16T22:19:21.465 INFO:tasks.workunit.client.1.smithi173.stdout:4/806: truncate d7/df/d62/f113 6411 0 2024-02-16T22:19:21.465 INFO:tasks.workunit.client.1.smithi173.stdout:7/750: dwrite d1/d1d/d4c/d63/d13/d36/d49/fe4 [0,4194304] 0 2024-02-16T22:19:21.467 INFO:tasks.workunit.client.1.smithi173.stdout:1/820: dwrite db/d1c/d25/d28/f49 [0,4194304] 0 2024-02-16T22:19:21.467 INFO:tasks.workunit.client.1.smithi173.stdout:6/828: dwrite d0/f44 [0,4194304] 0 2024-02-16T22:19:21.467 INFO:tasks.workunit.client.1.smithi173.stdout:6/829: chown d0/db/d2e/d2f/d31/d7a/f12b 3678 1 2024-02-16T22:19:21.468 INFO:tasks.workunit.client.1.smithi173.stdout:9/765: rename d1/d2/d1a/d2f/d3b/da6/de4/fc1 to d1/d2/dec/ffb 0 2024-02-16T22:19:21.470 INFO:tasks.workunit.client.1.smithi173.stdout:3/914: mkdir d9/d1a/d2b/d13c 0 2024-02-16T22:19:21.470 INFO:tasks.workunit.client.1.smithi173.stdout:3/915: chown d9/d1a/d2b/d4d/d5b/da9/db4/ffe 156505067 1 2024-02-16T22:19:21.470 INFO:tasks.workunit.client.1.smithi173.stdout:3/916: fdatasync d9/d1a/d2b/d45/f88 0 2024-02-16T22:19:21.470 INFO:tasks.workunit.client.1.smithi173.stdout:3/917: dread - d9/d1a/d2b/d45/d60/ffb zero size 2024-02-16T22:19:21.471 INFO:tasks.workunit.client.1.smithi173.stdout:2/807: rmdir d2/d4/d57/d82 39 2024-02-16T22:19:21.471 INFO:tasks.workunit.client.1.smithi173.stdout:2/808: write d2/d4/d8/d30/d44/d83/f85 [548469,54867] 0 2024-02-16T22:19:21.474 INFO:tasks.workunit.client.1.smithi173.stdout:7/751: mkdir d1/d1d/d4c/d63/d48/d9a/ded 0 2024-02-16T22:19:21.485 INFO:tasks.workunit.client.1.smithi173.stdout:0/768: dwrite d0/d12/d15/d3d/d98/d14/d24/d32/d39/f42 [0,4194304] 0 2024-02-16T22:19:21.485 INFO:tasks.workunit.client.1.smithi173.stdout:0/769: creat d0/d12/d15/d3d/d98/d14/d24/d2e/d6b/d8e/ffc x:0 0 0 2024-02-16T22:19:21.485 INFO:tasks.workunit.client.1.smithi173.stdout:0/770: truncate d0/d12/d15/d3d/d98/d27/fd3 5142210 0 2024-02-16T22:19:21.487 INFO:tasks.workunit.client.1.smithi173.stdout:4/807: dwrite d7/d28/d31/fc4 [0,4194304] 0 2024-02-16T22:19:21.487 INFO:tasks.workunit.client.1.smithi173.stdout:4/808: stat d7/df/d62/f6f 0 2024-02-16T22:19:21.487 INFO:tasks.workunit.client.1.smithi173.stdout:4/809: truncate d7/d28/d31/d33/dca/fe7 1900009 0 2024-02-16T22:19:21.487 INFO:tasks.workunit.client.1.smithi173.stdout:7/752: write d1/d1d/d4c/d63/d13/d36/f38 [3438785,62616] 0 2024-02-16T22:19:21.487 INFO:tasks.workunit.client.1.smithi173.stdout:7/753: fdatasync d1/d1d/d4c/d63/d13/d22/d53/d27/f73 0 2024-02-16T22:19:21.490 INFO:tasks.workunit.client.1.smithi173.stdout:9/766: unlink d1/d2/d1a/f5d 0 2024-02-16T22:19:21.491 INFO:tasks.workunit.client.1.smithi173.stdout:3/918: mkdir d9/d18/d5f/d6e/df9/d13d 0 2024-02-16T22:19:21.494 INFO:tasks.workunit.client.1.smithi173.stdout:2/809: creat d2/dc/d19/d1a/d74/db2/dec/f106 x:0 0 0 2024-02-16T22:19:21.494 INFO:tasks.workunit.client.1.smithi173.stdout:2/810: chown d2/dc/d19/d69/da5 19637 1 2024-02-16T22:19:21.495 INFO:tasks.workunit.client.1.smithi173.stdout:2/811: dread d2/d4/d8/f95 [0,4194304] 0 2024-02-16T22:19:21.498 INFO:tasks.workunit.client.1.smithi173.stdout:0/771: rename d0/d12/d15/d3d/d98/d14/l25 to d0/d12/d15/d3d/db5/dbf/lfd 0 2024-02-16T22:19:21.498 INFO:tasks.workunit.client.1.smithi173.stdout:0/772: fsync d0/d12/d15/d3d/d98/d14/d24/d2e/f83 0 2024-02-16T22:19:21.499 INFO:tasks.workunit.client.1.smithi173.stdout:1/821: truncate db/d29/d57/f5d 933628 0 2024-02-16T22:19:21.501 INFO:tasks.workunit.client.1.smithi173.stdout:4/810: symlink d7/dd5/dcf/l116 0 2024-02-16T22:19:21.502 INFO:tasks.workunit.client.1.smithi173.stdout:6/830: getdents d0/db/d2e/d65 0 2024-02-16T22:19:21.503 INFO:tasks.workunit.client.1.smithi173.stdout:7/754: dwrite d1/d1d/d4c/d63/d11/fb0 [0,4194304] 0 2024-02-16T22:19:21.503 INFO:tasks.workunit.client.1.smithi173.stdout:7/755: fsync d1/d1d/d4c/d63/d11/fb0 0 2024-02-16T22:19:21.504 INFO:tasks.workunit.client.1.smithi173.stdout:9/767: mknod d1/d5f/d6d/d91/da7/cfc 0 2024-02-16T22:19:21.505 INFO:tasks.workunit.client.1.smithi173.stdout:3/919: rmdir d9/d18/d5f/d6e/df9/d121 39 2024-02-16T22:19:21.506 INFO:tasks.workunit.client.1.smithi173.stdout:2/812: mkdir d2/dc/d19/da3/d107 0 2024-02-16T22:19:21.508 INFO:tasks.workunit.client.1.smithi173.stdout:1/822: truncate db/d1c/d25/d28/d3f/f4e 1732267 0 2024-02-16T22:19:21.508 INFO:tasks.workunit.client.1.smithi173.stdout:1/823: chown db/d1c/d7f 50 1 2024-02-16T22:19:21.508 INFO:tasks.workunit.client.1.smithi173.stdout:1/824: chown db/d29/d8f/f93 27152 1 2024-02-16T22:19:21.508 INFO:tasks.workunit.client.1.smithi173.stdout:1/825: write db/d1c/d25/d45/fa7 [703731,86989] 0 2024-02-16T22:19:21.509 INFO:tasks.workunit.client.1.smithi173.stdout:4/811: creat d7/d28/d31/d33/dcb/f117 x:0 0 0 2024-02-16T22:19:21.510 INFO:tasks.workunit.client.1.smithi173.stdout:6/831: symlink d0/db/d2e/d65/db8/de1/l12c 0 2024-02-16T22:19:21.510 INFO:tasks.workunit.client.1.smithi173.stdout:6/832: write d0/db/d2e/f83 [927067,47074] 0 2024-02-16T22:19:21.514 INFO:tasks.workunit.client.1.smithi173.stdout:7/756: rename d1/d1d/f20 to d1/d1d/d4c/d63/d48/d9a/dea/fee 0 2024-02-16T22:19:21.515 INFO:tasks.workunit.client.1.smithi173.stdout:6/833: dread d0/db/d2e/f88 [0,4194304] 0 2024-02-16T22:19:21.516 INFO:tasks.workunit.client.1.smithi173.stdout:0/773: dwrite d0/d12/d15/f85 [0,4194304] 0 2024-02-16T22:19:21.516 INFO:tasks.workunit.client.1.smithi173.stdout:9/768: symlink d1/d2/d1a/d1f/d34/d49/dac/lfd 0 2024-02-16T22:19:21.517 INFO:tasks.workunit.client.1.smithi173.stdout:3/920: stat d9/d18/d5f/d6e/df9/c117 0 2024-02-16T22:19:21.517 INFO:tasks.workunit.client.1.smithi173.stdout:3/921: write d9/f29 [2073559,59724] 0 2024-02-16T22:19:21.517 INFO:tasks.workunit.client.1.smithi173.stdout:3/922: fsync d9/d1a/d2b/d4d/d5b/da9/db4/ffe 0 2024-02-16T22:19:21.524 INFO:tasks.workunit.client.1.smithi173.stdout:1/826: mknod db/d1c/d7f/d98/df9/c117 0 2024-02-16T22:19:21.528 INFO:tasks.workunit.client.1.smithi173.stdout:4/812: rename d7/d28/d31/d33/d7d/d45/f79 to d7/d28/d52/d89/f118 0 2024-02-16T22:19:21.530 INFO:tasks.workunit.client.1.smithi173.stdout:4/813: write d7/d28/d31/d33/d7d/d4e/dd7/dec/f10e [1460478,82892] 0 2024-02-16T22:19:21.531 INFO:tasks.workunit.client.1.smithi173.stdout:4/814: write d7/d28/d31/d33/dca/df4/f101 [4765182,114250] 0 2024-02-16T22:19:21.531 INFO:tasks.workunit.client.1.smithi173.stdout:7/757: link d1/d1d/d4c/d63/d13/l17 d1/d1d/d4c/d63/d13/d36/lef 0 2024-02-16T22:19:21.532 INFO:tasks.workunit.client.1.smithi173.stdout:6/834: getdents d0/db/d2e/d65/d9f/de2 0 2024-02-16T22:19:21.532 INFO:tasks.workunit.client.1.smithi173.stdout:6/835: truncate d0/db/d2e/d65/d9f/fef 761678 0 2024-02-16T22:19:21.533 INFO:tasks.workunit.client.1.smithi173.stdout:6/836: read - d0/db/d2e/d2f/d31/d7a/f10a zero size 2024-02-16T22:19:21.533 INFO:tasks.workunit.client.1.smithi173.stdout:6/837: chown d0/db/d2e/d2f/da6/l106 2956607 1 2024-02-16T22:19:21.537 INFO:tasks.workunit.client.1.smithi173.stdout:6/838: dread d0/db/d2e/f56 [0,4194304] 0 2024-02-16T22:19:21.537 INFO:tasks.workunit.client.1.smithi173.stdout:6/839: creat d0/db/d2e/d65/d73/d100/d110/f12d x:0 0 0 2024-02-16T22:19:21.537 INFO:tasks.workunit.client.1.smithi173.stdout:6/840: write d0/db/d4d/f6f [724151,125783] 0 2024-02-16T22:19:21.546 INFO:tasks.workunit.client.1.smithi173.stdout:0/774: creat d0/d12/d15/d3d/dab/ffe x:0 0 0 2024-02-16T22:19:21.547 INFO:tasks.workunit.client.1.smithi173.stdout:3/923: unlink d9/d17/d25/dcf/cff 0 2024-02-16T22:19:21.551 INFO:tasks.workunit.client.1.smithi173.stdout:2/813: getdents d2/d4/d8/d3a 0 2024-02-16T22:19:21.551 INFO:tasks.workunit.client.1.smithi173.stdout:2/814: dread - d2/dc/d19/d69/fd6 zero size 2024-02-16T22:19:21.551 INFO:tasks.workunit.client.1.smithi173.stdout:2/815: chown d2/d4/d57/d82 532 1 2024-02-16T22:19:21.553 INFO:tasks.workunit.client.1.smithi173.stdout:9/769: rename d1/d2/d10/f33 to d1/d2/d1a/d3e/dc8/ffe 0 2024-02-16T22:19:21.553 INFO:tasks.workunit.client.1.smithi173.stdout:9/770: chown d1/d2/d1a/d2f/d51/la8 2515255 1 2024-02-16T22:19:21.553 INFO:tasks.workunit.client.1.smithi173.stdout:9/771: creat d1/d5f/d6d/d97/fff x:0 0 0 2024-02-16T22:19:21.555 INFO:tasks.workunit.client.1.smithi173.stdout:7/758: mknod d1/d1d/d4c/d63/d13/d22/d7e/db5/cf0 0 2024-02-16T22:19:21.555 INFO:tasks.workunit.client.1.smithi173.stdout:7/759: write d1/d1d/d4c/d63/d13/d22/d53/f85 [2724372,531] 0 2024-02-16T22:19:21.555 INFO:tasks.workunit.client.1.smithi173.stdout:7/760: dread - d1/d1d/d4c/d63/d13/fa0 zero size 2024-02-16T22:19:21.555 INFO:tasks.workunit.client.1.smithi173.stdout:7/761: chown d1/l7 2931 1 2024-02-16T22:19:21.556 INFO:tasks.workunit.client.1.smithi173.stdout:0/775: creat d0/d12/d15/d4f/fff x:0 0 0 2024-02-16T22:19:21.558 INFO:tasks.workunit.client.1.smithi173.stdout:4/815: rename c6 to d7/dd5/c119 0 2024-02-16T22:19:21.559 INFO:tasks.workunit.client.1.smithi173.stdout:0/776: creat d0/d12/d15/d3d/db5/dbf/f100 x:0 0 0 2024-02-16T22:19:21.561 INFO:tasks.workunit.client.1.smithi173.stdout:4/816: unlink d7/d28/d31/d33/d7d/f5d 0 2024-02-16T22:19:21.561 INFO:tasks.workunit.client.1.smithi173.stdout:3/924: dread d9/d1a/d2b/d4d/d118/f11c [0,4194304] 0 2024-02-16T22:19:21.562 INFO:tasks.workunit.client.1.smithi173.stdout:3/925: fdatasync d9/da/fd 0 2024-02-16T22:19:21.562 INFO:tasks.workunit.client.1.smithi173.stdout:4/817: rmdir d7/dd5 39 2024-02-16T22:19:21.562 INFO:tasks.workunit.client.1.smithi173.stdout:4/818: getdents d7/df/d110 0 2024-02-16T22:19:21.563 INFO:tasks.workunit.client.1.smithi173.stdout:4/819: truncate d7/d12/d7e/fc8 2474059 0 2024-02-16T22:19:21.563 INFO:tasks.workunit.client.1.smithi173.stdout:4/820: truncate d7/dd5/f8e 344236 0 2024-02-16T22:19:21.566 INFO:tasks.workunit.client.1.smithi173.stdout:3/926: dread d9/d1a/d2b/d4d/d5b/da9/db4/ffe [0,4194304] 0 2024-02-16T22:19:21.568 INFO:tasks.workunit.client.1.smithi173.stdout:3/927: symlink d9/d18/d73/db7/d7a/l13e 0 2024-02-16T22:19:21.569 INFO:tasks.workunit.client.1.smithi173.stdout:3/928: mkdir d9/d1a/d2b/d45/d60/d6a/d13f 0 2024-02-16T22:19:21.570 INFO:tasks.workunit.client.1.smithi173.stdout:3/929: mkdir d9/d1a/d2b/d4d/d5b/da9/db4/d140 0 2024-02-16T22:19:21.570 INFO:tasks.workunit.client.1.smithi173.stdout:3/930: stat d9/d1a/d2b/d4d/d5b/f12a 0 2024-02-16T22:19:21.588 INFO:tasks.workunit.client.1.smithi173.stdout:4/821: dwrite d7/fd [4194304,4194304] 0 2024-02-16T22:19:21.588 INFO:tasks.workunit.client.1.smithi173.stdout:4/822: creat d7/d28/d31/d33/f11a x:0 0 0 2024-02-16T22:19:21.590 INFO:tasks.workunit.client.1.smithi173.stdout:4/823: mknod d7/d28/d31/d33/c11b 0 2024-02-16T22:19:21.590 INFO:tasks.workunit.client.1.smithi173.stdout:4/824: write d7/d9a/fa9 [1690446,64504] 0 2024-02-16T22:19:21.591 INFO:tasks.workunit.client.1.smithi173.stdout:4/825: unlink d7/d28/d52/f90 0 2024-02-16T22:19:21.620 INFO:tasks.workunit.client.1.smithi173.stdout:7/762: write d1/d1d/d4c/d63/d13/d36/d49/f74 [3634342,60910] 0 2024-02-16T22:19:21.622 INFO:tasks.workunit.client.1.smithi173.stdout:7/763: creat d1/d1d/d4c/d63/d13/d22/d53/db9/dbc/ff1 x:0 0 0 2024-02-16T22:19:21.623 INFO:tasks.workunit.client.1.smithi173.stdout:7/764: creat d1/d1d/d4c/d63/d13/d22/ff2 x:0 0 0 2024-02-16T22:19:21.623 INFO:tasks.workunit.client.1.smithi173.stdout:7/765: truncate d1/d1d/d4c/d63/d13/fd0 135340 0 2024-02-16T22:19:21.624 INFO:tasks.workunit.client.1.smithi173.stdout:7/766: rename d1/d1d/d4c/d63/d13/d36/l47 to d1/d1d/d4c/d63/d13/d22/d7e/dbd/lf3 0 2024-02-16T22:19:21.624 INFO:tasks.workunit.client.1.smithi173.stdout:7/767: dread - d1/d1d/d4c/d63/d13/fa0 zero size 2024-02-16T22:19:21.624 INFO:tasks.workunit.client.1.smithi173.stdout:7/768: write d1/d1d/d4c/d63/d13/d22/d7e/db5/fc9 [5473642,64962] 0 2024-02-16T22:19:21.627 INFO:tasks.workunit.client.1.smithi173.stdout:6/841: dwrite d0/db/d2e/d2f/da6/daa/de8/f9e [0,4194304] 0 2024-02-16T22:19:21.628 INFO:tasks.workunit.client.1.smithi173.stdout:6/842: rename d0/db/d2e/d65/db8/de1/l12c to d0/d7c/d125/l12e 0 2024-02-16T22:19:21.630 INFO:tasks.workunit.client.1.smithi173.stdout:6/843: creat d0/db/d2e/d65/d73/f12f x:0 0 0 2024-02-16T22:19:21.631 INFO:tasks.workunit.client.1.smithi173.stdout:6/844: mknod d0/db/d2e/d2f/da6/c130 0 2024-02-16T22:19:21.631 INFO:tasks.workunit.client.1.smithi173.stdout:6/845: fdatasync d0/db/d2e/d65/d9f/de2/ff6 0 2024-02-16T22:19:21.631 INFO:tasks.workunit.client.1.smithi173.stdout:6/846: chown d0/db/d2e/d65/d67/d78/c93 34639 1 2024-02-16T22:19:21.637 INFO:tasks.workunit.client.1.smithi173.stdout:3/931: dwrite d9/d1a/d2b/de5/f12e [0,4194304] 0 2024-02-16T22:19:21.637 INFO:tasks.workunit.client.1.smithi173.stdout:0/777: dwrite d0/d12/d15/d3d/d98/d14/d24/d5f/fe8 [0,4194304] 0 2024-02-16T22:19:21.637 INFO:tasks.workunit.client.1.smithi173.stdout:0/778: fsync d0/d12/d15/d3d/d98/d14/d24/ddd/ff7 0 2024-02-16T22:19:21.637 INFO:tasks.workunit.client.1.smithi173.stdout:0/779: write d0/f95 [313327,78480] 0 2024-02-16T22:19:21.637 INFO:tasks.workunit.client.1.smithi173.stdout:4/826: dwrite d7/df/d62/dd8/f100 [0,4194304] 0 2024-02-16T22:19:21.638 INFO:tasks.workunit.client.1.smithi173.stdout:9/772: dwrite d1/d2/d1a/d2f/df4/d8c/fb6 [0,4194304] 0 2024-02-16T22:19:21.640 INFO:tasks.workunit.client.1.smithi173.stdout:0/780: dread d0/d12/d15/d3d/d98/d14/d50/f76 [0,4194304] 0 2024-02-16T22:19:21.642 INFO:tasks.workunit.client.1.smithi173.stdout:3/932: symlink d9/d1a/d2b/d4d/d5b/l141 0 2024-02-16T22:19:21.651 INFO:tasks.workunit.client.1.smithi173.stdout:4/827: rename d7/df/d110 to d7/df9/d11c 0 2024-02-16T22:19:21.651 INFO:tasks.workunit.client.1.smithi173.stdout:4/828: stat d7/d12/d7e/l88 0 2024-02-16T22:19:21.654 INFO:tasks.workunit.client.1.smithi173.stdout:9/773: unlink d1/d2/d1a/d3e/fa9 0 2024-02-16T22:19:21.656 INFO:tasks.workunit.client.1.smithi173.stdout:0/781: symlink d0/d12/l101 0 2024-02-16T22:19:21.657 INFO:tasks.workunit.client.1.smithi173.stdout:9/774: dread d1/f30 [0,4194304] 0 2024-02-16T22:19:21.657 INFO:tasks.workunit.client.1.smithi173.stdout:9/775: dread - d1/d2/da2/ff6 zero size 2024-02-16T22:19:21.658 INFO:tasks.workunit.client.1.smithi173.stdout:7/769: dwrite d1/d1d/d4c/d63/d48/f5d [0,4194304] 0 2024-02-16T22:19:21.658 INFO:tasks.workunit.client.1.smithi173.stdout:7/770: fdatasync d1/d1d/d4c/d63/d13/d36/d49/f7f 0 2024-02-16T22:19:21.658 INFO:tasks.workunit.client.1.smithi173.stdout:6/847: dwrite d0/db/d2e/d2f/d31/d33/f69 [0,4194304] 0 2024-02-16T22:19:21.659 INFO:tasks.workunit.client.1.smithi173.stdout:3/933: dwrite d9/d1a/d2b/d4d/f52 [4194304,4194304] 0 2024-02-16T22:19:21.660 INFO:tasks.workunit.client.1.smithi173.stdout:4/829: creat d7/df/d8b/da1/d114/f11d x:0 0 0 2024-02-16T22:19:21.660 INFO:tasks.workunit.client.1.smithi173.stdout:4/830: chown d7/d28/d31 10165 1 2024-02-16T22:19:21.662 INFO:tasks.workunit.client.1.smithi173.stdout:0/782: truncate d0/d84/d8c/fc4 193679 0 2024-02-16T22:19:21.667 INFO:tasks.workunit.client.1.smithi173.stdout:9/776: mknod d1/dcf/c100 0 2024-02-16T22:19:21.667 INFO:tasks.workunit.client.1.smithi173.stdout:9/777: readlink d1/d2/d1a/d1f/l37 0 2024-02-16T22:19:21.672 INFO:tasks.workunit.client.1.smithi173.stdout:7/771: mkdir d1/dd4/df4 0 2024-02-16T22:19:21.672 INFO:tasks.workunit.client.1.smithi173.stdout:7/772: read - d1/d1d/d4c/d63/d48/f8e zero size 2024-02-16T22:19:21.674 INFO:tasks.workunit.client.1.smithi173.stdout:8/930: sync 2024-02-16T22:19:21.678 INFO:tasks.workunit.client.1.smithi173.stdout:6/848: rename d0/db/c20 to d0/db/d4d/c131 0 2024-02-16T22:19:21.682 INFO:tasks.workunit.client.1.smithi173.stdout:4/831: mkdir d7/d12/d11e 0 2024-02-16T22:19:21.683 INFO:tasks.workunit.client.1.smithi173.stdout:5/891: sync 2024-02-16T22:19:21.684 INFO:tasks.workunit.client.1.smithi173.stdout:9/778: rmdir d1/d2/d1a/de1 0 2024-02-16T22:19:21.685 INFO:tasks.workunit.client.1.smithi173.stdout:3/934: dwrite d9/d1a/d2b/f2d [4194304,4194304] 0 2024-02-16T22:19:21.687 INFO:tasks.workunit.client.1.smithi173.stdout:7/773: link d1/d1d/d4c/d63/d48/f75 d1/d1d/d4c/d63/d11/ff5 0 2024-02-16T22:19:21.690 INFO:tasks.workunit.client.1.smithi173.stdout:4/832: truncate d7/f5f 468199 0 2024-02-16T22:19:21.691 INFO:tasks.workunit.client.1.smithi173.stdout:8/931: write dd/d7c/d7d/f60 [2592955,32932] 0 2024-02-16T22:19:21.691 INFO:tasks.workunit.client.1.smithi173.stdout:0/783: dwrite d0/d12/d15/d3d/dab/fb8 [0,4194304] 0 2024-02-16T22:19:21.691 INFO:tasks.workunit.client.1.smithi173.stdout:8/932: write dd/d7c/d7d/d22/f4e [5868238,106961] 0 2024-02-16T22:19:21.692 INFO:tasks.workunit.client.1.smithi173.stdout:5/892: symlink d8/d27/d63/l117 0 2024-02-16T22:19:21.695 INFO:tasks.workunit.client.1.smithi173.stdout:8/933: write dd/f86 [497875,4353] 0 2024-02-16T22:19:21.695 INFO:tasks.workunit.client.1.smithi173.stdout:8/934: write dd/d7c/d7d/d89/dad/f124 [630700,118072] 0 2024-02-16T22:19:21.697 INFO:tasks.workunit.client.1.smithi173.stdout:3/935: creat d9/d18/d5f/d6e/df9/d13d/f142 x:0 0 0 2024-02-16T22:19:21.697 INFO:tasks.workunit.client.1.smithi173.stdout:3/936: fdatasync d9/d1a/d2b/d4d/d5b/da9/db4/de2/f115 0 2024-02-16T22:19:21.697 INFO:tasks.workunit.client.1.smithi173.stdout:3/937: write d9/fb [8664689,23006] 0 2024-02-16T22:19:21.705 INFO:tasks.workunit.client.1.smithi173.stdout:6/849: dwrite d0/db/d2e/d2f/da6/ff5 [0,4194304] 0 2024-02-16T22:19:21.705 INFO:tasks.workunit.client.1.smithi173.stdout:6/850: dread - d0/db/d2e/d65/d73/da9/f11b zero size 2024-02-16T22:19:21.705 INFO:tasks.workunit.client.1.smithi173.stdout:6/851: readlink d0/db/d2e/d2f/d31/d33/l91 0 2024-02-16T22:19:21.707 INFO:tasks.workunit.client.1.smithi173.stdout:9/779: dwrite d1/d2/d1a/d2f/d3b/f84 [0,4194304] 0 2024-02-16T22:19:21.710 INFO:tasks.workunit.client.1.smithi173.stdout:5/893: dwrite d8/da/d2d/d36/d50/fe3 [0,4194304] 0 2024-02-16T22:19:21.710 INFO:tasks.workunit.client.1.smithi173.stdout:5/894: write d8/da/d1f/fb8 [1339049,74168] 0 2024-02-16T22:19:21.712 INFO:tasks.workunit.client.1.smithi173.stdout:4/833: symlink d7/d28/d31/d33/d7d/d4e/dd7/l11f 0 2024-02-16T22:19:21.717 INFO:tasks.workunit.client.1.smithi173.stdout:0/784: symlink d0/d12/d15/d3d/d98/d14/d38/df5/l102 0 2024-02-16T22:19:21.718 INFO:tasks.workunit.client.1.smithi173.stdout:8/935: mknod dd/d7c/d7d/d22/d28/d40/d69/df4/dff/d109/c125 0 2024-02-16T22:19:21.719 INFO:tasks.workunit.client.1.smithi173.stdout:3/938: unlink d9/d18/d5f/d6e/df9/f119 0 2024-02-16T22:19:21.721 INFO:tasks.workunit.client.1.smithi173.stdout:3/939: write d9/d18/d73/db7/d81/ddf/f104 [585839,46749] 0 2024-02-16T22:19:21.722 INFO:tasks.workunit.client.1.smithi173.stdout:5/895: dread f7 [0,4194304] 0 2024-02-16T22:19:21.722 INFO:tasks.workunit.client.1.smithi173.stdout:5/896: readlink d8/da/d2d/d56/l76 0 2024-02-16T22:19:21.722 INFO:tasks.workunit.client.1.smithi173.stdout:6/852: mkdir d0/db/d2e/d2f/da6/d132 0 2024-02-16T22:19:21.735 INFO:tasks.workunit.client.1.smithi173.stdout:3/940: write d9/f7c [437969,99468] 0 2024-02-16T22:19:21.735 INFO:tasks.workunit.client.1.smithi173.stdout:3/941: chown d9/d1a/d2b/d4d/d5b/da9/db4/de2/f115 5 1 2024-02-16T22:19:21.741 INFO:tasks.workunit.client.1.smithi173.stdout:5/897: dwrite d8/d27/d35/d8b/f9f [0,4194304] 0 2024-02-16T22:19:21.741 INFO:tasks.workunit.client.1.smithi173.stdout:5/898: chown d8/d27/d2f/ffd 72690 1 2024-02-16T22:19:21.745 INFO:tasks.workunit.client.1.smithi173.stdout:7/774: rmdir d1 39 2024-02-16T22:19:21.746 INFO:tasks.workunit.client.1.smithi173.stdout:3/942: write d9/d18/d5f/f69 [3381471,4810] 0 2024-02-16T22:19:21.746 INFO:tasks.workunit.client.1.smithi173.stdout:3/943: chown d9/d18/d73/db7/l95 210 1 2024-02-16T22:19:21.746 INFO:tasks.workunit.client.1.smithi173.stdout:3/944: readlink d9/da/l19 0 2024-02-16T22:19:21.749 INFO:tasks.workunit.client.1.smithi173.stdout:8/936: rename dd/d7c/d7d/d22/c2b to dd/d7c/d7d/c126 0 2024-02-16T22:19:21.749 INFO:tasks.workunit.client.1.smithi173.stdout:8/937: getdents dd/d7c/d7d/d93 0 2024-02-16T22:19:21.756 INFO:tasks.workunit.client.1.smithi173.stdout:3/945: mknod d9/d18/d73/c143 0 2024-02-16T22:19:21.757 INFO:tasks.workunit.client.1.smithi173.stdout:8/938: mkdir dd/d7c/d7d/d22/d28/d40/d69/df4/dff/d127 0 2024-02-16T22:19:21.760 INFO:tasks.workunit.client.1.smithi173.stdout:5/899: rename d8/da/d1f/db7/lf4 to d8/da/d1b/d57/dc9/l118 0 2024-02-16T22:19:21.761 INFO:tasks.workunit.client.1.smithi173.stdout:6/853: mkdir d0/d133 0 2024-02-16T22:19:21.765 INFO:tasks.workunit.client.1.smithi173.stdout:3/946: rename d9/d18/d5f/d6e/da7/f103 to d9/d18/daa/f144 0 2024-02-16T22:19:21.767 INFO:tasks.workunit.client.1.smithi173.stdout:7/775: dwrite d1/d1d/d4c/d63/d13/d36/d49/f86 [0,4194304] 0 2024-02-16T22:19:21.768 INFO:tasks.workunit.client.1.smithi173.stdout:5/900: link d8/da/d2d/d3a/da7/c81 d8/da/db0/c119 0 2024-02-16T22:19:21.768 INFO:tasks.workunit.client.1.smithi173.stdout:5/901: chown d8/da/d2d/d36/d50 4 1 2024-02-16T22:19:21.768 INFO:tasks.workunit.client.1.smithi173.stdout:5/902: creat d8/d27/d62/dfa/f11a x:0 0 0 2024-02-16T22:19:21.771 INFO:tasks.workunit.client.1.smithi173.stdout:6/854: link d0/d7c/dc5/d92/fb3 d0/db/d2e/d2f/d31/d33/d97/f134 0 2024-02-16T22:19:21.772 INFO:tasks.workunit.client.1.smithi173.stdout:3/947: symlink d9/d18/l145 0 2024-02-16T22:19:21.777 INFO:tasks.workunit.client.1.smithi173.stdout:8/939: dwrite dd/d7c/d7d/f39 [0,4194304] 0 2024-02-16T22:19:21.781 INFO:tasks.workunit.client.1.smithi173.stdout:7/776: mknod d1/d1d/d4c/d63/d13/d36/cf6 0 2024-02-16T22:19:21.781 INFO:tasks.workunit.client.1.smithi173.stdout:7/777: truncate d1/d1d/d4c/d63/d13/fa0 15427 0 2024-02-16T22:19:21.782 INFO:tasks.workunit.client.1.smithi173.stdout:6/855: dread d0/db/d2e/d2f/da6/ff5 [0,4194304] 0 2024-02-16T22:19:21.782 INFO:tasks.workunit.client.1.smithi173.stdout:6/856: truncate d0/db/f1a 4144450 0 2024-02-16T22:19:21.782 INFO:tasks.workunit.client.1.smithi173.stdout:6/857: truncate d0/d7c/fb0 1330323 0 2024-02-16T22:19:21.784 INFO:tasks.workunit.client.1.smithi173.stdout:6/858: write d0/db/d2e/d2f/d31/d7a/ffa [718530,126905] 0 2024-02-16T22:19:21.784 INFO:tasks.workunit.client.1.smithi173.stdout:5/903: mknod d8/da/db0/df0/c11b 0 2024-02-16T22:19:21.791 INFO:tasks.workunit.client.1.smithi173.stdout:3/948: unlink d9/d17/d93/lfa 0 2024-02-16T22:19:21.795 INFO:tasks.workunit.client.1.smithi173.stdout:5/904: mkdir d8/d11c 0 2024-02-16T22:19:21.797 INFO:tasks.workunit.client.1.smithi173.stdout:6/859: dread d0/db/d2e/d65/d73/d7d/fad [4194304,4194304] 0 2024-02-16T22:19:21.798 INFO:tasks.workunit.client.1.smithi173.stdout:5/905: rename d8/da/d2d/d36/dc2/lff to d8/da/d2d/d36/l11d 0 2024-02-16T22:19:21.800 INFO:tasks.workunit.client.1.smithi173.stdout:6/860: creat d0/d7c/f135 x:0 0 0 2024-02-16T22:19:21.802 INFO:tasks.workunit.client.1.smithi173.stdout:5/906: creat d8/da/d1b/f11e x:0 0 0 2024-02-16T22:19:21.804 INFO:tasks.workunit.client.1.smithi173.stdout:5/907: mknod d8/da/d1b/c11f 0 2024-02-16T22:19:21.807 INFO:tasks.workunit.client.1.smithi173.stdout:7/778: dwrite d1/fdc [0,4194304] 0 2024-02-16T22:19:21.807 INFO:tasks.workunit.client.1.smithi173.stdout:5/908: creat d8/d27/d35/d8b/f120 x:0 0 0 2024-02-16T22:19:21.807 INFO:tasks.workunit.client.1.smithi173.stdout:5/909: fsync d8/da/d2d/d56/fa5 0 2024-02-16T22:19:21.808 INFO:tasks.workunit.client.1.smithi173.stdout:3/949: dwrite d9/d18/daa/f144 [0,4194304] 0 2024-02-16T22:19:21.815 INFO:tasks.workunit.client.1.smithi173.stdout:7/779: mkdir d1/d1d/d4c/d63/d6c/dca/df7 0 2024-02-16T22:19:21.817 INFO:tasks.workunit.client.1.smithi173.stdout:5/910: write d8/da/d1b/d57/d105/f112 [777617,110512] 0 2024-02-16T22:19:21.819 INFO:tasks.workunit.client.1.smithi173.stdout:3/950: rename d9/d18/d5f/d6e/d4e/c9d to d9/d1a/d2b/d45/d60/d6a/d13f/c146 0 2024-02-16T22:19:21.821 INFO:tasks.workunit.client.1.smithi173.stdout:6/861: dwrite d0/db/d2e/d2f/d31/d33/f9c [0,4194304] 0 2024-02-16T22:19:21.821 INFO:tasks.workunit.client.1.smithi173.stdout:6/862: stat d0/d7c/dc5/d92/fb3 0 2024-02-16T22:19:21.821 INFO:tasks.workunit.client.1.smithi173.stdout:6/863: dread - d0/db/d2e/d65/d73/d100/d110/f126 zero size 2024-02-16T22:19:21.821 INFO:tasks.workunit.client.1.smithi173.stdout:7/780: link d1/d1d/d4c/d63/d13/l17 d1/d1d/d4c/d63/d54/lf8 0 2024-02-16T22:19:21.822 INFO:tasks.workunit.client.1.smithi173.stdout:5/911: creat d8/da/d1b/d57/dc9/f121 x:0 0 0 2024-02-16T22:19:21.824 INFO:tasks.workunit.client.1.smithi173.stdout:3/951: getdents d9/d18/d73/db7/d81 0 2024-02-16T22:19:21.827 INFO:tasks.workunit.client.1.smithi173.stdout:6/864: symlink d0/db/d4d/l136 0 2024-02-16T22:19:21.828 INFO:tasks.workunit.client.1.smithi173.stdout:7/781: creat d1/d1d/d4c/d63/d13/dce/ff9 x:0 0 0 2024-02-16T22:19:21.830 INFO:tasks.workunit.client.1.smithi173.stdout:5/912: unlink d8/da/d2d/d3a/da7/ff7 0 2024-02-16T22:19:21.834 INFO:tasks.workunit.client.1.smithi173.stdout:3/952: write d9/d18/d5f/d6e/df9/f108 [2016064,85011] 0 2024-02-16T22:19:21.834 INFO:tasks.workunit.client.1.smithi173.stdout:6/865: symlink d0/db/d2e/d2f/d31/d5d/l137 0 2024-02-16T22:19:21.834 INFO:tasks.workunit.client.1.smithi173.stdout:6/866: read - d0/db/d2e/d65/d73/d81/fce zero size 2024-02-16T22:19:21.838 INFO:tasks.workunit.client.1.smithi173.stdout:7/782: write d1/f41 [449771,53904] 0 2024-02-16T22:19:21.840 INFO:tasks.workunit.client.1.smithi173.stdout:7/783: dread d1/d1d/d4c/d63/d48/faa [0,4194304] 0 2024-02-16T22:19:21.843 INFO:tasks.workunit.client.1.smithi173.stdout:3/953: dread d9/d18/d5f/d6e/da7/ff7 [0,4194304] 0 2024-02-16T22:19:21.844 INFO:tasks.workunit.client.1.smithi173.stdout:5/913: rmdir d8/d27/d62/dfa 39 2024-02-16T22:19:21.846 INFO:tasks.workunit.client.1.smithi173.stdout:5/914: truncate d8/da/d1f/fb8 724621 0 2024-02-16T22:19:21.851 INFO:tasks.workunit.client.1.smithi173.stdout:5/915: rename d8/da/d1f/d30/d9b/f9c to d8/d27/d2f/f122 0 2024-02-16T22:19:21.859 INFO:tasks.workunit.client.1.smithi173.stdout:6/867: dwrite d0/db/d2e/d2f/d31/d7a/ffa [0,4194304] 0 2024-02-16T22:19:21.860 INFO:tasks.workunit.client.1.smithi173.stdout:3/954: write d9/d1a/d2b/d4d/f6b [4037357,31154] 0 2024-02-16T22:19:21.860 INFO:tasks.workunit.client.1.smithi173.stdout:7/784: dwrite d1/d1d/d4c/d63/d48/f75 [0,4194304] 0 2024-02-16T22:19:21.867 INFO:tasks.workunit.client.1.smithi173.stdout:3/955: dread d9/f7c [0,4194304] 0 2024-02-16T22:19:21.872 INFO:tasks.workunit.client.1.smithi173.stdout:1/827: sync 2024-02-16T22:19:21.873 INFO:tasks.workunit.client.1.smithi173.stdout:3/956: creat d9/d18/d5f/f147 x:0 0 0 2024-02-16T22:19:21.882 INFO:tasks.workunit.client.1.smithi173.stdout:5/916: truncate d8/da/d1f/fb8 786796 0 2024-02-16T22:19:21.883 INFO:tasks.workunit.client.1.smithi173.stdout:5/917: symlink d8/da/d1f/d8c/l123 0 2024-02-16T22:19:21.889 INFO:tasks.workunit.client.1.smithi173.stdout:3/957: write d9/da/f85 [7817540,25756] 0 2024-02-16T22:19:21.889 INFO:tasks.workunit.client.1.smithi173.stdout:3/958: chown d9/d1a/d2b/d4d/c55 162 1 2024-02-16T22:19:21.889 INFO:tasks.workunit.client.1.smithi173.stdout:3/959: fdatasync d9/d18/f3c 0 2024-02-16T22:19:21.889 INFO:tasks.workunit.client.1.smithi173.stdout:3/960: creat d9/d1a/d2b/d4d/d5b/da9/db4/de2/f148 x:0 0 0 2024-02-16T22:19:21.894 INFO:tasks.workunit.client.1.smithi173.stdout:3/961: getdents d9/d17/d25 0 2024-02-16T22:19:21.894 INFO:tasks.workunit.client.1.smithi173.stdout:3/962: creat d9/d1a/d2b/f149 x:0 0 0 2024-02-16T22:19:21.894 INFO:tasks.workunit.client.1.smithi173.stdout:3/963: read - d9/d1a/d2b/d4d/d94/f124 zero size 2024-02-16T22:19:21.895 INFO:tasks.workunit.client.1.smithi173.stdout:3/964: mkdir d9/d18/d14a 0 2024-02-16T22:19:21.895 INFO:tasks.workunit.client.1.smithi173.stdout:3/965: readlink d9/d1a/d2b/d4d/d94/d98/l11f 0 2024-02-16T22:19:21.896 INFO:tasks.workunit.client.1.smithi173.stdout:3/966: mknod d9/d18/d73/db7/c14b 0 2024-02-16T22:19:21.896 INFO:tasks.workunit.client.1.smithi173.stdout:3/967: write d9/f7c [3397502,28643] 0 2024-02-16T22:19:21.896 INFO:tasks.workunit.client.1.smithi173.stdout:3/968: dread - d9/d18/d5f/f147 zero size 2024-02-16T22:19:21.896 INFO:tasks.workunit.client.1.smithi173.stdout:3/969: write d9/d17/d25/ddc/f12b [181224,24474] 0 2024-02-16T22:19:21.907 INFO:tasks.workunit.client.1.smithi173.stdout:6/868: dwrite d0/db/d4d/f5f [0,4194304] 0 2024-02-16T22:19:21.908 INFO:tasks.workunit.client.1.smithi173.stdout:1/828: dwrite db/d1c/d25/f10e [0,4194304] 0 2024-02-16T22:19:21.908 INFO:tasks.workunit.client.1.smithi173.stdout:3/970: write d9/d1a/fb6 [1346779,9847] 0 2024-02-16T22:19:21.908 INFO:tasks.workunit.client.1.smithi173.stdout:7/785: dwrite d1/d1d/d4c/d63/d11/fcc [0,4194304] 0 2024-02-16T22:19:21.908 INFO:tasks.workunit.client.1.smithi173.stdout:5/918: dwrite d8/f7d [0,4194304] 0 2024-02-16T22:19:21.909 INFO:tasks.workunit.client.1.smithi173.stdout:6/869: mknod d0/db/d2e/d2f/d31/d33/d97/c138 0 2024-02-16T22:19:21.912 INFO:tasks.workunit.client.1.smithi173.stdout:2/816: sync 2024-02-16T22:19:21.912 INFO:tasks.workunit.client.1.smithi173.stdout:2/817: fdatasync d2/d4/d8/f95 0 2024-02-16T22:19:21.916 INFO:tasks.workunit.client.1.smithi173.stdout:7/786: rmdir d1/d1d/d4c/d63/d48/d9a/ded 0 2024-02-16T22:19:21.920 INFO:tasks.workunit.client.1.smithi173.stdout:6/870: mknod d0/db/d2e/d2f/c139 0 2024-02-16T22:19:21.922 INFO:tasks.workunit.client.1.smithi173.stdout:2/818: truncate d2/dc/d19/d1c/d53/fea 470571 0 2024-02-16T22:19:21.922 INFO:tasks.workunit.client.1.smithi173.stdout:2/819: fdatasync d2/dc/d19/d69/fa2 0 2024-02-16T22:19:21.922 INFO:tasks.workunit.client.1.smithi173.stdout:2/820: write d2/dc/d19/d1a/d74/db2/dec/f106 [814121,54811] 0 2024-02-16T22:19:21.923 INFO:tasks.workunit.client.1.smithi173.stdout:7/787: creat d1/d1d/d4c/d63/d13/d22/d7e/dc2/ffa x:0 0 0 2024-02-16T22:19:21.927 INFO:tasks.workunit.client.1.smithi173.stdout:5/919: rename d8/da/d1b/d57/dcb/de8/l101 to d8/da/d1f/d30/l124 0 2024-02-16T22:19:21.928 INFO:tasks.workunit.client.1.smithi173.stdout:1/829: dwrite db/d1c/d25/d28/fc9 [4194304,4194304] 0 2024-02-16T22:19:21.930 INFO:tasks.workunit.client.1.smithi173.stdout:6/871: write d0/db/f29 [747267,109749] 0 2024-02-16T22:19:21.930 INFO:tasks.workunit.client.1.smithi173.stdout:3/971: dwrite d9/d17/d25/dcf/f106 [0,4194304] 0 2024-02-16T22:19:21.931 INFO:tasks.workunit.client.1.smithi173.stdout:7/788: rename d1/d1d/d4c/d63/d13/d22/d53/db9/de1 to d1/d1d/d4c/d63/d13/d36/dd6/dfb 0 2024-02-16T22:19:21.932 INFO:tasks.workunit.client.1.smithi173.stdout:5/920: mkdir d8/d125 0 2024-02-16T22:19:21.932 INFO:tasks.workunit.client.1.smithi173.stdout:5/921: chown d8/da/d1f/d8c/lb9 15 1 2024-02-16T22:19:21.933 INFO:tasks.workunit.client.1.smithi173.stdout:5/922: write d8/f26 [1912097,31641] 0 2024-02-16T22:19:21.933 INFO:tasks.workunit.client.1.smithi173.stdout:2/821: write d2/d4/d8/d3a/f47 [3572417,1383] 0 2024-02-16T22:19:21.933 INFO:tasks.workunit.client.1.smithi173.stdout:2/822: truncate d2/d4/d57/f91 1531583 0 2024-02-16T22:19:21.933 INFO:tasks.workunit.client.1.smithi173.stdout:2/823: fsync d2/d4/d8/d2d/fb8 0 2024-02-16T22:19:21.934 INFO:tasks.workunit.client.1.smithi173.stdout:3/972: dread d9/d18/d73/fc8 [0,4194304] 0 2024-02-16T22:19:21.934 INFO:tasks.workunit.client.1.smithi173.stdout:3/973: fsync d9/d17/d93/fd0 0 2024-02-16T22:19:21.934 INFO:tasks.workunit.client.1.smithi173.stdout:3/974: readlink d9/d1a/l9b 0 2024-02-16T22:19:21.934 INFO:tasks.workunit.client.1.smithi173.stdout:1/830: symlink db/d29/d50/d85/l118 0 2024-02-16T22:19:21.935 INFO:tasks.workunit.client.1.smithi173.stdout:1/831: creat db/d29/d57/d73/f119 x:0 0 0 2024-02-16T22:19:21.945 INFO:tasks.workunit.client.1.smithi173.stdout:5/923: truncate f7 801781 0 2024-02-16T22:19:21.946 INFO:tasks.workunit.client.1.smithi173.stdout:5/924: chown d8/da/db0 35 1 2024-02-16T22:19:21.946 INFO:tasks.workunit.client.1.smithi173.stdout:5/925: write d8/f6a [3324265,99707] 0 2024-02-16T22:19:21.946 INFO:tasks.workunit.client.1.smithi173.stdout:2/824: rmdir d2/dc/d19/da3/da4 39 2024-02-16T22:19:21.946 INFO:tasks.workunit.client.1.smithi173.stdout:1/832: dread db/d1c/d25/d28/f6c [0,4194304] 0 2024-02-16T22:19:21.948 INFO:tasks.workunit.client.1.smithi173.stdout:3/975: link d9/d1a/d2b/d4d/f8c d9/d1a/d2b/d4d/d5b/da9/f14c 0 2024-02-16T22:19:21.950 INFO:tasks.workunit.client.1.smithi173.stdout:1/833: mknod db/d29/d50/d85/dde/c11a 0 2024-02-16T22:19:21.950 INFO:tasks.workunit.client.1.smithi173.stdout:1/834: chown db/d29/d50/d85/fec 0 1 2024-02-16T22:19:21.951 INFO:tasks.workunit.client.1.smithi173.stdout:3/976: symlink d9/d17/d25/dcf/l14d 0 2024-02-16T22:19:21.951 INFO:tasks.workunit.client.1.smithi173.stdout:3/977: chown d9/d1a/d2b/d4d/d5b/da9/d139/f135 188829957 1 2024-02-16T22:19:21.951 INFO:tasks.workunit.client.1.smithi173.stdout:3/978: getdents d9/d18/d73/db7/d130 0 2024-02-16T22:19:21.953 INFO:tasks.workunit.client.1.smithi173.stdout:3/979: truncate d9/d1a/d2b/d4d/f8c 1721584 0 2024-02-16T22:19:21.953 INFO:tasks.workunit.client.1.smithi173.stdout:6/872: dwrite d0/db/d4d/f76 [0,4194304] 0 2024-02-16T22:19:21.953 INFO:tasks.workunit.client.1.smithi173.stdout:3/980: dread - d9/d18/daa/df0/d10b/f10e zero size 2024-02-16T22:19:21.953 INFO:tasks.workunit.client.1.smithi173.stdout:6/873: dread - d0/db/d2e/d2f/da6/f104 zero size 2024-02-16T22:19:21.956 INFO:tasks.workunit.client.1.smithi173.stdout:6/874: unlink d0/db/d2e/d2f/c3f 0 2024-02-16T22:19:21.960 INFO:tasks.workunit.client.1.smithi173.stdout:5/926: write d8/d27/d28/f39 [3128862,17607] 0 2024-02-16T22:19:21.960 INFO:tasks.workunit.client.1.smithi173.stdout:5/927: chown d8/da/d1b/d57/c7f 1801 1 2024-02-16T22:19:21.960 INFO:tasks.workunit.client.1.smithi173.stdout:7/789: dwrite d1/d1d/d4c/d63/d54/f70 [8388608,4194304] 0 2024-02-16T22:19:21.960 INFO:tasks.workunit.client.1.smithi173.stdout:1/835: dread db/d1c/d25/d28/f3a [4194304,4194304] 0 2024-02-16T22:19:21.960 INFO:tasks.workunit.client.1.smithi173.stdout:5/928: creat d8/da/db0/f126 x:0 0 0 2024-02-16T22:19:21.960 INFO:tasks.workunit.client.1.smithi173.stdout:1/836: chown db/d1c/d5c/daf/cb4 2831 1 2024-02-16T22:19:21.960 INFO:tasks.workunit.client.1.smithi173.stdout:2/825: dwrite d2/dc/d19/dc4/fdd [0,4194304] 0 2024-02-16T22:19:21.969 INFO:tasks.workunit.client.1.smithi173.stdout:3/981: dread d9/f7c [0,4194304] 0 2024-02-16T22:19:21.970 INFO:tasks.workunit.client.1.smithi173.stdout:7/790: creat d1/d1d/d4c/d63/d6c/ffc x:0 0 0 2024-02-16T22:19:21.973 INFO:tasks.workunit.client.1.smithi173.stdout:2/826: creat d2/d4/d8/d2d/de6/f108 x:0 0 0 2024-02-16T22:19:21.973 INFO:tasks.workunit.client.1.smithi173.stdout:2/827: readlink d2/d4/d8/d30/d44/d81/d99/dda/l104 0 2024-02-16T22:19:21.973 INFO:tasks.workunit.client.1.smithi173.stdout:2/828: fsync d2/dc/d19/d1a/fc2 0 2024-02-16T22:19:21.976 INFO:tasks.workunit.client.1.smithi173.stdout:2/829: dread d2/dc/d19/d1c/d53/f7e [0,4194304] 0 2024-02-16T22:19:21.978 INFO:tasks.workunit.client.1.smithi173.stdout:1/837: dread db/f18 [0,4194304] 0 2024-02-16T22:19:21.979 INFO:tasks.workunit.client.1.smithi173.stdout:2/830: rmdir d2/d4/d8/d3a 39 2024-02-16T22:19:21.979 INFO:tasks.workunit.client.1.smithi173.stdout:2/831: write d2/dc/d19/f51 [1743936,128338] 0 2024-02-16T22:19:21.979 INFO:tasks.workunit.client.1.smithi173.stdout:2/832: read d2/d4/d8/f98 [2097996,45037] 0 2024-02-16T22:19:21.980 INFO:tasks.workunit.client.1.smithi173.stdout:8/940: sync 2024-02-16T22:19:21.980 INFO:tasks.workunit.client.1.smithi173.stdout:8/941: write dd/d7c/d7d/d22/d28/d40/d69/da7/dae/f123 [282409,111736] 0 2024-02-16T22:19:21.980 INFO:tasks.workunit.client.1.smithi173.stdout:0/785: sync 2024-02-16T22:19:21.980 INFO:tasks.workunit.client.1.smithi173.stdout:4/834: sync 2024-02-16T22:19:21.981 INFO:tasks.workunit.client.1.smithi173.stdout:6/875: dread d0/d7c/dc5/d92/fe4 [0,4194304] 0 2024-02-16T22:19:21.983 INFO:tasks.workunit.client.1.smithi173.stdout:9/780: sync 2024-02-16T22:19:21.983 INFO:tasks.workunit.client.1.smithi173.stdout:9/781: dread - d1/d2/d1a/d3e/dc8/fd2 zero size 2024-02-16T22:19:21.983 INFO:tasks.workunit.client.1.smithi173.stdout:1/838: creat db/d29/d83/dc2/f11b x:0 0 0 2024-02-16T22:19:21.986 INFO:tasks.workunit.client.1.smithi173.stdout:2/833: symlink d2/d10/d62/d6c/dcd/dff/l109 0 2024-02-16T22:19:21.990 INFO:tasks.workunit.client.1.smithi173.stdout:8/942: creat dd/d7c/d7d/d22/d28/f128 x:0 0 0 2024-02-16T22:19:21.995 INFO:tasks.workunit.client.1.smithi173.stdout:9/782: dread d1/f12 [8388608,4194304] 0 2024-02-16T22:19:21.995 INFO:tasks.workunit.client.1.smithi173.stdout:9/783: truncate d1/d2/d1a/d3e/fd0 844353 0 2024-02-16T22:19:21.995 INFO:tasks.workunit.client.1.smithi173.stdout:9/784: write d1/d5f/d6d/d97/fff [363422,61580] 0 2024-02-16T22:19:21.995 INFO:tasks.workunit.client.1.smithi173.stdout:9/785: creat d1/d2/dec/f101 x:0 0 0 2024-02-16T22:19:21.996 INFO:tasks.workunit.client.1.smithi173.stdout:6/876: creat d0/db/d2e/d65/db8/de1/d116/f13a x:0 0 0 2024-02-16T22:19:21.996 INFO:tasks.workunit.client.1.smithi173.stdout:6/877: fsync d0/db/d2e/d2f/d31/d33/d97/fa8 0 2024-02-16T22:19:21.996 INFO:tasks.workunit.client.1.smithi173.stdout:6/878: truncate d0/db/d2e/d2f/fc1 597646 0 2024-02-16T22:19:21.998 INFO:tasks.workunit.client.1.smithi173.stdout:3/982: dwrite d9/d1a/d2b/f10a [4194304,4194304] 0 2024-02-16T22:19:21.998 INFO:tasks.workunit.client.1.smithi173.stdout:3/983: chown d9/d1a/fb6 1327406638 1 2024-02-16T22:19:21.998 INFO:tasks.workunit.client.1.smithi173.stdout:3/984: read - d9/d17/d25/f10c zero size 2024-02-16T22:19:21.999 INFO:tasks.workunit.client.1.smithi173.stdout:3/985: write d9/d18/d73/f75 [4392943,15052] 0 2024-02-16T22:19:21.999 INFO:tasks.workunit.client.1.smithi173.stdout:3/986: chown d9/d1a/d2b/d4d/d118/d132/c12c 62550677 1 2024-02-16T22:19:22.002 INFO:tasks.workunit.client.1.smithi173.stdout:7/791: dwrite d1/d1d/d4c/d63/d6c/ffc [0,4194304] 0 2024-02-16T22:19:22.002 INFO:tasks.workunit.client.1.smithi173.stdout:7/792: readlink d1/d1d/d4c/d63/d6c/la9 0 2024-02-16T22:19:22.002 INFO:tasks.workunit.client.1.smithi173.stdout:7/793: dread - d1/d1d/d4c/d63/d6c/fc3 zero size 2024-02-16T22:19:22.002 INFO:tasks.workunit.client.1.smithi173.stdout:7/794: chown d1/d1d/d4c/d63/d13/lc4 1276 1 2024-02-16T22:19:22.002 INFO:tasks.workunit.client.1.smithi173.stdout:7/795: readlink d1/d1d/d4c/d63/d48/l7b 0 2024-02-16T22:19:22.005 INFO:tasks.workunit.client.1.smithi173.stdout:1/839: unlink db/d1c/l21 0 2024-02-16T22:19:22.008 INFO:tasks.workunit.client.1.smithi173.stdout:2/834: symlink d2/dc/d19/da3/d107/l10a 0 2024-02-16T22:19:22.010 INFO:tasks.workunit.client.1.smithi173.stdout:0/786: getdents d0/d12/d15/d3d/d98/d14/d24/d58 0 2024-02-16T22:19:22.011 INFO:tasks.workunit.client.1.smithi173.stdout:4/835: dwrite d7/d12/dda/ff7 [0,4194304] 0 2024-02-16T22:19:22.015 INFO:tasks.workunit.client.1.smithi173.stdout:9/786: creat d1/d2/d1a/d2f/d3b/f102 x:0 0 0 2024-02-16T22:19:22.017 INFO:tasks.workunit.client.1.smithi173.stdout:6/879: read d0/fd [1302353,55820] 0 2024-02-16T22:19:22.018 INFO:tasks.workunit.client.1.smithi173.stdout:8/943: dwrite dd/d7c/d7d/d89/dad/f124 [0,4194304] 0 2024-02-16T22:19:22.025 INFO:tasks.workunit.client.1.smithi173.stdout:7/796: truncate d1/d1d/d4c/d63/d13/d22/d53/d27/f65 157684 0 2024-02-16T22:19:22.026 INFO:tasks.workunit.client.1.smithi173.stdout:7/797: write d1/d1d/d4c/d63/d13/d36/d49/f7d [1909726,57890] 0 2024-02-16T22:19:22.027 INFO:tasks.workunit.client.1.smithi173.stdout:1/840: creat db/d5f/f11c x:0 0 0 2024-02-16T22:19:22.031 INFO:tasks.workunit.client.1.smithi173.stdout:2/835: mknod d2/d4/d8/d3a/c10b 0 2024-02-16T22:19:22.031 INFO:tasks.workunit.client.1.smithi173.stdout:2/836: fdatasync d2/f3c 0 2024-02-16T22:19:22.031 INFO:tasks.workunit.client.1.smithi173.stdout:2/837: chown d2/dc/d19/d69 155223 1 2024-02-16T22:19:22.034 INFO:tasks.workunit.client.1.smithi173.stdout:0/787: symlink d0/d12/d15/d3d/d98/d14/d50/l103 0 2024-02-16T22:19:22.034 INFO:tasks.workunit.client.1.smithi173.stdout:0/788: dread - d0/d12/d15/d3d/d98/d14/d24/d2e/d6b/d8e/ffc zero size 2024-02-16T22:19:22.034 INFO:tasks.workunit.client.1.smithi173.stdout:0/789: fsync d0/f10 0 2024-02-16T22:19:22.034 INFO:tasks.workunit.client.1.smithi173.stdout:0/790: creat d0/d12/d15/d4f/f104 x:0 0 0 2024-02-16T22:19:22.035 INFO:tasks.workunit.client.1.smithi173.stdout:0/791: dread d0/d84/d8c/fc4 [0,4194304] 0 2024-02-16T22:19:22.035 INFO:tasks.workunit.client.1.smithi173.stdout:0/792: write d0/d12/d15/d3d/d98/d14/f71 [5052224,1755] 0 2024-02-16T22:19:22.035 INFO:tasks.workunit.client.1.smithi173.stdout:0/793: dread - d0/d84/fb6 zero size 2024-02-16T22:19:22.038 INFO:tasks.workunit.client.1.smithi173.stdout:2/838: dread d2/d4/d8/d3a/fe7 [0,4194304] 0 2024-02-16T22:19:22.039 INFO:tasks.workunit.client.1.smithi173.stdout:9/787: dwrite d1/d2/d1a/d2f/f8e [0,4194304] 0 2024-02-16T22:19:22.040 INFO:tasks.workunit.client.1.smithi173.stdout:6/880: dwrite d0/db/d2e/f30 [0,4194304] 0 2024-02-16T22:19:22.042 INFO:tasks.workunit.client.1.smithi173.stdout:8/944: getdents dd/d7c/d7d 0 2024-02-16T22:19:22.047 INFO:tasks.workunit.client.1.smithi173.stdout:0/794: dread d0/d12/d15/f85 [0,4194304] 0 2024-02-16T22:19:22.047 INFO:tasks.workunit.client.1.smithi173.stdout:0/795: dread - d0/d12/d15/d3d/d98/f89 zero size 2024-02-16T22:19:22.047 INFO:tasks.workunit.client.1.smithi173.stdout:7/798: symlink d1/d1d/d4c/d80/lfd 0 2024-02-16T22:19:22.047 INFO:tasks.workunit.client.1.smithi173.stdout:1/841: rename db/d30/fee to db/d1c/d7f/f11d 0 2024-02-16T22:19:22.047 INFO:tasks.workunit.client.1.smithi173.stdout:1/842: read - db/d1c/d7f/d98/df9/ffb zero size 2024-02-16T22:19:22.048 INFO:tasks.workunit.client.1.smithi173.stdout:4/836: getdents d7/d28/d31/d33/dcb 0 2024-02-16T22:19:22.053 INFO:tasks.workunit.client.1.smithi173.stdout:2/839: creat d2/d4/d8/d3a/de1/f10c x:0 0 0 2024-02-16T22:19:22.053 INFO:tasks.workunit.client.1.smithi173.stdout:2/840: readlink d2/d4/l3d 0 2024-02-16T22:19:22.053 INFO:tasks.workunit.client.1.smithi173.stdout:9/788: symlink d1/d2/l103 0 2024-02-16T22:19:22.053 INFO:tasks.workunit.client.1.smithi173.stdout:8/945: truncate dd/d7c/d7d/d22/d2e/d41/d6b/f8e 2015705 0 2024-02-16T22:19:22.056 INFO:tasks.workunit.client.1.smithi173.stdout:0/796: link d0/d12/d15/d4f/d92/la7 d0/d84/d8c/l105 0 2024-02-16T22:19:22.056 INFO:tasks.workunit.client.1.smithi173.stdout:0/797: dread - d0/d12/d15/d3d/d98/d33/fcd zero size 2024-02-16T22:19:22.056 INFO:tasks.workunit.client.1.smithi173.stdout:0/798: getdents d0/d12/d15/d3d/d98/d14/d24/d58 0 2024-02-16T22:19:22.056 INFO:tasks.workunit.client.1.smithi173.stdout:0/799: readlink d0/d12/d15/d3d/d98/d33/d54/ld5 0 2024-02-16T22:19:22.056 INFO:tasks.workunit.client.1.smithi173.stdout:0/800: readlink d0/d12/l77 0 2024-02-16T22:19:22.056 INFO:tasks.workunit.client.1.smithi173.stdout:1/843: rmdir db/d29/d83/d10a 39 2024-02-16T22:19:22.056 INFO:tasks.workunit.client.1.smithi173.stdout:1/844: dread db/fd2 [0,4194304] 0 2024-02-16T22:19:22.063 INFO:tasks.workunit.client.1.smithi173.stdout:4/837: mkdir d7/d28/d10a/d120 0 2024-02-16T22:19:22.064 INFO:tasks.workunit.client.1.smithi173.stdout:9/789: symlink d1/dd7/l104 0 2024-02-16T22:19:22.065 INFO:tasks.workunit.client.1.smithi173.stdout:1/845: mkdir db/d1c/d25/d28/d3f/d4a/d11e 0 2024-02-16T22:19:22.065 INFO:tasks.workunit.client.1.smithi173.stdout:0/801: write d0/d12/d15/d86/ff6 [2871895,80643] 0 2024-02-16T22:19:22.066 INFO:tasks.workunit.client.1.smithi173.stdout:1/846: dread db/d1d/f20 [0,4194304] 0 2024-02-16T22:19:22.067 INFO:tasks.workunit.client.1.smithi173.stdout:1/847: creat db/d29/d50/d85/f11f x:0 0 0 2024-02-16T22:19:22.067 INFO:tasks.workunit.client.1.smithi173.stdout:9/790: rename d1/dd7/lf1 to d1/d2/d1a/d2f/d51/d96/l105 0 2024-02-16T22:19:22.068 INFO:tasks.workunit.client.1.smithi173.stdout:6/881: dwrite d0/db/d2e/d61/f8a [0,4194304] 0 2024-02-16T22:19:22.068 INFO:tasks.workunit.client.1.smithi173.stdout:6/882: fdatasync d0/db/d2e/d2f/f8d 0 2024-02-16T22:19:22.071 INFO:tasks.workunit.client.1.smithi173.stdout:1/848: creat db/d1c/d25/d28/d3f/d4a/f120 x:0 0 0 2024-02-16T22:19:22.071 INFO:tasks.workunit.client.1.smithi173.stdout:1/849: dread - db/d29/d50/d85/dde/f103 zero size 2024-02-16T22:19:22.072 INFO:tasks.workunit.client.1.smithi173.stdout:2/841: dwrite d2/d10/f66 [0,4194304] 0 2024-02-16T22:19:22.072 INFO:tasks.workunit.client.1.smithi173.stdout:2/842: truncate d2/d10/d62/fcf 266206 0 2024-02-16T22:19:22.072 INFO:tasks.workunit.client.1.smithi173.stdout:2/843: dread - d2/dc/d19/d1a/d74/db2/ddc/fee zero size 2024-02-16T22:19:22.076 INFO:tasks.workunit.client.1.smithi173.stdout:7/799: write d1/d1d/d4c/d63/d13/d36/d49/f7d [1648880,97759] 0 2024-02-16T22:19:22.078 INFO:tasks.workunit.client.1.smithi173.stdout:1/850: dread db/d1c/d25/d28/f3a [4194304,4194304] 0 2024-02-16T22:19:22.079 INFO:tasks.workunit.client.1.smithi173.stdout:9/791: dread d1/d2/d10/fc0 [0,4194304] 0 2024-02-16T22:19:22.079 INFO:tasks.workunit.client.1.smithi173.stdout:9/792: fsync d1/d2/d1a/d2f/d3b/f102 0 2024-02-16T22:19:22.079 INFO:tasks.workunit.client.1.smithi173.stdout:0/802: rename d0/d12/d15/d3d/d98/d33/d54/lec to d0/d12/d15/d4f/d92/l106 0 2024-02-16T22:19:22.080 INFO:tasks.workunit.client.1.smithi173.stdout:6/883: symlink d0/db/d2e/d65/d73/d81/l13b 0 2024-02-16T22:19:22.080 INFO:tasks.workunit.client.1.smithi173.stdout:6/884: chown d0/db/d2e/d65/db8/de1 51 1 2024-02-16T22:19:22.087 INFO:tasks.workunit.client.1.smithi173.stdout:7/800: mkdir d1/d1d/d4c/d80/dfe 0 2024-02-16T22:19:22.088 INFO:tasks.workunit.client.1.smithi173.stdout:6/885: write d0/db/d2e/d65/d73/d7d/f101 [757259,80320] 0 2024-02-16T22:19:22.089 INFO:tasks.workunit.client.1.smithi173.stdout:1/851: mkdir db/d29/d83/d121 0 2024-02-16T22:19:22.089 INFO:tasks.workunit.client.1.smithi173.stdout:1/852: stat db/d1d/dcf 0 2024-02-16T22:19:22.092 INFO:tasks.workunit.client.1.smithi173.stdout:0/803: unlink d0/f95 0 2024-02-16T22:19:22.097 INFO:tasks.workunit.client.1.smithi173.stdout:9/793: rename d1/d2/d1a/d1f/d34/d49/fa5 to d1/d2/d1a/d8b/f106 0 2024-02-16T22:19:22.100 INFO:tasks.workunit.client.1.smithi173.stdout:7/801: link d1/d1d/d4c/d63/d6c/f77 d1/fff 0 2024-02-16T22:19:22.100 INFO:tasks.workunit.client.1.smithi173.stdout:7/802: chown d1/d1d/f4e 20243 1 2024-02-16T22:19:22.100 INFO:tasks.workunit.client.1.smithi173.stdout:8/946: dwrite dd/d7c/d7d/d22/d28/d40/d69/df4/d118/f119 [0,4194304] 0 2024-02-16T22:19:22.101 INFO:tasks.workunit.client.1.smithi173.stdout:8/947: write dd/d7c/d7d/d22/d2e/f94 [983207,102053] 0 2024-02-16T22:19:22.102 INFO:tasks.workunit.client.1.smithi173.stdout:6/886: mkdir d0/db/d2e/d65/d9f/d10b/d13c 0 2024-02-16T22:19:22.106 INFO:tasks.workunit.client.1.smithi173.stdout:0/804: rename d0/d12/d15/d3d/d98/d14/d24/d70/cfa to d0/d84/d8c/c107 0 2024-02-16T22:19:22.106 INFO:tasks.workunit.client.1.smithi173.stdout:0/805: readlink d0/d12/d15/d3d/d98/d14/d24/l9b 0 2024-02-16T22:19:22.107 INFO:tasks.workunit.client.1.smithi173.stdout:7/803: symlink d1/d1d/d4c/d63/d13/d22/d53/d27/l100 0 2024-02-16T22:19:22.107 INFO:tasks.workunit.client.1.smithi173.stdout:7/804: fdatasync d1/d1d/d4c/d63/d13/d22/d53/d27/f65 0 2024-02-16T22:19:22.107 INFO:tasks.workunit.client.1.smithi173.stdout:7/805: write d1/d1d/d4c/d63/d11/fb0 [4399952,27437] 0 2024-02-16T22:19:22.110 INFO:tasks.workunit.client.1.smithi173.stdout:1/853: dwrite db/d1d/f84 [0,4194304] 0 2024-02-16T22:19:22.110 INFO:tasks.workunit.client.1.smithi173.stdout:1/854: stat db/d1c/d25/d28/c3c 0 2024-02-16T22:19:22.111 INFO:tasks.workunit.client.1.smithi173.stdout:4/838: dwrite d7/dd5/f44 [4194304,4194304] 0 2024-02-16T22:19:22.112 INFO:tasks.workunit.client.1.smithi173.stdout:8/948: symlink dd/d7c/d7d/d22/d28/d40/l129 0 2024-02-16T22:19:22.112 INFO:tasks.workunit.client.1.smithi173.stdout:9/794: dread d1/d2/f4c [0,4194304] 0 2024-02-16T22:19:22.112 INFO:tasks.workunit.client.1.smithi173.stdout:9/795: chown d1/d5f/d61/d80/c7b 61 1 2024-02-16T22:19:22.113 INFO:tasks.workunit.client.1.smithi173.stdout:0/806: mkdir d0/d12/d108 0 2024-02-16T22:19:22.118 INFO:tasks.workunit.client.1.smithi173.stdout:6/887: dwrite d0/d7c/dc5/f120 [0,4194304] 0 2024-02-16T22:19:22.120 INFO:tasks.workunit.client.1.smithi173.stdout:6/888: dread d0/db/f115 [0,4194304] 0 2024-02-16T22:19:22.121 INFO:tasks.workunit.client.1.smithi173.stdout:4/839: creat d7/d12/d11e/f121 x:0 0 0 2024-02-16T22:19:22.122 INFO:tasks.workunit.client.1.smithi173.stdout:8/949: rmdir dd/d7c/d7d/d89/db0/d113 39 2024-02-16T22:19:22.125 INFO:tasks.workunit.client.1.smithi173.stdout:9/796: rmdir d1/d2/d1a/d2f/d51/d96/db3 39 2024-02-16T22:19:22.125 INFO:tasks.workunit.client.1.smithi173.stdout:9/797: chown d1/d2/d1a/d1f/d34/d49/d88/lcd 0 1 2024-02-16T22:19:22.125 INFO:tasks.workunit.client.1.smithi173.stdout:0/807: creat d0/d12/dce/ddb/f109 x:0 0 0 2024-02-16T22:19:22.129 INFO:tasks.workunit.client.1.smithi173.stdout:7/806: rename d1/l7 to d1/d1d/d4c/d63/d13/d36/d49/l101 0 2024-02-16T22:19:22.129 INFO:tasks.workunit.client.1.smithi173.stdout:7/807: readlink d1/d1d/d4c/d63/d6c/la9 0 2024-02-16T22:19:22.129 INFO:tasks.workunit.client.1.smithi173.stdout:7/808: fdatasync d1/d1d/d4c/d63/d13/d36/d49/f6d 0 2024-02-16T22:19:22.129 INFO:tasks.workunit.client.1.smithi173.stdout:4/840: dread d7/f9 [0,4194304] 0 2024-02-16T22:19:22.129 INFO:tasks.workunit.client.1.smithi173.stdout:4/841: readlink d7/d28/l102 0 2024-02-16T22:19:22.129 INFO:tasks.workunit.client.1.smithi173.stdout:1/855: dwrite db/f18 [0,4194304] 0 2024-02-16T22:19:22.137 INFO:tasks.workunit.client.1.smithi173.stdout:9/798: write d1/d2/d1a/f2b [2246979,29324] 0 2024-02-16T22:19:22.137 INFO:tasks.workunit.client.1.smithi173.stdout:9/799: truncate d1/d5f/d6d/d91/da7/fc2 987527 0 2024-02-16T22:19:22.141 INFO:tasks.workunit.client.1.smithi173.stdout:6/889: symlink d0/db/d2e/d65/d73/d100/d110/l13d 0 2024-02-16T22:19:22.142 INFO:tasks.workunit.client.1.smithi173.stdout:6/890: write d0/db/d2e/d65/db8/de1/d116/f13a [65882,12623] 0 2024-02-16T22:19:22.142 INFO:tasks.workunit.client.1.smithi173.stdout:1/856: dread db/d1d/f26 [4194304,4194304] 0 2024-02-16T22:19:22.142 INFO:tasks.workunit.client.1.smithi173.stdout:1/857: write db/d1c/d25/d28/f7b [592858,26167] 0 2024-02-16T22:19:22.142 INFO:tasks.workunit.client.1.smithi173.stdout:1/858: creat db/d29/d83/f122 x:0 0 0 2024-02-16T22:19:22.144 INFO:tasks.workunit.client.1.smithi173.stdout:7/809: mknod d1/d1d/d4c/d63/d13/d22/d7e/db5/c102 0 2024-02-16T22:19:22.146 INFO:tasks.workunit.client.1.smithi173.stdout:4/842: stat d7/d28/d31/d33/d7d/d4e/l68 0 2024-02-16T22:19:22.149 INFO:tasks.workunit.client.1.smithi173.stdout:9/800: mkdir d1/d2/d1a/d2f/df4/d8c/d92/dd5/d107 0 2024-02-16T22:19:22.151 INFO:tasks.workunit.client.1.smithi173.stdout:9/801: rmdir d1/d2/d1a/d2f/d51/d96/db3/dd6 39 2024-02-16T22:19:22.152 INFO:tasks.workunit.client.1.smithi173.stdout:1/859: getdents db/d29/d57/d8c 0 2024-02-16T22:19:22.157 INFO:tasks.workunit.client.1.smithi173.stdout:1/860: creat db/d29/db5/f123 x:0 0 0 2024-02-16T22:19:22.157 INFO:tasks.workunit.client.1.smithi173.stdout:1/861: dread - db/d1c/d7f/d98/df9/ffb zero size 2024-02-16T22:19:22.157 INFO:tasks.workunit.client.1.smithi173.stdout:8/950: dwrite dd/d9d/f75 [0,4194304] 0 2024-02-16T22:19:22.157 INFO:tasks.workunit.client.1.smithi173.stdout:8/951: chown dd/d7c/dcb/fd0 6 1 2024-02-16T22:19:22.157 INFO:tasks.workunit.client.1.smithi173.stdout:8/952: chown dd/d7c/d7d/d22/c11a 2 1 2024-02-16T22:19:22.157 INFO:tasks.workunit.client.1.smithi173.stdout:8/953: rename dd/d7c/d7d to dd/d7c/d7d/d58/d11d/d12a 22 2024-02-16T22:19:22.157 INFO:tasks.workunit.client.1.smithi173.stdout:8/954: stat f2 0 2024-02-16T22:19:22.159 INFO:tasks.workunit.client.1.smithi173.stdout:0/808: dwrite d0/d12/d15/d3d/d98/d14/d24/d32/d39/f75 [0,4194304] 0 2024-02-16T22:19:22.169 INFO:tasks.workunit.client.1.smithi173.stdout:8/955: link dd/d7c/d7d/d22/d5a/l97 dd/d7c/d7d/d22/d2e/d41/l12b 0 2024-02-16T22:19:22.170 INFO:tasks.workunit.client.1.smithi173.stdout:8/956: fsync dd/d7c/d7d/d22/d28/d40/d69/ffa 0 2024-02-16T22:19:22.173 INFO:tasks.workunit.client.1.smithi173.stdout:8/957: creat dd/d7c/d7d/d22/d28/d40/d69/df4/dff/d127/f12c x:0 0 0 2024-02-16T22:19:22.177 INFO:tasks.workunit.client.1.smithi173.stdout:8/958: mknod dd/d7c/d7d/d22/d28/d40/d69/df4/d118/c12d 0 2024-02-16T22:19:22.180 INFO:tasks.workunit.client.1.smithi173.stdout:5/929: sync 2024-02-16T22:19:22.180 INFO:tasks.workunit.client.1.smithi173.stdout:5/930: creat d8/da/d1f/d30/d9b/f127 x:0 0 0 2024-02-16T22:19:22.180 INFO:tasks.workunit.client.1.smithi173.stdout:5/931: creat d8/da/d2d/d3a/f128 x:0 0 0 2024-02-16T22:19:22.183 INFO:tasks.workunit.client.1.smithi173.stdout:7/810: dwrite d1/d1d/d4c/d63/d48/f8e [0,4194304] 0 2024-02-16T22:19:22.184 INFO:tasks.workunit.client.1.smithi173.stdout:6/891: dwrite d0/db/d2e/d2f/d31/f62 [4194304,4194304] 0 2024-02-16T22:19:22.186 INFO:tasks.workunit.client.1.smithi173.stdout:8/959: rename dd/cdf to dd/d7c/d7d/d89/db0/c12e 0 2024-02-16T22:19:22.187 INFO:tasks.workunit.client.1.smithi173.stdout:0/809: dwrite d0/d12/d15/d3d/d98/f89 [0,4194304] 0 2024-02-16T22:19:22.191 INFO:tasks.workunit.client.1.smithi173.stdout:4/843: dwrite d7/d9a/fa8 [0,4194304] 0 2024-02-16T22:19:22.191 INFO:tasks.workunit.client.1.smithi173.stdout:1/862: dwrite db/d1c/d25/d28/f114 [0,4194304] 0 2024-02-16T22:19:22.191 INFO:tasks.workunit.client.1.smithi173.stdout:4/844: read - d7/d28/d31/d33/d7d/d45/f65 zero size 2024-02-16T22:19:22.202 INFO:tasks.workunit.client.1.smithi173.stdout:5/932: rename d8/c67 to d8/da/d1f/d6f/c129 0 2024-02-16T22:19:22.207 INFO:tasks.workunit.client.1.smithi173.stdout:4/845: dread d7/d28/d31/d33/d7d/d4e/fa4 [0,4194304] 0 2024-02-16T22:19:22.208 INFO:tasks.workunit.client.1.smithi173.stdout:1/863: symlink db/d1c/l124 0 2024-02-16T22:19:22.212 INFO:tasks.workunit.client.1.smithi173.stdout:6/892: dwrite d0/db/d2e/d65/d73/da9/f105 [0,4194304] 0 2024-02-16T22:19:22.212 INFO:tasks.workunit.client.1.smithi173.stdout:7/811: dwrite d1/d1d/d4c/d63/d13/d36/d49/f74 [4194304,4194304] 0 2024-02-16T22:19:22.213 INFO:tasks.workunit.client.1.smithi173.stdout:0/810: dwrite d0/d12/d15/d3d/db5/dbf/f9c [0,4194304] 0 2024-02-16T22:19:22.217 INFO:tasks.workunit.client.1.smithi173.stdout:6/893: mknod d0/db/d2e/d65/d67/d78/c13e 0 2024-02-16T22:19:22.217 INFO:tasks.workunit.client.1.smithi173.stdout:6/894: readlink d0/db/lbe 0 2024-02-16T22:19:22.218 INFO:tasks.workunit.client.1.smithi173.stdout:5/933: getdents d8/da/d2d/d3a/da7 0 2024-02-16T22:19:22.221 INFO:tasks.workunit.client.1.smithi173.stdout:7/812: mkdir d1/dd4/d103 0 2024-02-16T22:19:22.223 INFO:tasks.workunit.client.1.smithi173.stdout:1/864: truncate db/f18 2336668 0 2024-02-16T22:19:22.223 INFO:tasks.workunit.client.1.smithi173.stdout:1/865: stat db/d1c/d25/d28/f49 0 2024-02-16T22:19:22.225 INFO:tasks.workunit.client.1.smithi173.stdout:0/811: write d0/d12/d15/d4f/f9d [1544287,97847] 0 2024-02-16T22:19:22.225 INFO:tasks.workunit.client.1.smithi173.stdout:0/812: truncate d0/d12/d15/d3d/d98/d14/d24/d58/f93 641003 0 2024-02-16T22:19:22.225 INFO:tasks.workunit.client.1.smithi173.stdout:0/813: fsync d0/d12/d15/f1c 0 2024-02-16T22:19:22.225 INFO:tasks.workunit.client.1.smithi173.stdout:0/814: stat d0/d12/d15/d3d/d98/d14/d24/d32/d39 0 2024-02-16T22:19:22.225 INFO:tasks.workunit.client.1.smithi173.stdout:0/815: write d0/d12/d15/d3d/d98/fea [4254571,7650] 0 2024-02-16T22:19:22.225 INFO:tasks.workunit.client.1.smithi173.stdout:0/816: write d0/d12/d15/d4f/f104 [263922,7054] 0 2024-02-16T22:19:22.228 INFO:tasks.workunit.client.1.smithi173.stdout:6/895: read d0/db/d2e/f30 [923215,129730] 0 2024-02-16T22:19:22.229 INFO:tasks.workunit.client.1.smithi173.stdout:6/896: chown d0/db/d2e/d65/d73/d7d/fcd 2011609 1 2024-02-16T22:19:22.230 INFO:tasks.workunit.client.1.smithi173.stdout:4/846: dwrite d7/d28/d31/d33/dca/df4/f101 [0,4194304] 0 2024-02-16T22:19:22.232 INFO:tasks.workunit.client.1.smithi173.stdout:5/934: mkdir d8/da/d1b/d57/dc9/d92/dbc/dcd/dd1/d12a 0 2024-02-16T22:19:22.234 INFO:tasks.workunit.client.1.smithi173.stdout:7/813: rmdir d1/d1d/d4c/d63/d13/d36/dd6 39 2024-02-16T22:19:22.234 INFO:tasks.workunit.client.1.smithi173.stdout:7/814: chown d1/dd4 31 1 2024-02-16T22:19:22.234 INFO:tasks.workunit.client.1.smithi173.stdout:7/815: stat d1/l56 0 2024-02-16T22:19:22.234 INFO:tasks.workunit.client.1.smithi173.stdout:7/816: fsync d1/d1d/f4e 0 2024-02-16T22:19:22.234 INFO:tasks.workunit.client.1.smithi173.stdout:7/817: write d1/d1d/d4c/d63/d13/d22/ff2 [644854,126006] 0 2024-02-16T22:19:22.234 INFO:tasks.workunit.client.1.smithi173.stdout:7/818: truncate d1/d1d/d4c/d63/f4 1407324 0 2024-02-16T22:19:22.234 INFO:tasks.workunit.client.1.smithi173.stdout:0/817: mknod d0/d12/dce/c10a 0 2024-02-16T22:19:22.235 INFO:tasks.workunit.client.1.smithi173.stdout:0/818: readlink d0/d12/d15/d3d/d98/d14/d50/dd0/ldf 0 2024-02-16T22:19:22.237 INFO:tasks.workunit.client.1.smithi173.stdout:4/847: mknod d7/dd5/dcf/c122 0 2024-02-16T22:19:22.245 INFO:tasks.workunit.client.1.smithi173.stdout:7/819: dread d1/d1d/d4c/d63/ff [0,4194304] 0 2024-02-16T22:19:22.247 INFO:tasks.workunit.client.1.smithi173.stdout:1/866: dwrite db/d29/d57/d73/f119 [0,4194304] 0 2024-02-16T22:19:22.248 INFO:tasks.workunit.client.1.smithi173.stdout:1/867: creat db/d1c/d25/d45/f125 x:0 0 0 2024-02-16T22:19:22.256 INFO:tasks.workunit.client.1.smithi173.stdout:5/935: creat d8/d27/d35/f12b x:0 0 0 2024-02-16T22:19:22.259 INFO:tasks.workunit.client.1.smithi173.stdout:0/819: link d0/d12/d15/d3d/d98/d27/f57 d0/d12/d15/d3d/d98/d14/d50/f10b 0 2024-02-16T22:19:22.259 INFO:tasks.workunit.client.1.smithi173.stdout:0/820: chown d0/d12/d15/d3d/d98/d14/d24/d2e 2 1 2024-02-16T22:19:22.259 INFO:tasks.workunit.client.1.smithi173.stdout:0/821: fsync d0/d12/d15/d3d/d98/d14/d24/d32/d39/ff0 0 2024-02-16T22:19:22.260 INFO:tasks.workunit.client.1.smithi173.stdout:6/897: rmdir d0/db/d2e/d2f/d31/d7a 39 2024-02-16T22:19:22.263 INFO:tasks.workunit.client.1.smithi173.stdout:7/820: mknod d1/d1d/d4c/d80/c104 0 2024-02-16T22:19:22.268 INFO:tasks.workunit.client.1.smithi173.stdout:1/868: symlink db/d1c/l126 0 2024-02-16T22:19:22.268 INFO:tasks.workunit.client.1.smithi173.stdout:1/869: dread - db/d29/db5/d105/f10d zero size 2024-02-16T22:19:22.270 INFO:tasks.workunit.client.1.smithi173.stdout:5/936: symlink d8/da/d2d/d3a/da7/l12c 0 2024-02-16T22:19:22.271 INFO:tasks.workunit.client.1.smithi173.stdout:0/822: creat d0/d12/d15/d3d/d98/d33/dc2/f10c x:0 0 0 2024-02-16T22:19:22.273 INFO:tasks.workunit.client.1.smithi173.stdout:7/821: truncate d1/d1d/d4c/d63/d6c/f77 1663302 0 2024-02-16T22:19:22.273 INFO:tasks.workunit.client.1.smithi173.stdout:3/987: sync 2024-02-16T22:19:22.276 INFO:tasks.workunit.client.1.smithi173.stdout:7/822: mknod d1/d1d/d4c/d63/d13/d22/d53/db9/dbc/dcf/c105 0 2024-02-16T22:19:22.281 INFO:tasks.workunit.client.1.smithi173.stdout:1/870: symlink db/d29/d57/l127 0 2024-02-16T22:19:22.282 INFO:tasks.workunit.client.1.smithi173.stdout:5/937: write d8/da/d2d/d36/fb2 [1665231,4439] 0 2024-02-16T22:19:22.282 INFO:tasks.workunit.client.1.smithi173.stdout:5/938: creat d8/d27/d28/f12d x:0 0 0 2024-02-16T22:19:22.282 INFO:tasks.workunit.client.1.smithi173.stdout:7/823: creat d1/d1d/d4c/d63/d13/d22/d7e/dbd/dd2/f106 x:0 0 0 2024-02-16T22:19:22.284 INFO:tasks.workunit.client.1.smithi173.stdout:1/871: rmdir db/d1c/d7f/d98 39 2024-02-16T22:19:22.288 INFO:tasks.workunit.client.1.smithi173.stdout:5/939: symlink d8/da/db0/df0/l12e 0 2024-02-16T22:19:22.288 INFO:tasks.workunit.client.1.smithi173.stdout:7/824: mkdir d1/d1d/d4c/d63/d54/d107 0 2024-02-16T22:19:22.289 INFO:tasks.workunit.client.1.smithi173.stdout:7/825: chown d1/d1d/d4c/d63/d11/l4f 4115 1 2024-02-16T22:19:22.289 INFO:tasks.workunit.client.1.smithi173.stdout:1/872: mknod db/d29/d50/c128 0 2024-02-16T22:19:22.291 INFO:tasks.workunit.client.1.smithi173.stdout:7/826: link d1/d1d/d4c/d63/d13/d22/d7e/f9e d1/d1d/d4c/d80/f108 0 2024-02-16T22:19:22.291 INFO:tasks.workunit.client.1.smithi173.stdout:7/827: write d1/d1d/d4c/d63/ff [4690774,60497] 0 2024-02-16T22:19:22.292 INFO:tasks.workunit.client.1.smithi173.stdout:1/873: getdents db/d29/d83/d108 0 2024-02-16T22:19:22.294 INFO:tasks.workunit.client.1.smithi173.stdout:3/988: dwrite d9/f4c [4194304,4194304] 0 2024-02-16T22:19:22.296 INFO:tasks.workunit.client.1.smithi173.stdout:5/940: dread d8/d27/d28/f39 [0,4194304] 0 2024-02-16T22:19:22.296 INFO:tasks.workunit.client.1.smithi173.stdout:0/823: dwrite d0/d12/d15/d4f/f104 [0,4194304] 0 2024-02-16T22:19:22.296 INFO:tasks.workunit.client.1.smithi173.stdout:5/941: write d8/da/d2d/d36/f3d [2250408,91542] 0 2024-02-16T22:19:22.296 INFO:tasks.workunit.client.1.smithi173.stdout:0/824: write d0/d12/d15/f85 [5201245,115367] 0 2024-02-16T22:19:22.297 INFO:tasks.workunit.client.1.smithi173.stdout:7/828: mknod d1/d1d/d4c/c109 0 2024-02-16T22:19:22.297 INFO:tasks.workunit.client.1.smithi173.stdout:7/829: truncate d1/d1d/d4c/d63/d13/d22/d7e/dc2/f7c 4318929 0 2024-02-16T22:19:22.299 INFO:tasks.workunit.client.1.smithi173.stdout:1/874: creat db/d1d/dcf/d109/f129 x:0 0 0 2024-02-16T22:19:22.299 INFO:tasks.workunit.client.1.smithi173.stdout:1/875: write db/d29/d50/d85/fec [1012901,66993] 0 2024-02-16T22:19:22.299 INFO:tasks.workunit.client.1.smithi173.stdout:1/876: write f2 [2378812,116379] 0 2024-02-16T22:19:22.302 INFO:tasks.workunit.client.1.smithi173.stdout:7/830: dread d1/d1d/d4c/d63/d13/d22/d53/f85 [0,4194304] 0 2024-02-16T22:19:22.307 INFO:tasks.workunit.client.1.smithi173.stdout:1/877: write db/f18 [386207,42647] 0 2024-02-16T22:19:22.310 INFO:tasks.workunit.client.1.smithi173.stdout:3/989: write d9/da/f15 [3287948,59414] 0 2024-02-16T22:19:22.310 INFO:tasks.workunit.client.1.smithi173.stdout:3/990: chown d9/d18/d73/db7/d7a/f8a 802996769 1 2024-02-16T22:19:22.310 INFO:tasks.workunit.client.1.smithi173.stdout:3/991: creat d9/d1a/d2b/f14e x:0 0 0 2024-02-16T22:19:22.312 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: pgmap v263: 65 pgs: 65 active+clean; 2.0 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 155 MiB/s rd, 184 MiB/s wr, 390 op/s 2024-02-16T22:19:22.312 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:19:22.312 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:19:22.312 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:19:22.312 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:19:22.312 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:19:22.312 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:19:22.312 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr fail", "who": "smithi134.ordace"}]: dispatch 2024-02-16T22:19:22.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: osdmap e47: 6 total, 6 up, 6 in 2024-02-16T22:19:22.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "mgr fail", "who": "smithi134.ordace"}]': finished 2024-02-16T22:19:22.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: mgrmap e21: smithi173.kbofaa(active, starting, since 0.0218433s) 2024-02-16T22:19:22.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:19:22.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:19:22.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jyajef"}]: dispatch 2024-02-16T22:19:22.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:19:22.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.qljqef"}]: dispatch 2024-02-16T22:19:22.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.phstvm"}]: dispatch 2024-02-16T22:19:22.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mgr metadata", "who": "smithi173.kbofaa", "id": "smithi173.kbofaa"}]: dispatch 2024-02-16T22:19:22.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:19:22.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:19:22.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:19:22.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:19:22.314 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:19:22.314 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:19:22.314 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-16T22:19:22.314 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-16T22:19:22.314 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-16T22:19:22.315 INFO:tasks.workunit.client.1.smithi173.stdout:7/831: write d1/d1d/d4c/d63/d48/f79 [885944,5899] 0 2024-02-16T22:19:22.315 INFO:tasks.workunit.client.1.smithi173.stdout:7/832: chown d1/d1d/d4c/d63/ff 22 1 2024-02-16T22:19:22.322 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: pgmap v263: 65 pgs: 65 active+clean; 2.0 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 155 MiB/s rd, 184 MiB/s wr, 390 op/s 2024-02-16T22:19:22.322 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:19:22.322 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:19:22.322 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:19:22.322 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:19:22.322 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' 2024-02-16T22:19:22.322 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:19:22.322 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr fail", "who": "smithi134.ordace"}]: dispatch 2024-02-16T22:19:22.322 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: osdmap e47: 6 total, 6 up, 6 in 2024-02-16T22:19:22.322 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.14214 172.21.15.134:0/4246098712' entity='mgr.smithi134.ordace' cmd='[{"prefix": "mgr fail", "who": "smithi134.ordace"}]': finished 2024-02-16T22:19:22.322 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: mgrmap e21: smithi173.kbofaa(active, starting, since 0.0218433s) 2024-02-16T22:19:22.322 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:19:22.323 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:19:22.323 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jyajef"}]: dispatch 2024-02-16T22:19:22.323 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:19:22.323 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.qljqef"}]: dispatch 2024-02-16T22:19:22.323 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.phstvm"}]: dispatch 2024-02-16T22:19:22.323 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mgr metadata", "who": "smithi173.kbofaa", "id": "smithi173.kbofaa"}]: dispatch 2024-02-16T22:19:22.323 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:19:22.323 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:19:22.323 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:19:22.323 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:19:22.323 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:19:22.323 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:19:22.323 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-16T22:19:22.323 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-16T22:19:22.324 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-16T22:19:22.344 INFO:tasks.workunit.client.1.smithi173.stdout:5/942: unlink d8/da/d1b/l1e 0 2024-02-16T22:19:22.371 INFO:tasks.workunit.client.1.smithi173.stdout:1/878: symlink db/d29/d57/d8c/l12a 0 2024-02-16T22:19:22.372 INFO:tasks.workunit.client.1.smithi173.stdout:1/879: write db/d1c/d5c/f63 [1020125,17260] 0 2024-02-16T22:19:22.378 INFO:tasks.workunit.client.1.smithi173.stdout:3/992: creat d9/d1a/d2b/d45/d60/d6a/d13f/f14f x:0 0 0 2024-02-16T22:19:22.378 INFO:tasks.workunit.client.1.smithi173.stdout:3/993: chown d9/d1a/d2b/d4d/d5b/da9/db4/fc6 900626220 1 2024-02-16T22:19:22.432 INFO:tasks.workunit.client.1.smithi173.stdout:5/943: creat d8/d11c/f12f x:0 0 0 2024-02-16T22:19:22.441 INFO:tasks.workunit.client.1.smithi173.stdout:1/880: creat db/d29/d8f/f12b x:0 0 0 2024-02-16T22:19:22.443 INFO:tasks.workunit.client.1.smithi173.stdout:3/994: creat d9/d17/f150 x:0 0 0 2024-02-16T22:19:22.443 INFO:tasks.workunit.client.1.smithi173.stdout:3/995: fdatasync d9/d18/d5f/d6e/da7/ff7 0 2024-02-16T22:19:22.443 INFO:tasks.workunit.client.1.smithi173.stdout:3/996: fdatasync d9/da/feb 0 2024-02-16T22:19:22.444 INFO:tasks.workunit.client.1.smithi173.stdout:5/944: mknod d8/d27/d62/c130 0 2024-02-16T22:19:22.444 INFO:tasks.workunit.client.1.smithi173.stdout:5/945: readlink d8/da/d1f/d30/l124 0 2024-02-16T22:19:22.452 INFO:tasks.workunit.client.1.smithi173.stdout:1/881: mkdir db/d1c/d25/d12c 0 2024-02-16T22:19:22.452 INFO:tasks.workunit.client.1.smithi173.stdout:1/882: write db/d1c/d5c/dac/fbe [698527,44025] 0 2024-02-16T22:19:22.454 INFO:tasks.workunit.client.1.smithi173.stdout:1/883: truncate db/d1c/d25/d28/d3f/fc8 1847546 0 2024-02-16T22:19:22.454 INFO:tasks.workunit.client.1.smithi173.stdout:1/884: dread - db/d29/d83/dc2/f11b zero size 2024-02-16T22:19:22.456 INFO:tasks.workunit.client.1.smithi173.stdout:1/885: symlink db/d5f/l12d 0 2024-02-16T22:19:22.456 INFO:tasks.workunit.client.1.smithi173.stdout:1/886: rmdir db/d29/d57/d8c 39 2024-02-16T22:19:22.459 INFO:tasks.workunit.client.1.smithi173.stdout:9/802: sync 2024-02-16T22:19:22.459 INFO:tasks.workunit.client.1.smithi173.stdout:2/844: sync 2024-02-16T22:19:22.459 INFO:tasks.workunit.client.1.smithi173.stdout:2/845: chown d2/d4/d8/d30/d44/d81/d99/la0 229055 1 2024-02-16T22:19:22.459 INFO:tasks.workunit.client.1.smithi173.stdout:2/846: write d2/dc/d19/d1a/fc5 [626304,57103] 0 2024-02-16T22:19:22.460 INFO:tasks.workunit.client.1.smithi173.stdout:5/946: dwrite d8/da/d1b/d57/d97/fc6 [0,4194304] 0 2024-02-16T22:19:22.460 INFO:tasks.workunit.client.1.smithi173.stdout:5/947: creat d8/da/d2d/d3a/da7/de7/f131 x:0 0 0 2024-02-16T22:19:22.460 INFO:tasks.workunit.client.1.smithi173.stdout:2/847: rmdir d2/d4/d8/d2d 39 2024-02-16T22:19:22.465 INFO:tasks.workunit.client.1.smithi173.stdout:3/997: rename d9/d1a/d2b/d4d/d5b/f12a to d9/d1a/d2b/d4d/d118/f151 0 2024-02-16T22:19:22.468 INFO:tasks.workunit.client.1.smithi173.stdout:2/848: symlink d2/d4/d57/dc8/l10d 0 2024-02-16T22:19:22.471 INFO:tasks.workunit.client.1.smithi173.stdout:1/887: rename db/d5f/c60 to db/d29/d83/c12e 0 2024-02-16T22:19:22.472 INFO:tasks.workunit.client.1.smithi173.stdout:3/998: rmdir d9/d18/d5f/d6e/da7/de6 39 2024-02-16T22:19:22.474 INFO:tasks.workunit.client.1.smithi173.stdout:1/888: creat db/d1c/d25/d28/d3f/f12f x:0 0 0 2024-02-16T22:19:22.474 INFO:tasks.workunit.client.1.smithi173.stdout:1/889: creat db/d29/db5/d105/f130 x:0 0 0 2024-02-16T22:19:22.475 INFO:tasks.workunit.client.1.smithi173.stdout:2/849: write d2/dc/d19/d69/dab/fe9 [4027769,23658] 0 2024-02-16T22:19:22.475 INFO:tasks.workunit.client.1.smithi173.stdout:2/850: write d2/dc/d19/d1c/d53/fb1 [1319194,77049] 0 2024-02-16T22:19:22.478 INFO:tasks.workunit.client.1.smithi173.stdout:3/999: unlink d9/d18/d5f/d6e/da7/fd9 0 2024-02-16T22:19:22.484 INFO:tasks.workunit.client.1.smithi173.stdout:1/890: write db/d29/d57/d73/f119 [2944708,125322] 0 2024-02-16T22:19:22.484 INFO:tasks.workunit.client.1.smithi173.stdout:5/948: dwrite d8/da/d2d/f84 [0,4194304] 0 2024-02-16T22:19:22.484 INFO:tasks.workunit.client.1.smithi173.stdout:2/851: rename d2/d10/d62/d6c/dcd to d2/d4/d8/d2d/d10e 0 2024-02-16T22:19:22.484 INFO:tasks.workunit.client.1.smithi173.stdout:2/852: write d2/d4/d8/d3a/fe7 [1236864,16830] 0 2024-02-16T22:19:22.485 INFO:tasks.workunit.client.1.smithi173.stdout:1/891: mknod db/d1d/dcf/c131 0 2024-02-16T22:19:22.486 INFO:tasks.workunit.client.1.smithi173.stdout:2/853: mkdir d2/dc/d19/da3/da4/d10f 0 2024-02-16T22:19:22.487 INFO:tasks.workunit.client.1.smithi173.stdout:5/949: dread d8/da/f47 [0,4194304] 0 2024-02-16T22:19:22.487 INFO:tasks.workunit.client.1.smithi173.stdout:1/892: symlink db/d1c/d25/l132 0 2024-02-16T22:19:22.488 INFO:tasks.workunit.client.1.smithi173.stdout:2/854: mkdir d2/d4/d110 0 2024-02-16T22:19:22.489 INFO:tasks.workunit.client.1.smithi173.stdout:5/950: creat d8/d27/d63/de6/f132 x:0 0 0 2024-02-16T22:19:22.492 INFO:tasks.workunit.client.1.smithi173.stdout:5/951: dread d8/da/f1d [0,4194304] 0 2024-02-16T22:19:22.507 INFO:tasks.workunit.client.1.smithi173.stdout:8/960: sync 2024-02-16T22:19:22.508 INFO:tasks.workunit.client.1.smithi173.stdout:2/855: dwrite d2/dc/d19/d1a/f52 [0,4194304] 0 2024-02-16T22:19:22.531 INFO:tasks.workunit.client.1.smithi173.stdout:1/893: dwrite db/d1c/d5c/dac/dae/fcc [4194304,4194304] 0 2024-02-16T22:19:22.532 INFO:tasks.workunit.client.1.smithi173.stdout:1/894: creat db/d1c/d5c/f133 x:0 0 0 2024-02-16T22:19:22.532 INFO:tasks.workunit.client.1.smithi173.stdout:5/952: dwrite d8/da/d1b/d57/dc9/d92/fa1 [0,4194304] 0 2024-02-16T22:19:22.532 INFO:tasks.workunit.client.1.smithi173.stdout:5/953: chown d8/da/db0/df0/lf3 4 1 2024-02-16T22:19:22.532 INFO:tasks.workunit.client.1.smithi173.stdout:5/954: readlink d8/da/d1b/d57/dc9/l6b 0 2024-02-16T22:19:22.532 INFO:tasks.workunit.client.1.smithi173.stdout:5/955: creat d8/da/d1f/db7/f133 x:0 0 0 2024-02-16T22:19:22.532 INFO:tasks.workunit.client.1.smithi173.stdout:5/956: creat d8/da/d1b/f134 x:0 0 0 2024-02-16T22:19:22.532 INFO:tasks.workunit.client.1.smithi173.stdout:2/856: dwrite d2/dc/d19/d1c/d87/f8d [0,4194304] 0 2024-02-16T22:19:22.532 INFO:tasks.workunit.client.1.smithi173.stdout:2/857: getdents d2/d4/d57/d82/ded 0 2024-02-16T22:19:22.533 INFO:tasks.workunit.client.1.smithi173.stdout:5/957: dread d8/da/d2d/d36/f43 [0,4194304] 0 2024-02-16T22:19:22.533 INFO:tasks.workunit.client.1.smithi173.stdout:5/958: getdents d8/da/d1f/d8c/ddd 0 2024-02-16T22:19:22.546 INFO:tasks.workunit.client.1.smithi173.stdout:5/959: dread d8/da/d1f/d6f/fc4 [0,4194304] 0 2024-02-16T22:19:22.546 INFO:tasks.workunit.client.1.smithi173.stdout:5/960: getdents d8/d125 0 2024-02-16T22:19:22.555 INFO:tasks.workunit.client.1.smithi173.stdout:1/895: dwrite db/d1c/d5c/dac/dae/fcc [4194304,4194304] 0 2024-02-16T22:19:22.555 INFO:tasks.workunit.client.1.smithi173.stdout:1/896: stat db/d1c/d7f/d98/fea 0 2024-02-16T22:19:22.703 INFO:tasks.workunit.client.1.smithi173.stdout:8/961: mknod dd/d7c/d7d/d89/db0/d113/c12f 0 2024-02-16T22:19:22.712 INFO:tasks.workunit.client.1.smithi173.stdout:9/803: unlink d1/f30 0 2024-02-16T22:19:22.712 INFO:tasks.workunit.client.1.smithi173.stdout:9/804: write d1/d2/d1a/d2f/d3b/da6/de3/ff2 [972865,111932] 0 2024-02-16T22:19:22.728 INFO:tasks.workunit.client.1.smithi173.stdout:5/961: unlink d8/da/d1f/d8c/l123 0 2024-02-16T22:19:22.730 INFO:tasks.workunit.client.1.smithi173.stdout:1/897: mkdir db/d1c/d25/d134 0 2024-02-16T22:19:22.732 INFO:tasks.workunit.client.1.smithi173.stdout:8/962: creat dd/d7c/d7d/d58/dd5/f130 x:0 0 0 2024-02-16T22:19:22.732 INFO:tasks.workunit.client.1.smithi173.stdout:8/963: readlink dd/d7c/dcb/dd8/lea 0 2024-02-16T22:19:22.734 INFO:tasks.workunit.client.1.smithi173.stdout:9/805: creat d1/d2/d1a/d2f/df4/d8c/d92/dd5/f108 x:0 0 0 2024-02-16T22:19:22.736 INFO:tasks.workunit.client.1.smithi173.stdout:1/898: symlink db/d29/d57/d73/l135 0 2024-02-16T22:19:22.736 INFO:tasks.workunit.client.1.smithi173.stdout:1/899: write db/d1d/dcf/d109/f129 [245219,95241] 0 2024-02-16T22:19:22.738 INFO:tasks.workunit.client.1.smithi173.stdout:8/964: creat dd/f131 x:0 0 0 2024-02-16T22:19:22.740 INFO:tasks.workunit.client.1.smithi173.stdout:9/806: unlink d1/d2/d1a/d1f/f29 0 2024-02-16T22:19:22.741 INFO:tasks.workunit.client.1.smithi173.stdout:1/900: symlink db/d29/db5/l136 0 2024-02-16T22:19:22.741 INFO:tasks.workunit.client.1.smithi173.stdout:1/901: readlink db/d1c/d25/lbb 0 2024-02-16T22:19:22.741 INFO:tasks.workunit.client.1.smithi173.stdout:1/902: creat db/d29/d8f/f137 x:0 0 0 2024-02-16T22:19:22.741 INFO:tasks.workunit.client.1.smithi173.stdout:1/903: fdatasync db/d1d/f33 0 2024-02-16T22:19:22.742 INFO:tasks.workunit.client.1.smithi173.stdout:8/965: truncate dd/d9d/f75 1973748 0 2024-02-16T22:19:22.744 INFO:tasks.workunit.client.1.smithi173.stdout:9/807: creat d1/d2/d1a/f109 x:0 0 0 2024-02-16T22:19:22.744 INFO:tasks.workunit.client.1.smithi173.stdout:9/808: dread - d1/d2/d1a/d2f/df4/f4e zero size 2024-02-16T22:19:22.747 INFO:tasks.workunit.client.1.smithi173.stdout:8/966: getdents dd/d7c/d7d/d22 0 2024-02-16T22:19:22.749 INFO:tasks.workunit.client.1.smithi173.stdout:8/967: link cb dd/d7c/d7d/d22/d28/d40/d69/df4/dff/d109/c132 0 2024-02-16T22:19:22.749 INFO:tasks.workunit.client.1.smithi173.stdout:8/968: write dd/dd9/f10e [134529,128211] 0 2024-02-16T22:19:22.750 INFO:tasks.workunit.client.1.smithi173.stdout:5/962: dwrite d8/da/d1f/f51 [4194304,4194304] 0 2024-02-16T22:19:22.751 INFO:tasks.workunit.client.1.smithi173.stdout:8/969: getdents dd/d7c/d7d/d22/d28/d40/de5 0 2024-02-16T22:19:22.751 INFO:tasks.workunit.client.1.smithi173.stdout:8/970: readlink dd/le 0 2024-02-16T22:19:22.755 INFO:tasks.workunit.client.1.smithi173.stdout:5/963: creat d8/f135 x:0 0 0 2024-02-16T22:19:22.755 INFO:tasks.workunit.client.1.smithi173.stdout:5/964: dread - d8/da/db0/f111 zero size 2024-02-16T22:19:22.755 INFO:tasks.workunit.client.1.smithi173.stdout:5/965: write d8/da/d2d/d36/d50/f114 [398105,34650] 0 2024-02-16T22:19:22.756 INFO:tasks.workunit.client.1.smithi173.stdout:8/971: symlink dd/d7c/d7d/d89/dad/l133 0 2024-02-16T22:19:22.758 INFO:tasks.workunit.client.1.smithi173.stdout:8/972: mknod dd/dd9/c134 0 2024-02-16T22:19:22.765 INFO:tasks.workunit.client.1.smithi173.stdout:1/904: dwrite db/d29/db5/d105/f10d [0,4194304] 0 2024-02-16T22:19:22.765 INFO:tasks.workunit.client.1.smithi173.stdout:1/905: readlink db/l56 0 2024-02-16T22:19:22.766 INFO:tasks.workunit.client.1.smithi173.stdout:1/906: creat db/d29/d50/d85/f138 x:0 0 0 2024-02-16T22:19:22.766 INFO:tasks.workunit.client.1.smithi173.stdout:1/907: chown db/d29/f39 11957478 1 2024-02-16T22:19:22.766 INFO:tasks.workunit.client.1.smithi173.stdout:8/973: read dd/d7c/d7d/d22/d2e/d41/d6b/f8e [198510,122225] 0 2024-02-16T22:19:22.769 INFO:tasks.workunit.client.1.smithi173.stdout:5/966: dread d8/da/d2d/f84 [0,4194304] 0 2024-02-16T22:19:22.769 INFO:tasks.workunit.client.1.smithi173.stdout:5/967: dread - d8/d27/d63/de6/f132 zero size 2024-02-16T22:19:22.769 INFO:tasks.workunit.client.1.smithi173.stdout:5/968: fsync d8/d11c/f12f 0 2024-02-16T22:19:22.769 INFO:tasks.workunit.client.1.smithi173.stdout:1/908: stat db/d1c/d5c/la3 0 2024-02-16T22:19:22.770 INFO:tasks.workunit.client.1.smithi173.stdout:8/974: symlink dd/d7c/d7d/d22/d28/d40/de5/l135 0 2024-02-16T22:19:22.771 INFO:tasks.workunit.client.1.smithi173.stdout:9/809: dwrite d1/d2/f24 [0,4194304] 0 2024-02-16T22:19:22.772 INFO:tasks.workunit.client.1.smithi173.stdout:5/969: rename d8/d27/d35/l89 to d8/da/d1b/d57/d97/df9/l136 0 2024-02-16T22:19:22.774 INFO:tasks.workunit.client.1.smithi173.stdout:1/909: unlink db/d1c/d25/d28/ld3 0 2024-02-16T22:19:22.774 INFO:tasks.workunit.client.1.smithi173.stdout:1/910: dread - db/d29/d50/d85/f138 zero size 2024-02-16T22:19:22.774 INFO:tasks.workunit.client.1.smithi173.stdout:1/911: chown db/d1c/d25/l132 4710487 1 2024-02-16T22:19:22.774 INFO:tasks.workunit.client.1.smithi173.stdout:1/912: readlink db/d1c/d5c/dac/dae/lb2 0 2024-02-16T22:19:22.776 INFO:tasks.workunit.client.1.smithi173.stdout:4/848: sync 2024-02-16T22:19:22.776 INFO:tasks.workunit.client.1.smithi173.stdout:6/898: sync 2024-02-16T22:19:22.776 INFO:tasks.workunit.client.1.smithi173.stdout:4/849: write d7/d28/d31/d72/d93/f109 [882195,9641] 0 2024-02-16T22:19:22.782 INFO:tasks.workunit.client.1.smithi173.stdout:9/810: creat d1/d5f/f10a x:0 0 0 2024-02-16T22:19:22.787 INFO:tasks.workunit.client.1.smithi173.stdout:4/850: creat d7/d28/d31/d72/d93/d95/db4/f123 x:0 0 0 2024-02-16T22:19:22.789 INFO:tasks.workunit.client.1.smithi173.stdout:9/811: rename d1/d2/d1a/f2b to d1/d2/d1a/d1f/d34/db0/f10b 0 2024-02-16T22:19:22.789 INFO:tasks.workunit.client.1.smithi173.stdout:5/970: rmdir d8/d11c 39 2024-02-16T22:19:22.791 INFO:tasks.workunit.client.1.smithi173.stdout:7/833: sync 2024-02-16T22:19:22.791 INFO:tasks.workunit.client.1.smithi173.stdout:0/825: sync 2024-02-16T22:19:22.791 INFO:tasks.workunit.client.1.smithi173.stdout:0/826: readlink d0/d12/d15/d4f/d92/la7 0 2024-02-16T22:19:22.794 INFO:tasks.workunit.client.1.smithi173.stdout:9/812: creat d1/d2/d1a/d2f/df4/d8c/d92/dd5/d107/f10c x:0 0 0 2024-02-16T22:19:22.795 INFO:tasks.workunit.client.1.smithi173.stdout:8/975: dwrite dd/d7c/d7d/d22/d2e/d41/fb4 [0,4194304] 0 2024-02-16T22:19:22.798 INFO:tasks.workunit.client.1.smithi173.stdout:7/834: unlink d1/d1d/d4c/d63/d13/d36/dd6/fe0 0 2024-02-16T22:19:22.799 INFO:tasks.workunit.client.1.smithi173.stdout:0/827: truncate d0/d84/fcb 177983 0 2024-02-16T22:19:22.800 INFO:tasks.workunit.client.1.smithi173.stdout:0/828: dread - d0/d12/d15/d3d/d98/d14/d24/d2e/fd6 zero size 2024-02-16T22:19:22.802 INFO:tasks.workunit.client.1.smithi173.stdout:4/851: write d7/d28/d31/d33/d7d/d45/f6b [3717071,81044] 0 2024-02-16T22:19:22.802 INFO:tasks.workunit.client.1.smithi173.stdout:5/971: getdents d8/da/d1f/d30 0 2024-02-16T22:19:22.808 INFO:tasks.workunit.client.1.smithi173.stdout:7/835: creat d1/d1d/d4c/d63/d13/d36/f10a x:0 0 0 2024-02-16T22:19:22.808 INFO:tasks.workunit.client.1.smithi173.stdout:7/836: write d1/d1d/d4c/d63/d6c/f77 [2123788,3957] 0 2024-02-16T22:19:22.808 INFO:tasks.workunit.client.1.smithi173.stdout:7/837: stat d1/d1d/d4c/d63/d13/d36/d49/f86 0 2024-02-16T22:19:22.808 INFO:tasks.workunit.client.1.smithi173.stdout:4/852: mkdir d7/df/d62/dd8/d124 0 2024-02-16T22:19:22.811 INFO:tasks.workunit.client.1.smithi173.stdout:5/972: symlink d8/d11c/l137 0 2024-02-16T22:19:22.812 INFO:tasks.workunit.client.1.smithi173.stdout:7/838: symlink d1/d1d/d4c/d63/d11/dc7/l10b 0 2024-02-16T22:19:22.812 INFO:tasks.workunit.client.1.smithi173.stdout:7/839: creat d1/d1d/d4c/d63/d13/d22/d7e/dc2/f10c x:0 0 0 2024-02-16T22:19:22.823 INFO:tasks.workunit.client.1.smithi173.stdout:7/840: symlink d1/d1d/l10d 0 2024-02-16T22:19:22.823 INFO:tasks.workunit.client.1.smithi173.stdout:7/841: dread - d1/d1d/d4c/d63/d13/d22/d7e/dc2/f10c zero size 2024-02-16T22:19:22.823 INFO:tasks.workunit.client.1.smithi173.stdout:7/842: getdents d1/d1d/d4c/d80/dfe 0 2024-02-16T22:19:22.827 INFO:tasks.workunit.client.1.smithi173.stdout:5/973: write d8/da/d1b/d57/f79 [370847,50140] 0 2024-02-16T22:19:22.827 INFO:tasks.workunit.client.1.smithi173.stdout:5/974: chown d8/da/d1f/d8c/fb1 5 1 2024-02-16T22:19:22.832 INFO:tasks.workunit.client.1.smithi173.stdout:8/976: dwrite dd/d7c/d7d/d22/d2e/d41/d6b/f84 [0,4194304] 0 2024-02-16T22:19:22.833 INFO:tasks.workunit.client.1.smithi173.stdout:7/843: fdatasync d1/d1d/d4c/d63/d6c/f77 0 2024-02-16T22:19:22.833 INFO:tasks.workunit.client.1.smithi173.stdout:7/844: write d1/d1d/d4c/d63/ff [5495020,109843] 0 2024-02-16T22:19:22.833 INFO:tasks.workunit.client.1.smithi173.stdout:7/845: fsync d1/d1d/d4c/fc5 0 2024-02-16T22:19:22.833 INFO:tasks.workunit.client.1.smithi173.stdout:9/813: dwrite d1/d2/d1a/d1f/d34/f55 [4194304,4194304] 0 2024-02-16T22:19:22.833 INFO:tasks.workunit.client.1.smithi173.stdout:0/829: dwrite d0/d12/d15/d3d/d98/d14/d24/d5f/fe8 [0,4194304] 0 2024-02-16T22:19:22.835 INFO:tasks.workunit.client.1.smithi173.stdout:2/858: dwrite d2/d4/d8/d2d/fba [0,4194304] 0 2024-02-16T22:19:22.835 INFO:tasks.workunit.client.1.smithi173.stdout:2/859: truncate d2/d4/d8/d2d/d10e/dff/fef 491872 0 2024-02-16T22:19:22.840 INFO:tasks.workunit.client.1.smithi173.stdout:8/977: link c3 dd/d7c/dcb/dd8/df9/c136 0 2024-02-16T22:19:22.841 INFO:tasks.workunit.client.1.smithi173.stdout:7/846: symlink d1/d1d/d4c/d63/d13/d36/dd6/l10e 0 2024-02-16T22:19:22.841 INFO:tasks.workunit.client.1.smithi173.stdout:7/847: rename d1 to d1/d1d/d4c/d10f 22 2024-02-16T22:19:22.843 INFO:tasks.workunit.client.1.smithi173.stdout:9/814: symlink d1/d2/d1a/d2f/d3b/l10d 0 2024-02-16T22:19:22.845 INFO:tasks.workunit.client.1.smithi173.stdout:0/830: symlink d0/d12/d15/d3d/d98/d14/d24/d32/l10d 0 2024-02-16T22:19:22.845 INFO:tasks.workunit.client.1.smithi173.stdout:0/831: dread - d0/d12/ff4 zero size 2024-02-16T22:19:22.845 INFO:tasks.workunit.client.1.smithi173.stdout:5/975: dwrite d8/d27/d35/f44 [0,4194304] 0 2024-02-16T22:19:22.848 INFO:tasks.workunit.client.1.smithi173.stdout:2/860: mknod d2/dc/d19/da3/da4/c111 0 2024-02-16T22:19:22.848 INFO:tasks.workunit.client.1.smithi173.stdout:2/861: creat d2/d4/d8/d2d/de6/f112 x:0 0 0 2024-02-16T22:19:22.849 INFO:tasks.workunit.client.1.smithi173.stdout:8/978: mknod dd/d7c/d7d/d22/d2e/c137 0 2024-02-16T22:19:22.850 INFO:tasks.workunit.client.1.smithi173.stdout:7/848: creat d1/dd4/f110 x:0 0 0 2024-02-16T22:19:22.852 INFO:tasks.workunit.client.1.smithi173.stdout:0/832: rename d0/d12/d15/d3d/d98/d27/l7d to d0/d12/d15/d3d/db5/dbf/l10e 0 2024-02-16T22:19:22.857 INFO:tasks.workunit.client.1.smithi173.stdout:9/815: dread d1/d5f/d61/d80/f66 [0,4194304] 0 2024-02-16T22:19:22.860 INFO:tasks.workunit.client.1.smithi173.stdout:8/979: write dd/d9d/f54 [8174545,95205] 0 2024-02-16T22:19:22.863 INFO:tasks.workunit.client.1.smithi173.stdout:7/849: creat d1/d1d/d4c/d80/dfe/f111 x:0 0 0 2024-02-16T22:19:22.863 INFO:tasks.workunit.client.1.smithi173.stdout:7/850: fdatasync d1/d1d/d4c/d63/d13/d36/d49/f7f 0 2024-02-16T22:19:22.863 INFO:tasks.workunit.client.1.smithi173.stdout:9/816: truncate d1/d2/d10/f48 632136 0 2024-02-16T22:19:22.866 INFO:tasks.workunit.client.1.smithi173.stdout:0/833: rename d0/d12/d15/d3d/d98/f8 to d0/d12/d15/f10f 0 2024-02-16T22:19:22.868 INFO:tasks.workunit.client.1.smithi173.stdout:9/817: truncate d1/d2/d1a/d3e/dc8/ffe 300958 0 2024-02-16T22:19:22.868 INFO:tasks.workunit.client.1.smithi173.stdout:9/818: chown d1/d2/d1a/d3e/dc8/ffe 92957 1 2024-02-16T22:19:22.868 INFO:tasks.workunit.client.1.smithi173.stdout:9/819: chown d1/d2/c64 1 1 2024-02-16T22:19:22.868 INFO:tasks.workunit.client.1.smithi173.stdout:9/820: fdatasync d1/d2/d1a/d2f/df4/d8c/f9d 0 2024-02-16T22:19:22.868 INFO:tasks.workunit.client.1.smithi173.stdout:9/821: stat d1/d2/d1a/d3e/dc8/fd2 0 2024-02-16T22:19:22.870 INFO:tasks.workunit.client.1.smithi173.stdout:9/822: mkdir d1/d2/d1a/d1f/d34/d49/d10e 0 2024-02-16T22:19:22.871 INFO:tasks.workunit.client.1.smithi173.stdout:8/980: dread dd/d7c/d7d/d22/d5a/dc7/ff7 [0,4194304] 0 2024-02-16T22:19:22.871 INFO:tasks.workunit.client.1.smithi173.stdout:9/823: symlink d1/d2/d1a/d1f/d34/dbb/l10f 0 2024-02-16T22:19:22.876 INFO:tasks.workunit.client.1.smithi173.stdout:0/834: read d0/d12/d15/d3d/d98/f2a [6528981,95762] 0 2024-02-16T22:19:22.877 INFO:tasks.workunit.client.1.smithi173.stdout:0/835: chown d0/d12/d15/d3d/d98/d14/d24/l36 7486 1 2024-02-16T22:19:22.877 INFO:tasks.workunit.client.1.smithi173.stdout:9/824: mknod d1/d2/d1a/d1f/d34/d49/d88/c110 0 2024-02-16T22:19:22.877 INFO:tasks.workunit.client.1.smithi173.stdout:8/981: unlink dd/d7c/d7d/d22/d28/d40/d51/f9e 0 2024-02-16T22:19:22.879 INFO:tasks.workunit.client.1.smithi173.stdout:0/836: write d0/d12/d15/d3d/d98/d14/f8d [785327,17789] 0 2024-02-16T22:19:22.882 INFO:tasks.workunit.client.1.smithi173.stdout:0/837: mknod d0/d12/d15/d3d/d98/d14/d24/d70/c110 0 2024-02-16T22:19:22.882 INFO:tasks.workunit.client.1.smithi173.stdout:0/838: readlink d0/d12/d15/d3d/d98/d14/d50/dd0/ldf 0 2024-02-16T22:19:22.884 INFO:tasks.workunit.client.1.smithi173.stdout:0/839: mknod d0/d12/d15/d3d/d98/d14/d24/d70/c111 0 2024-02-16T22:19:22.884 INFO:tasks.workunit.client.1.smithi173.stdout:0/840: creat d0/d12/d15/d3d/d98/d14/d24/d2e/d6b/f112 x:0 0 0 2024-02-16T22:19:22.884 INFO:tasks.workunit.client.1.smithi173.stdout:0/841: creat d0/d12/d15/d3d/d98/d14/d24/ddd/f113 x:0 0 0 2024-02-16T22:19:22.888 INFO:tasks.workunit.client.1.smithi173.stdout:9/825: write d1/d2/d1a/d3e/dc8/fda [1568032,57448] 0 2024-02-16T22:19:22.889 INFO:tasks.workunit.client.1.smithi173.stdout:9/826: creat d1/d2/d1a/d2f/d3b/da6/de3/f111 x:0 0 0 2024-02-16T22:19:22.889 INFO:tasks.workunit.client.1.smithi173.stdout:8/982: write dd/d7c/d7d/d22/d2e/d41/d73/fc1 [970532,124637] 0 2024-02-16T22:19:22.890 INFO:tasks.workunit.client.1.smithi173.stdout:0/842: creat d0/d12/d15/d3d/d98/d14/d24/d58/de7/f114 x:0 0 0 2024-02-16T22:19:22.894 INFO:tasks.workunit.client.1.smithi173.stdout:9/827: mkdir d1/d5f/d6d/d112 0 2024-02-16T22:19:22.896 INFO:tasks.workunit.client.1.smithi173.stdout:8/983: mkdir dd/d7c/d7d/d22/d28/d40/d69/da7/dae/d138 0 2024-02-16T22:19:22.897 INFO:tasks.workunit.client.1.smithi173.stdout:9/828: dread d1/d2/d1a/d2f/df4/d8c/f9d [0,4194304] 0 2024-02-16T22:19:22.908 INFO:tasks.workunit.client.1.smithi173.stdout:7/851: fsync d1/d1d/d4c/d63/d13/d22/d7e/dc2/f10c 0 2024-02-16T22:19:22.908 INFO:tasks.workunit.client.1.smithi173.stdout:7/852: chown d1/d1d/d4c/d91/l5b 82534 1 2024-02-16T22:19:22.909 INFO:tasks.workunit.client.1.smithi173.stdout:0/843: dwrite d0/fb [4194304,4194304] 0 2024-02-16T22:19:22.910 INFO:tasks.workunit.client.1.smithi173.stdout:7/853: creat d1/d1d/f112 x:0 0 0 2024-02-16T22:19:22.913 INFO:tasks.workunit.client.1.smithi173.stdout:0/844: symlink d0/d12/d15/d3d/d98/d14/d24/d58/de7/l115 0 2024-02-16T22:19:22.916 INFO:tasks.workunit.client.1.smithi173.stdout:0/845: creat d0/d12/d15/d3d/d98/d14/d38/df5/f116 x:0 0 0 2024-02-16T22:19:22.924 INFO:tasks.workunit.client.1.smithi173.stdout:9/829: dwrite d1/d2/d1a/d2f/f86 [0,4194304] 0 2024-02-16T22:19:22.924 INFO:tasks.workunit.client.1.smithi173.stdout:8/984: dwrite dd/d7c/d7d/d22/d28/f105 [4194304,4194304] 0 2024-02-16T22:19:22.934 INFO:tasks.workunit.client.1.smithi173.stdout:9/830: getdents d1/d2/d1a/d3e/dc8 0 2024-02-16T22:19:22.934 INFO:tasks.workunit.client.1.smithi173.stdout:9/831: dread - d1/d2/d1a/d2f/d3b/da6/de4/fbf zero size 2024-02-16T22:19:22.936 INFO:tasks.workunit.client.1.smithi173.stdout:9/832: creat d1/d2/d1a/d8b/f113 x:0 0 0 2024-02-16T22:19:22.938 INFO:tasks.workunit.client.1.smithi173.stdout:9/833: getdents d1/d2/dec 0 2024-02-16T22:19:22.940 INFO:tasks.workunit.client.1.smithi173.stdout:9/834: rmdir d1/d2/d1a/d2f/d3b 39 2024-02-16T22:19:22.941 INFO:tasks.workunit.client.1.smithi173.stdout:9/835: creat d1/d2/d10/f114 x:0 0 0 2024-02-16T22:19:22.941 INFO:tasks.workunit.client.1.smithi173.stdout:9/836: readlink d1/d2/d1a/d1f/d34/d49/d88/lcd 0 2024-02-16T22:19:22.942 INFO:tasks.workunit.client.1.smithi173.stdout:7/854: rmdir d1/dd4 39 2024-02-16T22:19:22.947 INFO:tasks.workunit.client.1.smithi173.stdout:0/846: dwrite d0/d12/d15/d3d/d98/d14/d38/fe6 [0,4194304] 0 2024-02-16T22:19:22.951 INFO:tasks.workunit.client.1.smithi173.stdout:8/985: dwrite dd/d7c/d7d/d89/dad/fd6 [0,4194304] 0 2024-02-16T22:19:22.952 INFO:tasks.workunit.client.1.smithi173.stdout:8/986: truncate dd/d7c/dcb/fa3 625228 0 2024-02-16T22:19:22.952 INFO:tasks.workunit.client.1.smithi173.stdout:8/987: write dd/d7c/d7d/d22/d28/f3c [766760,8452] 0 2024-02-16T22:19:22.955 INFO:tasks.workunit.client.1.smithi173.stdout:0/847: unlink d0/d12/d15/d3d/d98/d14/d24/d2e/d6b/d8e/fa2 0 2024-02-16T22:19:22.955 INFO:tasks.workunit.client.1.smithi173.stdout:0/848: fdatasync d0/d12/d15/d3d/d98/d14/f2d 0 2024-02-16T22:19:22.955 INFO:tasks.workunit.client.1.smithi173.stdout:0/849: write d0/f10 [992858,110174] 0 2024-02-16T22:19:22.961 INFO:tasks.workunit.client.1.smithi173.stdout:9/837: write d1/d2/d10/f48 [101904,5555] 0 2024-02-16T22:19:22.962 INFO:tasks.workunit.client.1.smithi173.stdout:8/988: rename dd/d7c/d7d/d22/d28/d40/d69/da7/dae/d138 to dd/d7c/dcb/dd8/d139 0 2024-02-16T22:19:22.966 INFO:tasks.workunit.client.1.smithi173.stdout:9/838: unlink d1/d2/d1a/d2f/d3b/c3d 0 2024-02-16T22:19:22.966 INFO:tasks.workunit.client.1.smithi173.stdout:9/839: truncate d1/d5f/f10a 635265 0 2024-02-16T22:19:22.966 INFO:tasks.workunit.client.1.smithi173.stdout:8/989: dread dd/d7c/d7d/d22/d5a/dc7/ff7 [0,4194304] 0 2024-02-16T22:19:22.966 INFO:tasks.workunit.client.1.smithi173.stdout:8/990: fdatasync dd/d7c/d7d/d89/db0/fb6 0 2024-02-16T22:19:22.967 INFO:tasks.workunit.client.1.smithi173.stdout:0/850: getdents d0/d12/d15/d3d/d98/d14/d24/ddd 0 2024-02-16T22:19:22.969 INFO:tasks.workunit.client.1.smithi173.stdout:7/855: dwrite d1/f82 [0,4194304] 0 2024-02-16T22:19:22.969 INFO:tasks.workunit.client.1.smithi173.stdout:9/840: unlink d1/cb8 0 2024-02-16T22:19:22.969 INFO:tasks.workunit.client.1.smithi173.stdout:9/841: readlink d1/d5f/d6d/d91/lf3 0 2024-02-16T22:19:22.972 INFO:tasks.workunit.client.1.smithi173.stdout:8/991: mkdir dd/d7c/d7d/d93/daa/d103/d13a 0 2024-02-16T22:19:22.974 INFO:tasks.workunit.client.1.smithi173.stdout:0/851: mkdir d0/d12/d15/d3d/d98/d33/d54/d117 0 2024-02-16T22:19:22.977 INFO:tasks.workunit.client.1.smithi173.stdout:0/852: creat d0/f118 x:0 0 0 2024-02-16T22:19:22.980 INFO:tasks.workunit.client.1.smithi173.stdout:0/853: symlink d0/d12/d15/d3d/d98/d14/d24/d5f/l119 0 2024-02-16T22:19:22.980 INFO:tasks.workunit.client.1.smithi173.stdout:0/854: write d0/d12/d15/f1c [1350632,45672] 0 2024-02-16T22:19:22.981 INFO:tasks.workunit.client.1.smithi173.stdout:0/855: fdatasync d0/f5e 0 2024-02-16T22:19:22.983 INFO:tasks.workunit.client.1.smithi173.stdout:9/842: rename d1/dd7 to d1/d2/d1a/d2f/df4/d8c/d92/dd5/d107/d115 0 2024-02-16T22:19:22.985 INFO:tasks.workunit.client.1.smithi173.stdout:0/856: truncate d0/d6d/f91 2005921 0 2024-02-16T22:19:22.988 INFO:tasks.workunit.client.1.smithi173.stdout:9/843: rename d1/d2/f24 to d1/d5f/d6d/d97/f116 0 2024-02-16T22:19:22.990 INFO:tasks.workunit.client.1.smithi173.stdout:0/857: truncate d0/f5e 1821368 0 2024-02-16T22:19:22.992 INFO:tasks.workunit.client.1.smithi173.stdout:9/844: mkdir d1/d5f/d6d/d117 0 2024-02-16T22:19:22.992 INFO:tasks.workunit.client.1.smithi173.stdout:8/992: dwrite dd/d7c/d7d/d22/d2e/f48 [0,4194304] 0 2024-02-16T22:19:22.992 INFO:tasks.workunit.client.1.smithi173.stdout:8/993: dread - dd/d7c/d7d/d22/d28/d40/d69/df4/dff/d109/f10d zero size 2024-02-16T22:19:22.994 INFO:tasks.workunit.client.1.smithi173.stdout:0/858: creat d0/d12/d15/d3d/f11a x:0 0 0 2024-02-16T22:19:22.995 INFO:tasks.workunit.client.1.smithi173.stdout:9/845: rmdir d1/d2/d1a/d1f/d34/dbb 39 2024-02-16T22:19:22.995 INFO:tasks.workunit.client.1.smithi173.stdout:9/846: chown d1/c1c 4973 1 2024-02-16T22:19:23.001 INFO:tasks.workunit.client.1.smithi173.stdout:0/859: link d0/d12/d15/f85 d0/d12/d15/d3d/d98/d14/d24/d58/f11b 0 2024-02-16T22:19:23.010 INFO:tasks.workunit.client.1.smithi173.stdout:8/994: dwrite dd/d7c/d7d/d22/d28/d40/d69/df4/f10f [0,4194304] 0 2024-02-16T22:19:23.012 INFO:tasks.workunit.client.1.smithi173.stdout:9/847: mkdir d1/d5f/d6d/d112/d118 0 2024-02-16T22:19:23.014 INFO:tasks.workunit.client.1.smithi173.stdout:0/860: link d0/d12/d15/d3d/dab/fb8 d0/d12/d15/d3d/d98/d14/d24/d2e/f11c 0 2024-02-16T22:19:23.018 INFO:tasks.workunit.client.1.smithi173.stdout:8/995: creat dd/d7c/d7d/d93/f13b x:0 0 0 2024-02-16T22:19:23.018 INFO:tasks.workunit.client.1.smithi173.stdout:8/996: readlink dd/d7c/l100 0 2024-02-16T22:19:23.024 INFO:tasks.workunit.client.1.smithi173.stdout:0/861: truncate d0/d6d/f91 2795514 0 2024-02-16T22:19:23.026 INFO:tasks.workunit.client.1.smithi173.stdout:0/862: mknod d0/d12/d108/c11d 0 2024-02-16T22:19:23.026 INFO:tasks.workunit.client.1.smithi173.stdout:0/863: dread - d0/d12/d15/d3d/d98/d33/fcd zero size 2024-02-16T22:19:23.027 INFO:tasks.workunit.client.1.smithi173.stdout:0/864: symlink d0/d12/d15/d3d/d98/d14/d24/d70/l11e 0 2024-02-16T22:19:23.042 INFO:tasks.workunit.client.1.smithi173.stdout:9/848: dwrite d1/d2/d1a/f95 [0,4194304] 0 2024-02-16T22:19:23.042 INFO:tasks.workunit.client.1.smithi173.stdout:9/849: truncate d1/d2/d1a/d2f/d3b/da6/de3/ff2 1508002 0 2024-02-16T22:19:23.044 INFO:tasks.workunit.client.1.smithi173.stdout:8/997: dwrite dd/d7c/d7d/d22/d2e/d41/d73/fa6 [0,4194304] 0 2024-02-16T22:19:23.051 INFO:tasks.workunit.client.1.smithi173.stdout:0/865: getdents d0/d12/d15/d3d/d98/d14/d24/d70 0 2024-02-16T22:19:23.051 INFO:tasks.workunit.client.1.smithi173.stdout:0/866: dread - d0/d12/d15/d3d/d98/d14/d24/d2e/f83 zero size 2024-02-16T22:19:23.051 INFO:tasks.workunit.client.1.smithi173.stdout:0/867: stat d0/d12/d15/d3d/d98/d14/d38/cd4 0 2024-02-16T22:19:23.052 INFO:tasks.workunit.client.1.smithi173.stdout:9/850: dread d1/d2/d1a/d1f/f4d [0,4194304] 0 2024-02-16T22:19:23.052 INFO:tasks.workunit.client.1.smithi173.stdout:9/851: dread - d1/d2/d1a/d2f/d51/d96/ff5 zero size 2024-02-16T22:19:23.052 INFO:tasks.workunit.client.1.smithi173.stdout:9/852: fsync d1/d2/d1a/f28 0 2024-02-16T22:19:23.052 INFO:tasks.workunit.client.1.smithi173.stdout:0/868: truncate d0/d12/d15/d3d/d98/d14/d24/d32/d39/f2c 3766606 0 2024-02-16T22:19:23.052 INFO:tasks.workunit.client.1.smithi173.stdout:0/869: chown d0/d12/d15/d3d/d98/d14/d24/d2e/d6b/d8e/fd1 170373048 1 2024-02-16T22:19:23.052 INFO:tasks.workunit.client.1.smithi173.stdout:0/870: rename d0/d12/d15/d4f/d92 to d0/d12/d15/d4f/d92/d11f 22 2024-02-16T22:19:23.052 INFO:tasks.workunit.client.1.smithi173.stdout:0/871: creat d0/d12/d15/d3d/d98/d33/dc2/f120 x:0 0 0 2024-02-16T22:19:23.053 INFO:tasks.workunit.client.1.smithi173.stdout:9/853: chown d1/d2/d1a/d1f/d34/d49/d88/c110 28 1 2024-02-16T22:19:23.053 INFO:tasks.workunit.client.1.smithi173.stdout:9/854: readlink d1/d2/d1a/d2f/df4/d8c/d92/dd5/d107/d115/l104 0 2024-02-16T22:19:23.054 INFO:tasks.workunit.client.1.smithi173.stdout:0/872: dread d0/d12/d15/d4f/d92/fbe [0,4194304] 0 2024-02-16T22:19:23.055 INFO:tasks.workunit.client.1.smithi173.stdout:9/855: rename d1/d2/dec/ffb to d1/d2/d1a/d2f/d3b/da6/f119 0 2024-02-16T22:19:23.057 INFO:tasks.workunit.client.1.smithi173.stdout:0/873: link d0/fb d0/d12/d15/d3d/d98/d14/f121 0 2024-02-16T22:19:23.057 INFO:tasks.workunit.client.1.smithi173.stdout:0/874: write d0/d12/dce/ddb/f109 [51618,15712] 0 2024-02-16T22:19:23.058 INFO:tasks.workunit.client.1.smithi173.stdout:9/856: unlink d1/d2/d1a/d2f/d51/d96/cdf 0 2024-02-16T22:19:23.059 INFO:tasks.workunit.client.1.smithi173.stdout:0/875: rename d0/d12/d15/d3d/d98/d14/d24/d32/d39/ff0 to d0/d12/d108/f122 0 2024-02-16T22:19:23.060 INFO:tasks.workunit.client.1.smithi173.stdout:8/998: dwrite dd/d7c/dcb/fa1 [0,4194304] 0 2024-02-16T22:19:23.061 INFO:tasks.workunit.client.1.smithi173.stdout:9/857: creat d1/d2/d1a/d2f/df4/d8c/d92/dd5/d107/d115/f11a x:0 0 0 2024-02-16T22:19:23.062 INFO:tasks.workunit.client.1.smithi173.stdout:0/876: creat d0/d12/d15/d99/f123 x:0 0 0 2024-02-16T22:19:23.066 INFO:tasks.workunit.client.1.smithi173.stdout:9/858: rename d1/d2/d1a/d2f/d3b/l3c to d1/d5f/d6d/d97/l11b 0 2024-02-16T22:19:23.066 INFO:tasks.workunit.client.1.smithi173.stdout:8/999: rmdir dd/d7c/d7d/d22/d28/d40/d69/da7/dae 39 2024-02-16T22:19:23.067 INFO:tasks.workunit.client.1.smithi173.stdout:9/859: mknod d1/c11c 0 2024-02-16T22:19:23.067 INFO:tasks.workunit.client.1.smithi173.stdout:9/860: chown d1/d2/da2/cc4 121 1 2024-02-16T22:19:23.067 INFO:tasks.workunit.client.1.smithi173.stdout:9/861: write d1/d2/d1a/d2f/df4/f6a [633054,70796] 0 2024-02-16T22:19:23.067 INFO:tasks.workunit.client.1.smithi173.stdout:9/862: chown d1/d5f/d6d/d91/da7/fc2 791 1 2024-02-16T22:19:23.067 INFO:tasks.workunit.client.1.smithi173.stdout:9/863: creat d1/d2/f11d x:0 0 0 2024-02-16T22:19:23.071 INFO:tasks.workunit.client.1.smithi173.stdout:9/864: creat d1/d2/d1a/d2f/d51/f11e x:0 0 0 2024-02-16T22:19:23.071 INFO:tasks.workunit.client.1.smithi173.stdout:9/865: readlink d1/d5f/la4 0 2024-02-16T22:19:23.078 INFO:tasks.workunit.client.1.smithi173.stdout:0/877: dwrite d0/d12/d15/d3d/d98/d14/d24/d2e/f11c [0,4194304] 0 2024-02-16T22:19:23.078 INFO:tasks.workunit.client.1.smithi173.stdout:0/878: truncate d0/d12/d15/d3d/fa1 2823746 0 2024-02-16T22:19:23.078 INFO:tasks.workunit.client.1.smithi173.stdout:0/879: fdatasync d0/d12/d15/d3d/d98/d14/f71 0 2024-02-16T22:19:23.078 INFO:tasks.workunit.client.1.smithi173.stdout:0/880: readlink d0/d12/d15/d3d/d98/d14/lb0 0 2024-02-16T22:19:23.078 INFO:tasks.workunit.client.1.smithi173.stdout:0/881: stat d0/d12/d15/d3d/db5/dbf/l79 0 2024-02-16T22:19:23.078 INFO:tasks.workunit.client.1.smithi173.stdout:0/882: creat d0/d12/d15/d3d/f124 x:0 0 0 2024-02-16T22:19:23.082 INFO:tasks.workunit.client.1.smithi173.stdout:0/883: rename d0/d12/d15/d3d/d98/d14/d24/ddd/ff7 to d0/d12/dce/f125 0 2024-02-16T22:19:23.088 INFO:tasks.workunit.client.1.smithi173.stdout:9/866: dwrite d1/d2/d1a/d1f/d34/fb2 [0,4194304] 0 2024-02-16T22:19:23.089 INFO:tasks.workunit.client.1.smithi173.stdout:9/867: chown d1/d2/d1a/d1f/d34/d49/d88/c110 21790 1 2024-02-16T22:19:23.091 INFO:tasks.workunit.client.1.smithi173.stdout:0/884: dread d0/d12/d15/d3d/d98/d14/d24/d32/d39/fb7 [0,4194304] 0 2024-02-16T22:19:23.091 INFO:tasks.workunit.client.1.smithi173.stdout:0/885: fdatasync d0/d12/d15/d3d/d98/d14/f71 0 2024-02-16T22:19:23.091 INFO:tasks.workunit.client.1.smithi173.stdout:0/886: truncate d0/d12/d15/d3d/d98/d14/d38/df5/f116 1016874 0 2024-02-16T22:19:23.091 INFO:tasks.workunit.client.1.smithi173.stdout:0/887: truncate d0/d12/d15/d4f/fff 49858 0 2024-02-16T22:19:23.105 INFO:tasks.workunit.client.1.smithi173.stdout:0/888: dwrite d0/d12/d15/d3d/d98/f3e [0,4194304] 0 2024-02-16T22:19:23.105 INFO:tasks.workunit.client.1.smithi173.stdout:0/889: fsync d0/d6d/f7f 0 2024-02-16T22:19:23.107 INFO:tasks.workunit.client.1.smithi173.stdout:0/890: creat d0/d12/d15/d3d/d98/d14/d24/d32/f126 x:0 0 0 2024-02-16T22:19:23.108 INFO:tasks.workunit.client.1.smithi173.stdout:0/891: symlink d0/d12/d15/d3d/l127 0 2024-02-16T22:19:23.108 INFO:tasks.workunit.client.1.smithi173.stdout:0/892: mknod d0/c128 0 2024-02-16T22:19:23.109 INFO:tasks.workunit.client.1.smithi173.stdout:0/893: rmdir d0/d12/dce 39 2024-02-16T22:19:23.109 INFO:tasks.workunit.client.1.smithi173.stdout:0/894: chown d0/d12/d15/d3d/l7a 855508350 1 2024-02-16T22:19:23.110 INFO:tasks.workunit.client.1.smithi173.stdout:0/895: mkdir d0/d12/d15/d3d/d98/d14/d38/df5/d129 0 2024-02-16T22:19:23.111 INFO:tasks.workunit.client.1.smithi173.stdout:0/896: rename d0/d12/d15/d3d/dab/fb8 to d0/d12/d15/d3d/d98/d14/d24/ddd/f12a 0 2024-02-16T22:19:23.111 INFO:tasks.workunit.client.1.smithi173.stdout:0/897: readlink d0/d12/d15/d3d/d98/d14/d24/d32/lc6 0 2024-02-16T22:19:23.112 INFO:tasks.workunit.client.1.smithi173.stdout:0/898: chown d0/d12/d15/d3d/d98/d14/d24/d32/d39 627642 1 2024-02-16T22:19:23.113 INFO:tasks.workunit.client.1.smithi173.stdout:9/868: dwrite d1/d5f/f85 [0,4194304] 0 2024-02-16T22:19:23.117 INFO:tasks.workunit.client.1.smithi173.stdout:9/869: dread d1/d2/d1a/d3e/dc8/ffe [0,4194304] 0 2024-02-16T22:19:23.117 INFO:tasks.workunit.client.1.smithi173.stdout:9/870: stat d1/d2/d1a/d2f/df4/d8c/d92 0 2024-02-16T22:19:23.128 INFO:tasks.workunit.client.1.smithi173.stdout:0/899: dwrite d0/d12/d15/d3d/d98/d33/dc2/f120 [0,4194304] 0 2024-02-16T22:19:23.129 INFO:tasks.workunit.client.1.smithi173.stdout:0/900: fdatasync d0/d12/d15/d3d/d98/d14/d24/d5f/fba 0 2024-02-16T22:19:23.130 INFO:tasks.workunit.client.1.smithi173.stdout:0/901: mkdir d0/d12/d15/d3d/d98/d14/d12b 0 2024-02-16T22:19:23.132 INFO:tasks.workunit.client.1.smithi173.stdout:0/902: link d0/d12/d15/d3d/d98/d14/d24/d5f/fba d0/d12/d15/d3d/d98/d14/d12b/f12c 0 2024-02-16T22:19:23.133 INFO:tasks.workunit.client.1.smithi173.stdout:0/903: symlink d0/d12/d15/d3d/d98/d27/l12d 0 2024-02-16T22:19:23.134 INFO:tasks.workunit.client.1.smithi173.stdout:0/904: rmdir d0/d6d 39 2024-02-16T22:19:23.134 INFO:tasks.workunit.client.1.smithi173.stdout:0/905: dread - d0/d12/d15/d3d/db5/dbf/f100 zero size 2024-02-16T22:19:23.134 INFO:tasks.workunit.client.1.smithi173.stdout:1/913: sync 2024-02-16T22:19:23.135 INFO:tasks.workunit.client.1.smithi173.stdout:0/906: rmdir d0/d12/d15/d4f/d92 39 2024-02-16T22:19:23.136 INFO:tasks.workunit.client.1.smithi173.stdout:0/907: unlink d0/d12/d15/d3d/d98/d33/d54/lc7 0 2024-02-16T22:19:23.138 INFO:tasks.workunit.client.1.smithi173.stdout:1/914: dread db/d1c/d25/d28/d3f/fc8 [0,4194304] 0 2024-02-16T22:19:23.140 INFO:tasks.workunit.client.1.smithi173.stdout:1/915: creat db/d29/f139 x:0 0 0 2024-02-16T22:19:23.140 INFO:tasks.workunit.client.1.smithi173.stdout:1/916: chown db/d29/d50/fc6 5929436 1 2024-02-16T22:19:23.140 INFO:tasks.workunit.client.1.smithi173.stdout:1/917: truncate db/d29/d50/d85/f138 766633 0 2024-02-16T22:19:23.140 INFO:tasks.workunit.client.1.smithi173.stdout:1/918: truncate f9 3017678 0 2024-02-16T22:19:23.140 INFO:tasks.workunit.client.1.smithi173.stdout:1/919: truncate db/d1c/d7f/faa 253642 0 2024-02-16T22:19:23.140 INFO:tasks.workunit.client.1.smithi173.stdout:1/920: symlink db/d1c/d7f/d98/l13a 0 2024-02-16T22:19:23.142 INFO:tasks.workunit.client.1.smithi173.stdout:1/921: dread db/d1d/f20 [0,4194304] 0 2024-02-16T22:19:23.142 INFO:tasks.workunit.client.1.smithi173.stdout:1/922: mknod db/d1d/dcf/d109/c13b 0 2024-02-16T22:19:23.150 INFO:tasks.workunit.client.1.smithi173.stdout:1/923: read db/d1c/d25/d28/d3f/d4a/f99 [2097199,42806] 0 2024-02-16T22:19:23.171 INFO:tasks.workunit.client.1.smithi173.stdout:1/924: dwrite db/d1d/f33 [4194304,4194304] 0 2024-02-16T22:19:23.172 INFO:tasks.workunit.client.1.smithi173.stdout:1/925: read db/d29/db5/ff4 [390321,27696] 0 2024-02-16T22:19:23.173 INFO:tasks.workunit.client.1.smithi173.stdout:1/926: creat db/d5f/da9/f13c x:0 0 0 2024-02-16T22:19:23.173 INFO:tasks.workunit.client.1.smithi173.stdout:1/927: dread - db/d29/d83/dc2/f11b zero size 2024-02-16T22:19:23.190 INFO:tasks.workunit.client.1.smithi173.stdout:1/928: dwrite db/d1c/d25/d28/fbf [0,4194304] 0 2024-02-16T22:19:23.190 INFO:tasks.workunit.client.1.smithi173.stdout:1/929: readlink db/lfd 0 2024-02-16T22:19:23.193 INFO:tasks.workunit.client.1.smithi173.stdout:1/930: unlink db/d29/d50/fc6 0 2024-02-16T22:19:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:23 smithi134 ceph-mon[28869]: Manager daemon smithi173.kbofaa is now available 2024-02-16T22:19:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:23 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:23 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:19:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:23 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:19:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:23 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:19:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:23 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi173.kbofaa/mirror_snapshot_schedule"}]: dispatch 2024-02-16T22:19:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:23 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi173.kbofaa/mirror_snapshot_schedule"}]: dispatch 2024-02-16T22:19:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:23 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi173.kbofaa/trash_purge_schedule"}]: dispatch 2024-02-16T22:19:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:23 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi173.kbofaa/trash_purge_schedule"}]: dispatch 2024-02-16T22:19:23.281 INFO:tasks.workunit.client.1.smithi173.stdout:4/853: sync 2024-02-16T22:19:23.281 INFO:tasks.workunit.client.1.smithi173.stdout:5/976: sync 2024-02-16T22:19:23.282 INFO:tasks.workunit.client.1.smithi173.stdout:5/977: mkdir d8/da/d1b/d57/dc9/d92/dbc/dcd/dd1/d12a/d138 0 2024-02-16T22:19:23.283 INFO:tasks.workunit.client.1.smithi173.stdout:5/978: readlink d8/da/d1b/d57/lad 0 2024-02-16T22:19:23.285 INFO:tasks.workunit.client.1.smithi173.stdout:4/854: rename d7/df/d8b/da1/d114 to d7/d28/d31/d125 0 2024-02-16T22:19:23.286 INFO:tasks.workunit.client.1.smithi173.stdout:4/855: chown d7/df/d62/dd8/f100 69057 1 2024-02-16T22:19:23.287 INFO:tasks.workunit.client.1.smithi173.stdout:4/856: mkdir d7/d28/d31/d33/dca/df4/d126 0 2024-02-16T22:19:23.289 INFO:tasks.workunit.client.1.smithi173.stdout:4/857: link d7/d28/c59 d7/df/d62/dd8/dde/c127 0 2024-02-16T22:19:23.292 INFO:tasks.workunit.client.1.smithi173.stdout:4/858: rename d7/d12/f73 to d7/d28/d31/d125/f128 0 2024-02-16T22:19:23.304 INFO:tasks.workunit.client.1.smithi173.stdout:5/979: dwrite d8/d27/d62/dfa/ffb [0,4194304] 0 2024-02-16T22:19:23.315 INFO:tasks.workunit.client.1.smithi173.stdout:4/859: dwrite d7/d28/d31/d33/d7d/d3d/fce [0,4194304] 0 2024-02-16T22:19:23.315 INFO:tasks.workunit.client.1.smithi173.stdout:4/860: chown d7/df9/d11c 1 1 2024-02-16T22:19:23.321 INFO:tasks.workunit.client.1.smithi173.stdout:5/980: dread d8/da/d2d/d36/f8a [0,4194304] 0 2024-02-16T22:19:23.323 INFO:tasks.workunit.client.1.smithi173.stdout:4/861: rename d7/d12/d7e to d7/dd5/d129 0 2024-02-16T22:19:23.325 INFO:tasks.workunit.client.1.smithi173.stdout:4/862: unlink d7/d28/d31/d33/dca/fe7 0 2024-02-16T22:19:23.325 INFO:tasks.workunit.client.1.smithi173.stdout:4/863: dread - d7/d28/d31/d33/d7d/d3d/fd4 zero size 2024-02-16T22:19:23.326 INFO:tasks.workunit.client.1.smithi173.stdout:4/864: symlink d7/d28/d31/d33/dcb/df8/l12a 0 2024-02-16T22:19:23.329 INFO:tasks.workunit.client.1.smithi173.stdout:4/865: link d7/d28/d31/l36 d7/df/l12b 0 2024-02-16T22:19:23.330 INFO:tasks.workunit.client.1.smithi173.stdout:4/866: mknod d7/df/d62/dea/c12c 0 2024-02-16T22:19:23.332 INFO:tasks.workunit.client.1.smithi173.stdout:4/867: truncate d7/d28/d31/fbd 955518 0 2024-02-16T22:19:23.332 INFO:tasks.workunit.client.1.smithi173.stdout:4/868: fsync d7/df/fe8 0 2024-02-16T22:19:23.346 INFO:tasks.workunit.client.1.smithi173.stdout:5/981: dwrite d8/da/d2d/d3a/da7/de7/f10c [0,4194304] 0 2024-02-16T22:19:23.348 INFO:tasks.workunit.client.1.smithi173.stdout:4/869: write d7/d28/d31/d33/fe1 [896397,90129] 0 2024-02-16T22:19:23.348 INFO:tasks.workunit.client.1.smithi173.stdout:4/870: stat d7/d28/d31/d72/d93/d95/db4/f123 0 2024-02-16T22:19:23.348 INFO:tasks.workunit.client.1.smithi173.stdout:4/871: dread - d7/d28/d31/d33/f11a zero size 2024-02-16T22:19:23.348 INFO:tasks.workunit.client.1.smithi173.stdout:5/982: dread f7 [0,4194304] 0 2024-02-16T22:19:23.350 INFO:tasks.workunit.client.1.smithi173.stdout:4/872: creat d7/df/f12d x:0 0 0 2024-02-16T22:19:23.352 INFO:tasks.workunit.client.1.smithi173.stdout:4/873: rename d7/d28/d31/d33/d7d/d3d/fd4 to d7/d28/d31/d125/f12e 0 2024-02-16T22:19:23.352 INFO:tasks.workunit.client.1.smithi173.stdout:4/874: chown d7/d28/d31/d33/dbf/dfe 256883044 1 2024-02-16T22:19:23.353 INFO:tasks.workunit.client.1.smithi173.stdout:4/875: stat d7/cb 0 2024-02-16T22:19:23.364 INFO:tasks.workunit.client.1.smithi173.stdout:5/983: dread d8/da/d1b/d57/dde/f106 [0,4194304] 0 2024-02-16T22:19:23.364 INFO:tasks.workunit.client.1.smithi173.stdout:5/984: truncate d8/da/d1f/d8c/ffc 756587 0 2024-02-16T22:19:23.364 INFO:tasks.workunit.client.1.smithi173.stdout:4/876: write d7/d28/d31/d33/d7d/d4e/f6a [3188132,124956] 0 2024-02-16T22:19:23.364 INFO:tasks.workunit.client.1.smithi173.stdout:4/877: write d7/df/d62/f113 [769662,89773] 0 2024-02-16T22:19:23.366 INFO:tasks.workunit.client.1.smithi173.stdout:5/985: creat d8/d27/d35/f139 x:0 0 0 2024-02-16T22:19:23.366 INFO:tasks.workunit.client.1.smithi173.stdout:5/986: write d8/da/d2d/d56/fba [730745,90553] 0 2024-02-16T22:19:23.368 INFO:tasks.workunit.client.1.smithi173.stdout:4/878: link d7/d28/d31/d33/d7d/d4e/c53 d7/df/c12f 0 2024-02-16T22:19:23.372 INFO:tasks.workunit.client.1.smithi173.stdout:4/879: getdents d7/d12 0 2024-02-16T22:19:23.378 INFO:tasks.workunit.client.1.smithi173.stdout:5/987: write d8/fa3 [2016664,117135] 0 2024-02-16T22:19:23.378 INFO:tasks.workunit.client.1.smithi173.stdout:5/988: chown d8/da/d1b/d57/d105 0 1 2024-02-16T22:19:23.382 INFO:tasks.workunit.client.1.smithi173.stdout:5/989: mkdir d8/da/d2d/d36/dc2/d13a 0 2024-02-16T22:19:23.387 INFO:tasks.workunit.client.1.smithi173.stdout:5/990: creat d8/da/f13b x:0 0 0 2024-02-16T22:19:23.389 INFO:tasks.workunit.client.1.smithi173.stdout:5/991: mknod d8/da/d2d/d56/c13c 0 2024-02-16T22:19:23.398 INFO:tasks.workunit.client.1.smithi173.stdout:4/880: dwrite d7/d12/dda/fee [0,4194304] 0 2024-02-16T22:19:23.398 INFO:tasks.workunit.client.1.smithi173.stdout:4/881: write d7/fe5 [609487,119364] 0 2024-02-16T22:19:23.401 INFO:tasks.workunit.client.1.smithi173.stdout:4/882: rmdir d7/d28/d52/d89 39 2024-02-16T22:19:23.402 INFO:tasks.workunit.client.1.smithi173.stdout:5/992: write d8/d27/d62/f87 [270307,68897] 0 2024-02-16T22:19:23.430 INFO:tasks.workunit.client.1.smithi173.stdout:4/883: dwrite d7/fe5 [0,4194304] 0 2024-02-16T22:19:23.430 INFO:tasks.workunit.client.1.smithi173.stdout:4/884: fdatasync d7/d28/d31/d33/dbf/f105 0 2024-02-16T22:19:23.430 INFO:tasks.workunit.client.1.smithi173.stdout:5/993: dwrite d8/da/d2d/d36/d50/f114 [0,4194304] 0 2024-02-16T22:19:23.430 INFO:tasks.workunit.client.1.smithi173.stdout:4/885: chown d7/d28/d31/d33/d7d/d45/f69 282531154 1 2024-02-16T22:19:23.430 INFO:tasks.workunit.client.1.smithi173.stdout:4/886: truncate d7/dd5/d129/f9d 931464 0 2024-02-16T22:19:23.430 INFO:tasks.workunit.client.1.smithi173.stdout:4/887: fsync d7/d12/f30 0 2024-02-16T22:19:23.430 INFO:tasks.workunit.client.1.smithi173.stdout:4/888: getdents d7/d28/d31/d33/dca/df4/d126 0 2024-02-16T22:19:23.430 INFO:tasks.workunit.client.1.smithi173.stdout:4/889: getdents d7/d28/d31/d33/dbf/dfe 0 2024-02-16T22:19:23.432 INFO:tasks.workunit.client.1.smithi173.stdout:4/890: symlink d7/df/d8b/da1/l130 0 2024-02-16T22:19:23.432 INFO:tasks.workunit.client.1.smithi173.stdout:4/891: getdents d7/d28/d31/d33/dca/df4/d103 0 2024-02-16T22:19:23.433 INFO:tasks.workunit.client.1.smithi173.stdout:4/892: creat d7/df/d62/dd8/d124/f131 x:0 0 0 2024-02-16T22:19:23.433 INFO:tasks.workunit.client.1.smithi173.stdout:4/893: creat d7/d28/d31/f132 x:0 0 0 2024-02-16T22:19:23.436 INFO:tasks.workunit.client.1.smithi173.stdout:4/894: mkdir d7/df/d62/d133 0 2024-02-16T22:19:23.436 INFO:tasks.workunit.client.1.smithi173.stdout:4/895: fdatasync d7/df/f1b 0 2024-02-16T22:19:23.438 INFO:tasks.workunit.client.1.smithi173.stdout:4/896: getdents d7 0 2024-02-16T22:19:23.438 INFO:tasks.workunit.client.1.smithi173.stdout:4/897: fdatasync d7/d28/d31/fc4 0 2024-02-16T22:19:23.439 INFO:tasks.workunit.client.1.smithi173.stdout:4/898: write d7/d28/d31/d33/f50 [659173,79221] 0 2024-02-16T22:19:23.439 INFO:tasks.workunit.client.1.smithi173.stdout:4/899: creat d7/d12/dda/f134 x:0 0 0 2024-02-16T22:19:23.442 INFO:tasks.workunit.client.1.smithi173.stdout:4/900: unlink d7/d28/d52/cf6 0 2024-02-16T22:19:23.442 INFO:tasks.workunit.client.1.smithi173.stdout:2/862: sync 2024-02-16T22:19:23.442 INFO:tasks.workunit.client.1.smithi173.stdout:7/856: sync 2024-02-16T22:19:23.443 INFO:tasks.workunit.client.1.smithi173.stdout:2/863: dread - d2/d4/d8/d3a/de1/f10c zero size 2024-02-16T22:19:23.443 INFO:tasks.workunit.client.1.smithi173.stdout:4/901: dread d7/dd5/dad/f10f [0,4194304] 0 2024-02-16T22:19:23.444 INFO:tasks.workunit.client.1.smithi173.stdout:7/857: truncate d1/d1d/f32 1557319 0 2024-02-16T22:19:23.445 INFO:tasks.workunit.client.1.smithi173.stdout:7/858: read d1/d1d/d4c/d63/fa5 [638884,39947] 0 2024-02-16T22:19:23.445 INFO:tasks.workunit.client.1.smithi173.stdout:7/859: write d1/d1d/d4c/d63/fa5 [613774,14642] 0 2024-02-16T22:19:23.447 INFO:tasks.workunit.client.1.smithi173.stdout:4/902: rename d7/d28/c43 to d7/d28/d31/d72/d93/d95/c135 0 2024-02-16T22:19:23.447 INFO:tasks.workunit.client.1.smithi173.stdout:4/903: truncate d7/d28/d31/d33/f50 1151934 0 2024-02-16T22:19:23.449 INFO:tasks.workunit.client.1.smithi173.stdout:2/864: rename d2/dc/d19/d1c/d87 to d2/dc/d19/d1c/d113 0 2024-02-16T22:19:23.449 INFO:tasks.workunit.client.1.smithi173.stdout:2/865: readlink d2/dc/d19/d1a/lb7 0 2024-02-16T22:19:23.451 INFO:tasks.workunit.client.1.smithi173.stdout:2/866: rename d2/dc/d19/da3/d107 to d2/d4/d8/d3a/de1/d114 0 2024-02-16T22:19:23.451 INFO:tasks.workunit.client.1.smithi173.stdout:2/867: readlink d2/d10/d62/lbf 0 2024-02-16T22:19:23.451 INFO:tasks.workunit.client.1.smithi173.stdout:2/868: readlink d2/d4/d8/l9 0 2024-02-16T22:19:23.456 INFO:tasks.workunit.client.1.smithi173.stdout:7/860: write d1/d1d/d4c/d63/d6c/ffc [509945,5151] 0 2024-02-16T22:19:23.456 INFO:tasks.workunit.client.1.smithi173.stdout:7/861: write d1/d1d/d4c/d63/d13/d22/d53/fec [746757,101401] 0 2024-02-16T22:19:23.456 INFO:tasks.workunit.client.1.smithi173.stdout:5/994: dwrite d8/d27/f9e [0,4194304] 0 2024-02-16T22:19:23.459 INFO:tasks.workunit.client.1.smithi173.stdout:7/862: mknod d1/dd4/d103/c113 0 2024-02-16T22:19:23.464 INFO:tasks.workunit.client.1.smithi173.stdout:7/863: getdents d1/d1d/d4c/d63/d6c/dca 0 2024-02-16T22:19:23.470 INFO:tasks.workunit.client.1.smithi173.stdout:5/995: dread d8/d27/d62/f4a [0,4194304] 0 2024-02-16T22:19:23.471 INFO:tasks.workunit.client.1.smithi173.stdout:4/904: dwrite d7/df/f80 [0,4194304] 0 2024-02-16T22:19:23.475 INFO:tasks.workunit.client.1.smithi173.stdout:4/905: link d7/ced d7/d28/d31/d33/d7d/d4e/dcc/c136 0 2024-02-16T22:19:23.476 INFO:tasks.workunit.client.1.smithi173.stdout:4/906: mknod d7/d28/d52/c137 0 2024-02-16T22:19:23.476 INFO:tasks.workunit.client.1.smithi173.stdout:4/907: dread - d7/d28/d31/d33/dbf/fd6 zero size 2024-02-16T22:19:23.476 INFO:tasks.workunit.client.1.smithi173.stdout:4/908: write d7/d28/d31/d125/f11d [93893,78766] 0 2024-02-16T22:19:23.477 INFO:tasks.workunit.client.1.smithi173.stdout:4/909: fsync d7/d28/d31/d33/d7d/d4e/f5a 0 2024-02-16T22:19:23.477 INFO:tasks.workunit.client.1.smithi173.stdout:4/910: write d7/df/d8b/fef [34316,5911] 0 2024-02-16T22:19:23.478 INFO:tasks.workunit.client.1.smithi173.stdout:4/911: rename d7/d28/d14/cdb to d7/d28/d31/d33/d7d/d4e/dd7/c138 0 2024-02-16T22:19:23.478 INFO:tasks.workunit.client.1.smithi173.stdout:4/912: dread - d7/d28/d52/d89/fc0 zero size 2024-02-16T22:19:23.480 INFO:tasks.workunit.client.1.smithi173.stdout:4/913: mkdir d7/d28/d31/d33/d7d/d4e/dd7/d139 0 2024-02-16T22:19:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:23 smithi173 ceph-mon[37280]: Manager daemon smithi173.kbofaa is now available 2024-02-16T22:19:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:23 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:23 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:19:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:23 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:19:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:23 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:19:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:23 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi173.kbofaa/mirror_snapshot_schedule"}]: dispatch 2024-02-16T22:19:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:23 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi173.kbofaa/mirror_snapshot_schedule"}]: dispatch 2024-02-16T22:19:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:23 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi173.kbofaa/trash_purge_schedule"}]: dispatch 2024-02-16T22:19:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:23 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi173.kbofaa/trash_purge_schedule"}]: dispatch 2024-02-16T22:19:23.483 INFO:tasks.workunit.client.1.smithi173.stdout:5/996: dread d8/d27/d28/fa0 [0,4194304] 0 2024-02-16T22:19:23.484 INFO:tasks.workunit.client.1.smithi173.stdout:5/997: truncate d8/da/fc 4069007 0 2024-02-16T22:19:23.487 INFO:tasks.workunit.client.1.smithi173.stdout:5/998: unlink d8/da/d1f/d8c/ffc 0 2024-02-16T22:19:23.487 INFO:tasks.workunit.client.1.smithi173.stdout:2/869: dwrite d2/d4/d8/d30/d44/d83/f85 [0,4194304] 0 2024-02-16T22:19:23.488 INFO:tasks.workunit.client.1.smithi173.stdout:7/864: dwrite d1/d1d/f4e [0,4194304] 0 2024-02-16T22:19:23.491 INFO:tasks.workunit.client.1.smithi173.stdout:2/870: rmdir d2/d4/d57 39 2024-02-16T22:19:23.496 INFO:tasks.workunit.client.1.smithi173.stdout:7/865: symlink d1/d1d/d4c/d91/l114 0 2024-02-16T22:19:23.497 INFO:tasks.workunit.client.1.smithi173.stdout:7/866: symlink d1/d1d/d4c/d63/d13/d22/d7e/db5/l115 0 2024-02-16T22:19:23.497 INFO:tasks.workunit.client.1.smithi173.stdout:9/871: sync 2024-02-16T22:19:23.498 INFO:tasks.workunit.client.1.smithi173.stdout:9/872: readlink d1/d2/d1a/d1f/d34/d49/l8f 0 2024-02-16T22:19:23.498 INFO:tasks.workunit.client.1.smithi173.stdout:9/873: dread - d1/d2/d1a/d2f/d51/f11e zero size 2024-02-16T22:19:23.498 INFO:tasks.workunit.client.1.smithi173.stdout:9/874: chown d1/d2/d1a/d2f/d3b/da6 0 1 2024-02-16T22:19:23.498 INFO:tasks.workunit.client.1.smithi173.stdout:7/867: mknod d1/d1d/d4c/d63/d13/d36/c116 0 2024-02-16T22:19:23.498 INFO:tasks.workunit.client.1.smithi173.stdout:7/868: chown d1/d1d/d4c/d63/d13/d22/d7e/dbd 148 1 2024-02-16T22:19:23.498 INFO:tasks.workunit.client.1.smithi173.stdout:5/999: write d8/f6a [120065,102844] 0 2024-02-16T22:19:23.499 INFO:tasks.workunit.client.1.smithi173.stdout:9/875: symlink d1/d2/d1a/d2f/d3b/da6/de3/l11f 0 2024-02-16T22:19:23.499 INFO:tasks.workunit.client.1.smithi173.stdout:7/869: symlink d1/d1d/d4c/d63/d48/d9a/de6/l117 0 2024-02-16T22:19:23.500 INFO:tasks.workunit.client.1.smithi173.stdout:9/876: link d1/d2/d1a/d2f/d51/f11e d1/d2/d1a/d2f/d51/d96/db3/f120 0 2024-02-16T22:19:23.500 INFO:tasks.workunit.client.1.smithi173.stdout:9/877: readlink d1/d2/d1a/d1f/d34/d49/dac/lfd 0 2024-02-16T22:19:23.503 INFO:tasks.workunit.client.1.smithi173.stdout:9/878: getdents d1/d2/d1a/d1f/d34/d49/dac 0 2024-02-16T22:19:23.503 INFO:tasks.workunit.client.1.smithi173.stdout:9/879: dread d1/d2/d10/f48 [0,4194304] 0 2024-02-16T22:19:23.504 INFO:tasks.workunit.client.1.smithi173.stdout:9/880: symlink d1/d2/d1a/d2f/d3b/da6/de3/l121 0 2024-02-16T22:19:23.505 INFO:tasks.workunit.client.1.smithi173.stdout:9/881: link d1/c11c d1/c122 0 2024-02-16T22:19:23.508 INFO:tasks.workunit.client.1.smithi173.stdout:9/882: dread d1/d5f/d6d/f74 [0,4194304] 0 2024-02-16T22:19:23.508 INFO:tasks.workunit.client.1.smithi173.stdout:9/883: creat d1/d2/d1a/d2f/df4/d8c/d92/dd5/d107/d115/f123 x:0 0 0 2024-02-16T22:19:23.510 INFO:tasks.workunit.client.1.smithi173.stdout:9/884: mkdir d1/d2/d1a/d2f/df4/d8c/d124 0 2024-02-16T22:19:23.511 INFO:tasks.workunit.client.1.smithi173.stdout:9/885: creat d1/d5f/d6d/d112/f125 x:0 0 0 2024-02-16T22:19:23.515 INFO:tasks.workunit.client.1.smithi173.stdout:7/870: read d1/d1d/f45 [4162243,85163] 0 2024-02-16T22:19:23.517 INFO:tasks.workunit.client.1.smithi173.stdout:7/871: getdents d1/d1d/d4c/d63/d11 0 2024-02-16T22:19:23.517 INFO:tasks.workunit.client.1.smithi173.stdout:7/872: readlink d1/d1d/d4c/d63/d11/l8a 0 2024-02-16T22:19:23.519 INFO:tasks.workunit.client.1.smithi173.stdout:2/871: dwrite d2/d4/d8/d30/d44/d83/f85 [0,4194304] 0 2024-02-16T22:19:23.519 INFO:tasks.workunit.client.1.smithi173.stdout:4/914: dwrite d7/d28/d31/f132 [0,4194304] 0 2024-02-16T22:19:23.523 INFO:tasks.workunit.client.1.smithi173.stdout:1/931: sync 2024-02-16T22:19:23.523 INFO:tasks.workunit.client.1.smithi173.stdout:0/908: sync 2024-02-16T22:19:23.523 INFO:tasks.workunit.client.1.smithi173.stdout:1/932: dread - db/d1c/fd0 zero size 2024-02-16T22:19:23.524 INFO:tasks.workunit.client.1.smithi173.stdout:4/915: link d7/dd5/d129/l10b d7/dd5/d129/l13a 0 2024-02-16T22:19:23.524 INFO:tasks.workunit.client.1.smithi173.stdout:4/916: chown d7/d28/d31/d33/d7d/d45/c78 7472 1 2024-02-16T22:19:23.525 INFO:tasks.workunit.client.1.smithi173.stdout:0/909: rmdir d0/d12/d15/d3d/d98/d14/d50 39 2024-02-16T22:19:23.526 INFO:tasks.workunit.client.1.smithi173.stdout:7/873: dread d1/d1d/d4c/d63/d48/f5d [0,4194304] 0 2024-02-16T22:19:23.526 INFO:tasks.workunit.client.1.smithi173.stdout:1/933: truncate db/d1c/d25/d28/d3f/f4e 1720139 0 2024-02-16T22:19:23.527 INFO:tasks.workunit.client.1.smithi173.stdout:4/917: creat d7/d28/d31/d33/d7d/d4e/dd7/dec/f13b x:0 0 0 2024-02-16T22:19:23.529 INFO:tasks.workunit.client.1.smithi173.stdout:0/910: unlink d0/d12/d15/d3d/ce0 0 2024-02-16T22:19:23.530 INFO:tasks.workunit.client.1.smithi173.stdout:9/886: dwrite d1/d2/d1a/d2f/d51/d96/f9b [0,4194304] 0 2024-02-16T22:19:23.530 INFO:tasks.workunit.client.1.smithi173.stdout:2/872: dread d2/dc/d19/f51 [0,4194304] 0 2024-02-16T22:19:23.530 INFO:tasks.workunit.client.1.smithi173.stdout:2/873: truncate d2/dc/d19/d1a/fc5 1374568 0 2024-02-16T22:19:23.530 INFO:tasks.workunit.client.1.smithi173.stdout:2/874: fsync d2/d4/d8/fe8 0 2024-02-16T22:19:23.530 INFO:tasks.workunit.client.1.smithi173.stdout:7/874: truncate d1/d1d/d4c/fc5 616485 0 2024-02-16T22:19:23.530 INFO:tasks.workunit.client.1.smithi173.stdout:7/875: truncate d1/d1d/d4c/d63/d13/d36/f4d 4568255 0 2024-02-16T22:19:23.530 INFO:tasks.workunit.client.1.smithi173.stdout:7/876: chown d1/d1d/d4c/d63/d13/d22/d53/d27/c30 1782 1 2024-02-16T22:19:23.531 INFO:tasks.workunit.client.1.smithi173.stdout:7/877: dread - d1/d1d/f112 zero size 2024-02-16T22:19:23.531 INFO:tasks.workunit.client.1.smithi173.stdout:7/878: read d1/d1d/d4c/d63/d13/d36/f52 [1776423,33129] 0 2024-02-16T22:19:23.532 INFO:tasks.workunit.client.1.smithi173.stdout:1/934: rename db/d29/d83/d121 to db/d5f/d97/d13d 0 2024-02-16T22:19:23.534 INFO:tasks.workunit.client.1.smithi173.stdout:0/911: truncate d0/d12/d15/d3d/f65 1618804 0 2024-02-16T22:19:23.534 INFO:tasks.workunit.client.1.smithi173.stdout:0/912: creat d0/d12/d15/d3d/d98/d14/d38/f12e x:0 0 0 2024-02-16T22:19:23.534 INFO:tasks.workunit.client.1.smithi173.stdout:0/913: fdatasync d0/d84/d8c/f97 0 2024-02-16T22:19:23.537 INFO:tasks.workunit.client.1.smithi173.stdout:9/887: creat d1/d2/d1a/d3e/d79/f126 x:0 0 0 2024-02-16T22:19:23.539 INFO:tasks.workunit.client.1.smithi173.stdout:4/918: dread d7/dd5/fae [0,4194304] 0 2024-02-16T22:19:23.539 INFO:tasks.workunit.client.1.smithi173.stdout:9/888: dread d1/d2/d1a/d2f/d51/d96/fdd [0,4194304] 0 2024-02-16T22:19:23.542 INFO:tasks.workunit.client.1.smithi173.stdout:7/879: truncate d1/d1d/d4c/d63/f4 117129 0 2024-02-16T22:19:23.542 INFO:tasks.workunit.client.1.smithi173.stdout:7/880: read d1/d1d/d4c/d63/d48/f79 [1755734,19100] 0 2024-02-16T22:19:23.543 INFO:tasks.workunit.client.1.smithi173.stdout:7/881: fsync d1/d1d/d4c/d63/d13/d22/d53/db9/dbc/ff1 0 2024-02-16T22:19:23.543 INFO:tasks.workunit.client.1.smithi173.stdout:7/882: chown d1/d1d/d4c/d63/d48/cd8 8704 1 2024-02-16T22:19:23.545 INFO:tasks.workunit.client.1.smithi173.stdout:2/875: rename d2/d10/d9e to d2/dc/d19/d69/da5/d115 0 2024-02-16T22:19:23.548 INFO:tasks.workunit.client.1.smithi173.stdout:0/914: creat d0/d12/d15/d3d/d98/d33/d54/d117/f12f x:0 0 0 2024-02-16T22:19:23.548 INFO:tasks.workunit.client.1.smithi173.stdout:0/915: write d0/d12/d15/d4f/f9d [1177077,11964] 0 2024-02-16T22:19:23.549 INFO:tasks.workunit.client.1.smithi173.stdout:1/935: dwrite db/d1c/d7f/d98/fea [0,4194304] 0 2024-02-16T22:19:23.549 INFO:tasks.workunit.client.1.smithi173.stdout:1/936: fsync db/d29/f39 0 2024-02-16T22:19:23.549 INFO:tasks.workunit.client.1.smithi173.stdout:1/937: chown db/d29/f9c 76227 1 2024-02-16T22:19:23.549 INFO:tasks.workunit.client.1.smithi173.stdout:4/919: creat d7/d28/d31/d33/dca/df4/d126/f13c x:0 0 0 2024-02-16T22:19:23.550 INFO:tasks.workunit.client.1.smithi173.stdout:0/916: write d0/d12/d15/d3d/d98/d27/fd9 [685494,96875] 0 2024-02-16T22:19:23.550 INFO:tasks.workunit.client.1.smithi173.stdout:7/883: mknod d1/d1d/d4c/d63/d54/d107/c118 0 2024-02-16T22:19:23.554 INFO:tasks.workunit.client.1.smithi173.stdout:9/889: rename d1/d2/d1a/d1f/d34/d49/dac/le8 to d1/d2/d1a/d1f/d34/d49/d10e/l127 0 2024-02-16T22:19:23.556 INFO:tasks.workunit.client.1.smithi173.stdout:4/920: dread d7/d28/d31/d33/d7d/d4e/f6a [0,4194304] 0 2024-02-16T22:19:23.558 INFO:tasks.workunit.client.1.smithi173.stdout:1/938: symlink db/d1d/dcf/d109/l13e 0 2024-02-16T22:19:23.559 INFO:tasks.workunit.client.1.smithi173.stdout:0/917: rmdir d0/d12/d15/d3d/d98/d14/d24/d58 39 2024-02-16T22:19:23.560 INFO:tasks.workunit.client.1.smithi173.stdout:2/876: dwrite d2/d4/d8/d30/d44/d81/d99/ff5 [0,4194304] 0 2024-02-16T22:19:23.560 INFO:tasks.workunit.client.1.smithi173.stdout:2/877: chown d2/dc/d19/fe4 1 1 2024-02-16T22:19:23.560 INFO:tasks.workunit.client.1.smithi173.stdout:2/878: readlink d2/lbb 0 2024-02-16T22:19:23.560 INFO:tasks.workunit.client.1.smithi173.stdout:2/879: truncate d2/d4/d8/d2d/de6/f108 507483 0 2024-02-16T22:19:23.567 INFO:tasks.workunit.client.1.smithi173.stdout:1/939: dread db/d1c/d25/d45/fdf [0,4194304] 0 2024-02-16T22:19:23.567 INFO:tasks.workunit.client.1.smithi173.stdout:1/940: readlink db/d30/l4c 0 2024-02-16T22:19:23.567 INFO:tasks.workunit.client.1.smithi173.stdout:1/941: readlink db/d1c/lb8 0 2024-02-16T22:19:23.572 INFO:tasks.workunit.client.1.smithi173.stdout:0/918: write d0/d12/d15/d3d/d98/f89 [493653,87251] 0 2024-02-16T22:19:23.572 INFO:tasks.workunit.client.1.smithi173.stdout:0/919: stat d0/f5 0 2024-02-16T22:19:24.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:24 smithi134 ceph-mon[28869]: Deploying cephadm binary to smithi134 2024-02-16T22:19:24.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:24 smithi134 ceph-mon[28869]: Deploying cephadm binary to smithi173 2024-02-16T22:19:24.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:24 smithi134 ceph-mon[28869]: mgrmap e22: smithi173.kbofaa(active, since 1.07659s) 2024-02-16T22:19:24.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:24 smithi134 ceph-mon[28869]: pgmap v3: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail 2024-02-16T22:19:24.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:24 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:24.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:24 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:24.383 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:24 smithi173 ceph-mon[37280]: Deploying cephadm binary to smithi134 2024-02-16T22:19:24.383 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:24 smithi173 ceph-mon[37280]: Deploying cephadm binary to smithi173 2024-02-16T22:19:24.383 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:24 smithi173 ceph-mon[37280]: mgrmap e22: smithi173.kbofaa(active, since 1.07659s) 2024-02-16T22:19:24.383 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:24 smithi173 ceph-mon[37280]: pgmap v3: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail 2024-02-16T22:19:24.383 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:24 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:24.383 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:24 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:24.712 INFO:tasks.workunit.client.1.smithi173.stdout:7/884: rmdir d1/d1d/d4c/d63/d13/d22/d7e 39 2024-02-16T22:19:24.712 INFO:tasks.workunit.client.1.smithi173.stdout:7/885: truncate d1/d1d/d4c/d63/d13/d36/f10a 369936 0 2024-02-16T22:19:24.713 INFO:tasks.workunit.client.1.smithi173.stdout:7/886: dread d1/d1d/d4c/d63/d48/f5c [0,4194304] 0 2024-02-16T22:19:24.740 INFO:tasks.workunit.client.1.smithi173.stdout:9/890: rename d1/d2/d1a/d3e/dc8 to d1/d2/d1a/d3e/d79/d128 0 2024-02-16T22:19:24.752 INFO:tasks.workunit.client.1.smithi173.stdout:1/942: mknod db/d29/d50/c13f 0 2024-02-16T22:19:24.752 INFO:tasks.workunit.client.1.smithi173.stdout:1/943: creat db/d1c/d25/d28/d3f/d4a/f140 x:0 0 0 2024-02-16T22:19:24.754 INFO:tasks.workunit.client.1.smithi173.stdout:0/920: rmdir d0/d12/d15/d4f/d92 39 2024-02-16T22:19:24.756 INFO:tasks.workunit.client.1.smithi173.stdout:6/899: dwrite d0/d7c/dc5/f120 [4194304,4194304] 0 2024-02-16T22:19:24.756 INFO:tasks.workunit.client.1.smithi173.stdout:6/900: readlink d0/db/d2e/d65/d73/l123 0 2024-02-16T22:19:24.764 INFO:tasks.workunit.client.1.smithi173.stdout:0/921: write d0/d12/d15/d3d/d98/d14/d24/d2e/fe2 [776677,41227] 0 2024-02-16T22:19:24.765 INFO:tasks.workunit.client.1.smithi173.stdout:7/887: symlink d1/d1d/d4c/d63/d13/d22/d53/db9/l119 0 2024-02-16T22:19:24.768 INFO:tasks.workunit.client.1.smithi173.stdout:1/944: dwrite db/d29/db5/d105/f130 [0,4194304] 0 2024-02-16T22:19:24.772 INFO:tasks.workunit.client.1.smithi173.stdout:4/921: getdents d7/d28/d31/d33/d7d/d45 0 2024-02-16T22:19:24.785 INFO:tasks.workunit.client.1.smithi173.stdout:2/880: sync 2024-02-16T22:19:24.786 INFO:tasks.workunit.client.1.smithi173.stdout:0/922: mknod d0/d12/d108/c130 0 2024-02-16T22:19:24.791 INFO:tasks.workunit.client.1.smithi173.stdout:7/888: dwrite d1/d1d/d4c/d63/d13/d22/d7e/dc2/f7c [0,4194304] 0 2024-02-16T22:19:24.791 INFO:tasks.workunit.client.1.smithi173.stdout:7/889: fsync d1/d1d/d4c/d63/d13/d22/d53/d27/f65 0 2024-02-16T22:19:24.791 INFO:tasks.workunit.client.1.smithi173.stdout:1/945: dwrite db/d29/db5/d105/f10d [0,4194304] 0 2024-02-16T22:19:24.792 INFO:tasks.workunit.client.1.smithi173.stdout:1/946: chown db/d1c/d25/d45/fa7 45 1 2024-02-16T22:19:24.793 INFO:tasks.workunit.client.1.smithi173.stdout:1/947: dread db/d1c/d25/d45/df1/ff3 [0,4194304] 0 2024-02-16T22:19:24.797 INFO:tasks.workunit.client.1.smithi173.stdout:2/881: read d2/dc/d19/d1a/f34 [1984676,107094] 0 2024-02-16T22:19:24.797 INFO:tasks.workunit.client.1.smithi173.stdout:2/882: write d2/d4/d8/d2d/fba [5029769,79410] 0 2024-02-16T22:19:24.801 INFO:tasks.workunit.client.1.smithi173.stdout:7/890: mkdir d1/d1d/d4c/d63/d13/d22/d7e/dbd/dd2/d11a 0 2024-02-16T22:19:24.804 INFO:tasks.workunit.client.1.smithi173.stdout:1/948: creat db/d29/d83/d108/f141 x:0 0 0 2024-02-16T22:19:24.804 INFO:tasks.workunit.client.1.smithi173.stdout:1/949: fdatasync db/d5f/d97/fba 0 2024-02-16T22:19:24.804 INFO:tasks.workunit.client.1.smithi173.stdout:1/950: dread - db/d1c/fd0 zero size 2024-02-16T22:19:24.804 INFO:tasks.workunit.client.1.smithi173.stdout:1/951: readlink db/d5f/da9/le8 0 2024-02-16T22:19:24.804 INFO:tasks.workunit.client.1.smithi173.stdout:2/883: dread d2/d4/d8/d30/d44/d83/f85 [0,4194304] 0 2024-02-16T22:19:24.804 INFO:tasks.workunit.client.1.smithi173.stdout:2/884: truncate d2/dc/d19/d1c/d53/d6e/f73 882015 0 2024-02-16T22:19:24.805 INFO:tasks.workunit.client.1.smithi173.stdout:9/891: rename d1/d2/d1a/d2f/df4/d8c/d92/dd5 to d1/d2/d129 0 2024-02-16T22:19:24.806 INFO:tasks.workunit.client.1.smithi173.stdout:0/923: mkdir d0/d12/d15/d3d/d98/d131 0 2024-02-16T22:19:24.806 INFO:tasks.workunit.client.1.smithi173.stdout:0/924: write d0/d84/d8c/f97 [246962,51059] 0 2024-02-16T22:19:24.807 INFO:tasks.workunit.client.1.smithi173.stdout:7/891: creat d1/d1d/d4c/d63/d13/d22/f11b x:0 0 0 2024-02-16T22:19:24.809 INFO:tasks.workunit.client.1.smithi173.stdout:1/952: creat db/d1c/d25/d45/df1/f142 x:0 0 0 2024-02-16T22:19:24.812 INFO:tasks.workunit.client.1.smithi173.stdout:9/892: creat d1/d2/d1a/d1f/d34/db0/f12a x:0 0 0 2024-02-16T22:19:24.815 INFO:tasks.workunit.client.1.smithi173.stdout:0/925: write d0/d12/d15/d3d/d98/d27/f5a [2416117,16426] 0 2024-02-16T22:19:24.815 INFO:tasks.workunit.client.1.smithi173.stdout:0/926: readlink d0/d84/d8c/l105 0 2024-02-16T22:19:24.815 INFO:tasks.workunit.client.1.smithi173.stdout:0/927: fsync d0/d12/d15/d3d/d98/d33/dc2/f120 0 2024-02-16T22:19:24.816 INFO:tasks.workunit.client.1.smithi173.stdout:0/928: chown d0/d12/l77 592730035 1 2024-02-16T22:19:24.818 INFO:tasks.workunit.client.1.smithi173.stdout:0/929: creat d0/d12/d15/d3d/d98/d33/f132 x:0 0 0 2024-02-16T22:19:24.818 INFO:tasks.workunit.client.1.smithi173.stdout:0/930: truncate d0/d84/fb6 814654 0 2024-02-16T22:19:24.819 INFO:tasks.workunit.client.1.smithi173.stdout:1/953: read db/d1c/d25/d28/f49 [3138143,105502] 0 2024-02-16T22:19:24.820 INFO:tasks.workunit.client.1.smithi173.stdout:0/931: getdents d0/d12/d15/d4f 0 2024-02-16T22:19:24.820 INFO:tasks.workunit.client.1.smithi173.stdout:0/932: fdatasync d0/d12/d15/d3d/d98/d14/f8d 0 2024-02-16T22:19:24.821 INFO:tasks.workunit.client.1.smithi173.stdout:1/954: link db/d29/d50/d85/lfe db/d1c/d25/d134/l143 0 2024-02-16T22:19:24.821 INFO:tasks.workunit.client.1.smithi173.stdout:1/955: fdatasync db/d29/db5/d105/f112 0 2024-02-16T22:19:24.822 INFO:tasks.workunit.client.1.smithi173.stdout:0/933: rename d0/d12/ld8 to d0/d12/d15/d3d/d98/d33/dc2/l133 0 2024-02-16T22:19:24.824 INFO:tasks.workunit.client.1.smithi173.stdout:0/934: mknod d0/d6d/c134 0 2024-02-16T22:19:24.825 INFO:tasks.workunit.client.1.smithi173.stdout:0/935: mkdir d0/d12/d15/d3d/d98/d14/d38/df5/d129/d135 0 2024-02-16T22:19:24.825 INFO:tasks.workunit.client.1.smithi173.stdout:0/936: creat d0/d12/d15/d3d/d98/d14/d24/d70/f136 x:0 0 0 2024-02-16T22:19:24.826 INFO:tasks.workunit.client.1.smithi173.stdout:0/937: chown d0/d84/d8c 731 1 2024-02-16T22:19:24.827 INFO:tasks.workunit.client.1.smithi173.stdout:0/938: unlink d0/d12/d15/d3d/d98/d14/d24/d2e/c52 0 2024-02-16T22:19:24.828 INFO:tasks.workunit.client.1.smithi173.stdout:0/939: creat d0/d12/d15/d3d/d98/f137 x:0 0 0 2024-02-16T22:19:24.830 INFO:tasks.workunit.client.1.smithi173.stdout:9/893: getdents d1/d2 0 2024-02-16T22:19:24.838 INFO:tasks.workunit.client.1.smithi173.stdout:2/885: dwrite d2/dc/d19/d69/dab/fe9 [0,4194304] 0 2024-02-16T22:19:24.838 INFO:tasks.workunit.client.1.smithi173.stdout:7/892: dwrite d1/d1d/d4c/d63/d13/d22/d53/d27/f8d [4194304,4194304] 0 2024-02-16T22:19:24.839 INFO:tasks.workunit.client.1.smithi173.stdout:7/893: chown d1/d1d/l8c 92996883 1 2024-02-16T22:19:24.840 INFO:tasks.workunit.client.1.smithi173.stdout:2/886: mkdir d2/d4/d8/d80/d116 0 2024-02-16T22:19:24.840 INFO:tasks.workunit.client.1.smithi173.stdout:2/887: creat d2/dc/d19/d1a/d74/db2/dec/f117 x:0 0 0 2024-02-16T22:19:24.845 INFO:tasks.workunit.client.1.smithi173.stdout:2/888: symlink d2/dc/d19/d69/da5/d115/l118 0 2024-02-16T22:19:24.845 INFO:tasks.workunit.client.1.smithi173.stdout:7/894: dread d1/d1d/d4c/d63/d13/d22/ff2 [0,4194304] 0 2024-02-16T22:19:24.849 INFO:tasks.workunit.client.1.smithi173.stdout:9/894: dread d1/d2/d10/f46 [0,4194304] 0 2024-02-16T22:19:24.850 INFO:tasks.workunit.client.1.smithi173.stdout:9/895: dread d1/d2/d1a/d2f/d51/d96/fdd [0,4194304] 0 2024-02-16T22:19:24.850 INFO:tasks.workunit.client.1.smithi173.stdout:0/940: dwrite d0/d12/d15/d3d/d98/d14/f2d [0,4194304] 0 2024-02-16T22:19:24.861 INFO:tasks.workunit.client.1.smithi173.stdout:1/956: dwrite db/d29/d57/f5d [0,4194304] 0 2024-02-16T22:19:24.861 INFO:tasks.workunit.client.1.smithi173.stdout:1/957: fsync f2 0 2024-02-16T22:19:24.865 INFO:tasks.workunit.client.1.smithi173.stdout:1/958: getdents db/d1c/d7f 0 2024-02-16T22:19:24.865 INFO:tasks.workunit.client.1.smithi173.stdout:1/959: chown db/d29/f42 1533212 1 2024-02-16T22:19:24.866 INFO:tasks.workunit.client.1.smithi173.stdout:1/960: symlink db/d1c/d25/d45/l144 0 2024-02-16T22:19:24.868 INFO:tasks.workunit.client.1.smithi173.stdout:1/961: mknod db/d1c/d7f/d98/df9/c145 0 2024-02-16T22:19:24.868 INFO:tasks.workunit.client.1.smithi173.stdout:1/962: creat db/d29/db5/f146 x:0 0 0 2024-02-16T22:19:24.868 INFO:tasks.workunit.client.1.smithi173.stdout:1/963: readlink db/d29/d50/d85/l118 0 2024-02-16T22:19:24.868 INFO:tasks.workunit.client.1.smithi173.stdout:1/964: write db/d5f/d97/fab [842724,74277] 0 2024-02-16T22:19:24.868 INFO:tasks.workunit.client.1.smithi173.stdout:1/965: fdatasync db/d29/d50/f70 0 2024-02-16T22:19:24.868 INFO:tasks.workunit.client.1.smithi173.stdout:9/896: dread d1/d2/d1a/d1f/d34/d49/faa [0,4194304] 0 2024-02-16T22:19:24.869 INFO:tasks.workunit.client.1.smithi173.stdout:9/897: chown d1/d5f/d6d/d91/fa0 0 1 2024-02-16T22:19:24.869 INFO:tasks.workunit.client.1.smithi173.stdout:9/898: write d1/d2/d129/d107/d115/fed [197176,4200] 0 2024-02-16T22:19:24.869 INFO:tasks.workunit.client.1.smithi173.stdout:9/899: fsync d1/d2/d1a/d2f/d3b/f102 0 2024-02-16T22:19:24.870 INFO:tasks.workunit.client.1.smithi173.stdout:1/966: rmdir db/d29/d50/d85 39 2024-02-16T22:19:24.873 INFO:tasks.workunit.client.1.smithi173.stdout:9/900: dread d1/d2/d10/f46 [0,4194304] 0 2024-02-16T22:19:24.877 INFO:tasks.workunit.client.1.smithi173.stdout:9/901: dread d1/d2/d1a/d2f/d3b/f72 [0,4194304] 0 2024-02-16T22:19:24.877 INFO:tasks.workunit.client.1.smithi173.stdout:9/902: readlink d1/d2/d1a/d1f/d34/d49/d10e/l127 0 2024-02-16T22:19:24.878 INFO:tasks.workunit.client.1.smithi173.stdout:1/967: dread f9 [0,4194304] 0 2024-02-16T22:19:24.878 INFO:tasks.workunit.client.1.smithi173.stdout:9/903: mkdir d1/d2/d1a/d2f/d3b/da6/d12b 0 2024-02-16T22:19:24.879 INFO:tasks.workunit.client.1.smithi173.stdout:9/904: chown d1/d2/d1a/d2f/d3b/da6/de3/l11f 1 1 2024-02-16T22:19:24.880 INFO:tasks.workunit.client.1.smithi173.stdout:7/895: dwrite d1/d1d/d4c/d63/d13/d22/d53/d27/f73 [0,4194304] 0 2024-02-16T22:19:24.880 INFO:tasks.workunit.client.1.smithi173.stdout:7/896: truncate d1/d1d/d4c/d63/d13/d22/d53/db9/dbc/ff1 258809 0 2024-02-16T22:19:24.880 INFO:tasks.workunit.client.1.smithi173.stdout:7/897: chown d1/d1d/d4c/d63/d13/d36/l3a 44020 1 2024-02-16T22:19:24.880 INFO:tasks.workunit.client.1.smithi173.stdout:0/941: dwrite d0/d12/d15/d3d/d98/f3e [0,4194304] 0 2024-02-16T22:19:24.880 INFO:tasks.workunit.client.1.smithi173.stdout:2/889: dwrite d2/dc/d19/d1a/fb3 [0,4194304] 0 2024-02-16T22:19:24.881 INFO:tasks.workunit.client.1.smithi173.stdout:2/890: write d2/f3c [5012392,27564] 0 2024-02-16T22:19:24.881 INFO:tasks.workunit.client.1.smithi173.stdout:9/905: truncate d1/d5f/d61/d80/f87 357626 0 2024-02-16T22:19:24.882 INFO:tasks.workunit.client.1.smithi173.stdout:9/906: fsync d1/d5f/d6d/f74 0 2024-02-16T22:19:24.883 INFO:tasks.workunit.client.1.smithi173.stdout:9/907: write d1/d5f/d6d/f74 [175552,14979] 0 2024-02-16T22:19:24.885 INFO:tasks.workunit.client.1.smithi173.stdout:7/898: symlink d1/d1d/d4c/d63/d48/l11c 0 2024-02-16T22:19:24.885 INFO:tasks.workunit.client.1.smithi173.stdout:7/899: read - d1/d1d/d4c/d63/d13/d22/d7e/dbd/dd2/f106 zero size 2024-02-16T22:19:24.885 INFO:tasks.workunit.client.1.smithi173.stdout:7/900: stat d1/d1d/d4c/d63/d6c/ffc 0 2024-02-16T22:19:24.888 INFO:tasks.workunit.client.1.smithi173.stdout:0/942: creat d0/d12/d15/d3d/d98/d14/d38/df5/d129/d135/f138 x:0 0 0 2024-02-16T22:19:24.890 INFO:tasks.workunit.client.1.smithi173.stdout:2/891: mknod d2/dc/d19/d1a/d74/db2/dec/c119 0 2024-02-16T22:19:24.891 INFO:tasks.workunit.client.1.smithi173.stdout:9/908: link d1/d2/d1a/d1f/d34/d49/l8f d1/d5f/d61/d80/l12c 0 2024-02-16T22:19:24.891 INFO:tasks.workunit.client.1.smithi173.stdout:9/909: chown d1/d2/d1a/d2f/d51/d96/db3 7316 1 2024-02-16T22:19:24.891 INFO:tasks.workunit.client.1.smithi173.stdout:7/901: unlink d1/f41 0 2024-02-16T22:19:24.892 INFO:tasks.workunit.client.1.smithi173.stdout:7/902: chown d1/d1d/d4c/d63/d54/leb 58419 1 2024-02-16T22:19:24.892 INFO:tasks.workunit.client.1.smithi173.stdout:1/968: rename db/d29 to db/d1c/d7f/d147 0 2024-02-16T22:19:24.894 INFO:tasks.workunit.client.1.smithi173.stdout:2/892: unlink d2/dc/d19/d1a/f46 0 2024-02-16T22:19:24.894 INFO:tasks.workunit.client.1.smithi173.stdout:1/969: read db/d1c/d25/d28/d3f/d4a/ff5 [137868,37442] 0 2024-02-16T22:19:24.894 INFO:tasks.workunit.client.1.smithi173.stdout:9/910: rename d1/d2/d10/f60 to d1/d2/d10/f12d 0 2024-02-16T22:19:24.895 INFO:tasks.workunit.client.1.smithi173.stdout:7/903: mknod d1/d1d/d4c/d63/d13/dce/c11d 0 2024-02-16T22:19:24.895 INFO:tasks.workunit.client.1.smithi173.stdout:7/904: creat d1/d1d/d4c/d63/d13/d22/f11e x:0 0 0 2024-02-16T22:19:24.895 INFO:tasks.workunit.client.1.smithi173.stdout:7/905: write d1/d1d/d4c/d63/d13/d22/f11e [44034,34027] 0 2024-02-16T22:19:24.895 INFO:tasks.workunit.client.1.smithi173.stdout:7/906: chown d1/d1d/d4c/d63/d13/d36/d49/f86 115 1 2024-02-16T22:19:24.900 INFO:tasks.workunit.client.1.smithi173.stdout:7/907: rmdir d1/d1d/d4c/d91 39 2024-02-16T22:19:24.902 INFO:tasks.workunit.client.1.smithi173.stdout:0/943: dread d0/d12/d15/d3d/d98/f2a [4194304,4194304] 0 2024-02-16T22:19:24.902 INFO:tasks.workunit.client.1.smithi173.stdout:0/944: stat d0/d12/d15/d3d/d98/d33/c4a 0 2024-02-16T22:19:24.905 INFO:tasks.workunit.client.1.smithi173.stdout:0/945: dread d0/d12/d15/f1c [0,4194304] 0 2024-02-16T22:19:24.905 INFO:tasks.workunit.client.1.smithi173.stdout:0/946: chown d0/d84/d8c/fc4 29 1 2024-02-16T22:19:24.906 INFO:tasks.workunit.client.1.smithi173.stdout:9/911: write d1/d2/d1a/d2f/df4/d8c/fb6 [932998,113463] 0 2024-02-16T22:19:24.907 INFO:tasks.workunit.client.1.smithi173.stdout:9/912: symlink d1/d2/d10/l12e 0 2024-02-16T22:19:24.912 INFO:tasks.workunit.client.1.smithi173.stdout:9/913: write d1/d2/d1a/d2f/d3b/d75/f90 [2063940,68463] 0 2024-02-16T22:19:24.914 INFO:tasks.workunit.client.1.smithi173.stdout:1/970: dwrite db/d1c/d7f/d147/d50/d85/dde/f103 [0,4194304] 0 2024-02-16T22:19:24.923 INFO:tasks.workunit.client.1.smithi173.stdout:7/908: dwrite d1/d1d/d4c/d63/d13/d22/d53/d27/f73 [0,4194304] 0 2024-02-16T22:19:24.926 INFO:tasks.workunit.client.1.smithi173.stdout:7/909: truncate d1/d1d/d4c/d63/d13/d36/d49/f6d 2104616 0 2024-02-16T22:19:24.926 INFO:tasks.workunit.client.1.smithi173.stdout:7/910: write d1/d1d/d4c/d63/d13/d36/d49/f7f [6605383,93941] 0 2024-02-16T22:19:24.928 INFO:tasks.workunit.client.1.smithi173.stdout:7/911: mknod d1/d1d/d4c/d63/d13/d22/d53/db9/c11f 0 2024-02-16T22:19:24.928 INFO:tasks.workunit.client.1.smithi173.stdout:7/912: dread - d1/d1d/d4c/d63/d13/d22/d7e/db5/fcd zero size 2024-02-16T22:19:24.930 INFO:tasks.workunit.client.1.smithi173.stdout:7/913: creat d1/dd4/f120 x:0 0 0 2024-02-16T22:19:24.930 INFO:tasks.workunit.client.1.smithi173.stdout:9/914: dread d1/d5f/d6d/d91/fa0 [0,4194304] 0 2024-02-16T22:19:24.931 INFO:tasks.workunit.client.1.smithi173.stdout:7/914: symlink d1/d1d/d4c/d63/d13/d36/dd6/l121 0 2024-02-16T22:19:24.931 INFO:tasks.workunit.client.1.smithi173.stdout:7/915: chown d1/d1d/d4c/d63/d13/dce/c11d 0 1 2024-02-16T22:19:24.931 INFO:tasks.workunit.client.1.smithi173.stdout:7/916: fdatasync d1/d1d/d4c/d63/d13/f26 0 2024-02-16T22:19:24.932 INFO:tasks.workunit.client.1.smithi173.stdout:9/915: mkdir d1/d2/d1a/d2f/d3b/da6/de3/d12f 0 2024-02-16T22:19:24.934 INFO:tasks.workunit.client.1.smithi173.stdout:9/916: mknod d1/d2/d1a/d1f/d34/d49/dac/c130 0 2024-02-16T22:19:24.935 INFO:tasks.workunit.client.1.smithi173.stdout:7/917: mknod d1/d1d/d4c/d63/d13/d22/d53/c122 0 2024-02-16T22:19:24.935 INFO:tasks.workunit.client.1.smithi173.stdout:7/918: write d1/d1d/f32 [91813,47215] 0 2024-02-16T22:19:24.935 INFO:tasks.workunit.client.1.smithi173.stdout:7/919: write d1/d1d/d4c/d63/fa5 [1403926,27474] 0 2024-02-16T22:19:24.937 INFO:tasks.workunit.client.1.smithi173.stdout:7/920: write d1/d1d/d4c/d63/d13/d36/d49/f7d [914325,123607] 0 2024-02-16T22:19:24.937 INFO:tasks.workunit.client.1.smithi173.stdout:7/921: chown d1/d1d/d4c/d63/d13/d36/d49/f74 1102163673 1 2024-02-16T22:19:24.937 INFO:tasks.workunit.client.1.smithi173.stdout:7/922: read d1/d1d/d4c/d63/d13/d22/f9c [1382914,120442] 0 2024-02-16T22:19:24.937 INFO:tasks.workunit.client.1.smithi173.stdout:7/923: write d1/d1d/d4c/d63/d48/d9a/dea/fee [1636296,1031] 0 2024-02-16T22:19:24.938 INFO:tasks.workunit.client.1.smithi173.stdout:7/924: unlink d1/d1d/d4c/d63/d48/f8e 0 2024-02-16T22:19:24.938 INFO:tasks.workunit.client.1.smithi173.stdout:7/925: dread - d1/d1d/d4c/d63/d13/d22/d7e/dbd/fc1 zero size 2024-02-16T22:19:24.938 INFO:tasks.workunit.client.1.smithi173.stdout:7/926: write d1/d1d/fa1 [1351007,112846] 0 2024-02-16T22:19:24.938 INFO:tasks.workunit.client.1.smithi173.stdout:7/927: dread - d1/d1d/d4c/d63/d13/d22/d7e/dbd/fc1 zero size 2024-02-16T22:19:24.939 INFO:tasks.workunit.client.1.smithi173.stdout:7/928: creat d1/d1d/d4c/d63/d11/dc7/f123 x:0 0 0 2024-02-16T22:19:24.939 INFO:tasks.workunit.client.1.smithi173.stdout:7/929: chown d1/d1d/d4c/d63/d13/dce 7502181 1 2024-02-16T22:19:24.940 INFO:tasks.workunit.client.1.smithi173.stdout:7/930: chown d1/d1d/d4c/d63/d13/d22/d53/db9/dbc/dcf/fe8 0 1 2024-02-16T22:19:24.940 INFO:tasks.workunit.client.1.smithi173.stdout:1/971: dwrite db/d30/f72 [0,4194304] 0 2024-02-16T22:19:24.941 INFO:tasks.workunit.client.1.smithi173.stdout:1/972: creat db/d30/f148 x:0 0 0 2024-02-16T22:19:24.948 INFO:tasks.workunit.client.1.smithi173.stdout:9/917: dread d1/d2/d1a/d2f/df4/d8c/fb6 [0,4194304] 0 2024-02-16T22:19:24.951 INFO:tasks.workunit.client.1.smithi173.stdout:9/918: symlink d1/d2/l131 0 2024-02-16T22:19:24.951 INFO:tasks.workunit.client.1.smithi173.stdout:9/919: dread - d1/d2/dec/f101 zero size 2024-02-16T22:19:24.951 INFO:tasks.workunit.client.1.smithi173.stdout:9/920: readlink d1/d2/d1a/d2f/d51/d96/lee 0 2024-02-16T22:19:24.952 INFO:tasks.workunit.client.1.smithi173.stdout:7/931: write d1/d1d/d4c/d63/d54/f70 [10003754,125138] 0 2024-02-16T22:19:24.952 INFO:tasks.workunit.client.1.smithi173.stdout:9/921: mknod d1/d5f/d61/c132 0 2024-02-16T22:19:24.953 INFO:tasks.workunit.client.1.smithi173.stdout:7/932: mkdir d1/d1d/d124 0 2024-02-16T22:19:24.955 INFO:tasks.workunit.client.1.smithi173.stdout:9/922: link f0 d1/d2/d1a/d3e/d79/d128/f133 0 2024-02-16T22:19:24.956 INFO:tasks.workunit.client.1.smithi173.stdout:9/923: creat d1/d5f/d61/d80/f134 x:0 0 0 2024-02-16T22:19:24.958 INFO:tasks.workunit.client.1.smithi173.stdout:9/924: symlink d1/d2/d1a/d2f/df4/d8c/l135 0 2024-02-16T22:19:24.960 INFO:tasks.workunit.client.1.smithi173.stdout:9/925: rename d1/d2/d1a/d1f/d34/d49/d88/le6 to d1/dcf/l136 0 2024-02-16T22:19:24.961 INFO:tasks.workunit.client.1.smithi173.stdout:9/926: mkdir d1/d2/dec/d137 0 2024-02-16T22:19:24.963 INFO:tasks.workunit.client.1.smithi173.stdout:7/933: dread d1/d1d/d4c/d63/d13/d22/d7e/dc2/f7c [0,4194304] 0 2024-02-16T22:19:24.964 INFO:tasks.workunit.client.1.smithi173.stdout:1/973: dwrite db/d1c/d7f/d147/d50/d85/fec [0,4194304] 0 2024-02-16T22:19:24.966 INFO:tasks.workunit.client.1.smithi173.stdout:1/974: mkdir db/d1c/d7f/d147/d83/dc2/d149 0 2024-02-16T22:19:24.979 INFO:tasks.workunit.client.1.smithi173.stdout:1/975: write db/d1c/d25/f10e [1958865,108662] 0 2024-02-16T22:19:24.981 INFO:tasks.workunit.client.1.smithi173.stdout:1/976: rename db/d1c/d7f/d147/d57/d73/f119 to db/d1c/d25/d12c/f14a 0 2024-02-16T22:19:24.988 INFO:tasks.workunit.client.1.smithi173.stdout:7/934: dwrite d1/d1d/d4c/d63/d13/d22/f11e [0,4194304] 0 2024-02-16T22:19:24.990 INFO:tasks.workunit.client.1.smithi173.stdout:9/927: dwrite d1/d2/d1a/d1f/d34/d49/faa [8388608,4194304] 0 2024-02-16T22:19:24.991 INFO:tasks.workunit.client.1.smithi173.stdout:7/935: link d1/d1d/d4c/d63/d13/d22/d7e/db5/l115 d1/d1d/d4c/d63/d6c/dca/df7/l125 0 2024-02-16T22:19:24.991 INFO:tasks.workunit.client.1.smithi173.stdout:7/936: dread - d1/d1d/d4c/d91/d9f/fb1 zero size 2024-02-16T22:19:24.991 INFO:tasks.workunit.client.1.smithi173.stdout:7/937: chown d1/d1d/d4c/d63/d48/d9a/de6 1201131 1 2024-02-16T22:19:24.993 INFO:tasks.workunit.client.1.smithi173.stdout:7/938: getdents d1/d1d/d4c/d63/d13/d22 0 2024-02-16T22:19:24.995 INFO:tasks.workunit.client.1.smithi173.stdout:7/939: unlink d1/d1d/d4c/d63/d13/d22/d53/db9/dbc/lc6 0 2024-02-16T22:19:24.998 INFO:tasks.workunit.client.1.smithi173.stdout:1/977: dwrite db/d1c/d7f/d98/fc1 [0,4194304] 0 2024-02-16T22:19:24.998 INFO:tasks.workunit.client.1.smithi173.stdout:1/978: readlink db/d30/l3d 0 2024-02-16T22:19:24.998 INFO:tasks.workunit.client.1.smithi173.stdout:1/979: fdatasync db/d1c/d7f/d147/d57/d73/f87 0 2024-02-16T22:19:25.001 INFO:tasks.workunit.client.1.smithi173.stdout:1/980: dread db/f75 [0,4194304] 0 2024-02-16T22:19:25.006 INFO:tasks.workunit.client.1.smithi173.stdout:1/981: rmdir db/d1c/d25/d28/d3f 39 2024-02-16T22:19:25.029 INFO:tasks.workunit.client.1.smithi173.stdout:9/928: dwrite d1/d2/d10/f2e [0,4194304] 0 2024-02-16T22:19:25.030 INFO:tasks.workunit.client.1.smithi173.stdout:9/929: getdents d1/d5f/d61/d80 0 2024-02-16T22:19:25.031 INFO:tasks.workunit.client.1.smithi173.stdout:7/940: dwrite d1/d1d/d4c/d63/d13/d22/d7e/dc2/f60 [0,4194304] 0 2024-02-16T22:19:25.032 INFO:tasks.workunit.client.1.smithi173.stdout:9/930: unlink d1/d2/d1a/d2f/d51/fdc 0 2024-02-16T22:19:25.033 INFO:tasks.workunit.client.1.smithi173.stdout:9/931: readlink d1/d5f/d61/d80/l12c 0 2024-02-16T22:19:25.033 INFO:tasks.workunit.client.1.smithi173.stdout:1/982: dwrite db/d5f/d97/fe1 [0,4194304] 0 2024-02-16T22:19:25.047 INFO:tasks.workunit.client.1.smithi173.stdout:9/932: write d1/d2/d1a/d1f/d34/f55 [4875165,100116] 0 2024-02-16T22:19:25.047 INFO:tasks.workunit.client.1.smithi173.stdout:9/933: creat d1/d5f/d6d/d97/f138 x:0 0 0 2024-02-16T22:19:25.047 INFO:tasks.workunit.client.1.smithi173.stdout:9/934: write d1/d2/da2/ff6 [747490,106159] 0 2024-02-16T22:19:25.053 INFO:tasks.workunit.client.1.smithi173.stdout:6/901: creat d0/db/d2e/d65/d67/f13f x:0 0 0 2024-02-16T22:19:25.054 INFO:tasks.workunit.client.1.smithi173.stdout:6/902: chown d0/db/d2e/d65/d73/d7d 1906 1 2024-02-16T22:19:25.054 INFO:tasks.workunit.client.1.smithi173.stdout:6/903: read - d0/db/d2e/d2f/d31/d7a/f10a zero size 2024-02-16T22:19:25.054 INFO:tasks.workunit.client.1.smithi173.stdout:6/904: write d0/db/d2e/d65/d67/d78/fcf [1604208,78734] 0 2024-02-16T22:19:25.056 INFO:tasks.workunit.client.1.smithi173.stdout:1/983: dwrite db/d1c/d25/d28/d3f/d4a/f140 [0,4194304] 0 2024-02-16T22:19:25.056 INFO:tasks.workunit.client.1.smithi173.stdout:1/984: creat db/d5f/da9/f14b x:0 0 0 2024-02-16T22:19:25.056 INFO:tasks.workunit.client.1.smithi173.stdout:1/985: readlink db/d1c/d5c/l76 0 2024-02-16T22:19:25.056 INFO:tasks.workunit.client.1.smithi173.stdout:7/941: dwrite d1/d1d/d4c/d63/d13/d22/d7e/f9e [0,4194304] 0 2024-02-16T22:19:25.056 INFO:tasks.workunit.client.1.smithi173.stdout:7/942: creat d1/d1d/d4c/d63/d13/d22/d7e/dc2/f126 x:0 0 0 2024-02-16T22:19:25.058 INFO:tasks.workunit.client.1.smithi173.stdout:6/905: creat d0/db/d2e/d2f/da6/daa/dff/f140 x:0 0 0 2024-02-16T22:19:25.061 INFO:tasks.workunit.client.1.smithi173.stdout:7/943: mkdir d1/d1d/d4c/d63/d6c/dca/de7/d127 0 2024-02-16T22:19:25.062 INFO:tasks.workunit.client.1.smithi173.stdout:9/935: dwrite d1/d2/d10/f2e [4194304,4194304] 0 2024-02-16T22:19:25.063 INFO:tasks.workunit.client.1.smithi173.stdout:9/936: stat d1/d2/d1a/l42 0 2024-02-16T22:19:25.063 INFO:tasks.workunit.client.1.smithi173.stdout:9/937: truncate d1/d2/d10/f46 4346336 0 2024-02-16T22:19:25.063 INFO:tasks.workunit.client.1.smithi173.stdout:7/944: symlink d1/d1d/d4c/l128 0 2024-02-16T22:19:25.063 INFO:tasks.workunit.client.1.smithi173.stdout:6/906: symlink d0/d133/l141 0 2024-02-16T22:19:25.067 INFO:tasks.workunit.client.1.smithi173.stdout:7/945: symlink d1/d1d/d4c/d63/d13/d22/d7e/dbd/dd2/l129 0 2024-02-16T22:19:25.067 INFO:tasks.workunit.client.1.smithi173.stdout:7/946: readlink d1/d1d/d4c/d63/d54/lf8 0 2024-02-16T22:19:25.067 INFO:tasks.workunit.client.1.smithi173.stdout:7/947: chown d1/d1d/d4c/d63/d13/d22/d7e/db5/l115 0 1 2024-02-16T22:19:25.067 INFO:tasks.workunit.client.1.smithi173.stdout:7/948: creat d1/d1d/d4c/d80/dfe/f12a x:0 0 0 2024-02-16T22:19:25.067 INFO:tasks.workunit.client.1.smithi173.stdout:7/949: readlink d1/d1d/d4c/d63/d13/d22/d7e/dc2/lba 0 2024-02-16T22:19:25.071 INFO:tasks.workunit.client.1.smithi173.stdout:7/950: symlink d1/d1d/d4c/d63/d6c/dca/l12b 0 2024-02-16T22:19:25.085 INFO:tasks.workunit.client.1.smithi173.stdout:7/951: dread d1/d1d/d4c/d80/f108 [0,4194304] 0 2024-02-16T22:19:25.086 INFO:tasks.workunit.client.1.smithi173.stdout:7/952: unlink d1/d1d/f4e 0 2024-02-16T22:19:25.088 INFO:tasks.workunit.client.1.smithi173.stdout:1/986: dwrite db/d1c/d25/d28/d3f/fc8 [0,4194304] 0 2024-02-16T22:19:25.088 INFO:tasks.workunit.client.1.smithi173.stdout:1/987: stat db/d1c/d7f/d147/d8f/f12b 0 2024-02-16T22:19:25.088 INFO:tasks.workunit.client.1.smithi173.stdout:7/953: mkdir d1/d1d/d4c/d63/d48/d12c 0 2024-02-16T22:19:25.088 INFO:tasks.workunit.client.1.smithi173.stdout:6/907: dwrite d0/db/d2e/f54 [0,4194304] 0 2024-02-16T22:19:25.088 INFO:tasks.workunit.client.1.smithi173.stdout:7/954: dread - d1/d1d/d4c/d63/d13/d22/d7e/dbd/fc1 zero size 2024-02-16T22:19:25.088 INFO:tasks.workunit.client.1.smithi173.stdout:1/988: mkdir db/d1c/d7f/d147/d50/d85/dde/d14c 0 2024-02-16T22:19:25.089 INFO:tasks.workunit.client.1.smithi173.stdout:1/989: fdatasync db/d1c/d7f/d147/d50/d85/f11f 0 2024-02-16T22:19:25.089 INFO:tasks.workunit.client.1.smithi173.stdout:1/990: dread - db/d1c/d7f/d147/d8f/f137 zero size 2024-02-16T22:19:25.089 INFO:tasks.workunit.client.1.smithi173.stdout:7/955: creat d1/d1d/d4c/d63/d13/d22/d7e/f12d x:0 0 0 2024-02-16T22:19:25.091 INFO:tasks.workunit.client.1.smithi173.stdout:7/956: mknod d1/d1d/d4c/c12e 0 2024-02-16T22:19:25.091 INFO:tasks.workunit.client.1.smithi173.stdout:7/957: fdatasync d1/d1d/d4c/d63/d48/f79 0 2024-02-16T22:19:25.109 INFO:tasks.workunit.client.1.smithi173.stdout:7/958: dwrite d1/d1d/d4c/d63/d13/dce/ff9 [0,4194304] 0 2024-02-16T22:19:25.109 INFO:tasks.workunit.client.1.smithi173.stdout:7/959: truncate d1/d1d/d4c/d63/f4 1062518 0 2024-02-16T22:19:25.109 INFO:tasks.workunit.client.1.smithi173.stdout:7/960: write d1/d1d/d4c/d63/d13/d22/d53/d27/f65 [657425,106493] 0 2024-02-16T22:19:25.110 INFO:tasks.workunit.client.1.smithi173.stdout:6/908: dread d0/f5c [0,4194304] 0 2024-02-16T22:19:25.111 INFO:tasks.workunit.client.1.smithi173.stdout:6/909: symlink d0/db/df0/l142 0 2024-02-16T22:19:25.111 INFO:tasks.workunit.client.1.smithi173.stdout:6/910: write d0/db/d2e/d65/db8/feb [993545,131028] 0 2024-02-16T22:19:25.112 INFO:tasks.workunit.client.1.smithi173.stdout:7/961: write d1/d1d/d4c/d63/d13/d22/d53/fec [345544,72083] 0 2024-02-16T22:19:25.115 INFO:tasks.workunit.client.1.smithi173.stdout:6/911: mknod d0/db/d2e/d65/d9f/c143 0 2024-02-16T22:19:25.115 INFO:tasks.workunit.client.1.smithi173.stdout:6/912: readlink d0/db/d2e/d2f/d31/ld9 0 2024-02-16T22:19:25.116 INFO:tasks.workunit.client.1.smithi173.stdout:6/913: mknod d0/db/d2e/d65/d73/d81/c144 0 2024-02-16T22:19:25.116 INFO:tasks.workunit.client.1.smithi173.stdout:6/914: fsync d0/db/fb2 0 2024-02-16T22:19:25.121 INFO:tasks.workunit.client.1.smithi173.stdout:1/991: dwrite db/d1c/d7f/d147/f3b [0,4194304] 0 2024-02-16T22:19:25.121 INFO:tasks.workunit.client.1.smithi173.stdout:6/915: rename d0/f44 to d0/db/d2e/d65/d118/f145 0 2024-02-16T22:19:25.122 INFO:tasks.workunit.client.1.smithi173.stdout:1/992: mkdir db/d1c/d25/d28/d3f/d4a/d14d 0 2024-02-16T22:19:25.123 INFO:tasks.workunit.client.1.smithi173.stdout:1/993: rmdir db/d1c/d7f/d147/d83/dc2 39 2024-02-16T22:19:25.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:25 smithi134 ceph-mon[28869]: [16/Feb/2024:22:19:23] ENGINE Bus STARTING 2024-02-16T22:19:25.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:25 smithi134 ceph-mon[28869]: [16/Feb/2024:22:19:23] ENGINE Serving on http://172.21.15.173:8765 2024-02-16T22:19:25.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:25 smithi134 ceph-mon[28869]: pgmap v4: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail 2024-02-16T22:19:25.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:25 smithi134 ceph-mon[28869]: [16/Feb/2024:22:19:24] ENGINE Serving on https://172.21.15.173:7150 2024-02-16T22:19:25.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:25 smithi134 ceph-mon[28869]: [16/Feb/2024:22:19:24] ENGINE Bus STARTED 2024-02-16T22:19:25.138 INFO:tasks.workunit.client.1.smithi173.stdout:6/916: unlink d0/db/d2e/d65/d67/f80 0 2024-02-16T22:19:25.142 INFO:tasks.workunit.client.1.smithi173.stdout:6/917: symlink d0/db/d2e/d61/l146 0 2024-02-16T22:19:25.144 INFO:tasks.workunit.client.1.smithi173.stdout:1/994: creat db/d1c/d25/d134/f14e x:0 0 0 2024-02-16T22:19:25.144 INFO:tasks.workunit.client.1.smithi173.stdout:6/918: dread d0/db/d2e/d2f/da6/fba [0,4194304] 0 2024-02-16T22:19:25.145 INFO:tasks.workunit.client.1.smithi173.stdout:1/995: mknod db/d1c/d7f/d147/d57/d73/c14f 0 2024-02-16T22:19:25.152 INFO:tasks.workunit.client.1.smithi173.stdout:6/919: mknod d0/db/d2e/d65/db8/de1/c147 0 2024-02-16T22:19:25.152 INFO:tasks.workunit.client.1.smithi173.stdout:6/920: write d0/db/d2e/d2f/d31/d7a/f12b [332200,45307] 0 2024-02-16T22:19:25.152 INFO:tasks.workunit.client.1.smithi173.stdout:6/921: fsync d0/db/d2e/d2f/fac 0 2024-02-16T22:19:25.155 INFO:tasks.workunit.client.1.smithi173.stdout:1/996: dread db/d1c/d7f/d147/d57/f5d [0,4194304] 0 2024-02-16T22:19:25.171 INFO:tasks.workunit.client.1.smithi173.stdout:6/922: creat d0/db/d2e/d2f/da6/daa/f148 x:0 0 0 2024-02-16T22:19:25.177 INFO:tasks.workunit.client.1.smithi173.stdout:1/997: symlink db/d1c/d7f/d98/df9/l150 0 2024-02-16T22:19:25.177 INFO:tasks.workunit.client.1.smithi173.stdout:4/922: chown d7/dd5/f8e 29691 1 2024-02-16T22:19:25.178 INFO:tasks.workunit.client.1.smithi173.stdout:1/998: mknod db/d1c/d5c/daf/c151 0 2024-02-16T22:19:25.179 INFO:tasks.workunit.client.1.smithi173.stdout:1/999: creat db/d1c/d7f/d147/d83/dc2/d149/f152 x:0 0 0 2024-02-16T22:19:25.184 INFO:tasks.workunit.client.1.smithi173.stdout:6/923: mkdir d0/db/d2e/d65/d118/d149 0 2024-02-16T22:19:25.185 INFO:tasks.workunit.client.1.smithi173.stdout:4/923: symlink d7/d12/d11e/l13d 0 2024-02-16T22:19:25.191 INFO:tasks.workunit.client.1.smithi173.stdout:6/924: write d0/db/d2e/d65/d118/f145 [3196638,65314] 0 2024-02-16T22:19:25.192 INFO:tasks.workunit.client.1.smithi173.stdout:4/924: rename d7/dd5 to d7/df9/d13e 0 2024-02-16T22:19:25.193 INFO:tasks.workunit.client.1.smithi173.stdout:6/925: rename d0/db/d2e/d65/d67/lea to d0/db/d2e/d65/d67/d10f/l14a 0 2024-02-16T22:19:25.195 INFO:tasks.workunit.client.1.smithi173.stdout:6/926: mkdir d0/db/d2e/d65/d73/da9/d14b 0 2024-02-16T22:19:25.195 INFO:tasks.workunit.client.1.smithi173.stdout:6/927: stat d0/db/d2e/d65/d73/da9/f11b 0 2024-02-16T22:19:25.197 INFO:tasks.workunit.client.1.smithi173.stdout:6/928: mkdir d0/db/d2e/d65/d73/da9/d14c 0 2024-02-16T22:19:25.199 INFO:tasks.workunit.client.1.smithi173.stdout:4/925: dread d7/fd [0,4194304] 0 2024-02-16T22:19:25.201 INFO:tasks.workunit.client.1.smithi173.stdout:4/926: rename d7/df9/d13e/d129/l88 to d7/d28/d31/d72/d93/d95/l13f 0 2024-02-16T22:19:25.203 INFO:tasks.workunit.client.1.smithi173.stdout:4/927: mknod d7/d28/d31/d72/d93/d95/c140 0 2024-02-16T22:19:25.206 INFO:tasks.workunit.client.1.smithi173.stdout:6/929: write d0/d7c/dc5/f120 [4944464,60361] 0 2024-02-16T22:19:25.210 INFO:tasks.workunit.client.1.smithi173.stdout:6/930: rename d0/d7c/dc5/d9b/d127 to d0/db/df0/d14d 0 2024-02-16T22:19:25.210 INFO:tasks.workunit.client.1.smithi173.stdout:6/931: write d0/f5b [417305,43455] 0 2024-02-16T22:19:25.210 INFO:tasks.workunit.client.1.smithi173.stdout:6/932: fdatasync d0/db/d2e/d65/d67/d78/fa2 0 2024-02-16T22:19:25.212 INFO:tasks.workunit.client.1.smithi173.stdout:6/933: symlink d0/db/d2e/d65/d67/d10f/l14e 0 2024-02-16T22:19:25.215 INFO:tasks.workunit.client.1.smithi173.stdout:6/934: mknod d0/db/d4d/d109/c14f 0 2024-02-16T22:19:25.216 INFO:tasks.workunit.client.1.smithi173.stdout:6/935: fsync d0/db/d2e/f83 0 2024-02-16T22:19:25.216 INFO:tasks.workunit.client.1.smithi173.stdout:4/928: getdents d7/d28/d31/d72/d93/d95 0 2024-02-16T22:19:25.219 INFO:tasks.workunit.client.1.smithi173.stdout:6/936: creat d0/db/d2e/d65/d67/d10f/f150 x:0 0 0 2024-02-16T22:19:25.219 INFO:tasks.workunit.client.1.smithi173.stdout:6/937: chown d0/db/d2e/d65/d67/f10c 15 1 2024-02-16T22:19:25.223 INFO:tasks.workunit.client.1.smithi173.stdout:4/929: rename d7/df/l12b to d7/df/d62/d133/l141 0 2024-02-16T22:19:25.225 INFO:tasks.workunit.client.1.smithi173.stdout:4/930: mkdir d7/d28/d52/d142 0 2024-02-16T22:19:25.225 INFO:tasks.workunit.client.1.smithi173.stdout:4/931: chown d7/d28/d31/d72/d93/f109 0 1 2024-02-16T22:19:25.228 INFO:tasks.workunit.client.1.smithi173.stdout:4/932: getdents d7/d12/dda 0 2024-02-16T22:19:25.230 INFO:tasks.workunit.client.1.smithi173.stdout:4/933: mkdir d7/d28/d143 0 2024-02-16T22:19:25.230 INFO:tasks.workunit.client.1.smithi173.stdout:4/934: write d7/d28/d31/d72/d93/d95/db4/f123 [842418,79706] 0 2024-02-16T22:19:25.235 INFO:tasks.workunit.client.1.smithi173.stdout:6/938: dwrite d0/db/d2e/f83 [0,4194304] 0 2024-02-16T22:19:25.238 INFO:tasks.workunit.client.1.smithi173.stdout:6/939: rmdir d0/db/d2e/d65/d118/d149 0 2024-02-16T22:19:25.247 INFO:tasks.workunit.client.1.smithi173.stdout:6/940: write d0/db/f28 [2287952,67789] 0 2024-02-16T22:19:25.253 INFO:tasks.workunit.client.1.smithi173.stdout:6/941: rename d0/db/d2e/d2f/da6 to d0/db/d2e/d2f/d31/d33/d151 0 2024-02-16T22:19:25.261 INFO:tasks.workunit.client.1.smithi173.stdout:6/942: dread d0/f11 [0,4194304] 0 2024-02-16T22:19:25.262 INFO:tasks.workunit.client.1.smithi173.stdout:6/943: chown d0/db/d2e/d2f/d31/l129 239 1 2024-02-16T22:19:25.277 INFO:tasks.workunit.client.1.smithi173.stdout:6/944: dwrite d0/db/d2e/d2f/d31/d5d/f122 [0,4194304] 0 2024-02-16T22:19:25.278 INFO:tasks.workunit.client.1.smithi173.stdout:6/945: fdatasync d0/db/d2e/d2f/d31/d5d/ffd 0 2024-02-16T22:19:25.278 INFO:tasks.workunit.client.1.smithi173.stdout:6/946: getdents d0/db/d2e/d2f/d31/d33/d151/d132 0 2024-02-16T22:19:25.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:25 smithi173 ceph-mon[37280]: [16/Feb/2024:22:19:23] ENGINE Bus STARTING 2024-02-16T22:19:25.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:25 smithi173 ceph-mon[37280]: [16/Feb/2024:22:19:23] ENGINE Serving on http://172.21.15.173:8765 2024-02-16T22:19:25.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:25 smithi173 ceph-mon[37280]: pgmap v4: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail 2024-02-16T22:19:25.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:25 smithi173 ceph-mon[37280]: [16/Feb/2024:22:19:24] ENGINE Serving on https://172.21.15.173:7150 2024-02-16T22:19:25.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:25 smithi173 ceph-mon[37280]: [16/Feb/2024:22:19:24] ENGINE Bus STARTED 2024-02-16T22:19:25.732 INFO:tasks.workunit.client.1.smithi173.stdout:4/935: sync 2024-02-16T22:19:25.732 INFO:tasks.workunit.client.1.smithi173.stdout:9/938: sync 2024-02-16T22:19:25.733 INFO:tasks.workunit.client.1.smithi173.stdout:2/893: sync 2024-02-16T22:19:25.733 INFO:tasks.workunit.client.1.smithi173.stdout:4/936: dread - d7/df/f12d zero size 2024-02-16T22:19:25.733 INFO:tasks.workunit.client.1.smithi173.stdout:4/937: chown d7/d28/d31/d72/d93/d95 3831317 1 2024-02-16T22:19:25.733 INFO:tasks.workunit.client.1.smithi173.stdout:0/947: sync 2024-02-16T22:19:25.733 INFO:tasks.workunit.client.1.smithi173.stdout:7/962: sync 2024-02-16T22:19:25.733 INFO:tasks.workunit.client.1.smithi173.stdout:4/938: write d7/d28/d31/d72/f7f [9221,95744] 0 2024-02-16T22:19:25.733 INFO:tasks.workunit.client.1.smithi173.stdout:9/939: creat d1/d5f/d6d/d91/f139 x:0 0 0 2024-02-16T22:19:25.733 INFO:tasks.workunit.client.1.smithi173.stdout:9/940: fsync d1/d2/d1a/d1f/d34/fb2 0 2024-02-16T22:19:25.733 INFO:tasks.workunit.client.1.smithi173.stdout:6/947: sync 2024-02-16T22:19:25.733 INFO:tasks.workunit.client.1.smithi173.stdout:9/941: truncate d1/d2/d1a/d1f/f4d 2906022 0 2024-02-16T22:19:25.733 INFO:tasks.workunit.client.1.smithi173.stdout:2/894: truncate d2/d4/d8/d30/d44/fad 984868 0 2024-02-16T22:19:25.734 INFO:tasks.workunit.client.1.smithi173.stdout:4/939: unlink d7/d28/d31/d33/c39 0 2024-02-16T22:19:25.736 INFO:tasks.workunit.client.1.smithi173.stdout:0/948: symlink d0/d12/d15/d3d/d98/d14/d50/l139 0 2024-02-16T22:19:25.737 INFO:tasks.workunit.client.1.smithi173.stdout:6/948: unlink d0/db/d4d/d109/c14f 0 2024-02-16T22:19:25.738 INFO:tasks.workunit.client.1.smithi173.stdout:9/942: symlink d1/d2/d1a/d1f/d34/l13a 0 2024-02-16T22:19:25.738 INFO:tasks.workunit.client.1.smithi173.stdout:9/943: write d1/d2/d129/f108 [413195,111087] 0 2024-02-16T22:19:25.739 INFO:tasks.workunit.client.1.smithi173.stdout:9/944: creat d1/d2/d1a/f13b x:0 0 0 2024-02-16T22:19:25.740 INFO:tasks.workunit.client.1.smithi173.stdout:9/945: mkdir d1/d2/d1a/d13c 0 2024-02-16T22:19:25.741 INFO:tasks.workunit.client.1.smithi173.stdout:4/940: rename d7/df/d8b/fef to d7/d28/d31/d33/d7d/d4e/dd7/dec/f144 0 2024-02-16T22:19:25.743 INFO:tasks.workunit.client.1.smithi173.stdout:7/963: write d1/f9 [2349831,5882] 0 2024-02-16T22:19:25.743 INFO:tasks.workunit.client.1.smithi173.stdout:0/949: rename d0/d12/d15/f85 to d0/d12/d15/d3d/d98/d14/d50/dd0/f13a 0 2024-02-16T22:19:25.751 INFO:tasks.workunit.client.1.smithi173.stdout:9/946: rename d1/d2/d1a/d3e/d79/d128/ffe to d1/d5f/d6d/f13d 0 2024-02-16T22:19:25.754 INFO:tasks.workunit.client.1.smithi173.stdout:2/895: dwrite d2/dc/d19/d69/da5/f102 [0,4194304] 0 2024-02-16T22:19:25.756 INFO:tasks.workunit.client.1.smithi173.stdout:7/964: dread d1/f82 [0,4194304] 0 2024-02-16T22:19:25.756 INFO:tasks.workunit.client.1.smithi173.stdout:7/965: chown d1/d1d/d4c/d63/d13/d36 63188 1 2024-02-16T22:19:25.758 INFO:tasks.workunit.client.1.smithi173.stdout:9/947: creat d1/d2/d1a/d1f/d34/d49/dac/f13e x:0 0 0 2024-02-16T22:19:25.760 INFO:tasks.workunit.client.1.smithi173.stdout:6/949: rmdir d0/db/d2e/d65/d73/d7d 39 2024-02-16T22:19:25.761 INFO:tasks.workunit.client.1.smithi173.stdout:0/950: rmdir d0/d12/d15/d3d/d98/d33/d54/d117 39 2024-02-16T22:19:25.761 INFO:tasks.workunit.client.1.smithi173.stdout:0/951: chown d0/d12/d15/d3d/d98/d33/d54/f5c 1665 1 2024-02-16T22:19:25.762 INFO:tasks.workunit.client.1.smithi173.stdout:0/952: dread - d0/d12/d15/d3d/f11a zero size 2024-02-16T22:19:25.762 INFO:tasks.workunit.client.1.smithi173.stdout:0/953: fdatasync d0/d12/d15/d3d/d98/f7 0 2024-02-16T22:19:25.768 INFO:tasks.workunit.client.1.smithi173.stdout:9/948: dread d1/d2/d1a/d1f/d34/fb2 [0,4194304] 0 2024-02-16T22:19:25.771 INFO:tasks.workunit.client.1.smithi173.stdout:2/896: symlink d2/d4/d8/d30/d44/d81/l11a 0 2024-02-16T22:19:25.772 INFO:tasks.workunit.client.1.smithi173.stdout:6/950: write d0/db/d2e/d2f/d31/d7a/ffa [3088162,118171] 0 2024-02-16T22:19:25.772 INFO:tasks.workunit.client.1.smithi173.stdout:6/951: getdents d0/db/d2e/d65/d73/da9/d14b 0 2024-02-16T22:19:25.773 INFO:tasks.workunit.client.1.smithi173.stdout:7/966: creat d1/d1d/d4c/d63/d54/f12f x:0 0 0 2024-02-16T22:19:25.775 INFO:tasks.workunit.client.1.smithi173.stdout:0/954: dread d0/ff [0,4194304] 0 2024-02-16T22:19:25.776 INFO:tasks.workunit.client.1.smithi173.stdout:2/897: mkdir d2/dc/d19/da3/da4/d10f/d11b 0 2024-02-16T22:19:25.777 INFO:tasks.workunit.client.1.smithi173.stdout:2/898: dread - d2/d10/d62/d6c/ffa zero size 2024-02-16T22:19:25.777 INFO:tasks.workunit.client.1.smithi173.stdout:2/899: chown d2/dc/d19/d69/fd6 21 1 2024-02-16T22:19:25.777 INFO:tasks.workunit.client.1.smithi173.stdout:0/955: mkdir d0/d12/d15/d3d/d98/d14/d24/d13b 0 2024-02-16T22:19:25.781 INFO:tasks.workunit.client.1.smithi173.stdout:4/941: rename d7/df9/d13e/dad to d7/d28/d31/d33/d145 0 2024-02-16T22:19:25.783 INFO:tasks.workunit.client.1.smithi173.stdout:4/942: unlink d7/d28/d52/l91 0 2024-02-16T22:19:25.786 INFO:tasks.workunit.client.1.smithi173.stdout:0/956: dread d0/d12/d15/f10f [4194304,4194304] 0 2024-02-16T22:19:25.791 INFO:tasks.workunit.client.1.smithi173.stdout:0/957: truncate d0/d12/d15/d3d/d98/d27/fd9 361285 0 2024-02-16T22:19:25.793 INFO:tasks.workunit.client.1.smithi173.stdout:4/943: read d7/d28/d31/d33/d7d/d4e/f5a [4004064,6144] 0 2024-02-16T22:19:25.794 INFO:tasks.workunit.client.1.smithi173.stdout:4/944: truncate d7/d12/f106 990985 0 2024-02-16T22:19:25.794 INFO:tasks.workunit.client.1.smithi173.stdout:4/945: dread d7/df9/d13e/d129/f9d [0,4194304] 0 2024-02-16T22:19:25.795 INFO:tasks.workunit.client.1.smithi173.stdout:2/900: write d2/d4/d8/d30/f37 [725151,9786] 0 2024-02-16T22:19:25.798 INFO:tasks.workunit.client.1.smithi173.stdout:4/946: link d7/d28/d31/d33/d7d/d4e/dd7/c138 d7/d12/c146 0 2024-02-16T22:19:25.802 INFO:tasks.workunit.client.1.smithi173.stdout:4/947: link d7/d28/d31/d33/d7d/d3d/l9e d7/d28/d10a/d120/l147 0 2024-02-16T22:19:25.803 INFO:tasks.workunit.client.1.smithi173.stdout:4/948: rename d7/d28/d31/l36 to d7/d28/l148 0 2024-02-16T22:19:25.825 INFO:tasks.workunit.client.1.smithi173.stdout:9/949: dwrite d1/d5f/d6d/f74 [0,4194304] 0 2024-02-16T22:19:25.826 INFO:tasks.workunit.client.1.smithi173.stdout:6/952: dwrite d0/d7c/dc5/d92/fb3 [4194304,4194304] 0 2024-02-16T22:19:25.826 INFO:tasks.workunit.client.1.smithi173.stdout:0/958: dwrite d0/d12/d15/d3d/d98/d27/f5a [0,4194304] 0 2024-02-16T22:19:25.826 INFO:tasks.workunit.client.1.smithi173.stdout:7/967: dwrite d1/dd4/f120 [0,4194304] 0 2024-02-16T22:19:25.826 INFO:tasks.workunit.client.1.smithi173.stdout:4/949: dwrite d7/d12/f106 [0,4194304] 0 2024-02-16T22:19:25.829 INFO:tasks.workunit.client.1.smithi173.stdout:9/950: mkdir d1/d5f/d6d/d91/da7/d13f 0 2024-02-16T22:19:25.831 INFO:tasks.workunit.client.1.smithi173.stdout:0/959: rename d0/d12/d15/d4f/d92 to d0/d12/d15/d3d/d98/d14/d24/ddd/d13c 0 2024-02-16T22:19:25.834 INFO:tasks.workunit.client.1.smithi173.stdout:6/953: read d0/db/d2e/f54 [1606067,42351] 0 2024-02-16T22:19:25.834 INFO:tasks.workunit.client.1.smithi173.stdout:6/954: stat d0/db/d2e/d65/d67/f10c 0 2024-02-16T22:19:25.834 INFO:tasks.workunit.client.1.smithi173.stdout:6/955: truncate d0/db/d2e/d65/db8/de1/d116/f13a 423579 0 2024-02-16T22:19:25.837 INFO:tasks.workunit.client.1.smithi173.stdout:9/951: truncate d1/d2/d1a/d2f/df4/f6a 689906 0 2024-02-16T22:19:25.837 INFO:tasks.workunit.client.1.smithi173.stdout:9/952: truncate d1/d2/dec/f101 959075 0 2024-02-16T22:19:25.837 INFO:tasks.workunit.client.1.smithi173.stdout:9/953: chown d1/d2/d1a/d2f/d51/d96/db3/dd6/cfa 7 1 2024-02-16T22:19:25.838 INFO:tasks.workunit.client.1.smithi173.stdout:9/954: fdatasync d1/d2/d1a/d3e/d79/d128/fd2 0 2024-02-16T22:19:25.838 INFO:tasks.workunit.client.1.smithi173.stdout:4/950: symlink d7/l149 0 2024-02-16T22:19:25.839 INFO:tasks.workunit.client.1.smithi173.stdout:4/951: fdatasync d7/d28/d52/f60 0 2024-02-16T22:19:25.839 INFO:tasks.workunit.client.1.smithi173.stdout:4/952: fsync d7/d28/d52/fb7 0 2024-02-16T22:19:25.839 INFO:tasks.workunit.client.1.smithi173.stdout:7/968: read d1/d1d/d4c/d63/d11/ff5 [153841,45963] 0 2024-02-16T22:19:25.839 INFO:tasks.workunit.client.1.smithi173.stdout:0/960: creat d0/d12/d15/d3d/d98/d33/d54/d117/f13d x:0 0 0 2024-02-16T22:19:25.840 INFO:tasks.workunit.client.1.smithi173.stdout:7/969: dread d1/d1d/d4c/d63/d13/d22/d53/db9/dbc/ff1 [0,4194304] 0 2024-02-16T22:19:25.842 INFO:tasks.workunit.client.1.smithi173.stdout:7/970: rmdir d1/d1d/d4c/d63/d48/d9a/de6 39 2024-02-16T22:19:25.842 INFO:tasks.workunit.client.1.smithi173.stdout:7/971: chown d1/d1d/d4c/d63/d13/d36/d49/f6d 1483219466 1 2024-02-16T22:19:25.848 INFO:tasks.workunit.client.1.smithi173.stdout:4/953: read d7/fd [3369678,63023] 0 2024-02-16T22:19:25.850 INFO:tasks.workunit.client.1.smithi173.stdout:4/954: link d7/d28/d31/d33/d7d/d45/f6b d7/d28/d31/d33/d7d/d4e/dd7/d139/f14a 0 2024-02-16T22:19:25.853 INFO:tasks.workunit.client.1.smithi173.stdout:4/955: getdents d7/d28/d31/d72/d93/d95/db4 0 2024-02-16T22:19:25.855 INFO:tasks.workunit.client.1.smithi173.stdout:4/956: truncate d7/d12/f30 2139723 0 2024-02-16T22:19:25.860 INFO:tasks.workunit.client.1.smithi173.stdout:4/957: mkdir d7/d14b 0 2024-02-16T22:19:25.862 INFO:tasks.workunit.client.1.smithi173.stdout:4/958: rmdir d7/df9/d13e/d129 39 2024-02-16T22:19:25.862 INFO:tasks.workunit.client.1.smithi173.stdout:4/959: chown d7/d28/d31/d72 375 1 2024-02-16T22:19:25.863 INFO:tasks.workunit.client.1.smithi173.stdout:4/960: fsync d7/f9 0 2024-02-16T22:19:25.883 INFO:tasks.workunit.client.1.smithi173.stdout:4/961: dread d7/fd [4194304,4194304] 0 2024-02-16T22:19:25.884 INFO:tasks.workunit.client.1.smithi173.stdout:4/962: getdents d7/df/d62/d133 0 2024-02-16T22:19:25.888 INFO:tasks.workunit.client.1.smithi173.stdout:7/972: dwrite d1/d1d/d4c/d63/d13/d22/ff2 [0,4194304] 0 2024-02-16T22:19:25.888 INFO:tasks.workunit.client.1.smithi173.stdout:6/956: dwrite d0/db/d2e/d2f/d31/d33/f69 [0,4194304] 0 2024-02-16T22:19:25.888 INFO:tasks.workunit.client.1.smithi173.stdout:0/961: dwrite d0/d12/d15/d3d/d98/f2a [0,4194304] 0 2024-02-16T22:19:25.888 INFO:tasks.workunit.client.1.smithi173.stdout:0/962: write d0/d12/d15/d3d/d98/d14/d24/d58/f93 [1499333,29479] 0 2024-02-16T22:19:25.889 INFO:tasks.workunit.client.1.smithi173.stdout:9/955: dwrite d1/d5f/d6d/f13d [0,4194304] 0 2024-02-16T22:19:25.889 INFO:tasks.workunit.client.1.smithi173.stdout:9/956: fsync d1/d2/fc9 0 2024-02-16T22:19:25.889 INFO:tasks.workunit.client.1.smithi173.stdout:7/973: symlink d1/d1d/d4c/d63/d13/d36/l130 0 2024-02-16T22:19:25.889 INFO:tasks.workunit.client.1.smithi173.stdout:7/974: write d1/d1d/d4c/d63/d13/d36/f10a [228487,46524] 0 2024-02-16T22:19:25.889 INFO:tasks.workunit.client.1.smithi173.stdout:6/957: mknod d0/db/d2e/d2f/d31/d33/d151/daa/de8/c152 0 2024-02-16T22:19:25.894 INFO:tasks.workunit.client.1.smithi173.stdout:6/958: mknod d0/db/d2e/d65/d73/d100/d110/c153 0 2024-02-16T22:19:25.894 INFO:tasks.workunit.client.1.smithi173.stdout:6/959: read d0/f18 [297181,105402] 0 2024-02-16T22:19:25.894 INFO:tasks.workunit.client.1.smithi173.stdout:6/960: chown d0/db/f29 139 1 2024-02-16T22:19:25.898 INFO:tasks.workunit.client.1.smithi173.stdout:6/961: creat d0/db/d2e/d65/d73/da9/f154 x:0 0 0 2024-02-16T22:19:25.898 INFO:tasks.workunit.client.1.smithi173.stdout:6/962: write d0/db/d2e/d2f/d31/d7a/ffa [4973668,69353] 0 2024-02-16T22:19:25.902 INFO:tasks.workunit.client.1.smithi173.stdout:4/963: rename d7/d28/d31/d33/d7d/d4e/dd7/dec/df3 to d7/d28/d31/d72/d93/d14c 0 2024-02-16T22:19:25.904 INFO:tasks.workunit.client.1.smithi173.stdout:4/964: read d7/d28/d31/d125/f128 [1045918,116759] 0 2024-02-16T22:19:25.906 INFO:tasks.workunit.client.1.smithi173.stdout:4/965: creat d7/df/d62/dd8/d124/f14d x:0 0 0 2024-02-16T22:19:25.909 INFO:tasks.workunit.client.1.smithi173.stdout:4/966: dread d7/d12/f96 [4194304,4194304] 0 2024-02-16T22:19:25.912 INFO:tasks.workunit.client.1.smithi173.stdout:4/967: symlink d7/d28/d31/d33/dca/df4/d126/l14e 0 2024-02-16T22:19:25.912 INFO:tasks.workunit.client.1.smithi173.stdout:4/968: truncate d7/df/d62/f6f 1081083 0 2024-02-16T22:19:25.913 INFO:tasks.workunit.client.1.smithi173.stdout:6/963: dread d0/db/d2e/d65/db8/fca [0,4194304] 0 2024-02-16T22:19:25.914 INFO:tasks.workunit.client.1.smithi173.stdout:6/964: stat d0/db/d2e/d65/d73 0 2024-02-16T22:19:25.914 INFO:tasks.workunit.client.1.smithi173.stdout:4/969: creat d7/d12/dda/f14f x:0 0 0 2024-02-16T22:19:25.915 INFO:tasks.workunit.client.1.smithi173.stdout:4/970: mkdir d7/d28/d31/d72/d93/d14c/d150 0 2024-02-16T22:19:25.917 INFO:tasks.workunit.client.1.smithi173.stdout:4/971: creat d7/df/d8b/f151 x:0 0 0 2024-02-16T22:19:25.918 INFO:tasks.workunit.client.1.smithi173.stdout:4/972: truncate d7/d28/d31/d33/d7d/d4e/f6a 2882828 0 2024-02-16T22:19:25.918 INFO:tasks.workunit.client.1.smithi173.stdout:4/973: stat d7/d28/d31/f132 0 2024-02-16T22:19:25.919 INFO:tasks.workunit.client.1.smithi173.stdout:4/974: truncate d7/d28/d31/d33/d7d/d4e/f83 577089 0 2024-02-16T22:19:25.920 INFO:tasks.workunit.client.1.smithi173.stdout:9/957: dwrite d1/d2/d1a/d2f/d3b/f84 [0,4194304] 0 2024-02-16T22:19:25.920 INFO:tasks.workunit.client.1.smithi173.stdout:7/975: dwrite d1/d1d/d4c/d63/fa5 [0,4194304] 0 2024-02-16T22:19:25.921 INFO:tasks.workunit.client.1.smithi173.stdout:4/975: mkdir d7/d28/d31/d33/d7d/d4e/dd7/dec/d152 0 2024-02-16T22:19:25.922 INFO:tasks.workunit.client.1.smithi173.stdout:9/958: creat d1/d2/d1a/d2f/f140 x:0 0 0 2024-02-16T22:19:25.922 INFO:tasks.workunit.client.1.smithi173.stdout:9/959: fsync d1/d2/da2/ff6 0 2024-02-16T22:19:25.930 INFO:tasks.workunit.client.1.smithi173.stdout:4/976: dread d7/df9/d13e/f5c [0,4194304] 0 2024-02-16T22:19:25.934 INFO:tasks.workunit.client.1.smithi173.stdout:9/960: write d1/d2/fc9 [1555433,759] 0 2024-02-16T22:19:25.934 INFO:tasks.workunit.client.1.smithi173.stdout:7/976: dread d1/d1d/d4c/d63/d48/f5d [0,4194304] 0 2024-02-16T22:19:25.935 INFO:tasks.workunit.client.1.smithi173.stdout:7/977: symlink d1/d1d/d4c/d63/d13/d22/l131 0 2024-02-16T22:19:25.939 INFO:tasks.workunit.client.1.smithi173.stdout:7/978: dread d1/d1d/d4c/d63/f4 [0,4194304] 0 2024-02-16T22:19:25.940 INFO:tasks.workunit.client.1.smithi173.stdout:4/977: write d7/f15 [6264147,56977] 0 2024-02-16T22:19:25.945 INFO:tasks.workunit.client.1.smithi173.stdout:4/978: symlink d7/df9/d13e/dcf/l153 0 2024-02-16T22:19:25.947 INFO:tasks.workunit.client.1.smithi173.stdout:4/979: mknod d7/df/d62/c154 0 2024-02-16T22:19:25.954 INFO:tasks.workunit.client.1.smithi173.stdout:7/979: dwrite d1/d1d/d4c/d63/d13/d36/f87 [0,4194304] 0 2024-02-16T22:19:25.965 INFO:tasks.workunit.client.1.smithi173.stdout:4/980: dwrite d7/d28/d31/d33/d7d/d4e/f83 [0,4194304] 0 2024-02-16T22:19:25.965 INFO:tasks.workunit.client.1.smithi173.stdout:4/981: write d7/df/d8b/fa0 [5086058,38171] 0 2024-02-16T22:19:25.970 INFO:tasks.workunit.client.1.smithi173.stdout:4/982: getdents d7/df/d62 0 2024-02-16T22:19:25.970 INFO:tasks.workunit.client.1.smithi173.stdout:4/983: dread - d7/d28/d31/d33/f11a zero size 2024-02-16T22:19:25.972 INFO:tasks.workunit.client.1.smithi173.stdout:4/984: rmdir d7/d28/d31/d33/d7d/d45 39 2024-02-16T22:19:25.972 INFO:tasks.workunit.client.1.smithi173.stdout:4/985: chown d7/fd9 477742228 1 2024-02-16T22:19:25.973 INFO:tasks.workunit.client.1.smithi173.stdout:4/986: write d7/d28/d52/d89/fdc [860419,3697] 0 2024-02-16T22:19:25.975 INFO:tasks.workunit.client.1.smithi173.stdout:4/987: dread d7/df/d62/f113 [0,4194304] 0 2024-02-16T22:19:25.976 INFO:tasks.workunit.client.1.smithi173.stdout:4/988: symlink d7/d14b/l155 0 2024-02-16T22:19:25.977 INFO:tasks.workunit.client.1.smithi173.stdout:4/989: creat d7/d28/d31/d125/f156 x:0 0 0 2024-02-16T22:19:25.981 INFO:tasks.workunit.client.1.smithi173.stdout:4/990: write d7/d28/d31/f66 [260754,29043] 0 2024-02-16T22:19:25.983 INFO:tasks.workunit.client.1.smithi173.stdout:4/991: symlink d7/d28/d31/d33/d7d/d3d/l157 0 2024-02-16T22:19:25.986 INFO:tasks.workunit.client.1.smithi173.stdout:4/992: rename d7/df9/d13e/f44 to d7/f158 0 2024-02-16T22:19:25.988 INFO:tasks.workunit.client.1.smithi173.stdout:4/993: truncate d7/d28/d31/d33/d7d/d45/ffc 3738778 0 2024-02-16T22:19:25.989 INFO:tasks.workunit.client.1.smithi173.stdout:4/994: rename d7/d28/d31/d33/d7d/cc3 to d7/df/d62/dd8/dde/c159 0 2024-02-16T22:19:25.991 INFO:tasks.workunit.client.1.smithi173.stdout:4/995: mkdir d7/d28/d31/d125/d15a 0 2024-02-16T22:19:25.993 INFO:tasks.workunit.client.1.smithi173.stdout:4/996: unlink d7/df9/d13e/d129/fbb 0 2024-02-16T22:19:25.994 INFO:tasks.workunit.client.1.smithi173.stdout:4/997: truncate d7/d28/d31/d33/fd1 1837994 0 2024-02-16T22:19:25.994 INFO:tasks.workunit.client.1.smithi173.stdout:4/998: readlink d7/d28/d31/d33/d7d/l87 0 2024-02-16T22:19:25.996 INFO:tasks.workunit.client.1.smithi173.stdout:4/999: unlink d7/d28/d31/d125/f156 0 2024-02-16T22:19:26.230 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:26 smithi173 ceph-mon[37280]: mgrmap e23: smithi173.kbofaa(active, since 3s) 2024-02-16T22:19:26.445 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:26 smithi134 ceph-mon[28869]: mgrmap e23: smithi173.kbofaa(active, since 3s) 2024-02-16T22:19:27.344 INFO:tasks.workunit.client.1.smithi173.stdout:2/901: sync 2024-02-16T22:19:27.345 INFO:tasks.workunit.client.1.smithi173.stdout:2/902: stat d2/dc/d19/d1a/d74/db2/dec/f117 0 2024-02-16T22:19:27.345 INFO:tasks.workunit.client.1.smithi173.stdout:6/965: sync 2024-02-16T22:19:27.345 INFO:tasks.workunit.client.1.smithi173.stdout:7/980: sync 2024-02-16T22:19:27.345 INFO:tasks.workunit.client.1.smithi173.stdout:9/961: sync 2024-02-16T22:19:27.345 INFO:tasks.workunit.client.1.smithi173.stdout:0/963: sync 2024-02-16T22:19:27.345 INFO:tasks.workunit.client.1.smithi173.stdout:0/964: chown d0/d12/d15/d3d/d98/d14/f8d 7 1 2024-02-16T22:19:27.345 INFO:tasks.workunit.client.1.smithi173.stdout:0/965: chown d0/d12/d15/d3d/db5/dbf 774 1 2024-02-16T22:19:27.349 INFO:tasks.workunit.client.1.smithi173.stdout:6/966: link d0/db/d2e/d2f/d31/d33/d97/fa8 d0/d133/f155 0 2024-02-16T22:19:27.350 INFO:tasks.workunit.client.1.smithi173.stdout:2/903: dread d2/dc/d5d/f6a [4194304,4194304] 0 2024-02-16T22:19:27.368 INFO:tasks.workunit.client.1.smithi173.stdout:7/981: dwrite d1/d1d/d4c/d63/fa5 [4194304,4194304] 0 2024-02-16T22:19:27.368 INFO:tasks.workunit.client.1.smithi173.stdout:6/967: dwrite d0/db/d2e/d65/d9f/fef [0,4194304] 0 2024-02-16T22:19:27.373 INFO:tasks.workunit.client.1.smithi173.stdout:6/968: creat d0/db/d2e/d65/d9f/f156 x:0 0 0 2024-02-16T22:19:27.376 INFO:tasks.workunit.client.1.smithi173.stdout:6/969: creat d0/d7c/d125/f157 x:0 0 0 2024-02-16T22:19:27.378 INFO:tasks.workunit.client.1.smithi173.stdout:6/970: link d0/db/d2e/d65/d73/d100/d110/l13d d0/db/d2e/d65/d73/d81/l158 0 2024-02-16T22:19:27.395 INFO:tasks.workunit.client.1.smithi173.stdout:6/971: dwrite d0/db/d2e/d65/fbb [4194304,4194304] 0 2024-02-16T22:19:27.396 INFO:tasks.workunit.client.1.smithi173.stdout:6/972: symlink d0/db/d2e/d2f/d108/l159 0 2024-02-16T22:19:27.397 INFO:tasks.workunit.client.1.smithi173.stdout:6/973: readlink d0/db/d2e/d65/d67/d10f/l121 0 2024-02-16T22:19:27.399 INFO:tasks.workunit.client.1.smithi173.stdout:6/974: getdents d0/db/d2e/d2f/d31/d7a 0 2024-02-16T22:19:27.409 INFO:tasks.workunit.client.1.smithi173.stdout:9/962: unlink d1/d2/d1a/d8b/f113 0 2024-02-16T22:19:27.410 INFO:tasks.workunit.client.1.smithi173.stdout:0/966: getdents d0/d12 0 2024-02-16T22:19:27.412 INFO:tasks.workunit.client.1.smithi173.stdout:2/904: creat d2/d4/d8/d30/daf/f11c x:0 0 0 2024-02-16T22:19:27.415 INFO:tasks.workunit.client.1.smithi173.stdout:6/975: dwrite d0/db/d2e/d2f/d31/fc7 [4194304,4194304] 0 2024-02-16T22:19:27.415 INFO:tasks.workunit.client.1.smithi173.stdout:6/976: chown d0/db/d2e/d65/d118/f145 3 1 2024-02-16T22:19:27.416 INFO:tasks.workunit.client.1.smithi173.stdout:7/982: symlink d1/d1d/d4c/d63/d6c/dca/de7/l132 0 2024-02-16T22:19:27.416 INFO:tasks.workunit.client.1.smithi173.stdout:7/983: stat d1/d1d/d4c/d63/d13/dce/c11d 0 2024-02-16T22:19:27.418 INFO:tasks.workunit.client.1.smithi173.stdout:9/963: getdents d1/d2/d129/d107/d115 0 2024-02-16T22:19:27.422 INFO:tasks.workunit.client.1.smithi173.stdout:2/905: mkdir d2/d4/d8/d30/d4d/da8/d11d 0 2024-02-16T22:19:27.422 INFO:tasks.workunit.client.1.smithi173.stdout:2/906: write d2/d4/d8/d30/d4d/f4e [371937,118624] 0 2024-02-16T22:19:27.424 INFO:tasks.workunit.client.1.smithi173.stdout:9/964: chown d1/d2/d1a/d1f/d34/dbb/l10f 47 1 2024-02-16T22:19:27.424 INFO:tasks.workunit.client.1.smithi173.stdout:9/965: chown d1/d2/d1a/d1f/d34/fb2 235 1 2024-02-16T22:19:27.426 INFO:tasks.workunit.client.1.smithi173.stdout:6/977: dread d0/db/d2e/d2f/d31/d33/fab [0,4194304] 0 2024-02-16T22:19:27.426 INFO:tasks.workunit.client.1.smithi173.stdout:6/978: fdatasync d0/d133/f155 0 2024-02-16T22:19:27.428 INFO:tasks.workunit.client.1.smithi173.stdout:7/984: creat d1/d1d/d4c/d63/d13/d36/f133 x:0 0 0 2024-02-16T22:19:27.430 INFO:tasks.workunit.client.1.smithi173.stdout:6/979: getdents d0/db/d2e/d2f/d31/d5d 0 2024-02-16T22:19:27.430 INFO:tasks.workunit.client.1.smithi173.stdout:0/967: dwrite d0/d12/d15/d3d/d98/d14/d24/d32/f66 [0,4194304] 0 2024-02-16T22:19:27.433 INFO:tasks.workunit.client.1.smithi173.stdout:6/980: mknod d0/db/d2e/d2f/c15a 0 2024-02-16T22:19:27.434 INFO:tasks.workunit.client.1.smithi173.stdout:0/968: creat d0/d12/d15/d3d/d98/d14/d12b/f13e x:0 0 0 2024-02-16T22:19:27.434 INFO:tasks.workunit.client.1.smithi173.stdout:0/969: fdatasync d0/d12/d15/f10f 0 2024-02-16T22:19:27.437 INFO:tasks.workunit.client.1.smithi173.stdout:0/970: mknod d0/d12/d15/d3d/d98/c13f 0 2024-02-16T22:19:27.438 INFO:tasks.workunit.client.1.smithi173.stdout:6/981: unlink d0/db/d2e/d2f/d108/l159 0 2024-02-16T22:19:27.440 INFO:tasks.workunit.client.1.smithi173.stdout:0/971: mkdir d0/d12/d15/d3d/dab/d140 0 2024-02-16T22:19:27.441 INFO:tasks.workunit.client.1.smithi173.stdout:6/982: dread d0/db/d2e/d65/db8/feb [0,4194304] 0 2024-02-16T22:19:27.441 INFO:tasks.workunit.client.1.smithi173.stdout:6/983: stat d0/db/d2e/d65/fe5 0 2024-02-16T22:19:27.445 INFO:tasks.workunit.client.1.smithi173.stdout:6/984: creat d0/db/d2e/d2f/d31/d33/d151/d132/f15b x:0 0 0 2024-02-16T22:19:27.449 INFO:tasks.workunit.client.1.smithi173.stdout:0/972: write d0/d12/d15/d3d/d98/f3e [581614,25916] 0 2024-02-16T22:19:27.451 INFO:tasks.workunit.client.1.smithi173.stdout:0/973: rename d0/d12/d15/d86/cc8 to d0/d12/d15/d3d/db5/c141 0 2024-02-16T22:19:27.453 INFO:tasks.workunit.client.1.smithi173.stdout:0/974: rename d0/d12/d15/d3d/d98/d14/f2d to d0/d12/d15/d3d/dab/f142 0 2024-02-16T22:19:27.455 INFO:tasks.workunit.client.1.smithi173.stdout:7/985: dwrite d1/d1d/d4c/d63/d13/d22/d7e/dc2/f59 [0,4194304] 0 2024-02-16T22:19:27.456 INFO:tasks.workunit.client.1.smithi173.stdout:7/986: fdatasync d1/d1d/d4c/d63/d13/d22/f11b 0 2024-02-16T22:19:27.456 INFO:tasks.workunit.client.1.smithi173.stdout:0/975: unlink d0/d12/d15/d3d/d98/d33/d54/ld5 0 2024-02-16T22:19:27.459 INFO:tasks.workunit.client.1.smithi173.stdout:0/976: rename d0/d12/d15/d3d/d98/d14/l47 to d0/d12/dce/l143 0 2024-02-16T22:19:27.460 INFO:tasks.workunit.client.1.smithi173.stdout:6/985: dread d0/db/f3d [0,4194304] 0 2024-02-16T22:19:27.461 INFO:tasks.workunit.client.1.smithi173.stdout:6/986: mknod d0/d7c/dc5/c15c 0 2024-02-16T22:19:27.461 INFO:tasks.workunit.client.1.smithi173.stdout:6/987: truncate d0/db/d2e/d2f/d31/d33/d151/daa/f148 976628 0 2024-02-16T22:19:27.463 INFO:tasks.workunit.client.1.smithi173.stdout:0/977: truncate d0/d12/d15/d3d/d98/fe 3509767 0 2024-02-16T22:19:27.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:27 smithi134 ceph-mon[28869]: pgmap v5: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail 2024-02-16T22:19:27.466 INFO:tasks.workunit.client.1.smithi173.stdout:9/966: getdents d1/d2/d1a/d8b 0 2024-02-16T22:19:27.466 INFO:tasks.workunit.client.1.smithi173.stdout:9/967: dread - d1/d5f/fca zero size 2024-02-16T22:19:27.468 INFO:tasks.workunit.client.1.smithi173.stdout:0/978: stat d0/d12/d15/d3d/db5/dbf/l10e 0 2024-02-16T22:19:27.469 INFO:tasks.workunit.client.1.smithi173.stdout:9/968: mkdir d1/d2/d141 0 2024-02-16T22:19:27.476 INFO:tasks.workunit.client.1.smithi173.stdout:0/979: dread d0/d12/d15/d3d/d98/d14/d24/d5f/fe8 [0,4194304] 0 2024-02-16T22:19:27.478 INFO:tasks.workunit.client.1.smithi173.stdout:0/980: link d0/d6d/dc9/lc1 d0/d12/d15/d3d/d98/d14/d24/d13b/l144 0 2024-02-16T22:19:27.478 INFO:tasks.workunit.client.1.smithi173.stdout:0/981: dread - d0/d12/d15/d3d/d98/d14/d24/d2e/d6b/fbd zero size 2024-02-16T22:19:27.478 INFO:tasks.workunit.client.1.smithi173.stdout:0/982: truncate d0/d12/d15/d3d/d98/d14/d24/d70/f136 424437 0 2024-02-16T22:19:27.480 INFO:tasks.workunit.client.1.smithi173.stdout:9/969: dread d1/d2/d1a/d8b/f106 [0,4194304] 0 2024-02-16T22:19:27.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:27 smithi173 ceph-mon[37280]: pgmap v5: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail 2024-02-16T22:19:27.482 INFO:tasks.workunit.client.1.smithi173.stdout:6/988: dwrite d0/db/d2e/d2f/d31/fc7 [0,4194304] 0 2024-02-16T22:19:27.483 INFO:tasks.workunit.client.1.smithi173.stdout:6/989: readlink d0/d7c/d125/l12e 0 2024-02-16T22:19:27.483 INFO:tasks.workunit.client.1.smithi173.stdout:7/987: dwrite d1/d1d/d4c/d63/d13/d22/ff2 [0,4194304] 0 2024-02-16T22:19:27.512 INFO:tasks.workunit.client.1.smithi173.stdout:6/990: dwrite d0/db/d2e/d2f/f82 [0,4194304] 0 2024-02-16T22:19:27.512 INFO:tasks.workunit.client.1.smithi173.stdout:0/983: dwrite d0/d12/d15/d3d/d98/d33/d54/d117/f13d [0,4194304] 0 2024-02-16T22:19:27.512 INFO:tasks.workunit.client.1.smithi173.stdout:7/988: dwrite d1/d1d/d4c/d63/d48/faa [0,4194304] 0 2024-02-16T22:19:27.512 INFO:tasks.workunit.client.1.smithi173.stdout:7/989: fsync d1/d1d/d4c/d63/d6c/f77 0 2024-02-16T22:19:27.512 INFO:tasks.workunit.client.1.smithi173.stdout:0/984: dread - d0/d12/d15/d3d/d98/d33/dc2/f10c zero size 2024-02-16T22:19:27.512 INFO:tasks.workunit.client.1.smithi173.stdout:0/985: chown d0/d12/d108/c130 62 1 2024-02-16T22:19:27.513 INFO:tasks.workunit.client.1.smithi173.stdout:6/991: truncate d0/db/d2e/d2f/d31/d33/d151/ff5 162589 0 2024-02-16T22:19:27.513 INFO:tasks.workunit.client.1.smithi173.stdout:6/992: truncate d0/db/d2e/d2f/f8d 1018710 0 2024-02-16T22:19:27.515 INFO:tasks.workunit.client.1.smithi173.stdout:7/990: getdents d1/dd4/d103 0 2024-02-16T22:19:27.515 INFO:tasks.workunit.client.1.smithi173.stdout:7/991: readlink d1/d1d/d4c/d63/d13/d36/dd6/l121 0 2024-02-16T22:19:27.515 INFO:tasks.workunit.client.1.smithi173.stdout:7/992: creat d1/d1d/d4c/d63/d13/d36/f134 x:0 0 0 2024-02-16T22:19:27.515 INFO:tasks.workunit.client.1.smithi173.stdout:7/993: fsync d1/d1d/d4c/d63/d13/d22/ff2 0 2024-02-16T22:19:27.516 INFO:tasks.workunit.client.1.smithi173.stdout:0/986: link d0/d12/d15/d3d/db5/dbf/l10e d0/d12/d15/d3d/d98/d14/d24/ddd/d13c/l145 0 2024-02-16T22:19:27.518 INFO:tasks.workunit.client.1.smithi173.stdout:6/993: creat d0/db/d4d/f15d x:0 0 0 2024-02-16T22:19:27.518 INFO:tasks.workunit.client.1.smithi173.stdout:0/987: creat d0/d12/d15/f146 x:0 0 0 2024-02-16T22:19:27.529 INFO:tasks.workunit.client.1.smithi173.stdout:0/988: dread d0/d12/d15/d3d/d98/d14/d24/d32/d39/f75 [0,4194304] 0 2024-02-16T22:19:27.529 INFO:tasks.workunit.client.1.smithi173.stdout:0/989: truncate d0/d12/d15/d3d/d98/d14/d24/d2e/fd6 296206 0 2024-02-16T22:19:27.530 INFO:tasks.workunit.client.1.smithi173.stdout:0/990: mknod d0/c147 0 2024-02-16T22:19:27.530 INFO:tasks.workunit.client.1.smithi173.stdout:0/991: chown d0/d12/d15/d3d/d98/d14/d50/l139 49447708 1 2024-02-16T22:19:27.531 INFO:tasks.workunit.client.1.smithi173.stdout:0/992: rename d0/f118 to d0/d12/dce/f148 0 2024-02-16T22:19:27.531 INFO:tasks.workunit.client.1.smithi173.stdout:0/993: fsync d0/d12/d15/d3d/d98/d14/d24/d2e/fe2 0 2024-02-16T22:19:27.531 INFO:tasks.workunit.client.1.smithi173.stdout:0/994: truncate d0/d12/d15/d3d/d98/f3e 4540312 0 2024-02-16T22:19:27.532 INFO:tasks.workunit.client.1.smithi173.stdout:0/995: symlink d0/d12/d15/d3d/d98/d14/d24/d32/d39/l149 0 2024-02-16T22:19:27.532 INFO:tasks.workunit.client.1.smithi173.stdout:0/996: truncate d0/d12/d15/d3d/d98/d33/f3c 5931504 0 2024-02-16T22:19:27.533 INFO:tasks.workunit.client.1.smithi173.stdout:0/997: rmdir d0/d12/d15/d3d/d98/d14/d24/d58/de7 39 2024-02-16T22:19:27.583 INFO:tasks.workunit.client.1.smithi173.stdout:6/994: truncate d0/db/d2e/f30 6303138 0 2024-02-16T22:19:27.600 INFO:tasks.workunit.client.1.smithi173.stdout:6/995: dwrite d0/db/d2e/d2f/f3b [0,4194304] 0 2024-02-16T22:19:27.607 INFO:tasks.workunit.client.1.smithi173.stdout:6/996: mknod d0/db/d2e/d65/db8/c15e 0 2024-02-16T22:19:27.611 INFO:tasks.workunit.client.1.smithi173.stdout:6/997: rename d0/db/d2e/d65/d73/ce9 to d0/db/d2e/d2f/d31/d7a/c15f 0 2024-02-16T22:19:27.611 INFO:tasks.workunit.client.1.smithi173.stdout:6/998: dread - d0/db/d2e/f7e zero size 2024-02-16T22:19:27.612 INFO:tasks.workunit.client.1.smithi173.stdout:6/999: creat d0/db/d2e/d65/d9f/f160 x:0 0 0 2024-02-16T22:19:28.539 INFO:tasks.workunit.client.1.smithi173.stdout:2/907: sync 2024-02-16T22:19:28.541 INFO:tasks.workunit.client.1.smithi173.stdout:2/908: creat d2/d10/d62/d6c/f11e x:0 0 0 2024-02-16T22:19:28.541 INFO:tasks.workunit.client.1.smithi173.stdout:2/909: write d2/d10/d62/d6c/ffa [599570,52020] 0 2024-02-16T22:19:28.558 INFO:tasks.workunit.client.1.smithi173.stdout:2/910: dwrite d2/dc/d19/d1a/f5f [4194304,4194304] 0 2024-02-16T22:19:28.573 INFO:tasks.workunit.client.1.smithi173.stdout:2/911: dwrite d2/d4/d8/d2d/de6/f112 [0,4194304] 0 2024-02-16T22:19:28.573 INFO:tasks.workunit.client.1.smithi173.stdout:2/912: fsync d2/d10/d62/d6c/f11e 0 2024-02-16T22:19:28.575 INFO:tasks.workunit.client.1.smithi173.stdout:2/913: symlink d2/d4/d57/d82/ded/l11f 0 2024-02-16T22:19:28.575 INFO:tasks.workunit.client.1.smithi173.stdout:2/914: chown d2/dc/d19/d1a/f34 1097 1 2024-02-16T22:19:28.575 INFO:tasks.workunit.client.1.smithi173.stdout:2/915: chown d2/dc/d19/d1a/f5f 259274 1 2024-02-16T22:19:28.576 INFO:tasks.workunit.client.1.smithi173.stdout:2/916: symlink d2/d4/d8/d2d/d10e/dff/l120 0 2024-02-16T22:19:28.576 INFO:tasks.workunit.client.1.smithi173.stdout:2/917: fsync d2/dc/d19/d1c/d53/fea 0 2024-02-16T22:19:28.579 INFO:tasks.workunit.client.1.smithi173.stdout:2/918: unlink d2/dc/d19/d1a/d74/db2/dec/f117 0 2024-02-16T22:19:28.579 INFO:tasks.workunit.client.1.smithi173.stdout:2/919: stat d2/dc/d19/d69/da5/d115/l118 0 2024-02-16T22:19:28.579 INFO:tasks.workunit.client.1.smithi173.stdout:2/920: truncate d2/d4/d8/d30/daf/f11c 740853 0 2024-02-16T22:19:28.579 INFO:tasks.workunit.client.1.smithi173.stdout:2/921: fsync d2/d4/d8/d30/d4d/f4e 0 2024-02-16T22:19:28.580 INFO:tasks.workunit.client.1.smithi173.stdout:2/922: rename d2/d4/d8/d2d/d10e/fe3 to d2/dc/d19/deb/f121 0 2024-02-16T22:19:28.744 INFO:tasks.workunit.client.1.smithi173.stdout:0/998: sync 2024-02-16T22:19:28.745 INFO:tasks.workunit.client.1.smithi173.stdout:7/994: sync 2024-02-16T22:19:28.745 INFO:tasks.workunit.client.1.smithi173.stdout:9/970: sync 2024-02-16T22:19:28.745 INFO:tasks.workunit.client.1.smithi173.stdout:0/999: fsync d0/d12/d15/d86/fa6 0 2024-02-16T22:19:28.746 INFO:tasks.workunit.client.1.smithi173.stdout:9/971: rename d1/d5f/d6d/d91/fea to d1/d5f/d6d/d91/da7/f142 0 2024-02-16T22:19:28.746 INFO:tasks.workunit.client.1.smithi173.stdout:9/972: readlink d1/d5f/d6d/d97/l11b 0 2024-02-16T22:19:28.746 INFO:tasks.workunit.client.1.smithi173.stdout:9/973: write d1/d2/d1a/d2f/d3b/f7c [2554371,37296] 0 2024-02-16T22:19:28.747 INFO:tasks.workunit.client.1.smithi173.stdout:7/995: symlink d1/d1d/d4c/d63/d13/d22/d53/d27/l135 0 2024-02-16T22:19:28.748 INFO:tasks.workunit.client.1.smithi173.stdout:9/974: link d1/d2/d129/f108 d1/d5f/d6d/d97/f143 0 2024-02-16T22:19:28.748 INFO:tasks.workunit.client.1.smithi173.stdout:9/975: chown d1/d2/fc9 179540846 1 2024-02-16T22:19:28.750 INFO:tasks.workunit.client.1.smithi173.stdout:7/996: rename d1/d1d/d4c/d63/d13/d22/d7e/dbd/dd2/f106 to d1/d1d/d4c/d63/d48/d9a/dea/f136 0 2024-02-16T22:19:28.751 INFO:tasks.workunit.client.1.smithi173.stdout:9/976: creat d1/d2/d1a/d2f/d3b/d75/db1/f144 x:0 0 0 2024-02-16T22:19:28.752 INFO:tasks.workunit.client.1.smithi173.stdout:9/977: chown d1/d2/d129/d107 113 1 2024-02-16T22:19:28.752 INFO:tasks.workunit.client.1.smithi173.stdout:7/997: stat d1/d1d/d4c/d63/d13/d36/d49/l101 0 2024-02-16T22:19:28.752 INFO:tasks.workunit.client.1.smithi173.stdout:7/998: readlink d1/d1d/d4c/d63/d13/d36/d49/la4 0 2024-02-16T22:19:28.753 INFO:tasks.workunit.client.1.smithi173.stdout:9/978: rename d1/d2/d129/d107/d115/fed to d1/d5f/d6d/d97/f145 0 2024-02-16T22:19:28.753 INFO:tasks.workunit.client.1.smithi173.stdout:9/979: truncate d1/d2/d10/f114 805541 0 2024-02-16T22:19:28.753 INFO:tasks.workunit.client.1.smithi173.stdout:9/980: chown d1/d2/da2 28 1 2024-02-16T22:19:28.754 INFO:tasks.workunit.client.1.smithi173.stdout:7/999: truncate d1/d1d/d4c/d63/d13/d22/d53/d27/f62 3145113 0 2024-02-16T22:19:28.754 INFO:tasks.workunit.client.1.smithi173.stdout:9/981: creat d1/d2/d1a/d1f/f146 x:0 0 0 2024-02-16T22:19:28.755 INFO:tasks.workunit.client.1.smithi173.stdout:9/982: write d1/d2/d1a/f109 [21591,27371] 0 2024-02-16T22:19:28.771 INFO:tasks.workunit.client.1.smithi173.stdout:9/983: dwrite d1/d2/d1a/d8b/f106 [0,4194304] 0 2024-02-16T22:19:28.771 INFO:tasks.workunit.client.1.smithi173.stdout:9/984: read - d1/d5f/fca zero size 2024-02-16T22:19:28.771 INFO:tasks.workunit.client.1.smithi173.stdout:9/985: read f0 [795684,75647] 0 2024-02-16T22:19:28.773 INFO:tasks.workunit.client.1.smithi173.stdout:9/986: mknod d1/d2/d1a/d2f/df4/d8c/d92/c147 0 2024-02-16T22:19:28.774 INFO:tasks.workunit.client.1.smithi173.stdout:9/987: mkdir d1/d5f/d6d/d91/d148 0 2024-02-16T22:19:28.775 INFO:tasks.workunit.client.1.smithi173.stdout:9/988: creat d1/d2/d1a/d2f/df4/d8c/d124/f149 x:0 0 0 2024-02-16T22:19:28.777 INFO:tasks.workunit.client.1.smithi173.stdout:9/989: mknod d1/d2/d1a/c14a 0 2024-02-16T22:19:28.779 INFO:tasks.workunit.client.1.smithi173.stdout:9/990: rename d1/f5a to d1/d5f/d6d/d91/d148/f14b 0 2024-02-16T22:19:28.787 INFO:tasks.workunit.client.1.smithi173.stdout:2/923: sync 2024-02-16T22:19:28.787 INFO:tasks.workunit.client.1.smithi173.stdout:2/924: getdents d2/dc/d19/d1c 0 2024-02-16T22:19:28.788 INFO:tasks.workunit.client.1.smithi173.stdout:9/991: write d1/d5f/d61/d80/f87 [743923,11378] 0 2024-02-16T22:19:28.788 INFO:tasks.workunit.client.1.smithi173.stdout:9/992: write d1/d2/d1a/d1f/f81 [113554,80097] 0 2024-02-16T22:19:29.008 INFO:tasks.workunit.client.1.smithi173.stdout:9/993: sync 2024-02-16T22:19:29.008 INFO:tasks.workunit.client.1.smithi173.stdout:2/925: sync 2024-02-16T22:19:29.009 INFO:tasks.workunit.client.1.smithi173.stdout:2/926: mknod d2/d4/d8/d30/c122 0 2024-02-16T22:19:29.009 INFO:tasks.workunit.client.1.smithi173.stdout:2/927: write d2/d10/f64 [153470,36547] 0 2024-02-16T22:19:29.009 INFO:tasks.workunit.client.1.smithi173.stdout:9/994: getdents d1/d2/d1a/d2f/d3b 0 2024-02-16T22:19:29.011 INFO:tasks.workunit.client.1.smithi173.stdout:2/928: mkdir d2/dc/d19/deb/d123 0 2024-02-16T22:19:29.011 INFO:tasks.workunit.client.1.smithi173.stdout:2/929: getdents d2/d4/d8/d30/d44/d81 0 2024-02-16T22:19:29.012 INFO:tasks.workunit.client.1.smithi173.stdout:2/930: creat d2/dc/d19/d1c/d113/f124 x:0 0 0 2024-02-16T22:19:29.014 INFO:tasks.workunit.client.1.smithi173.stdout:2/931: creat d2/d4/d8/d30/d4d/f125 x:0 0 0 2024-02-16T22:19:29.014 INFO:tasks.workunit.client.1.smithi173.stdout:2/932: write d2/d4/d8/d30/d4d/f125 [714079,18853] 0 2024-02-16T22:19:29.014 INFO:tasks.workunit.client.1.smithi173.stdout:2/933: chown d2/d4/d8/d2d/fba 908933460 1 2024-02-16T22:19:29.014 INFO:tasks.workunit.client.1.smithi173.stdout:2/934: readlink d2/dc/l5a 0 2024-02-16T22:19:29.017 INFO:tasks.workunit.client.1.smithi173.stdout:9/995: read d1/d2/d10/f3f [742971,24604] 0 2024-02-16T22:19:29.018 INFO:tasks.workunit.client.1.smithi173.stdout:9/996: dread - d1/d2/d1a/d2f/df4/f4e zero size 2024-02-16T22:19:29.019 INFO:tasks.workunit.client.1.smithi173.stdout:2/935: rename d2/d4/d8 to d2/d4/d126 0 2024-02-16T22:19:29.020 INFO:tasks.workunit.client.1.smithi173.stdout:9/997: rename d1/d5f/d6d/d97/f138 to d1/d5f/d6d/d112/f14c 0 2024-02-16T22:19:29.021 INFO:tasks.workunit.client.1.smithi173.stdout:2/936: creat d2/d4/d126/d2d/f127 x:0 0 0 2024-02-16T22:19:29.023 INFO:tasks.workunit.client.1.smithi173.stdout:2/937: rename d2/d4/d126/d2d/d10e/dff/l109 to d2/dc/d19/d1a/d74/db2/l128 0 2024-02-16T22:19:29.029 INFO:tasks.workunit.client.1.smithi173.stdout:2/938: dread d2/dc/d5d/f6a [4194304,4194304] 0 2024-02-16T22:19:29.046 INFO:tasks.workunit.client.1.smithi173.stdout:2/939: dwrite d2/dc/d19/d1a/d74/db2/ddc/fee [0,4194304] 0 2024-02-16T22:19:29.047 INFO:tasks.workunit.client.1.smithi173.stdout:2/940: chown d2/d4/c61 279 1 2024-02-16T22:19:29.071 INFO:tasks.workunit.client.1.smithi173.stdout:2/941: dwrite d2/d4/d126/d3a/de1/f105 [0,4194304] 0 2024-02-16T22:19:29.074 INFO:tasks.workunit.client.1.smithi173.stdout:2/942: creat d2/dc/d19/f129 x:0 0 0 2024-02-16T22:19:29.076 INFO:tasks.workunit.client.1.smithi173.stdout:2/943: rename d2/d4/d126/d30/d44/d81/cf8 to d2/dc/d19/d1c/d113/c12a 0 2024-02-16T22:19:29.077 INFO:tasks.workunit.client.1.smithi173.stdout:2/944: getdents d2/dc/d19/d69/da5/d115 0 2024-02-16T22:19:29.078 INFO:tasks.workunit.client.1.smithi173.stdout:2/945: creat d2/dc/d19/d1a/d74/db2/f12b x:0 0 0 2024-02-16T22:19:29.079 INFO:tasks.workunit.client.1.smithi173.stdout:2/946: creat d2/d4/d126/d30/daf/f12c x:0 0 0 2024-02-16T22:19:29.080 INFO:tasks.workunit.client.1.smithi173.stdout:2/947: symlink d2/dc/d19/d1a/d74/db2/ddc/l12d 0 2024-02-16T22:19:29.080 INFO:tasks.workunit.client.1.smithi173.stdout:2/948: rmdir d2/d4/d126/d80 39 2024-02-16T22:19:29.094 INFO:tasks.workunit.client.1.smithi173.stdout:2/949: dwrite d2/d4/d57/faa [0,4194304] 0 2024-02-16T22:19:29.105 INFO:tasks.workunit.client.1.smithi173.stdout:2/950: dread d2/dc/d19/f51 [0,4194304] 0 2024-02-16T22:19:29.106 INFO:tasks.workunit.client.1.smithi173.stdout:2/951: mkdir d2/dc/d19/d1a/d74/db2/ddc/d12e 0 2024-02-16T22:19:29.107 INFO:tasks.workunit.client.1.smithi173.stdout:2/952: mkdir d2/dc/d5d/d12f 0 2024-02-16T22:19:29.108 INFO:tasks.workunit.client.1.smithi173.stdout:2/953: symlink d2/dc/d19/d1a/d74/db2/ddc/l130 0 2024-02-16T22:19:29.108 INFO:tasks.workunit.client.1.smithi173.stdout:2/954: fsync d2/d4/d126/d30/daf/f11c 0 2024-02-16T22:19:29.109 INFO:tasks.workunit.client.1.smithi173.stdout:2/955: creat d2/dc/d19/d1a/d74/db2/ddc/d12e/f131 x:0 0 0 2024-02-16T22:19:29.109 INFO:tasks.workunit.client.1.smithi173.stdout:2/956: chown d2/dc/d19/dc4/fdd 75 1 2024-02-16T22:19:29.109 INFO:tasks.workunit.client.1.smithi173.stdout:2/957: chown d2/dc/d19/d1a/ld4 13300533 1 2024-02-16T22:19:29.109 INFO:tasks.workunit.client.1.smithi173.stdout:2/958: read d2/dc/d19/f51 [1795778,91498] 0 2024-02-16T22:19:29.109 INFO:tasks.workunit.client.1.smithi173.stdout:2/959: symlink d2/dc/d19/d1a/d74/db2/l132 0 2024-02-16T22:19:29.109 INFO:tasks.workunit.client.1.smithi173.stdout:2/960: write d2/dc/d19/d1a/d74/db2/dec/f106 [1705315,3620] 0 2024-02-16T22:19:29.116 INFO:tasks.workunit.client.1.smithi173.stdout:2/961: write d2/dc/f86 [1341880,40961] 0 2024-02-16T22:19:29.117 INFO:tasks.workunit.client.1.smithi173.stdout:2/962: link d2/d10/d62/lbf d2/d4/d126/d3a/de1/l133 0 2024-02-16T22:19:29.118 INFO:tasks.workunit.client.1.smithi173.stdout:2/963: mknod d2/dc/d19/da3/c134 0 2024-02-16T22:19:29.119 INFO:tasks.workunit.client.1.smithi173.stdout:2/964: symlink d2/d4/d126/d30/d44/d81/d99/dda/l135 0 2024-02-16T22:19:29.120 INFO:tasks.workunit.client.1.smithi173.stdout:2/965: rmdir d2/d4/d110 0 2024-02-16T22:19:29.121 INFO:tasks.workunit.client.1.smithi173.stdout:2/966: mkdir d2/d10/d136 0 2024-02-16T22:19:29.121 INFO:tasks.workunit.client.1.smithi173.stdout:2/967: fsync d2/d10/d62/d6c/ffa 0 2024-02-16T22:19:29.121 INFO:tasks.workunit.client.1.smithi173.stdout:2/968: truncate d2/dc/d19/d1a/d74/db2/f12b 78944 0 2024-02-16T22:19:29.121 INFO:tasks.workunit.client.1.smithi173.stdout:2/969: fdatasync d2/d4/d126/d30/f37 0 2024-02-16T22:19:29.130 INFO:tasks.workunit.client.1.smithi173.stdout:2/970: dread d2/dc/d19/d1a/f34 [0,4194304] 0 2024-02-16T22:19:29.140 INFO:tasks.workunit.client.1.smithi173.stdout:2/971: write d2/d4/d126/d3a/de1/f105 [3029438,41470] 0 2024-02-16T22:19:29.140 INFO:tasks.workunit.client.1.smithi173.stdout:2/972: chown d2/dc 0 1 2024-02-16T22:19:29.145 INFO:tasks.workunit.client.1.smithi173.stdout:2/973: write d2/d4/f70 [2484358,96503] 0 2024-02-16T22:19:29.146 INFO:tasks.workunit.client.1.smithi173.stdout:2/974: dread - d2/d4/d126/d80/fce zero size 2024-02-16T22:19:29.146 INFO:tasks.workunit.client.1.smithi173.stdout:2/975: rmdir d2/d4/d57/d82/ded 39 2024-02-16T22:19:29.146 INFO:tasks.workunit.client.1.smithi173.stdout:2/976: truncate d2/dc/d19/d1a/f3f 3146611 0 2024-02-16T22:19:29.147 INFO:tasks.workunit.client.1.smithi173.stdout:2/977: creat d2/f137 x:0 0 0 2024-02-16T22:19:29.148 INFO:tasks.workunit.client.1.smithi173.stdout:2/978: unlink d2/dc/d19/d1a/d74/db2/f12b 0 2024-02-16T22:19:29.149 INFO:tasks.workunit.client.1.smithi173.stdout:2/979: creat d2/d4/d126/d30/d44/d83/f138 x:0 0 0 2024-02-16T22:19:29.277 INFO:tasks.workunit.client.1.smithi173.stdout:9/998: sync 2024-02-16T22:19:29.278 INFO:tasks.workunit.client.1.smithi173.stdout:9/999: write d1/d2/d1a/f26 [5024243,76144] 0 2024-02-16T22:19:29.318 INFO:tasks.workunit.client.1.smithi173.stdout:2/980: sync 2024-02-16T22:19:29.319 INFO:tasks.workunit.client.1.smithi173.stdout:2/981: write d2/d4/f70 [2121599,51901] 0 2024-02-16T22:19:29.319 INFO:tasks.workunit.client.1.smithi173.stdout:2/982: fdatasync d2/d4/d126/d2d/f8b 0 2024-02-16T22:19:29.342 INFO:tasks.workunit.client.1.smithi173.stdout:2/983: dwrite d2/d4/d57/d82/fd5 [0,4194304] 0 2024-02-16T22:19:29.342 INFO:tasks.workunit.client.1.smithi173.stdout:2/984: truncate d2/d4/d126/d30/d44/d83/f94 499523 0 2024-02-16T22:19:29.345 INFO:tasks.workunit.client.1.smithi173.stdout:2/985: unlink d2/d4/d126/d2d/f8b 0 2024-02-16T22:19:29.346 INFO:tasks.workunit.client.1.smithi173.stdout:2/986: mknod d2/dc/d19/da3/c139 0 2024-02-16T22:19:29.347 INFO:tasks.workunit.client.1.smithi173.stdout:2/987: rename d2/dc/d19/d69/da5 to d2/dc/d19/da3/da4/d13a 0 2024-02-16T22:19:29.348 INFO:tasks.workunit.client.1.smithi173.stdout:2/988: mknod d2/d4/d126/d30/d44/c13b 0 2024-02-16T22:19:29.348 INFO:tasks.workunit.client.1.smithi173.stdout:2/989: chown d2/dc 15648 1 2024-02-16T22:19:29.350 INFO:tasks.workunit.client.1.smithi173.stdout:2/990: dread d2/d4/d126/d30/d4d/f125 [0,4194304] 0 2024-02-16T22:19:29.352 INFO:tasks.workunit.client.1.smithi173.stdout:2/991: creat d2/dc/d19/da3/da4/f13c x:0 0 0 2024-02-16T22:19:29.356 INFO:tasks.workunit.client.1.smithi173.stdout:2/992: dread d2/d4/d126/d30/d44/f71 [0,4194304] 0 2024-02-16T22:19:29.356 INFO:tasks.workunit.client.1.smithi173.stdout:2/993: stat d2/dc/d19/f60 0 2024-02-16T22:19:29.357 INFO:tasks.workunit.client.1.smithi173.stdout:2/994: mkdir d2/d4/d126/d30/daf/d13d 0 2024-02-16T22:19:29.359 INFO:tasks.workunit.client.1.smithi173.stdout:2/995: rename d2/dc/d19/d1c/d113/f8d to d2/dc/d19/d1a/d74/db2/ddc/d12e/f13e 0 2024-02-16T22:19:29.359 INFO:tasks.workunit.client.1.smithi173.stdout:2/996: truncate d2/dc/d19/d1a/fc5 2287931 0 2024-02-16T22:19:29.361 INFO:tasks.workunit.client.1.smithi173.stdout:2/997: creat d2/dc/d19/d1a/f13f x:0 0 0 2024-02-16T22:19:29.362 INFO:tasks.workunit.client.1.smithi173.stdout:2/998: symlink d2/d4/d57/d82/ded/l140 0 2024-02-16T22:19:29.362 INFO:tasks.workunit.client.1.smithi173.stdout:2/999: write d2/d4/d126/d30/daf/f11c [285817,76336] 0 2024-02-16T22:19:29.367 INFO:tasks.workunit.client.1.smithi173.stderr:+ rm -rf -- ./tmp.GEfnZhx8qB 2024-02-16T22:19:29.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:29 smithi134 ceph-mon[28869]: pgmap v6: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail 2024-02-16T22:19:29.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:29 smithi173 ceph-mon[37280]: pgmap v6: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail 2024-02-16T22:19:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:31 smithi134 ceph-mon[28869]: pgmap v7: 65 pgs: 65 active+clean; 2.3 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 43 MiB/s rd, 48 MiB/s wr, 207 op/s 2024-02-16T22:19:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:31 smithi134 ceph-mon[28869]: Standby manager daemon smithi134.ordace started 2024-02-16T22:19:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:31 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.134:0/2964258932' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.ordace/crt"}]: dispatch 2024-02-16T22:19:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:31 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.134:0/2964258932' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-16T22:19:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:31 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.134:0/2964258932' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.ordace/key"}]: dispatch 2024-02-16T22:19:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:31 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.134:0/2964258932' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-16T22:19:31.435 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:31 smithi173 ceph-mon[37280]: pgmap v7: 65 pgs: 65 active+clean; 2.3 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 43 MiB/s rd, 48 MiB/s wr, 207 op/s 2024-02-16T22:19:31.435 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:31 smithi173 ceph-mon[37280]: Standby manager daemon smithi134.ordace started 2024-02-16T22:19:31.435 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:31 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.134:0/2964258932' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.ordace/crt"}]: dispatch 2024-02-16T22:19:31.435 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:31 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.134:0/2964258932' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-16T22:19:31.435 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:31 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.134:0/2964258932' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.ordace/key"}]: dispatch 2024-02-16T22:19:31.436 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:31 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.134:0/2964258932' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-16T22:19:32.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:32 smithi134 ceph-mon[28869]: mgrmap e24: smithi173.kbofaa(active, since 9s), standbys: smithi134.ordace 2024-02-16T22:19:32.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:32 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mgr metadata", "who": "smithi134.ordace", "id": "smithi134.ordace"}]: dispatch 2024-02-16T22:19:32.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:32 smithi173 ceph-mon[37280]: mgrmap e24: smithi173.kbofaa(active, since 9s), standbys: smithi134.ordace 2024-02-16T22:19:32.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:32 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mgr metadata", "who": "smithi134.ordace", "id": "smithi134.ordace"}]: dispatch 2024-02-16T22:19:33.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:33 smithi134 ceph-mon[28869]: pgmap v8: 65 pgs: 65 active+clean; 2.3 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 33 MiB/s rd, 37 MiB/s wr, 161 op/s 2024-02-16T22:19:33.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:33 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:33.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:33 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:33.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:33 smithi173 ceph-mon[37280]: pgmap v8: 65 pgs: 65 active+clean; 2.3 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 33 MiB/s rd, 37 MiB/s wr, 161 op/s 2024-02-16T22:19:33.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:33 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:33.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:33 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:34.623 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:34 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:34.623 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:34 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:34.623 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:34 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:34.623 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:34 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:34.623 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:34 smithi173 ceph-mon[37280]: pgmap v9: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 30 MiB/s rd, 34 MiB/s wr, 298 op/s 2024-02-16T22:19:34.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:34 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:34.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:34 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:34.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:34 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:34.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:34 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:34.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:34 smithi134 ceph-mon[28869]: pgmap v9: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 30 MiB/s rd, 34 MiB/s wr, 298 op/s 2024-02-16T22:19:36.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:36 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:36.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:36 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:36.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:36 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:36.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:36 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:36.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:36 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:36.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:36 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:36.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:36 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:36.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:36 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:36.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:36 smithi173 ceph-mon[37280]: Adjusting osd_memory_target on smithi134 to 1557M 2024-02-16T22:19:36.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:36 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:36.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:36 smithi173 ceph-mon[37280]: pgmap v10: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 27 MiB/s rd, 31 MiB/s wr, 271 op/s 2024-02-16T22:19:36.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:36 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:36.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:36 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:36.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:36 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:36.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:36 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:36.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:36 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:36.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:36 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:36.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:36 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:36.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:36 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:36.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:36 smithi134 ceph-mon[28869]: Adjusting osd_memory_target on smithi134 to 1557M 2024-02-16T22:19:36.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:36 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:36.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:36 smithi134 ceph-mon[28869]: pgmap v10: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 27 MiB/s rd, 31 MiB/s wr, 271 op/s 2024-02-16T22:19:37.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.997+0000 7fb27ea41700 1 -- 172.21.15.134:0/2896886101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2780fcfb0 msgr2=0x7fb2780fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:37.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.997+0000 7fb27ea41700 1 --2- 172.21.15.134:0/2896886101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2780fcfb0 0x7fb2780fd420 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb26c004940 tx=0x7fb26c009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:37.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.997+0000 7fb27ea41700 1 -- 172.21.15.134:0/2896886101 shutdown_connections 2024-02-16T22:19:37.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.997+0000 7fb27ea41700 1 --2- 172.21.15.134:0/2896886101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2780fcfb0 0x7fb2780fd420 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.997+0000 7fb27ea41700 1 --2- 172.21.15.134:0/2896886101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2780fbe40 0x7fb2780fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.997+0000 7fb27ea41700 1 -- 172.21.15.134:0/2896886101 >> 172.21.15.134:0/2896886101 conn(0x7fb2780f74e0 msgr2=0x7fb2780f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:37.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.998+0000 7fb27ea41700 1 -- 172.21.15.134:0/2896886101 shutdown_connections 2024-02-16T22:19:37.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.998+0000 7fb27ea41700 1 -- 172.21.15.134:0/2896886101 wait complete. 2024-02-16T22:19:37.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.998+0000 7fb27ea41700 1 Processor -- start 2024-02-16T22:19:37.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.998+0000 7fb27ea41700 1 -- start start 2024-02-16T22:19:37.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.998+0000 7fb27ea41700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2780fbe40 0x7fb27810fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:37.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.998+0000 7fb27ea41700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2780fcfb0 0x7fb27810fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:37.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.998+0000 7fb27ea41700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2781105f0 con 0x7fb2780fcfb0 2024-02-16T22:19:37.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.998+0000 7fb27ea41700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb278110e90 con 0x7fb2780fbe40 2024-02-16T22:19:37.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.999+0000 7fb2777fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2780fcfb0 0x7fb27810fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:37.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.999+0000 7fb2777fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2780fcfb0 0x7fb27810fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57132/0 (socket says 172.21.15.134:57132) 2024-02-16T22:19:37.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.999+0000 7fb2777fe700 1 -- 172.21.15.134:0/3047668665 learned_addr learned my addr 172.21.15.134:0/3047668665 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:19:37.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.999+0000 7fb277fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2780fbe40 0x7fb27810fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:37.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.999+0000 7fb277fff700 1 -- 172.21.15.134:0/3047668665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2780fcfb0 msgr2=0x7fb27810fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:37.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.999+0000 7fb277fff700 1 --2- 172.21.15.134:0/3047668665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2780fcfb0 0x7fb27810fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.999+0000 7fb277fff700 1 -- 172.21.15.134:0/3047668665 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c005040 con 0x7fb2780fbe40 2024-02-16T22:19:37.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.999+0000 7fb277fff700 1 --2- 172.21.15.134:0/3047668665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2780fbe40 0x7fb27810fab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb268009fd0 tx=0x7fb26800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:37.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.999+0000 7fb274ff9700 1 -- 172.21.15.134:0/3047668665 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb268004e90 con 0x7fb2780fbe40 2024-02-16T22:19:37.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.999+0000 7fb27ea41700 1 -- 172.21.15.134:0/3047668665 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb278111110 con 0x7fb2780fbe40 2024-02-16T22:19:37.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.999+0000 7fb274ff9700 1 -- 172.21.15.134:0/3047668665 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb26800f040 con 0x7fb2780fbe40 2024-02-16T22:19:37.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:36.999+0000 7fb274ff9700 1 -- 172.21.15.134:0/3047668665 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb26800c9b0 con 0x7fb2780fbe40 2024-02-16T22:19:37.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.000+0000 7fb27ea41700 1 -- 172.21.15.134:0/3047668665 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb278111590 con 0x7fb2780fbe40 2024-02-16T22:19:37.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.000+0000 7fb27ea41700 1 -- 172.21.15.134:0/3047668665 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27804bed0 con 0x7fb2780fbe40 2024-02-16T22:19:37.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.001+0000 7fb274ff9700 1 -- 172.21.15.134:0/3047668665 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7fb268007cc0 con 0x7fb2780fbe40 2024-02-16T22:19:37.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.001+0000 7fb274ff9700 1 --2- 172.21.15.134:0/3047668665 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fb26006b2e0 0x7fb26006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:37.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.002+0000 7fb274ff9700 1 -- 172.21.15.134:0/3047668665 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb2680897d0 con 0x7fb2780fbe40 2024-02-16T22:19:37.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.002+0000 7fb2777fe700 1 --2- 172.21.15.134:0/3047668665 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fb26006b2e0 0x7fb26006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:37.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.002+0000 7fb2777fe700 1 --2- 172.21.15.134:0/3047668665 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fb26006b2e0 0x7fb26006d790 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00b0d0 tx=0x7fb26c009e30 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:37.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.006+0000 7fb274ff9700 1 -- 172.21.15.134:0/3047668665 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb26804f620 con 0x7fb2780fbe40 2024-02-16T22:19:37.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.284+0000 7fb27ea41700 1 -- 172.21.15.134:0/3047668665 --> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb278111cd0 con 0x7fb26006b2e0 2024-02-16T22:19:37.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.286+0000 7fb274ff9700 1 -- 172.21.15.134:0/3047668665 <== mgr.24371 v2:172.21.15.173:6828/2126919483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb278111cd0 con 0x7fb26006b2e0 2024-02-16T22:19:37.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.288+0000 7fb27ea41700 1 -- 172.21.15.134:0/3047668665 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fb26006b2e0 msgr2=0x7fb26006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:37.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.288+0000 7fb27ea41700 1 --2- 172.21.15.134:0/3047668665 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fb26006b2e0 0x7fb26006d790 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00b0d0 tx=0x7fb26c009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:37.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.288+0000 7fb27ea41700 1 -- 172.21.15.134:0/3047668665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2780fbe40 msgr2=0x7fb27810fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:37.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.288+0000 7fb27ea41700 1 --2- 172.21.15.134:0/3047668665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2780fbe40 0x7fb27810fab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb268009fd0 tx=0x7fb26800b040 comp rx=0 tx=0).stop 2024-02-16T22:19:37.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.288+0000 7fb27ea41700 1 -- 172.21.15.134:0/3047668665 shutdown_connections 2024-02-16T22:19:37.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.288+0000 7fb27ea41700 1 --2- 172.21.15.134:0/3047668665 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fb26006b2e0 0x7fb26006d790 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.288+0000 7fb27ea41700 1 --2- 172.21.15.134:0/3047668665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2780fbe40 0x7fb27810fab0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.288+0000 7fb27ea41700 1 --2- 172.21.15.134:0/3047668665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2780fcfb0 0x7fb27810fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.288+0000 7fb27ea41700 1 -- 172.21.15.134:0/3047668665 >> 172.21.15.134:0/3047668665 conn(0x7fb2780f74e0 msgr2=0x7fb2780656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:37.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.288+0000 7fb27ea41700 1 -- 172.21.15.134:0/3047668665 shutdown_connections 2024-02-16T22:19:37.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.288+0000 7fb27ea41700 1 -- 172.21.15.134:0/3047668665 wait complete. 2024-02-16T22:19:37.303 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:19:37.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.410+0000 7ff65ee53700 1 -- 172.21.15.134:0/658410413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6580fcef0 msgr2=0x7ff6580fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:37.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.410+0000 7ff65ee53700 1 --2- 172.21.15.134:0/658410413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6580fcef0 0x7ff6580fd320 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff64c004940 tx=0x7ff64c009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:37.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.410+0000 7ff65ee53700 1 -- 172.21.15.134:0/658410413 shutdown_connections 2024-02-16T22:19:37.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.410+0000 7ff65ee53700 1 --2- 172.21.15.134:0/658410413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6580fe0e0 0x7ff6580fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.410+0000 7ff65ee53700 1 --2- 172.21.15.134:0/658410413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6580fcef0 0x7ff6580fd320 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.410+0000 7ff65ee53700 1 -- 172.21.15.134:0/658410413 >> 172.21.15.134:0/658410413 conn(0x7ff6580f8620 msgr2=0x7ff6580faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:37.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.410+0000 7ff65ee53700 1 -- 172.21.15.134:0/658410413 shutdown_connections 2024-02-16T22:19:37.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.410+0000 7ff65ee53700 1 -- 172.21.15.134:0/658410413 wait complete. 2024-02-16T22:19:37.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.411+0000 7ff65ee53700 1 Processor -- start 2024-02-16T22:19:37.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.411+0000 7ff65ee53700 1 -- start start 2024-02-16T22:19:37.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.411+0000 7ff65ee53700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6580fcef0 0x7ff65810d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:37.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.411+0000 7ff65ee53700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6580fe0e0 0x7ff65810de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:37.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.411+0000 7ff65ee53700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65810e420 con 0x7ff6580fe0e0 2024-02-16T22:19:37.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.411+0000 7ff65ee53700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65810ecc0 con 0x7ff6580fcef0 2024-02-16T22:19:37.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.411+0000 7ff657fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6580fe0e0 0x7ff65810de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:37.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.411+0000 7ff65cbef700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6580fcef0 0x7ff65810d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:37.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.411+0000 7ff657fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6580fe0e0 0x7ff65810de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57152/0 (socket says 172.21.15.134:57152) 2024-02-16T22:19:37.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.411+0000 7ff657fff700 1 -- 172.21.15.134:0/1493310045 learned_addr learned my addr 172.21.15.134:0/1493310045 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:19:37.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.412+0000 7ff657fff700 1 -- 172.21.15.134:0/1493310045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6580fcef0 msgr2=0x7ff65810d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:37.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.412+0000 7ff657fff700 1 --2- 172.21.15.134:0/1493310045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6580fcef0 0x7ff65810d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.412+0000 7ff657fff700 1 -- 172.21.15.134:0/1493310045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c005040 con 0x7ff6580fe0e0 2024-02-16T22:19:37.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.412+0000 7ff657fff700 1 --2- 172.21.15.134:0/1493310045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6580fe0e0 0x7ff65810de20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff64400eb40 tx=0x7ff64400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:37.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.412+0000 7ff6557fa700 1 -- 172.21.15.134:0/1493310045 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff644007cc0 con 0x7ff6580fe0e0 2024-02-16T22:19:37.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.412+0000 7ff6557fa700 1 -- 172.21.15.134:0/1493310045 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff64400f040 con 0x7ff6580fe0e0 2024-02-16T22:19:37.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.412+0000 7ff65ee53700 1 -- 172.21.15.134:0/1493310045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65810ef40 con 0x7ff6580fe0e0 2024-02-16T22:19:37.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.412+0000 7ff6557fa700 1 -- 172.21.15.134:0/1493310045 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff64400ca10 con 0x7ff6580fe0e0 2024-02-16T22:19:37.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.412+0000 7ff65ee53700 1 -- 172.21.15.134:0/1493310045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65810f480 con 0x7ff6580fe0e0 2024-02-16T22:19:37.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.413+0000 7ff65ee53700 1 -- 172.21.15.134:0/1493310045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65804bed0 con 0x7ff6580fe0e0 2024-02-16T22:19:37.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.414+0000 7ff6557fa700 1 -- 172.21.15.134:0/1493310045 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7ff64400cb70 con 0x7ff6580fe0e0 2024-02-16T22:19:37.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.414+0000 7ff6557fa700 1 --2- 172.21.15.134:0/1493310045 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7ff64806b2e0 0x7ff64806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:37.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.414+0000 7ff6557fa700 1 -- 172.21.15.134:0/1493310045 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff644089920 con 0x7ff6580fe0e0 2024-02-16T22:19:37.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.414+0000 7ff65cbef700 1 --2- 172.21.15.134:0/1493310045 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7ff64806b2e0 0x7ff64806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:37.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.415+0000 7ff65cbef700 1 --2- 172.21.15.134:0/1493310045 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7ff64806b2e0 0x7ff64806d790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff64c000c00 tx=0x7ff64c009e30 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:37.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.420+0000 7ff6557fa700 1 -- 172.21.15.134:0/1493310045 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7ff64404f620 con 0x7ff6580fe0e0 2024-02-16T22:19:37.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:37 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:19:37.730 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:37 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:19:37.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.734+0000 7ff65ee53700 1 -- 172.21.15.134:0/1493310045 --> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff65810f920 con 0x7ff64806b2e0 2024-02-16T22:19:37.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.735+0000 7ff6557fa700 1 -- 172.21.15.134:0/1493310045 <== mgr.24371 v2:172.21.15.173:6828/2126919483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7ff65810f920 con 0x7ff64806b2e0 2024-02-16T22:19:37.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.738+0000 7ff65ee53700 1 -- 172.21.15.134:0/1493310045 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7ff64806b2e0 msgr2=0x7ff64806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:37.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.738+0000 7ff65ee53700 1 --2- 172.21.15.134:0/1493310045 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7ff64806b2e0 0x7ff64806d790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff64c000c00 tx=0x7ff64c009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:37.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.738+0000 7ff65ee53700 1 -- 172.21.15.134:0/1493310045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6580fe0e0 msgr2=0x7ff65810de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:37.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.738+0000 7ff65ee53700 1 --2- 172.21.15.134:0/1493310045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6580fe0e0 0x7ff65810de20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff64400eb40 tx=0x7ff64400b040 comp rx=0 tx=0).stop 2024-02-16T22:19:37.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.738+0000 7ff65ee53700 1 -- 172.21.15.134:0/1493310045 shutdown_connections 2024-02-16T22:19:37.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.738+0000 7ff65ee53700 1 --2- 172.21.15.134:0/1493310045 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7ff64806b2e0 0x7ff64806d790 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.738+0000 7ff65ee53700 1 --2- 172.21.15.134:0/1493310045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6580fcef0 0x7ff65810d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.738+0000 7ff65ee53700 1 --2- 172.21.15.134:0/1493310045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6580fe0e0 0x7ff65810de20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.738+0000 7ff65ee53700 1 -- 172.21.15.134:0/1493310045 >> 172.21.15.134:0/1493310045 conn(0x7ff6580f8620 msgr2=0x7ff6581013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:37.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.738+0000 7ff65ee53700 1 -- 172.21.15.134:0/1493310045 shutdown_connections 2024-02-16T22:19:37.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.738+0000 7ff65ee53700 1 -- 172.21.15.134:0/1493310045 wait complete. 2024-02-16T22:19:37.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.873+0000 7f7afd811700 1 -- 172.21.15.134:0/4276037101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af806ee00 msgr2=0x7f7af806f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:37.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.873+0000 7f7afd811700 1 --2- 172.21.15.134:0/4276037101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af806ee00 0x7f7af806f270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0004940 tx=0x7f7ae0009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:37.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.873+0000 7f7afd811700 1 -- 172.21.15.134:0/4276037101 shutdown_connections 2024-02-16T22:19:37.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.873+0000 7f7afd811700 1 --2- 172.21.15.134:0/4276037101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af806ee00 0x7f7af806f270 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.873+0000 7f7afd811700 1 --2- 172.21.15.134:0/4276037101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7af8104f90 0x7f7af8107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.873+0000 7f7afd811700 1 -- 172.21.15.134:0/4276037101 >> 172.21.15.134:0/4276037101 conn(0x7f7af806a2c0 msgr2=0x7f7af806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:37.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.874+0000 7f7afd811700 1 -- 172.21.15.134:0/4276037101 shutdown_connections 2024-02-16T22:19:37.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.874+0000 7f7afd811700 1 -- 172.21.15.134:0/4276037101 wait complete. 2024-02-16T22:19:37.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.874+0000 7f7afd811700 1 Processor -- start 2024-02-16T22:19:37.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.874+0000 7f7afd811700 1 -- start start 2024-02-16T22:19:37.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.875+0000 7f7afd811700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af806ee00 0x7f7af810eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:37.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.875+0000 7f7afd811700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7af8104f90 0x7f7af810f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:37.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.875+0000 7f7afd811700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af810fa60 con 0x7f7af8104f90 2024-02-16T22:19:37.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.875+0000 7f7afd811700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af8110300 con 0x7f7af806ee00 2024-02-16T22:19:37.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.875+0000 7f7af6ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af806ee00 0x7f7af810eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:37.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.875+0000 7f7af6ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af806ee00 0x7f7af810eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.134:36972/0 (socket says 172.21.15.134:36972) 2024-02-16T22:19:37.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.875+0000 7f7af6ffd700 1 -- 172.21.15.134:0/235306048 learned_addr learned my addr 172.21.15.134:0/235306048 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:19:37.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.875+0000 7f7aeffff700 1 --2- 172.21.15.134:0/235306048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7af8104f90 0x7f7af810f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:37.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.876+0000 7f7af6ffd700 1 -- 172.21.15.134:0/235306048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7af8104f90 msgr2=0x7f7af810f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:37.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.876+0000 7f7af6ffd700 1 --2- 172.21.15.134:0/235306048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7af8104f90 0x7f7af810f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:37.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.876+0000 7f7af6ffd700 1 -- 172.21.15.134:0/235306048 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae0005040 con 0x7f7af806ee00 2024-02-16T22:19:37.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.876+0000 7f7af6ffd700 1 --2- 172.21.15.134:0/235306048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af806ee00 0x7f7af810eed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800eb40 tx=0x7f7ae800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:37.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.877+0000 7f7aef7fe700 1 -- 172.21.15.134:0/235306048 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae8007cc0 con 0x7f7af806ee00 2024-02-16T22:19:37.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.877+0000 7f7afd811700 1 -- 172.21.15.134:0/235306048 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af8110580 con 0x7f7af806ee00 2024-02-16T22:19:37.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.877+0000 7f7afd811700 1 -- 172.21.15.134:0/235306048 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af8110a00 con 0x7f7af806ee00 2024-02-16T22:19:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.877+0000 7f7aef7fe700 1 -- 172.21.15.134:0/235306048 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ae800f040 con 0x7f7af806ee00 2024-02-16T22:19:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.877+0000 7f7aef7fe700 1 -- 172.21.15.134:0/235306048 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae800cad0 con 0x7f7af806ee00 2024-02-16T22:19:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.878+0000 7f7afd811700 1 -- 172.21.15.134:0/235306048 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad80052e0 con 0x7f7af806ee00 2024-02-16T22:19:37.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.879+0000 7f7aef7fe700 1 -- 172.21.15.134:0/235306048 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f7ae800cc30 con 0x7f7af806ee00 2024-02-16T22:19:37.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.879+0000 7f7aef7fe700 1 --2- 172.21.15.134:0/235306048 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f7ae406b470 0x7f7ae406d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:37.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.879+0000 7f7aef7fe700 1 -- 172.21.15.134:0/235306048 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7ae8089780 con 0x7f7af806ee00 2024-02-16T22:19:37.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.880+0000 7f7aeffff700 1 --2- 172.21.15.134:0/235306048 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f7ae406b470 0x7f7ae406d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:37.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.881+0000 7f7aeffff700 1 --2- 172.21.15.134:0/235306048 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f7ae406b470 0x7f7ae406d920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0013740 tx=0x7f7ae0009e30 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:37.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:37.888+0000 7f7aef7fe700 1 -- 172.21.15.134:0/235306048 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f7ae804f620 con 0x7f7af806ee00 2024-02-16T22:19:38.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.201+0000 7f7afd811700 1 -- 172.21.15.134:0/235306048 --> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ad8000bf0 con 0x7f7ae406b470 2024-02-16T22:19:38.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.214+0000 7f7aef7fe700 1 -- 172.21.15.134:0/235306048 <== mgr.24371 v2:172.21.15.173:6828/2126919483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7ad8000bf0 con 0x7f7ae406b470 2024-02-16T22:19:38.217 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:19:38.217 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (7m) 4s ago 8m 24.6M - 0.25.0 c8568f914cd2 62f86e3efbe2 2024-02-16T22:19:38.217 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (8m) 4s ago 8m 6660k - 17.2.7-513-gb88fae66 870a0944ccb8 a0d53bc0a925 2024-02-16T22:19:38.217 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (7m) 6s ago 7m 6669k - 17.2.7-513-gb88fae66 870a0944ccb8 a8d69537e08a 2024-02-16T22:19:38.217 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (7m) 4s ago 8m 86.5M - 9.4.7 954c08fa6188 67572f26488e 2024-02-16T22:19:38.217 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (3m) 4s ago 3m 11.7M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:19:38.217 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (2m) 4s ago 2m 160M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:19:38.217 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (2m) 6s ago 2m 14.9M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:19:38.217 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (2m) 6s ago 2m 193M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:19:38.218 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:9283 running (10m) 4s ago 10m 393M - 17.2.7-513-gb88fae66 870a0944ccb8 52095085178d 2024-02-16T22:19:38.218 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283 running (62s) 6s ago 7m 487M - 19.0.0-1450-gf78a58c0 f081f847070a 9d4cb8c4184e 2024-02-16T22:19:38.218 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (10m) 4s ago 10m 48.4M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 93a679740d93 2024-02-16T22:19:38.218 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (7m) 6s ago 7m 36.6M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 cfbef35950ef 2024-02-16T22:19:38.218 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (8m) 4s ago 8m 15.9M - 1.5.0 0da6a335fe13 7e7604241558 2024-02-16T22:19:38.218 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (7m) 6s ago 7m 15.3M - 1.5.0 0da6a335fe13 cddf6bc3c421 2024-02-16T22:19:38.218 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (6m) 4s ago 6m 232M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 099f0b29d202 2024-02-16T22:19:38.218 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (6m) 4s ago 6m 245M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:19:38.218 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (5m) 4s ago 5m 200M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:19:38.218 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (5m) 6s ago 5m 282M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:19:38.218 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (4m) 6s ago 4m 227M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:19:38.218 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (4m) 6s ago 4m 297M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:19:38.218 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (6m) 4s ago 8m 56.5M - 2.43.0 a07b618ecd1d 37e529bd9229 2024-02-16T22:19:38.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.216+0000 7f7afd811700 1 -- 172.21.15.134:0/235306048 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f7ae406b470 msgr2=0x7f7ae406d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:38.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.216+0000 7f7afd811700 1 --2- 172.21.15.134:0/235306048 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f7ae406b470 0x7f7ae406d920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0013740 tx=0x7f7ae0009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:38.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.216+0000 7f7afd811700 1 -- 172.21.15.134:0/235306048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af806ee00 msgr2=0x7f7af810eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:38.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.216+0000 7f7afd811700 1 --2- 172.21.15.134:0/235306048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af806ee00 0x7f7af810eed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800eb40 tx=0x7f7ae800b040 comp rx=0 tx=0).stop 2024-02-16T22:19:38.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.216+0000 7f7afd811700 1 -- 172.21.15.134:0/235306048 shutdown_connections 2024-02-16T22:19:38.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.216+0000 7f7afd811700 1 --2- 172.21.15.134:0/235306048 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f7ae406b470 0x7f7ae406d920 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:38.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.216+0000 7f7afd811700 1 --2- 172.21.15.134:0/235306048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af806ee00 0x7f7af810eed0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:38.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.216+0000 7f7afd811700 1 --2- 172.21.15.134:0/235306048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7af8104f90 0x7f7af810f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:38.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.216+0000 7f7afd811700 1 -- 172.21.15.134:0/235306048 >> 172.21.15.134:0/235306048 conn(0x7f7af806a2c0 msgr2=0x7f7af806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:38.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.217+0000 7f7afd811700 1 -- 172.21.15.134:0/235306048 shutdown_connections 2024-02-16T22:19:38.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.217+0000 7f7afd811700 1 -- 172.21.15.134:0/235306048 wait complete. 2024-02-16T22:19:38.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.340+0000 7fcc524c1700 1 -- 172.21.15.134:0/3806974155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc4c0fbe40 msgr2=0x7fcc4c0fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:38.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.340+0000 7fcc524c1700 1 --2- 172.21.15.134:0/3806974155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc4c0fbe40 0x7fcc4c0fc250 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c004940 tx=0x7fcc3c009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:38.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.340+0000 7fcc524c1700 1 -- 172.21.15.134:0/3806974155 shutdown_connections 2024-02-16T22:19:38.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.340+0000 7fcc524c1700 1 --2- 172.21.15.134:0/3806974155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc4c0fcfb0 0x7fcc4c0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:38.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.340+0000 7fcc524c1700 1 --2- 172.21.15.134:0/3806974155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc4c0fbe40 0x7fcc4c0fc250 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:38.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.340+0000 7fcc524c1700 1 -- 172.21.15.134:0/3806974155 >> 172.21.15.134:0/3806974155 conn(0x7fcc4c0f7500 msgr2=0x7fcc4c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:38.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.340+0000 7fcc524c1700 1 -- 172.21.15.134:0/3806974155 shutdown_connections 2024-02-16T22:19:38.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.340+0000 7fcc524c1700 1 -- 172.21.15.134:0/3806974155 wait complete. 2024-02-16T22:19:38.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.341+0000 7fcc524c1700 1 Processor -- start 2024-02-16T22:19:38.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.341+0000 7fcc524c1700 1 -- start start 2024-02-16T22:19:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.341+0000 7fcc524c1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc4c0fbe40 0x7fcc4c10c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.341+0000 7fcc524c1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc4c0fcfb0 0x7fcc4c10cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.341+0000 7fcc524c1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c10d380 con 0x7fcc4c0fcfb0 2024-02-16T22:19:38.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.341+0000 7fcc524c1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c10dc20 con 0x7fcc4c0fbe40 2024-02-16T22:19:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.341+0000 7fcc4b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc4c0fcfb0 0x7fcc4c10cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.341+0000 7fcc4b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc4c0fcfb0 0x7fcc4c10cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57182/0 (socket says 172.21.15.134:57182) 2024-02-16T22:19:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.341+0000 7fcc4b7fe700 1 -- 172.21.15.134:0/1476829036 learned_addr learned my addr 172.21.15.134:0/1476829036 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:19:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.341+0000 7fcc4bfff700 1 --2- 172.21.15.134:0/1476829036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc4c0fbe40 0x7fcc4c10c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.342+0000 7fcc4b7fe700 1 -- 172.21.15.134:0/1476829036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc4c0fbe40 msgr2=0x7fcc4c10c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.342+0000 7fcc4b7fe700 1 --2- 172.21.15.134:0/1476829036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc4c0fbe40 0x7fcc4c10c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.342+0000 7fcc4b7fe700 1 -- 172.21.15.134:0/1476829036 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c005040 con 0x7fcc4c0fcfb0 2024-02-16T22:19:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.342+0000 7fcc4b7fe700 1 --2- 172.21.15.134:0/1476829036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc4c0fcfb0 0x7fcc4c10cd80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcc40002a50 tx=0x7fcc400046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.342+0000 7fcc48ff9700 1 -- 172.21.15.134:0/1476829036 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc40007cc0 con 0x7fcc4c0fcfb0 2024-02-16T22:19:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.342+0000 7fcc48ff9700 1 -- 172.21.15.134:0/1476829036 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc4000f040 con 0x7fcc4c0fcfb0 2024-02-16T22:19:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.342+0000 7fcc48ff9700 1 -- 172.21.15.134:0/1476829036 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc4000da30 con 0x7fcc4c0fcfb0 2024-02-16T22:19:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.342+0000 7fcc524c1700 1 -- 172.21.15.134:0/1476829036 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4c10df00 con 0x7fcc4c0fcfb0 2024-02-16T22:19:38.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.342+0000 7fcc524c1700 1 -- 172.21.15.134:0/1476829036 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4c10e330 con 0x7fcc4c0fcfb0 2024-02-16T22:19:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.343+0000 7fcc524c1700 1 -- 172.21.15.134:0/1476829036 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4c04bed0 con 0x7fcc4c0fcfb0 2024-02-16T22:19:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.344+0000 7fcc48ff9700 1 -- 172.21.15.134:0/1476829036 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7fcc4000db90 con 0x7fcc4c0fcfb0 2024-02-16T22:19:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.344+0000 7fcc48ff9700 1 --2- 172.21.15.134:0/1476829036 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fcc3406b2e0 0x7fcc3406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.344+0000 7fcc48ff9700 1 -- 172.21.15.134:0/1476829036 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcc40089c40 con 0x7fcc4c0fcfb0 2024-02-16T22:19:38.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.344+0000 7fcc4bfff700 1 --2- 172.21.15.134:0/1476829036 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fcc3406b2e0 0x7fcc3406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:38.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.345+0000 7fcc4bfff700 1 --2- 172.21.15.134:0/1476829036 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fcc3406b2e0 0x7fcc3406d790 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00b3b0 tx=0x7fcc3c009e30 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:38.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.349+0000 7fcc48ff9700 1 -- 172.21.15.134:0/1476829036 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fcc40057680 con 0x7fcc4c0fcfb0 2024-02-16T22:19:38.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.652+0000 7fcc524c1700 1 -- 172.21.15.134:0/1476829036 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcc4c104930 con 0x7fcc4c0fcfb0 2024-02-16T22:19:38.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.653+0000 7fcc48ff9700 1 -- 172.21.15.134:0/1476829036 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fcc40057210 con 0x7fcc4c0fcfb0 2024-02-16T22:19:38.656 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:19:38.656 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:19:38.656 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 2 2024-02-16T22:19:38.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:19:38.656 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:19:38.656 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 1, 2024-02-16T22:19:38.656 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-16T22:19:38.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:19:38.656 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:19:38.656 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 6 2024-02-16T22:19:38.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:19:38.657 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:19:38.657 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:19:38.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:19:38.657 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:19:38.657 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 13, 2024-02-16T22:19:38.657 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-16T22:19:38.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:19:38.657 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:19:38.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.655+0000 7fcc524c1700 1 -- 172.21.15.134:0/1476829036 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fcc3406b2e0 msgr2=0x7fcc3406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:38.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.655+0000 7fcc524c1700 1 --2- 172.21.15.134:0/1476829036 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fcc3406b2e0 0x7fcc3406d790 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00b3b0 tx=0x7fcc3c009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:38.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.655+0000 7fcc524c1700 1 -- 172.21.15.134:0/1476829036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc4c0fcfb0 msgr2=0x7fcc4c10cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:38.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.655+0000 7fcc524c1700 1 --2- 172.21.15.134:0/1476829036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc4c0fcfb0 0x7fcc4c10cd80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcc40002a50 tx=0x7fcc400046b0 comp rx=0 tx=0).stop 2024-02-16T22:19:38.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.655+0000 7fcc524c1700 1 -- 172.21.15.134:0/1476829036 shutdown_connections 2024-02-16T22:19:38.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.655+0000 7fcc524c1700 1 --2- 172.21.15.134:0/1476829036 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fcc3406b2e0 0x7fcc3406d790 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:38.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.656+0000 7fcc524c1700 1 --2- 172.21.15.134:0/1476829036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc4c0fbe40 0x7fcc4c10c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:38.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.656+0000 7fcc524c1700 1 --2- 172.21.15.134:0/1476829036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc4c0fcfb0 0x7fcc4c10cd80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:38.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.656+0000 7fcc524c1700 1 -- 172.21.15.134:0/1476829036 >> 172.21.15.134:0/1476829036 conn(0x7fcc4c0f7500 msgr2=0x7fcc4c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:38.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.656+0000 7fcc524c1700 1 -- 172.21.15.134:0/1476829036 shutdown_connections 2024-02-16T22:19:38.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.656+0000 7fcc524c1700 1 -- 172.21.15.134:0/1476829036 wait complete. 2024-02-16T22:19:38.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.767+0000 7f9ab922a700 1 -- 172.21.15.134:0/2323054030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ab40fbe40 msgr2=0x7f9ab40fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:38.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.767+0000 7f9ab922a700 1 --2- 172.21.15.134:0/2323054030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ab40fbe40 0x7f9ab40fc250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80049c0 tx=0x7f9aa8009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:38.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.768+0000 7f9ab922a700 1 -- 172.21.15.134:0/2323054030 shutdown_connections 2024-02-16T22:19:38.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.768+0000 7f9ab922a700 1 --2- 172.21.15.134:0/2323054030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ab40fcfb0 0x7f9ab40fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:38.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.768+0000 7f9ab922a700 1 --2- 172.21.15.134:0/2323054030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ab40fbe40 0x7f9ab40fc250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:38.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.768+0000 7f9ab922a700 1 -- 172.21.15.134:0/2323054030 >> 172.21.15.134:0/2323054030 conn(0x7f9ab40f7500 msgr2=0x7f9ab40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:38.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.768+0000 7f9ab922a700 1 -- 172.21.15.134:0/2323054030 shutdown_connections 2024-02-16T22:19:38.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.769+0000 7f9ab922a700 1 -- 172.21.15.134:0/2323054030 wait complete. 2024-02-16T22:19:38.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.770+0000 7f9ab922a700 1 Processor -- start 2024-02-16T22:19:38.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.770+0000 7f9ab922a700 1 -- start start 2024-02-16T22:19:38.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.770+0000 7f9ab922a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ab40fbe40 0x7f9ab410f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:38.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.770+0000 7f9ab922a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ab40fcfb0 0x7f9ab410fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:38.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.770+0000 7f9ab922a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab41103f0 con 0x7f9ab40fbe40 2024-02-16T22:19:38.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.770+0000 7f9ab922a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab4110c90 con 0x7f9ab40fcfb0 2024-02-16T22:19:38.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.770+0000 7f9ab2d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ab40fbe40 0x7f9ab410f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:38.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.770+0000 7f9ab2d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ab40fbe40 0x7f9ab410f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57202/0 (socket says 172.21.15.134:57202) 2024-02-16T22:19:38.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.770+0000 7f9ab2d9d700 1 -- 172.21.15.134:0/3179436625 learned_addr learned my addr 172.21.15.134:0/3179436625 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:19:38.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.770+0000 7f9ab259c700 1 --2- 172.21.15.134:0/3179436625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ab40fcfb0 0x7f9ab410fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:38.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.770+0000 7f9ab2d9d700 1 -- 172.21.15.134:0/3179436625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ab40fcfb0 msgr2=0x7f9ab410fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:38.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.770+0000 7f9ab2d9d700 1 --2- 172.21.15.134:0/3179436625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ab40fcfb0 0x7f9ab410fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:38.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.770+0000 7f9ab2d9d700 1 -- 172.21.15.134:0/3179436625 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa8005040 con 0x7f9ab40fbe40 2024-02-16T22:19:38.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.771+0000 7f9ab2d9d700 1 --2- 172.21.15.134:0/3179436625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ab40fbe40 0x7f9ab410f8b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009b50 tx=0x7f9aa8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:38.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.771+0000 7f9a9b7fe700 1 -- 172.21.15.134:0/3179436625 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aa80116b0 con 0x7f9ab40fbe40 2024-02-16T22:19:38.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.771+0000 7f9a9b7fe700 1 -- 172.21.15.134:0/3179436625 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9aa8011ce0 con 0x7f9ab40fbe40 2024-02-16T22:19:38.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.771+0000 7f9ab922a700 1 -- 172.21.15.134:0/3179436625 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab4110f10 con 0x7f9ab40fbe40 2024-02-16T22:19:38.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.771+0000 7f9a9b7fe700 1 -- 172.21.15.134:0/3179436625 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aa801ade0 con 0x7f9ab40fbe40 2024-02-16T22:19:38.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.771+0000 7f9ab922a700 1 -- 172.21.15.134:0/3179436625 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab4111450 con 0x7f9ab40fbe40 2024-02-16T22:19:38.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.772+0000 7f9ab922a700 1 -- 172.21.15.134:0/3179436625 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab404bed0 con 0x7f9ab40fbe40 2024-02-16T22:19:38.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.774+0000 7f9a9b7fe700 1 -- 172.21.15.134:0/3179436625 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f9aa8011810 con 0x7f9ab40fbe40 2024-02-16T22:19:38.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.774+0000 7f9a9b7fe700 1 --2- 172.21.15.134:0/3179436625 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f9a9c06b3b0 0x7f9a9c06d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:19:38.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.775+0000 7f9a9b7fe700 1 -- 172.21.15.134:0/3179436625 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f9aa808bda0 con 0x7f9ab40fbe40 2024-02-16T22:19:38.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.775+0000 7f9ab259c700 1 --2- 172.21.15.134:0/3179436625 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f9a9c06b3b0 0x7f9a9c06d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:19:38.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.776+0000 7f9ab259c700 1 --2- 172.21.15.134:0/3179436625 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f9a9c06b3b0 0x7f9a9c06d860 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4007fd0 tx=0x7f9aa4009040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:19:38.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:38.782+0000 7f9a9b7fe700 1 -- 172.21.15.134:0/3179436625 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f9aa80598e0 con 0x7f9ab40fbe40 2024-02-16T22:19:39.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:39.073+0000 7f9ab922a700 1 -- 172.21.15.134:0/3179436625 --> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ab4101720 con 0x7f9a9c06b3b0 2024-02-16T22:19:39.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:39.074+0000 7f9a9b7fe700 1 -- 172.21.15.134:0/3179436625 <== mgr.24371 v2:172.21.15.173:6828/2126919483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f9ab4101720 con 0x7f9a9c06b3b0 2024-02-16T22:19:39.077 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:19:39.077 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:19:39.077 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:19:39.077 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-16T22:19:39.077 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-02-16T22:19:39.077 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "1/2 daemons upgraded", 2024-02-16T22:19:39.077 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "", 2024-02-16T22:19:39.077 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:19:39.078 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:19:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:39.076+0000 7f9ab922a700 1 -- 172.21.15.134:0/3179436625 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f9a9c06b3b0 msgr2=0x7f9a9c06d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:39.076+0000 7f9ab922a700 1 --2- 172.21.15.134:0/3179436625 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f9a9c06b3b0 0x7f9a9c06d860 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4007fd0 tx=0x7f9aa4009040 comp rx=0 tx=0).stop 2024-02-16T22:19:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:39.076+0000 7f9ab922a700 1 -- 172.21.15.134:0/3179436625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ab40fbe40 msgr2=0x7f9ab410f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:19:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:39.076+0000 7f9ab922a700 1 --2- 172.21.15.134:0/3179436625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ab40fbe40 0x7f9ab410f8b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009b50 tx=0x7f9aa8009e30 comp rx=0 tx=0).stop 2024-02-16T22:19:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:39.076+0000 7f9ab922a700 1 -- 172.21.15.134:0/3179436625 shutdown_connections 2024-02-16T22:19:39.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:39.076+0000 7f9ab922a700 1 --2- 172.21.15.134:0/3179436625 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f9a9c06b3b0 0x7f9a9c06d860 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:39.076+0000 7f9ab922a700 1 --2- 172.21.15.134:0/3179436625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ab40fbe40 0x7f9ab410f8b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:39.076+0000 7f9ab922a700 1 --2- 172.21.15.134:0/3179436625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ab40fcfb0 0x7f9ab410fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:19:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:39.076+0000 7f9ab922a700 1 -- 172.21.15.134:0/3179436625 >> 172.21.15.134:0/3179436625 conn(0x7f9ab40f7500 msgr2=0x7f9ab40f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:19:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:39.076+0000 7f9ab922a700 1 -- 172.21.15.134:0/3179436625 shutdown_connections 2024-02-16T22:19:39.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:19:39.076+0000 7f9ab922a700 1 -- 172.21.15.134:0/3179436625 wait complete. 2024-02-16T22:19:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: Adjusting osd_memory_target on smithi173 to 2581M 2024-02-16T22:19:39.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:39.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:19:39.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:19:39.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: Updating smithi134:/etc/ceph/ceph.conf 2024-02-16T22:19:39.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: Updating smithi173:/etc/ceph/ceph.conf 2024-02-16T22:19:39.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: pgmap v11: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 27 MiB/s rd, 31 MiB/s wr, 271 op/s 2024-02-16T22:19:39.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:38 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/1476829036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:19:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-16T22:19:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: Adjusting osd_memory_target on smithi173 to 2581M 2024-02-16T22:19:39.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:39.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:19:39.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:19:39.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: Updating smithi134:/etc/ceph/ceph.conf 2024-02-16T22:19:39.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: Updating smithi173:/etc/ceph/ceph.conf 2024-02-16T22:19:39.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: pgmap v11: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 27 MiB/s rd, 31 MiB/s wr, 271 op/s 2024-02-16T22:19:39.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:38 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/1476829036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:19:40.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: from='client.24429 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:40.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:19:40.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:19:40.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:19:40.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:19:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-16T22:19:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-16T22:19:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:40 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: from='client.24429 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:19:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:19:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:19:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:19:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-16T22:19:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-16T22:19:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:19:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:40.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:40 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:41.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:41 smithi134 ceph-mon[28869]: Reconfiguring node-exporter.smithi134 (dependencies changed)... 2024-02-16T22:19:41.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:41 smithi134 ceph-mon[28869]: Reconfiguring daemon node-exporter.smithi134 on smithi134 2024-02-16T22:19:41.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:41 smithi134 ceph-mon[28869]: pgmap v12: 65 pgs: 65 active+clean; 915 MiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 27 MiB/s rd, 32 MiB/s wr, 464 op/s 2024-02-16T22:19:41.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:41 smithi173 ceph-mon[37280]: Reconfiguring node-exporter.smithi134 (dependencies changed)... 2024-02-16T22:19:41.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:41 smithi173 ceph-mon[37280]: Reconfiguring daemon node-exporter.smithi134 on smithi134 2024-02-16T22:19:41.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:41 smithi173 ceph-mon[37280]: pgmap v12: 65 pgs: 65 active+clean; 915 MiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 27 MiB/s rd, 32 MiB/s wr, 464 op/s 2024-02-16T22:19:42.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:42 smithi134 ceph-mon[28869]: pgmap v13: 65 pgs: 65 active+clean; 915 MiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 344 op/s 2024-02-16T22:19:42.980 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:42 smithi173 ceph-mon[37280]: pgmap v13: 65 pgs: 65 active+clean; 915 MiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 344 op/s 2024-02-16T22:19:44.996 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-16T22:19:44.996 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-16T22:19:45.393 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:45 smithi134 ceph-mon[28869]: pgmap v14: 65 pgs: 65 active+clean; 479 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 489 op/s 2024-02-16T22:19:45.393 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:45 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:45.393 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:45 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:45.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:45 smithi173 ceph-mon[37280]: pgmap v14: 65 pgs: 65 active+clean; 479 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 489 op/s 2024-02-16T22:19:45.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:45 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:45.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:45 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:46.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:46 smithi173 ceph-mon[37280]: Reconfiguring alertmanager.smithi134 (dependencies changed)... 2024-02-16T22:19:46.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:46 smithi173 ceph-mon[37280]: Reconfiguring daemon alertmanager.smithi134 on smithi134 2024-02-16T22:19:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:46 smithi134 ceph-mon[28869]: Reconfiguring alertmanager.smithi134 (dependencies changed)... 2024-02-16T22:19:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:46 smithi134 ceph-mon[28869]: Reconfiguring daemon alertmanager.smithi134 on smithi134 2024-02-16T22:19:47.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:47 smithi134 ceph-mon[28869]: pgmap v15: 65 pgs: 65 active+clean; 479 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 39 KiB/s rd, 1.7 MiB/s wr, 337 op/s 2024-02-16T22:19:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:47 smithi173 ceph-mon[37280]: pgmap v15: 65 pgs: 65 active+clean; 479 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 39 KiB/s rd, 1.7 MiB/s wr, 337 op/s 2024-02-16T22:19:49.306 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:49 smithi134 ceph-mon[28869]: pgmap v16: 65 pgs: 65 active+clean; 479 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 39 KiB/s rd, 1.7 MiB/s wr, 337 op/s 2024-02-16T22:19:49.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:49 smithi173 ceph-mon[37280]: pgmap v16: 65 pgs: 65 active+clean; 479 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 39 KiB/s rd, 1.7 MiB/s wr, 337 op/s 2024-02-16T22:19:51.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:51 smithi134 ceph-mon[28869]: pgmap v17: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 65 KiB/s rd, 2.7 MiB/s wr, 545 op/s 2024-02-16T22:19:51.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:51 smithi173 ceph-mon[37280]: pgmap v17: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 65 KiB/s rd, 2.7 MiB/s wr, 545 op/s 2024-02-16T22:19:52.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:52 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:52.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:52 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:52.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:52 smithi134 ceph-mon[28869]: Reconfiguring grafana.smithi134 (dependencies changed)... 2024-02-16T22:19:52.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:52 smithi134 ceph-mon[28869]: Reconfiguring daemon grafana.smithi134 on smithi134 2024-02-16T22:19:52.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:52 smithi134 ceph-mon[28869]: pgmap v18: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.6 MiB/s wr, 353 op/s 2024-02-16T22:19:52.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:52 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:19:52.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:52 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:52.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:52 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:19:52.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:52 smithi173 ceph-mon[37280]: Reconfiguring grafana.smithi134 (dependencies changed)... 2024-02-16T22:19:52.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:52 smithi173 ceph-mon[37280]: Reconfiguring daemon grafana.smithi134 on smithi134 2024-02-16T22:19:52.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:52 smithi173 ceph-mon[37280]: pgmap v18: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.6 MiB/s wr, 353 op/s 2024-02-16T22:19:52.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:52 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:19:55.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:55 smithi134 ceph-mon[28869]: pgmap v19: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 55 KiB/s rd, 2.9 MiB/s wr, 505 op/s 2024-02-16T22:19:55.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:55 smithi173 ceph-mon[37280]: pgmap v19: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 55 KiB/s rd, 2.9 MiB/s wr, 505 op/s 2024-02-16T22:19:57.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:57 smithi134 ceph-mon[28869]: pgmap v20: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.2 MiB/s wr, 359 op/s 2024-02-16T22:19:57.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:57 smithi173 ceph-mon[37280]: pgmap v20: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.2 MiB/s wr, 359 op/s 2024-02-16T22:19:59.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:19:59 smithi134 ceph-mon[28869]: pgmap v21: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.2 MiB/s wr, 359 op/s 2024-02-16T22:19:59.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:19:59 smithi173 ceph-mon[37280]: pgmap v21: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.2 MiB/s wr, 359 op/s 2024-02-16T22:20:00.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:00 smithi134 ceph-mon[28869]: overall HEALTH_OK 2024-02-16T22:20:00.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:00 smithi173 ceph-mon[37280]: overall HEALTH_OK 2024-02-16T22:20:01.316 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:01 smithi134 ceph-mon[28869]: pgmap v22: 65 pgs: 65 active+clean; 312 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 64 KiB/s rd, 3.4 MiB/s wr, 612 op/s 2024-02-16T22:20:01.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:01 smithi173 ceph-mon[37280]: pgmap v22: 65 pgs: 65 active+clean; 312 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 64 KiB/s rd, 3.4 MiB/s wr, 612 op/s 2024-02-16T22:20:02.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:02 smithi134 ceph-mon[28869]: pgmap v23: 65 pgs: 65 active+clean; 312 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.4 MiB/s wr, 404 op/s 2024-02-16T22:20:02.980 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:02 smithi173 ceph-mon[37280]: pgmap v23: 65 pgs: 65 active+clean; 312 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.4 MiB/s wr, 404 op/s 2024-02-16T22:20:05.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:05 smithi134 ceph-mon[28869]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 65 KiB/s rd, 3.4 MiB/s wr, 676 op/s 2024-02-16T22:20:05.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:05 smithi173 ceph-mon[37280]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 65 KiB/s rd, 3.4 MiB/s wr, 676 op/s 2024-02-16T22:20:07.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:07 smithi134 ceph-mon[28869]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.2 MiB/s wr, 524 op/s 2024-02-16T22:20:07.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:07 smithi173 ceph-mon[37280]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.2 MiB/s wr, 524 op/s 2024-02-16T22:20:08.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:08 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:20:08.331 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:08 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:20:08.332 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-16T22:20:08.332 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-16T22:20:08.798 DEBUG:teuthology.parallel:result is None 2024-02-16T22:20:09.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.194+0000 7f43dc25c700 1 -- 172.21.15.134:0/3446679313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d40fcef0 msgr2=0x7f43d40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:09.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.194+0000 7f43dc25c700 1 --2- 172.21.15.134:0/3446679313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d40fcef0 0x7f43d40fd320 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f43d0004940 tx=0x7f43d0009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:09.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.194+0000 7f43dc25c700 1 -- 172.21.15.134:0/3446679313 shutdown_connections 2024-02-16T22:20:09.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.194+0000 7f43dc25c700 1 --2- 172.21.15.134:0/3446679313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43d40fe0e0 0x7f43d40fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:09.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.194+0000 7f43dc25c700 1 --2- 172.21.15.134:0/3446679313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d40fcef0 0x7f43d40fd320 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.194+0000 7f43dc25c700 1 -- 172.21.15.134:0/3446679313 >> 172.21.15.134:0/3446679313 conn(0x7f43d40f8620 msgr2=0x7f43d40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.194+0000 7f43dc25c700 1 -- 172.21.15.134:0/3446679313 shutdown_connections 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.194+0000 7f43dc25c700 1 -- 172.21.15.134:0/3446679313 wait complete. 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.195+0000 7f43dc25c700 1 Processor -- start 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.195+0000 7f43dc25c700 1 -- start start 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.195+0000 7f43dc25c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d40fcef0 0x7f43d410b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.195+0000 7f43dc25c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43d40fe0e0 0x7f43d410bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.195+0000 7f43dc25c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d410c2b0 con 0x7f43d40fcef0 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.195+0000 7f43dc25c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d410cb50 con 0x7f43d40fe0e0 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.195+0000 7f43d9ff8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d40fcef0 0x7f43d410b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.195+0000 7f43d9ff8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d40fcef0 0x7f43d410b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42248/0 (socket says 172.21.15.134:42248) 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.195+0000 7f43d9ff8700 1 -- 172.21.15.134:0/803034308 learned_addr learned my addr 172.21.15.134:0/803034308 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.195+0000 7f43d97f7700 1 --2- 172.21.15.134:0/803034308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43d40fe0e0 0x7f43d410bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.196+0000 7f43d9ff8700 1 -- 172.21.15.134:0/803034308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43d40fe0e0 msgr2=0x7f43d410bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:09.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.196+0000 7f43d9ff8700 1 --2- 172.21.15.134:0/803034308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43d40fe0e0 0x7f43d410bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:09.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.196+0000 7f43d9ff8700 1 -- 172.21.15.134:0/803034308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d0005040 con 0x7f43d40fcef0 2024-02-16T22:20:09.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.196+0000 7f43d9ff8700 1 --2- 172.21.15.134:0/803034308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d40fcef0 0x7f43d410b720 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009360 tx=0x7f43d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:09.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.196+0000 7f43ca7fc700 1 -- 172.21.15.134:0/803034308 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43d000e040 con 0x7f43d40fcef0 2024-02-16T22:20:09.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.196+0000 7f43dc25c700 1 -- 172.21.15.134:0/803034308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d410cdd0 con 0x7f43d40fcef0 2024-02-16T22:20:09.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.196+0000 7f43ca7fc700 1 -- 172.21.15.134:0/803034308 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f43d0004290 con 0x7f43d40fcef0 2024-02-16T22:20:09.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.196+0000 7f43ca7fc700 1 -- 172.21.15.134:0/803034308 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43d001c630 con 0x7f43d40fcef0 2024-02-16T22:20:09.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.196+0000 7f43dc25c700 1 -- 172.21.15.134:0/803034308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d410d310 con 0x7f43d40fcef0 2024-02-16T22:20:09.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.197+0000 7f43dc25c700 1 -- 172.21.15.134:0/803034308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d404bed0 con 0x7f43d40fcef0 2024-02-16T22:20:09.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.198+0000 7f43ca7fc700 1 -- 172.21.15.134:0/803034308 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f43d0013980 con 0x7f43d40fcef0 2024-02-16T22:20:09.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.198+0000 7f43ca7fc700 1 --2- 172.21.15.134:0/803034308 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f43c006b2e0 0x7f43c006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:09.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.199+0000 7f43ca7fc700 1 -- 172.21.15.134:0/803034308 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f43d008b100 con 0x7f43d40fcef0 2024-02-16T22:20:09.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.199+0000 7f43d97f7700 1 --2- 172.21.15.134:0/803034308 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f43c006b2e0 0x7f43c006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:09.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.199+0000 7f43d97f7700 1 --2- 172.21.15.134:0/803034308 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f43c006b2e0 0x7f43c006d790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f43c40041d0 tx=0x7f43c40043c0 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:09.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.203+0000 7f43ca7fc700 1 -- 172.21.15.134:0/803034308 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f43d0055110 con 0x7f43d40fcef0 2024-02-16T22:20:09.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:09 smithi134 ceph-mon[28869]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.2 MiB/s wr, 524 op/s 2024-02-16T22:20:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:09 smithi173 ceph-mon[37280]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.2 MiB/s wr, 524 op/s 2024-02-16T22:20:09.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.502+0000 7f43dc25c700 1 -- 172.21.15.134:0/803034308 --> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43d405e3d0 con 0x7f43c006b2e0 2024-02-16T22:20:09.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.503+0000 7f43ca7fc700 1 -- 172.21.15.134:0/803034308 <== mgr.24371 v2:172.21.15.173:6828/2126919483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f43d405e3d0 con 0x7f43c006b2e0 2024-02-16T22:20:09.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.505+0000 7f43dc25c700 1 -- 172.21.15.134:0/803034308 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f43c006b2e0 msgr2=0x7f43c006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:09.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.505+0000 7f43dc25c700 1 --2- 172.21.15.134:0/803034308 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f43c006b2e0 0x7f43c006d790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f43c40041d0 tx=0x7f43c40043c0 comp rx=0 tx=0).stop 2024-02-16T22:20:09.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.505+0000 7f43dc25c700 1 -- 172.21.15.134:0/803034308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d40fcef0 msgr2=0x7f43d410b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:09.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.505+0000 7f43dc25c700 1 --2- 172.21.15.134:0/803034308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d40fcef0 0x7f43d410b720 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009360 tx=0x7f43d0009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:09.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.505+0000 7f43dc25c700 1 -- 172.21.15.134:0/803034308 shutdown_connections 2024-02-16T22:20:09.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.505+0000 7f43dc25c700 1 --2- 172.21.15.134:0/803034308 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f43c006b2e0 0x7f43c006d790 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:09.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.505+0000 7f43dc25c700 1 --2- 172.21.15.134:0/803034308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d40fcef0 0x7f43d410b720 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:09.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.505+0000 7f43dc25c700 1 --2- 172.21.15.134:0/803034308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43d40fe0e0 0x7f43d410bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:09.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.505+0000 7f43dc25c700 1 -- 172.21.15.134:0/803034308 >> 172.21.15.134:0/803034308 conn(0x7f43d40f8620 msgr2=0x7f43d40ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:09.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.505+0000 7f43dc25c700 1 -- 172.21.15.134:0/803034308 shutdown_connections 2024-02-16T22:20:09.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.505+0000 7f43dc25c700 1 -- 172.21.15.134:0/803034308 wait complete. 2024-02-16T22:20:09.518 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:20:09.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.633+0000 7fb99804c700 1 -- 172.21.15.134:0/3137524871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9900fc0a0 msgr2=0x7fb9900fc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:09.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.633+0000 7fb99804c700 1 --2- 172.21.15.134:0/3137524871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9900fc0a0 0x7fb9900fc510 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb980004940 tx=0x7fb980009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:09.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.633+0000 7fb99804c700 1 -- 172.21.15.134:0/3137524871 shutdown_connections 2024-02-16T22:20:09.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.633+0000 7fb99804c700 1 --2- 172.21.15.134:0/3137524871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9900fc0a0 0x7fb9900fc510 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:09.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.633+0000 7fb99804c700 1 --2- 172.21.15.134:0/3137524871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9900fd430 0x7fb9900fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:09.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.633+0000 7fb99804c700 1 -- 172.21.15.134:0/3137524871 >> 172.21.15.134:0/3137524871 conn(0x7fb9900f6ca0 msgr2=0x7fb9900f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:09.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.633+0000 7fb99804c700 1 -- 172.21.15.134:0/3137524871 shutdown_connections 2024-02-16T22:20:09.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.633+0000 7fb99804c700 1 -- 172.21.15.134:0/3137524871 wait complete. 2024-02-16T22:20:09.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb99804c700 1 Processor -- start 2024-02-16T22:20:09.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb99804c700 1 -- start start 2024-02-16T22:20:09.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb99804c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9900fc0a0 0x7fb99010fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:09.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb99804c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9900fd430 0x7fb990110200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:09.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb99804c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb990110800 con 0x7fb9900fd430 2024-02-16T22:20:09.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb99804c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb990110f90 con 0x7fb9900fc0a0 2024-02-16T22:20:09.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb9955e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9900fd430 0x7fb990110200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:09.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb9955e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9900fd430 0x7fb990110200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42278/0 (socket says 172.21.15.134:42278) 2024-02-16T22:20:09.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb9955e7700 1 -- 172.21.15.134:0/2954725510 learned_addr learned my addr 172.21.15.134:0/2954725510 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:20:09.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb995de8700 1 --2- 172.21.15.134:0/2954725510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9900fc0a0 0x7fb99010fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:09.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb9955e7700 1 -- 172.21.15.134:0/2954725510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9900fc0a0 msgr2=0x7fb99010fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb9955e7700 1 --2- 172.21.15.134:0/2954725510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9900fc0a0 0x7fb99010fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb9955e7700 1 -- 172.21.15.134:0/2954725510 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb980005040 con 0x7fb9900fd430 2024-02-16T22:20:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb995de8700 1 --2- 172.21.15.134:0/2954725510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9900fc0a0 0x7fb99010fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:20:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.634+0000 7fb9955e7700 1 --2- 172.21.15.134:0/2954725510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9900fd430 0x7fb990110200 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb980009b30 tx=0x7fb980009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.635+0000 7fb9867fc700 1 -- 172.21.15.134:0/2954725510 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb980021070 con 0x7fb9900fd430 2024-02-16T22:20:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.635+0000 7fb9867fc700 1 -- 172.21.15.134:0/2954725510 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb98001c400 con 0x7fb9900fd430 2024-02-16T22:20:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.635+0000 7fb99804c700 1 -- 172.21.15.134:0/2954725510 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb990111210 con 0x7fb9900fd430 2024-02-16T22:20:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.635+0000 7fb9867fc700 1 -- 172.21.15.134:0/2954725510 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb98000e070 con 0x7fb9900fd430 2024-02-16T22:20:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.635+0000 7fb99804c700 1 -- 172.21.15.134:0/2954725510 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9901116f0 con 0x7fb9900fd430 2024-02-16T22:20:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.636+0000 7fb99804c700 1 -- 172.21.15.134:0/2954725510 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99004bed0 con 0x7fb9900fd430 2024-02-16T22:20:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.636+0000 7fb9867fc700 1 -- 172.21.15.134:0/2954725510 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7fb98001c9e0 con 0x7fb9900fd430 2024-02-16T22:20:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.637+0000 7fb9867fc700 1 --2- 172.21.15.134:0/2954725510 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fb97c06b2e0 0x7fb97c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.637+0000 7fb9867fc700 1 -- 172.21.15.134:0/2954725510 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb98008b050 con 0x7fb9900fd430 2024-02-16T22:20:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.637+0000 7fb995de8700 1 --2- 172.21.15.134:0/2954725510 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fb97c06b2e0 0x7fb97c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.637+0000 7fb995de8700 1 --2- 172.21.15.134:0/2954725510 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fb97c06b2e0 0x7fb97c06d790 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb990065190 tx=0x7fb98c00b040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:09.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.641+0000 7fb9867fc700 1 -- 172.21.15.134:0/2954725510 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb980058b90 con 0x7fb9900fd430 2024-02-16T22:20:09.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.911+0000 7fb99804c700 1 -- 172.21.15.134:0/2954725510 --> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb990111d50 con 0x7fb97c06b2e0 2024-02-16T22:20:09.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.912+0000 7fb9867fc700 1 -- 172.21.15.134:0/2954725510 <== mgr.24371 v2:172.21.15.173:6828/2126919483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb990111d50 con 0x7fb97c06b2e0 2024-02-16T22:20:09.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.916+0000 7fb99804c700 1 -- 172.21.15.134:0/2954725510 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fb97c06b2e0 msgr2=0x7fb97c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:09.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.916+0000 7fb99804c700 1 --2- 172.21.15.134:0/2954725510 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fb97c06b2e0 0x7fb97c06d790 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb990065190 tx=0x7fb98c00b040 comp rx=0 tx=0).stop 2024-02-16T22:20:09.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.916+0000 7fb99804c700 1 -- 172.21.15.134:0/2954725510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9900fd430 msgr2=0x7fb990110200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:09.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.916+0000 7fb99804c700 1 --2- 172.21.15.134:0/2954725510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9900fd430 0x7fb990110200 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb980009b30 tx=0x7fb980009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:09.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.916+0000 7fb99804c700 1 -- 172.21.15.134:0/2954725510 shutdown_connections 2024-02-16T22:20:09.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.916+0000 7fb99804c700 1 --2- 172.21.15.134:0/2954725510 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fb97c06b2e0 0x7fb97c06d790 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:09.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.916+0000 7fb99804c700 1 --2- 172.21.15.134:0/2954725510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9900fc0a0 0x7fb99010fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:09.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.916+0000 7fb99804c700 1 --2- 172.21.15.134:0/2954725510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9900fd430 0x7fb990110200 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:09.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.916+0000 7fb99804c700 1 -- 172.21.15.134:0/2954725510 >> 172.21.15.134:0/2954725510 conn(0x7fb9900f6ca0 msgr2=0x7fb9901002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:09.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.916+0000 7fb99804c700 1 -- 172.21.15.134:0/2954725510 shutdown_connections 2024-02-16T22:20:09.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:09.916+0000 7fb99804c700 1 -- 172.21.15.134:0/2954725510 wait complete. 2024-02-16T22:20:10.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.020+0000 7f500f0c2700 1 -- 172.21.15.134:0/241185292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50080fbe40 msgr2=0x7f50080fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:10.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.020+0000 7f500f0c2700 1 --2- 172.21.15.134:0/241185292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50080fbe40 0x7f50080fc250 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc004940 tx=0x7f4ffc009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:10.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.020+0000 7f500f0c2700 1 -- 172.21.15.134:0/241185292 shutdown_connections 2024-02-16T22:20:10.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.020+0000 7f500f0c2700 1 --2- 172.21.15.134:0/241185292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50080fcfb0 0x7f50080fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.020+0000 7f500f0c2700 1 --2- 172.21.15.134:0/241185292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50080fbe40 0x7f50080fc250 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.020+0000 7f500f0c2700 1 -- 172.21.15.134:0/241185292 >> 172.21.15.134:0/241185292 conn(0x7f50080f74e0 msgr2=0x7f50080f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:10.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.020+0000 7f500f0c2700 1 -- 172.21.15.134:0/241185292 shutdown_connections 2024-02-16T22:20:10.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.020+0000 7f500f0c2700 1 -- 172.21.15.134:0/241185292 wait complete. 2024-02-16T22:20:10.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.021+0000 7f500f0c2700 1 Processor -- start 2024-02-16T22:20:10.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.021+0000 7f500f0c2700 1 -- start start 2024-02-16T22:20:10.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.021+0000 7f500f0c2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50080fbe40 0x7f500810d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:10.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.021+0000 7f500f0c2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50080fcfb0 0x7f500810ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:10.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.021+0000 7f500f0c2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500810e3f0 con 0x7f50080fbe40 2024-02-16T22:20:10.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.021+0000 7f500f0c2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500810ec90 con 0x7f50080fcfb0 2024-02-16T22:20:10.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.021+0000 7f500ce5e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50080fbe40 0x7f500810d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:10.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.022+0000 7f500ce5e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50080fbe40 0x7f500810d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42292/0 (socket says 172.21.15.134:42292) 2024-02-16T22:20:10.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.022+0000 7f5007fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50080fcfb0 0x7f500810ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:10.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.022+0000 7f500ce5e700 1 -- 172.21.15.134:0/1105434062 learned_addr learned my addr 172.21.15.134:0/1105434062 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:20:10.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.022+0000 7f500ce5e700 1 -- 172.21.15.134:0/1105434062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50080fcfb0 msgr2=0x7f500810ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:10.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.022+0000 7f500ce5e700 1 --2- 172.21.15.134:0/1105434062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50080fcfb0 0x7f500810ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.022+0000 7f500ce5e700 1 -- 172.21.15.134:0/1105434062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc005040 con 0x7f50080fbe40 2024-02-16T22:20:10.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.022+0000 7f5007fff700 1 --2- 172.21.15.134:0/1105434062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50080fcfb0 0x7f500810ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:20:10.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.022+0000 7f500ce5e700 1 --2- 172.21.15.134:0/1105434062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50080fbe40 0x7f500810d8b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009fd0 tx=0x7f4ffc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:10.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.022+0000 7f50057fa700 1 -- 172.21.15.134:0/1105434062 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ffc021070 con 0x7f50080fbe40 2024-02-16T22:20:10.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.022+0000 7f50057fa700 1 -- 172.21.15.134:0/1105434062 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ffc01c400 con 0x7f50080fbe40 2024-02-16T22:20:10.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.022+0000 7f500f0c2700 1 -- 172.21.15.134:0/1105434062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500810ef10 con 0x7f50080fbe40 2024-02-16T22:20:10.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.022+0000 7f50057fa700 1 -- 172.21.15.134:0/1105434062 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ffc00e070 con 0x7f50080fbe40 2024-02-16T22:20:10.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.022+0000 7f500f0c2700 1 -- 172.21.15.134:0/1105434062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500810f3a0 con 0x7f50080fbe40 2024-02-16T22:20:10.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.023+0000 7f500f0c2700 1 -- 172.21.15.134:0/1105434062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500804bed0 con 0x7f50080fbe40 2024-02-16T22:20:10.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.024+0000 7f50057fa700 1 -- 172.21.15.134:0/1105434062 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f4ffc01ca50 con 0x7f50080fbe40 2024-02-16T22:20:10.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.025+0000 7f50057fa700 1 --2- 172.21.15.134:0/1105434062 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f4ff806b2e0 0x7f4ff806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:10.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.025+0000 7f50057fa700 1 -- 172.21.15.134:0/1105434062 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4ffc08b780 con 0x7f50080fbe40 2024-02-16T22:20:10.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.025+0000 7f5007fff700 1 --2- 172.21.15.134:0/1105434062 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f4ff806b2e0 0x7f4ff806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:10.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.026+0000 7f5007fff700 1 --2- 172.21.15.134:0/1105434062 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f4ff806b2e0 0x7f4ff806d790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009b80 tx=0x7f4ff400b040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:10.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.031+0000 7f50057fa700 1 -- 172.21.15.134:0/1105434062 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4ffc0592c0 con 0x7f50080fbe40 2024-02-16T22:20:10.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.292+0000 7f500f0c2700 1 -- 172.21.15.134:0/1105434062 --> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5008065dd0 con 0x7f4ff806b2e0 2024-02-16T22:20:10.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.310+0000 7f50057fa700 1 -- 172.21.15.134:0/1105434062 <== mgr.24371 v2:172.21.15.173:6828/2126919483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5008065dd0 con 0x7f4ff806b2e0 2024-02-16T22:20:10.312 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:20:10.312 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 starting - - - - 2024-02-16T22:20:10.312 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (9m) 36s ago 9m 6660k - 17.2.7-513-gb88fae66 870a0944ccb8 a0d53bc0a925 2024-02-16T22:20:10.312 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (8m) 38s ago 8m 6669k - 17.2.7-513-gb88fae66 870a0944ccb8 a8d69537e08a 2024-02-16T22:20:10.312 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (7m) 36s ago 8m 86.5M - 9.4.7 954c08fa6188 67572f26488e 2024-02-16T22:20:10.312 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (3m) 36s ago 3m 11.7M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (3m) 36s ago 3m 160M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (3m) 38s ago 3m 14.9M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (3m) 38s ago 3m 193M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:9283 running (10m) 36s ago 10m 393M - 17.2.7-513-gb88fae66 870a0944ccb8 52095085178d 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283 running (94s) 38s ago 8m 487M - 19.0.0-1450-gf78a58c0 f081f847070a 9d4cb8c4184e 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (10m) 36s ago 10m 48.4M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 93a679740d93 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (7m) 38s ago 7m 36.6M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 cfbef35950ef 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 starting - - - - 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (8m) 38s ago 8m 15.3M - 1.5.0 0da6a335fe13 cddf6bc3c421 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (7m) 36s ago 7m 232M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 099f0b29d202 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (6m) 36s ago 6m 245M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (6m) 36s ago 6m 200M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (5m) 38s ago 5m 282M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (5m) 38s ago 5m 227M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:20:10.313 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (5m) 38s ago 5m 297M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:20:10.314 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (7m) 36s ago 8m 56.5M - 2.43.0 a07b618ecd1d 37e529bd9229 2024-02-16T22:20:10.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.314+0000 7f500f0c2700 1 -- 172.21.15.134:0/1105434062 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f4ff806b2e0 msgr2=0x7f4ff806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:10.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.314+0000 7f500f0c2700 1 --2- 172.21.15.134:0/1105434062 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f4ff806b2e0 0x7f4ff806d790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009b80 tx=0x7f4ff400b040 comp rx=0 tx=0).stop 2024-02-16T22:20:10.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.314+0000 7f500f0c2700 1 -- 172.21.15.134:0/1105434062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50080fbe40 msgr2=0x7f500810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:10.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.314+0000 7f500f0c2700 1 --2- 172.21.15.134:0/1105434062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50080fbe40 0x7f500810d8b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009fd0 tx=0x7f4ffc009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:10.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.315+0000 7f500f0c2700 1 -- 172.21.15.134:0/1105434062 shutdown_connections 2024-02-16T22:20:10.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.315+0000 7f500f0c2700 1 --2- 172.21.15.134:0/1105434062 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f4ff806b2e0 0x7f4ff806d790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.315+0000 7f500f0c2700 1 --2- 172.21.15.134:0/1105434062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50080fbe40 0x7f500810d8b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.315+0000 7f500f0c2700 1 --2- 172.21.15.134:0/1105434062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50080fcfb0 0x7f500810ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.315+0000 7f500f0c2700 1 -- 172.21.15.134:0/1105434062 >> 172.21.15.134:0/1105434062 conn(0x7f50080f74e0 msgr2=0x7f50080656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:10.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.315+0000 7f500f0c2700 1 -- 172.21.15.134:0/1105434062 shutdown_connections 2024-02-16T22:20:10.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.315+0000 7f500f0c2700 1 -- 172.21.15.134:0/1105434062 wait complete. 2024-02-16T22:20:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.459+0000 7f06fffa3700 1 -- 172.21.15.134:0/3581750180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f80fcfb0 msgr2=0x7f06f80fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.459+0000 7f06fffa3700 1 --2- 172.21.15.134:0/3581750180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f80fcfb0 0x7f06f80fd420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f06e8004940 tx=0x7f06e8009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.459+0000 7f06fffa3700 1 -- 172.21.15.134:0/3581750180 shutdown_connections 2024-02-16T22:20:10.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.459+0000 7f06fffa3700 1 --2- 172.21.15.134:0/3581750180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f80fcfb0 0x7f06f80fd420 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.459+0000 7f06fffa3700 1 --2- 172.21.15.134:0/3581750180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06f80fbe40 0x7f06f80fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.459+0000 7f06fffa3700 1 -- 172.21.15.134:0/3581750180 >> 172.21.15.134:0/3581750180 conn(0x7f06f80f74e0 msgr2=0x7f06f80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.459+0000 7f06fffa3700 1 -- 172.21.15.134:0/3581750180 shutdown_connections 2024-02-16T22:20:10.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.459+0000 7f06fffa3700 1 -- 172.21.15.134:0/3581750180 wait complete. 2024-02-16T22:20:10.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.460+0000 7f06fffa3700 1 Processor -- start 2024-02-16T22:20:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.460+0000 7f06fffa3700 1 -- start start 2024-02-16T22:20:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.460+0000 7f06fffa3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f80fbe40 0x7f06f810c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.460+0000 7f06fffa3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06f80fcfb0 0x7f06f810cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.460+0000 7f06fffa3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f810d3b0 con 0x7f06f80fbe40 2024-02-16T22:20:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.460+0000 7f06fffa3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f810dc50 con 0x7f06f80fcfb0 2024-02-16T22:20:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.460+0000 7f06fdd3f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f80fbe40 0x7f06f810c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.460+0000 7f06fdd3f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f80fbe40 0x7f06f810c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42298/0 (socket says 172.21.15.134:42298) 2024-02-16T22:20:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.460+0000 7f06fdd3f700 1 -- 172.21.15.134:0/1007942316 learned_addr learned my addr 172.21.15.134:0/1007942316 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:20:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.460+0000 7f06fd53e700 1 --2- 172.21.15.134:0/1007942316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06f80fcfb0 0x7f06f810cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.461+0000 7f06fdd3f700 1 -- 172.21.15.134:0/1007942316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06f80fcfb0 msgr2=0x7f06f810cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:10.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.461+0000 7f06fdd3f700 1 --2- 172.21.15.134:0/1007942316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06f80fcfb0 0x7f06f810cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.461+0000 7f06fdd3f700 1 -- 172.21.15.134:0/1007942316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e8005040 con 0x7f06f80fbe40 2024-02-16T22:20:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.461+0000 7f06fdd3f700 1 --2- 172.21.15.134:0/1007942316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f80fbe40 0x7f06f810c870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f06f400c830 tx=0x7f06f4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.461+0000 7f06ee7fc700 1 -- 172.21.15.134:0/1007942316 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06f400a760 con 0x7f06f80fbe40 2024-02-16T22:20:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.461+0000 7f06fffa3700 1 -- 172.21.15.134:0/1007942316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f810df30 con 0x7f06f80fbe40 2024-02-16T22:20:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.461+0000 7f06ee7fc700 1 -- 172.21.15.134:0/1007942316 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06f400ad90 con 0x7f06f80fbe40 2024-02-16T22:20:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.461+0000 7f06ee7fc700 1 -- 172.21.15.134:0/1007942316 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06f40113a0 con 0x7f06f80fbe40 2024-02-16T22:20:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.461+0000 7f06fffa3700 1 -- 172.21.15.134:0/1007942316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f810e470 con 0x7f06f80fbe40 2024-02-16T22:20:10.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.462+0000 7f06fffa3700 1 -- 172.21.15.134:0/1007942316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f804bed0 con 0x7f06f80fbe40 2024-02-16T22:20:10.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.462+0000 7f06ee7fc700 1 -- 172.21.15.134:0/1007942316 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f06f4012400 con 0x7f06f80fbe40 2024-02-16T22:20:10.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.463+0000 7f06ee7fc700 1 --2- 172.21.15.134:0/1007942316 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f06e406b2e0 0x7f06e406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:10.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.463+0000 7f06ee7fc700 1 -- 172.21.15.134:0/1007942316 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f06f4089da0 con 0x7f06f80fbe40 2024-02-16T22:20:10.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.463+0000 7f06fd53e700 1 --2- 172.21.15.134:0/1007942316 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f06e406b2e0 0x7f06e406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:10.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.463+0000 7f06fd53e700 1 --2- 172.21.15.134:0/1007942316 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f06e406b2e0 0x7f06e406d790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f06e8004f90 tx=0x7f06e8009e30 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:10.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.467+0000 7f06ee7fc700 1 -- 172.21.15.134:0/1007942316 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f06f40579f0 con 0x7f06f80fbe40 2024-02-16T22:20:10.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.792+0000 7f06fffa3700 1 -- 172.21.15.134:0/1007942316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f06f810e880 con 0x7f06f80fbe40 2024-02-16T22:20:10.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.792+0000 7f06ee7fc700 1 -- 172.21.15.134:0/1007942316 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f06f4057580 con 0x7f06f80fbe40 2024-02-16T22:20:10.794 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:20:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:20:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 2 2024-02-16T22:20:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:20:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:20:10.794 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 1, 2024-02-16T22:20:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-16T22:20:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:20:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:20:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 6 2024-02-16T22:20:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:20:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:20:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:20:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:20:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:20:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 13, 2024-02-16T22:20:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-16T22:20:10.795 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:20:10.795 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:20:10.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.794+0000 7f06fffa3700 1 -- 172.21.15.134:0/1007942316 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f06e406b2e0 msgr2=0x7f06e406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:10.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.794+0000 7f06fffa3700 1 --2- 172.21.15.134:0/1007942316 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f06e406b2e0 0x7f06e406d790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f06e8004f90 tx=0x7f06e8009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:10.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.794+0000 7f06fffa3700 1 -- 172.21.15.134:0/1007942316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f80fbe40 msgr2=0x7f06f810c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:10.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.794+0000 7f06fffa3700 1 --2- 172.21.15.134:0/1007942316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f80fbe40 0x7f06f810c870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f06f400c830 tx=0x7f06f4004470 comp rx=0 tx=0).stop 2024-02-16T22:20:10.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.795+0000 7f06fffa3700 1 -- 172.21.15.134:0/1007942316 shutdown_connections 2024-02-16T22:20:10.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.795+0000 7f06fffa3700 1 --2- 172.21.15.134:0/1007942316 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f06e406b2e0 0x7f06e406d790 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.795+0000 7f06fffa3700 1 --2- 172.21.15.134:0/1007942316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f80fbe40 0x7f06f810c870 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.795+0000 7f06fffa3700 1 --2- 172.21.15.134:0/1007942316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06f80fcfb0 0x7f06f810cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.795+0000 7f06fffa3700 1 -- 172.21.15.134:0/1007942316 >> 172.21.15.134:0/1007942316 conn(0x7f06f80f74e0 msgr2=0x7f06f8100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:10.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.795+0000 7f06fffa3700 1 -- 172.21.15.134:0/1007942316 shutdown_connections 2024-02-16T22:20:10.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.795+0000 7f06fffa3700 1 -- 172.21.15.134:0/1007942316 wait complete. 2024-02-16T22:20:10.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.902+0000 7f453f1d4700 1 -- 172.21.15.134:0/3348475448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45380fbe40 msgr2=0x7f45380fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:10.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.902+0000 7f453f1d4700 1 --2- 172.21.15.134:0/3348475448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45380fbe40 0x7f45380fc250 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4534004940 tx=0x7f4534009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:10.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.902+0000 7f453f1d4700 1 -- 172.21.15.134:0/3348475448 shutdown_connections 2024-02-16T22:20:10.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.902+0000 7f453f1d4700 1 --2- 172.21.15.134:0/3348475448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45380fcfb0 0x7f45380fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.902+0000 7f453f1d4700 1 --2- 172.21.15.134:0/3348475448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45380fbe40 0x7f45380fc250 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.902+0000 7f453f1d4700 1 -- 172.21.15.134:0/3348475448 >> 172.21.15.134:0/3348475448 conn(0x7f45380f74e0 msgr2=0x7f45380f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:10.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.902+0000 7f453f1d4700 1 -- 172.21.15.134:0/3348475448 shutdown_connections 2024-02-16T22:20:10.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.902+0000 7f453f1d4700 1 -- 172.21.15.134:0/3348475448 wait complete. 2024-02-16T22:20:10.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.903+0000 7f453f1d4700 1 Processor -- start 2024-02-16T22:20:10.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.903+0000 7f453f1d4700 1 -- start start 2024-02-16T22:20:10.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.903+0000 7f453f1d4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45380fbe40 0x7f4538110590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:10.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.903+0000 7f453f1d4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45380fcfb0 0x7f4538112ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:10.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.903+0000 7f453f1d4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45380664c0 con 0x7f45380fbe40 2024-02-16T22:20:10.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.903+0000 7f453f1d4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4538066600 con 0x7f45380fcfb0 2024-02-16T22:20:10.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.903+0000 7f453cf70700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45380fbe40 0x7f4538110590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:10.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.903+0000 7f453cf70700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45380fbe40 0x7f4538110590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42328/0 (socket says 172.21.15.134:42328) 2024-02-16T22:20:10.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.903+0000 7f453cf70700 1 -- 172.21.15.134:0/3133094847 learned_addr learned my addr 172.21.15.134:0/3133094847 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:20:10.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.904+0000 7f452ffff700 1 --2- 172.21.15.134:0/3133094847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45380fcfb0 0x7f4538112ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:10.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.904+0000 7f453cf70700 1 -- 172.21.15.134:0/3133094847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45380fcfb0 msgr2=0x7f4538112ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:10.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.904+0000 7f453cf70700 1 --2- 172.21.15.134:0/3133094847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45380fcfb0 0x7f4538112ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:10.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.904+0000 7f453cf70700 1 -- 172.21.15.134:0/3133094847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4534005040 con 0x7f45380fbe40 2024-02-16T22:20:10.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.904+0000 7f453cf70700 1 --2- 172.21.15.134:0/3133094847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45380fbe40 0x7f4538110590 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f45340093e0 tx=0x7f4534009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:10.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.904+0000 7f452d7fa700 1 -- 172.21.15.134:0/3133094847 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f453400e040 con 0x7f45380fbe40 2024-02-16T22:20:10.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.904+0000 7f452d7fa700 1 -- 172.21.15.134:0/3133094847 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f453400bcc0 con 0x7f45380fbe40 2024-02-16T22:20:10.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.904+0000 7f453f1d4700 1 -- 172.21.15.134:0/3133094847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45381130e0 con 0x7f45380fbe40 2024-02-16T22:20:10.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.904+0000 7f452d7fa700 1 -- 172.21.15.134:0/3133094847 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f453401c630 con 0x7f45380fbe40 2024-02-16T22:20:10.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.904+0000 7f453f1d4700 1 -- 172.21.15.134:0/3133094847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4538113620 con 0x7f45380fbe40 2024-02-16T22:20:10.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.905+0000 7f453f1d4700 1 -- 172.21.15.134:0/3133094847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453804bed0 con 0x7f45380fbe40 2024-02-16T22:20:10.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.906+0000 7f452d7fa700 1 -- 172.21.15.134:0/3133094847 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f45340139f0 con 0x7f45380fbe40 2024-02-16T22:20:10.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.906+0000 7f452d7fa700 1 --2- 172.21.15.134:0/3133094847 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f452006b2e0 0x7f452006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:10.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.906+0000 7f452d7fa700 1 -- 172.21.15.134:0/3133094847 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f453408b260 con 0x7f45380fbe40 2024-02-16T22:20:10.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.907+0000 7f452ffff700 1 --2- 172.21.15.134:0/3133094847 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f452006b2e0 0x7f452006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:10.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.907+0000 7f452ffff700 1 --2- 172.21.15.134:0/3133094847 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f452006b2e0 0x7f452006d790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4528009fd0 tx=0x7f4528009f60 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:10.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:10.911+0000 7f452d7fa700 1 -- 172.21.15.134:0/3133094847 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4534055270 con 0x7f45380fbe40 2024-02-16T22:20:11.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:11.133+0000 7f453f1d4700 1 -- 172.21.15.134:0/3133094847 --> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4538101990 con 0x7f452006b2e0 2024-02-16T22:20:11.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:11.134+0000 7f452d7fa700 1 -- 172.21.15.134:0/3133094847 <== mgr.24371 v2:172.21.15.173:6828/2126919483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f4538101990 con 0x7f452006b2e0 2024-02-16T22:20:11.136 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:20:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:20:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:20:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-16T22:20:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-02-16T22:20:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "1/2 daemons upgraded", 2024-02-16T22:20:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "", 2024-02-16T22:20:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:20:11.136 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:20:11.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:11.137+0000 7f453f1d4700 1 -- 172.21.15.134:0/3133094847 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f452006b2e0 msgr2=0x7f452006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:11.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:11.137+0000 7f453f1d4700 1 --2- 172.21.15.134:0/3133094847 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f452006b2e0 0x7f452006d790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4528009fd0 tx=0x7f4528009f60 comp rx=0 tx=0).stop 2024-02-16T22:20:11.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:11.137+0000 7f453f1d4700 1 -- 172.21.15.134:0/3133094847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45380fbe40 msgr2=0x7f4538110590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:11.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:11.137+0000 7f453f1d4700 1 --2- 172.21.15.134:0/3133094847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45380fbe40 0x7f4538110590 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f45340093e0 tx=0x7f4534009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:11.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:11.137+0000 7f453f1d4700 1 -- 172.21.15.134:0/3133094847 shutdown_connections 2024-02-16T22:20:11.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:11.137+0000 7f453f1d4700 1 --2- 172.21.15.134:0/3133094847 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f452006b2e0 0x7f452006d790 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:11.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:11.137+0000 7f453f1d4700 1 --2- 172.21.15.134:0/3133094847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45380fbe40 0x7f4538110590 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:11.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:11.137+0000 7f453f1d4700 1 --2- 172.21.15.134:0/3133094847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45380fcfb0 0x7f4538112ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:11.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:11.137+0000 7f453f1d4700 1 -- 172.21.15.134:0/3133094847 >> 172.21.15.134:0/3133094847 conn(0x7f45380f74e0 msgr2=0x7f4538100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:11.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:11.137+0000 7f453f1d4700 1 -- 172.21.15.134:0/3133094847 shutdown_connections 2024-02-16T22:20:11.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:11.137+0000 7f453f1d4700 1 -- 172.21.15.134:0/3133094847 wait complete. 2024-02-16T22:20:11.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:11 smithi134 ceph-mon[28869]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:11.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:11 smithi134 ceph-mon[28869]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:11.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:11 smithi134 ceph-mon[28869]: pgmap v27: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 68 KiB/s rd, 3.4 MiB/s wr, 715 op/s 2024-02-16T22:20:11.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:11 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/1007942316' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:20:11.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:11 smithi173 ceph-mon[37280]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:11.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:11 smithi173 ceph-mon[37280]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:11.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:11 smithi173 ceph-mon[37280]: pgmap v27: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 68 KiB/s rd, 3.4 MiB/s wr, 715 op/s 2024-02-16T22:20:11.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:11 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/1007942316' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:20:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:12 smithi134 ceph-mon[28869]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:12 smithi173 ceph-mon[37280]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:13.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:13 smithi134 ceph-mon[28869]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:13.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:13 smithi134 ceph-mon[28869]: pgmap v28: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.3 MiB/s wr, 462 op/s 2024-02-16T22:20:13.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:13 smithi173 ceph-mon[37280]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:13.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:13 smithi173 ceph-mon[37280]: pgmap v28: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.3 MiB/s wr, 462 op/s 2024-02-16T22:20:15.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:15 smithi134 ceph-mon[28869]: pgmap v29: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 62 KiB/s rd, 3.1 MiB/s wr, 652 op/s 2024-02-16T22:20:15.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:15 smithi173 ceph-mon[37280]: pgmap v29: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 62 KiB/s rd, 3.1 MiB/s wr, 652 op/s 2024-02-16T22:20:17.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:17 smithi134 ceph-mon[28869]: pgmap v30: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 2.1 MiB/s wr, 380 op/s 2024-02-16T22:20:17.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:17 smithi173 ceph-mon[37280]: pgmap v30: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 2.1 MiB/s wr, 380 op/s 2024-02-16T22:20:19.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:19 smithi134 ceph-mon[28869]: pgmap v31: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 2.1 MiB/s wr, 380 op/s 2024-02-16T22:20:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:19 smithi173 ceph-mon[37280]: pgmap v31: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 2.1 MiB/s wr, 380 op/s 2024-02-16T22:20:21.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:21 smithi134 ceph-mon[28869]: pgmap v32: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.6 MiB/s wr, 494 op/s 2024-02-16T22:20:21.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:21 smithi173 ceph-mon[37280]: pgmap v32: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.6 MiB/s wr, 494 op/s 2024-02-16T22:20:22.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:22 smithi134 ceph-mon[28869]: pgmap v33: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.4 MiB/s wr, 303 op/s 2024-02-16T22:20:22.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:22 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:20:22.980 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:22 smithi173 ceph-mon[37280]: pgmap v33: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.4 MiB/s wr, 303 op/s 2024-02-16T22:20:22.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:22 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:20:25.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:25 smithi134 ceph-mon[28869]: pgmap v34: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 2.0 MiB/s wr, 446 op/s 2024-02-16T22:20:25.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:25 smithi173 ceph-mon[37280]: pgmap v34: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 2.0 MiB/s wr, 446 op/s 2024-02-16T22:20:27.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:27 smithi134 ceph-mon[28869]: pgmap v35: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-02-16T22:20:27.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:27 smithi173 ceph-mon[37280]: pgmap v35: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-02-16T22:20:29.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:29 smithi134 ceph-mon[28869]: pgmap v36: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-02-16T22:20:29.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:29 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:29.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:29 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:29.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:29 smithi173 ceph-mon[37280]: pgmap v36: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-02-16T22:20:29.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:29 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:29.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:29 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:29.673 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-16T22:20:29.673 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-16T22:20:29.947 DEBUG:teuthology.parallel:result is None 2024-02-16T22:20:29.947 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-16T22:20:29.982 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-16T22:20:29.982 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-16T22:20:30.018 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-16T22:20:30.018 DEBUG:teuthology.parallel:result is None 2024-02-16T22:20:30.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:30 smithi173 ceph-mon[37280]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-02-16T22:20:30.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:30 smithi173 ceph-mon[37280]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-02-16T22:20:30.316 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:30 smithi134 ceph-mon[28869]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-02-16T22:20:30.316 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:30 smithi134 ceph-mon[28869]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-02-16T22:20:31.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:31 smithi134 ceph-mon[28869]: pgmap v37: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.8 MiB/s wr, 377 op/s 2024-02-16T22:20:31.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:31 smithi173 ceph-mon[37280]: pgmap v37: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.8 MiB/s wr, 377 op/s 2024-02-16T22:20:32.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:32 smithi134 ceph-mon[28869]: pgmap v38: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 263 op/s 2024-02-16T22:20:32.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:32 smithi173 ceph-mon[37280]: pgmap v38: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 263 op/s 2024-02-16T22:20:35.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:35 smithi134 ceph-mon[28869]: pgmap v39: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.4 MiB/s wr, 328 op/s 2024-02-16T22:20:35.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:35 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:35.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:35 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:35.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:35 smithi173 ceph-mon[37280]: pgmap v39: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.4 MiB/s wr, 328 op/s 2024-02-16T22:20:35.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:35 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:35.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:35 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:36.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:36 smithi173 ceph-mon[37280]: Reconfiguring node-exporter.smithi173 (dependencies changed)... 2024-02-16T22:20:36.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:36 smithi173 ceph-mon[37280]: Reconfiguring daemon node-exporter.smithi173 on smithi173 2024-02-16T22:20:36.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:36 smithi134 ceph-mon[28869]: Reconfiguring node-exporter.smithi173 (dependencies changed)... 2024-02-16T22:20:36.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:36 smithi134 ceph-mon[28869]: Reconfiguring daemon node-exporter.smithi173 on smithi173 2024-02-16T22:20:37.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:37 smithi134 ceph-mon[28869]: pgmap v40: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 829 KiB/s wr, 185 op/s 2024-02-16T22:20:37.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:37 smithi173 ceph-mon[37280]: pgmap v40: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 829 KiB/s wr, 185 op/s 2024-02-16T22:20:38.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:38 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:20:38.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:38 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:20:39.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:39 smithi134 ceph-mon[28869]: pgmap v41: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 829 KiB/s wr, 185 op/s 2024-02-16T22:20:39.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:39 smithi173 ceph-mon[37280]: pgmap v41: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 829 KiB/s wr, 185 op/s 2024-02-16T22:20:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.253+0000 7f13c911e700 1 -- 172.21.15.134:0/2636545492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c40fe0e0 msgr2=0x7f13c40fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.253+0000 7f13c911e700 1 --2- 172.21.15.134:0/2636545492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c40fe0e0 0x7f13c40fe550 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f13b4004940 tx=0x7f13b4009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.253+0000 7f13c911e700 1 -- 172.21.15.134:0/2636545492 shutdown_connections 2024-02-16T22:20:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.253+0000 7f13c911e700 1 --2- 172.21.15.134:0/2636545492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c40fe0e0 0x7f13c40fe550 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.253+0000 7f13c911e700 1 --2- 172.21.15.134:0/2636545492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13c40fcef0 0x7f13c40fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.253+0000 7f13c911e700 1 -- 172.21.15.134:0/2636545492 >> 172.21.15.134:0/2636545492 conn(0x7f13c40f8620 msgr2=0x7f13c40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.253+0000 7f13c911e700 1 -- 172.21.15.134:0/2636545492 shutdown_connections 2024-02-16T22:20:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.253+0000 7f13c911e700 1 -- 172.21.15.134:0/2636545492 wait complete. 2024-02-16T22:20:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.254+0000 7f13c911e700 1 Processor -- start 2024-02-16T22:20:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.254+0000 7f13c911e700 1 -- start start 2024-02-16T22:20:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.254+0000 7f13c911e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13c40fcef0 0x7f13c4071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.254+0000 7f13c911e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c40fe0e0 0x7f13c40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.254+0000 7f13c911e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c4070970 con 0x7f13c40fe0e0 2024-02-16T22:20:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.254+0000 7f13c911e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c4070ae0 con 0x7f13c40fcef0 2024-02-16T22:20:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.254+0000 7f13c259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c40fe0e0 0x7f13c40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.255+0000 7f13c259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c40fe0e0 0x7f13c40702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44900/0 (socket says 172.21.15.134:44900) 2024-02-16T22:20:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.255+0000 7f13c259c700 1 -- 172.21.15.134:0/2976515187 learned_addr learned my addr 172.21.15.134:0/2976515187 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:20:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.255+0000 7f13c2d9d700 1 --2- 172.21.15.134:0/2976515187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13c40fcef0 0x7f13c4071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:41.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.255+0000 7f13c259c700 1 -- 172.21.15.134:0/2976515187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13c40fcef0 msgr2=0x7f13c4071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:41.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.255+0000 7f13c259c700 1 --2- 172.21.15.134:0/2976515187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13c40fcef0 0x7f13c4071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.255+0000 7f13c259c700 1 -- 172.21.15.134:0/2976515187 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b4005040 con 0x7f13c40fe0e0 2024-02-16T22:20:41.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.255+0000 7f13c259c700 1 --2- 172.21.15.134:0/2976515187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c40fe0e0 0x7f13c40702e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f13b40093b0 tx=0x7f13b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:41.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.255+0000 7f13ab7fe700 1 -- 172.21.15.134:0/2976515187 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13b400e040 con 0x7f13c40fe0e0 2024-02-16T22:20:41.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.255+0000 7f13c911e700 1 -- 172.21.15.134:0/2976515187 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c4070d60 con 0x7f13c40fe0e0 2024-02-16T22:20:41.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.255+0000 7f13ab7fe700 1 -- 172.21.15.134:0/2976515187 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13b400bcc0 con 0x7f13c40fe0e0 2024-02-16T22:20:41.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.255+0000 7f13ab7fe700 1 -- 172.21.15.134:0/2976515187 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13b401c630 con 0x7f13c40fe0e0 2024-02-16T22:20:41.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.255+0000 7f13c911e700 1 -- 172.21.15.134:0/2976515187 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c41159c0 con 0x7f13c40fe0e0 2024-02-16T22:20:41.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.256+0000 7f13c911e700 1 -- 172.21.15.134:0/2976515187 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c404bed0 con 0x7f13c40fe0e0 2024-02-16T22:20:41.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.257+0000 7f13ab7fe700 1 -- 172.21.15.134:0/2976515187 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f13b4013980 con 0x7f13c40fe0e0 2024-02-16T22:20:41.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.257+0000 7f13ab7fe700 1 --2- 172.21.15.134:0/2976515187 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f13ac06b2e0 0x7f13ac06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:41.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.257+0000 7f13ab7fe700 1 -- 172.21.15.134:0/2976515187 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f13b408b1a0 con 0x7f13c40fe0e0 2024-02-16T22:20:41.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.257+0000 7f13c2d9d700 1 --2- 172.21.15.134:0/2976515187 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f13ac06b2e0 0x7f13ac06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:41.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.258+0000 7f13c2d9d700 1 --2- 172.21.15.134:0/2976515187 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f13ac06b2e0 0x7f13ac06d790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f13c4071bf0 tx=0x7f13b80091a0 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.262+0000 7f13ab7fe700 1 -- 172.21.15.134:0/2976515187 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f13b4058ce0 con 0x7f13c40fe0e0 2024-02-16T22:20:41.344 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:41 smithi173 ceph-mon[37280]: pgmap v42: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 834 KiB/s wr, 185 op/s 2024-02-16T22:20:41.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.470+0000 7f13c911e700 1 -- 172.21.15.134:0/2976515187 --> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f13c4102ac0 con 0x7f13ac06b2e0 2024-02-16T22:20:41.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:41 smithi134 ceph-mon[28869]: pgmap v42: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 834 KiB/s wr, 185 op/s 2024-02-16T22:20:41.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.472+0000 7f13ab7fe700 1 -- 172.21.15.134:0/2976515187 <== mgr.24371 v2:172.21.15.173:6828/2126919483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f13c4102ac0 con 0x7f13ac06b2e0 2024-02-16T22:20:41.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.474+0000 7f13c911e700 1 -- 172.21.15.134:0/2976515187 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f13ac06b2e0 msgr2=0x7f13ac06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:41.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.474+0000 7f13c911e700 1 --2- 172.21.15.134:0/2976515187 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f13ac06b2e0 0x7f13ac06d790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f13c4071bf0 tx=0x7f13b80091a0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.474+0000 7f13c911e700 1 -- 172.21.15.134:0/2976515187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c40fe0e0 msgr2=0x7f13c40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:41.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.474+0000 7f13c911e700 1 --2- 172.21.15.134:0/2976515187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c40fe0e0 0x7f13c40702e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f13b40093b0 tx=0x7f13b4009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:41.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.474+0000 7f13c911e700 1 -- 172.21.15.134:0/2976515187 shutdown_connections 2024-02-16T22:20:41.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.474+0000 7f13c911e700 1 --2- 172.21.15.134:0/2976515187 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f13ac06b2e0 0x7f13ac06d790 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.474+0000 7f13c911e700 1 --2- 172.21.15.134:0/2976515187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13c40fcef0 0x7f13c4071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.474+0000 7f13c911e700 1 --2- 172.21.15.134:0/2976515187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13c40fe0e0 0x7f13c40702e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.474+0000 7f13c911e700 1 -- 172.21.15.134:0/2976515187 >> 172.21.15.134:0/2976515187 conn(0x7f13c40f8620 msgr2=0x7f13c41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:41.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.474+0000 7f13c911e700 1 -- 172.21.15.134:0/2976515187 shutdown_connections 2024-02-16T22:20:41.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.474+0000 7f13c911e700 1 -- 172.21.15.134:0/2976515187 wait complete. 2024-02-16T22:20:41.486 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:20:41.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.577+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3511826701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff440fe2b0 msgr2=0x7eff440fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:41.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.577+0000 7eff4c5ba700 1 --2- 172.21.15.134:0/3511826701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff440fe2b0 0x7eff440fe700 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7eff34004940 tx=0x7eff34009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:41.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.577+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3511826701 shutdown_connections 2024-02-16T22:20:41.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.577+0000 7eff4c5ba700 1 --2- 172.21.15.134:0/3511826701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff440fe2b0 0x7eff440fe700 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.577+0000 7eff4c5ba700 1 --2- 172.21.15.134:0/3511826701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff440fb220 0x7eff440fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.577+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3511826701 >> 172.21.15.134:0/3511826701 conn(0x7eff440f6ca0 msgr2=0x7eff440f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:41.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.577+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3511826701 shutdown_connections 2024-02-16T22:20:41.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.578+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3511826701 wait complete. 2024-02-16T22:20:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.578+0000 7eff4c5ba700 1 Processor -- start 2024-02-16T22:20:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.578+0000 7eff4c5ba700 1 -- start start 2024-02-16T22:20:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.578+0000 7eff4c5ba700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff440fb220 0x7eff4410d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.578+0000 7eff4c5ba700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff440fe2b0 0x7eff4410dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.578+0000 7eff4c5ba700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4410e4c0 con 0x7eff440fe2b0 2024-02-16T22:20:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.578+0000 7eff4c5ba700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4410ed60 con 0x7eff440fb220 2024-02-16T22:20:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.578+0000 7eff49b55700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff440fe2b0 0x7eff4410dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.578+0000 7eff49b55700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff440fe2b0 0x7eff4410dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37896/0 (socket says 172.21.15.134:37896) 2024-02-16T22:20:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.578+0000 7eff4a356700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff440fb220 0x7eff4410d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.578+0000 7eff49b55700 1 -- 172.21.15.134:0/3512015495 learned_addr learned my addr 172.21.15.134:0/3512015495 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:20:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.579+0000 7eff49b55700 1 -- 172.21.15.134:0/3512015495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff440fb220 msgr2=0x7eff4410d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.579+0000 7eff49b55700 1 --2- 172.21.15.134:0/3512015495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff440fb220 0x7eff4410d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.579+0000 7eff49b55700 1 -- 172.21.15.134:0/3512015495 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff34005040 con 0x7eff440fe2b0 2024-02-16T22:20:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.579+0000 7eff49b55700 1 --2- 172.21.15.134:0/3512015495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff440fe2b0 0x7eff4410dec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7eff34009b30 tx=0x7eff34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:41.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.579+0000 7eff3affd700 1 -- 172.21.15.134:0/3512015495 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff34021070 con 0x7eff440fe2b0 2024-02-16T22:20:41.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.579+0000 7eff3affd700 1 -- 172.21.15.134:0/3512015495 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff3401c400 con 0x7eff440fe2b0 2024-02-16T22:20:41.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.579+0000 7eff3affd700 1 -- 172.21.15.134:0/3512015495 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff3400e070 con 0x7eff440fe2b0 2024-02-16T22:20:41.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.579+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3512015495 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4410efe0 con 0x7eff440fe2b0 2024-02-16T22:20:41.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.579+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3512015495 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4410f4c0 con 0x7eff440fe2b0 2024-02-16T22:20:41.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.580+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3512015495 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4404bed0 con 0x7eff440fe2b0 2024-02-16T22:20:41.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.580+0000 7eff3affd700 1 -- 172.21.15.134:0/3512015495 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7eff3401ca00 con 0x7eff440fe2b0 2024-02-16T22:20:41.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.581+0000 7eff3affd700 1 --2- 172.21.15.134:0/3512015495 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7eff3006b2e0 0x7eff3006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:41.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.581+0000 7eff3affd700 1 -- 172.21.15.134:0/3512015495 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7eff3408ae90 con 0x7eff440fe2b0 2024-02-16T22:20:41.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.581+0000 7eff4a356700 1 --2- 172.21.15.134:0/3512015495 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7eff3006b2e0 0x7eff3006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:41.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.581+0000 7eff4a356700 1 --2- 172.21.15.134:0/3512015495 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7eff3006b2e0 0x7eff3006d790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009b80 tx=0x7eff3c00b040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:41.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.585+0000 7eff3affd700 1 -- 172.21.15.134:0/3512015495 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7eff34058a90 con 0x7eff440fe2b0 2024-02-16T22:20:41.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.802+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3512015495 --> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7eff44102c00 con 0x7eff3006b2e0 2024-02-16T22:20:41.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.803+0000 7eff3affd700 1 -- 172.21.15.134:0/3512015495 <== mgr.24371 v2:172.21.15.173:6828/2126919483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7eff44102c00 con 0x7eff3006b2e0 2024-02-16T22:20:41.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.805+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3512015495 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7eff3006b2e0 msgr2=0x7eff3006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.805+0000 7eff4c5ba700 1 --2- 172.21.15.134:0/3512015495 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7eff3006b2e0 0x7eff3006d790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009b80 tx=0x7eff3c00b040 comp rx=0 tx=0).stop 2024-02-16T22:20:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.805+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3512015495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff440fe2b0 msgr2=0x7eff4410dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.805+0000 7eff4c5ba700 1 --2- 172.21.15.134:0/3512015495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff440fe2b0 0x7eff4410dec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7eff34009b30 tx=0x7eff34009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.805+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3512015495 shutdown_connections 2024-02-16T22:20:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.805+0000 7eff4c5ba700 1 --2- 172.21.15.134:0/3512015495 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7eff3006b2e0 0x7eff3006d790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.805+0000 7eff4c5ba700 1 --2- 172.21.15.134:0/3512015495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff440fb220 0x7eff4410d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.805+0000 7eff4c5ba700 1 --2- 172.21.15.134:0/3512015495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff440fe2b0 0x7eff4410dec0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.806+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3512015495 >> 172.21.15.134:0/3512015495 conn(0x7eff440f6ca0 msgr2=0x7eff441014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.806+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3512015495 shutdown_connections 2024-02-16T22:20:41.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.806+0000 7eff4c5ba700 1 -- 172.21.15.134:0/3512015495 wait complete. 2024-02-16T22:20:41.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.910+0000 7fd1440f4700 1 -- 172.21.15.134:0/2016607853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c0fbe40 msgr2=0x7fd13c0fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:41.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.910+0000 7fd1440f4700 1 --2- 172.21.15.134:0/2016607853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c0fbe40 0x7fd13c0fc250 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd12c004940 tx=0x7fd12c009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:41.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.910+0000 7fd1440f4700 1 -- 172.21.15.134:0/2016607853 shutdown_connections 2024-02-16T22:20:41.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.910+0000 7fd1440f4700 1 --2- 172.21.15.134:0/2016607853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd13c0fcfb0 0x7fd13c0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.910+0000 7fd1440f4700 1 --2- 172.21.15.134:0/2016607853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c0fbe40 0x7fd13c0fc250 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.910+0000 7fd1440f4700 1 -- 172.21.15.134:0/2016607853 >> 172.21.15.134:0/2016607853 conn(0x7fd13c0f74e0 msgr2=0x7fd13c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:41.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.910+0000 7fd1440f4700 1 -- 172.21.15.134:0/2016607853 shutdown_connections 2024-02-16T22:20:41.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.910+0000 7fd1440f4700 1 -- 172.21.15.134:0/2016607853 wait complete. 2024-02-16T22:20:41.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.910+0000 7fd1440f4700 1 Processor -- start 2024-02-16T22:20:41.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.910+0000 7fd1440f4700 1 -- start start 2024-02-16T22:20:41.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd1440f4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c0fbe40 0x7fd13c0fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:41.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd1440f4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd13c0fcfb0 0x7fd13c0fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:41.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd1440f4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0fea10 con 0x7fd13c0fbe40 2024-02-16T22:20:41.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd1440f4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0feb80 con 0x7fd13c0fcfb0 2024-02-16T22:20:41.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd141e90700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c0fbe40 0x7fd13c0fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:41.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd141e90700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c0fbe40 0x7fd13c0fff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37926/0 (socket says 172.21.15.134:37926) 2024-02-16T22:20:41.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd141e90700 1 -- 172.21.15.134:0/769593729 learned_addr learned my addr 172.21.15.134:0/769593729 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:20:41.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd14168f700 1 --2- 172.21.15.134:0/769593729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd13c0fcfb0 0x7fd13c0fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:41.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd141e90700 1 -- 172.21.15.134:0/769593729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd13c0fcfb0 msgr2=0x7fd13c0fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:41.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd141e90700 1 --2- 172.21.15.134:0/769593729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd13c0fcfb0 0x7fd13c0fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:41.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd141e90700 1 -- 172.21.15.134:0/769593729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c005040 con 0x7fd13c0fbe40 2024-02-16T22:20:41.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd141e90700 1 --2- 172.21.15.134:0/769593729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c0fbe40 0x7fd13c0fff00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0093b0 tx=0x7fd12c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:41.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd1327fc700 1 -- 172.21.15.134:0/769593729 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd12c00e040 con 0x7fd13c0fbe40 2024-02-16T22:20:41.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd1327fc700 1 -- 172.21.15.134:0/769593729 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd12c00bcc0 con 0x7fd13c0fbe40 2024-02-16T22:20:41.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd1440f4700 1 -- 172.21.15.134:0/769593729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13c0fee00 con 0x7fd13c0fbe40 2024-02-16T22:20:41.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd1327fc700 1 -- 172.21.15.134:0/769593729 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd12c01c630 con 0x7fd13c0fbe40 2024-02-16T22:20:41.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.911+0000 7fd1440f4700 1 -- 172.21.15.134:0/769593729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13c115960 con 0x7fd13c0fbe40 2024-02-16T22:20:41.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.912+0000 7fd1440f4700 1 -- 172.21.15.134:0/769593729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13c04bed0 con 0x7fd13c0fbe40 2024-02-16T22:20:41.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.913+0000 7fd1327fc700 1 -- 172.21.15.134:0/769593729 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7fd12c0139f0 con 0x7fd13c0fbe40 2024-02-16T22:20:41.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.913+0000 7fd1327fc700 1 --2- 172.21.15.134:0/769593729 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fd12806b2e0 0x7fd12806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:41.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.913+0000 7fd1327fc700 1 -- 172.21.15.134:0/769593729 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd12c08b120 con 0x7fd13c0fbe40 2024-02-16T22:20:41.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.914+0000 7fd14168f700 1 --2- 172.21.15.134:0/769593729 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fd12806b2e0 0x7fd12806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:41.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.914+0000 7fd14168f700 1 --2- 172.21.15.134:0/769593729 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fd12806b2e0 0x7fd12806d790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd138006fd0 tx=0x7fd138008040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:41.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:41.918+0000 7fd1327fc700 1 -- 172.21.15.134:0/769593729 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fd12c058d20 con 0x7fd13c0fbe40 2024-02-16T22:20:42.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.129+0000 7fd1440f4700 1 -- 172.21.15.134:0/769593729 --> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd13c065dd0 con 0x7fd12806b2e0 2024-02-16T22:20:42.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.139+0000 7fd1327fc700 1 -- 172.21.15.134:0/769593729 <== mgr.24371 v2:172.21.15.173:6828/2126919483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd13c065dd0 con 0x7fd12806b2e0 2024-02-16T22:20:42.141 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:20:42.141 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 starting - - - - 2024-02-16T22:20:42.141 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (9m) 68s ago 9m 6660k - 17.2.7-513-gb88fae66 870a0944ccb8 a0d53bc0a925 2024-02-16T22:20:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (8m) 70s ago 8m 6669k - 17.2.7-513-gb88fae66 870a0944ccb8 a8d69537e08a 2024-02-16T22:20:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 starting - - - - 2024-02-16T22:20:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (4m) 68s ago 4m 11.7M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:20:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (4m) 68s ago 3m 160M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:20:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (3m) 70s ago 3m 14.9M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:20:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (4m) 70s ago 4m 193M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:20:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:9283 running (11m) 68s ago 11m 393M - 17.2.7-513-gb88fae66 870a0944ccb8 52095085178d 2024-02-16T22:20:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283 running (2m) 70s ago 8m 487M - 19.0.0-1450-gf78a58c0 f081f847070a 9d4cb8c4184e 2024-02-16T22:20:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (11m) 68s ago 11m 48.4M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 93a679740d93 2024-02-16T22:20:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (8m) 70s ago 8m 36.6M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 cfbef35950ef 2024-02-16T22:20:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 starting - - - - 2024-02-16T22:20:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 starting - - - - 2024-02-16T22:20:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (7m) 68s ago 7m 232M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 099f0b29d202 2024-02-16T22:20:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (7m) 68s ago 7m 245M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:20:42.143 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (6m) 68s ago 6m 200M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:20:42.143 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (6m) 70s ago 6m 282M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:20:42.143 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (5m) 70s ago 5m 227M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:20:42.143 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (5m) 70s ago 5m 297M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:20:42.143 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 starting - - - - 2024-02-16T22:20:42.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.141+0000 7fd1440f4700 1 -- 172.21.15.134:0/769593729 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fd12806b2e0 msgr2=0x7fd12806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:42.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.141+0000 7fd1440f4700 1 --2- 172.21.15.134:0/769593729 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fd12806b2e0 0x7fd12806d790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd138006fd0 tx=0x7fd138008040 comp rx=0 tx=0).stop 2024-02-16T22:20:42.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.141+0000 7fd1440f4700 1 -- 172.21.15.134:0/769593729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c0fbe40 msgr2=0x7fd13c0fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:42.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.141+0000 7fd1440f4700 1 --2- 172.21.15.134:0/769593729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c0fbe40 0x7fd13c0fff00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0093b0 tx=0x7fd12c009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:42.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.142+0000 7fd1440f4700 1 -- 172.21.15.134:0/769593729 shutdown_connections 2024-02-16T22:20:42.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.142+0000 7fd1440f4700 1 --2- 172.21.15.134:0/769593729 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fd12806b2e0 0x7fd12806d790 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.142+0000 7fd1440f4700 1 --2- 172.21.15.134:0/769593729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c0fbe40 0x7fd13c0fff00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.142+0000 7fd1440f4700 1 --2- 172.21.15.134:0/769593729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd13c0fcfb0 0x7fd13c0fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.142+0000 7fd1440f4700 1 -- 172.21.15.134:0/769593729 >> 172.21.15.134:0/769593729 conn(0x7fd13c0f74e0 msgr2=0x7fd13c0656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:42.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.142+0000 7fd1440f4700 1 -- 172.21.15.134:0/769593729 shutdown_connections 2024-02-16T22:20:42.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.142+0000 7fd1440f4700 1 -- 172.21.15.134:0/769593729 wait complete. 2024-02-16T22:20:42.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.242+0000 7f8380d83700 1 -- 172.21.15.134:0/506704841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c0fbe40 msgr2=0x7f837c0fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:42.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.242+0000 7f8380d83700 1 --2- 172.21.15.134:0/506704841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c0fbe40 0x7f837c0fc250 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8374009ce0 tx=0x7f8374004d10 comp rx=0 tx=0).stop 2024-02-16T22:20:42.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.242+0000 7f8380d83700 1 -- 172.21.15.134:0/506704841 shutdown_connections 2024-02-16T22:20:42.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.242+0000 7f8380d83700 1 --2- 172.21.15.134:0/506704841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f837c0fcfb0 0x7f837c0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.242+0000 7f8380d83700 1 --2- 172.21.15.134:0/506704841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c0fbe40 0x7f837c0fc250 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.242+0000 7f8380d83700 1 -- 172.21.15.134:0/506704841 >> 172.21.15.134:0/506704841 conn(0x7f837c0f7520 msgr2=0x7f837c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:42.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.242+0000 7f8380d83700 1 -- 172.21.15.134:0/506704841 shutdown_connections 2024-02-16T22:20:42.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.242+0000 7f8380d83700 1 -- 172.21.15.134:0/506704841 wait complete. 2024-02-16T22:20:42.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.243+0000 7f8380d83700 1 Processor -- start 2024-02-16T22:20:42.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.243+0000 7f8380d83700 1 -- start start 2024-02-16T22:20:42.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.243+0000 7f8380d83700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c0fbe40 0x7f837c10c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:42.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.243+0000 7f8380d83700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f837c0fcfb0 0x7f837c10cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:42.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.243+0000 7f8380d83700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c10d4e0 con 0x7f837c0fbe40 2024-02-16T22:20:42.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.243+0000 7f8380d83700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c10dd80 con 0x7f837c0fcfb0 2024-02-16T22:20:42.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.243+0000 7f837a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c0fbe40 0x7f837c10c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:42.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.243+0000 7f837a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c0fbe40 0x7f837c10c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37948/0 (socket says 172.21.15.134:37948) 2024-02-16T22:20:42.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.243+0000 7f837a59c700 1 -- 172.21.15.134:0/2418794662 learned_addr learned my addr 172.21.15.134:0/2418794662 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:20:42.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.243+0000 7f837a59c700 1 -- 172.21.15.134:0/2418794662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f837c0fcfb0 msgr2=0x7f837c10cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:42.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.243+0000 7f837a59c700 1 --2- 172.21.15.134:0/2418794662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f837c0fcfb0 0x7f837c10cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.243+0000 7f837a59c700 1 -- 172.21.15.134:0/2418794662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8374009940 con 0x7f837c0fbe40 2024-02-16T22:20:42.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.243+0000 7f837a59c700 1 --2- 172.21.15.134:0/2418794662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c0fbe40 0x7f837c10c9a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8374015040 tx=0x7f8374004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:42.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.244+0000 7f836affd700 1 -- 172.21.15.134:0/2418794662 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f837400e040 con 0x7f837c0fbe40 2024-02-16T22:20:42.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.244+0000 7f836affd700 1 -- 172.21.15.134:0/2418794662 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83740128e0 con 0x7f837c0fbe40 2024-02-16T22:20:42.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.244+0000 7f8380d83700 1 -- 172.21.15.134:0/2418794662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c10e000 con 0x7f837c0fbe40 2024-02-16T22:20:42.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.244+0000 7f836affd700 1 -- 172.21.15.134:0/2418794662 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f837401c840 con 0x7f837c0fbe40 2024-02-16T22:20:42.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.244+0000 7f8380d83700 1 -- 172.21.15.134:0/2418794662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c10e540 con 0x7f837c0fbe40 2024-02-16T22:20:42.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.245+0000 7f8380d83700 1 -- 172.21.15.134:0/2418794662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c04bed0 con 0x7f837c0fbe40 2024-02-16T22:20:42.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.245+0000 7f836affd700 1 -- 172.21.15.134:0/2418794662 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f8374012a50 con 0x7f837c0fbe40 2024-02-16T22:20:42.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.245+0000 7f836affd700 1 --2- 172.21.15.134:0/2418794662 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f836406b2e0 0x7f836406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:42.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.246+0000 7f836affd700 1 -- 172.21.15.134:0/2418794662 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f837408ba70 con 0x7f837c0fbe40 2024-02-16T22:20:42.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.246+0000 7f8379d9b700 1 --2- 172.21.15.134:0/2418794662 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f836406b2e0 0x7f836406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:42.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.246+0000 7f8379d9b700 1 --2- 172.21.15.134:0/2418794662 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f836406b2e0 0x7f836406d790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8370004d00 tx=0x7f8370009ce0 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:42.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.250+0000 7f836affd700 1 -- 172.21.15.134:0/2418794662 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f83740595b0 con 0x7f837c0fbe40 2024-02-16T22:20:42.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.537+0000 7f8380d83700 1 -- 172.21.15.134:0/2418794662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f837c10e870 con 0x7f837c0fbe40 2024-02-16T22:20:42.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.537+0000 7f836affd700 1 -- 172.21.15.134:0/2418794662 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f8374059140 con 0x7f837c0fbe40 2024-02-16T22:20:42.539 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:20:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:20:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 2 2024-02-16T22:20:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:20:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:20:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 1, 2024-02-16T22:20:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-16T22:20:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:20:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:20:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 6 2024-02-16T22:20:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:20:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:20:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:20:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:20:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:20:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 13, 2024-02-16T22:20:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-16T22:20:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:20:42.540 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:20:42.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.539+0000 7f8380d83700 1 -- 172.21.15.134:0/2418794662 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f836406b2e0 msgr2=0x7f836406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:42.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.539+0000 7f8380d83700 1 --2- 172.21.15.134:0/2418794662 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f836406b2e0 0x7f836406d790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8370004d00 tx=0x7f8370009ce0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.539+0000 7f8380d83700 1 -- 172.21.15.134:0/2418794662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c0fbe40 msgr2=0x7f837c10c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:42.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.539+0000 7f8380d83700 1 --2- 172.21.15.134:0/2418794662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c0fbe40 0x7f837c10c9a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8374015040 tx=0x7f8374004d10 comp rx=0 tx=0).stop 2024-02-16T22:20:42.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.539+0000 7f8380d83700 1 -- 172.21.15.134:0/2418794662 shutdown_connections 2024-02-16T22:20:42.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.539+0000 7f8380d83700 1 --2- 172.21.15.134:0/2418794662 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7f836406b2e0 0x7f836406d790 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.539+0000 7f8380d83700 1 --2- 172.21.15.134:0/2418794662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c0fbe40 0x7f837c10c9a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.539+0000 7f8380d83700 1 --2- 172.21.15.134:0/2418794662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f837c0fcfb0 0x7f837c10cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.539+0000 7f8380d83700 1 -- 172.21.15.134:0/2418794662 >> 172.21.15.134:0/2418794662 conn(0x7f837c0f7520 msgr2=0x7f837c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:42.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.539+0000 7f8380d83700 1 -- 172.21.15.134:0/2418794662 shutdown_connections 2024-02-16T22:20:42.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.539+0000 7f8380d83700 1 -- 172.21.15.134:0/2418794662 wait complete. 2024-02-16T22:20:42.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.641+0000 7fa39800b700 1 -- 172.21.15.134:0/3893749061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3900fe0e0 msgr2=0x7fa3900fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:42.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.641+0000 7fa39800b700 1 --2- 172.21.15.134:0/3893749061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3900fe0e0 0x7fa3900fe550 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa380004940 tx=0x7fa380009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:42.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.641+0000 7fa39800b700 1 -- 172.21.15.134:0/3893749061 shutdown_connections 2024-02-16T22:20:42.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.641+0000 7fa39800b700 1 --2- 172.21.15.134:0/3893749061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3900fe0e0 0x7fa3900fe550 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.641+0000 7fa39800b700 1 --2- 172.21.15.134:0/3893749061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3900fcef0 0x7fa3900fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.641+0000 7fa39800b700 1 -- 172.21.15.134:0/3893749061 >> 172.21.15.134:0/3893749061 conn(0x7fa3900f8620 msgr2=0x7fa3900faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:42.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.641+0000 7fa39800b700 1 -- 172.21.15.134:0/3893749061 shutdown_connections 2024-02-16T22:20:42.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.641+0000 7fa39800b700 1 -- 172.21.15.134:0/3893749061 wait complete. 2024-02-16T22:20:42.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.641+0000 7fa39800b700 1 Processor -- start 2024-02-16T22:20:42.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.641+0000 7fa39800b700 1 -- start start 2024-02-16T22:20:42.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.641+0000 7fa39800b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3900fcef0 0x7fa39010d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:42.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.641+0000 7fa39800b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3900fe0e0 0x7fa39010dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:42.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.641+0000 7fa39800b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39010e4a0 con 0x7fa3900fe0e0 2024-02-16T22:20:42.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.641+0000 7fa39800b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39010ed40 con 0x7fa3900fcef0 2024-02-16T22:20:42.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.642+0000 7fa3955a6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3900fe0e0 0x7fa39010dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:42.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.642+0000 7fa3955a6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3900fe0e0 0x7fa39010dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37964/0 (socket says 172.21.15.134:37964) 2024-02-16T22:20:42.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.642+0000 7fa3955a6700 1 -- 172.21.15.134:0/1013299921 learned_addr learned my addr 172.21.15.134:0/1013299921 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:20:42.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.642+0000 7fa395da7700 1 --2- 172.21.15.134:0/1013299921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3900fcef0 0x7fa39010d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:42.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.642+0000 7fa3955a6700 1 -- 172.21.15.134:0/1013299921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3900fcef0 msgr2=0x7fa39010d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:42.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.642+0000 7fa3955a6700 1 --2- 172.21.15.134:0/1013299921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3900fcef0 0x7fa39010d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.642+0000 7fa3955a6700 1 -- 172.21.15.134:0/1013299921 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa380005040 con 0x7fa3900fe0e0 2024-02-16T22:20:42.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:42.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-16T22:20:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-16T22:20:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-16T22:20:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-16T22:20:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:20:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:20:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:20:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: Upgrade: Need to upgrade myself (mgr.smithi173.kbofaa) 2024-02-16T22:20:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: Upgrade: Need to upgrade myself (mgr.smithi173.kbofaa) 2024-02-16T22:20:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: pgmap v43: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.1 KiB/s rd, 225 KiB/s wr, 65 op/s 2024-02-16T22:20:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:42 smithi134 ceph-mon[28869]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:42.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.642+0000 7fa3955a6700 1 --2- 172.21.15.134:0/1013299921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3900fe0e0 0x7fa39010dea0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa3800093b0 tx=0x7fa380009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:42.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.642+0000 7fa3867fc700 1 -- 172.21.15.134:0/1013299921 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa38000e040 con 0x7fa3900fe0e0 2024-02-16T22:20:42.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.642+0000 7fa39800b700 1 -- 172.21.15.134:0/1013299921 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39010efc0 con 0x7fa3900fe0e0 2024-02-16T22:20:42.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.642+0000 7fa3867fc700 1 -- 172.21.15.134:0/1013299921 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa38000bcc0 con 0x7fa3900fe0e0 2024-02-16T22:20:42.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.642+0000 7fa3867fc700 1 -- 172.21.15.134:0/1013299921 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa38001c630 con 0x7fa3900fe0e0 2024-02-16T22:20:42.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.643+0000 7fa39800b700 1 -- 172.21.15.134:0/1013299921 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39010f500 con 0x7fa3900fe0e0 2024-02-16T22:20:42.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.644+0000 7fa39800b700 1 -- 172.21.15.134:0/1013299921 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39004bed0 con 0x7fa3900fe0e0 2024-02-16T22:20:42.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.644+0000 7fa3867fc700 1 -- 172.21.15.134:0/1013299921 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7fa3800139f0 con 0x7fa3900fe0e0 2024-02-16T22:20:42.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.645+0000 7fa3867fc700 1 --2- 172.21.15.134:0/1013299921 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fa37c06b2e0 0x7fa37c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:20:42.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.645+0000 7fa3867fc700 1 -- 172.21.15.134:0/1013299921 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa38008b120 con 0x7fa3900fe0e0 2024-02-16T22:20:42.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.645+0000 7fa395da7700 1 --2- 172.21.15.134:0/1013299921 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fa37c06b2e0 0x7fa37c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:20:42.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.646+0000 7fa395da7700 1 --2- 172.21.15.134:0/1013299921 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fa37c06b2e0 0x7fa37c06d790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009fd0 tx=0x7fa38c009f00 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:20:42.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.649+0000 7fa3867fc700 1 -- 172.21.15.134:0/1013299921 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa380058d20 con 0x7fa3900fe0e0 2024-02-16T22:20:42.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.862+0000 7fa39800b700 1 -- 172.21.15.134:0/1013299921 --> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa39010f9a0 con 0x7fa37c06b2e0 2024-02-16T22:20:42.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.863+0000 7fa3867fc700 1 -- 172.21.15.134:0/1013299921 <== mgr.24371 v2:172.21.15.173:6828/2126919483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fa39010f9a0 con 0x7fa37c06b2e0 2024-02-16T22:20:42.865 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:20:42.865 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:20:42.866 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:20:42.866 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-16T22:20:42.866 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-02-16T22:20:42.866 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "1/2 daemons upgraded", 2024-02-16T22:20:42.866 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mgr daemons", 2024-02-16T22:20:42.866 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:20:42.866 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:20:42.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.865+0000 7fa39800b700 1 -- 172.21.15.134:0/1013299921 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fa37c06b2e0 msgr2=0x7fa37c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:42.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.865+0000 7fa39800b700 1 --2- 172.21.15.134:0/1013299921 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fa37c06b2e0 0x7fa37c06d790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009fd0 tx=0x7fa38c009f00 comp rx=0 tx=0).stop 2024-02-16T22:20:42.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.865+0000 7fa39800b700 1 -- 172.21.15.134:0/1013299921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3900fe0e0 msgr2=0x7fa39010dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:20:42.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.865+0000 7fa39800b700 1 --2- 172.21.15.134:0/1013299921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3900fe0e0 0x7fa39010dea0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa3800093b0 tx=0x7fa380009e30 comp rx=0 tx=0).stop 2024-02-16T22:20:42.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.866+0000 7fa39800b700 1 -- 172.21.15.134:0/1013299921 shutdown_connections 2024-02-16T22:20:42.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.866+0000 7fa39800b700 1 --2- 172.21.15.134:0/1013299921 >> [v2:172.21.15.173:6828/2126919483,v1:172.21.15.173:6829/2126919483] conn(0x7fa37c06b2e0 0x7fa37c06d790 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.866+0000 7fa39800b700 1 --2- 172.21.15.134:0/1013299921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3900fcef0 0x7fa39010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.866+0000 7fa39800b700 1 --2- 172.21.15.134:0/1013299921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3900fe0e0 0x7fa39010dea0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:20:42.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.866+0000 7fa39800b700 1 -- 172.21.15.134:0/1013299921 >> 172.21.15.134:0/1013299921 conn(0x7fa3900f8620 msgr2=0x7fa3901013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:20:42.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.866+0000 7fa39800b700 1 -- 172.21.15.134:0/1013299921 shutdown_connections 2024-02-16T22:20:42.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:20:42.866+0000 7fa39800b700 1 -- 172.21.15.134:0/1013299921 wait complete. 2024-02-16T22:20:42.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:42.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:42.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:42.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-16T22:20:42.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-16T22:20:42.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-16T22:20:42.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-16T22:20:42.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:20:42.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:20:42.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:20:42.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: Upgrade: Need to upgrade myself (mgr.smithi173.kbofaa) 2024-02-16T22:20:42.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: Upgrade: Need to upgrade myself (mgr.smithi173.kbofaa) 2024-02-16T22:20:42.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:42.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: pgmap v43: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.1 KiB/s rd, 225 KiB/s wr, 65 op/s 2024-02-16T22:20:42.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:42 smithi173 ceph-mon[37280]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:43.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:43 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/2418794662' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:20:43.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:43 smithi134 ceph-mon[28869]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:43.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:43 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:43.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:43 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.ordace", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:20:43.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:43 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.ordace", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:20:43.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:43 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:20:43.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:43 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:20:43.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:43 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/2418794662' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:20:43.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:43 smithi173 ceph-mon[37280]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:20:43.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:43 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:43.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:43 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.ordace", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:20:43.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:43 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.ordace", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:20:43.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:43 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:20:43.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:43 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:20:44.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:44 smithi134 ceph-mon[28869]: Upgrade: Updating mgr.smithi134.ordace 2024-02-16T22:20:44.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:44 smithi134 ceph-mon[28869]: Deploying daemon mgr.smithi134.ordace on smithi134 2024-02-16T22:20:44.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:44 smithi134 ceph-mon[28869]: pgmap v44: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.2 KiB/s rd, 225 KiB/s wr, 66 op/s 2024-02-16T22:20:44.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:44 smithi173 ceph-mon[37280]: Upgrade: Updating mgr.smithi134.ordace 2024-02-16T22:20:44.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:44 smithi173 ceph-mon[37280]: Deploying daemon mgr.smithi134.ordace on smithi134 2024-02-16T22:20:44.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:44 smithi173 ceph-mon[37280]: pgmap v44: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.2 KiB/s rd, 225 KiB/s wr, 66 op/s 2024-02-16T22:20:47.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:47 smithi134 ceph-mon[28869]: pgmap v45: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 5.0 KiB/s wr, 1 op/s 2024-02-16T22:20:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:47 smithi173 ceph-mon[37280]: pgmap v45: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 5.0 KiB/s wr, 1 op/s 2024-02-16T22:20:48.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:48 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:48.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:48 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:48.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:48 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:20:48.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:48 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:48.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:48 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:48.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:48 smithi173 ceph-mon[37280]: pgmap v46: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 5.0 KiB/s wr, 1 op/s 2024-02-16T22:20:48.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:48 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:48.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:48 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:48.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:48 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:20:48.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:48 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:48.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:48 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:48.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:48 smithi134 ceph-mon[28869]: pgmap v46: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 5.0 KiB/s wr, 1 op/s 2024-02-16T22:20:51.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:51 smithi134 ceph-mon[28869]: pgmap v47: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 5.0 KiB/s wr, 1 op/s 2024-02-16T22:20:51.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:51 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:51.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:51 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:51.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:51 smithi173 ceph-mon[37280]: pgmap v47: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 5.0 KiB/s wr, 1 op/s 2024-02-16T22:20:51.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:51 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:51.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:51 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:52.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:52 smithi134 ceph-mon[28869]: pgmap v48: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 511 B/s wr, 0 op/s 2024-02-16T22:20:52.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:52 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:20:52.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:52 smithi173 ceph-mon[37280]: pgmap v48: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 511 B/s wr, 0 op/s 2024-02-16T22:20:52.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:52 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:20:54.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:54 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:54.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:54 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:54.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:54 smithi134 ceph-mon[28869]: mgrmap e25: smithi173.kbofaa(active, since 91s), standbys: smithi134.ordace 2024-02-16T22:20:54.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:54 smithi134 ceph-mon[28869]: pgmap v49: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 1023 B/s wr, 1 op/s 2024-02-16T22:20:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:54 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:54 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:54 smithi173 ceph-mon[37280]: mgrmap e25: smithi173.kbofaa(active, since 91s), standbys: smithi134.ordace 2024-02-16T22:20:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:54 smithi173 ceph-mon[37280]: pgmap v49: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 1023 B/s wr, 1 op/s 2024-02-16T22:20:55.655 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:55 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:55.656 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:55 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:55.656 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:55 smithi173 ceph-mon[37280]: Standby manager daemon smithi134.ordace restarted 2024-02-16T22:20:55.656 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:55 smithi173 ceph-mon[37280]: Standby manager daemon smithi134.ordace started 2024-02-16T22:20:55.656 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:55 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.ordace/crt"}]: dispatch 2024-02-16T22:20:55.656 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:55 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-16T22:20:55.656 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:55 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.ordace/key"}]: dispatch 2024-02-16T22:20:55.656 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:55 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-16T22:20:55.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:55 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:55.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:55 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:55.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:55 smithi134 ceph-mon[28869]: Standby manager daemon smithi134.ordace restarted 2024-02-16T22:20:55.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:55 smithi134 ceph-mon[28869]: Standby manager daemon smithi134.ordace started 2024-02-16T22:20:55.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:55 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.ordace/crt"}]: dispatch 2024-02-16T22:20:55.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:55 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-16T22:20:55.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:55 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.ordace/key"}]: dispatch 2024-02-16T22:20:55.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:55 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-16T22:20:56.586 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:56 smithi173 ceph-mon[37280]: mgrmap e26: smithi173.kbofaa(active, since 93s), standbys: smithi134.ordace 2024-02-16T22:20:56.586 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:56 smithi173 ceph-mon[37280]: pgmap v50: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:20:56.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:56 smithi134 ceph-mon[28869]: mgrmap e26: smithi173.kbofaa(active, since 93s), standbys: smithi134.ordace 2024-02-16T22:20:56.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:56 smithi134 ceph-mon[28869]: pgmap v50: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:20:59.222 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:59.223 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:59.223 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:20:59.223 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:20:59.223 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:59.223 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:20:59.223 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mgr fail", "who": "smithi173.kbofaa"}]: dispatch 2024-02-16T22:20:59.223 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mgr fail", "who": "smithi173.kbofaa"}]: dispatch 2024-02-16T22:20:59.223 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: osdmap e48: 6 total, 6 up, 6 in 2024-02-16T22:20:59.223 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd='[{"prefix": "mgr fail", "who": "smithi173.kbofaa"}]': finished 2024-02-16T22:20:59.223 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: mgrmap e27: smithi134.ordace(active, starting, since 0.00687817s) 2024-02-16T22:20:59.223 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:20:59.223 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:20:59.223 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jyajef"}]: dispatch 2024-02-16T22:20:59.223 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:20:59.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.qljqef"}]: dispatch 2024-02-16T22:20:59.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.phstvm"}]: dispatch 2024-02-16T22:20:59.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr metadata", "who": "smithi134.ordace", "id": "smithi134.ordace"}]: dispatch 2024-02-16T22:20:59.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:20:59.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:20:59.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:20:59.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:20:59.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:20:59.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:20:59.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-16T22:20:59.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-16T22:20:59.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-16T22:20:59.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: Manager daemon smithi134.ordace is now available 2024-02-16T22:20:59.224 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:20:59.225 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:20:59.225 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:20:59.225 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/mirror_snapshot_schedule"}]: dispatch 2024-02-16T22:20:59.225 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:20:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/trash_purge_schedule"}]: dispatch 2024-02-16T22:20:59.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:59.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:59.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:20:59.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:20:59.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' 2024-02-16T22:20:59.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:20:59.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.24371 172.21.15.173:0/1474473630' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mgr fail", "who": "smithi173.kbofaa"}]: dispatch 2024-02-16T22:20:59.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "mgr fail", "who": "smithi173.kbofaa"}]: dispatch 2024-02-16T22:20:59.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: osdmap e48: 6 total, 6 up, 6 in 2024-02-16T22:20:59.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.24371 ' entity='mgr.smithi173.kbofaa' cmd='[{"prefix": "mgr fail", "who": "smithi173.kbofaa"}]': finished 2024-02-16T22:20:59.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: mgrmap e27: smithi134.ordace(active, starting, since 0.00687817s) 2024-02-16T22:20:59.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:20:59.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:20:59.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jyajef"}]: dispatch 2024-02-16T22:20:59.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:20:59.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.qljqef"}]: dispatch 2024-02-16T22:20:59.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.phstvm"}]: dispatch 2024-02-16T22:20:59.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr metadata", "who": "smithi134.ordace", "id": "smithi134.ordace"}]: dispatch 2024-02-16T22:20:59.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:20:59.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:20:59.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:20:59.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:20:59.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:20:59.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:20:59.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-16T22:20:59.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-16T22:20:59.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-16T22:20:59.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: Manager daemon smithi134.ordace is now available 2024-02-16T22:20:59.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:20:59.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:20:59.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:20:59.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/mirror_snapshot_schedule"}]: dispatch 2024-02-16T22:20:59.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:20:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/trash_purge_schedule"}]: dispatch 2024-02-16T22:21:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:00 smithi134 ceph-mon[28869]: mgrmap e28: smithi134.ordace(active, since 1.00968s) 2024-02-16T22:21:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:00 smithi134 ceph-mon[28869]: pgmap v3: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:00.364 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:00 smithi173 ceph-mon[37280]: mgrmap e28: smithi134.ordace(active, since 1.00968s) 2024-02-16T22:21:00.364 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:00 smithi173 ceph-mon[37280]: pgmap v3: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:01.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:01 smithi173 ceph-mon[37280]: [16/Feb/2024:22:20:59] ENGINE Bus STARTING 2024-02-16T22:21:01.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:01 smithi173 ceph-mon[37280]: [16/Feb/2024:22:20:59] ENGINE Serving on http://172.21.15.134:8765 2024-02-16T22:21:01.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:01 smithi173 ceph-mon[37280]: [16/Feb/2024:22:20:59] ENGINE Serving on https://172.21.15.134:7150 2024-02-16T22:21:01.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:01 smithi173 ceph-mon[37280]: [16/Feb/2024:22:20:59] ENGINE Bus STARTED 2024-02-16T22:21:01.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:01 smithi173 ceph-mon[37280]: pgmap v4: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:01.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:01 smithi134 ceph-mon[28869]: [16/Feb/2024:22:20:59] ENGINE Bus STARTING 2024-02-16T22:21:01.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:01 smithi134 ceph-mon[28869]: [16/Feb/2024:22:20:59] ENGINE Serving on http://172.21.15.134:8765 2024-02-16T22:21:01.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:01 smithi134 ceph-mon[28869]: [16/Feb/2024:22:20:59] ENGINE Serving on https://172.21.15.134:7150 2024-02-16T22:21:01.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:01 smithi134 ceph-mon[28869]: [16/Feb/2024:22:20:59] ENGINE Bus STARTED 2024-02-16T22:21:01.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:01 smithi134 ceph-mon[28869]: pgmap v4: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:02.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:02 smithi134 ceph-mon[28869]: mgrmap e29: smithi134.ordace(active, since 3s) 2024-02-16T22:21:02.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:02 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:02.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:02 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:02.479 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:02 smithi173 ceph-mon[37280]: mgrmap e29: smithi134.ordace(active, since 3s) 2024-02-16T22:21:02.479 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:02 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:02.479 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:02 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:03.226 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:03 smithi173 ceph-mon[37280]: pgmap v5: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:03.226 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:03 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:03.226 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:03 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:03.239 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:03 smithi134 ceph-mon[28869]: pgmap v5: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:03.239 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:03 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:03.239 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:03 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:04.941 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:04 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:04.942 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:04 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:04.942 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:04 smithi173 ceph-mon[37280]: pgmap v6: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:04.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:04 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:04.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:04 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:04.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:04 smithi134 ceph-mon[28869]: pgmap v6: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:05 smithi134 ceph-mon[28869]: Standby manager daemon smithi173.kbofaa started 2024-02-16T22:21:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:05 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/794352984' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/crt"}]: dispatch 2024-02-16T22:21:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:05 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/794352984' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-16T22:21:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:05 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/794352984' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/key"}]: dispatch 2024-02-16T22:21:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:05 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/794352984' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-16T22:21:06.090 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:06.090 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:06.090 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:05 smithi173 ceph-mon[37280]: Standby manager daemon smithi173.kbofaa started 2024-02-16T22:21:06.090 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:05 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/794352984' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/crt"}]: dispatch 2024-02-16T22:21:06.090 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:05 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/794352984' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-16T22:21:06.090 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:05 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/794352984' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/key"}]: dispatch 2024-02-16T22:21:06.090 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:05 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/794352984' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-16T22:21:06.975 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:06 smithi134 ceph-mon[28869]: mgrmap e30: smithi134.ordace(active, since 7s), standbys: smithi173.kbofaa 2024-02-16T22:21:06.975 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:06 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr metadata", "who": "smithi173.kbofaa", "id": "smithi173.kbofaa"}]: dispatch 2024-02-16T22:21:06.975 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:06 smithi134 ceph-mon[28869]: pgmap v7: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-16T22:21:06.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:06 smithi173 ceph-mon[37280]: mgrmap e30: smithi134.ordace(active, since 7s), standbys: smithi173.kbofaa 2024-02-16T22:21:06.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:06 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr metadata", "who": "smithi173.kbofaa", "id": "smithi173.kbofaa"}]: dispatch 2024-02-16T22:21:06.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:06 smithi173 ceph-mon[37280]: pgmap v7: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-16T22:21:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:09 smithi134 ceph-mon[28869]: pgmap v8: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-16T22:21:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:09 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:09 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:09 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:21:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:09 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:21:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:09 smithi173 ceph-mon[37280]: pgmap v8: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-16T22:21:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:09 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:09 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:09 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:21:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:09 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:21:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:10 smithi134 ceph-mon[28869]: Updating smithi134:/etc/ceph/ceph.conf 2024-02-16T22:21:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:10 smithi134 ceph-mon[28869]: Updating smithi173:/etc/ceph/ceph.conf 2024-02-16T22:21:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:10 smithi134 ceph-mon[28869]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:21:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:10 smithi134 ceph-mon[28869]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:21:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:10 smithi134 ceph-mon[28869]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:21:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:10 smithi134 ceph-mon[28869]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:21:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:10 smithi134 ceph-mon[28869]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-16T22:21:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:10 smithi134 ceph-mon[28869]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-16T22:21:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:10 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:10 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:10 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:10 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:10 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:10 smithi173 ceph-mon[37280]: Updating smithi134:/etc/ceph/ceph.conf 2024-02-16T22:21:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:10 smithi173 ceph-mon[37280]: Updating smithi173:/etc/ceph/ceph.conf 2024-02-16T22:21:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:10 smithi173 ceph-mon[37280]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:21:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:10 smithi173 ceph-mon[37280]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:21:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:10 smithi173 ceph-mon[37280]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:21:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:10 smithi173 ceph-mon[37280]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:21:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:10 smithi173 ceph-mon[37280]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-16T22:21:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:10 smithi173 ceph-mon[37280]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-16T22:21:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:10 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:10 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:10 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:10 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:10 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:11.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:11 smithi134 ceph-mon[28869]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-02-16T22:21:11.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:11 smithi134 ceph-mon[28869]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-02-16T22:21:11.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:11 smithi134 ceph-mon[28869]: pgmap v9: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-16T22:21:11.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:11 smithi173 ceph-mon[37280]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-02-16T22:21:11.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:11 smithi173 ceph-mon[37280]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-02-16T22:21:11.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:11 smithi173 ceph-mon[37280]: pgmap v9: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-16T22:21:12.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:12 smithi134 ceph-mon[28869]: pgmap v10: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-16T22:21:12.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:12 smithi173 ceph-mon[37280]: pgmap v10: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-16T22:21:12.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.979+0000 7f8d10cb3700 1 -- 172.21.15.134:0/672949400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d0c0fcfb0 msgr2=0x7f8d0c0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:12.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.979+0000 7f8d10cb3700 1 --2- 172.21.15.134:0/672949400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d0c0fcfb0 0x7f8d0c0fd420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8d00004940 tx=0x7f8d00009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:12.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.979+0000 7f8d10cb3700 1 -- 172.21.15.134:0/672949400 shutdown_connections 2024-02-16T22:21:12.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.979+0000 7f8d10cb3700 1 --2- 172.21.15.134:0/672949400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d0c0fcfb0 0x7f8d0c0fd420 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:12.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.979+0000 7f8d10cb3700 1 --2- 172.21.15.134:0/672949400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d0c0fbe40 0x7f8d0c0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:12.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.979+0000 7f8d10cb3700 1 -- 172.21.15.134:0/672949400 >> 172.21.15.134:0/672949400 conn(0x7f8d0c0f7520 msgr2=0x7f8d0c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:12.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.979+0000 7f8d10cb3700 1 -- 172.21.15.134:0/672949400 shutdown_connections 2024-02-16T22:21:12.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.979+0000 7f8d10cb3700 1 -- 172.21.15.134:0/672949400 wait complete. 2024-02-16T22:21:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.980+0000 7f8d10cb3700 1 Processor -- start 2024-02-16T22:21:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.980+0000 7f8d10cb3700 1 -- start start 2024-02-16T22:21:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.980+0000 7f8d10cb3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d0c0fbe40 0x7f8d0c10c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.980+0000 7f8d10cb3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d0c0fcfb0 0x7f8d0c10cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.980+0000 7f8d10cb3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c10d3f0 con 0x7f8d0c0fbe40 2024-02-16T22:21:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.980+0000 7f8d10cb3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c10dc30 con 0x7f8d0c0fcfb0 2024-02-16T22:21:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.980+0000 7f8d0a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d0c0fbe40 0x7f8d0c10c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.980+0000 7f8d0a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d0c0fbe40 0x7f8d0c10c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48214/0 (socket says 172.21.15.134:48214) 2024-02-16T22:21:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.980+0000 7f8d0a59c700 1 -- 172.21.15.134:0/1351797552 learned_addr learned my addr 172.21.15.134:0/1351797552 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:21:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.980+0000 7f8d09d9b700 1 --2- 172.21.15.134:0/1351797552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d0c0fcfb0 0x7f8d0c10cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.981+0000 7f8d0a59c700 1 -- 172.21.15.134:0/1351797552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d0c0fcfb0 msgr2=0x7f8d0c10cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.981+0000 7f8d0a59c700 1 --2- 172.21.15.134:0/1351797552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d0c0fcfb0 0x7f8d0c10cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:12.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.981+0000 7f8d0a59c700 1 -- 172.21.15.134:0/1351797552 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d00005040 con 0x7f8d0c0fbe40 2024-02-16T22:21:12.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.981+0000 7f8d0a59c700 1 --2- 172.21.15.134:0/1351797552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d0c0fbe40 0x7f8d0c10c820 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00b790 tx=0x7f8cfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:12.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.981+0000 7f8cfaffd700 1 -- 172.21.15.134:0/1351797552 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cfc00f6f0 con 0x7f8d0c0fbe40 2024-02-16T22:21:12.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.981+0000 7f8cfaffd700 1 -- 172.21.15.134:0/1351797552 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8cfc00fd20 con 0x7f8d0c0fbe40 2024-02-16T22:21:12.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.981+0000 7f8cfaffd700 1 -- 172.21.15.134:0/1351797552 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cfc0103a0 con 0x7f8d0c0fbe40 2024-02-16T22:21:12.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.981+0000 7f8d10cb3700 1 -- 172.21.15.134:0/1351797552 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0c10df10 con 0x7f8d0c0fbe40 2024-02-16T22:21:12.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.981+0000 7f8d10cb3700 1 -- 172.21.15.134:0/1351797552 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0c10e450 con 0x7f8d0c0fbe40 2024-02-16T22:21:12.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.982+0000 7f8d10cb3700 1 -- 172.21.15.134:0/1351797552 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0c04bed0 con 0x7f8d0c0fbe40 2024-02-16T22:21:12.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.983+0000 7f8cfaffd700 1 -- 172.21.15.134:0/1351797552 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 30) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f8cfc011400 con 0x7f8d0c0fbe40 2024-02-16T22:21:12.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.983+0000 7f8cfaffd700 1 --2- 172.21.15.134:0/1351797552 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f8cf406d200 0x7f8cf406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:12.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.983+0000 7f8cfaffd700 1 -- 172.21.15.134:0/1351797552 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8cfc08c4c0 con 0x7f8d0c0fbe40 2024-02-16T22:21:12.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.983+0000 7f8d09d9b700 1 --2- 172.21.15.134:0/1351797552 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f8cf406d200 0x7f8cf406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:12.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.984+0000 7f8d09d9b700 1 --2- 172.21.15.134:0/1351797552 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f8cf406d200 0x7f8cf406f6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000b3b0 tx=0x7f8d00009e30 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:12.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:12.988+0000 7f8cfaffd700 1 -- 172.21.15.134:0/1351797552 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8cfc05a000 con 0x7f8d0c0fbe40 2024-02-16T22:21:13.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.203+0000 7f8d10cb3700 1 -- 172.21.15.134:0/1351797552 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d0c101990 con 0x7f8cf406d200 2024-02-16T22:21:13.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.207+0000 7f8cfaffd700 1 -- 172.21.15.134:0/1351797552 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f8d0c101990 con 0x7f8cf406d200 2024-02-16T22:21:13.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.209+0000 7f8d10cb3700 1 -- 172.21.15.134:0/1351797552 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f8cf406d200 msgr2=0x7f8cf406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:13.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.209+0000 7f8d10cb3700 1 --2- 172.21.15.134:0/1351797552 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f8cf406d200 0x7f8cf406f6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000b3b0 tx=0x7f8d00009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:13.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.209+0000 7f8d10cb3700 1 -- 172.21.15.134:0/1351797552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d0c0fbe40 msgr2=0x7f8d0c10c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:13.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.209+0000 7f8d10cb3700 1 --2- 172.21.15.134:0/1351797552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d0c0fbe40 0x7f8d0c10c820 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00b790 tx=0x7f8cfc009250 comp rx=0 tx=0).stop 2024-02-16T22:21:13.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.209+0000 7f8d10cb3700 1 -- 172.21.15.134:0/1351797552 shutdown_connections 2024-02-16T22:21:13.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.209+0000 7f8d10cb3700 1 --2- 172.21.15.134:0/1351797552 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f8cf406d200 0x7f8cf406f6b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.209+0000 7f8d10cb3700 1 --2- 172.21.15.134:0/1351797552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d0c0fbe40 0x7f8d0c10c820 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.209+0000 7f8d10cb3700 1 --2- 172.21.15.134:0/1351797552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d0c0fcfb0 0x7f8d0c10cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.209+0000 7f8d10cb3700 1 -- 172.21.15.134:0/1351797552 >> 172.21.15.134:0/1351797552 conn(0x7f8d0c0f7520 msgr2=0x7f8d0c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:13.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.209+0000 7f8d10cb3700 1 -- 172.21.15.134:0/1351797552 shutdown_connections 2024-02-16T22:21:13.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.209+0000 7f8d10cb3700 1 -- 172.21.15.134:0/1351797552 wait complete. 2024-02-16T22:21:13.221 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:21:13.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.311+0000 7f9117892700 1 -- 172.21.15.134:0/155079203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91100fcfb0 msgr2=0x7f91100fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:13.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.311+0000 7f9117892700 1 --2- 172.21.15.134:0/155079203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91100fcfb0 0x7f91100fd420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9100004940 tx=0x7f9100009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:13.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.311+0000 7f9117892700 1 -- 172.21.15.134:0/155079203 shutdown_connections 2024-02-16T22:21:13.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.311+0000 7f9117892700 1 --2- 172.21.15.134:0/155079203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91100fcfb0 0x7f91100fd420 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.311+0000 7f9117892700 1 --2- 172.21.15.134:0/155079203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91100fbe40 0x7f91100fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.311+0000 7f9117892700 1 -- 172.21.15.134:0/155079203 >> 172.21.15.134:0/155079203 conn(0x7f91100f74e0 msgr2=0x7f91100f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:13.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.311+0000 7f9117892700 1 -- 172.21.15.134:0/155079203 shutdown_connections 2024-02-16T22:21:13.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.311+0000 7f9117892700 1 -- 172.21.15.134:0/155079203 wait complete. 2024-02-16T22:21:13.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.311+0000 7f9117892700 1 Processor -- start 2024-02-16T22:21:13.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.311+0000 7f9117892700 1 -- start start 2024-02-16T22:21:13.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f9117892700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91100fbe40 0x7f91100fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:13.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f9117892700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91100fcfb0 0x7f91100fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:13.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f9117892700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91100fe980 con 0x7f91100fbe40 2024-02-16T22:21:13.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f9117892700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91100feaf0 con 0x7f91100fcfb0 2024-02-16T22:21:13.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f911562e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91100fbe40 0x7f91100fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:13.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f911562e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91100fbe40 0x7f91100fff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48228/0 (socket says 172.21.15.134:48228) 2024-02-16T22:21:13.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f911562e700 1 -- 172.21.15.134:0/1161657163 learned_addr learned my addr 172.21.15.134:0/1161657163 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:21:13.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f9114e2d700 1 --2- 172.21.15.134:0/1161657163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91100fcfb0 0x7f91100fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:13.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f911562e700 1 -- 172.21.15.134:0/1161657163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91100fcfb0 msgr2=0x7f91100fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:13.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f911562e700 1 --2- 172.21.15.134:0/1161657163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91100fcfb0 0x7f91100fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f911562e700 1 -- 172.21.15.134:0/1161657163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9100005040 con 0x7f91100fbe40 2024-02-16T22:21:13.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f9114e2d700 1 --2- 172.21.15.134:0/1161657163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91100fcfb0 0x7f91100fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:21:13.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f911562e700 1 --2- 172.21.15.134:0/1161657163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91100fbe40 0x7f91100fff00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f910c00c830 tx=0x7f910c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:13.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f9105ffb700 1 -- 172.21.15.134:0/1161657163 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f910c00a760 con 0x7f91100fbe40 2024-02-16T22:21:13.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f9105ffb700 1 -- 172.21.15.134:0/1161657163 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f910c00ad90 con 0x7f91100fbe40 2024-02-16T22:21:13.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f9117892700 1 -- 172.21.15.134:0/1161657163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91100fedd0 con 0x7f91100fbe40 2024-02-16T22:21:13.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.312+0000 7f9105ffb700 1 -- 172.21.15.134:0/1161657163 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f910c0113a0 con 0x7f91100fbe40 2024-02-16T22:21:13.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.313+0000 7f9117892700 1 -- 172.21.15.134:0/1161657163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9110115990 con 0x7f91100fbe40 2024-02-16T22:21:13.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.313+0000 7f9117892700 1 -- 172.21.15.134:0/1161657163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911004bed0 con 0x7f91100fbe40 2024-02-16T22:21:13.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.314+0000 7f9105ffb700 1 -- 172.21.15.134:0/1161657163 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 30) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f910c012400 con 0x7f91100fbe40 2024-02-16T22:21:13.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.314+0000 7f9105ffb700 1 --2- 172.21.15.134:0/1161657163 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f90fc06d200 0x7f90fc06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:13.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.314+0000 7f9114e2d700 1 --2- 172.21.15.134:0/1161657163 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f90fc06d200 0x7f90fc06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:13.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.314+0000 7f9105ffb700 1 -- 172.21.15.134:0/1161657163 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f910c08c650 con 0x7f91100fbe40 2024-02-16T22:21:13.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.315+0000 7f9114e2d700 1 --2- 172.21.15.134:0/1161657163 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f90fc06d200 0x7f90fc06f6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9100000c00 tx=0x7f9100009e30 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:13.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.319+0000 7f9105ffb700 1 -- 172.21.15.134:0/1161657163 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f910c05a230 con 0x7f91100fbe40 2024-02-16T22:21:13.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.552+0000 7f9117892700 1 -- 172.21.15.134:0/1161657163 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9110065dd0 con 0x7f90fc06d200 2024-02-16T22:21:13.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.553+0000 7f9105ffb700 1 -- 172.21.15.134:0/1161657163 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f9110065dd0 con 0x7f90fc06d200 2024-02-16T22:21:13.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.555+0000 7f9117892700 1 -- 172.21.15.134:0/1161657163 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f90fc06d200 msgr2=0x7f90fc06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:13.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.555+0000 7f9117892700 1 --2- 172.21.15.134:0/1161657163 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f90fc06d200 0x7f90fc06f6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9100000c00 tx=0x7f9100009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:13.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.555+0000 7f9117892700 1 -- 172.21.15.134:0/1161657163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91100fbe40 msgr2=0x7f91100fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:13.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.555+0000 7f9117892700 1 --2- 172.21.15.134:0/1161657163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91100fbe40 0x7f91100fff00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f910c00c830 tx=0x7f910c004470 comp rx=0 tx=0).stop 2024-02-16T22:21:13.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.555+0000 7f9117892700 1 -- 172.21.15.134:0/1161657163 shutdown_connections 2024-02-16T22:21:13.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.555+0000 7f9117892700 1 --2- 172.21.15.134:0/1161657163 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f90fc06d200 0x7f90fc06f6b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.555+0000 7f9117892700 1 --2- 172.21.15.134:0/1161657163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91100fbe40 0x7f91100fff00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.555+0000 7f9117892700 1 --2- 172.21.15.134:0/1161657163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91100fcfb0 0x7f91100fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.555+0000 7f9117892700 1 -- 172.21.15.134:0/1161657163 >> 172.21.15.134:0/1161657163 conn(0x7f91100f74e0 msgr2=0x7f91100656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:13.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.555+0000 7f9117892700 1 -- 172.21.15.134:0/1161657163 shutdown_connections 2024-02-16T22:21:13.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.555+0000 7f9117892700 1 -- 172.21.15.134:0/1161657163 wait complete. 2024-02-16T22:21:13.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.657+0000 7fa8056b5700 1 -- 172.21.15.134:0/2162940249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa800108b60 msgr2=0x7fa800108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:13.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.657+0000 7fa8056b5700 1 --2- 172.21.15.134:0/2162940249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa800108b60 0x7fa800108fb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8004940 tx=0x7fa7e8009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:13.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.657+0000 7fa8056b5700 1 -- 172.21.15.134:0/2162940249 shutdown_connections 2024-02-16T22:21:13.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.657+0000 7fa8056b5700 1 --2- 172.21.15.134:0/2162940249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa800108b60 0x7fa800108fb0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.657+0000 7fa8056b5700 1 --2- 172.21.15.134:0/2162940249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa800107950 0x7fa800107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.657+0000 7fa8056b5700 1 -- 172.21.15.134:0/2162940249 >> 172.21.15.134:0/2162940249 conn(0x7fa8000672f0 msgr2=0x7fa800067710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:13.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.657+0000 7fa8056b5700 1 -- 172.21.15.134:0/2162940249 shutdown_connections 2024-02-16T22:21:13.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.657+0000 7fa8056b5700 1 -- 172.21.15.134:0/2162940249 wait complete. 2024-02-16T22:21:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.658+0000 7fa8056b5700 1 Processor -- start 2024-02-16T22:21:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.658+0000 7fa8056b5700 1 -- start start 2024-02-16T22:21:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.658+0000 7fa8056b5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa800107950 0x7fa8001183d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.658+0000 7fa8056b5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa800108b60 0x7fa800118910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.658+0000 7fa8056b5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa800118f10 con 0x7fa800108b60 2024-02-16T22:21:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.658+0000 7fa8056b5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8001197b0 con 0x7fa800107950 2024-02-16T22:21:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.658+0000 7fa7fe7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa800108b60 0x7fa800118910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.658+0000 7fa7fe7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa800108b60 0x7fa800118910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48244/0 (socket says 172.21.15.134:48244) 2024-02-16T22:21:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.658+0000 7fa7fe7fc700 1 -- 172.21.15.134:0/1003807797 learned_addr learned my addr 172.21.15.134:0/1003807797 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:21:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.658+0000 7fa7feffd700 1 --2- 172.21.15.134:0/1003807797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa800107950 0x7fa8001183d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.659+0000 7fa7fe7fc700 1 -- 172.21.15.134:0/1003807797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa800107950 msgr2=0x7fa8001183d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.659+0000 7fa7fe7fc700 1 --2- 172.21.15.134:0/1003807797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa800107950 0x7fa8001183d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.659+0000 7fa7fe7fc700 1 -- 172.21.15.134:0/1003807797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e8005040 con 0x7fa800108b60 2024-02-16T22:21:13.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.659+0000 7fa7fe7fc700 1 --2- 172.21.15.134:0/1003807797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa800108b60 0x7fa800118910 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800b3b0 tx=0x7fa7e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:13.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.659+0000 7fa7f77fe700 1 -- 172.21.15.134:0/1003807797 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e800e040 con 0x7fa800108b60 2024-02-16T22:21:13.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.659+0000 7fa7f77fe700 1 -- 172.21.15.134:0/1003807797 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7e800bbf0 con 0x7fa800108b60 2024-02-16T22:21:13.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.659+0000 7fa8056b5700 1 -- 172.21.15.134:0/1003807797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa800119a30 con 0x7fa800108b60 2024-02-16T22:21:13.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.659+0000 7fa7f77fe700 1 -- 172.21.15.134:0/1003807797 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e801c630 con 0x7fa800108b60 2024-02-16T22:21:13.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.659+0000 7fa8056b5700 1 -- 172.21.15.134:0/1003807797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa800119f70 con 0x7fa800108b60 2024-02-16T22:21:13.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.660+0000 7fa8056b5700 1 -- 172.21.15.134:0/1003807797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80004bed0 con 0x7fa800108b60 2024-02-16T22:21:13.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.661+0000 7fa7f77fe700 1 -- 172.21.15.134:0/1003807797 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 30) v1 ==== 91311+0+0 (secure 0 0 0) 0x7fa7e8013420 con 0x7fa800108b60 2024-02-16T22:21:13.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.661+0000 7fa7f77fe700 1 --2- 172.21.15.134:0/1003807797 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa7ec06d200 0x7fa7ec06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:13.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.661+0000 7fa7f77fe700 1 -- 172.21.15.134:0/1003807797 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa7e808db80 con 0x7fa800108b60 2024-02-16T22:21:13.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.661+0000 7fa7feffd700 1 --2- 172.21.15.134:0/1003807797 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa7ec06d200 0x7fa7ec06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:13.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.662+0000 7fa7feffd700 1 --2- 172.21.15.134:0/1003807797 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa7ec06d200 0x7fa7ec06f6b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0004550 tx=0x7fa7f0007ed0 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:13.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.666+0000 7fa7f77fe700 1 -- 172.21.15.134:0/1003807797 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa7e805b5b0 con 0x7fa800108b60 2024-02-16T22:21:13.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.878+0000 7fa8056b5700 1 -- 172.21.15.134:0/1003807797 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa80011a380 con 0x7fa7ec06d200 2024-02-16T22:21:13.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:13 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:21:13.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.888+0000 7fa7f77fe700 1 -- 172.21.15.134:0/1003807797 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa80011a380 con 0x7fa7ec06d200 2024-02-16T22:21:13.890 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:21:13.890 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (83s) 10s ago 10m 18.7M - 0.25.0 c8568f914cd2 6535c13e765a 2024-02-16T22:21:13.890 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (10m) 10s ago 10m 6660k - 17.2.7-513-gb88fae66 870a0944ccb8 a0d53bc0a925 2024-02-16T22:21:13.890 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (9m) 12s ago 9m 6669k - 17.2.7-513-gb88fae66 870a0944ccb8 a8d69537e08a 2024-02-16T22:21:13.890 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (45s) 10s ago 9m 75.7M - 9.4.7 954c08fa6188 4e6d36fb67d5 2024-02-16T22:21:13.890 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (4m) 10s ago 4m 12.3M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:21:13.890 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (4m) 10s ago 4m 126M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:21:13.890 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (4m) 12s ago 4m 15.4M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:21:13.891 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (4m) 12s ago 4m 119M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:21:13.891 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (27s) 10s ago 11m 472M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:21:13.891 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283 running (2m) 12s ago 9m 73.7M - 19.0.0-1450-gf78a58c0 f081f847070a 9d4cb8c4184e 2024-02-16T22:21:13.891 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (11m) 10s ago 11m 51.7M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 93a679740d93 2024-02-16T22:21:13.891 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (9m) 12s ago 9m 39.4M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 cfbef35950ef 2024-02-16T22:21:13.891 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (89s) 10s ago 10m 8950k - 1.5.0 0da6a335fe13 a70804c4f993 2024-02-16T22:21:13.891 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (35s) 12s ago 9m 13.0M - 1.5.0 0da6a335fe13 6e025ebe7e31 2024-02-16T22:21:13.891 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (8m) 10s ago 8m 217M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 099f0b29d202 2024-02-16T22:21:13.891 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (7m) 10s ago 7m 231M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:21:13.891 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (7m) 10s ago 7m 188M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:21:13.891 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (6m) 12s ago 6m 264M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:21:13.891 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (6m) 12s ago 6m 235M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:21:13.891 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (6m) 12s ago 6m 227M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:21:13.891 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (39s) 10s ago 9m 46.4M - 2.43.0 a07b618ecd1d 9c1036f566c2 2024-02-16T22:21:13.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.890+0000 7fa8056b5700 1 -- 172.21.15.134:0/1003807797 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa7ec06d200 msgr2=0x7fa7ec06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:13.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.890+0000 7fa8056b5700 1 --2- 172.21.15.134:0/1003807797 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa7ec06d200 0x7fa7ec06f6b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0004550 tx=0x7fa7f0007ed0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.890+0000 7fa8056b5700 1 -- 172.21.15.134:0/1003807797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa800108b60 msgr2=0x7fa800118910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:13.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.890+0000 7fa8056b5700 1 --2- 172.21.15.134:0/1003807797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa800108b60 0x7fa800118910 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800b3b0 tx=0x7fa7e8009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:13.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.890+0000 7fa8056b5700 1 -- 172.21.15.134:0/1003807797 shutdown_connections 2024-02-16T22:21:13.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.890+0000 7fa8056b5700 1 --2- 172.21.15.134:0/1003807797 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa7ec06d200 0x7fa7ec06f6b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.890+0000 7fa8056b5700 1 --2- 172.21.15.134:0/1003807797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa800107950 0x7fa8001183d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.890+0000 7fa8056b5700 1 --2- 172.21.15.134:0/1003807797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa800108b60 0x7fa800118910 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.890+0000 7fa8056b5700 1 -- 172.21.15.134:0/1003807797 >> 172.21.15.134:0/1003807797 conn(0x7fa8000672f0 msgr2=0x7fa80010bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:13.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.891+0000 7fa8056b5700 1 -- 172.21.15.134:0/1003807797 shutdown_connections 2024-02-16T22:21:13.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.891+0000 7fa8056b5700 1 -- 172.21.15.134:0/1003807797 wait complete. 2024-02-16T22:21:13.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:13 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:21:13.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.991+0000 7f7803f38700 1 -- 172.21.15.134:0/4123474359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77fc0fcef0 msgr2=0x7f77fc0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:13.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.991+0000 7f7803f38700 1 --2- 172.21.15.134:0/4123474359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77fc0fcef0 0x7f77fc0fd320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f77f8004940 tx=0x7f77f8009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:13.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.992+0000 7f7803f38700 1 -- 172.21.15.134:0/4123474359 shutdown_connections 2024-02-16T22:21:13.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.992+0000 7f7803f38700 1 --2- 172.21.15.134:0/4123474359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77fc0fe0e0 0x7f77fc0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.992+0000 7f7803f38700 1 --2- 172.21.15.134:0/4123474359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77fc0fcef0 0x7f77fc0fd320 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.992+0000 7f7803f38700 1 -- 172.21.15.134:0/4123474359 >> 172.21.15.134:0/4123474359 conn(0x7f77fc0f8620 msgr2=0x7f77fc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:13.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.992+0000 7f7803f38700 1 -- 172.21.15.134:0/4123474359 shutdown_connections 2024-02-16T22:21:13.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.992+0000 7f7803f38700 1 -- 172.21.15.134:0/4123474359 wait complete. 2024-02-16T22:21:13.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.992+0000 7f7803f38700 1 Processor -- start 2024-02-16T22:21:13.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.992+0000 7f7803f38700 1 -- start start 2024-02-16T22:21:13.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.992+0000 7f7803f38700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77fc0fcef0 0x7f77fc071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.992+0000 7f7803f38700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77fc0fe0e0 0x7f77fc0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.992+0000 7f7803f38700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc0708e0 con 0x7f77fc0fe0e0 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.992+0000 7f7803f38700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc070a50 con 0x7f77fc0fcef0 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.993+0000 7f78014d3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77fc0fe0e0 0x7f77fc0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.993+0000 7f78014d3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77fc0fe0e0 0x7f77fc0702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48264/0 (socket says 172.21.15.134:48264) 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.993+0000 7f78014d3700 1 -- 172.21.15.134:0/3329266522 learned_addr learned my addr 172.21.15.134:0/3329266522 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.993+0000 7f7801cd4700 1 --2- 172.21.15.134:0/3329266522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77fc0fcef0 0x7f77fc071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.993+0000 7f78014d3700 1 -- 172.21.15.134:0/3329266522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77fc0fcef0 msgr2=0x7f77fc071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.993+0000 7f78014d3700 1 --2- 172.21.15.134:0/3329266522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77fc0fcef0 0x7f77fc071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.993+0000 7f78014d3700 1 -- 172.21.15.134:0/3329266522 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8005040 con 0x7f77fc0fe0e0 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.993+0000 7f78014d3700 1 --2- 172.21.15.134:0/3329266522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77fc0fe0e0 0x7f77fc0702e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00c830 tx=0x7f77ec004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.993+0000 7f77f27fc700 1 -- 172.21.15.134:0/3329266522 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77ec00a760 con 0x7f77fc0fe0e0 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.993+0000 7f7803f38700 1 -- 172.21.15.134:0/3329266522 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77fc070d30 con 0x7f77fc0fe0e0 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.993+0000 7f77f27fc700 1 -- 172.21.15.134:0/3329266522 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77ec00ad90 con 0x7f77fc0fe0e0 2024-02-16T22:21:13.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.993+0000 7f77f27fc700 1 -- 172.21.15.134:0/3329266522 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77ec0113a0 con 0x7f77fc0fe0e0 2024-02-16T22:21:13.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.993+0000 7f7803f38700 1 -- 172.21.15.134:0/3329266522 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77fc1159a0 con 0x7f77fc0fe0e0 2024-02-16T22:21:13.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.994+0000 7f7803f38700 1 -- 172.21.15.134:0/3329266522 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77fc04bed0 con 0x7f77fc0fe0e0 2024-02-16T22:21:13.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.995+0000 7f77f27fc700 1 -- 172.21.15.134:0/3329266522 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 30) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f77ec012400 con 0x7f77fc0fe0e0 2024-02-16T22:21:13.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.995+0000 7f77f27fc700 1 --2- 172.21.15.134:0/3329266522 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f77e806d200 0x7f77e806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:13.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.995+0000 7f77f27fc700 1 -- 172.21.15.134:0/3329266522 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f77ec08c7b0 con 0x7f77fc0fe0e0 2024-02-16T22:21:13.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.995+0000 7f7801cd4700 1 --2- 172.21.15.134:0/3329266522 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f77e806d200 0x7f77e806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:13.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:13.996+0000 7f7801cd4700 1 --2- 172.21.15.134:0/3329266522 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f77e806d200 0x7f77e806f6b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f77f8004890 tx=0x7f77f8009e30 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:14.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.000+0000 7f77f27fc700 1 -- 172.21.15.134:0/3329266522 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f77ec05a250 con 0x7f77fc0fe0e0 2024-02-16T22:21:14.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.287+0000 7f7803f38700 1 -- 172.21.15.134:0/3329266522 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f77fc115e40 con 0x7f77fc0fe0e0 2024-02-16T22:21:14.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.287+0000 7f77f27fc700 1 -- 172.21.15.134:0/3329266522 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f77ec059de0 con 0x7f77fc0fe0e0 2024-02-16T22:21:14.289 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:21:14.289 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:21:14.289 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 2 2024-02-16T22:21:14.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:21:14.289 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:21:14.290 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:21:14.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:21:14.290 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:21:14.290 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 6 2024-02-16T22:21:14.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:21:14.290 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:21:14.290 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:21:14.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:21:14.290 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:21:14.290 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 12, 2024-02-16T22:21:14.290 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:21:14.290 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:21:14.290 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:21:14.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.289+0000 7f7803f38700 1 -- 172.21.15.134:0/3329266522 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f77e806d200 msgr2=0x7f77e806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.289+0000 7f7803f38700 1 --2- 172.21.15.134:0/3329266522 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f77e806d200 0x7f77e806f6b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f77f8004890 tx=0x7f77f8009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.289+0000 7f7803f38700 1 -- 172.21.15.134:0/3329266522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77fc0fe0e0 msgr2=0x7f77fc0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.289+0000 7f7803f38700 1 --2- 172.21.15.134:0/3329266522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77fc0fe0e0 0x7f77fc0702e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00c830 tx=0x7f77ec004470 comp rx=0 tx=0).stop 2024-02-16T22:21:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.289+0000 7f7803f38700 1 -- 172.21.15.134:0/3329266522 shutdown_connections 2024-02-16T22:21:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.289+0000 7f7803f38700 1 --2- 172.21.15.134:0/3329266522 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f77e806d200 0x7f77e806f6b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.289+0000 7f7803f38700 1 --2- 172.21.15.134:0/3329266522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77fc0fcef0 0x7f77fc071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.289+0000 7f7803f38700 1 --2- 172.21.15.134:0/3329266522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77fc0fe0e0 0x7f77fc0702e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.289+0000 7f7803f38700 1 -- 172.21.15.134:0/3329266522 >> 172.21.15.134:0/3329266522 conn(0x7f77fc0f8620 msgr2=0x7f77fc1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.290+0000 7f7803f38700 1 -- 172.21.15.134:0/3329266522 shutdown_connections 2024-02-16T22:21:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.290+0000 7f7803f38700 1 -- 172.21.15.134:0/3329266522 wait complete. 2024-02-16T22:21:14.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.393+0000 7efd8c122700 1 -- 172.21.15.134:0/2405638075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84066c50 msgr2=0x7efd840ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:14.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.393+0000 7efd8c122700 1 --2- 172.21.15.134:0/2405638075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84066c50 0x7efd840ffb10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7efd74004940 tx=0x7efd74009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:14.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.393+0000 7efd8c122700 1 -- 172.21.15.134:0/2405638075 shutdown_connections 2024-02-16T22:21:14.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.393+0000 7efd8c122700 1 --2- 172.21.15.134:0/2405638075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd841000e0 0x7efd84102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:14.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.393+0000 7efd8c122700 1 --2- 172.21.15.134:0/2405638075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84066c50 0x7efd840ffb10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:14.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.393+0000 7efd8c122700 1 -- 172.21.15.134:0/2405638075 >> 172.21.15.134:0/2405638075 conn(0x7efd840f7520 msgr2=0x7efd840f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:14.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.393+0000 7efd8c122700 1 -- 172.21.15.134:0/2405638075 shutdown_connections 2024-02-16T22:21:14.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.393+0000 7efd8c122700 1 -- 172.21.15.134:0/2405638075 wait complete. 2024-02-16T22:21:14.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.394+0000 7efd8c122700 1 Processor -- start 2024-02-16T22:21:14.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.394+0000 7efd8c122700 1 -- start start 2024-02-16T22:21:14.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.394+0000 7efd8c122700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd84066c50 0x7efd8410d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:14.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.394+0000 7efd8c122700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd841000e0 0x7efd8410de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:14.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.394+0000 7efd8c122700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8410e480 con 0x7efd841000e0 2024-02-16T22:21:14.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.394+0000 7efd8c122700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8410ed20 con 0x7efd84066c50 2024-02-16T22:21:14.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.394+0000 7efd896bd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd841000e0 0x7efd8410de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:14.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.394+0000 7efd896bd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd841000e0 0x7efd8410de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48278/0 (socket says 172.21.15.134:48278) 2024-02-16T22:21:14.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.394+0000 7efd896bd700 1 -- 172.21.15.134:0/357641924 learned_addr learned my addr 172.21.15.134:0/357641924 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:21:14.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.394+0000 7efd89ebe700 1 --2- 172.21.15.134:0/357641924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd84066c50 0x7efd8410d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:14.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.394+0000 7efd896bd700 1 -- 172.21.15.134:0/357641924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd84066c50 msgr2=0x7efd8410d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:14.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.394+0000 7efd896bd700 1 --2- 172.21.15.134:0/357641924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd84066c50 0x7efd8410d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:14.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.394+0000 7efd896bd700 1 -- 172.21.15.134:0/357641924 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd74005040 con 0x7efd841000e0 2024-02-16T22:21:14.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.394+0000 7efd896bd700 1 --2- 172.21.15.134:0/357641924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd841000e0 0x7efd8410de80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efd80002a50 tx=0x7efd80004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:14.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.395+0000 7efd7a7fc700 1 -- 172.21.15.134:0/357641924 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd80007cc0 con 0x7efd841000e0 2024-02-16T22:21:14.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.395+0000 7efd8c122700 1 -- 172.21.15.134:0/357641924 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8410f000 con 0x7efd841000e0 2024-02-16T22:21:14.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.395+0000 7efd7a7fc700 1 -- 172.21.15.134:0/357641924 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd8000f040 con 0x7efd841000e0 2024-02-16T22:21:14.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.395+0000 7efd7a7fc700 1 -- 172.21.15.134:0/357641924 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd8000d9c0 con 0x7efd841000e0 2024-02-16T22:21:14.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.395+0000 7efd8c122700 1 -- 172.21.15.134:0/357641924 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8410f540 con 0x7efd841000e0 2024-02-16T22:21:14.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.396+0000 7efd8c122700 1 -- 172.21.15.134:0/357641924 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd84107a70 con 0x7efd841000e0 2024-02-16T22:21:14.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.396+0000 7efd7a7fc700 1 -- 172.21.15.134:0/357641924 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 30) v1 ==== 91311+0+0 (secure 0 0 0) 0x7efd80009730 con 0x7efd841000e0 2024-02-16T22:21:14.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.397+0000 7efd7a7fc700 1 --2- 172.21.15.134:0/357641924 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efd7006d200 0x7efd7006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:14.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.397+0000 7efd7a7fc700 1 -- 172.21.15.134:0/357641924 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7efd8008c550 con 0x7efd841000e0 2024-02-16T22:21:14.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.397+0000 7efd89ebe700 1 --2- 172.21.15.134:0/357641924 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efd7006d200 0x7efd7006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:14.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.397+0000 7efd89ebe700 1 --2- 172.21.15.134:0/357641924 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efd7006d200 0x7efd7006f6b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efd74004f90 tx=0x7efd74009e30 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:14.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.401+0000 7efd7a7fc700 1 -- 172.21.15.134:0/357641924 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7efd80059f00 con 0x7efd841000e0 2024-02-16T22:21:14.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.627+0000 7efd8c122700 1 -- 172.21.15.134:0/357641924 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd8410f7d0 con 0x7efd7006d200 2024-02-16T22:21:14.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.628+0000 7efd7a7fc700 1 -- 172.21.15.134:0/357641924 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7efd8410f7d0 con 0x7efd7006d200 2024-02-16T22:21:14.630 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:21:14.630 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:21:14.630 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:21:14.630 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-16T22:21:14.630 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-02-16T22:21:14.630 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr" 2024-02-16T22:21:14.630 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-02-16T22:21:14.630 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "2/2 daemons upgraded", 2024-02-16T22:21:14.631 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "", 2024-02-16T22:21:14.631 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:21:14.631 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:21:14.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.631+0000 7efd8c122700 1 -- 172.21.15.134:0/357641924 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efd7006d200 msgr2=0x7efd7006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:14.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.631+0000 7efd8c122700 1 --2- 172.21.15.134:0/357641924 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efd7006d200 0x7efd7006f6b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efd74004f90 tx=0x7efd74009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:14.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.631+0000 7efd8c122700 1 -- 172.21.15.134:0/357641924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd841000e0 msgr2=0x7efd8410de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:14.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.631+0000 7efd8c122700 1 --2- 172.21.15.134:0/357641924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd841000e0 0x7efd8410de80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efd80002a50 tx=0x7efd80004600 comp rx=0 tx=0).stop 2024-02-16T22:21:14.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.631+0000 7efd8c122700 1 -- 172.21.15.134:0/357641924 shutdown_connections 2024-02-16T22:21:14.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.631+0000 7efd8c122700 1 --2- 172.21.15.134:0/357641924 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efd7006d200 0x7efd7006f6b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:14.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.631+0000 7efd8c122700 1 --2- 172.21.15.134:0/357641924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd84066c50 0x7efd8410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:14.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.631+0000 7efd8c122700 1 --2- 172.21.15.134:0/357641924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd841000e0 0x7efd8410de80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:14.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.631+0000 7efd8c122700 1 -- 172.21.15.134:0/357641924 >> 172.21.15.134:0/357641924 conn(0x7efd840f7520 msgr2=0x7efd840f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:14.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.631+0000 7efd8c122700 1 -- 172.21.15.134:0/357641924 shutdown_connections 2024-02-16T22:21:14.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:14.631+0000 7efd8c122700 1 -- 172.21.15.134:0/357641924 wait complete. 2024-02-16T22:21:14.844 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:14 smithi134 ceph-mon[28869]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:14.844 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:14 smithi134 ceph-mon[28869]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:14.844 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:14 smithi134 ceph-mon[28869]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:14.844 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:14 smithi134 ceph-mon[28869]: pgmap v11: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-16T22:21:14.844 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:14 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/3329266522' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:14.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:14 smithi173 ceph-mon[37280]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:14.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:14 smithi173 ceph-mon[37280]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:14.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:14 smithi173 ceph-mon[37280]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:14.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:14 smithi173 ceph-mon[37280]: pgmap v11: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-16T22:21:14.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:14 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/3329266522' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:15.845 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:15 smithi173 ceph-mon[37280]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:15.845 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:15 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:15.845 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:15 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:15.845 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:15 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:21:15.845 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:15 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:21:15.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:15 smithi134 ceph-mon[28869]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:15.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:15 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:15.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:15 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:15.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:15 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:21:15.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:15 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:21:16.857 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:16 smithi173 ceph-mon[37280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:21:16.858 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:16 smithi173 ceph-mon[37280]: pgmap v12: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-16T22:21:16.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:16 smithi134 ceph-mon[28869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:21:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:16 smithi134 ceph-mon[28869]: pgmap v12: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-16T22:21:17.722 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:17 smithi173 ceph-mon[37280]: Upgrade: Updating mgr.smithi173.kbofaa 2024-02-16T22:21:17.723 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:17 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi173.kbofaa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:21:17.723 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:17 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:21:17.723 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:17 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:21:17.723 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:17 smithi173 ceph-mon[37280]: Deploying daemon mgr.smithi173.kbofaa on smithi173 2024-02-16T22:21:17.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:17 smithi134 ceph-mon[28869]: Upgrade: Updating mgr.smithi173.kbofaa 2024-02-16T22:21:17.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:17 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi173.kbofaa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:21:17.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:17 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:21:17.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:17 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:21:17.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:17 smithi134 ceph-mon[28869]: Deploying daemon mgr.smithi173.kbofaa on smithi173 2024-02-16T22:21:18.618 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:18 smithi173 ceph-mon[37280]: pgmap v13: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:18.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:18 smithi134 ceph-mon[28869]: pgmap v13: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:21.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:21 smithi134 ceph-mon[28869]: pgmap v14: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:21.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:21 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:21.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:21 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:21.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:21 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:21:21.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:21 smithi173 ceph-mon[37280]: pgmap v14: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:21.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:21 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:21.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:21 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:21.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:21 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:21:22.661 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:22 smithi173 ceph-mon[37280]: pgmap v15: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:22.844 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:22 smithi134 ceph-mon[28869]: pgmap v15: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:24.664 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:24 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:24.664 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:24 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:24.664 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:24 smithi173 ceph-mon[37280]: pgmap v16: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:24.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:24 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:24.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:24 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:24.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:24 smithi134 ceph-mon[28869]: pgmap v16: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:25.682 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:25 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:25.682 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:25 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:25.682 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:25 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:25.682 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:25 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:25.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:25 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:25.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:25 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:25.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:25 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:25.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:25 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:26.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:26 smithi134 ceph-mon[28869]: pgmap v17: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:26.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:26 smithi173 ceph-mon[37280]: pgmap v17: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:27.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:27 smithi134 ceph-mon[28869]: Standby manager daemon smithi173.kbofaa restarted 2024-02-16T22:21:27.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:27 smithi134 ceph-mon[28869]: Standby manager daemon smithi173.kbofaa started 2024-02-16T22:21:27.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:27 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/3175186064' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/crt"}]: dispatch 2024-02-16T22:21:27.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:27 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/3175186064' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-16T22:21:27.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:27 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/3175186064' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/key"}]: dispatch 2024-02-16T22:21:27.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:27 smithi134 ceph-mon[28869]: from='mgr.? 172.21.15.173:0/3175186064' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-16T22:21:27.729 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:27 smithi173 ceph-mon[37280]: Standby manager daemon smithi173.kbofaa restarted 2024-02-16T22:21:27.729 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:27 smithi173 ceph-mon[37280]: Standby manager daemon smithi173.kbofaa started 2024-02-16T22:21:27.729 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:27 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/3175186064' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/crt"}]: dispatch 2024-02-16T22:21:27.729 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:27 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/3175186064' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-16T22:21:27.729 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:27 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/3175186064' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/key"}]: dispatch 2024-02-16T22:21:27.729 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:27 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/3175186064' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-16T22:21:28.893 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: mgrmap e31: smithi134.ordace(active, since 29s), standbys: smithi173.kbofaa 2024-02-16T22:21:28.893 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.893 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.893 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:21:28.893 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:21:28.893 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: pgmap v18: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:28.893 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.893 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:21:28.893 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:21:28.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.ordace"}]: dispatch 2024-02-16T22:21:28.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.ordace"}]': finished 2024-02-16T22:21:28.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi173.kbofaa"}]: dispatch 2024-02-16T22:21:28.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi173.kbofaa"}]': finished 2024-02-16T22:21:28.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:28 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: mgrmap e31: smithi134.ordace(active, since 29s), standbys: smithi173.kbofaa 2024-02-16T22:21:28.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:21:28.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:21:28.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: pgmap v18: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:28.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:21:28.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:21:28.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.ordace"}]: dispatch 2024-02-16T22:21:28.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.ordace"}]': finished 2024-02-16T22:21:28.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi173.kbofaa"}]: dispatch 2024-02-16T22:21:28.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi173.kbofaa"}]': finished 2024-02-16T22:21:28.983 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.983 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.983 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.983 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.983 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.983 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.983 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.983 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.983 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.983 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.983 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.983 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:28.983 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:28.983 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:28 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:30.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:30 smithi134 ceph-mon[28869]: Upgrade: Setting container_image for all mgr 2024-02-16T22:21:30.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:30 smithi134 ceph-mon[28869]: Upgrade: Setting container_image for all rgw 2024-02-16T22:21:30.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:30 smithi134 ceph-mon[28869]: Upgrade: Setting container_image for all rbd-mirror 2024-02-16T22:21:30.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:30 smithi134 ceph-mon[28869]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-16T22:21:30.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:30 smithi134 ceph-mon[28869]: Upgrade: Setting container_image for all ceph-exporter 2024-02-16T22:21:30.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:30 smithi134 ceph-mon[28869]: Upgrade: Setting container_image for all iscsi 2024-02-16T22:21:30.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:30 smithi134 ceph-mon[28869]: Upgrade: Setting container_image for all nfs 2024-02-16T22:21:30.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:30 smithi134 ceph-mon[28869]: Upgrade: Setting container_image for all nvmeof 2024-02-16T22:21:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:30 smithi173 ceph-mon[37280]: Upgrade: Setting container_image for all mgr 2024-02-16T22:21:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:30 smithi173 ceph-mon[37280]: Upgrade: Setting container_image for all rgw 2024-02-16T22:21:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:30 smithi173 ceph-mon[37280]: Upgrade: Setting container_image for all rbd-mirror 2024-02-16T22:21:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:30 smithi173 ceph-mon[37280]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-16T22:21:30.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:30 smithi173 ceph-mon[37280]: Upgrade: Setting container_image for all ceph-exporter 2024-02-16T22:21:30.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:30 smithi173 ceph-mon[37280]: Upgrade: Setting container_image for all iscsi 2024-02-16T22:21:30.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:30 smithi173 ceph-mon[37280]: Upgrade: Setting container_image for all nfs 2024-02-16T22:21:30.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:30 smithi173 ceph-mon[37280]: Upgrade: Setting container_image for all nvmeof 2024-02-16T22:21:31.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:31 smithi134 ceph-mon[28869]: pgmap v19: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:31.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:31 smithi134 ceph-mon[28869]: Upgrade: Updating node-exporter.smithi134 (1/2) 2024-02-16T22:21:31.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:31 smithi134 ceph-mon[28869]: Deploying daemon node-exporter.smithi134 on smithi134 2024-02-16T22:21:31.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:31 smithi173 ceph-mon[37280]: pgmap v19: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:31.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:31 smithi173 ceph-mon[37280]: Upgrade: Updating node-exporter.smithi134 (1/2) 2024-02-16T22:21:31.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:31 smithi173 ceph-mon[37280]: Deploying daemon node-exporter.smithi134 on smithi134 2024-02-16T22:21:32.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:32 smithi134 ceph-mon[28869]: pgmap v20: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:32.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:32 smithi173 ceph-mon[37280]: pgmap v20: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:33.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:33 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:33.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:33 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:34.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:33 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:34.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:33 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:35.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:34 smithi134 ceph-mon[28869]: pgmap v21: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:35.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:34 smithi173 ceph-mon[37280]: pgmap v21: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:36.217 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:35 smithi173 ceph-mon[37280]: Upgrade: Updating node-exporter.smithi173 (2/2) 2024-02-16T22:21:36.217 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:35 smithi173 ceph-mon[37280]: Deploying daemon node-exporter.smithi173 on smithi173 2024-02-16T22:21:36.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:35 smithi134 ceph-mon[28869]: Upgrade: Updating node-exporter.smithi173 (2/2) 2024-02-16T22:21:36.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:35 smithi134 ceph-mon[28869]: Deploying daemon node-exporter.smithi173 on smithi173 2024-02-16T22:21:37.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:36 smithi134 ceph-mon[28869]: pgmap v22: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:37.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:36 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:37.230 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:36 smithi173 ceph-mon[37280]: pgmap v22: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:37.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:36 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:37.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:37 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:37.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:37 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:21:37.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:37 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:37.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:37 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:21:38.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:38 smithi134 ceph-mon[28869]: pgmap v23: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:39.074 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:38 smithi173 ceph-mon[37280]: pgmap v23: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:40.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:40 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:40.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:40 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:40.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:40 smithi134 ceph-mon[28869]: pgmap v24: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:40.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:40 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:40.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:40 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:40.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:40 smithi173 ceph-mon[37280]: pgmap v24: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:41.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:41 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:41.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:41 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:42.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:41 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:42.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:41 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:42.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:42 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:42.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:42 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:42.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:42 smithi173 ceph-mon[37280]: pgmap v25: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:43.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:42 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:43.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:42 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:43.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:42 smithi134 ceph-mon[28869]: pgmap v25: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:44.112 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:43 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:44.112 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:43 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:44.113 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:43 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:21:44.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:43 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:44.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:43 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:44.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:43 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:21:44.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.766+0000 7fd991032700 1 -- 172.21.15.134:0/1182398298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd98c0fcfb0 msgr2=0x7fd98c0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:44.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.766+0000 7fd991032700 1 --2- 172.21.15.134:0/1182398298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd98c0fcfb0 0x7fd98c0fd420 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd97c004940 tx=0x7fd97c009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:44.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.766+0000 7fd991032700 1 -- 172.21.15.134:0/1182398298 shutdown_connections 2024-02-16T22:21:44.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.766+0000 7fd991032700 1 --2- 172.21.15.134:0/1182398298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd98c0fcfb0 0x7fd98c0fd420 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:44.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.766+0000 7fd991032700 1 --2- 172.21.15.134:0/1182398298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd98c0fbe40 0x7fd98c0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:44.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.766+0000 7fd991032700 1 -- 172.21.15.134:0/1182398298 >> 172.21.15.134:0/1182398298 conn(0x7fd98c0f74e0 msgr2=0x7fd98c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:44.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.766+0000 7fd991032700 1 -- 172.21.15.134:0/1182398298 shutdown_connections 2024-02-16T22:21:44.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.766+0000 7fd991032700 1 -- 172.21.15.134:0/1182398298 wait complete. 2024-02-16T22:21:44.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.766+0000 7fd991032700 1 Processor -- start 2024-02-16T22:21:44.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.767+0000 7fd991032700 1 -- start start 2024-02-16T22:21:44.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.767+0000 7fd991032700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd98c0fbe40 0x7fd98c0fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:44.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.767+0000 7fd991032700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd98c0fcfb0 0x7fd98c0fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:44.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.767+0000 7fd991032700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0fe980 con 0x7fd98c0fcfb0 2024-02-16T22:21:44.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.767+0000 7fd991032700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0feaf0 con 0x7fd98c0fbe40 2024-02-16T22:21:44.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.767+0000 7fd98a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd98c0fcfb0 0x7fd98c0fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:44.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.767+0000 7fd98a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd98c0fcfb0 0x7fd98c0fe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38128/0 (socket says 172.21.15.134:38128) 2024-02-16T22:21:44.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.767+0000 7fd98a59c700 1 -- 172.21.15.134:0/317847129 learned_addr learned my addr 172.21.15.134:0/317847129 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:21:44.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.767+0000 7fd98ad9d700 1 --2- 172.21.15.134:0/317847129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd98c0fbe40 0x7fd98c0fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:44.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.767+0000 7fd98a59c700 1 -- 172.21.15.134:0/317847129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd98c0fbe40 msgr2=0x7fd98c0fff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:44.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.767+0000 7fd98a59c700 1 --2- 172.21.15.134:0/317847129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd98c0fbe40 0x7fd98c0fff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:44.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.767+0000 7fd98a59c700 1 -- 172.21.15.134:0/317847129 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c005040 con 0x7fd98c0fcfb0 2024-02-16T22:21:44.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.767+0000 7fd98a59c700 1 --2- 172.21.15.134:0/317847129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd98c0fcfb0 0x7fd98c0fe380 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0093b0 tx=0x7fd97c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:44.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.768+0000 7fd9737fe700 1 -- 172.21.15.134:0/317847129 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd97c00e040 con 0x7fd98c0fcfb0 2024-02-16T22:21:44.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.768+0000 7fd9737fe700 1 -- 172.21.15.134:0/317847129 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd97c00bcc0 con 0x7fd98c0fcfb0 2024-02-16T22:21:44.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.768+0000 7fd9737fe700 1 -- 172.21.15.134:0/317847129 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd97c01c630 con 0x7fd98c0fcfb0 2024-02-16T22:21:44.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.768+0000 7fd991032700 1 -- 172.21.15.134:0/317847129 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c0fed70 con 0x7fd98c0fcfb0 2024-02-16T22:21:44.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.768+0000 7fd991032700 1 -- 172.21.15.134:0/317847129 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c115990 con 0x7fd98c0fcfb0 2024-02-16T22:21:44.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.769+0000 7fd991032700 1 -- 172.21.15.134:0/317847129 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c04bed0 con 0x7fd98c0fcfb0 2024-02-16T22:21:44.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.769+0000 7fd9737fe700 1 -- 172.21.15.134:0/317847129 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7fd97c013980 con 0x7fd98c0fcfb0 2024-02-16T22:21:44.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.770+0000 7fd9737fe700 1 --2- 172.21.15.134:0/317847129 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fd97406d200 0x7fd97406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:44.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.770+0000 7fd9737fe700 1 -- 172.21.15.134:0/317847129 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd97c08da80 con 0x7fd98c0fcfb0 2024-02-16T22:21:44.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.770+0000 7fd98ad9d700 1 --2- 172.21.15.134:0/317847129 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fd97406d200 0x7fd97406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:44.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.770+0000 7fd98ad9d700 1 --2- 172.21.15.134:0/317847129 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fd97406d200 0x7fd97406f6b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0ffc90 tx=0x7fd98000b040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:44.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.775+0000 7fd9737fe700 1 -- 172.21.15.134:0/317847129 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fd97c05b550 con 0x7fd98c0fcfb0 2024-02-16T22:21:44.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.991+0000 7fd991032700 1 -- 172.21.15.134:0/317847129 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd98c065dd0 con 0x7fd97406d200 2024-02-16T22:21:44.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.992+0000 7fd9737fe700 1 -- 172.21.15.134:0/317847129 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fd98c065dd0 con 0x7fd97406d200 2024-02-16T22:21:44.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.994+0000 7fd991032700 1 -- 172.21.15.134:0/317847129 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fd97406d200 msgr2=0x7fd97406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:44.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.994+0000 7fd991032700 1 --2- 172.21.15.134:0/317847129 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fd97406d200 0x7fd97406f6b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0ffc90 tx=0x7fd98000b040 comp rx=0 tx=0).stop 2024-02-16T22:21:44.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.994+0000 7fd991032700 1 -- 172.21.15.134:0/317847129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd98c0fcfb0 msgr2=0x7fd98c0fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:44.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.994+0000 7fd991032700 1 --2- 172.21.15.134:0/317847129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd98c0fcfb0 0x7fd98c0fe380 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0093b0 tx=0x7fd97c009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:44.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.994+0000 7fd991032700 1 -- 172.21.15.134:0/317847129 shutdown_connections 2024-02-16T22:21:44.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.994+0000 7fd991032700 1 --2- 172.21.15.134:0/317847129 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fd97406d200 0x7fd97406f6b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:44.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.994+0000 7fd991032700 1 --2- 172.21.15.134:0/317847129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd98c0fbe40 0x7fd98c0fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:44.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.994+0000 7fd991032700 1 --2- 172.21.15.134:0/317847129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd98c0fcfb0 0x7fd98c0fe380 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:44.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.994+0000 7fd991032700 1 -- 172.21.15.134:0/317847129 >> 172.21.15.134:0/317847129 conn(0x7fd98c0f74e0 msgr2=0x7fd98c0656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:44.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.995+0000 7fd991032700 1 -- 172.21.15.134:0/317847129 shutdown_connections 2024-02-16T22:21:44.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:44.995+0000 7fd991032700 1 -- 172.21.15.134:0/317847129 wait complete. 2024-02-16T22:21:45.008 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:21:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.102+0000 7fa259694700 1 -- 172.21.15.134:0/1562582433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2540fcfb0 msgr2=0x7fa2540fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.102+0000 7fa259694700 1 --2- 172.21.15.134:0/1562582433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2540fcfb0 0x7fa2540fd420 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa248004940 tx=0x7fa248009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.102+0000 7fa259694700 1 -- 172.21.15.134:0/1562582433 shutdown_connections 2024-02-16T22:21:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.102+0000 7fa259694700 1 --2- 172.21.15.134:0/1562582433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2540fcfb0 0x7fa2540fd420 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.102+0000 7fa259694700 1 --2- 172.21.15.134:0/1562582433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2540fbe40 0x7fa2540fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.102+0000 7fa259694700 1 -- 172.21.15.134:0/1562582433 >> 172.21.15.134:0/1562582433 conn(0x7fa2540f74e0 msgr2=0x7fa2540f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:45.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.102+0000 7fa259694700 1 -- 172.21.15.134:0/1562582433 shutdown_connections 2024-02-16T22:21:45.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.102+0000 7fa259694700 1 -- 172.21.15.134:0/1562582433 wait complete. 2024-02-16T22:21:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.103+0000 7fa259694700 1 Processor -- start 2024-02-16T22:21:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.103+0000 7fa259694700 1 -- start start 2024-02-16T22:21:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.103+0000 7fa259694700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2540fbe40 0x7fa25410d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.103+0000 7fa259694700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2540fcfb0 0x7fa25410ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.103+0000 7fa259694700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25410e3f0 con 0x7fa2540fcfb0 2024-02-16T22:21:45.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.103+0000 7fa259694700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25410ec90 con 0x7fa2540fbe40 2024-02-16T22:21:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.103+0000 7fa2527fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2540fcfb0 0x7fa25410ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.103+0000 7fa2527fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2540fcfb0 0x7fa25410ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38152/0 (socket says 172.21.15.134:38152) 2024-02-16T22:21:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.103+0000 7fa2527fc700 1 -- 172.21.15.134:0/2501366225 learned_addr learned my addr 172.21.15.134:0/2501366225 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:21:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.103+0000 7fa252ffd700 1 --2- 172.21.15.134:0/2501366225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2540fbe40 0x7fa25410d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.103+0000 7fa2527fc700 1 -- 172.21.15.134:0/2501366225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2540fbe40 msgr2=0x7fa25410d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.103+0000 7fa2527fc700 1 --2- 172.21.15.134:0/2501366225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2540fbe40 0x7fa25410d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.103+0000 7fa2527fc700 1 -- 172.21.15.134:0/2501366225 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa248005040 con 0x7fa2540fcfb0 2024-02-16T22:21:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.103+0000 7fa2527fc700 1 --2- 172.21.15.134:0/2501366225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2540fcfb0 0x7fa25410ddf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa248000c00 tx=0x7fa248009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.104+0000 7fa23b7fe700 1 -- 172.21.15.134:0/2501366225 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa248021070 con 0x7fa2540fcfb0 2024-02-16T22:21:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.104+0000 7fa259694700 1 -- 172.21.15.134:0/2501366225 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25410ef10 con 0x7fa2540fcfb0 2024-02-16T22:21:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.104+0000 7fa23b7fe700 1 -- 172.21.15.134:0/2501366225 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa24801c400 con 0x7fa2540fcfb0 2024-02-16T22:21:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.104+0000 7fa23b7fe700 1 -- 172.21.15.134:0/2501366225 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa24800e070 con 0x7fa2540fcfb0 2024-02-16T22:21:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.104+0000 7fa259694700 1 -- 172.21.15.134:0/2501366225 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25410f3f0 con 0x7fa2540fcfb0 2024-02-16T22:21:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.105+0000 7fa259694700 1 -- 172.21.15.134:0/2501366225 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25404bed0 con 0x7fa2540fcfb0 2024-02-16T22:21:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.105+0000 7fa23b7fe700 1 -- 172.21.15.134:0/2501366225 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7fa24801ca50 con 0x7fa2540fcfb0 2024-02-16T22:21:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.105+0000 7fa23b7fe700 1 --2- 172.21.15.134:0/2501366225 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa23c06d200 0x7fa23c06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.106+0000 7fa23b7fe700 1 -- 172.21.15.134:0/2501366225 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa24808d960 con 0x7fa2540fcfb0 2024-02-16T22:21:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.106+0000 7fa252ffd700 1 --2- 172.21.15.134:0/2501366225 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa23c06d200 0x7fa23c06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:45.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.106+0000 7fa252ffd700 1 --2- 172.21.15.134:0/2501366225 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa23c06d200 0x7fa23c06f6b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa24c001470 tx=0x7fa24c00b040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:45.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.110+0000 7fa23b7fe700 1 -- 172.21.15.134:0/2501366225 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa24805b390 con 0x7fa2540fcfb0 2024-02-16T22:21:45.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:44 smithi134 ceph-mon[28869]: pgmap v26: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:45.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:44 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:45.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:44 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:45.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:44 smithi173 ceph-mon[37280]: pgmap v26: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:45.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:44 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:45.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:44 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:45.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.331+0000 7fa259694700 1 -- 172.21.15.134:0/2501366225 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa25410f800 con 0x7fa23c06d200 2024-02-16T22:21:45.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.332+0000 7fa23b7fe700 1 -- 172.21.15.134:0/2501366225 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fa25410f800 con 0x7fa23c06d200 2024-02-16T22:21:45.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.334+0000 7fa259694700 1 -- 172.21.15.134:0/2501366225 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa23c06d200 msgr2=0x7fa23c06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:45.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.334+0000 7fa259694700 1 --2- 172.21.15.134:0/2501366225 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa23c06d200 0x7fa23c06f6b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa24c001470 tx=0x7fa24c00b040 comp rx=0 tx=0).stop 2024-02-16T22:21:45.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.334+0000 7fa259694700 1 -- 172.21.15.134:0/2501366225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2540fcfb0 msgr2=0x7fa25410ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:45.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.334+0000 7fa259694700 1 --2- 172.21.15.134:0/2501366225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2540fcfb0 0x7fa25410ddf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa248000c00 tx=0x7fa248009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:45.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.335+0000 7fa259694700 1 -- 172.21.15.134:0/2501366225 shutdown_connections 2024-02-16T22:21:45.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.335+0000 7fa259694700 1 --2- 172.21.15.134:0/2501366225 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa23c06d200 0x7fa23c06f6b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.335+0000 7fa259694700 1 --2- 172.21.15.134:0/2501366225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2540fbe40 0x7fa25410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.335+0000 7fa259694700 1 --2- 172.21.15.134:0/2501366225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2540fcfb0 0x7fa25410ddf0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.335+0000 7fa259694700 1 -- 172.21.15.134:0/2501366225 >> 172.21.15.134:0/2501366225 conn(0x7fa2540f74e0 msgr2=0x7fa2540656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:45.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.335+0000 7fa259694700 1 -- 172.21.15.134:0/2501366225 shutdown_connections 2024-02-16T22:21:45.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.335+0000 7fa259694700 1 -- 172.21.15.134:0/2501366225 wait complete. 2024-02-16T22:21:45.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.441+0000 7f46130ad700 1 -- 172.21.15.134:0/641612722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f460c102430 msgr2=0x7f460c104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:45.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.441+0000 7f46130ad700 1 --2- 172.21.15.134:0/641612722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f460c102430 0x7f460c104810 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f45f8004940 tx=0x7f45f8009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:45.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.441+0000 7f46130ad700 1 -- 172.21.15.134:0/641612722 shutdown_connections 2024-02-16T22:21:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.441+0000 7f46130ad700 1 --2- 172.21.15.134:0/641612722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f460c102430 0x7f460c104810 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.441+0000 7f46130ad700 1 --2- 172.21.15.134:0/641612722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f460c066c70 0x7f460c101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.441+0000 7f46130ad700 1 -- 172.21.15.134:0/641612722 >> 172.21.15.134:0/641612722 conn(0x7f460c0f7500 msgr2=0x7f460c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.442+0000 7f46130ad700 1 -- 172.21.15.134:0/641612722 shutdown_connections 2024-02-16T22:21:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.442+0000 7f46130ad700 1 -- 172.21.15.134:0/641612722 wait complete. 2024-02-16T22:21:45.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.442+0000 7f46130ad700 1 Processor -- start 2024-02-16T22:21:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.442+0000 7f46130ad700 1 -- start start 2024-02-16T22:21:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.443+0000 7f46130ad700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f460c066c70 0x7f460c10fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.443+0000 7f46130ad700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f460c102430 0x7f460c1100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.443+0000 7f46130ad700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c1106b0 con 0x7f460c102430 2024-02-16T22:21:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.443+0000 7f46130ad700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c110f50 con 0x7f460c066c70 2024-02-16T22:21:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.443+0000 7f460bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f460c102430 0x7f460c1100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.443+0000 7f460bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f460c102430 0x7f460c1100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38172/0 (socket says 172.21.15.134:38172) 2024-02-16T22:21:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.443+0000 7f460bfff700 1 -- 172.21.15.134:0/2094202573 learned_addr learned my addr 172.21.15.134:0/2094202573 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:21:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.443+0000 7f4610e49700 1 --2- 172.21.15.134:0/2094202573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f460c066c70 0x7f460c10fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.443+0000 7f460bfff700 1 -- 172.21.15.134:0/2094202573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f460c066c70 msgr2=0x7f460c10fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.443+0000 7f460bfff700 1 --2- 172.21.15.134:0/2094202573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f460c066c70 0x7f460c10fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.443+0000 7f460bfff700 1 -- 172.21.15.134:0/2094202573 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8005040 con 0x7f460c102430 2024-02-16T22:21:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.443+0000 7f460bfff700 1 --2- 172.21.15.134:0/2094202573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f460c102430 0x7f460c1100b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f45f800b3b0 tx=0x7f45f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:45.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.443+0000 7f46097fa700 1 -- 172.21.15.134:0/2094202573 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45f800e040 con 0x7f460c102430 2024-02-16T22:21:45.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.444+0000 7f46097fa700 1 -- 172.21.15.134:0/2094202573 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45f800bcc0 con 0x7f460c102430 2024-02-16T22:21:45.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.444+0000 7f46130ad700 1 -- 172.21.15.134:0/2094202573 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460c1111d0 con 0x7f460c102430 2024-02-16T22:21:45.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.444+0000 7f46097fa700 1 -- 172.21.15.134:0/2094202573 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45f801c630 con 0x7f460c102430 2024-02-16T22:21:45.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.444+0000 7f46130ad700 1 -- 172.21.15.134:0/2094202573 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460c111710 con 0x7f460c102430 2024-02-16T22:21:45.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.445+0000 7f46130ad700 1 -- 172.21.15.134:0/2094202573 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460c04bed0 con 0x7f460c102430 2024-02-16T22:21:45.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.445+0000 7f46097fa700 1 -- 172.21.15.134:0/2094202573 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f45f80139f0 con 0x7f460c102430 2024-02-16T22:21:45.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.446+0000 7f46097fa700 1 --2- 172.21.15.134:0/2094202573 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f45fc06d200 0x7f45fc06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:45.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.446+0000 7f46097fa700 1 -- 172.21.15.134:0/2094202573 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f45f808dc50 con 0x7f460c102430 2024-02-16T22:21:45.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.446+0000 7f4610e49700 1 --2- 172.21.15.134:0/2094202573 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f45fc06d200 0x7f45fc06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:45.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.446+0000 7f4610e49700 1 --2- 172.21.15.134:0/2094202573 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f45fc06d200 0x7f45fc06f6b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4600007fd0 tx=0x7f4600009040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:45.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.451+0000 7f46097fa700 1 -- 172.21.15.134:0/2094202573 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f45f805b680 con 0x7f460c102430 2024-02-16T22:21:45.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.690+0000 7f46130ad700 1 -- 172.21.15.134:0/2094202573 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f460c111b60 con 0x7f45fc06d200 2024-02-16T22:21:45.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.701+0000 7f46097fa700 1 -- 172.21.15.134:0/2094202573 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f460c111b60 con 0x7f45fc06d200 2024-02-16T22:21:45.703 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:21:45.703 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (115s) 3s ago 10m 18.7M - 0.25.0 c8568f914cd2 6535c13e765a 2024-02-16T22:21:45.703 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (10m) 3s ago 10m 6660k - 17.2.7-513-gb88fae66 870a0944ccb8 a0d53bc0a925 2024-02-16T22:21:45.703 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (9m) 6s ago 9m 6669k - 17.2.7-513-gb88fae66 870a0944ccb8 a8d69537e08a 2024-02-16T22:21:45.703 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (77s) 3s ago 10m 78.4M - 9.4.7 954c08fa6188 4e6d36fb67d5 2024-02-16T22:21:45.703 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (5m) 3s ago 5m 12.6M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:21:45.703 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (5m) 3s ago 5m 126M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:21:45.703 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (5m) 6s ago 5m 15.7M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:21:45.703 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (5m) 6s ago 5m 119M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:21:45.703 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (58s) 3s ago 12m 493M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:21:45.703 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (25s) 6s ago 9m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:21:45.703 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (12m) 3s ago 12m 53.2M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 93a679740d93 2024-02-16T22:21:45.704 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (9m) 6s ago 9m 43.3M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 cfbef35950ef 2024-02-16T22:21:45.704 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (13s) 3s ago 10m 7977k - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:21:45.704 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (9s) 6s ago 9m 3397k - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:21:45.704 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (8m) 3s ago 8m 217M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 099f0b29d202 2024-02-16T22:21:45.704 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (8m) 3s ago 8m 232M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:21:45.704 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (7m) 3s ago 7m 189M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:21:45.704 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (7m) 6s ago 7m 265M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:21:45.704 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (7m) 6s ago 7m 235M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:21:45.704 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (6m) 6s ago 6m 228M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:21:45.704 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (30s) 3s ago 10m 42.5M - 2.43.0 a07b618ecd1d 70cb8cc54fa1 2024-02-16T22:21:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.703+0000 7f46130ad700 1 -- 172.21.15.134:0/2094202573 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f45fc06d200 msgr2=0x7f45fc06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.703+0000 7f46130ad700 1 --2- 172.21.15.134:0/2094202573 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f45fc06d200 0x7f45fc06f6b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4600007fd0 tx=0x7f4600009040 comp rx=0 tx=0).stop 2024-02-16T22:21:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.703+0000 7f46130ad700 1 -- 172.21.15.134:0/2094202573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f460c102430 msgr2=0x7f460c1100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.703+0000 7f46130ad700 1 --2- 172.21.15.134:0/2094202573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f460c102430 0x7f460c1100b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f45f800b3b0 tx=0x7f45f8009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.703+0000 7f46130ad700 1 -- 172.21.15.134:0/2094202573 shutdown_connections 2024-02-16T22:21:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.703+0000 7f46130ad700 1 --2- 172.21.15.134:0/2094202573 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f45fc06d200 0x7f45fc06f6b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.703+0000 7f46130ad700 1 --2- 172.21.15.134:0/2094202573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f460c066c70 0x7f460c10fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.703+0000 7f46130ad700 1 --2- 172.21.15.134:0/2094202573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f460c102430 0x7f460c1100b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.703+0000 7f46130ad700 1 -- 172.21.15.134:0/2094202573 >> 172.21.15.134:0/2094202573 conn(0x7f460c0f7500 msgr2=0x7f460c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:45.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.703+0000 7f46130ad700 1 -- 172.21.15.134:0/2094202573 shutdown_connections 2024-02-16T22:21:45.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.703+0000 7f46130ad700 1 -- 172.21.15.134:0/2094202573 wait complete. 2024-02-16T22:21:45.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.807+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1812284121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc40fb220 msgr2=0x7f3fc40fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:45.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.807+0000 7f3fca3f6700 1 --2- 172.21.15.134:0/1812284121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc40fb220 0x7f3fc40fb630 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3fac004940 tx=0x7f3fac009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:45.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.807+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1812284121 shutdown_connections 2024-02-16T22:21:45.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.807+0000 7f3fca3f6700 1 --2- 172.21.15.134:0/1812284121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fc40fe2b0 0x7f3fc40fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.807+0000 7f3fca3f6700 1 --2- 172.21.15.134:0/1812284121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc40fb220 0x7f3fc40fb630 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.807+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1812284121 >> 172.21.15.134:0/1812284121 conn(0x7f3fc40f6ca0 msgr2=0x7f3fc40f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:45.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.807+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1812284121 shutdown_connections 2024-02-16T22:21:45.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.807+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1812284121 wait complete. 2024-02-16T22:21:45.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.808+0000 7f3fca3f6700 1 Processor -- start 2024-02-16T22:21:45.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.808+0000 7f3fca3f6700 1 -- start start 2024-02-16T22:21:45.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.808+0000 7f3fca3f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc40fb220 0x7f3fc410fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:45.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.808+0000 7f3fca3f6700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fc40fe2b0 0x7f3fc4110230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:45.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.808+0000 7f3fca3f6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4110830 con 0x7f3fc40fb220 2024-02-16T22:21:45.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.808+0000 7f3fca3f6700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4110fc0 con 0x7f3fc40fe2b0 2024-02-16T22:21:45.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.808+0000 7f3fc3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc40fb220 0x7f3fc410fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:45.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.808+0000 7f3fc3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc40fb220 0x7f3fc410fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38196/0 (socket says 172.21.15.134:38196) 2024-02-16T22:21:45.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.808+0000 7f3fc3fff700 1 -- 172.21.15.134:0/1387139025 learned_addr learned my addr 172.21.15.134:0/1387139025 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:21:45.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.808+0000 7f3fc37fe700 1 --2- 172.21.15.134:0/1387139025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fc40fe2b0 0x7f3fc4110230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:45.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.809+0000 7f3fc3fff700 1 -- 172.21.15.134:0/1387139025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fc40fe2b0 msgr2=0x7f3fc4110230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:45.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.809+0000 7f3fc3fff700 1 --2- 172.21.15.134:0/1387139025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fc40fe2b0 0x7f3fc4110230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.809+0000 7f3fc3fff700 1 -- 172.21.15.134:0/1387139025 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac005040 con 0x7f3fc40fb220 2024-02-16T22:21:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.809+0000 7f3fc37fe700 1 --2- 172.21.15.134:0/1387139025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fc40fe2b0 0x7f3fc4110230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:21:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.809+0000 7f3fc3fff700 1 --2- 172.21.15.134:0/1387139025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc40fb220 0x7f3fc410fcf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009150 tx=0x7f3fac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.809+0000 7f3fc0ff9700 1 -- 172.21.15.134:0/1387139025 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fac00e040 con 0x7f3fc40fb220 2024-02-16T22:21:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.809+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1387139025 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc4111240 con 0x7f3fc40fb220 2024-02-16T22:21:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.809+0000 7f3fc0ff9700 1 -- 172.21.15.134:0/1387139025 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3fac00bbf0 con 0x7f3fc40fb220 2024-02-16T22:21:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.809+0000 7f3fc0ff9700 1 -- 172.21.15.134:0/1387139025 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fac01c630 con 0x7f3fc40fb220 2024-02-16T22:21:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.809+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1387139025 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc4111780 con 0x7f3fc40fb220 2024-02-16T22:21:45.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.810+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1387139025 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc4102350 con 0x7f3fc40fb220 2024-02-16T22:21:45.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.811+0000 7f3fc0ff9700 1 -- 172.21.15.134:0/1387139025 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f3fac00bd60 con 0x7f3fc40fb220 2024-02-16T22:21:45.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.811+0000 7f3fc0ff9700 1 --2- 172.21.15.134:0/1387139025 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3fb006d200 0x7f3fb006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:45.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.811+0000 7f3fc0ff9700 1 -- 172.21.15.134:0/1387139025 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f3fac08db40 con 0x7f3fc40fb220 2024-02-16T22:21:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.811+0000 7f3fc37fe700 1 --2- 172.21.15.134:0/1387139025 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3fb006d200 0x7f3fb006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.812+0000 7f3fc37fe700 1 --2- 172.21.15.134:0/1387139025 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3fb006d200 0x7f3fb006f6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009fd0 tx=0x7f3fb4009ee0 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:45.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:45.816+0000 7f3fc0ff9700 1 -- 172.21.15.134:0/1387139025 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3fac05b570 con 0x7f3fc40fb220 2024-02-16T22:21:46.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.149+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1387139025 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3fc404bed0 con 0x7f3fc40fb220 2024-02-16T22:21:46.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.150+0000 7f3fc0ff9700 1 -- 172.21.15.134:0/1387139025 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f3fac05b100 con 0x7f3fc40fb220 2024-02-16T22:21:46.152 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:21:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:21:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 2 2024-02-16T22:21:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:21:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:21:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:21:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:21:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:21:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 6 2024-02-16T22:21:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:21:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:21:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:21:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:21:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:21:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 12, 2024-02-16T22:21:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:21:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:21:46.153 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:21:46.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.152+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1387139025 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3fb006d200 msgr2=0x7f3fb006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:46.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.152+0000 7f3fca3f6700 1 --2- 172.21.15.134:0/1387139025 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3fb006d200 0x7f3fb006f6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009fd0 tx=0x7f3fb4009ee0 comp rx=0 tx=0).stop 2024-02-16T22:21:46.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.152+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1387139025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc40fb220 msgr2=0x7f3fc410fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:46.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.152+0000 7f3fca3f6700 1 --2- 172.21.15.134:0/1387139025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc40fb220 0x7f3fc410fcf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009150 tx=0x7f3fac009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:46.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.152+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1387139025 shutdown_connections 2024-02-16T22:21:46.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.152+0000 7f3fca3f6700 1 --2- 172.21.15.134:0/1387139025 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3fb006d200 0x7f3fb006f6b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:46.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.152+0000 7f3fca3f6700 1 --2- 172.21.15.134:0/1387139025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc40fb220 0x7f3fc410fcf0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:46.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.152+0000 7f3fca3f6700 1 --2- 172.21.15.134:0/1387139025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fc40fe2b0 0x7f3fc4110230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:46.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.152+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1387139025 >> 172.21.15.134:0/1387139025 conn(0x7f3fc40f6ca0 msgr2=0x7f3fc40ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.152+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1387139025 shutdown_connections 2024-02-16T22:21:46.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.152+0000 7f3fca3f6700 1 -- 172.21.15.134:0/1387139025 wait complete. 2024-02-16T22:21:46.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:45 smithi134 ceph-mon[28869]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:46.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:45 smithi173 ceph-mon[37280]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:46.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.258+0000 7fd5d46a2700 1 -- 172.21.15.134:0/3192612484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc0fcfb0 msgr2=0x7fd5cc0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:46.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.258+0000 7fd5d46a2700 1 --2- 172.21.15.134:0/3192612484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc0fcfb0 0x7fd5cc0fd420 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc004940 tx=0x7fd5bc009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:46.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.258+0000 7fd5d46a2700 1 -- 172.21.15.134:0/3192612484 shutdown_connections 2024-02-16T22:21:46.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.258+0000 7fd5d46a2700 1 --2- 172.21.15.134:0/3192612484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc0fcfb0 0x7fd5cc0fd420 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:46.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.258+0000 7fd5d46a2700 1 --2- 172.21.15.134:0/3192612484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5cc0fbe40 0x7fd5cc0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:46.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.258+0000 7fd5d46a2700 1 -- 172.21.15.134:0/3192612484 >> 172.21.15.134:0/3192612484 conn(0x7fd5cc0f74e0 msgr2=0x7fd5cc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:46.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.258+0000 7fd5d46a2700 1 -- 172.21.15.134:0/3192612484 shutdown_connections 2024-02-16T22:21:46.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.258+0000 7fd5d46a2700 1 -- 172.21.15.134:0/3192612484 wait complete. 2024-02-16T22:21:46.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.259+0000 7fd5d46a2700 1 Processor -- start 2024-02-16T22:21:46.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.259+0000 7fd5d46a2700 1 -- start start 2024-02-16T22:21:46.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.259+0000 7fd5d46a2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc0fbe40 0x7fd5cc10c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:46.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.259+0000 7fd5d46a2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5cc0fcfb0 0x7fd5cc10cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:46.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.259+0000 7fd5d46a2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc10d3b0 con 0x7fd5cc0fbe40 2024-02-16T22:21:46.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.259+0000 7fd5d46a2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc10dc50 con 0x7fd5cc0fcfb0 2024-02-16T22:21:46.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.259+0000 7fd5d243e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc0fbe40 0x7fd5cc10c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:46.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.259+0000 7fd5d243e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc0fbe40 0x7fd5cc10c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38216/0 (socket says 172.21.15.134:38216) 2024-02-16T22:21:46.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.259+0000 7fd5d243e700 1 -- 172.21.15.134:0/655083066 learned_addr learned my addr 172.21.15.134:0/655083066 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:21:46.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.259+0000 7fd5d1c3d700 1 --2- 172.21.15.134:0/655083066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5cc0fcfb0 0x7fd5cc10cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:46.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.259+0000 7fd5d243e700 1 -- 172.21.15.134:0/655083066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5cc0fcfb0 msgr2=0x7fd5cc10cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:46.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.259+0000 7fd5d243e700 1 --2- 172.21.15.134:0/655083066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5cc0fcfb0 0x7fd5cc10cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:46.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.259+0000 7fd5d243e700 1 -- 172.21.15.134:0/655083066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc005040 con 0x7fd5cc0fbe40 2024-02-16T22:21:46.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.259+0000 7fd5d1c3d700 1 --2- 172.21.15.134:0/655083066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5cc0fcfb0 0x7fd5cc10cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:21:46.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.260+0000 7fd5d243e700 1 --2- 172.21.15.134:0/655083066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc0fbe40 0x7fd5cc10c870 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800c8c0 tx=0x7fd5c80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:46.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.260+0000 7fd5c2ffd700 1 -- 172.21.15.134:0/655083066 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5c800a980 con 0x7fd5cc0fbe40 2024-02-16T22:21:46.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.260+0000 7fd5d46a2700 1 -- 172.21.15.134:0/655083066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5cc10df30 con 0x7fd5cc0fbe40 2024-02-16T22:21:46.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.260+0000 7fd5c2ffd700 1 -- 172.21.15.134:0/655083066 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5c800ce60 con 0x7fd5cc0fbe40 2024-02-16T22:21:46.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.260+0000 7fd5c2ffd700 1 -- 172.21.15.134:0/655083066 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5c80115e0 con 0x7fd5cc0fbe40 2024-02-16T22:21:46.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.260+0000 7fd5d46a2700 1 -- 172.21.15.134:0/655083066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc10e470 con 0x7fd5cc0fbe40 2024-02-16T22:21:46.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.261+0000 7fd5d46a2700 1 -- 172.21.15.134:0/655083066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5cc04bed0 con 0x7fd5cc0fbe40 2024-02-16T22:21:46.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.262+0000 7fd5c2ffd700 1 -- 172.21.15.134:0/655083066 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7fd5c8012400 con 0x7fd5cc0fbe40 2024-02-16T22:21:46.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.262+0000 7fd5c2ffd700 1 --2- 172.21.15.134:0/655083066 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fd5b806f410 0x7fd5b80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:21:46.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.262+0000 7fd5c2ffd700 1 -- 172.21.15.134:0/655083066 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd5c808c7b0 con 0x7fd5cc0fbe40 2024-02-16T22:21:46.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.262+0000 7fd5d1c3d700 1 --2- 172.21.15.134:0/655083066 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fd5b806f410 0x7fd5b80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:21:46.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.263+0000 7fd5d1c3d700 1 --2- 172.21.15.134:0/655083066 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fd5b806f410 0x7fd5b80718c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009fd0 tx=0x7fd5bc009e30 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:21:46.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.271+0000 7fd5c2ffd700 1 -- 172.21.15.134:0/655083066 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fd5c805a2f0 con 0x7fd5cc0fbe40 2024-02-16T22:21:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.490+0000 7fd5d46a2700 1 -- 172.21.15.134:0/655083066 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5cc101990 con 0x7fd5b806f410 2024-02-16T22:21:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.492+0000 7fd5c2ffd700 1 -- 172.21.15.134:0/655083066 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fd5cc101990 con 0x7fd5b806f410 2024-02-16T22:21:46.494 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:21:46.494 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:21:46.494 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:21:46.494 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-16T22:21:46.494 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-02-16T22:21:46.494 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr" 2024-02-16T22:21:46.494 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-02-16T22:21:46.494 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "2/2 daemons upgraded", 2024-02-16T22:21:46.494 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-16T22:21:46.494 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:21:46.494 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:21:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.494+0000 7fd5d46a2700 1 -- 172.21.15.134:0/655083066 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fd5b806f410 msgr2=0x7fd5b80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.494+0000 7fd5d46a2700 1 --2- 172.21.15.134:0/655083066 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fd5b806f410 0x7fd5b80718c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009fd0 tx=0x7fd5bc009e30 comp rx=0 tx=0).stop 2024-02-16T22:21:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.494+0000 7fd5d46a2700 1 -- 172.21.15.134:0/655083066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc0fbe40 msgr2=0x7fd5cc10c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:21:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.494+0000 7fd5d46a2700 1 --2- 172.21.15.134:0/655083066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc0fbe40 0x7fd5cc10c870 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800c8c0 tx=0x7fd5c80044c0 comp rx=0 tx=0).stop 2024-02-16T22:21:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.494+0000 7fd5d46a2700 1 -- 172.21.15.134:0/655083066 shutdown_connections 2024-02-16T22:21:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.494+0000 7fd5d46a2700 1 --2- 172.21.15.134:0/655083066 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fd5b806f410 0x7fd5b80718c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.494+0000 7fd5d46a2700 1 --2- 172.21.15.134:0/655083066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc0fbe40 0x7fd5cc10c870 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.494+0000 7fd5d46a2700 1 --2- 172.21.15.134:0/655083066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5cc0fcfb0 0x7fd5cc10cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:21:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.494+0000 7fd5d46a2700 1 -- 172.21.15.134:0/655083066 >> 172.21.15.134:0/655083066 conn(0x7fd5cc0f74e0 msgr2=0x7fd5cc100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:21:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.494+0000 7fd5d46a2700 1 -- 172.21.15.134:0/655083066 shutdown_connections 2024-02-16T22:21:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:21:46.494+0000 7fd5d46a2700 1 -- 172.21.15.134:0/655083066 wait complete. 2024-02-16T22:21:47.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: pgmap v27: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/1387139025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:21:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:21:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:21:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:46 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: pgmap v27: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/1387139025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:47.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:47.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:21:47.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:21:47.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:47.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:21:47.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:47.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:46 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:21:48.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:47 smithi134 ceph-mon[28869]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:48.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:47 smithi173 ceph-mon[37280]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:21:49.311 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:48 smithi134 ceph-mon[28869]: pgmap v28: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:49.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:48 smithi173 ceph-mon[37280]: pgmap v28: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:50.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:49 smithi134 ceph-mon[28869]: Upgrade: Updating prometheus.smithi134 2024-02-16T22:21:50.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:49 smithi134 ceph-mon[28869]: Deploying daemon prometheus.smithi134 on smithi134 2024-02-16T22:21:50.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:49 smithi173 ceph-mon[37280]: Upgrade: Updating prometheus.smithi134 2024-02-16T22:21:50.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:49 smithi173 ceph-mon[37280]: Deploying daemon prometheus.smithi134 on smithi134 2024-02-16T22:21:51.087 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:50 smithi134 ceph-mon[28869]: pgmap v29: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:51.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:50 smithi173 ceph-mon[37280]: pgmap v29: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:52.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:52 smithi134 ceph-mon[28869]: pgmap v30: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:52.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:52 smithi173 ceph-mon[37280]: pgmap v30: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:55.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:55 smithi134 ceph-mon[28869]: pgmap v31: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:55.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:55 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:55.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:55 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:55.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:55 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:21:55.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:55 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:55.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:55 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:55.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:55 smithi173 ceph-mon[37280]: pgmap v31: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:55.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:55 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:55.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:55 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:55.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:55 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:21:55.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:55 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:55.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:55 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:21:57.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:57 smithi134 ceph-mon[28869]: pgmap v32: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:57.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:57 smithi173 ceph-mon[37280]: pgmap v32: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:59.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:59 smithi134 ceph-mon[28869]: pgmap v33: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:59.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:21:59 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:21:59.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:59 smithi173 ceph-mon[37280]: pgmap v33: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:21:59.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:21:59 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:22:00.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:00 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:00.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:00 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:00.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:00 smithi134 ceph-mon[28869]: pgmap v34: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:00.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:00 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:00.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:00 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:00.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:00 smithi173 ceph-mon[37280]: pgmap v34: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:01.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:01 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:01.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:01 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:01.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:01 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:01.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:01 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:02.842 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:02 smithi134 ceph-mon[28869]: pgmap v35: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:02.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:02 smithi173 ceph-mon[37280]: pgmap v35: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:05.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: pgmap v36: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:05.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:05.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:05.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:22:05.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:22:05.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:05.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:22:05.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:22:05.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:05 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: pgmap v36: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:05.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:05.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:05.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:22:05.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:22:05.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:05.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:22:05.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:22:05.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:05.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:05 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:06.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:06 smithi134 ceph-mon[28869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:22:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:06 smithi173 ceph-mon[37280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-16T22:22:07.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:07 smithi134 ceph-mon[28869]: pgmap v37: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:07.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:07 smithi134 ceph-mon[28869]: Upgrade: Updating alertmanager.smithi134 2024-02-16T22:22:07.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:07 smithi134 ceph-mon[28869]: Deploying daemon alertmanager.smithi134 on smithi134 2024-02-16T22:22:07.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:07 smithi173 ceph-mon[37280]: pgmap v37: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:07.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:07 smithi173 ceph-mon[37280]: Upgrade: Updating alertmanager.smithi134 2024-02-16T22:22:07.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:07 smithi173 ceph-mon[37280]: Deploying daemon alertmanager.smithi134 on smithi134 2024-02-16T22:22:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:09 smithi134 ceph-mon[28869]: pgmap v38: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:09 smithi173 ceph-mon[37280]: pgmap v38: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:11.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:11 smithi134 ceph-mon[28869]: pgmap v39: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:11.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:11 smithi173 ceph-mon[37280]: pgmap v39: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:13 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:13 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:13 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:22:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:13 smithi134 ceph-mon[28869]: pgmap v40: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:13.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:13 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:13.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:13 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:13.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:13 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:22:13.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:13 smithi173 ceph-mon[37280]: pgmap v40: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:14.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:14 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:22:14.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:14 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:22:15.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:15 smithi134 ceph-mon[28869]: pgmap v41: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:15.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:15 smithi173 ceph-mon[37280]: pgmap v41: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.601+0000 7f4391840700 1 -- 172.21.15.134:0/2486049166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f438c0fbe40 msgr2=0x7f438c0fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.601+0000 7f4391840700 1 --2- 172.21.15.134:0/2486049166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f438c0fbe40 0x7f438c0fc250 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f437c004940 tx=0x7f437c009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.601+0000 7f4391840700 1 -- 172.21.15.134:0/2486049166 shutdown_connections 2024-02-16T22:22:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.601+0000 7f4391840700 1 --2- 172.21.15.134:0/2486049166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f438c0fcfb0 0x7f438c0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.601+0000 7f4391840700 1 --2- 172.21.15.134:0/2486049166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f438c0fbe40 0x7f438c0fc250 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.601+0000 7f4391840700 1 -- 172.21.15.134:0/2486049166 >> 172.21.15.134:0/2486049166 conn(0x7f438c0f74e0 msgr2=0x7f438c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.601+0000 7f4391840700 1 -- 172.21.15.134:0/2486049166 shutdown_connections 2024-02-16T22:22:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.601+0000 7f4391840700 1 -- 172.21.15.134:0/2486049166 wait complete. 2024-02-16T22:22:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.602+0000 7f4391840700 1 Processor -- start 2024-02-16T22:22:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.602+0000 7f4391840700 1 -- start start 2024-02-16T22:22:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.602+0000 7f4391840700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f438c0fbe40 0x7f438c110660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.602+0000 7f4391840700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f438c0fcfb0 0x7f438c112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.602+0000 7f4391840700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c066460 con 0x7f438c0fcfb0 2024-02-16T22:22:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.602+0000 7f4391840700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c0665a0 con 0x7f438c0fbe40 2024-02-16T22:22:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.602+0000 7f438a7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f438c0fcfb0 0x7f438c112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.602+0000 7f438a7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f438c0fcfb0 0x7f438c112bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56450/0 (socket says 172.21.15.134:56450) 2024-02-16T22:22:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.602+0000 7f438a7fc700 1 -- 172.21.15.134:0/3245441857 learned_addr learned my addr 172.21.15.134:0/3245441857 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:22:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.602+0000 7f438affd700 1 --2- 172.21.15.134:0/3245441857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f438c0fbe40 0x7f438c110660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.602+0000 7f438a7fc700 1 -- 172.21.15.134:0/3245441857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f438c0fbe40 msgr2=0x7f438c110660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.602+0000 7f438a7fc700 1 --2- 172.21.15.134:0/3245441857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f438c0fbe40 0x7f438c110660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.603+0000 7f438a7fc700 1 -- 172.21.15.134:0/3245441857 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c005040 con 0x7f438c0fcfb0 2024-02-16T22:22:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.603+0000 7f438a7fc700 1 --2- 172.21.15.134:0/3245441857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f438c0fcfb0 0x7f438c112bb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4380002a50 tx=0x7f43800046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.603+0000 7f43737fe700 1 -- 172.21.15.134:0/3245441857 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4380007cc0 con 0x7f438c0fcfb0 2024-02-16T22:22:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.603+0000 7f43737fe700 1 -- 172.21.15.134:0/3245441857 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f438000f040 con 0x7f438c0fcfb0 2024-02-16T22:22:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.603+0000 7f4391840700 1 -- 172.21.15.134:0/3245441857 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c1131b0 con 0x7f438c0fcfb0 2024-02-16T22:22:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.603+0000 7f43737fe700 1 -- 172.21.15.134:0/3245441857 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f438000da30 con 0x7f438c0fcfb0 2024-02-16T22:22:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.603+0000 7f4391840700 1 -- 172.21.15.134:0/3245441857 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c1136f0 con 0x7f438c0fcfb0 2024-02-16T22:22:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.604+0000 7f4391840700 1 -- 172.21.15.134:0/3245441857 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c04bed0 con 0x7f438c0fcfb0 2024-02-16T22:22:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.604+0000 7f43737fe700 1 -- 172.21.15.134:0/3245441857 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f438000dcb0 con 0x7f438c0fcfb0 2024-02-16T22:22:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.605+0000 7f43737fe700 1 --2- 172.21.15.134:0/3245441857 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f437406d200 0x7f437406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.605+0000 7f43737fe700 1 -- 172.21.15.134:0/3245441857 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f438008c5b0 con 0x7f438c0fcfb0 2024-02-16T22:22:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.605+0000 7f438affd700 1 --2- 172.21.15.134:0/3245441857 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f437406d200 0x7f437406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.605+0000 7f438affd700 1 --2- 172.21.15.134:0/3245441857 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f437406d200 0x7f437406f6b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f437c00b3b0 tx=0x7f437c009e30 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.610+0000 7f43737fe700 1 -- 172.21.15.134:0/3245441857 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4380056430 con 0x7f438c0fcfb0 2024-02-16T22:22:16.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.829+0000 7f4391840700 1 -- 172.21.15.134:0/3245441857 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f438c101990 con 0x7f437406d200 2024-02-16T22:22:16.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.831+0000 7f43737fe700 1 -- 172.21.15.134:0/3245441857 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f438c101990 con 0x7f437406d200 2024-02-16T22:22:16.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.833+0000 7f4391840700 1 -- 172.21.15.134:0/3245441857 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f437406d200 msgr2=0x7f437406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:16.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.833+0000 7f4391840700 1 --2- 172.21.15.134:0/3245441857 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f437406d200 0x7f437406f6b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f437c00b3b0 tx=0x7f437c009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:16.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.833+0000 7f4391840700 1 -- 172.21.15.134:0/3245441857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f438c0fcfb0 msgr2=0x7f438c112bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:16.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.833+0000 7f4391840700 1 --2- 172.21.15.134:0/3245441857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f438c0fcfb0 0x7f438c112bb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4380002a50 tx=0x7f43800046b0 comp rx=0 tx=0).stop 2024-02-16T22:22:16.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.833+0000 7f4391840700 1 -- 172.21.15.134:0/3245441857 shutdown_connections 2024-02-16T22:22:16.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.833+0000 7f4391840700 1 --2- 172.21.15.134:0/3245441857 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f437406d200 0x7f437406f6b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:16.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.833+0000 7f4391840700 1 --2- 172.21.15.134:0/3245441857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f438c0fbe40 0x7f438c110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:16.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.833+0000 7f4391840700 1 --2- 172.21.15.134:0/3245441857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f438c0fcfb0 0x7f438c112bb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:16.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.833+0000 7f4391840700 1 -- 172.21.15.134:0/3245441857 >> 172.21.15.134:0/3245441857 conn(0x7f438c0f74e0 msgr2=0x7f438c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:16.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.833+0000 7f4391840700 1 -- 172.21.15.134:0/3245441857 shutdown_connections 2024-02-16T22:22:16.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.833+0000 7f4391840700 1 -- 172.21.15.134:0/3245441857 wait complete. 2024-02-16T22:22:16.847 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:22:16.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.951+0000 7f2df9d38700 1 -- 172.21.15.134:0/1938428042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df4066bf0 msgr2=0x7f2df40ffb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:16.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.951+0000 7f2df9d38700 1 --2- 172.21.15.134:0/1938428042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df4066bf0 0x7f2df40ffb80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2de4004940 tx=0x7f2de4009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:16.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.951+0000 7f2df9d38700 1 -- 172.21.15.134:0/1938428042 shutdown_connections 2024-02-16T22:22:16.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.951+0000 7f2df9d38700 1 --2- 172.21.15.134:0/1938428042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df41000c0 0x7f2df41024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:16.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.951+0000 7f2df9d38700 1 --2- 172.21.15.134:0/1938428042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df4066bf0 0x7f2df40ffb80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:16.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.951+0000 7f2df9d38700 1 -- 172.21.15.134:0/1938428042 >> 172.21.15.134:0/1938428042 conn(0x7f2df40f7590 msgr2=0x7f2df40f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:16.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.951+0000 7f2df9d38700 1 -- 172.21.15.134:0/1938428042 shutdown_connections 2024-02-16T22:22:16.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.951+0000 7f2df9d38700 1 -- 172.21.15.134:0/1938428042 wait complete. 2024-02-16T22:22:16.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.951+0000 7f2df9d38700 1 Processor -- start 2024-02-16T22:22:16.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.952+0000 7f2df9d38700 1 -- start start 2024-02-16T22:22:16.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.952+0000 7f2df9d38700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df4066bf0 0x7f2df406f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:16.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.952+0000 7f2df9d38700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df41000c0 0x7f2df406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.952+0000 7f2df9d38700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df406fb90 con 0x7f2df41000c0 2024-02-16T22:22:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.952+0000 7f2df9d38700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4117570 con 0x7f2df4066bf0 2024-02-16T22:22:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.952+0000 7f2df2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df41000c0 0x7f2df406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.952+0000 7f2df2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df41000c0 0x7f2df406f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56464/0 (socket says 172.21.15.134:56464) 2024-02-16T22:22:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.952+0000 7f2df2ffd700 1 -- 172.21.15.134:0/2565779421 learned_addr learned my addr 172.21.15.134:0/2565779421 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:22:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.952+0000 7f2df37fe700 1 --2- 172.21.15.134:0/2565779421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df4066bf0 0x7f2df406f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.952+0000 7f2df2ffd700 1 -- 172.21.15.134:0/2565779421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df4066bf0 msgr2=0x7f2df406f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.952+0000 7f2df2ffd700 1 --2- 172.21.15.134:0/2565779421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df4066bf0 0x7f2df406f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.952+0000 7f2df2ffd700 1 -- 172.21.15.134:0/2565779421 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de4005040 con 0x7f2df41000c0 2024-02-16T22:22:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.952+0000 7f2df2ffd700 1 --2- 172.21.15.134:0/2565779421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df41000c0 0x7f2df406f590 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2de8002a50 tx=0x7f2de80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.953+0000 7f2ddbfff700 1 -- 172.21.15.134:0/2565779421 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2de8007cc0 con 0x7f2df41000c0 2024-02-16T22:22:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.953+0000 7f2ddbfff700 1 -- 172.21.15.134:0/2565779421 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2de800f040 con 0x7f2df41000c0 2024-02-16T22:22:16.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.953+0000 7f2df9d38700 1 -- 172.21.15.134:0/2565779421 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df4117850 con 0x7f2df41000c0 2024-02-16T22:22:16.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.953+0000 7f2ddbfff700 1 -- 172.21.15.134:0/2565779421 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2de800da30 con 0x7f2df41000c0 2024-02-16T22:22:16.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.953+0000 7f2df9d38700 1 -- 172.21.15.134:0/2565779421 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df4117cd0 con 0x7f2df41000c0 2024-02-16T22:22:16.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.954+0000 7f2ddbfff700 1 -- 172.21.15.134:0/2565779421 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f2de800db90 con 0x7f2df41000c0 2024-02-16T22:22:16.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.955+0000 7f2df9d38700 1 -- 172.21.15.134:0/2565779421 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df404bed0 con 0x7f2df41000c0 2024-02-16T22:22:16.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.955+0000 7f2ddbfff700 1 --2- 172.21.15.134:0/2565779421 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f2ddc06d2d0 0x7f2ddc06f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:16.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.955+0000 7f2ddbfff700 1 -- 172.21.15.134:0/2565779421 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f2de808c570 con 0x7f2df41000c0 2024-02-16T22:22:16.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.955+0000 7f2df37fe700 1 --2- 172.21.15.134:0/2565779421 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f2ddc06d2d0 0x7f2ddc06f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:16.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.955+0000 7f2df37fe700 1 --2- 172.21.15.134:0/2565779421 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f2ddc06d2d0 0x7f2ddc06f780 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2de4004890 tx=0x7f2de4009e30 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:16.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:16.960+0000 7f2ddbfff700 1 -- 172.21.15.134:0/2565779421 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f2de8059f00 con 0x7f2df41000c0 2024-02-16T22:22:17.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.179+0000 7f2df9d38700 1 -- 172.21.15.134:0/2565779421 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2df4118230 con 0x7f2ddc06d2d0 2024-02-16T22:22:17.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.180+0000 7f2ddbfff700 1 -- 172.21.15.134:0/2565779421 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f2df4118230 con 0x7f2ddc06d2d0 2024-02-16T22:22:17.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.182+0000 7f2df9d38700 1 -- 172.21.15.134:0/2565779421 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f2ddc06d2d0 msgr2=0x7f2ddc06f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:17.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.182+0000 7f2df9d38700 1 --2- 172.21.15.134:0/2565779421 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f2ddc06d2d0 0x7f2ddc06f780 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2de4004890 tx=0x7f2de4009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:17.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.182+0000 7f2df9d38700 1 -- 172.21.15.134:0/2565779421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df41000c0 msgr2=0x7f2df406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:17.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.182+0000 7f2df9d38700 1 --2- 172.21.15.134:0/2565779421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df41000c0 0x7f2df406f590 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2de8002a50 tx=0x7f2de80046b0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.182+0000 7f2df9d38700 1 -- 172.21.15.134:0/2565779421 shutdown_connections 2024-02-16T22:22:17.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.182+0000 7f2df9d38700 1 --2- 172.21.15.134:0/2565779421 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f2ddc06d2d0 0x7f2ddc06f780 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.182+0000 7f2df9d38700 1 --2- 172.21.15.134:0/2565779421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df4066bf0 0x7f2df406f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.182+0000 7f2df9d38700 1 --2- 172.21.15.134:0/2565779421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df41000c0 0x7f2df406f590 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.182+0000 7f2df9d38700 1 -- 172.21.15.134:0/2565779421 >> 172.21.15.134:0/2565779421 conn(0x7f2df40f7590 msgr2=0x7f2df40f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:17.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.182+0000 7f2df9d38700 1 -- 172.21.15.134:0/2565779421 shutdown_connections 2024-02-16T22:22:17.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.182+0000 7f2df9d38700 1 -- 172.21.15.134:0/2565779421 wait complete. 2024-02-16T22:22:17.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.286+0000 7fbebbf7b700 1 -- 172.21.15.134:0/19513926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeb40fcfb0 msgr2=0x7fbeb40fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:17.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.286+0000 7fbebbf7b700 1 --2- 172.21.15.134:0/19513926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeb40fcfb0 0x7fbeb40fd420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbea4004940 tx=0x7fbea4009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:17.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.286+0000 7fbebbf7b700 1 -- 172.21.15.134:0/19513926 shutdown_connections 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.286+0000 7fbebbf7b700 1 --2- 172.21.15.134:0/19513926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeb40fcfb0 0x7fbeb40fd420 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.286+0000 7fbebbf7b700 1 --2- 172.21.15.134:0/19513926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbeb40fbe40 0x7fbeb40fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.286+0000 7fbebbf7b700 1 -- 172.21.15.134:0/19513926 >> 172.21.15.134:0/19513926 conn(0x7fbeb40f7500 msgr2=0x7fbeb40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.286+0000 7fbebbf7b700 1 -- 172.21.15.134:0/19513926 shutdown_connections 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.286+0000 7fbebbf7b700 1 -- 172.21.15.134:0/19513926 wait complete. 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.287+0000 7fbebbf7b700 1 Processor -- start 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.287+0000 7fbebbf7b700 1 -- start start 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.287+0000 7fbebbf7b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbeb40fbe40 0x7fbeb4110640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.287+0000 7fbebbf7b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeb40fcfb0 0x7fbeb4112b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.287+0000 7fbebbf7b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb4066d10 con 0x7fbeb40fcfb0 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.287+0000 7fbebbf7b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb4066e50 con 0x7fbeb40fbe40 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.287+0000 7fbeb9516700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeb40fcfb0 0x7fbeb4112b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.287+0000 7fbeb9516700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeb40fcfb0 0x7fbeb4112b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56486/0 (socket says 172.21.15.134:56486) 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.287+0000 7fbeb9516700 1 -- 172.21.15.134:0/1212240406 learned_addr learned my addr 172.21.15.134:0/1212240406 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.287+0000 7fbeb9d17700 1 --2- 172.21.15.134:0/1212240406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbeb40fbe40 0x7fbeb4110640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:17.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.287+0000 7fbeb9516700 1 -- 172.21.15.134:0/1212240406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbeb40fbe40 msgr2=0x7fbeb4110640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:17.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.287+0000 7fbeb9516700 1 --2- 172.21.15.134:0/1212240406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbeb40fbe40 0x7fbeb4110640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.287+0000 7fbeb9516700 1 -- 172.21.15.134:0/1212240406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea4005040 con 0x7fbeb40fcfb0 2024-02-16T22:22:17.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.287+0000 7fbeb9516700 1 --2- 172.21.15.134:0/1212240406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeb40fcfb0 0x7fbeb4112b90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbea40093b0 tx=0x7fbea4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:17.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.288+0000 7fbeaa7fc700 1 -- 172.21.15.134:0/1212240406 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbea400e040 con 0x7fbeb40fcfb0 2024-02-16T22:22:17.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.288+0000 7fbebbf7b700 1 -- 172.21.15.134:0/1212240406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb4113190 con 0x7fbeb40fcfb0 2024-02-16T22:22:17.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.288+0000 7fbeaa7fc700 1 -- 172.21.15.134:0/1212240406 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbea400bcc0 con 0x7fbeb40fcfb0 2024-02-16T22:22:17.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.288+0000 7fbebbf7b700 1 -- 172.21.15.134:0/1212240406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb4113680 con 0x7fbeb40fcfb0 2024-02-16T22:22:17.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.288+0000 7fbeaa7fc700 1 -- 172.21.15.134:0/1212240406 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbea401c630 con 0x7fbeb40fcfb0 2024-02-16T22:22:17.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.289+0000 7fbebbf7b700 1 -- 172.21.15.134:0/1212240406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb404bed0 con 0x7fbeb40fcfb0 2024-02-16T22:22:17.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.289+0000 7fbeaa7fc700 1 -- 172.21.15.134:0/1212240406 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7fbea4013980 con 0x7fbeb40fcfb0 2024-02-16T22:22:17.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.290+0000 7fbeaa7fc700 1 --2- 172.21.15.134:0/1212240406 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fbea006d200 0x7fbea006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:17.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.290+0000 7fbeaa7fc700 1 -- 172.21.15.134:0/1212240406 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fbea408dc00 con 0x7fbeb40fcfb0 2024-02-16T22:22:17.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.290+0000 7fbeb9d17700 1 --2- 172.21.15.134:0/1212240406 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fbea006d200 0x7fbea006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:17.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.290+0000 7fbeb9d17700 1 --2- 172.21.15.134:0/1212240406 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fbea006d200 0x7fbea006f6b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4066990 tx=0x7fbeb000b040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:17.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.294+0000 7fbeaa7fc700 1 -- 172.21.15.134:0/1212240406 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fbea4057a60 con 0x7fbeb40fcfb0 2024-02-16T22:22:17.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:17 smithi134 ceph-mon[28869]: pgmap v42: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:17.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:17 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:17.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:17 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:17.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:17 smithi173 ceph-mon[37280]: pgmap v42: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:17.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:17 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:17.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:17 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:17.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.504+0000 7fbebbf7b700 1 -- 172.21.15.134:0/1212240406 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbeb4101990 con 0x7fbea006d200 2024-02-16T22:22:17.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.514+0000 7fbeaa7fc700 1 -- 172.21.15.134:0/1212240406 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fbeb4101990 con 0x7fbea006d200 2024-02-16T22:22:17.516 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:22:17.517 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (6s) 0s ago 11m 17.1M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:22:17.517 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (11m) 0s ago 11m 6660k - 17.2.7-513-gb88fae66 870a0944ccb8 a0d53bc0a925 2024-02-16T22:22:17.517 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (10m) 37s ago 10m 6669k - 17.2.7-513-gb88fae66 870a0944ccb8 a8d69537e08a 2024-02-16T22:22:17.517 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (109s) 0s ago 10m 80.0M - 9.4.7 954c08fa6188 4e6d36fb67d5 2024-02-16T22:22:17.517 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (5m) 0s ago 5m 12.8M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:22:17.517 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (5m) 0s ago 5m 126M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:22:17.517 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (5m) 37s ago 5m 15.7M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:22:17.518 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (5m) 37s ago 5m 119M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:22:17.518 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (90s) 0s ago 12m 500M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:22:17.518 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (57s) 37s ago 10m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:22:17.518 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (12m) 0s ago 12m 53.7M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 93a679740d93 2024-02-16T22:22:17.518 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (10m) 37s ago 10m 43.3M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 cfbef35950ef 2024-02-16T22:22:17.518 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (45s) 0s ago 11m 8632k - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:22:17.518 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (41s) 37s ago 10m 3397k - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:22:17.518 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (9m) 0s ago 9m 217M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 099f0b29d202 2024-02-16T22:22:17.518 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (8m) 0s ago 8m 231M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:22:17.518 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (8m) 0s ago 8m 188M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:22:17.518 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (8m) 37s ago 7m 265M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:22:17.519 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (7m) 37s ago 7m 235M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:22:17.519 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (7m) 37s ago 7m 228M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:22:17.519 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (23s) 0s ago 10m 43.5M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:22:17.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.516+0000 7fbebbf7b700 1 -- 172.21.15.134:0/1212240406 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fbea006d200 msgr2=0x7fbea006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:17.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.516+0000 7fbebbf7b700 1 --2- 172.21.15.134:0/1212240406 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fbea006d200 0x7fbea006f6b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4066990 tx=0x7fbeb000b040 comp rx=0 tx=0).stop 2024-02-16T22:22:17.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.516+0000 7fbebbf7b700 1 -- 172.21.15.134:0/1212240406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeb40fcfb0 msgr2=0x7fbeb4112b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:17.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.516+0000 7fbebbf7b700 1 --2- 172.21.15.134:0/1212240406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeb40fcfb0 0x7fbeb4112b90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbea40093b0 tx=0x7fbea4009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:17.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.516+0000 7fbebbf7b700 1 -- 172.21.15.134:0/1212240406 shutdown_connections 2024-02-16T22:22:17.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.516+0000 7fbebbf7b700 1 --2- 172.21.15.134:0/1212240406 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fbea006d200 0x7fbea006f6b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.517+0000 7fbebbf7b700 1 --2- 172.21.15.134:0/1212240406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbeb40fbe40 0x7fbeb4110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.517+0000 7fbebbf7b700 1 --2- 172.21.15.134:0/1212240406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeb40fcfb0 0x7fbeb4112b90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.517+0000 7fbebbf7b700 1 -- 172.21.15.134:0/1212240406 >> 172.21.15.134:0/1212240406 conn(0x7fbeb40f7500 msgr2=0x7fbeb4100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.517+0000 7fbebbf7b700 1 -- 172.21.15.134:0/1212240406 shutdown_connections 2024-02-16T22:22:17.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.517+0000 7fbebbf7b700 1 -- 172.21.15.134:0/1212240406 wait complete. 2024-02-16T22:22:17.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.622+0000 7f9270516700 1 -- 172.21.15.134:0/3376639288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92680fd080 msgr2=0x7f92680fd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:17.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.623+0000 7f9270516700 1 --2- 172.21.15.134:0/3376639288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92680fd080 0x7f92680fd4f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9258004940 tx=0x7f9258009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:17.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.623+0000 7f9270516700 1 -- 172.21.15.134:0/3376639288 shutdown_connections 2024-02-16T22:22:17.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.623+0000 7f9270516700 1 --2- 172.21.15.134:0/3376639288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92680fd080 0x7f92680fd4f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.623+0000 7f9270516700 1 --2- 172.21.15.134:0/3376639288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92680fbe80 0x7f92680fc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.623+0000 7f9270516700 1 -- 172.21.15.134:0/3376639288 >> 172.21.15.134:0/3376639288 conn(0x7f92680f7590 msgr2=0x7f92680f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:17.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.623+0000 7f9270516700 1 -- 172.21.15.134:0/3376639288 shutdown_connections 2024-02-16T22:22:17.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.623+0000 7f9270516700 1 -- 172.21.15.134:0/3376639288 wait complete. 2024-02-16T22:22:17.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.623+0000 7f9270516700 1 Processor -- start 2024-02-16T22:22:17.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.623+0000 7f9270516700 1 -- start start 2024-02-16T22:22:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f9270516700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92680fbe80 0x7f926810c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f9270516700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92680fd080 0x7f926810cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f9270516700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926810d360 con 0x7f92680fd080 2024-02-16T22:22:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f9270516700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926810dc00 con 0x7f92680fbe80 2024-02-16T22:22:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f926dab1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92680fd080 0x7f926810cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f926dab1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92680fd080 0x7f926810cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56510/0 (socket says 172.21.15.134:56510) 2024-02-16T22:22:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f926dab1700 1 -- 172.21.15.134:0/1839127206 learned_addr learned my addr 172.21.15.134:0/1839127206 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:22:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f926e2b2700 1 --2- 172.21.15.134:0/1839127206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92680fbe80 0x7f926810c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f926dab1700 1 -- 172.21.15.134:0/1839127206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92680fbe80 msgr2=0x7f926810c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f926dab1700 1 --2- 172.21.15.134:0/1839127206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92680fbe80 0x7f926810c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f926dab1700 1 -- 172.21.15.134:0/1839127206 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9258005040 con 0x7f92680fd080 2024-02-16T22:22:17.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f926dab1700 1 --2- 172.21.15.134:0/1839127206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92680fd080 0x7f926810cd60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9258000c00 tx=0x7f9258009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f925effd700 1 -- 172.21.15.134:0/1839127206 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9258021070 con 0x7f92680fd080 2024-02-16T22:22:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f925effd700 1 -- 172.21.15.134:0/1839127206 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f925801c400 con 0x7f92680fd080 2024-02-16T22:22:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f925effd700 1 -- 172.21.15.134:0/1839127206 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f925800e070 con 0x7f92680fd080 2024-02-16T22:22:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f9270516700 1 -- 172.21.15.134:0/1839127206 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926810de80 con 0x7f92680fd080 2024-02-16T22:22:17.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.624+0000 7f9270516700 1 -- 172.21.15.134:0/1839127206 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926810e360 con 0x7f92680fd080 2024-02-16T22:22:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.625+0000 7f9270516700 1 -- 172.21.15.134:0/1839127206 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926804bed0 con 0x7f92680fd080 2024-02-16T22:22:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.626+0000 7f925effd700 1 -- 172.21.15.134:0/1839127206 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f925801ca50 con 0x7f92680fd080 2024-02-16T22:22:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.626+0000 7f925effd700 1 --2- 172.21.15.134:0/1839127206 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f925406d200 0x7f925406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.626+0000 7f925effd700 1 -- 172.21.15.134:0/1839127206 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f925808d8e0 con 0x7f92680fd080 2024-02-16T22:22:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.626+0000 7f926e2b2700 1 --2- 172.21.15.134:0/1839127206 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f925406d200 0x7f925406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:17.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.627+0000 7f926e2b2700 1 --2- 172.21.15.134:0/1839127206 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f925406d200 0x7f925406f6b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9264009b80 tx=0x7f926400b040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:17.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.631+0000 7f925effd700 1 -- 172.21.15.134:0/1839127206 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f925805b3b0 con 0x7f92680fd080 2024-02-16T22:22:17.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.923+0000 7f9270516700 1 -- 172.21.15.134:0/1839127206 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9268104930 con 0x7f92680fd080 2024-02-16T22:22:17.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.924+0000 7f925effd700 1 -- 172.21.15.134:0/1839127206 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f925805af40 con 0x7f92680fd080 2024-02-16T22:22:17.926 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:22:17.926 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:22:17.926 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 2 2024-02-16T22:22:17.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:22:17.926 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:22:17.926 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:22:17.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:22:17.926 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:22:17.926 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 6 2024-02-16T22:22:17.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:22:17.927 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:22:17.927 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:22:17.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:22:17.927 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:22:17.927 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 12, 2024-02-16T22:22:17.927 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:22:17.927 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:22:17.927 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:22:17.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.926+0000 7f9270516700 1 -- 172.21.15.134:0/1839127206 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f925406d200 msgr2=0x7f925406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:17.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.926+0000 7f9270516700 1 --2- 172.21.15.134:0/1839127206 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f925406d200 0x7f925406f6b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9264009b80 tx=0x7f926400b040 comp rx=0 tx=0).stop 2024-02-16T22:22:17.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.926+0000 7f9270516700 1 -- 172.21.15.134:0/1839127206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92680fd080 msgr2=0x7f926810cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:17.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.926+0000 7f9270516700 1 --2- 172.21.15.134:0/1839127206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92680fd080 0x7f926810cd60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9258000c00 tx=0x7f9258009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:17.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.926+0000 7f9270516700 1 -- 172.21.15.134:0/1839127206 shutdown_connections 2024-02-16T22:22:17.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.926+0000 7f9270516700 1 --2- 172.21.15.134:0/1839127206 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f925406d200 0x7f925406f6b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.926+0000 7f9270516700 1 --2- 172.21.15.134:0/1839127206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92680fbe80 0x7f926810c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.926+0000 7f9270516700 1 --2- 172.21.15.134:0/1839127206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92680fd080 0x7f926810cd60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:17.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.926+0000 7f9270516700 1 -- 172.21.15.134:0/1839127206 >> 172.21.15.134:0/1839127206 conn(0x7f92680f7590 msgr2=0x7f92681002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:17.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.926+0000 7f9270516700 1 -- 172.21.15.134:0/1839127206 shutdown_connections 2024-02-16T22:22:17.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:17.926+0000 7f9270516700 1 -- 172.21.15.134:0/1839127206 wait complete. 2024-02-16T22:22:18.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.031+0000 7f5bb1341700 1 -- 172.21.15.134:0/1746203681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bac0fbe40 msgr2=0x7f5bac0fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:18.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.031+0000 7f5bb1341700 1 --2- 172.21.15.134:0/1746203681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bac0fbe40 0x7f5bac0fc250 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c004940 tx=0x7f5b9c009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:18.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.031+0000 7f5bb1341700 1 -- 172.21.15.134:0/1746203681 shutdown_connections 2024-02-16T22:22:18.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.031+0000 7f5bb1341700 1 --2- 172.21.15.134:0/1746203681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5bac0fcfb0 0x7f5bac0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:18.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.031+0000 7f5bb1341700 1 --2- 172.21.15.134:0/1746203681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bac0fbe40 0x7f5bac0fc250 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:18.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.031+0000 7f5bb1341700 1 -- 172.21.15.134:0/1746203681 >> 172.21.15.134:0/1746203681 conn(0x7f5bac0f74e0 msgr2=0x7f5bac0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:18.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.032+0000 7f5bb1341700 1 -- 172.21.15.134:0/1746203681 shutdown_connections 2024-02-16T22:22:18.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.032+0000 7f5bb1341700 1 -- 172.21.15.134:0/1746203681 wait complete. 2024-02-16T22:22:18.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.032+0000 7f5bb1341700 1 Processor -- start 2024-02-16T22:22:18.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.032+0000 7f5bb1341700 1 -- start start 2024-02-16T22:22:18.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.032+0000 7f5bb1341700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bac0fbe40 0x7f5bac10d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:18.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.032+0000 7f5bb1341700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5bac0fcfb0 0x7f5bac10de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:18.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.032+0000 7f5bb1341700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac10e500 con 0x7f5bac0fbe40 2024-02-16T22:22:18.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.032+0000 7f5bb1341700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac10ed40 con 0x7f5bac0fcfb0 2024-02-16T22:22:18.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.033+0000 7f5baaffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bac0fbe40 0x7f5bac10d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:18.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.033+0000 7f5baaffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bac0fbe40 0x7f5bac10d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56536/0 (socket says 172.21.15.134:56536) 2024-02-16T22:22:18.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.033+0000 7f5baaffd700 1 -- 172.21.15.134:0/2911902241 learned_addr learned my addr 172.21.15.134:0/2911902241 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:22:18.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.033+0000 7f5baa7fc700 1 --2- 172.21.15.134:0/2911902241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5bac0fcfb0 0x7f5bac10de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:18.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.033+0000 7f5baaffd700 1 -- 172.21.15.134:0/2911902241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5bac0fcfb0 msgr2=0x7f5bac10de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:18.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.033+0000 7f5baaffd700 1 --2- 172.21.15.134:0/2911902241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5bac0fcfb0 0x7f5bac10de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:18.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.033+0000 7f5baaffd700 1 -- 172.21.15.134:0/2911902241 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c005040 con 0x7f5bac0fbe40 2024-02-16T22:22:18.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.033+0000 7f5baa7fc700 1 --2- 172.21.15.134:0/2911902241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5bac0fcfb0 0x7f5bac10de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:22:18.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.033+0000 7f5baaffd700 1 --2- 172.21.15.134:0/2911902241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bac0fbe40 0x7f5bac10d930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0093b0 tx=0x7f5b9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:18.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.033+0000 7f5b937fe700 1 -- 172.21.15.134:0/2911902241 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b9c00e040 con 0x7f5bac0fbe40 2024-02-16T22:22:18.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.033+0000 7f5b937fe700 1 -- 172.21.15.134:0/2911902241 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b9c00bcc0 con 0x7f5bac0fbe40 2024-02-16T22:22:18.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.033+0000 7f5bb1341700 1 -- 172.21.15.134:0/2911902241 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bac10efc0 con 0x7f5bac0fbe40 2024-02-16T22:22:18.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.033+0000 7f5b937fe700 1 -- 172.21.15.134:0/2911902241 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b9c01c630 con 0x7f5bac0fbe40 2024-02-16T22:22:18.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.033+0000 7f5bb1341700 1 -- 172.21.15.134:0/2911902241 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bac10f500 con 0x7f5bac0fbe40 2024-02-16T22:22:18.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.034+0000 7f5bb1341700 1 -- 172.21.15.134:0/2911902241 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bac04bed0 con 0x7f5bac0fbe40 2024-02-16T22:22:18.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.035+0000 7f5b937fe700 1 -- 172.21.15.134:0/2911902241 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f5b9c0139f0 con 0x7f5bac0fbe40 2024-02-16T22:22:18.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.035+0000 7f5b937fe700 1 --2- 172.21.15.134:0/2911902241 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f5b9406d200 0x7f5b9406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:18.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.036+0000 7f5b937fe700 1 -- 172.21.15.134:0/2911902241 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f5b9c08dc50 con 0x7f5bac0fbe40 2024-02-16T22:22:18.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.036+0000 7f5baa7fc700 1 --2- 172.21.15.134:0/2911902241 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f5b9406d200 0x7f5b9406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:18.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.036+0000 7f5baa7fc700 1 --2- 172.21.15.134:0/2911902241 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f5b9406d200 0x7f5b9406f6b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009b10 tx=0x7f5ba0008040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:18.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.040+0000 7f5b937fe700 1 -- 172.21.15.134:0/2911902241 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5b9c05b680 con 0x7f5bac0fbe40 2024-02-16T22:22:18.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.269+0000 7f5bb1341700 1 -- 172.21.15.134:0/2911902241 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bac065dd0 con 0x7f5b9406d200 2024-02-16T22:22:18.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.271+0000 7f5b937fe700 1 -- 172.21.15.134:0/2911902241 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f5bac065dd0 con 0x7f5b9406d200 2024-02-16T22:22:18.272 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:22:18.273 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:22:18.273 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:22:18.273 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-16T22:22:18.273 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-02-16T22:22:18.273 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr" 2024-02-16T22:22:18.273 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-02-16T22:22:18.273 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "2/2 daemons upgraded", 2024-02-16T22:22:18.273 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading alertmanager daemons", 2024-02-16T22:22:18.273 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:22:18.273 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:22:18.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.273+0000 7f5bb1341700 1 -- 172.21.15.134:0/2911902241 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f5b9406d200 msgr2=0x7f5b9406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:18.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.273+0000 7f5bb1341700 1 --2- 172.21.15.134:0/2911902241 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f5b9406d200 0x7f5b9406f6b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009b10 tx=0x7f5ba0008040 comp rx=0 tx=0).stop 2024-02-16T22:22:18.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.273+0000 7f5bb1341700 1 -- 172.21.15.134:0/2911902241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bac0fbe40 msgr2=0x7f5bac10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:18.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.273+0000 7f5bb1341700 1 --2- 172.21.15.134:0/2911902241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bac0fbe40 0x7f5bac10d930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0093b0 tx=0x7f5b9c009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:18.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.273+0000 7f5bb1341700 1 -- 172.21.15.134:0/2911902241 shutdown_connections 2024-02-16T22:22:18.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.273+0000 7f5bb1341700 1 --2- 172.21.15.134:0/2911902241 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f5b9406d200 0x7f5b9406f6b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:18.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.273+0000 7f5bb1341700 1 --2- 172.21.15.134:0/2911902241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bac0fbe40 0x7f5bac10d930 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:18.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.273+0000 7f5bb1341700 1 --2- 172.21.15.134:0/2911902241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5bac0fcfb0 0x7f5bac10de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:18.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.273+0000 7f5bb1341700 1 -- 172.21.15.134:0/2911902241 >> 172.21.15.134:0/2911902241 conn(0x7f5bac0f74e0 msgr2=0x7f5bac0656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:18.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.273+0000 7f5bb1341700 1 -- 172.21.15.134:0/2911902241 shutdown_connections 2024-02-16T22:22:18.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:18.273+0000 7f5bb1341700 1 -- 172.21.15.134:0/2911902241 wait complete. 2024-02-16T22:22:18.472 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:18 smithi134 ceph-mon[28869]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:22:18.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:18 smithi134 ceph-mon[28869]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:22:18.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:18 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/1839127206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:18.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:18 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:18.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:18 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:18 smithi173 ceph-mon[37280]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:22:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:18 smithi173 ceph-mon[37280]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:22:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:18 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/1839127206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:18 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:18 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:19.444 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:19 smithi134 ceph-mon[28869]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:22:19.444 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:19 smithi134 ceph-mon[28869]: pgmap v43: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:19 smithi173 ceph-mon[37280]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:22:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:19 smithi173 ceph-mon[37280]: pgmap v43: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:20.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:20 smithi134 ceph-mon[28869]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:22:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:20 smithi173 ceph-mon[37280]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:22:21.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:21 smithi134 ceph-mon[28869]: pgmap v44: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:21.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:21 smithi173 ceph-mon[37280]: pgmap v44: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:22:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:22:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-16T22:22:23.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-16T22:22:23.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:22:23.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:22 smithi134 ceph-mon[28869]: pgmap v45: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:23.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:23.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:23.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:22:23.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:22:23.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:23.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-16T22:22:23.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-16T22:22:23.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:22:23.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:23.233 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:22 smithi173 ceph-mon[37280]: pgmap v45: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:25.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:25 smithi134 ceph-mon[28869]: Upgrade: Updating grafana.smithi134 2024-02-16T22:22:25.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:25 smithi134 ceph-mon[28869]: Deploying daemon grafana.smithi134 on smithi134 2024-02-16T22:22:25.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:25 smithi134 ceph-mon[28869]: pgmap v46: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:25.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:25 smithi173 ceph-mon[37280]: Upgrade: Updating grafana.smithi134 2024-02-16T22:22:25.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:25 smithi173 ceph-mon[37280]: Deploying daemon grafana.smithi134 on smithi134 2024-02-16T22:22:25.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:25 smithi173 ceph-mon[37280]: pgmap v46: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:27.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:27 smithi134 ceph-mon[28869]: pgmap v47: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:27.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:27 smithi173 ceph-mon[37280]: pgmap v47: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:29.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:29 smithi134 ceph-mon[28869]: pgmap v48: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:29.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:29 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:22:29.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:29 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:29.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:29 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:29.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:29 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:22:29.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:29 smithi173 ceph-mon[37280]: pgmap v48: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:29.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:29 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:22:29.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:29 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:29.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:29 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:29.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:29 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:22:30.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:30 smithi134 ceph-mon[28869]: mgrmap e32: smithi134.ordace(active, since 91s), standbys: smithi173.kbofaa 2024-02-16T22:22:30.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:30 smithi134 ceph-mon[28869]: pgmap v49: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:22:30.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:30 smithi173 ceph-mon[37280]: mgrmap e32: smithi134.ordace(active, since 91s), standbys: smithi173.kbofaa 2024-02-16T22:22:30.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:30 smithi173 ceph-mon[37280]: pgmap v49: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:22:32.890 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:32 smithi134 ceph-mon[28869]: pgmap v50: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:22:32.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:32 smithi173 ceph-mon[37280]: pgmap v50: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:22:34.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:34 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:34.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:34 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:34.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:34 smithi134 ceph-mon[28869]: pgmap v51: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:22:34.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:34 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:34.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:34 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:34.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:34 smithi173 ceph-mon[37280]: pgmap v51: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:22:35.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:35 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:35.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:35 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:35.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:35 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:35.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:35 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:36.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:36 smithi134 ceph-mon[28869]: pgmap v52: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:22:36.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:36 smithi173 ceph-mon[37280]: pgmap v52: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:22:39.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:39.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: pgmap v53: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-16T22:22:39.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-16T22:22:39.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-16T22:22:39.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:22:39.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:22:39.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:22:39.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:39.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:22:39.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:22:39.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:22:39.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:39 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:39.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:39.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: pgmap v53: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:22:39.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:39.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:22:39.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:22:39.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-16T22:22:39.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-16T22:22:39.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-16T22:22:39.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-16T22:22:39.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-16T22:22:39.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-16T22:22:39.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-16T22:22:39.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-16T22:22:39.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:22:39.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-16T22:22:39.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-16T22:22:39.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:22:39.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:22:39.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:22:39.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:39.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:22:39.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:22:39.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:22:39.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:39 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:40.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:40 smithi134 ceph-mon[28869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-16T22:22:40.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:40 smithi134 ceph-mon[28869]: Upgrade: Finalizing container_image settings 2024-02-16T22:22:40.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:40 smithi134 ceph-mon[28869]: Upgrade: Complete! 2024-02-16T22:22:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:40 smithi173 ceph-mon[37280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-16T22:22:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:40 smithi173 ceph-mon[37280]: Upgrade: Finalizing container_image settings 2024-02-16T22:22:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:40 smithi173 ceph-mon[37280]: Upgrade: Complete! 2024-02-16T22:22:41.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:41 smithi134 ceph-mon[28869]: pgmap v54: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:22:41.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:41 smithi173 ceph-mon[37280]: pgmap v54: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:22:42.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:42 smithi134 ceph-mon[28869]: pgmap v55: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:42.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:42 smithi173 ceph-mon[37280]: pgmap v55: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:43.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:43 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:22:43.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:43 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:43.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:43 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:22:43.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:43 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:22:44.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:44 smithi134 ceph-mon[28869]: pgmap v56: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:44.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:44 smithi173 ceph-mon[37280]: pgmap v56: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:47 smithi134 ceph-mon[28869]: pgmap v57: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:47 smithi173 ceph-mon[37280]: pgmap v57: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:48.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.389+0000 7ffbb61b9700 1 -- 172.21.15.134:0/4150726254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb00fda80 msgr2=0x7ffbb00ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:48.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.389+0000 7ffbb61b9700 1 --2- 172.21.15.134:0/4150726254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb00fda80 0x7ffbb00ffe60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffba0004940 tx=0x7ffba0009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:48.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.389+0000 7ffbb61b9700 1 -- 172.21.15.134:0/4150726254 shutdown_connections 2024-02-16T22:22:48.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.389+0000 7ffbb61b9700 1 --2- 172.21.15.134:0/4150726254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbb01003a0 0x7ffbb0102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:48.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.389+0000 7ffbb61b9700 1 --2- 172.21.15.134:0/4150726254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb00fda80 0x7ffbb00ffe60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:48.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.389+0000 7ffbb61b9700 1 -- 172.21.15.134:0/4150726254 >> 172.21.15.134:0/4150726254 conn(0x7ffbb00f7500 msgr2=0x7ffbb00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:48.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.389+0000 7ffbb61b9700 1 -- 172.21.15.134:0/4150726254 shutdown_connections 2024-02-16T22:22:48.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.389+0000 7ffbb61b9700 1 -- 172.21.15.134:0/4150726254 wait complete. 2024-02-16T22:22:48.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.390+0000 7ffbb61b9700 1 Processor -- start 2024-02-16T22:22:48.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.390+0000 7ffbb61b9700 1 -- start start 2024-02-16T22:22:48.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.390+0000 7ffbb61b9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb00fda80 0x7ffbb010d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:48.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.390+0000 7ffbb61b9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbb01003a0 0x7ffbb010de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:48.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.390+0000 7ffbb61b9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb010e440 con 0x7ffbb00fda80 2024-02-16T22:22:48.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.390+0000 7ffbb61b9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb010ece0 con 0x7ffbb01003a0 2024-02-16T22:22:48.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.390+0000 7ffbaf7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb00fda80 0x7ffbb010d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:48.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.390+0000 7ffbaf7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb00fda80 0x7ffbb010d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38070/0 (socket says 172.21.15.134:38070) 2024-02-16T22:22:48.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.390+0000 7ffbaf7fe700 1 -- 172.21.15.134:0/3730828053 learned_addr learned my addr 172.21.15.134:0/3730828053 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:22:48.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.390+0000 7ffba6ffd700 1 --2- 172.21.15.134:0/3730828053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbb01003a0 0x7ffbb010de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:48.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.391+0000 7ffbaf7fe700 1 -- 172.21.15.134:0/3730828053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbb01003a0 msgr2=0x7ffbb010de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:48.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.391+0000 7ffbaf7fe700 1 --2- 172.21.15.134:0/3730828053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbb01003a0 0x7ffbb010de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:48.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.391+0000 7ffbaf7fe700 1 -- 172.21.15.134:0/3730828053 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba0005040 con 0x7ffbb00fda80 2024-02-16T22:22:48.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.391+0000 7ffbaf7fe700 1 --2- 172.21.15.134:0/3730828053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb00fda80 0x7ffbb010d900 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffba00093b0 tx=0x7ffba0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:48.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.391+0000 7ffbacff9700 1 -- 172.21.15.134:0/3730828053 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffba000e040 con 0x7ffbb00fda80 2024-02-16T22:22:48.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.391+0000 7ffbacff9700 1 -- 172.21.15.134:0/3730828053 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffba000bcc0 con 0x7ffbb00fda80 2024-02-16T22:22:48.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.391+0000 7ffbacff9700 1 -- 172.21.15.134:0/3730828053 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffba001c630 con 0x7ffbb00fda80 2024-02-16T22:22:48.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.391+0000 7ffbb61b9700 1 -- 172.21.15.134:0/3730828053 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb010ef60 con 0x7ffbb00fda80 2024-02-16T22:22:48.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.391+0000 7ffbb61b9700 1 -- 172.21.15.134:0/3730828053 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb010f4a0 con 0x7ffbb00fda80 2024-02-16T22:22:48.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.392+0000 7ffbb61b9700 1 -- 172.21.15.134:0/3730828053 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb004bed0 con 0x7ffbb00fda80 2024-02-16T22:22:48.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.393+0000 7ffbacff9700 1 -- 172.21.15.134:0/3730828053 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7ffba0013980 con 0x7ffbb00fda80 2024-02-16T22:22:48.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.393+0000 7ffbacff9700 1 --2- 172.21.15.134:0/3730828053 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7ffb9c06d0e0 0x7ffb9c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:48.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.393+0000 7ffbacff9700 1 -- 172.21.15.134:0/3730828053 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ffba008d900 con 0x7ffbb00fda80 2024-02-16T22:22:48.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.393+0000 7ffba6ffd700 1 --2- 172.21.15.134:0/3730828053 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7ffb9c06d0e0 0x7ffb9c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:48.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.394+0000 7ffba6ffd700 1 --2- 172.21.15.134:0/3730828053 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7ffb9c06d0e0 0x7ffb9c06f590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffb98007fd0 tx=0x7ffb98009040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:48.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.398+0000 7ffbacff9700 1 -- 172.21.15.134:0/3730828053 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7ffba005b550 con 0x7ffbb00fda80 2024-02-16T22:22:48.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.612+0000 7ffbb61b9700 1 -- 172.21.15.134:0/3730828053 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbb0101000 con 0x7ffb9c06d0e0 2024-02-16T22:22:48.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.613+0000 7ffbacff9700 1 -- 172.21.15.134:0/3730828053 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7ffbb0101000 con 0x7ffb9c06d0e0 2024-02-16T22:22:48.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.615+0000 7ffbb61b9700 1 -- 172.21.15.134:0/3730828053 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7ffb9c06d0e0 msgr2=0x7ffb9c06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:48.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.615+0000 7ffbb61b9700 1 --2- 172.21.15.134:0/3730828053 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7ffb9c06d0e0 0x7ffb9c06f590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffb98007fd0 tx=0x7ffb98009040 comp rx=0 tx=0).stop 2024-02-16T22:22:48.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.615+0000 7ffbb61b9700 1 -- 172.21.15.134:0/3730828053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb00fda80 msgr2=0x7ffbb010d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:48.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.615+0000 7ffbb61b9700 1 --2- 172.21.15.134:0/3730828053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb00fda80 0x7ffbb010d900 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffba00093b0 tx=0x7ffba0009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:48.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.615+0000 7ffbb61b9700 1 -- 172.21.15.134:0/3730828053 shutdown_connections 2024-02-16T22:22:48.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.615+0000 7ffbb61b9700 1 --2- 172.21.15.134:0/3730828053 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7ffb9c06d0e0 0x7ffb9c06f590 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:48.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.615+0000 7ffbb61b9700 1 --2- 172.21.15.134:0/3730828053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb00fda80 0x7ffbb010d900 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:48.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.615+0000 7ffbb61b9700 1 --2- 172.21.15.134:0/3730828053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbb01003a0 0x7ffbb010de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:48.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.615+0000 7ffbb61b9700 1 -- 172.21.15.134:0/3730828053 >> 172.21.15.134:0/3730828053 conn(0x7ffbb00f7500 msgr2=0x7ffbb00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:48.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.615+0000 7ffbb61b9700 1 -- 172.21.15.134:0/3730828053 shutdown_connections 2024-02-16T22:22:48.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:48.615+0000 7ffbb61b9700 1 -- 172.21.15.134:0/3730828053 wait complete. 2024-02-16T22:22:49.352 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:49 smithi134 ceph-mon[28869]: pgmap v58: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:49.377 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-02-16T22:22:49.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:49 smithi173 ceph-mon[37280]: pgmap v58: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:49.896 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:22:50.288 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:50 smithi134 ceph-mon[28869]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:22:50.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:50 smithi173 ceph-mon[37280]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:22:51.346 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:51 smithi134 ceph-mon[28869]: pgmap v59: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:51.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:51 smithi173 ceph-mon[37280]: pgmap v59: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:51.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.720+0000 7f9b2d483700 1 -- 172.21.15.134:0/1094659449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b28102800 msgr2=0x7f9b280fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:51.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.720+0000 7f9b2d483700 1 --2- 172.21.15.134:0/1094659449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b28102800 0x7f9b280fbe70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9b10004940 tx=0x7f9b10009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:51.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.720+0000 7f9b2d483700 1 -- 172.21.15.134:0/1094659449 shutdown_connections 2024-02-16T22:22:51.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.720+0000 7f9b2d483700 1 --2- 172.21.15.134:0/1094659449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b28102800 0x7f9b280fbe70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:51.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.720+0000 7f9b2d483700 1 --2- 172.21.15.134:0/1094659449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b28101e60 0x7f9b28102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:51.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.720+0000 7f9b2d483700 1 -- 172.21.15.134:0/1094659449 >> 172.21.15.134:0/1094659449 conn(0x7f9b280f7a10 msgr2=0x7f9b280f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:51.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.720+0000 7f9b2d483700 1 -- 172.21.15.134:0/1094659449 shutdown_connections 2024-02-16T22:22:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.720+0000 7f9b2d483700 1 -- 172.21.15.134:0/1094659449 wait complete. 2024-02-16T22:22:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.721+0000 7f9b2d483700 1 Processor -- start 2024-02-16T22:22:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.721+0000 7f9b2d483700 1 -- start start 2024-02-16T22:22:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.721+0000 7f9b2d483700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b28101e60 0x7f9b2810ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.721+0000 7f9b2d483700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b28102800 0x7f9b2810f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.721+0000 7f9b2d483700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2810f6b0 con 0x7f9b28101e60 2024-02-16T22:22:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.721+0000 7f9b2d483700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2810f7f0 con 0x7f9b28102800 2024-02-16T22:22:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.721+0000 7f9b26ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b28101e60 0x7f9b2810ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.721+0000 7f9b26ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b28101e60 0x7f9b2810ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42558/0 (socket says 172.21.15.134:42558) 2024-02-16T22:22:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.721+0000 7f9b26ffd700 1 -- 172.21.15.134:0/1764129228 learned_addr learned my addr 172.21.15.134:0/1764129228 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:22:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.721+0000 7f9b267fc700 1 --2- 172.21.15.134:0/1764129228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b28102800 0x7f9b2810f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.721+0000 7f9b26ffd700 1 -- 172.21.15.134:0/1764129228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b28102800 msgr2=0x7f9b2810f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.721+0000 7f9b26ffd700 1 --2- 172.21.15.134:0/1764129228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b28102800 0x7f9b2810f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:51.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.721+0000 7f9b26ffd700 1 -- 172.21.15.134:0/1764129228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b10005040 con 0x7f9b28101e60 2024-02-16T22:22:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.722+0000 7f9b26ffd700 1 --2- 172.21.15.134:0/1764129228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b28101e60 0x7f9b2810ec30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000bbb0 tx=0x7f9b20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.722+0000 7f9b1f7fe700 1 -- 172.21.15.134:0/1764129228 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b200092e0 con 0x7f9b28101e60 2024-02-16T22:22:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.722+0000 7f9b1f7fe700 1 -- 172.21.15.134:0/1764129228 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b2000cbd0 con 0x7f9b28101e60 2024-02-16T22:22:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.722+0000 7f9b2d483700 1 -- 172.21.15.134:0/1764129228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b28117b40 con 0x7f9b28101e60 2024-02-16T22:22:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.722+0000 7f9b1f7fe700 1 -- 172.21.15.134:0/1764129228 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b20007400 con 0x7f9b28101e60 2024-02-16T22:22:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.722+0000 7f9b2d483700 1 -- 172.21.15.134:0/1764129228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b28118080 con 0x7f9b28101e60 2024-02-16T22:22:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.723+0000 7f9b2d483700 1 -- 172.21.15.134:0/1764129228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b280ff170 con 0x7f9b28101e60 2024-02-16T22:22:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.723+0000 7f9b1f7fe700 1 -- 172.21.15.134:0/1764129228 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f9b20012070 con 0x7f9b28101e60 2024-02-16T22:22:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.724+0000 7f9b1f7fe700 1 --2- 172.21.15.134:0/1764129228 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f9b1406d0e0 0x7f9b1406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.724+0000 7f9b1f7fe700 1 -- 172.21.15.134:0/1764129228 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9b2008c160 con 0x7f9b28101e60 2024-02-16T22:22:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.724+0000 7f9b267fc700 1 --2- 172.21.15.134:0/1764129228 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f9b1406d0e0 0x7f9b1406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.724+0000 7f9b267fc700 1 --2- 172.21.15.134:0/1764129228 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f9b1406d0e0 0x7f9b1406f590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9b28066970 tx=0x7f9b10009e30 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:51.728+0000 7f9b1f7fe700 1 -- 172.21.15.134:0/1764129228 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f9b20056220 con 0x7f9b28101e60 2024-02-16T22:22:52.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:52.010+0000 7f9b2d483700 1 -- 172.21.15.134:0/1764129228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9b280fb610 con 0x7f9b28101e60 2024-02-16T22:22:52.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:52.010+0000 7f9b1f7fe700 1 -- 172.21.15.134:0/1764129228 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f9b200598e0 con 0x7f9b28101e60 2024-02-16T22:22:52.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:52.012+0000 7f9b2d483700 1 -- 172.21.15.134:0/1764129228 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f9b1406d0e0 msgr2=0x7f9b1406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:52.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:52.012+0000 7f9b2d483700 1 --2- 172.21.15.134:0/1764129228 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f9b1406d0e0 0x7f9b1406f590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9b28066970 tx=0x7f9b10009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:52.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:52.012+0000 7f9b2d483700 1 -- 172.21.15.134:0/1764129228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b28101e60 msgr2=0x7f9b2810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:52.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:52.012+0000 7f9b2d483700 1 --2- 172.21.15.134:0/1764129228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b28101e60 0x7f9b2810ec30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000bbb0 tx=0x7f9b20009840 comp rx=0 tx=0).stop 2024-02-16T22:22:52.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:52.012+0000 7f9b2d483700 1 -- 172.21.15.134:0/1764129228 shutdown_connections 2024-02-16T22:22:52.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:52.012+0000 7f9b2d483700 1 --2- 172.21.15.134:0/1764129228 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f9b1406d0e0 0x7f9b1406f590 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:52.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:52.012+0000 7f9b2d483700 1 --2- 172.21.15.134:0/1764129228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b28101e60 0x7f9b2810ec30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:52.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:52.012+0000 7f9b2d483700 1 --2- 172.21.15.134:0/1764129228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b28102800 0x7f9b2810f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:52.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:52.012+0000 7f9b2d483700 1 -- 172.21.15.134:0/1764129228 >> 172.21.15.134:0/1764129228 conn(0x7f9b280f7a10 msgr2=0x7f9b280f9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:52.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:52.012+0000 7f9b2d483700 1 -- 172.21.15.134:0/1764129228 shutdown_connections 2024-02-16T22:22:52.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:52.012+0000 7f9b2d483700 1 -- 172.21.15.134:0/1764129228 wait complete. 2024-02-16T22:22:52.024 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:22:52.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:52 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/1764129228' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:52.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:52 smithi134 ceph-mon[28869]: pgmap v60: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:52.653 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-02-16T22:22:52.910 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:22:52.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:52 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/1764129228' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:52.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:52 smithi173 ceph-mon[37280]: pgmap v60: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:54.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.560+0000 7f100ede2700 1 -- 172.21.15.134:0/2574172648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1008101e40 msgr2=0x7f1008102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:54.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.560+0000 7f100ede2700 1 --2- 172.21.15.134:0/2574172648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1008101e40 0x7f1008102210 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009ce0 tx=0x7f0ff8004d10 comp rx=0 tx=0).stop 2024-02-16T22:22:54.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.560+0000 7f100ede2700 1 -- 172.21.15.134:0/2574172648 shutdown_connections 2024-02-16T22:22:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.560+0000 7f100ede2700 1 --2- 172.21.15.134:0/2574172648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10081027e0 0x7f10080fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.560+0000 7f100ede2700 1 --2- 172.21.15.134:0/2574172648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1008101e40 0x7f1008102210 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.560+0000 7f100ede2700 1 -- 172.21.15.134:0/2574172648 >> 172.21.15.134:0/2574172648 conn(0x7f1008071d90 msgr2=0x7f1008072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.560+0000 7f100ede2700 1 -- 172.21.15.134:0/2574172648 shutdown_connections 2024-02-16T22:22:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.560+0000 7f100ede2700 1 -- 172.21.15.134:0/2574172648 wait complete. 2024-02-16T22:22:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.560+0000 7f100ede2700 1 Processor -- start 2024-02-16T22:22:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.560+0000 7f100ede2700 1 -- start start 2024-02-16T22:22:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.561+0000 7f100ede2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1008101e40 0x7f1008112ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.561+0000 7f100ede2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10081027e0 0x7f1008113010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.561+0000 7f100ede2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10081136f0 con 0x7f10081027e0 2024-02-16T22:22:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.561+0000 7f100ede2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100810c990 con 0x7f1008101e40 2024-02-16T22:22:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.561+0000 7f1007fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10081027e0 0x7f1008113010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.561+0000 7f1007fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10081027e0 0x7f1008113010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42576/0 (socket says 172.21.15.134:42576) 2024-02-16T22:22:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.561+0000 7f1007fff700 1 -- 172.21.15.134:0/3219523266 learned_addr learned my addr 172.21.15.134:0/3219523266 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:22:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.561+0000 7f100cb7e700 1 --2- 172.21.15.134:0/3219523266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1008101e40 0x7f1008112ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.561+0000 7f1007fff700 1 -- 172.21.15.134:0/3219523266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1008101e40 msgr2=0x7f1008112ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.561+0000 7f1007fff700 1 --2- 172.21.15.134:0/3219523266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1008101e40 0x7f1008112ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.561+0000 7f1007fff700 1 -- 172.21.15.134:0/3219523266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff8009940 con 0x7f10081027e0 2024-02-16T22:22:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.561+0000 7f100cb7e700 1 --2- 172.21.15.134:0/3219523266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1008101e40 0x7f1008112ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:22:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.561+0000 7f1007fff700 1 --2- 172.21.15.134:0/3219523266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10081027e0 0x7f1008113010 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000b790 tx=0x7f0ff0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.562+0000 7f10057fa700 1 -- 172.21.15.134:0/3219523266 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ff000f6f0 con 0x7f10081027e0 2024-02-16T22:22:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.562+0000 7f10057fa700 1 -- 172.21.15.134:0/3219523266 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ff000fd20 con 0x7f10081027e0 2024-02-16T22:22:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.562+0000 7f100ede2700 1 -- 172.21.15.134:0/3219523266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100810cc70 con 0x7f10081027e0 2024-02-16T22:22:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.562+0000 7f10057fa700 1 -- 172.21.15.134:0/3219523266 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ff00103a0 con 0x7f10081027e0 2024-02-16T22:22:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.562+0000 7f100ede2700 1 -- 172.21.15.134:0/3219523266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100810d1b0 con 0x7f10081027e0 2024-02-16T22:22:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.563+0000 7f100ede2700 1 -- 172.21.15.134:0/3219523266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10080738b0 con 0x7f10081027e0 2024-02-16T22:22:54.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.563+0000 7f10057fa700 1 -- 172.21.15.134:0/3219523266 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f0ff0011400 con 0x7f10081027e0 2024-02-16T22:22:54.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.564+0000 7f10057fa700 1 --2- 172.21.15.134:0/3219523266 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f0ff406d0e0 0x7f0ff406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:54.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.564+0000 7f100cb7e700 1 --2- 172.21.15.134:0/3219523266 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f0ff406d0e0 0x7f0ff406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:54.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.564+0000 7f10057fa700 1 -- 172.21.15.134:0/3219523266 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0ff008c480 con 0x7f10081027e0 2024-02-16T22:22:54.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.564+0000 7f100cb7e700 1 --2- 172.21.15.134:0/3219523266 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f0ff406d0e0 0x7f0ff406f590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800b740 tx=0x7f0ff8004d10 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:54.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.568+0000 7f10057fa700 1 -- 172.21.15.134:0/3219523266 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f0ff0059fb0 con 0x7f10081027e0 2024-02-16T22:22:54.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.843+0000 7f100ede2700 1 -- 172.21.15.134:0/3219523266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f100810e0b0 con 0x7f10081027e0 2024-02-16T22:22:54.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.843+0000 7f10057fa700 1 -- 172.21.15.134:0/3219523266 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f0ff0059b40 con 0x7f10081027e0 2024-02-16T22:22:54.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.845+0000 7f100ede2700 1 -- 172.21.15.134:0/3219523266 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f0ff406d0e0 msgr2=0x7f0ff406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:54.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.845+0000 7f100ede2700 1 --2- 172.21.15.134:0/3219523266 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f0ff406d0e0 0x7f0ff406f590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800b740 tx=0x7f0ff8004d10 comp rx=0 tx=0).stop 2024-02-16T22:22:54.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.845+0000 7f100ede2700 1 -- 172.21.15.134:0/3219523266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10081027e0 msgr2=0x7f1008113010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:54.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.845+0000 7f100ede2700 1 --2- 172.21.15.134:0/3219523266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10081027e0 0x7f1008113010 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000b790 tx=0x7f0ff0009220 comp rx=0 tx=0).stop 2024-02-16T22:22:54.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.846+0000 7f100ede2700 1 -- 172.21.15.134:0/3219523266 shutdown_connections 2024-02-16T22:22:54.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.846+0000 7f100ede2700 1 --2- 172.21.15.134:0/3219523266 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f0ff406d0e0 0x7f0ff406f590 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:54.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.846+0000 7f100ede2700 1 --2- 172.21.15.134:0/3219523266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1008101e40 0x7f1008112ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:54.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.846+0000 7f100ede2700 1 --2- 172.21.15.134:0/3219523266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10081027e0 0x7f1008113010 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:54.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.846+0000 7f100ede2700 1 -- 172.21.15.134:0/3219523266 >> 172.21.15.134:0/3219523266 conn(0x7f1008071d90 msgr2=0x7f10080fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:54.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.846+0000 7f100ede2700 1 -- 172.21.15.134:0/3219523266 shutdown_connections 2024-02-16T22:22:54.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:54.846+0000 7f100ede2700 1 -- 172.21.15.134:0/3219523266 wait complete. 2024-02-16T22:22:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)" 2024-02-16T22:22:55.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:55 smithi134 ceph-mon[28869]: pgmap v61: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:55.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:55 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/3219523266' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:55.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:55 smithi173 ceph-mon[37280]: pgmap v61: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:55.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:55 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/3219523266' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:55.485 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-02-16T22:22:55.742 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:22:57.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.393+0000 7efd35357700 1 -- 172.21.15.134:0/2082785802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd301027f0 msgr2=0x7efd300fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.393+0000 7efd35357700 1 --2- 172.21.15.134:0/2082785802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd301027f0 0x7efd300fbe60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efd24004940 tx=0x7efd24009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.393+0000 7efd35357700 1 -- 172.21.15.134:0/2082785802 shutdown_connections 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.393+0000 7efd35357700 1 --2- 172.21.15.134:0/2082785802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd301027f0 0x7efd300fbe60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.393+0000 7efd35357700 1 --2- 172.21.15.134:0/2082785802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd30101e50 0x7efd30102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.393+0000 7efd35357700 1 -- 172.21.15.134:0/2082785802 >> 172.21.15.134:0/2082785802 conn(0x7efd300f79e0 msgr2=0x7efd300f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.393+0000 7efd35357700 1 -- 172.21.15.134:0/2082785802 shutdown_connections 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.393+0000 7efd35357700 1 -- 172.21.15.134:0/2082785802 wait complete. 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.394+0000 7efd35357700 1 Processor -- start 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.394+0000 7efd35357700 1 -- start start 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.394+0000 7efd35357700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd30101e50 0x7efd30113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.394+0000 7efd35357700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd301027f0 0x7efd30113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.394+0000 7efd35357700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd30114620 con 0x7efd30101e50 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.394+0000 7efd35357700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3010d950 con 0x7efd301027f0 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.394+0000 7efd2effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd30101e50 0x7efd30113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:57.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.394+0000 7efd2effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd30101e50 0x7efd30113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42604/0 (socket says 172.21.15.134:42604) 2024-02-16T22:22:57.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.394+0000 7efd2effd700 1 -- 172.21.15.134:0/1394513287 learned_addr learned my addr 172.21.15.134:0/1394513287 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:22:57.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.394+0000 7efd2effd700 1 -- 172.21.15.134:0/1394513287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd301027f0 msgr2=0x7efd30113fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:57.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.394+0000 7efd2effd700 1 --2- 172.21.15.134:0/1394513287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd301027f0 0x7efd30113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:57.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.394+0000 7efd2effd700 1 -- 172.21.15.134:0/1394513287 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd24005040 con 0x7efd30101e50 2024-02-16T22:22:57.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.394+0000 7efd2effd700 1 --2- 172.21.15.134:0/1394513287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd30101e50 0x7efd30113a90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efd2000c8c0 tx=0x7efd200044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:57.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.395+0000 7efd177fe700 1 -- 172.21.15.134:0/1394513287 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd2000a980 con 0x7efd30101e50 2024-02-16T22:22:57.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.395+0000 7efd177fe700 1 -- 172.21.15.134:0/1394513287 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd2000ce60 con 0x7efd30101e50 2024-02-16T22:22:57.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.395+0000 7efd35357700 1 -- 172.21.15.134:0/1394513287 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3010dc30 con 0x7efd30101e50 2024-02-16T22:22:57.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.395+0000 7efd177fe700 1 -- 172.21.15.134:0/1394513287 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd200115e0 con 0x7efd30101e50 2024-02-16T22:22:57.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.395+0000 7efd35357700 1 -- 172.21.15.134:0/1394513287 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3010e170 con 0x7efd30101e50 2024-02-16T22:22:57.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.396+0000 7efd35357700 1 -- 172.21.15.134:0/1394513287 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd30064b00 con 0x7efd30101e50 2024-02-16T22:22:57.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.396+0000 7efd177fe700 1 -- 172.21.15.134:0/1394513287 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7efd20012400 con 0x7efd30101e50 2024-02-16T22:22:57.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.396+0000 7efd177fe700 1 --2- 172.21.15.134:0/1394513287 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efd1806d0e0 0x7efd1806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:22:57.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.397+0000 7efd177fe700 1 -- 172.21.15.134:0/1394513287 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7efd2008c550 con 0x7efd30101e50 2024-02-16T22:22:57.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.397+0000 7efd2e7fc700 1 --2- 172.21.15.134:0/1394513287 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efd1806d0e0 0x7efd1806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:22:57.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.397+0000 7efd2e7fc700 1 --2- 172.21.15.134:0/1394513287 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efd1806d0e0 0x7efd1806f590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efd2400b3b0 tx=0x7efd24009e30 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:22:57.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.401+0000 7efd177fe700 1 -- 172.21.15.134:0/1394513287 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7efd2005a240 con 0x7efd30101e50 2024-02-16T22:22:57.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:57 smithi134 ceph-mon[28869]: pgmap v62: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:57.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:57 smithi173 ceph-mon[37280]: pgmap v62: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:57.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.676+0000 7efd35357700 1 -- 172.21.15.134:0/1394513287 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efd300fb5e0 con 0x7efd30101e50 2024-02-16T22:22:57.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.677+0000 7efd177fe700 1 -- 172.21.15.134:0/1394513287 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7efd200126b0 con 0x7efd30101e50 2024-02-16T22:22:57.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.679+0000 7efd35357700 1 -- 172.21.15.134:0/1394513287 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efd1806d0e0 msgr2=0x7efd1806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:57.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.679+0000 7efd35357700 1 --2- 172.21.15.134:0/1394513287 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efd1806d0e0 0x7efd1806f590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efd2400b3b0 tx=0x7efd24009e30 comp rx=0 tx=0).stop 2024-02-16T22:22:57.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.679+0000 7efd35357700 1 -- 172.21.15.134:0/1394513287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd30101e50 msgr2=0x7efd30113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:22:57.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.679+0000 7efd35357700 1 --2- 172.21.15.134:0/1394513287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd30101e50 0x7efd30113a90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efd2000c8c0 tx=0x7efd200044c0 comp rx=0 tx=0).stop 2024-02-16T22:22:57.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.679+0000 7efd35357700 1 -- 172.21.15.134:0/1394513287 shutdown_connections 2024-02-16T22:22:57.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.679+0000 7efd35357700 1 --2- 172.21.15.134:0/1394513287 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efd1806d0e0 0x7efd1806f590 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:57.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.679+0000 7efd35357700 1 --2- 172.21.15.134:0/1394513287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd30101e50 0x7efd30113a90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:57.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.679+0000 7efd35357700 1 --2- 172.21.15.134:0/1394513287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd301027f0 0x7efd30113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:22:57.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.679+0000 7efd35357700 1 -- 172.21.15.134:0/1394513287 >> 172.21.15.134:0/1394513287 conn(0x7efd300f79e0 msgr2=0x7efd30066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:22:57.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.679+0000 7efd35357700 1 -- 172.21.15.134:0/1394513287 shutdown_connections 2024-02-16T22:22:57.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:22:57.679+0000 7efd35357700 1 -- 172.21.15.134:0/1394513287 wait complete. 2024-02-16T22:22:57.691 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:22:58.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:58 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/1394513287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:58.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:58 smithi134 ceph-mon[28869]: pgmap v63: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:58.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:22:58 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:22:58.409 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-02-16T22:22:58.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:58 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/1394513287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:22:58.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:58 smithi173 ceph-mon[37280]: pgmap v63: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:22:58.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:22:58 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:22:58.665 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:23:00.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.270+0000 7f9ee4b60700 1 -- 172.21.15.134:0/3824573780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ee01038f0 msgr2=0x7f9ee00fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:00.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.270+0000 7f9ee4b60700 1 --2- 172.21.15.134:0/3824573780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ee01038f0 0x7f9ee00fcf60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009ce0 tx=0x7f9ed4004d10 comp rx=0 tx=0).stop 2024-02-16T22:23:00.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.270+0000 7f9ee4b60700 1 -- 172.21.15.134:0/3824573780 shutdown_connections 2024-02-16T22:23:00.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.270+0000 7f9ee4b60700 1 --2- 172.21.15.134:0/3824573780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ee01038f0 0x7f9ee00fcf60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:00.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.270+0000 7f9ee4b60700 1 --2- 172.21.15.134:0/3824573780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ee0102f50 0x7f9ee0103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:00.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.270+0000 7f9ee4b60700 1 -- 172.21.15.134:0/3824573780 >> 172.21.15.134:0/3824573780 conn(0x7f9ee00f8ae0 msgr2=0x7f9ee00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:00.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.270+0000 7f9ee4b60700 1 -- 172.21.15.134:0/3824573780 shutdown_connections 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.270+0000 7f9ee4b60700 1 -- 172.21.15.134:0/3824573780 wait complete. 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.271+0000 7f9ee4b60700 1 Processor -- start 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.271+0000 7f9ee4b60700 1 -- start start 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.271+0000 7f9ee4b60700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ee0102f50 0x7f9ee0113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.271+0000 7f9ee4b60700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ee01038f0 0x7f9ee0114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.271+0000 7f9ee4b60700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee0114780 con 0x7f9ee0102f50 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.271+0000 7f9ee4b60700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee010dab0 con 0x7f9ee01038f0 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.271+0000 7f9ede59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ee0102f50 0x7f9ee0113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.271+0000 7f9ede59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ee0102f50 0x7f9ee0113bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42624/0 (socket says 172.21.15.134:42624) 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.271+0000 7f9ede59c700 1 -- 172.21.15.134:0/2685929859 learned_addr learned my addr 172.21.15.134:0/2685929859 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.271+0000 7f9eddd9b700 1 --2- 172.21.15.134:0/2685929859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ee01038f0 0x7f9ee0114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.272+0000 7f9ede59c700 1 -- 172.21.15.134:0/2685929859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ee01038f0 msgr2=0x7f9ee0114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.272+0000 7f9ede59c700 1 --2- 172.21.15.134:0/2685929859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ee01038f0 0x7f9ee0114130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.272+0000 7f9ede59c700 1 -- 172.21.15.134:0/2685929859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed4009940 con 0x7f9ee0102f50 2024-02-16T22:23:00.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.272+0000 7f9ede59c700 1 --2- 172.21.15.134:0/2685929859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ee0102f50 0x7f9ee0113bf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8002a50 tx=0x7f9ed80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:00.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.272+0000 7f9eceffd700 1 -- 172.21.15.134:0/2685929859 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ed8007cc0 con 0x7f9ee0102f50 2024-02-16T22:23:00.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.272+0000 7f9ee4b60700 1 -- 172.21.15.134:0/2685929859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee010dd90 con 0x7f9ee0102f50 2024-02-16T22:23:00.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.272+0000 7f9eceffd700 1 -- 172.21.15.134:0/2685929859 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ed800f040 con 0x7f9ee0102f50 2024-02-16T22:23:00.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.272+0000 7f9eceffd700 1 -- 172.21.15.134:0/2685929859 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ed800da30 con 0x7f9ee0102f50 2024-02-16T22:23:00.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.272+0000 7f9ee4b60700 1 -- 172.21.15.134:0/2685929859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee010e2a0 con 0x7f9ee0102f50 2024-02-16T22:23:00.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.273+0000 7f9ee4b60700 1 -- 172.21.15.134:0/2685929859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee0105420 con 0x7f9ee0102f50 2024-02-16T22:23:00.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.273+0000 7f9eceffd700 1 -- 172.21.15.134:0/2685929859 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f9ed800db90 con 0x7f9ee0102f50 2024-02-16T22:23:00.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.274+0000 7f9eceffd700 1 --2- 172.21.15.134:0/2685929859 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f9ec806d0e0 0x7f9ec806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:00.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.274+0000 7f9eddd9b700 1 --2- 172.21.15.134:0/2685929859 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f9ec806d0e0 0x7f9ec806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:00.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.274+0000 7f9eceffd700 1 -- 172.21.15.134:0/2685929859 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9ed808c300 con 0x7f9ee0102f50 2024-02-16T22:23:00.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.274+0000 7f9eddd9b700 1 --2- 172.21.15.134:0/2685929859 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f9ec806d0e0 0x7f9ec806f590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ee010ede0 tx=0x7f9ed4004d10 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:00.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.278+0000 7f9eceffd700 1 -- 172.21.15.134:0/2685929859 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f9ed8059ed0 con 0x7f9ee0102f50 2024-02-16T22:23:00.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:00.490+0000 7f9ee4b60700 1 -- 172.21.15.134:0/2685929859 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ee010f1d0 con 0x7f9ec806d0e0 2024-02-16T22:23:01.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:01 smithi134 ceph-mon[28869]: pgmap v64: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:01.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:01 smithi173 ceph-mon[37280]: pgmap v64: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:02.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:02 smithi134 ceph-mon[28869]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:02.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:02 smithi173 ceph-mon[37280]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:02.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:02.660+0000 7f9eceffd700 1 -- 172.21.15.134:0/2685929859 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5092 (secure 0 0 0) 0x7f9ee010f1d0 con 0x7f9ec806d0e0 2024-02-16T22:23:02.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:02.663+0000 7f9ee4b60700 1 -- 172.21.15.134:0/2685929859 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f9ec806d0e0 msgr2=0x7f9ec806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:02.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:02.663+0000 7f9ee4b60700 1 --2- 172.21.15.134:0/2685929859 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f9ec806d0e0 0x7f9ec806f590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ee010ede0 tx=0x7f9ed4004d10 comp rx=0 tx=0).stop 2024-02-16T22:23:02.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:02.663+0000 7f9ee4b60700 1 -- 172.21.15.134:0/2685929859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ee0102f50 msgr2=0x7f9ee0113bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:02.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:02.663+0000 7f9ee4b60700 1 --2- 172.21.15.134:0/2685929859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ee0102f50 0x7f9ee0113bf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8002a50 tx=0x7f9ed80046b0 comp rx=0 tx=0).stop 2024-02-16T22:23:02.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:02.663+0000 7f9ee4b60700 1 -- 172.21.15.134:0/2685929859 shutdown_connections 2024-02-16T22:23:02.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:02.663+0000 7f9ee4b60700 1 --2- 172.21.15.134:0/2685929859 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f9ec806d0e0 0x7f9ec806f590 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:02.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:02.663+0000 7f9ee4b60700 1 --2- 172.21.15.134:0/2685929859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ee0102f50 0x7f9ee0113bf0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:02.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:02.663+0000 7f9ee4b60700 1 --2- 172.21.15.134:0/2685929859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ee01038f0 0x7f9ee0114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:02.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:02.663+0000 7f9ee4b60700 1 -- 172.21.15.134:0/2685929859 >> 172.21.15.134:0/2685929859 conn(0x7f9ee00f8ae0 msgr2=0x7f9ee00fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:02.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:02.663+0000 7f9ee4b60700 1 -- 172.21.15.134:0/2685929859 shutdown_connections 2024-02-16T22:23:02.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:02.663+0000 7f9ee4b60700 1 -- 172.21.15.134:0/2685929859 wait complete. 2024-02-16T22:23:02.675 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:23:03.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:03 smithi134 ceph-mon[28869]: pgmap v65: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:03.267 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-16T22:23:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:03 smithi173 ceph-mon[37280]: pgmap v65: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:03.521 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:23:05.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.259+0000 7f7046944700 1 -- 172.21.15.134:0/3655221551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7040102f40 msgr2=0x7f7040103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:05.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.259+0000 7f7046944700 1 --2- 172.21.15.134:0/3655221551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7040102f40 0x7f7040103310 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7030004940 tx=0x7f7030009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:05.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.259+0000 7f7046944700 1 -- 172.21.15.134:0/3655221551 shutdown_connections 2024-02-16T22:23:05.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.259+0000 7f7046944700 1 --2- 172.21.15.134:0/3655221551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70401038e0 0x7f70400fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:05.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.259+0000 7f7046944700 1 --2- 172.21.15.134:0/3655221551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7040102f40 0x7f7040103310 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:05.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.259+0000 7f7046944700 1 -- 172.21.15.134:0/3655221551 >> 172.21.15.134:0/3655221551 conn(0x7f70400f8af0 msgr2=0x7f70400faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:05.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.259+0000 7f7046944700 1 -- 172.21.15.134:0/3655221551 shutdown_connections 2024-02-16T22:23:05.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.259+0000 7f7046944700 1 -- 172.21.15.134:0/3655221551 wait complete. 2024-02-16T22:23:05.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.259+0000 7f7046944700 1 Processor -- start 2024-02-16T22:23:05.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.260+0000 7f7046944700 1 -- start start 2024-02-16T22:23:05.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.260+0000 7f7046944700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7040102f40 0x7f7040113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:05.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.260+0000 7f7046944700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70401038e0 0x7f7040113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:05.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.260+0000 7f7046944700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70401145e0 con 0x7f70401038e0 2024-02-16T22:23:05.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.260+0000 7f7046944700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704010d910 con 0x7f7040102f40 2024-02-16T22:23:05.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.260+0000 7f703f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70401038e0 0x7f7040113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:05.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.260+0000 7f703f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70401038e0 0x7f7040113f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50594/0 (socket says 172.21.15.134:50594) 2024-02-16T22:23:05.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.260+0000 7f703f7fe700 1 -- 172.21.15.134:0/2137293403 learned_addr learned my addr 172.21.15.134:0/2137293403 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:05.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.260+0000 7f703f7fe700 1 -- 172.21.15.134:0/2137293403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7040102f40 msgr2=0x7f7040113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:05.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.260+0000 7f703f7fe700 1 --2- 172.21.15.134:0/2137293403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7040102f40 0x7f7040113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:05.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.260+0000 7f703f7fe700 1 -- 172.21.15.134:0/2137293403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030005040 con 0x7f70401038e0 2024-02-16T22:23:05.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.260+0000 7f703f7fe700 1 --2- 172.21.15.134:0/2137293403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70401038e0 0x7f7040113f90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f703400c890 tx=0x7f70340044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:05.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.261+0000 7f703cff9700 1 -- 172.21.15.134:0/2137293403 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f703400a7d0 con 0x7f70401038e0 2024-02-16T22:23:05.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.261+0000 7f703cff9700 1 -- 172.21.15.134:0/2137293403 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f703400ae00 con 0x7f70401038e0 2024-02-16T22:23:05.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.261+0000 7f7046944700 1 -- 172.21.15.134:0/2137293403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704010dbf0 con 0x7f70401038e0 2024-02-16T22:23:05.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.261+0000 7f703cff9700 1 -- 172.21.15.134:0/2137293403 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70340113a0 con 0x7f70401038e0 2024-02-16T22:23:05.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.261+0000 7f7046944700 1 -- 172.21.15.134:0/2137293403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704010e130 con 0x7f70401038e0 2024-02-16T22:23:05.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.261+0000 7f7046944700 1 -- 172.21.15.134:0/2137293403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7040100250 con 0x7f70401038e0 2024-02-16T22:23:05.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.262+0000 7f703cff9700 1 -- 172.21.15.134:0/2137293403 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f7034012400 con 0x7f70401038e0 2024-02-16T22:23:05.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.262+0000 7f703cff9700 1 --2- 172.21.15.134:0/2137293403 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f702806d0e0 0x7f702806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:05.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.263+0000 7f703cff9700 1 -- 172.21.15.134:0/2137293403 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f703408c6d0 con 0x7f70401038e0 2024-02-16T22:23:05.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.263+0000 7f703ffff700 1 --2- 172.21.15.134:0/2137293403 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f702806d0e0 0x7f702806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:05.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.263+0000 7f703ffff700 1 --2- 172.21.15.134:0/2137293403 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f702806d0e0 0x7f702806f590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7030004f90 tx=0x7f7030009e30 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:05.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.267+0000 7f703cff9700 1 -- 172.21.15.134:0/2137293403 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f703405a2c0 con 0x7f70401038e0 2024-02-16T22:23:05.270 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:05 smithi134 ceph-mon[28869]: pgmap v66: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:05.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.467+0000 7f7046944700 1 -- 172.21.15.134:0/2137293403 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f704004bed0 con 0x7f702806d0e0 2024-02-16T22:23:05.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.477+0000 7f703cff9700 1 -- 172.21.15.134:0/2137293403 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f704004bed0 con 0x7f702806d0e0 2024-02-16T22:23:05.480 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:23:05.480 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (54s) 31s ago 12m 17.1M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:23:05.481 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (12m) 31s ago 12m 6660k - 17.2.7-513-gb88fae66 870a0944ccb8 a0d53bc0a925 2024-02-16T22:23:05.481 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (11m) 85s ago 11m 6669k - 17.2.7-513-gb88fae66 870a0944ccb8 a8d69537e08a 2024-02-16T22:23:05.481 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (37s) 31s ago 11m 59.7M - 9.4.12 a0ea5e3c46d9 29d29cf667e7 2024-02-16T22:23:05.481 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (6m) 31s ago 6m 12.8M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:23:05.481 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (6m) 31s ago 6m 126M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:23:05.481 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (6m) 85s ago 6m 15.7M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:23:05.481 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (6m) 85s ago 6m 119M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:23:05.481 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (2m) 31s ago 13m 501M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:23:05.481 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (105s) 85s ago 10m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:23:05.481 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (13m) 31s ago 13m 53.2M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 93a679740d93 2024-02-16T22:23:05.481 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (10m) 85s ago 10m 43.3M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 cfbef35950ef 2024-02-16T22:23:05.481 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (93s) 31s ago 12m 8480k - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:23:05.481 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (89s) 85s ago 11m 3397k - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:23:05.482 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (10m) 31s ago 10m 218M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 099f0b29d202 2024-02-16T22:23:05.482 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (9m) 31s ago 9m 231M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:23:05.482 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (9m) 31s ago 9m 189M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:23:05.482 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (8m) 85s ago 8m 265M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:23:05.482 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (8m) 85s ago 8m 235M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:23:05.482 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (7m) 85s ago 7m 228M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:23:05.482 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (71s) 31s ago 11m 48.4M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:23:05.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:05 smithi173 ceph-mon[37280]: pgmap v66: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:05.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.479+0000 7f7046944700 1 -- 172.21.15.134:0/2137293403 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f702806d0e0 msgr2=0x7f702806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:05.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.479+0000 7f7046944700 1 --2- 172.21.15.134:0/2137293403 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f702806d0e0 0x7f702806f590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7030004f90 tx=0x7f7030009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:05.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.479+0000 7f7046944700 1 -- 172.21.15.134:0/2137293403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70401038e0 msgr2=0x7f7040113f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:05.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.479+0000 7f7046944700 1 --2- 172.21.15.134:0/2137293403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70401038e0 0x7f7040113f90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f703400c890 tx=0x7f70340044c0 comp rx=0 tx=0).stop 2024-02-16T22:23:05.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.479+0000 7f7046944700 1 -- 172.21.15.134:0/2137293403 shutdown_connections 2024-02-16T22:23:05.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.480+0000 7f7046944700 1 --2- 172.21.15.134:0/2137293403 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f702806d0e0 0x7f702806f590 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:05.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.480+0000 7f7046944700 1 --2- 172.21.15.134:0/2137293403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7040102f40 0x7f7040113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:05.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.480+0000 7f7046944700 1 --2- 172.21.15.134:0/2137293403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70401038e0 0x7f7040113f90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:05.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.480+0000 7f7046944700 1 -- 172.21.15.134:0/2137293403 >> 172.21.15.134:0/2137293403 conn(0x7f70400f8af0 msgr2=0x7f70400fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:05.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.480+0000 7f7046944700 1 -- 172.21.15.134:0/2137293403 shutdown_connections 2024-02-16T22:23:05.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:05.480+0000 7f7046944700 1 -- 172.21.15.134:0/2137293403 wait complete. 2024-02-16T22:23:06.075 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-16T22:23:06.076 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T22:23:06.076 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-02-16T22:23:06.334 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:23:06.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:06 smithi134 ceph-mon[28869]: fsmap cephfs:2 {0=cephfs.smithi134.jyajef=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:23:06.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:06 smithi134 ceph-mon[28869]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:06.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:06 smithi134 ceph-mon[28869]: pgmap v67: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:06 smithi173 ceph-mon[37280]: fsmap cephfs:2 {0=cephfs.smithi134.jyajef=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:23:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:06 smithi173 ceph-mon[37280]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:06 smithi173 ceph-mon[37280]: pgmap v67: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:07.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.983+0000 7f85dd6bc700 1 -- 172.21.15.134:0/1775814323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d8102800 msgr2=0x7f85d80fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:07.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.983+0000 7f85dd6bc700 1 --2- 172.21.15.134:0/1775814323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d8102800 0x7f85d80fbe70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f85cc004940 tx=0x7f85cc009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:07.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.983+0000 7f85dd6bc700 1 -- 172.21.15.134:0/1775814323 shutdown_connections 2024-02-16T22:23:07.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.983+0000 7f85dd6bc700 1 --2- 172.21.15.134:0/1775814323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d8102800 0x7f85d80fbe70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:07.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.983+0000 7f85dd6bc700 1 --2- 172.21.15.134:0/1775814323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85d8101e60 0x7f85d8102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:07.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.983+0000 7f85dd6bc700 1 -- 172.21.15.134:0/1775814323 >> 172.21.15.134:0/1775814323 conn(0x7f85d80f7a10 msgr2=0x7f85d80f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:07.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.983+0000 7f85dd6bc700 1 -- 172.21.15.134:0/1775814323 shutdown_connections 2024-02-16T22:23:07.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.983+0000 7f85dd6bc700 1 -- 172.21.15.134:0/1775814323 wait complete. 2024-02-16T22:23:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.984+0000 7f85dd6bc700 1 Processor -- start 2024-02-16T22:23:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.984+0000 7f85dd6bc700 1 -- start start 2024-02-16T22:23:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.984+0000 7f85dd6bc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85d8101e60 0x7f85d81129e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.984+0000 7f85dd6bc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d8102800 0x7f85d8112f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.984+0000 7f85dd6bc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d8113600 con 0x7f85d8102800 2024-02-16T22:23:07.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.984+0000 7f85dd6bc700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d810c8a0 con 0x7f85d8101e60 2024-02-16T22:23:07.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.984+0000 7f85d67fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d8102800 0x7f85d8112f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:07.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.984+0000 7f85d67fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d8102800 0x7f85d8112f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50620/0 (socket says 172.21.15.134:50620) 2024-02-16T22:23:07.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.984+0000 7f85d67fc700 1 -- 172.21.15.134:0/333585547 learned_addr learned my addr 172.21.15.134:0/333585547 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:07.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.984+0000 7f85d67fc700 1 -- 172.21.15.134:0/333585547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85d8101e60 msgr2=0x7f85d81129e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:07.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.984+0000 7f85d67fc700 1 --2- 172.21.15.134:0/333585547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85d8101e60 0x7f85d81129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:07.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.984+0000 7f85d67fc700 1 -- 172.21.15.134:0/333585547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc005040 con 0x7f85d8102800 2024-02-16T22:23:07.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.985+0000 7f85d67fc700 1 --2- 172.21.15.134:0/333585547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d8102800 0x7f85d8112f20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0090d0 tx=0x7f85cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:07.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.985+0000 7f85bf7fe700 1 -- 172.21.15.134:0/333585547 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85cc00e040 con 0x7f85d8102800 2024-02-16T22:23:07.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.985+0000 7f85bf7fe700 1 -- 172.21.15.134:0/333585547 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85cc00bbf0 con 0x7f85d8102800 2024-02-16T22:23:07.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.985+0000 7f85dd6bc700 1 -- 172.21.15.134:0/333585547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d810cb20 con 0x7f85d8102800 2024-02-16T22:23:07.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.985+0000 7f85bf7fe700 1 -- 172.21.15.134:0/333585547 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85cc01c630 con 0x7f85d8102800 2024-02-16T22:23:07.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.985+0000 7f85dd6bc700 1 -- 172.21.15.134:0/333585547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d810d060 con 0x7f85d8102800 2024-02-16T22:23:07.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.986+0000 7f85dd6bc700 1 -- 172.21.15.134:0/333585547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d80fb610 con 0x7f85d8102800 2024-02-16T22:23:07.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.986+0000 7f85bf7fe700 1 -- 172.21.15.134:0/333585547 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f85cc00bd60 con 0x7f85d8102800 2024-02-16T22:23:07.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.987+0000 7f85bf7fe700 1 --2- 172.21.15.134:0/333585547 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f85c006d0e0 0x7f85c006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:07.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.987+0000 7f85bf7fe700 1 -- 172.21.15.134:0/333585547 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f85cc08d7c0 con 0x7f85d8102800 2024-02-16T22:23:07.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.987+0000 7f85d6ffd700 1 --2- 172.21.15.134:0/333585547 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f85c006d0e0 0x7f85c006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:07.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.987+0000 7f85d6ffd700 1 --2- 172.21.15.134:0/333585547 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f85c006d0e0 0x7f85c006f590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f85c80098f0 tx=0x7f85c8006da0 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:07.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:07.991+0000 7f85bf7fe700 1 -- 172.21.15.134:0/333585547 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f85cc05b4b0 con 0x7f85d8102800 2024-02-16T22:23:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:08.182+0000 7f85dd6bc700 1 -- 172.21.15.134:0/333585547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f85d810d2d0 con 0x7f85d8102800 2024-02-16T22:23:08.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:08.187+0000 7f85bf7fe700 1 -- 172.21.15.134:0/333585547 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f85cc013e60 con 0x7f85d8102800 2024-02-16T22:23:08.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:08.189+0000 7f85dd6bc700 1 -- 172.21.15.134:0/333585547 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f85c006d0e0 msgr2=0x7f85c006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:08.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:08.189+0000 7f85dd6bc700 1 --2- 172.21.15.134:0/333585547 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f85c006d0e0 0x7f85c006f590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f85c80098f0 tx=0x7f85c8006da0 comp rx=0 tx=0).stop 2024-02-16T22:23:08.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:08.189+0000 7f85dd6bc700 1 -- 172.21.15.134:0/333585547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d8102800 msgr2=0x7f85d8112f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:08.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:08.189+0000 7f85dd6bc700 1 --2- 172.21.15.134:0/333585547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d8102800 0x7f85d8112f20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0090d0 tx=0x7f85cc009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:08.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:08.189+0000 7f85dd6bc700 1 -- 172.21.15.134:0/333585547 shutdown_connections 2024-02-16T22:23:08.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:08.189+0000 7f85dd6bc700 1 --2- 172.21.15.134:0/333585547 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f85c006d0e0 0x7f85c006f590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:08.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:08.189+0000 7f85dd6bc700 1 --2- 172.21.15.134:0/333585547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85d8101e60 0x7f85d81129e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:08.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:08.189+0000 7f85dd6bc700 1 --2- 172.21.15.134:0/333585547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d8102800 0x7f85d8112f20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:08.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:08.189+0000 7f85dd6bc700 1 -- 172.21.15.134:0/333585547 >> 172.21.15.134:0/333585547 conn(0x7f85d80f7a10 msgr2=0x7f85d80f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:08.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:08.189+0000 7f85dd6bc700 1 -- 172.21.15.134:0/333585547 shutdown_connections 2024-02-16T22:23:08.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:08.189+0000 7f85dd6bc700 1 -- 172.21.15.134:0/333585547 wait complete. 2024-02-16T22:23:08.797 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-16T22:23:08.798 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T22:23:08.798 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-16T22:23:09.058 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:23:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:09 smithi134 ceph-mon[28869]: pgmap v68: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:09.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:09 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/333585547' entity='client.admin' 2024-02-16T22:23:09.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:09 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:23:09.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:09 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:23:09.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:09 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:23:09.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:09 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:23:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:09 smithi173 ceph-mon[37280]: pgmap v68: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:09 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/333585547' entity='client.admin' 2024-02-16T22:23:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:09 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:23:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:09 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:23:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:09 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:23:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:09 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:23:10.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.642+0000 7f3c59453700 1 -- 172.21.15.134:0/2577778190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540fdfe0 msgr2=0x7f3c540fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:10.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.642+0000 7f3c59453700 1 --2- 172.21.15.134:0/2577778190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540fdfe0 0x7f3c540fe3b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3c44004970 tx=0x7f3c44009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:10.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.642+0000 7f3c59453700 1 -- 172.21.15.134:0/2577778190 shutdown_connections 2024-02-16T22:23:10.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.642+0000 7f3c59453700 1 --2- 172.21.15.134:0/2577778190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c540fe8f0 0x7f3c54107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:10.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.642+0000 7f3c59453700 1 --2- 172.21.15.134:0/2577778190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540fdfe0 0x7f3c540fe3b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:10.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.642+0000 7f3c59453700 1 -- 172.21.15.134:0/2577778190 >> 172.21.15.134:0/2577778190 conn(0x7f3c54071d90 msgr2=0x7f3c54072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:10.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.642+0000 7f3c59453700 1 -- 172.21.15.134:0/2577778190 shutdown_connections 2024-02-16T22:23:10.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.642+0000 7f3c59453700 1 -- 172.21.15.134:0/2577778190 wait complete. 2024-02-16T22:23:10.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.643+0000 7f3c59453700 1 Processor -- start 2024-02-16T22:23:10.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.643+0000 7f3c59453700 1 -- start start 2024-02-16T22:23:10.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.643+0000 7f3c59453700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540fdfe0 0x7f3c54113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:10.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.643+0000 7f3c59453700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c540fe8f0 0x7f3c54113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:10.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.643+0000 7f3c59453700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c541145e0 con 0x7f3c540fdfe0 2024-02-16T22:23:10.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.643+0000 7f3c59453700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5410d910 con 0x7f3c540fe8f0 2024-02-16T22:23:10.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.643+0000 7f3c52ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540fdfe0 0x7f3c54113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:10.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.643+0000 7f3c52ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540fdfe0 0x7f3c54113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50638/0 (socket says 172.21.15.134:50638) 2024-02-16T22:23:10.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.643+0000 7f3c52ffd700 1 -- 172.21.15.134:0/576916442 learned_addr learned my addr 172.21.15.134:0/576916442 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:10.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.644+0000 7f3c52ffd700 1 -- 172.21.15.134:0/576916442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c540fe8f0 msgr2=0x7f3c54113f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:10.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.644+0000 7f3c52ffd700 1 --2- 172.21.15.134:0/576916442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c540fe8f0 0x7f3c54113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:10.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.644+0000 7f3c52ffd700 1 -- 172.21.15.134:0/576916442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44005040 con 0x7f3c540fdfe0 2024-02-16T22:23:10.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.644+0000 7f3c52ffd700 1 --2- 172.21.15.134:0/576916442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540fdfe0 0x7f3c54113a50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3c44000c00 tx=0x7f3c44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:10.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.644+0000 7f3c3b7fe700 1 -- 172.21.15.134:0/576916442 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c4400e040 con 0x7f3c540fdfe0 2024-02-16T22:23:10.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.644+0000 7f3c3b7fe700 1 -- 172.21.15.134:0/576916442 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c4400bce0 con 0x7f3c540fdfe0 2024-02-16T22:23:10.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.644+0000 7f3c59453700 1 -- 172.21.15.134:0/576916442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5410db90 con 0x7f3c540fdfe0 2024-02-16T22:23:10.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.644+0000 7f3c3b7fe700 1 -- 172.21.15.134:0/576916442 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c4401c630 con 0x7f3c540fdfe0 2024-02-16T22:23:10.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.644+0000 7f3c59453700 1 -- 172.21.15.134:0/576916442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5410e0d0 con 0x7f3c540fdfe0 2024-02-16T22:23:10.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.645+0000 7f3c59453700 1 -- 172.21.15.134:0/576916442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c541046c0 con 0x7f3c540fdfe0 2024-02-16T22:23:10.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.645+0000 7f3c3b7fe700 1 -- 172.21.15.134:0/576916442 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f3c440139f0 con 0x7f3c540fdfe0 2024-02-16T22:23:10.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.646+0000 7f3c3b7fe700 1 --2- 172.21.15.134:0/576916442 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3c3c06d0e0 0x7f3c3c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:10.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.646+0000 7f3c3b7fe700 1 -- 172.21.15.134:0/576916442 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f3c4408d7f0 con 0x7f3c540fdfe0 2024-02-16T22:23:10.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.646+0000 7f3c527fc700 1 --2- 172.21.15.134:0/576916442 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3c3c06d0e0 0x7f3c3c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:10.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.646+0000 7f3c527fc700 1 --2- 172.21.15.134:0/576916442 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3c3c06d0e0 0x7f3c3c06f590 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3c5410f280 tx=0x7f3c48009ce0 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:10.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.650+0000 7f3c3b7fe700 1 -- 172.21.15.134:0/576916442 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3c4405b4e0 con 0x7f3c540fdfe0 2024-02-16T22:23:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.842+0000 7f3c59453700 1 -- 172.21.15.134:0/576916442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f3c5410a030 con 0x7f3c540fdfe0 2024-02-16T22:23:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.843+0000 7f3c3b7fe700 1 -- 172.21.15.134:0/576916442 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7f3c44004de0 con 0x7f3c540fdfe0 2024-02-16T22:23:10.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.844+0000 7f3c59453700 1 -- 172.21.15.134:0/576916442 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3c3c06d0e0 msgr2=0x7f3c3c06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.844+0000 7f3c59453700 1 --2- 172.21.15.134:0/576916442 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3c3c06d0e0 0x7f3c3c06f590 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3c5410f280 tx=0x7f3c48009ce0 comp rx=0 tx=0).stop 2024-02-16T22:23:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.845+0000 7f3c59453700 1 -- 172.21.15.134:0/576916442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540fdfe0 msgr2=0x7f3c54113a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.845+0000 7f3c59453700 1 --2- 172.21.15.134:0/576916442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540fdfe0 0x7f3c54113a50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3c44000c00 tx=0x7f3c44009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.845+0000 7f3c59453700 1 -- 172.21.15.134:0/576916442 shutdown_connections 2024-02-16T22:23:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.845+0000 7f3c59453700 1 --2- 172.21.15.134:0/576916442 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3c3c06d0e0 0x7f3c3c06f590 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.845+0000 7f3c59453700 1 --2- 172.21.15.134:0/576916442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540fdfe0 0x7f3c54113a50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.845+0000 7f3c59453700 1 --2- 172.21.15.134:0/576916442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c540fe8f0 0x7f3c54113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.845+0000 7f3c59453700 1 -- 172.21.15.134:0/576916442 >> 172.21.15.134:0/576916442 conn(0x7f3c54071d90 msgr2=0x7f3c54101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.845+0000 7f3c59453700 1 -- 172.21.15.134:0/576916442 shutdown_connections 2024-02-16T22:23:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:10.845+0000 7f3c59453700 1 -- 172.21.15.134:0/576916442 wait complete. 2024-02-16T22:23:11.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:11 smithi134 ceph-mon[28869]: pgmap v69: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:11.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:11 smithi173 ceph-mon[37280]: pgmap v69: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:11.487 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-16T22:23:11.745 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:23:12.828 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:12 smithi134 ceph-mon[28869]: pgmap v70: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:12.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:12 smithi173 ceph-mon[37280]: pgmap v70: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:13.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.357+0000 7f175ccae700 1 -- 172.21.15.134:0/4143920388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17580fc6a0 msgr2=0x7f17580fcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:13.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.357+0000 7f175ccae700 1 --2- 172.21.15.134:0/4143920388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17580fc6a0 0x7f17580fcb10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1748004940 tx=0x7f1748009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:13.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.357+0000 7f175ccae700 1 -- 172.21.15.134:0/4143920388 shutdown_connections 2024-02-16T22:23:13.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.357+0000 7f175ccae700 1 --2- 172.21.15.134:0/4143920388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17580fc6a0 0x7f17580fcb10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:13.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.357+0000 7f175ccae700 1 --2- 172.21.15.134:0/4143920388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1758101f60 0x7f1758102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:13.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.357+0000 7f175ccae700 1 -- 172.21.15.134:0/4143920388 >> 172.21.15.134:0/4143920388 conn(0x7f1758071560 msgr2=0x7f1758071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:13.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.357+0000 7f175ccae700 1 -- 172.21.15.134:0/4143920388 shutdown_connections 2024-02-16T22:23:13.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.357+0000 7f175ccae700 1 -- 172.21.15.134:0/4143920388 wait complete. 2024-02-16T22:23:13.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.358+0000 7f175ccae700 1 Processor -- start 2024-02-16T22:23:13.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.358+0000 7f175ccae700 1 -- start start 2024-02-16T22:23:13.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.358+0000 7f175ccae700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17580fc6a0 0x7f17581129b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:13.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.358+0000 7f175ccae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1758101f60 0x7f1758112ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:13.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.358+0000 7f175ccae700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1758113540 con 0x7f1758101f60 2024-02-16T22:23:13.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.358+0000 7f175ccae700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175810c870 con 0x7f17580fc6a0 2024-02-16T22:23:13.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.358+0000 7f1755d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1758101f60 0x7f1758112ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.358+0000 7f1755d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1758101f60 0x7f1758112ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39334/0 (socket says 172.21.15.134:39334) 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.358+0000 7f1755d9b700 1 -- 172.21.15.134:0/3417134550 learned_addr learned my addr 172.21.15.134:0/3417134550 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.358+0000 7f175659c700 1 --2- 172.21.15.134:0/3417134550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17580fc6a0 0x7f17581129b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.358+0000 7f1755d9b700 1 -- 172.21.15.134:0/3417134550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17580fc6a0 msgr2=0x7f17581129b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.358+0000 7f1755d9b700 1 --2- 172.21.15.134:0/3417134550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17580fc6a0 0x7f17581129b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.359+0000 7f1755d9b700 1 -- 172.21.15.134:0/3417134550 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748005040 con 0x7f1758101f60 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.359+0000 7f175659c700 1 --2- 172.21.15.134:0/3417134550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17580fc6a0 0x7f17581129b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.359+0000 7f1755d9b700 1 --2- 172.21.15.134:0/3417134550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1758101f60 0x7f1758112ef0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f174800b3b0 tx=0x7f1748009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.359+0000 7f1746ffd700 1 -- 172.21.15.134:0/3417134550 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f174800e040 con 0x7f1758101f60 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.359+0000 7f1746ffd700 1 -- 172.21.15.134:0/3417134550 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f174800bbf0 con 0x7f1758101f60 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.359+0000 7f1746ffd700 1 -- 172.21.15.134:0/3417134550 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f174801c630 con 0x7f1758101f60 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.359+0000 7f175ccae700 1 -- 172.21.15.134:0/3417134550 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175810caf0 con 0x7f1758101f60 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.359+0000 7f175ccae700 1 -- 172.21.15.134:0/3417134550 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175810cfe0 con 0x7f1758101f60 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.360+0000 7f175ccae700 1 -- 172.21.15.134:0/3417134550 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17580ff210 con 0x7f1758101f60 2024-02-16T22:23:13.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.360+0000 7f1746ffd700 1 -- 172.21.15.134:0/3417134550 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f174800bd60 con 0x7f1758101f60 2024-02-16T22:23:13.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.361+0000 7f1746ffd700 1 --2- 172.21.15.134:0/3417134550 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f174006d0e0 0x7f174006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:13.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.361+0000 7f1746ffd700 1 -- 172.21.15.134:0/3417134550 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f174808d8e0 con 0x7f1758101f60 2024-02-16T22:23:13.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.361+0000 7f175659c700 1 --2- 172.21.15.134:0/3417134550 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f174006d0e0 0x7f174006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:13.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.361+0000 7f175659c700 1 --2- 172.21.15.134:0/3417134550 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f174006d0e0 0x7f174006f590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f174c007fd0 tx=0x7f174c009040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:13.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.365+0000 7f1746ffd700 1 -- 172.21.15.134:0/3417134550 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f174805b530 con 0x7f1758101f60 2024-02-16T22:23:13.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.564+0000 7f175ccae700 1 -- 172.21.15.134:0/3417134550 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f17581090b0 con 0x7f1758101f60 2024-02-16T22:23:13.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.564+0000 7f1746ffd700 1 -- 172.21.15.134:0/3417134550 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f174805b0c0 con 0x7f1758101f60 2024-02-16T22:23:13.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.566+0000 7f175ccae700 1 -- 172.21.15.134:0/3417134550 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f174006d0e0 msgr2=0x7f174006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:13.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.566+0000 7f175ccae700 1 --2- 172.21.15.134:0/3417134550 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f174006d0e0 0x7f174006f590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f174c007fd0 tx=0x7f174c009040 comp rx=0 tx=0).stop 2024-02-16T22:23:13.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.566+0000 7f175ccae700 1 -- 172.21.15.134:0/3417134550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1758101f60 msgr2=0x7f1758112ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:13.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.566+0000 7f175ccae700 1 --2- 172.21.15.134:0/3417134550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1758101f60 0x7f1758112ef0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f174800b3b0 tx=0x7f1748009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:13.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.566+0000 7f175ccae700 1 -- 172.21.15.134:0/3417134550 shutdown_connections 2024-02-16T22:23:13.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.566+0000 7f175ccae700 1 --2- 172.21.15.134:0/3417134550 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f174006d0e0 0x7f174006f590 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:13.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.566+0000 7f175ccae700 1 --2- 172.21.15.134:0/3417134550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17580fc6a0 0x7f17581129b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:13.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.566+0000 7f175ccae700 1 --2- 172.21.15.134:0/3417134550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1758101f60 0x7f1758112ef0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:13.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.567+0000 7f175ccae700 1 -- 172.21.15.134:0/3417134550 >> 172.21.15.134:0/3417134550 conn(0x7f1758071560 msgr2=0x7f17580fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:13.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.567+0000 7f175ccae700 1 -- 172.21.15.134:0/3417134550 shutdown_connections 2024-02-16T22:23:13.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:13.567+0000 7f175ccae700 1 -- 172.21.15.134:0/3417134550 wait complete. 2024-02-16T22:23:13.891 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:13 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:23:13.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:13 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:23:14.194 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-16T22:23:14.450 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:23:14.823 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:14 smithi134 ceph-mon[28869]: pgmap v71: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:14.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:14 smithi173 ceph-mon[37280]: pgmap v71: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:16.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.064+0000 7efec0f82700 1 -- 172.21.15.134:0/2009824623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efebc1027e0 msgr2=0x7efebc0fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:16.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.064+0000 7efec0f82700 1 --2- 172.21.15.134:0/2009824623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efebc1027e0 0x7efebc0fbea0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7efeac004940 tx=0x7efeac009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.064+0000 7efec0f82700 1 -- 172.21.15.134:0/2009824623 shutdown_connections 2024-02-16T22:23:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.064+0000 7efec0f82700 1 --2- 172.21.15.134:0/2009824623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efebc1027e0 0x7efebc0fbea0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.064+0000 7efec0f82700 1 --2- 172.21.15.134:0/2009824623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efebc101e40 0x7efebc102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.064+0000 7efec0f82700 1 -- 172.21.15.134:0/2009824623 >> 172.21.15.134:0/2009824623 conn(0x7efebc071d90 msgr2=0x7efebc072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.064+0000 7efec0f82700 1 -- 172.21.15.134:0/2009824623 shutdown_connections 2024-02-16T22:23:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.064+0000 7efec0f82700 1 -- 172.21.15.134:0/2009824623 wait complete. 2024-02-16T22:23:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.064+0000 7efec0f82700 1 Processor -- start 2024-02-16T22:23:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efec0f82700 1 -- start start 2024-02-16T22:23:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efec0f82700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efebc101e40 0x7efebc113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efec0f82700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efebc1027e0 0x7efebc113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efec0f82700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc1145f0 con 0x7efebc1027e0 2024-02-16T22:23:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efec0f82700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc10d920 con 0x7efebc101e40 2024-02-16T22:23:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efeb9d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efebc1027e0 0x7efebc113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efeb9d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efebc1027e0 0x7efebc113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39352/0 (socket says 172.21.15.134:39352) 2024-02-16T22:23:16.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efeb9d9b700 1 -- 172.21.15.134:0/2805076535 learned_addr learned my addr 172.21.15.134:0/2805076535 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:16.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efeba59c700 1 --2- 172.21.15.134:0/2805076535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efebc101e40 0x7efebc113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:16.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efeb9d9b700 1 -- 172.21.15.134:0/2805076535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efebc101e40 msgr2=0x7efebc113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:16.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efeb9d9b700 1 --2- 172.21.15.134:0/2805076535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efebc101e40 0x7efebc113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:16.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efeb9d9b700 1 -- 172.21.15.134:0/2805076535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac005040 con 0x7efebc1027e0 2024-02-16T22:23:16.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efeb9d9b700 1 --2- 172.21.15.134:0/2805076535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efebc1027e0 0x7efebc113fa0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7efeac009150 tx=0x7efeac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:16.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efeaaffd700 1 -- 172.21.15.134:0/2805076535 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efeac00e040 con 0x7efebc1027e0 2024-02-16T22:23:16.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efec0f82700 1 -- 172.21.15.134:0/2805076535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc10dba0 con 0x7efebc1027e0 2024-02-16T22:23:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efeaaffd700 1 -- 172.21.15.134:0/2805076535 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efeac00bbf0 con 0x7efebc1027e0 2024-02-16T22:23:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.065+0000 7efeaaffd700 1 -- 172.21.15.134:0/2805076535 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efeac01c630 con 0x7efebc1027e0 2024-02-16T22:23:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.066+0000 7efec0f82700 1 -- 172.21.15.134:0/2805076535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc10e0e0 con 0x7efebc1027e0 2024-02-16T22:23:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.067+0000 7efec0f82700 1 -- 172.21.15.134:0/2805076535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efebc0738b0 con 0x7efebc1027e0 2024-02-16T22:23:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.067+0000 7efeaaffd700 1 -- 172.21.15.134:0/2805076535 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7efeac00bd60 con 0x7efebc1027e0 2024-02-16T22:23:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.067+0000 7efeaaffd700 1 --2- 172.21.15.134:0/2805076535 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efea406d0e0 0x7efea406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.067+0000 7efeaaffd700 1 -- 172.21.15.134:0/2805076535 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7efeac08d960 con 0x7efebc1027e0 2024-02-16T22:23:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.067+0000 7efeba59c700 1 --2- 172.21.15.134:0/2805076535 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efea406d0e0 0x7efea406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.068+0000 7efeba59c700 1 --2- 172.21.15.134:0/2805076535 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efea406d0e0 0x7efea406f590 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efeb0007fd0 tx=0x7efeb0009040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:16.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.072+0000 7efeaaffd700 1 -- 172.21.15.134:0/2805076535 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7efeac05b5b0 con 0x7efebc1027e0 2024-02-16T22:23:16.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.268+0000 7efec0f82700 1 -- 172.21.15.134:0/2805076535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7efebc10f040 con 0x7efebc1027e0 2024-02-16T22:23:16.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.268+0000 7efeaaffd700 1 -- 172.21.15.134:0/2805076535 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7efeac05b140 con 0x7efebc1027e0 2024-02-16T22:23:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.270+0000 7efec0f82700 1 -- 172.21.15.134:0/2805076535 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efea406d0e0 msgr2=0x7efea406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.270+0000 7efec0f82700 1 --2- 172.21.15.134:0/2805076535 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efea406d0e0 0x7efea406f590 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efeb0007fd0 tx=0x7efeb0009040 comp rx=0 tx=0).stop 2024-02-16T22:23:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.270+0000 7efec0f82700 1 -- 172.21.15.134:0/2805076535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efebc1027e0 msgr2=0x7efebc113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.270+0000 7efec0f82700 1 --2- 172.21.15.134:0/2805076535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efebc1027e0 0x7efebc113fa0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7efeac009150 tx=0x7efeac009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.271+0000 7efec0f82700 1 -- 172.21.15.134:0/2805076535 shutdown_connections 2024-02-16T22:23:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.271+0000 7efec0f82700 1 --2- 172.21.15.134:0/2805076535 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7efea406d0e0 0x7efea406f590 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.271+0000 7efec0f82700 1 --2- 172.21.15.134:0/2805076535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efebc101e40 0x7efebc113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.271+0000 7efec0f82700 1 --2- 172.21.15.134:0/2805076535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efebc1027e0 0x7efebc113fa0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.271+0000 7efec0f82700 1 -- 172.21.15.134:0/2805076535 >> 172.21.15.134:0/2805076535 conn(0x7efebc071d90 msgr2=0x7efebc100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.271+0000 7efec0f82700 1 -- 172.21.15.134:0/2805076535 shutdown_connections 2024-02-16T22:23:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:16.271+0000 7efec0f82700 1 -- 172.21.15.134:0/2805076535 wait complete. 2024-02-16T22:23:16.969 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-16T22:23:17.224 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:23:17.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:17 smithi134 ceph-mon[28869]: pgmap v72: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:17.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:17 smithi173 ceph-mon[37280]: pgmap v72: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:18.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.972+0000 7f78d321d700 1 -- 172.21.15.134:0/4154083935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78cc101e40 msgr2=0x7f78cc102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:18.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.972+0000 7f78d321d700 1 --2- 172.21.15.134:0/4154083935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78cc101e40 0x7f78cc102210 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f78c0004940 tx=0x7f78c0009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:18.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.972+0000 7f78d321d700 1 -- 172.21.15.134:0/4154083935 shutdown_connections 2024-02-16T22:23:18.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.972+0000 7f78d321d700 1 --2- 172.21.15.134:0/4154083935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78cc1027e0 0x7f78cc0fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:18.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.972+0000 7f78d321d700 1 --2- 172.21.15.134:0/4154083935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78cc101e40 0x7f78cc102210 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:18.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.972+0000 7f78d321d700 1 -- 172.21.15.134:0/4154083935 >> 172.21.15.134:0/4154083935 conn(0x7f78cc071d90 msgr2=0x7f78cc072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:18.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.972+0000 7f78d321d700 1 -- 172.21.15.134:0/4154083935 shutdown_connections 2024-02-16T22:23:18.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.972+0000 7f78d321d700 1 -- 172.21.15.134:0/4154083935 wait complete. 2024-02-16T22:23:18.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78d321d700 1 Processor -- start 2024-02-16T22:23:18.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78d321d700 1 -- start start 2024-02-16T22:23:18.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78d321d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78cc101e40 0x7f78cc10eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:18.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78d321d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78cc1027e0 0x7f78cc10f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:18.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78d321d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc10f650 con 0x7f78cc101e40 2024-02-16T22:23:18.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78d321d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc10f7c0 con 0x7f78cc1027e0 2024-02-16T22:23:18.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78d0fb9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78cc101e40 0x7f78cc10eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:18.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78d0fb9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78cc101e40 0x7f78cc10eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39380/0 (socket says 172.21.15.134:39380) 2024-02-16T22:23:18.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78d0fb9700 1 -- 172.21.15.134:0/2226327601 learned_addr learned my addr 172.21.15.134:0/2226327601 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:18.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78cbfff700 1 --2- 172.21.15.134:0/2226327601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78cc1027e0 0x7f78cc10f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:18.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78d0fb9700 1 -- 172.21.15.134:0/2226327601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78cc1027e0 msgr2=0x7f78cc10f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:18.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78d0fb9700 1 --2- 172.21.15.134:0/2226327601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78cc1027e0 0x7f78cc10f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:18.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78d0fb9700 1 -- 172.21.15.134:0/2226327601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c0005040 con 0x7f78cc101e40 2024-02-16T22:23:18.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78cbfff700 1 --2- 172.21.15.134:0/2226327601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78cc1027e0 0x7f78cc10f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:23:18.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.973+0000 7f78d0fb9700 1 --2- 172.21.15.134:0/2226327601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78cc101e40 0x7f78cc10eaf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f78c000b8b0 tx=0x7f78c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:18.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.974+0000 7f78c97fa700 1 -- 172.21.15.134:0/2226327601 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78c000e040 con 0x7f78cc101e40 2024-02-16T22:23:18.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.974+0000 7f78c97fa700 1 -- 172.21.15.134:0/2226327601 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78c000bbf0 con 0x7f78cc101e40 2024-02-16T22:23:18.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.974+0000 7f78d321d700 1 -- 172.21.15.134:0/2226327601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78cc117ab0 con 0x7f78cc101e40 2024-02-16T22:23:18.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.974+0000 7f78c97fa700 1 -- 172.21.15.134:0/2226327601 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78c001c630 con 0x7f78cc101e40 2024-02-16T22:23:18.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.974+0000 7f78d321d700 1 -- 172.21.15.134:0/2226327601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78cc117fc0 con 0x7f78cc101e40 2024-02-16T22:23:18.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.975+0000 7f78d321d700 1 -- 172.21.15.134:0/2226327601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78cc0738b0 con 0x7f78cc101e40 2024-02-16T22:23:18.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.975+0000 7f78c97fa700 1 -- 172.21.15.134:0/2226327601 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f78c000bd60 con 0x7f78cc101e40 2024-02-16T22:23:18.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.976+0000 7f78c97fa700 1 --2- 172.21.15.134:0/2226327601 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f78bc06d0e0 0x7f78bc06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:18.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.976+0000 7f78c97fa700 1 -- 172.21.15.134:0/2226327601 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f78c008d930 con 0x7f78cc101e40 2024-02-16T22:23:18.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.976+0000 7f78cbfff700 1 --2- 172.21.15.134:0/2226327601 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f78bc06d0e0 0x7f78bc06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:18.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.976+0000 7f78cbfff700 1 --2- 172.21.15.134:0/2226327601 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f78bc06d0e0 0x7f78bc06f590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f78b8006fd0 tx=0x7f78b8008040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:18.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:18.980+0000 7f78c97fa700 1 -- 172.21.15.134:0/2226327601 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f78c0057a50 con 0x7f78cc101e40 2024-02-16T22:23:19.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:19.195+0000 7f78d321d700 1 -- 172.21.15.134:0/2226327601 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}) v1 -- 0x7f78cc0fb420 con 0x7f78bc06d0e0 2024-02-16T22:23:19.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:19.200+0000 7f78c97fa700 1 -- 172.21.15.134:0/2226327601 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f78cc0fb420 con 0x7f78bc06d0e0 2024-02-16T22:23:19.202 INFO:teuthology.orchestra.run.smithi134.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:23:19.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:19.202+0000 7f78d321d700 1 -- 172.21.15.134:0/2226327601 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f78bc06d0e0 msgr2=0x7f78bc06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:19.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:19.202+0000 7f78d321d700 1 --2- 172.21.15.134:0/2226327601 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f78bc06d0e0 0x7f78bc06f590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f78b8006fd0 tx=0x7f78b8008040 comp rx=0 tx=0).stop 2024-02-16T22:23:19.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:19.202+0000 7f78d321d700 1 -- 172.21.15.134:0/2226327601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78cc101e40 msgr2=0x7f78cc10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:19.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:19.202+0000 7f78d321d700 1 --2- 172.21.15.134:0/2226327601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78cc101e40 0x7f78cc10eaf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f78c000b8b0 tx=0x7f78c0009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:19.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:19.203+0000 7f78d321d700 1 -- 172.21.15.134:0/2226327601 shutdown_connections 2024-02-16T22:23:19.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:19.203+0000 7f78d321d700 1 --2- 172.21.15.134:0/2226327601 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f78bc06d0e0 0x7f78bc06f590 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:19.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:19.203+0000 7f78d321d700 1 --2- 172.21.15.134:0/2226327601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78cc101e40 0x7f78cc10eaf0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:19.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:19.203+0000 7f78d321d700 1 --2- 172.21.15.134:0/2226327601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78cc1027e0 0x7f78cc10f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:19.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:19.203+0000 7f78d321d700 1 -- 172.21.15.134:0/2226327601 >> 172.21.15.134:0/2226327601 conn(0x7f78cc071d90 msgr2=0x7f78cc0fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:19.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:19.203+0000 7f78d321d700 1 -- 172.21.15.134:0/2226327601 shutdown_connections 2024-02-16T22:23:19.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:19.203+0000 7f78d321d700 1 -- 172.21.15.134:0/2226327601 wait complete. 2024-02-16T22:23:19.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:19 smithi134 ceph-mon[28869]: pgmap v73: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:19 smithi173 ceph-mon[37280]: pgmap v73: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:19.884 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-16T22:23:19.885 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T22:23:19.885 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-02-16T22:23:20.163 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:23:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:20 smithi134 ceph-mon[28869]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:20 smithi134 ceph-mon[28869]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:23:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:20 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:23:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:20 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:23:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:20 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:23:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:20 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:23:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:20 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:23:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:20 smithi173 ceph-mon[37280]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:20 smithi173 ceph-mon[37280]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:23:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:20 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:23:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:20 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:23:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:20 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:23:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:20 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:23:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:20 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:23:21.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:21 smithi134 ceph-mon[28869]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:23:21.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:21 smithi134 ceph-mon[28869]: pgmap v74: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:21.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:21 smithi173 ceph-mon[37280]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-16T22:23:21.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:21 smithi173 ceph-mon[37280]: pgmap v74: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:22.914 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:22 smithi134 ceph-mon[28869]: pgmap v75: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:22.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:22 smithi173 ceph-mon[37280]: pgmap v75: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:23.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.247+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1412170028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb81027e0 msgr2=0x7f3fb80fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:23.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.247+0000 7f3fbf1f2700 1 --2- 172.21.15.134:0/1412170028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb81027e0 0x7f3fb80fbea0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4004940 tx=0x7f3fa4009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:23.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.247+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1412170028 shutdown_connections 2024-02-16T22:23:23.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.247+0000 7f3fbf1f2700 1 --2- 172.21.15.134:0/1412170028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb81027e0 0x7f3fb80fbea0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.247+0000 7f3fbf1f2700 1 --2- 172.21.15.134:0/1412170028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fb8101e40 0x7f3fb8102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.247+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1412170028 >> 172.21.15.134:0/1412170028 conn(0x7f3fb8071d90 msgr2=0x7f3fb8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:23.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.247+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1412170028 shutdown_connections 2024-02-16T22:23:23.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.247+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1412170028 wait complete. 2024-02-16T22:23:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.248+0000 7f3fbf1f2700 1 Processor -- start 2024-02-16T22:23:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.248+0000 7f3fbf1f2700 1 -- start start 2024-02-16T22:23:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.248+0000 7f3fbf1f2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fb8101e40 0x7f3fb8115cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.248+0000 7f3fbf1f2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb81027e0 0x7f3fb8116200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.248+0000 7f3fbf1f2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8116850 con 0x7f3fb81027e0 2024-02-16T22:23:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.248+0000 7f3fbf1f2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb810fb60 con 0x7f3fb8101e40 2024-02-16T22:23:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.248+0000 7f3fb7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb81027e0 0x7f3fb8116200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.248+0000 7f3fb7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb81027e0 0x7f3fb8116200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34176/0 (socket says 172.21.15.134:34176) 2024-02-16T22:23:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.248+0000 7f3fb7fff700 1 -- 172.21.15.134:0/1954187509 learned_addr learned my addr 172.21.15.134:0/1954187509 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.249+0000 7f3fbcf8e700 1 --2- 172.21.15.134:0/1954187509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fb8101e40 0x7f3fb8115cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.249+0000 7f3fb7fff700 1 -- 172.21.15.134:0/1954187509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fb8101e40 msgr2=0x7f3fb8115cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.249+0000 7f3fb7fff700 1 --2- 172.21.15.134:0/1954187509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fb8101e40 0x7f3fb8115cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.249+0000 7f3fb7fff700 1 -- 172.21.15.134:0/1954187509 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa4005040 con 0x7f3fb81027e0 2024-02-16T22:23:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.249+0000 7f3fbcf8e700 1 --2- 172.21.15.134:0/1954187509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fb8101e40 0x7f3fb8115cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:23:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.249+0000 7f3fb7fff700 1 --2- 172.21.15.134:0/1954187509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb81027e0 0x7f3fb8116200 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4009150 tx=0x7f3fa4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.249+0000 7f3fb57fa700 1 -- 172.21.15.134:0/1954187509 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa400e040 con 0x7f3fb81027e0 2024-02-16T22:23:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.249+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1954187509 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb810fde0 con 0x7f3fb81027e0 2024-02-16T22:23:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.249+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1954187509 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb8110320 con 0x7f3fb81027e0 2024-02-16T22:23:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.249+0000 7f3fb57fa700 1 -- 172.21.15.134:0/1954187509 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3fa400bbf0 con 0x7f3fb81027e0 2024-02-16T22:23:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.249+0000 7f3fb57fa700 1 -- 172.21.15.134:0/1954187509 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa401c630 con 0x7f3fb81027e0 2024-02-16T22:23:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.250+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1954187509 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c0052b0 con 0x7f3fb81027e0 2024-02-16T22:23:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.251+0000 7f3fb57fa700 1 -- 172.21.15.134:0/1954187509 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f3fa400bd60 con 0x7f3fb81027e0 2024-02-16T22:23:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.251+0000 7f3fb57fa700 1 --2- 172.21.15.134:0/1954187509 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3fa806d0e0 0x7f3fa806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.252+0000 7f3fb57fa700 1 -- 172.21.15.134:0/1954187509 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f3fa408e270 con 0x7f3fb81027e0 2024-02-16T22:23:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.258+0000 7f3fbcf8e700 1 --2- 172.21.15.134:0/1954187509 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3fa806d0e0 0x7f3fa806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.258+0000 7f3fbcf8e700 1 --2- 172.21.15.134:0/1954187509 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3fa806d0e0 0x7f3fa806f590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0041d0 tx=0x7f3fac009040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.259+0000 7f3fb57fa700 1 -- 172.21.15.134:0/1954187509 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3fa405bf60 con 0x7f3fb81027e0 2024-02-16T22:23:23.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.477+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1954187509 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f9c000bc0 con 0x7f3fa806d0e0 2024-02-16T22:23:23.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.478+0000 7f3fb57fa700 1 -- 172.21.15.134:0/1954187509 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f3f9c000bc0 con 0x7f3fa806d0e0 2024-02-16T22:23:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.480+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1954187509 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3fa806d0e0 msgr2=0x7f3fa806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.480+0000 7f3fbf1f2700 1 --2- 172.21.15.134:0/1954187509 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3fa806d0e0 0x7f3fa806f590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0041d0 tx=0x7f3fac009040 comp rx=0 tx=0).stop 2024-02-16T22:23:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.480+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1954187509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb81027e0 msgr2=0x7f3fb8116200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.480+0000 7f3fbf1f2700 1 --2- 172.21.15.134:0/1954187509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb81027e0 0x7f3fb8116200 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4009150 tx=0x7f3fa4009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.480+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1954187509 shutdown_connections 2024-02-16T22:23:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.480+0000 7f3fbf1f2700 1 --2- 172.21.15.134:0/1954187509 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f3fa806d0e0 0x7f3fa806f590 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.480+0000 7f3fbf1f2700 1 --2- 172.21.15.134:0/1954187509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fb8101e40 0x7f3fb8115cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.480+0000 7f3fbf1f2700 1 --2- 172.21.15.134:0/1954187509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb81027e0 0x7f3fb8116200 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.480+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1954187509 >> 172.21.15.134:0/1954187509 conn(0x7f3fb8071d90 msgr2=0x7f3fb8065720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.481+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1954187509 shutdown_connections 2024-02-16T22:23:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.481+0000 7f3fbf1f2700 1 -- 172.21.15.134:0/1954187509 wait complete. 2024-02-16T22:23:23.494 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:23:23.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.586+0000 7f6a6d537700 1 -- 172.21.15.134:0/2323124837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a68101e60 msgr2=0x7f6a68102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:23.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.586+0000 7f6a6d537700 1 --2- 172.21.15.134:0/2323124837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a68101e60 0x7f6a68102230 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c004940 tx=0x7f6a5c009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:23.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.586+0000 7f6a6d537700 1 -- 172.21.15.134:0/2323124837 shutdown_connections 2024-02-16T22:23:23.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.586+0000 7f6a6d537700 1 --2- 172.21.15.134:0/2323124837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a68102800 0x7f6a680fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.586+0000 7f6a6d537700 1 --2- 172.21.15.134:0/2323124837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a68101e60 0x7f6a68102230 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.586+0000 7f6a6d537700 1 -- 172.21.15.134:0/2323124837 >> 172.21.15.134:0/2323124837 conn(0x7f6a680f7a10 msgr2=0x7f6a680f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:23.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.587+0000 7f6a6d537700 1 -- 172.21.15.134:0/2323124837 shutdown_connections 2024-02-16T22:23:23.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.587+0000 7f6a6d537700 1 -- 172.21.15.134:0/2323124837 wait complete. 2024-02-16T22:23:23.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.587+0000 7f6a6d537700 1 Processor -- start 2024-02-16T22:23:23.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.587+0000 7f6a6d537700 1 -- start start 2024-02-16T22:23:23.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.587+0000 7f6a6d537700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a68101e60 0x7f6a68112a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:23.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.587+0000 7f6a6d537700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a68102800 0x7f6a68112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:23.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.587+0000 7f6a6d537700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a681135a0 con 0x7f6a68101e60 2024-02-16T22:23:23.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.587+0000 7f6a6d537700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6810c8d0 con 0x7f6a68102800 2024-02-16T22:23:23.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.587+0000 7f6a66ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a68101e60 0x7f6a68112a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:23.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.588+0000 7f6a66ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a68101e60 0x7f6a68112a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34200/0 (socket says 172.21.15.134:34200) 2024-02-16T22:23:23.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.588+0000 7f6a66ffd700 1 -- 172.21.15.134:0/3493073747 learned_addr learned my addr 172.21.15.134:0/3493073747 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:23.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.588+0000 7f6a667fc700 1 --2- 172.21.15.134:0/3493073747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a68102800 0x7f6a68112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:23.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.588+0000 7f6a66ffd700 1 -- 172.21.15.134:0/3493073747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a68102800 msgr2=0x7f6a68112f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:23.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.588+0000 7f6a66ffd700 1 --2- 172.21.15.134:0/3493073747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a68102800 0x7f6a68112f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.588+0000 7f6a66ffd700 1 -- 172.21.15.134:0/3493073747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c005040 con 0x7f6a68101e60 2024-02-16T22:23:23.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.588+0000 7f6a667fc700 1 --2- 172.21.15.134:0/3493073747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a68102800 0x7f6a68112f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:23:23.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.588+0000 7f6a66ffd700 1 --2- 172.21.15.134:0/3493073747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a68101e60 0x7f6a68112a10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00b3b0 tx=0x7f6a5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:23.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.588+0000 7f6a4f7fe700 1 -- 172.21.15.134:0/3493073747 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a5c00e040 con 0x7f6a68101e60 2024-02-16T22:23:23.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.588+0000 7f6a4f7fe700 1 -- 172.21.15.134:0/3493073747 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a5c00bbf0 con 0x7f6a68101e60 2024-02-16T22:23:23.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.588+0000 7f6a4f7fe700 1 -- 172.21.15.134:0/3493073747 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a5c01c630 con 0x7f6a68101e60 2024-02-16T22:23:23.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.588+0000 7f6a6d537700 1 -- 172.21.15.134:0/3493073747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6810cb50 con 0x7f6a68101e60 2024-02-16T22:23:23.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.588+0000 7f6a6d537700 1 -- 172.21.15.134:0/3493073747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6810cf60 con 0x7f6a68101e60 2024-02-16T22:23:23.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.589+0000 7f6a6d537700 1 -- 172.21.15.134:0/3493073747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a680fb610 con 0x7f6a68101e60 2024-02-16T22:23:23.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.590+0000 7f6a4f7fe700 1 -- 172.21.15.134:0/3493073747 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f6a5c00bd60 con 0x7f6a68101e60 2024-02-16T22:23:23.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.590+0000 7f6a4f7fe700 1 --2- 172.21.15.134:0/3493073747 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f6a5006d0e0 0x7f6a5006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:23.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.590+0000 7f6a4f7fe700 1 -- 172.21.15.134:0/3493073747 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6a5c08d960 con 0x7f6a68101e60 2024-02-16T22:23:23.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.590+0000 7f6a667fc700 1 --2- 172.21.15.134:0/3493073747 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f6a5006d0e0 0x7f6a5006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:23.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.591+0000 7f6a667fc700 1 --2- 172.21.15.134:0/3493073747 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f6a5006d0e0 0x7f6a5006f590 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009fd0 tx=0x7f6a58009ee0 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:23.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.595+0000 7f6a4f7fe700 1 -- 172.21.15.134:0/3493073747 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6a5c05b5b0 con 0x7f6a68101e60 2024-02-16T22:23:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.813+0000 7f6a6d537700 1 -- 172.21.15.134:0/3493073747 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a6804bf40 con 0x7f6a5006d0e0 2024-02-16T22:23:23.815 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:23 smithi134 ceph-mon[28869]: fsmap cephfs:2 {0=cephfs.smithi134.jyajef=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:23:23.815 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:23 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:23:23.816 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:23 smithi134 ceph-mon[28869]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (squid) 2024-02-16T22:23:23.816 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:23 smithi134 ceph-mon[28869]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-16T22:23:23.816 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:23 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:23:23.816 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:23 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:23:23.816 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:23 smithi134 ceph-mon[28869]: Upgrade: Setting container_image for all mgr 2024-02-16T22:23:23.816 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:23 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:23:23.816 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:23 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-16T22:23:23.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.814+0000 7f6a4f7fe700 1 -- 172.21.15.134:0/3493073747 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f6a6804bf40 con 0x7f6a5006d0e0 2024-02-16T22:23:23.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.816+0000 7f6a6d537700 1 -- 172.21.15.134:0/3493073747 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f6a5006d0e0 msgr2=0x7f6a5006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:23.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.816+0000 7f6a6d537700 1 --2- 172.21.15.134:0/3493073747 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f6a5006d0e0 0x7f6a5006f590 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009fd0 tx=0x7f6a58009ee0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.816+0000 7f6a6d537700 1 -- 172.21.15.134:0/3493073747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a68101e60 msgr2=0x7f6a68112a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:23.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.816+0000 7f6a6d537700 1 --2- 172.21.15.134:0/3493073747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a68101e60 0x7f6a68112a10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00b3b0 tx=0x7f6a5c009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:23.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.816+0000 7f6a6d537700 1 -- 172.21.15.134:0/3493073747 shutdown_connections 2024-02-16T22:23:23.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.816+0000 7f6a6d537700 1 --2- 172.21.15.134:0/3493073747 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f6a5006d0e0 0x7f6a5006f590 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.816+0000 7f6a6d537700 1 --2- 172.21.15.134:0/3493073747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a68101e60 0x7f6a68112a10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.816+0000 7f6a6d537700 1 --2- 172.21.15.134:0/3493073747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a68102800 0x7f6a68112f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.816+0000 7f6a6d537700 1 -- 172.21.15.134:0/3493073747 >> 172.21.15.134:0/3493073747 conn(0x7f6a680f7a10 msgr2=0x7f6a680f9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:23.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.816+0000 7f6a6d537700 1 -- 172.21.15.134:0/3493073747 shutdown_connections 2024-02-16T22:23:23.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.816+0000 7f6a6d537700 1 -- 172.21.15.134:0/3493073747 wait complete. 2024-02-16T22:23:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.920+0000 7fa163bf7700 1 -- 172.21.15.134:0/924170419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0fdfe0 msgr2=0x7fa15c0fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.920+0000 7fa163bf7700 1 --2- 172.21.15.134:0/924170419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0fdfe0 0x7fa15c0fe3b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa158004970 tx=0x7fa158009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.920+0000 7fa163bf7700 1 -- 172.21.15.134:0/924170419 shutdown_connections 2024-02-16T22:23:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.920+0000 7fa163bf7700 1 --2- 172.21.15.134:0/924170419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa15c0fe8f0 0x7fa15c107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.920+0000 7fa163bf7700 1 --2- 172.21.15.134:0/924170419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0fdfe0 0x7fa15c0fe3b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.920+0000 7fa163bf7700 1 -- 172.21.15.134:0/924170419 >> 172.21.15.134:0/924170419 conn(0x7fa15c071d90 msgr2=0x7fa15c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.921+0000 7fa163bf7700 1 -- 172.21.15.134:0/924170419 shutdown_connections 2024-02-16T22:23:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.921+0000 7fa163bf7700 1 -- 172.21.15.134:0/924170419 wait complete. 2024-02-16T22:23:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.921+0000 7fa163bf7700 1 Processor -- start 2024-02-16T22:23:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.921+0000 7fa163bf7700 1 -- start start 2024-02-16T22:23:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.921+0000 7fa163bf7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0fdfe0 0x7fa15c0fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.921+0000 7fa163bf7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa15c0fe8f0 0x7fa15c0fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.921+0000 7fa163bf7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c0fc9e0 con 0x7fa15c0fdfe0 2024-02-16T22:23:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.921+0000 7fa163bf7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c0fcb50 con 0x7fa15c0fe8f0 2024-02-16T22:23:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.921+0000 7fa161993700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0fdfe0 0x7fa15c0fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.921+0000 7fa161993700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0fdfe0 0x7fa15c0fbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34216/0 (socket says 172.21.15.134:34216) 2024-02-16T22:23:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.921+0000 7fa161993700 1 -- 172.21.15.134:0/3651588105 learned_addr learned my addr 172.21.15.134:0/3651588105 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.922+0000 7fa161192700 1 --2- 172.21.15.134:0/3651588105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa15c0fe8f0 0x7fa15c0fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.922+0000 7fa161993700 1 -- 172.21.15.134:0/3651588105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa15c0fe8f0 msgr2=0x7fa15c0fc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.922+0000 7fa161993700 1 --2- 172.21.15.134:0/3651588105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa15c0fe8f0 0x7fa15c0fc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.922+0000 7fa161993700 1 -- 172.21.15.134:0/3651588105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa158005040 con 0x7fa15c0fdfe0 2024-02-16T22:23:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.922+0000 7fa161993700 1 --2- 172.21.15.134:0/3651588105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0fdfe0 0x7fa15c0fbea0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa158004f50 tx=0x7fa158009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.922+0000 7fa1527fc700 1 -- 172.21.15.134:0/3651588105 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa15800e040 con 0x7fa15c0fdfe0 2024-02-16T22:23:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.922+0000 7fa1527fc700 1 -- 172.21.15.134:0/3651588105 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa158004290 con 0x7fa15c0fdfe0 2024-02-16T22:23:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.922+0000 7fa163bf7700 1 -- 172.21.15.134:0/3651588105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15c119c90 con 0x7fa15c0fdfe0 2024-02-16T22:23:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.922+0000 7fa1527fc700 1 -- 172.21.15.134:0/3651588105 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa15801c630 con 0x7fa15c0fdfe0 2024-02-16T22:23:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.922+0000 7fa163bf7700 1 -- 172.21.15.134:0/3651588105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15c11a0f0 con 0x7fa15c0fdfe0 2024-02-16T22:23:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.923+0000 7fa163bf7700 1 -- 172.21.15.134:0/3651588105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15c1046c0 con 0x7fa15c0fdfe0 2024-02-16T22:23:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.924+0000 7fa1527fc700 1 -- 172.21.15.134:0/3651588105 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7fa15800bc10 con 0x7fa15c0fdfe0 2024-02-16T22:23:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.924+0000 7fa1527fc700 1 --2- 172.21.15.134:0/3651588105 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa14806d0f0 0x7fa14806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.924+0000 7fa1527fc700 1 -- 172.21.15.134:0/3651588105 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa15808d950 con 0x7fa15c0fdfe0 2024-02-16T22:23:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.924+0000 7fa161192700 1 --2- 172.21.15.134:0/3651588105 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa14806d0f0 0x7fa14806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.925+0000 7fa161192700 1 --2- 172.21.15.134:0/3651588105 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa14806d0f0 0x7fa14806f5a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa15c0fd8a0 tx=0x7fa14c009040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:23.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:23.929+0000 7fa1527fc700 1 -- 172.21.15.134:0/3651588105 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa158057a70 con 0x7fa15c0fdfe0 2024-02-16T22:23:23.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:23 smithi173 ceph-mon[37280]: fsmap cephfs:2 {0=cephfs.smithi134.jyajef=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:23:23.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:23 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:23:23.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:23 smithi173 ceph-mon[37280]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (squid) 2024-02-16T22:23:23.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:23 smithi173 ceph-mon[37280]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-16T22:23:23.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:23 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:23:23.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:23 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:23:23.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:23 smithi173 ceph-mon[37280]: Upgrade: Setting container_image for all mgr 2024-02-16T22:23:23.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:23 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:23:23.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:23 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-16T22:23:24.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.142+0000 7fa163bf7700 1 -- 172.21.15.134:0/3651588105 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa15c04bf40 con 0x7fa14806d0f0 2024-02-16T22:23:24.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.157+0000 7fa1527fc700 1 -- 172.21.15.134:0/3651588105 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fa15c04bf40 con 0x7fa14806d0f0 2024-02-16T22:23:24.159 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:23:24.159 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (72s) 50s ago 12m 17.1M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:23:24.159 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (12m) 50s ago 12m 6660k - 17.2.7-513-gb88fae66 870a0944ccb8 a0d53bc0a925 2024-02-16T22:23:24.159 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (11m) 104s ago 11m 6669k - 17.2.7-513-gb88fae66 870a0944ccb8 a8d69537e08a 2024-02-16T22:23:24.159 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (56s) 50s ago 12m 59.7M - 9.4.12 a0ea5e3c46d9 29d29cf667e7 2024-02-16T22:23:24.159 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (6m) 50s ago 6m 12.8M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:23:24.160 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (6m) 50s ago 6m 126M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:23:24.160 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (6m) 104s ago 6m 15.7M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:23:24.160 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (6m) 104s ago 6m 119M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:23:24.160 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (2m) 50s ago 13m 501M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:23:24.160 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (2m) 104s ago 11m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:23:24.160 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (13m) 50s ago 13m 53.2M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 93a679740d93 2024-02-16T22:23:24.160 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (11m) 104s ago 11m 43.3M 2048M 17.2.7-513-gb88fae66 870a0944ccb8 cfbef35950ef 2024-02-16T22:23:24.160 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (111s) 50s ago 12m 8480k - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:23:24.160 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (107s) 104s ago 11m 3397k - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:23:24.160 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (10m) 50s ago 10m 218M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 099f0b29d202 2024-02-16T22:23:24.160 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (9m) 50s ago 9m 231M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:23:24.160 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (9m) 50s ago 9m 189M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:23:24.160 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (9m) 104s ago 9m 265M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:23:24.160 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (8m) 104s ago 8m 235M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:23:24.161 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (8m) 104s ago 8m 228M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:23:24.161 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (90s) 50s ago 11m 48.4M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:23:24.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.160+0000 7fa163bf7700 1 -- 172.21.15.134:0/3651588105 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa14806d0f0 msgr2=0x7fa14806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:24.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.160+0000 7fa163bf7700 1 --2- 172.21.15.134:0/3651588105 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa14806d0f0 0x7fa14806f5a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa15c0fd8a0 tx=0x7fa14c009040 comp rx=0 tx=0).stop 2024-02-16T22:23:24.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.160+0000 7fa163bf7700 1 -- 172.21.15.134:0/3651588105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0fdfe0 msgr2=0x7fa15c0fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:24.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.160+0000 7fa163bf7700 1 --2- 172.21.15.134:0/3651588105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0fdfe0 0x7fa15c0fbea0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa158004f50 tx=0x7fa158009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:24.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.160+0000 7fa163bf7700 1 -- 172.21.15.134:0/3651588105 shutdown_connections 2024-02-16T22:23:24.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.160+0000 7fa163bf7700 1 --2- 172.21.15.134:0/3651588105 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fa14806d0f0 0x7fa14806f5a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.160+0000 7fa163bf7700 1 --2- 172.21.15.134:0/3651588105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0fdfe0 0x7fa15c0fbea0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.160+0000 7fa163bf7700 1 --2- 172.21.15.134:0/3651588105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa15c0fe8f0 0x7fa15c0fc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.160+0000 7fa163bf7700 1 -- 172.21.15.134:0/3651588105 >> 172.21.15.134:0/3651588105 conn(0x7fa15c071d90 msgr2=0x7fa15c101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:24.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.160+0000 7fa163bf7700 1 -- 172.21.15.134:0/3651588105 shutdown_connections 2024-02-16T22:23:24.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.160+0000 7fa163bf7700 1 -- 172.21.15.134:0/3651588105 wait complete. 2024-02-16T22:23:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.259+0000 7f0cc90df700 1 -- 172.21.15.134:0/1777705272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc41038f0 msgr2=0x7f0cc40fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.259+0000 7f0cc90df700 1 --2- 172.21.15.134:0/1777705272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc41038f0 0x7f0cc40fcf60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8004940 tx=0x7f0cb8009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.259+0000 7f0cc90df700 1 -- 172.21.15.134:0/1777705272 shutdown_connections 2024-02-16T22:23:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.259+0000 7f0cc90df700 1 --2- 172.21.15.134:0/1777705272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc41038f0 0x7f0cc40fcf60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.259+0000 7f0cc90df700 1 --2- 172.21.15.134:0/1777705272 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cc4102f50 0x7f0cc4103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.259+0000 7f0cc90df700 1 -- 172.21.15.134:0/1777705272 >> 172.21.15.134:0/1777705272 conn(0x7f0cc40f8ae0 msgr2=0x7f0cc40faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.259+0000 7f0cc90df700 1 -- 172.21.15.134:0/1777705272 shutdown_connections 2024-02-16T22:23:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.260+0000 7f0cc90df700 1 -- 172.21.15.134:0/1777705272 wait complete. 2024-02-16T22:23:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.260+0000 7f0cc90df700 1 Processor -- start 2024-02-16T22:23:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.260+0000 7f0cc90df700 1 -- start start 2024-02-16T22:23:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.260+0000 7f0cc90df700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cc4102f50 0x7f0cc4113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.260+0000 7f0cc90df700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc41038f0 0x7f0cc4114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.260+0000 7f0cc90df700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc41146e0 con 0x7f0cc41038f0 2024-02-16T22:23:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.260+0000 7f0cc90df700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc410d980 con 0x7f0cc4102f50 2024-02-16T22:23:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.260+0000 7f0cc259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc41038f0 0x7f0cc4114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.260+0000 7f0cc259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc41038f0 0x7f0cc4114000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34234/0 (socket says 172.21.15.134:34234) 2024-02-16T22:23:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.260+0000 7f0cc259c700 1 -- 172.21.15.134:0/513022406 learned_addr learned my addr 172.21.15.134:0/513022406 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.261+0000 7f0cc2d9d700 1 --2- 172.21.15.134:0/513022406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cc4102f50 0x7f0cc4113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.261+0000 7f0cc259c700 1 -- 172.21.15.134:0/513022406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cc4102f50 msgr2=0x7f0cc4113ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.261+0000 7f0cc259c700 1 --2- 172.21.15.134:0/513022406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cc4102f50 0x7f0cc4113ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.261+0000 7f0cc259c700 1 -- 172.21.15.134:0/513022406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8005040 con 0x7f0cc41038f0 2024-02-16T22:23:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.261+0000 7f0cc2d9d700 1 --2- 172.21.15.134:0/513022406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cc4102f50 0x7f0cc4113ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:23:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.261+0000 7f0cc259c700 1 --2- 172.21.15.134:0/513022406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc41038f0 0x7f0cc4114000 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80090d0 tx=0x7f0cb8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.261+0000 7f0cab7fe700 1 -- 172.21.15.134:0/513022406 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb800e040 con 0x7f0cc41038f0 2024-02-16T22:23:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.261+0000 7f0cab7fe700 1 -- 172.21.15.134:0/513022406 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0cb800bbf0 con 0x7f0cc41038f0 2024-02-16T22:23:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.261+0000 7f0cc90df700 1 -- 172.21.15.134:0/513022406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc410dc00 con 0x7f0cc41038f0 2024-02-16T22:23:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.261+0000 7f0cab7fe700 1 -- 172.21.15.134:0/513022406 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb801c630 con 0x7f0cc41038f0 2024-02-16T22:23:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.261+0000 7f0cc90df700 1 -- 172.21.15.134:0/513022406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc410e140 con 0x7f0cc41038f0 2024-02-16T22:23:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.262+0000 7f0cc90df700 1 -- 172.21.15.134:0/513022406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc40fc6e0 con 0x7f0cc41038f0 2024-02-16T22:23:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.263+0000 7f0cab7fe700 1 -- 172.21.15.134:0/513022406 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f0cb800bd60 con 0x7f0cc41038f0 2024-02-16T22:23:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.263+0000 7f0cab7fe700 1 --2- 172.21.15.134:0/513022406 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f0cac06d0e0 0x7f0cac06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.263+0000 7f0cc2d9d700 1 --2- 172.21.15.134:0/513022406 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f0cac06d0e0 0x7f0cac06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.263+0000 7f0cab7fe700 1 -- 172.21.15.134:0/513022406 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0cb808d7c0 con 0x7f0cc41038f0 2024-02-16T22:23:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.264+0000 7f0cc2d9d700 1 --2- 172.21.15.134:0/513022406 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f0cac06d0e0 0x7f0cac06f590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4006fd0 tx=0x7f0cb4008040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:24.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.268+0000 7f0cab7fe700 1 -- 172.21.15.134:0/513022406 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f0cb805b4b0 con 0x7f0cc41038f0 2024-02-16T22:23:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.550+0000 7f0cc90df700 1 -- 172.21.15.134:0/513022406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0cc404bed0 con 0x7f0cc41038f0 2024-02-16T22:23:24.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.553+0000 7f0cab7fe700 1 -- 172.21.15.134:0/513022406 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f0cb8013e60 con 0x7f0cc41038f0 2024-02-16T22:23:24.555 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:23:24.555 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:23:24.555 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 2 2024-02-16T22:23:24.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:23:24.555 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:23:24.555 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:23:24.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:23:24.555 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:23:24.555 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 6 2024-02-16T22:23:24.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:23:24.555 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:23:24.555 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:23:24.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:23:24.555 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:23:24.556 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 12, 2024-02-16T22:23:24.556 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:23:24.556 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:23:24.556 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:23:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.555+0000 7f0cc90df700 1 -- 172.21.15.134:0/513022406 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f0cac06d0e0 msgr2=0x7f0cac06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.555+0000 7f0cc90df700 1 --2- 172.21.15.134:0/513022406 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f0cac06d0e0 0x7f0cac06f590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4006fd0 tx=0x7f0cb4008040 comp rx=0 tx=0).stop 2024-02-16T22:23:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.555+0000 7f0cc90df700 1 -- 172.21.15.134:0/513022406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc41038f0 msgr2=0x7f0cc4114000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.555+0000 7f0cc90df700 1 --2- 172.21.15.134:0/513022406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc41038f0 0x7f0cc4114000 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80090d0 tx=0x7f0cb8009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.555+0000 7f0cc90df700 1 -- 172.21.15.134:0/513022406 shutdown_connections 2024-02-16T22:23:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.555+0000 7f0cc90df700 1 --2- 172.21.15.134:0/513022406 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f0cac06d0e0 0x7f0cac06f590 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.555+0000 7f0cc90df700 1 --2- 172.21.15.134:0/513022406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cc4102f50 0x7f0cc4113ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.555+0000 7f0cc90df700 1 --2- 172.21.15.134:0/513022406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cc41038f0 0x7f0cc4114000 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.556+0000 7f0cc90df700 1 -- 172.21.15.134:0/513022406 >> 172.21.15.134:0/513022406 conn(0x7f0cc40f8ae0 msgr2=0x7f0cc40fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.556+0000 7f0cc90df700 1 -- 172.21.15.134:0/513022406 shutdown_connections 2024-02-16T22:23:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.556+0000 7f0cc90df700 1 -- 172.21.15.134:0/513022406 wait complete. 2024-02-16T22:23:24.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.673+0000 7fc866cf7700 1 -- 172.21.15.134:0/2595909628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8600fe8f0 msgr2=0x7fc860106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:24.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.673+0000 7fc866cf7700 1 --2- 172.21.15.134:0/2595909628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8600fe8f0 0x7fc860106f30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc84c004940 tx=0x7fc84c009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:24.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.673+0000 7fc866cf7700 1 -- 172.21.15.134:0/2595909628 shutdown_connections 2024-02-16T22:23:24.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.673+0000 7fc866cf7700 1 --2- 172.21.15.134:0/2595909628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8600fe8f0 0x7fc860106f30 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.673+0000 7fc866cf7700 1 --2- 172.21.15.134:0/2595909628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8600fdf50 0x7fc8600fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.673+0000 7fc866cf7700 1 -- 172.21.15.134:0/2595909628 >> 172.21.15.134:0/2595909628 conn(0x7fc8600f79e0 msgr2=0x7fc8600f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:24.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.674+0000 7fc866cf7700 1 -- 172.21.15.134:0/2595909628 shutdown_connections 2024-02-16T22:23:24.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.674+0000 7fc866cf7700 1 -- 172.21.15.134:0/2595909628 wait complete. 2024-02-16T22:23:24.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.674+0000 7fc866cf7700 1 Processor -- start 2024-02-16T22:23:24.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.674+0000 7fc866cf7700 1 -- start start 2024-02-16T22:23:24.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.675+0000 7fc866cf7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8600fdf50 0x7fc8600fbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:24.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.675+0000 7fc866cf7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8600fe8f0 0x7fc8600fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:24.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.675+0000 7fc866cf7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8600fc8c0 con 0x7fc8600fe8f0 2024-02-16T22:23:24.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.675+0000 7fc866cf7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8600fca30 con 0x7fc8600fdf50 2024-02-16T22:23:24.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.675+0000 7fc85ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8600fe8f0 0x7fc8600fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:24.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.675+0000 7fc85ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8600fe8f0 0x7fc8600fc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34262/0 (socket says 172.21.15.134:34262) 2024-02-16T22:23:24.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.675+0000 7fc85ffff700 1 -- 172.21.15.134:0/688261890 learned_addr learned my addr 172.21.15.134:0/688261890 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:24.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.675+0000 7fc864a93700 1 --2- 172.21.15.134:0/688261890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8600fdf50 0x7fc8600fbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:24.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.675+0000 7fc85ffff700 1 -- 172.21.15.134:0/688261890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8600fdf50 msgr2=0x7fc8600fbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:24.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.675+0000 7fc85ffff700 1 --2- 172.21.15.134:0/688261890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8600fdf50 0x7fc8600fbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.675+0000 7fc85ffff700 1 -- 172.21.15.134:0/688261890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c005040 con 0x7fc8600fe8f0 2024-02-16T22:23:24.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.675+0000 7fc85ffff700 1 --2- 172.21.15.134:0/688261890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8600fe8f0 0x7fc8600fc2c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc84c007f50 tx=0x7fc84c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:24.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.676+0000 7fc85d7fa700 1 -- 172.21.15.134:0/688261890 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc84c021070 con 0x7fc8600fe8f0 2024-02-16T22:23:24.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.676+0000 7fc85d7fa700 1 -- 172.21.15.134:0/688261890 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc84c013dd0 con 0x7fc8600fe8f0 2024-02-16T22:23:24.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.676+0000 7fc85d7fa700 1 -- 172.21.15.134:0/688261890 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc84c00e070 con 0x7fc8600fe8f0 2024-02-16T22:23:24.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.676+0000 7fc866cf7700 1 -- 172.21.15.134:0/688261890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc860119ca0 con 0x7fc8600fe8f0 2024-02-16T22:23:24.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.676+0000 7fc866cf7700 1 -- 172.21.15.134:0/688261890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86011a040 con 0x7fc8600fe8f0 2024-02-16T22:23:24.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.677+0000 7fc866cf7700 1 -- 172.21.15.134:0/688261890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc860104540 con 0x7fc8600fe8f0 2024-02-16T22:23:24.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.677+0000 7fc85d7fa700 1 -- 172.21.15.134:0/688261890 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7fc84c01c400 con 0x7fc8600fe8f0 2024-02-16T22:23:24.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.678+0000 7fc85d7fa700 1 --2- 172.21.15.134:0/688261890 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fc85006d0e0 0x7fc85006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:24.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.678+0000 7fc85d7fa700 1 -- 172.21.15.134:0/688261890 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc84c08da30 con 0x7fc8600fe8f0 2024-02-16T22:23:24.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.678+0000 7fc864a93700 1 --2- 172.21.15.134:0/688261890 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fc85006d0e0 0x7fc85006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:24.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.678+0000 7fc864a93700 1 --2- 172.21.15.134:0/688261890 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fc85006d0e0 0x7fc85006f590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc854004600 tx=0x7fc85400b040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:24.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.683+0000 7fc85d7fa700 1 -- 172.21.15.134:0/688261890 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc84c057bf0 con 0x7fc8600fe8f0 2024-02-16T22:23:24.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.925+0000 7fc866cf7700 1 -- 172.21.15.134:0/688261890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc86004bed0 con 0x7fc8600fe8f0 2024-02-16T22:23:24.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:24 smithi134 ceph-mon[28869]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:24.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:24 smithi134 ceph-mon[28869]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:24.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:24 smithi134 ceph-mon[28869]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:24.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:24 smithi134 ceph-mon[28869]: pgmap v76: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:24.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.926+0000 7fc85d7fa700 1 -- 172.21.15.134:0/688261890 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1822 (secure 0 0 0) 0x7fc84c05b2b0 con 0x7fc8600fe8f0 2024-02-16T22:23:24.928 INFO:teuthology.orchestra.run.smithi134.stdout:e20 2024-02-16T22:23:24.928 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:23:24.928 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 20 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-02-16T22:23:22.543229+0000 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-02-16T22:23:24.929 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-02-16T22:23:24.930 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-02-16T22:23:24.930 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:23:24.930 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 2 2024-02-16T22:23:24.930 INFO:teuthology.orchestra.run.smithi134.stdout:in 0,1 2024-02-16T22:23:24.930 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14478,1=24269} 2024-02-16T22:23:24.930 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-02-16T22:23:24.930 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-02-16T22:23:24.930 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-02-16T22:23:24.930 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-02-16T22:23:24.930 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-02-16T22:23:24.930 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-02-16T22:23:24.930 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-02-16T22:23:24.930 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-02-16T22:23:24.930 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.jyajef{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:24.931 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.qljqef{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:24.931 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:23:24.931 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:23:24.931 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-02-16T22:23:24.931 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:23:24.931 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.cygfxr{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2804816044,v1:172.21.15.134:6827/2804816044] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:24.931 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.phstvm{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.928+0000 7fc866cf7700 1 -- 172.21.15.134:0/688261890 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fc85006d0e0 msgr2=0x7fc85006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.928+0000 7fc866cf7700 1 --2- 172.21.15.134:0/688261890 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fc85006d0e0 0x7fc85006f590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc854004600 tx=0x7fc85400b040 comp rx=0 tx=0).stop 2024-02-16T22:23:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.928+0000 7fc866cf7700 1 -- 172.21.15.134:0/688261890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8600fe8f0 msgr2=0x7fc8600fc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.928+0000 7fc866cf7700 1 --2- 172.21.15.134:0/688261890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8600fe8f0 0x7fc8600fc2c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc84c007f50 tx=0x7fc84c009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.928+0000 7fc866cf7700 1 -- 172.21.15.134:0/688261890 shutdown_connections 2024-02-16T22:23:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.928+0000 7fc866cf7700 1 --2- 172.21.15.134:0/688261890 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7fc85006d0e0 0x7fc85006f590 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.928+0000 7fc866cf7700 1 --2- 172.21.15.134:0/688261890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8600fdf50 0x7fc8600fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.928+0000 7fc866cf7700 1 --2- 172.21.15.134:0/688261890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8600fe8f0 0x7fc8600fc2c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:24.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.928+0000 7fc866cf7700 1 -- 172.21.15.134:0/688261890 >> 172.21.15.134:0/688261890 conn(0x7fc8600f79e0 msgr2=0x7fc8601016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.928+0000 7fc866cf7700 1 -- 172.21.15.134:0/688261890 shutdown_connections 2024-02-16T22:23:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:24.928+0000 7fc866cf7700 1 -- 172.21.15.134:0/688261890 wait complete. 2024-02-16T22:23:24.933 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 20 2024-02-16T22:23:24.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:24 smithi173 ceph-mon[37280]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:24.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:24 smithi173 ceph-mon[37280]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:24.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:24 smithi173 ceph-mon[37280]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:24.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:24 smithi173 ceph-mon[37280]: pgmap v76: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:25.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.033+0000 7f5168c49700 1 -- 172.21.15.134:0/816532796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5164102880 msgr2=0x7f51640fc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.033+0000 7f5168c49700 1 --2- 172.21.15.134:0/816532796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5164102880 0x7f51640fc680 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5158004940 tx=0x7f5158009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.034+0000 7f5168c49700 1 -- 172.21.15.134:0/816532796 shutdown_connections 2024-02-16T22:23:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.034+0000 7f5168c49700 1 --2- 172.21.15.134:0/816532796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5164102880 0x7f51640fc680 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.034+0000 7f5168c49700 1 --2- 172.21.15.134:0/816532796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5164101ee0 0x7f51641022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.034+0000 7f5168c49700 1 -- 172.21.15.134:0/816532796 >> 172.21.15.134:0/816532796 conn(0x7f5164071560 msgr2=0x7f5164071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.034+0000 7f5168c49700 1 -- 172.21.15.134:0/816532796 shutdown_connections 2024-02-16T22:23:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.034+0000 7f5168c49700 1 -- 172.21.15.134:0/816532796 wait complete. 2024-02-16T22:23:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.034+0000 7f5168c49700 1 Processor -- start 2024-02-16T22:23:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.034+0000 7f5168c49700 1 -- start start 2024-02-16T22:23:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.034+0000 7f5168c49700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5164101ee0 0x7f516410eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.034+0000 7f5168c49700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5164102880 0x7f516410f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.034+0000 7f5168c49700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516410f660 con 0x7f5164101ee0 2024-02-16T22:23:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.034+0000 7f5168c49700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516410f7d0 con 0x7f5164102880 2024-02-16T22:23:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.035+0000 7f516259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5164101ee0 0x7f516410eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.035+0000 7f516259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5164101ee0 0x7f516410eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34280/0 (socket says 172.21.15.134:34280) 2024-02-16T22:23:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.035+0000 7f516259c700 1 -- 172.21.15.134:0/150992813 learned_addr learned my addr 172.21.15.134:0/150992813 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.035+0000 7f5161d9b700 1 --2- 172.21.15.134:0/150992813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5164102880 0x7f516410f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.035+0000 7f516259c700 1 -- 172.21.15.134:0/150992813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5164102880 msgr2=0x7f516410f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.035+0000 7f516259c700 1 --2- 172.21.15.134:0/150992813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5164102880 0x7f516410f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.035+0000 7f516259c700 1 -- 172.21.15.134:0/150992813 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5158005040 con 0x7f5164101ee0 2024-02-16T22:23:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.035+0000 7f516259c700 1 --2- 172.21.15.134:0/150992813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5164101ee0 0x7f516410eb00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f515400b7c0 tx=0x7f5154009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.035+0000 7f5152ffd700 1 -- 172.21.15.134:0/150992813 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f515400f6f0 con 0x7f5164101ee0 2024-02-16T22:23:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.035+0000 7f5168c49700 1 -- 172.21.15.134:0/150992813 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5164117b20 con 0x7f5164101ee0 2024-02-16T22:23:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.035+0000 7f5152ffd700 1 -- 172.21.15.134:0/150992813 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f515400fd20 con 0x7f5164101ee0 2024-02-16T22:23:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.035+0000 7f5152ffd700 1 -- 172.21.15.134:0/150992813 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51540103a0 con 0x7f5164101ee0 2024-02-16T22:23:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.035+0000 7f5168c49700 1 -- 172.21.15.134:0/150992813 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5164118030 con 0x7f5164101ee0 2024-02-16T22:23:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.036+0000 7f5168c49700 1 -- 172.21.15.134:0/150992813 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5164073080 con 0x7f5164101ee0 2024-02-16T22:23:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.037+0000 7f5152ffd700 1 -- 172.21.15.134:0/150992813 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f5154011400 con 0x7f5164101ee0 2024-02-16T22:23:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.037+0000 7f5152ffd700 1 --2- 172.21.15.134:0/150992813 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f514c06d0e0 0x7f514c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.037+0000 7f5152ffd700 1 -- 172.21.15.134:0/150992813 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f515408c390 con 0x7f5164101ee0 2024-02-16T22:23:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.037+0000 7f5161d9b700 1 --2- 172.21.15.134:0/150992813 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f514c06d0e0 0x7f514c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.038+0000 7f5161d9b700 1 --2- 172.21.15.134:0/150992813 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f514c06d0e0 0x7f514c06f590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f51640fc050 tx=0x7f5158009e30 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.042+0000 7f5152ffd700 1 -- 172.21.15.134:0/150992813 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f51540564b0 con 0x7f5164101ee0 2024-02-16T22:23:25.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.265+0000 7f5168c49700 1 -- 172.21.15.134:0/150992813 --> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51640fbea0 con 0x7f514c06d0e0 2024-02-16T22:23:25.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.266+0000 7f5152ffd700 1 -- 172.21.15.134:0/150992813 <== mgr.14690 v2:172.21.15.134:6800/3164225175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f51640fbea0 con 0x7f514c06d0e0 2024-02-16T22:23:25.268 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:23:25.268 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:23:25.268 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:23:25.268 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-16T22:23:25.269 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-02-16T22:23:25.269 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr" 2024-02-16T22:23:25.269 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-02-16T22:23:25.269 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "2/21 daemons upgraded", 2024-02-16T22:23:25.269 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mon daemons", 2024-02-16T22:23:25.269 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:23:25.269 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:23:25.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.268+0000 7f5168c49700 1 -- 172.21.15.134:0/150992813 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f514c06d0e0 msgr2=0x7f514c06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:25.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.268+0000 7f5168c49700 1 --2- 172.21.15.134:0/150992813 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f514c06d0e0 0x7f514c06f590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f51640fc050 tx=0x7f5158009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:25.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.268+0000 7f5168c49700 1 -- 172.21.15.134:0/150992813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5164101ee0 msgr2=0x7f516410eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:25.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.268+0000 7f5168c49700 1 --2- 172.21.15.134:0/150992813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5164101ee0 0x7f516410eb00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f515400b7c0 tx=0x7f5154009250 comp rx=0 tx=0).stop 2024-02-16T22:23:25.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.268+0000 7f5168c49700 1 -- 172.21.15.134:0/150992813 shutdown_connections 2024-02-16T22:23:25.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.268+0000 7f5168c49700 1 --2- 172.21.15.134:0/150992813 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f514c06d0e0 0x7f514c06f590 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:25.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.268+0000 7f5168c49700 1 --2- 172.21.15.134:0/150992813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5164101ee0 0x7f516410eb00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:25.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.268+0000 7f5168c49700 1 --2- 172.21.15.134:0/150992813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5164102880 0x7f516410f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:25.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.268+0000 7f5168c49700 1 -- 172.21.15.134:0/150992813 >> 172.21.15.134:0/150992813 conn(0x7f5164071560 msgr2=0x7f51640fa470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:25.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.268+0000 7f5168c49700 1 -- 172.21.15.134:0/150992813 shutdown_connections 2024-02-16T22:23:25.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.269+0000 7f5168c49700 1 -- 172.21.15.134:0/150992813 wait complete. 2024-02-16T22:23:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.374+0000 7f88d187b700 1 -- 172.21.15.134:0/4212093965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc101e50 msgr2=0x7f88cc102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.374+0000 7f88d187b700 1 --2- 172.21.15.134:0/4212093965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc101e50 0x7f88cc102220 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f88bc004940 tx=0x7f88bc009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.374+0000 7f88d187b700 1 -- 172.21.15.134:0/4212093965 shutdown_connections 2024-02-16T22:23:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.374+0000 7f88d187b700 1 --2- 172.21.15.134:0/4212093965 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88cc1027f0 0x7f88cc0fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.374+0000 7f88d187b700 1 --2- 172.21.15.134:0/4212093965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc101e50 0x7f88cc102220 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.374+0000 7f88d187b700 1 -- 172.21.15.134:0/4212093965 >> 172.21.15.134:0/4212093965 conn(0x7f88cc0f79e0 msgr2=0x7f88cc0f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.374+0000 7f88d187b700 1 -- 172.21.15.134:0/4212093965 shutdown_connections 2024-02-16T22:23:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.374+0000 7f88d187b700 1 -- 172.21.15.134:0/4212093965 wait complete. 2024-02-16T22:23:25.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.374+0000 7f88d187b700 1 Processor -- start 2024-02-16T22:23:25.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.374+0000 7f88d187b700 1 -- start start 2024-02-16T22:23:25.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.375+0000 7f88d187b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88cc101e50 0x7f88cc113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:25.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.375+0000 7f88d187b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc1027f0 0x7f88cc114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:25.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.375+0000 7f88d187b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc114710 con 0x7f88cc1027f0 2024-02-16T22:23:25.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.375+0000 7f88d187b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc10d9b0 con 0x7f88cc101e50 2024-02-16T22:23:25.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.375+0000 7f88c27fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc1027f0 0x7f88cc114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:25.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.375+0000 7f88c27fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc1027f0 0x7f88cc114030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34306/0 (socket says 172.21.15.134:34306) 2024-02-16T22:23:25.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.375+0000 7f88c27fc700 1 -- 172.21.15.134:0/966141847 learned_addr learned my addr 172.21.15.134:0/966141847 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:25.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.375+0000 7f88caffd700 1 --2- 172.21.15.134:0/966141847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88cc101e50 0x7f88cc113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:25.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.375+0000 7f88c27fc700 1 -- 172.21.15.134:0/966141847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88cc101e50 msgr2=0x7f88cc113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:25.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.375+0000 7f88c27fc700 1 --2- 172.21.15.134:0/966141847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88cc101e50 0x7f88cc113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:25.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.375+0000 7f88c27fc700 1 -- 172.21.15.134:0/966141847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88bc005040 con 0x7f88cc1027f0 2024-02-16T22:23:25.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.375+0000 7f88c27fc700 1 --2- 172.21.15.134:0/966141847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc1027f0 0x7f88cc114030 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f88b400b790 tx=0x7f88b4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:25.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.375+0000 7f88c3fff700 1 -- 172.21.15.134:0/966141847 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88b400f6f0 con 0x7f88cc1027f0 2024-02-16T22:23:25.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.375+0000 7f88d187b700 1 -- 172.21.15.134:0/966141847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88cc10dc90 con 0x7f88cc1027f0 2024-02-16T22:23:25.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.376+0000 7f88d187b700 1 -- 172.21.15.134:0/966141847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88cc10e1d0 con 0x7f88cc1027f0 2024-02-16T22:23:25.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.376+0000 7f88c3fff700 1 -- 172.21.15.134:0/966141847 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88b400fd20 con 0x7f88cc1027f0 2024-02-16T22:23:25.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.376+0000 7f88c3fff700 1 -- 172.21.15.134:0/966141847 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88b40103a0 con 0x7f88cc1027f0 2024-02-16T22:23:25.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.377+0000 7f88d187b700 1 -- 172.21.15.134:0/966141847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ac0052e0 con 0x7f88cc1027f0 2024-02-16T22:23:25.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.377+0000 7f88c3fff700 1 -- 172.21.15.134:0/966141847 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f88b4010500 con 0x7f88cc1027f0 2024-02-16T22:23:25.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.378+0000 7f88c3fff700 1 --2- 172.21.15.134:0/966141847 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f88b806d0e0 0x7f88b806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:25.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.378+0000 7f88caffd700 1 --2- 172.21.15.134:0/966141847 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f88b806d0e0 0x7f88b806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:25.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.379+0000 7f88c3fff700 1 -- 172.21.15.134:0/966141847 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f88b408c190 con 0x7f88cc1027f0 2024-02-16T22:23:25.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.379+0000 7f88caffd700 1 --2- 172.21.15.134:0/966141847 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f88b806d0e0 0x7f88b806f590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f88bc004f90 tx=0x7f88bc009e30 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:25.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.384+0000 7f88c3fff700 1 -- 172.21.15.134:0/966141847 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f88b4059fd0 con 0x7f88cc1027f0 2024-02-16T22:23:25.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.666+0000 7f88d187b700 1 -- 172.21.15.134:0/966141847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f88ac005590 con 0x7f88cc1027f0 2024-02-16T22:23:25.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.666+0000 7f88c3fff700 1 -- 172.21.15.134:0/966141847 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f88b4059b60 con 0x7f88cc1027f0 2024-02-16T22:23:25.668 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-02-16T22:23:25.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.668+0000 7f88d187b700 1 -- 172.21.15.134:0/966141847 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f88b806d0e0 msgr2=0x7f88b806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:25.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.668+0000 7f88d187b700 1 --2- 172.21.15.134:0/966141847 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f88b806d0e0 0x7f88b806f590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f88bc004f90 tx=0x7f88bc009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:25.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.668+0000 7f88d187b700 1 -- 172.21.15.134:0/966141847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc1027f0 msgr2=0x7f88cc114030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:25.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.668+0000 7f88d187b700 1 --2- 172.21.15.134:0/966141847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc1027f0 0x7f88cc114030 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f88b400b790 tx=0x7f88b4009220 comp rx=0 tx=0).stop 2024-02-16T22:23:25.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.668+0000 7f88d187b700 1 -- 172.21.15.134:0/966141847 shutdown_connections 2024-02-16T22:23:25.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.668+0000 7f88d187b700 1 --2- 172.21.15.134:0/966141847 >> [v2:172.21.15.134:6800/3164225175,v1:172.21.15.134:6801/3164225175] conn(0x7f88b806d0e0 0x7f88b806f590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:25.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.668+0000 7f88d187b700 1 --2- 172.21.15.134:0/966141847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88cc101e50 0x7f88cc113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:25.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.668+0000 7f88d187b700 1 --2- 172.21.15.134:0/966141847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc1027f0 0x7f88cc114030 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:25.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.668+0000 7f88d187b700 1 -- 172.21.15.134:0/966141847 >> 172.21.15.134:0/966141847 conn(0x7f88cc0f79e0 msgr2=0x7f88cc105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:25.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.668+0000 7f88d187b700 1 -- 172.21.15.134:0/966141847 shutdown_connections 2024-02-16T22:23:25.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:25.668+0000 7f88d187b700 1 -- 172.21.15.134:0/966141847 wait complete. 2024-02-16T22:23:25.882 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:25 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/513022406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:23:25.882 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:25 smithi173 ceph-mon[37280]: Upgrade: Updating mon.smithi134 2024-02-16T22:23:25.882 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:25 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:23:25.882 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:25 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-16T22:23:25.883 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:25 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-16T22:23:25.883 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:25 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:23:25.883 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:25 smithi173 ceph-mon[37280]: Deploying daemon mon.smithi134 on smithi134 2024-02-16T22:23:25.883 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:25 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/688261890' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:23:25.930 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:25 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/513022406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:23:25.930 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:25 smithi134 ceph-mon[28869]: Upgrade: Updating mon.smithi134 2024-02-16T22:23:25.931 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:25 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' 2024-02-16T22:23:25.931 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:25 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-16T22:23:25.931 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:25 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-16T22:23:25.931 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:25 smithi134 ceph-mon[28869]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:23:25.931 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:25 smithi134 ceph-mon[28869]: Deploying daemon mon.smithi134 on smithi134 2024-02-16T22:23:25.931 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:25 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/688261890' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:23:26.819 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:26 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:23:26.819 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:26 smithi134 ceph-mon[28869]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:26.820 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:26 smithi134 ceph-mon[28869]: from='client.? 172.21.15.134:0/966141847' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:23:26.820 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:26 smithi134 ceph-mon[28869]: pgmap v77: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:26.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:26 smithi173 ceph-mon[37280]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:26.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:26 smithi173 ceph-mon[37280]: from='client.? 172.21.15.134:0/966141847' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:23:26.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:26 smithi173 ceph-mon[37280]: pgmap v77: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:27.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:26 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134[28865]: 2024-02-16T22:23:26.817+0000 7f738f69e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:23:27.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:26 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134[28865]: 2024-02-16T22:23:26.817+0000 7f738f69e700 -1 mon.smithi134@0(leader) e2 *** Got Signal Terminated *** 2024-02-16T22:23:27.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:26 smithi134 podman[112341]: 2024-02-16 22:23:26.950179086 +0000 UTC m=+0.263615029 container died 93a679740d930487bbf01364d2fd8617cdc6851d1b22a04d9c006804a5d2f5e0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, RELEASE=quincy-b88fae6, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-16T22:23:27.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:27 smithi134 podman[112341]: 2024-02-16 22:23:27.350759128 +0000 UTC m=+0.664195070 container cleanup 93a679740d930487bbf01364d2fd8617cdc6851d1b22a04d9c006804a5d2f5e0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=quincy-b88fae6, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214) 2024-02-16T22:23:27.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:27 smithi134 bash[112341]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134 2024-02-16T22:23:27.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:27 smithi134 podman[112366]: 2024-02-16 22:23:27.652250399 +0000 UTC m=+0.702348771 container remove 93a679740d930487bbf01364d2fd8617cdc6851d1b22a04d9c006804a5d2f5e0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134, ceph=True, org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=quincy-b88fae6, org.label-schema.license=GPLv2) 2024-02-16T22:23:27.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:27 smithi134 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi134.service: Deactivated successfully. 2024-02-16T22:23:27.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:27 smithi134 systemd[1]: Stopped Ceph mon.smithi134 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:23:27.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:27 smithi134 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi134.service: Consumed 13.021s CPU time. 2024-02-16T22:23:28.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 systemd[1]: Starting Ceph mon.smithi134 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:23:28.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 podman[112495]: 2024-02-16 22:23:28.17616539 +0000 UTC m=+0.018242260 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:23:28.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 podman[112495]: 2024-02-16 22:23:28.304006523 +0000 UTC m=+0.146083395 container create 2903b3988442cf5c0bc6558ed26b4ab10bcce04f0fe1e4677991099afb33bb9b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-16T22:23:28.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 podman[112495]: 2024-02-16 22:23:28.539822419 +0000 UTC m=+0.381899290 container init 2903b3988442cf5c0bc6558ed26b4ab10bcce04f0fe1e4677991099afb33bb9b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-02-16T22:23:28.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 podman[112495]: 2024-02-16 22:23:28.542998934 +0000 UTC m=+0.385075813 container start 2903b3988442cf5c0bc6558ed26b4ab10bcce04f0fe1e4677991099afb33bb9b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:23:28.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: set uid:gid to 167:167 (ceph:ceph) 2024-02-16T22:23:28.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev), process ceph-mon, pid 2 2024-02-16T22:23:28.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: pidfile_write: ignore empty --pid-file 2024-02-16T22:23:28.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: load: jerasure load: lrc 2024-02-16T22:23:28.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: RocksDB version: 7.9.2 2024-02-16T22:23:28.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Git sha 0 2024-02-16T22:23:28.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Compile date 2024-02-15 18:05:23 2024-02-16T22:23:28.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: DB SUMMARY 2024-02-16T22:23:28.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: DB Session ID: 9PN1I1CS6H26QASLFKZR 2024-02-16T22:23:28.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: CURRENT file: CURRENT 2024-02-16T22:23:28.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: IDENTITY file: IDENTITY 2024-02-16T22:23:28.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1170 Bytes 2024-02-16T22:23:28.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi134/store.db dir, Total Num: 1, files: 000033.sst 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi134/store.db: 000031.log size: 4747630 ; 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.error_if_exists: 0 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.create_if_missing: 0 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.paranoid_checks: 1 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.env: 0x55caa0c46ae0 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.fs: PosixFileSystem 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.info_log: 0x55caa22df760 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_file_opening_threads: 16 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.statistics: (nil) 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.use_fsync: 0 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_log_file_size: 0 2024-02-16T22:23:28.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-16T22:23:28.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-16T22:23:28.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.keep_log_file_num: 1000 2024-02-16T22:23:28.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.recycle_log_file_num: 0 2024-02-16T22:23:28.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.allow_fallocate: 1 2024-02-16T22:23:28.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.allow_mmap_reads: 0 2024-02-16T22:23:28.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.allow_mmap_writes: 0 2024-02-16T22:23:28.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.use_direct_reads: 0 2024-02-16T22:23:28.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-16T22:23:28.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.create_missing_column_families: 0 2024-02-16T22:23:28.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.db_log_dir: 2024-02-16T22:23:28.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.wal_dir: 2024-02-16T22:23:28.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-16T22:23:28.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-16T22:23:28.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.advise_random_on_open: 1 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.db_write_buffer_size: 0 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.write_buffer_manager: 0x55caa22b3400 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.rate_limiter: (nil) 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.wal_recovery_mode: 2 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.enable_thread_tracking: 0 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.enable_pipelined_write: 0 2024-02-16T22:23:28.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.unordered_write: 0 2024-02-16T22:23:28.732 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-16T22:23:28.732 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-16T22:23:28.732 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-16T22:23:28.732 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-16T22:23:28.732 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.row_cache: None 2024-02-16T22:23:28.733 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.wal_filter: None 2024-02-16T22:23:28.733 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-16T22:23:28.733 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.allow_ingest_behind: 0 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.two_write_queues: 0 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.manual_wal_flush: 0 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.wal_compression: 0 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.atomic_flush: 0 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.log_readahead_size: 0 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.best_efforts_recovery: 0 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.allow_data_in_errors: 0 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.db_host_id: __hostname__ 2024-02-16T22:23:28.734 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-16T22:23:28.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_background_jobs: 2 2024-02-16T22:23:28.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_background_compactions: -1 2024-02-16T22:23:28.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_subcompactions: 1 2024-02-16T22:23:28.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-16T22:23:28.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-16T22:23:28.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-16T22:23:28.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_total_wal_size: 0 2024-02-16T22:23:28.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-16T22:23:28.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-16T22:23:28.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-16T22:23:28.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-16T22:23:28.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_open_files: -1 2024-02-16T22:23:28.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.bytes_per_sync: 0 2024-02-16T22:23:28.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compaction_readahead_size: 0 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_background_flushes: -1 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Compression algorithms supported: 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: kZSTD supported: 0 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: kXpressCompression supported: 0 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: kLZ4HCCompression supported: 1 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: kZlibCompression supported: 1 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: kSnappyCompression supported: 1 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: kLZ4Compression supported: 1 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: kBZip2Compression supported: 0 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-16T22:23:28.736 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000015 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.merge_operator: 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compaction_filter: None 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compaction_filter_factory: None 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.sst_partitioner_factory: None 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55caa22df880) 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks: 1 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_top_level_index_and_filter: 1 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_type: 0 2024-02-16T22:23:28.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_index_type: 0 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_shortening: 1 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: checksum: 4 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: no_block_cache: 0 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache: 0x55caa22e3090 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_name: BinnedLRUCache 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_options: 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: capacity : 536870912 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_shard_bits : 4 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: strict_capacity_limit : 0 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: high_pri_pool_ratio: 0.000 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_compressed: (nil) 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: persistent_cache: (nil) 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size: 4096 2024-02-16T22:23:28.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size_deviation: 10 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_restart_interval: 16 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_block_restart_interval: 1 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_block_size: 4096 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: partition_filters: 0 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: use_delta_encoding: 1 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: filter_policy: bloomfilter 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: whole_key_filtering: 1 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: verify_compression: 0 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: read_amp_bytes_per_bit: 0 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: format_version: 5 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_index_compression: 1 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_align: 0 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_auto_readahead_size: 262144 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: prepopulate_block_cache: 0 2024-02-16T22:23:28.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: initial_auto_readahead_size: 8192 2024-02-16T22:23:28.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_file_reads_for_auto_readahead: 2 2024-02-16T22:23:28.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.write_buffer_size: 33554432 2024-02-16T22:23:28.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_write_buffer_number: 2 2024-02-16T22:23:28.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compression: NoCompression 2024-02-16T22:23:28.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.bottommost_compression: Disabled 2024-02-16T22:23:28.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.prefix_extractor: nullptr 2024-02-16T22:23:28.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-16T22:23:28.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.num_levels: 7 2024-02-16T22:23:28.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-16T22:23:28.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-16T22:23:28.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-16T22:23:28.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-16T22:23:28.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-16T22:23:28.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compression_opts.level: 32767 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compression_opts.strategy: 0 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compression_opts.enabled: false 2024-02-16T22:23:28.741 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-16T22:23:28.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-16T22:23:28.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-16T22:23:28.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-16T22:23:28.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.target_file_size_base: 67108864 2024-02-16T22:23:28.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-16T22:23:28.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-16T22:23:28.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-16T22:23:28.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-16T22:23:28.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-16T22:23:28.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-16T22:23:28.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-16T22:23:28.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-16T22:23:28.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.arena_block_size: 1048576 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.disable_auto_compactions: 0 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-16T22:23:28.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-16T22:23:28.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-16T22:23:28.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-16T22:23:28.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-16T22:23:28.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-16T22:23:28.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.table_properties_collectors: 2024-02-16T22:23:28.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.inplace_update_support: 0 2024-02-16T22:23:28.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-16T22:23:28.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-16T22:23:28.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-16T22:23:28.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-16T22:23:28.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.bloom_locality: 0 2024-02-16T22:23:28.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.max_successive_merges: 0 2024-02-16T22:23:28.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-16T22:23:28.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.paranoid_file_checks: 0 2024-02-16T22:23:28.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.force_consistency_checks: 1 2024-02-16T22:23:28.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.report_bg_io_stats: 0 2024-02-16T22:23:28.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.ttl: 2592000 2024-02-16T22:23:28.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-16T22:23:28.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-16T22:23:28.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-16T22:23:28.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.enable_blob_files: false 2024-02-16T22:23:28.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.min_blob_size: 0 2024-02-16T22:23:28.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.blob_file_size: 268435456 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.blob_file_starting_level: 0 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12102, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3b0a4693-3174-4fb7-b142-7bcc4109bbd7 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708122208572273, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-02-16T22:23:28.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708122208585360, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 4231142, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12103, "largest_seqno": 15272, "table_properties": {"data_size": 4218735, "index_size": 7674, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3717, "raw_key_size": 32548, "raw_average_key_size": 22, "raw_value_size": 4190105, "raw_average_value_size": 2864, "num_data_blocks": 348, "num_entries": 1463, "num_filter_entries": 1463, "num_deletions": 260, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708122208, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3b0a4693-3174-4fb7-b142-7bcc4109bbd7", "db_session_id": "9PN1I1CS6H26QASLFKZR", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708122208585480, "job": 1, "event": "recovery_finished"} 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi134/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55caa23d2000 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: DB pointer 0x55caa23be000 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** DB Stats ** 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-16T22:23:28.747 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L0 1/0 4.04 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 675.1 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L6 1/0 4.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Sum 2/0 8.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 675.1 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 675.1 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 675.1 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-02-16T22:23:28.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative compaction: 0.00 GB write, 251.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval compaction: 0.00 GB write, 251.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Block cache BinnedLRUCache@0x55caa22e3090#2 capacity: 512.00 MB usage: 12.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,8.08 KB,0.00154078%) Misc(1,0.00 KB,0%) 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-16T22:23:28.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: starting mon.smithi134 rank 0 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi134 fsid f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: mon.smithi134@-1(???) e2 preinit fsid f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: mon.smithi134@-1(???).mds e20 new map 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: mon.smithi134@-1(???).mds e20 print_map 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: e20 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: legacy client fscid: 1 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Filesystem 'cephfs' (1) 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: fs_name cephfs 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: epoch 20 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: modified 2024-02-16T22:23:22.543229+0000 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: tableserver 0 2024-02-16T22:23:28.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: root 0 2024-02-16T22:23:28.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: session_timeout 60 2024-02-16T22:23:28.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: session_autoclose 300 2024-02-16T22:23:28.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_file_size 1099511627776 2024-02-16T22:23:28.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_xattr_size 65536 2024-02-16T22:23:28.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: required_client_features {} 2024-02-16T22:23:28.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: last_failure 0 2024-02-16T22:23:28.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: last_failure_osd_epoch 46 2024-02-16T22:23:28.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:23:28.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_mds 2 2024-02-16T22:23:28.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: in 0,1 2024-02-16T22:23:28.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: up {0=14478,1=24269} 2024-02-16T22:23:28.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: failed 2024-02-16T22:23:28.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: damaged 2024-02-16T22:23:28.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: stopped 2024-02-16T22:23:28.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_pools [3] 2024-02-16T22:23:28.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_pool 2 2024-02-16T22:23:28.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: inline_data disabled 2024-02-16T22:23:28.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: balancer 2024-02-16T22:23:28.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: bal_rank_mask -1 2024-02-16T22:23:28.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: standby_count_wanted 1 2024-02-16T22:23:28.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi134.jyajef{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:28.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi173.qljqef{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:28.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:23:28.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:23:28.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Standby daemons: 2024-02-16T22:23:28.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-02-16T22:23:28.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi134.cygfxr{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2804816044,v1:172.21.15.134:6827/2804816044] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:28.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi173.phstvm{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:28.753 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: mon.smithi134@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-16T22:23:28.753 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: mon.smithi134@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-16T22:23:28.753 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: mon.smithi134@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-16T22:23:28.753 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: mon.smithi134@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-16T22:23:28.753 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 ceph-mon[112514]: mon.smithi134@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-02-16T22:23:28.753 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 bash[112495]: 2903b3988442cf5c0bc6558ed26b4ab10bcce04f0fe1e4677991099afb33bb9b 2024-02-16T22:23:28.753 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:28 smithi134 systemd[1]: Started Ceph mon.smithi134 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:23:30.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:30 smithi134 ceph-mon[112514]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:23:30.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:30 smithi134 ceph-mon[112514]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:23:30.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:30 smithi134 ceph-mon[112514]: pgmap v78: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:30.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:30 smithi134 ceph-mon[112514]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:23:30.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:30 smithi134 ceph-mon[112514]: mon.smithi134 calling monitor election 2024-02-16T22:23:30.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:30 smithi134 ceph-mon[112514]: mon.smithi134 is new leader, mons smithi134,smithi173 in quorum (ranks 0,1) 2024-02-16T22:23:30.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:30 smithi134 ceph-mon[112514]: monmap e2: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi173=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-16T22:23:30.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:30 smithi134 ceph-mon[112514]: fsmap cephfs:2 {0=cephfs.smithi134.jyajef=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:23:30.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:30 smithi134 ceph-mon[112514]: osdmap e48: 6 total, 6 up, 6 in 2024-02-16T22:23:30.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:30 smithi134 ceph-mon[112514]: mgrmap e32: smithi134.ordace(active, since 2m), standbys: smithi173.kbofaa 2024-02-16T22:23:30.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:30 smithi134 ceph-mon[112514]: overall HEALTH_OK 2024-02-16T22:23:30.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:30 smithi134 ceph-mon[112514]: from='mgr.14690 ' entity='' 2024-02-16T22:23:30.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:30 smithi134 ceph-mon[112514]: mgrmap e33: smithi134.ordace(active, since 2m), standbys: smithi173.kbofaa 2024-02-16T22:23:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:30 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:23:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:30 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:23:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:30 smithi173 ceph-mon[37280]: pgmap v78: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:30 smithi173 ceph-mon[37280]: from='mgr.14690 172.21.15.134:0/4219237538' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:23:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:30 smithi173 ceph-mon[37280]: mon.smithi134 calling monitor election 2024-02-16T22:23:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:30 smithi173 ceph-mon[37280]: mon.smithi134 is new leader, mons smithi134,smithi173 in quorum (ranks 0,1) 2024-02-16T22:23:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:30 smithi173 ceph-mon[37280]: monmap e2: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi173=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-16T22:23:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:30 smithi173 ceph-mon[37280]: fsmap cephfs:2 {0=cephfs.smithi134.jyajef=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:23:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:30 smithi173 ceph-mon[37280]: osdmap e48: 6 total, 6 up, 6 in 2024-02-16T22:23:30.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:30 smithi173 ceph-mon[37280]: mgrmap e32: smithi134.ordace(active, since 2m), standbys: smithi173.kbofaa 2024-02-16T22:23:30.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:30 smithi173 ceph-mon[37280]: overall HEALTH_OK 2024-02-16T22:23:30.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:30 smithi173 ceph-mon[37280]: from='mgr.14690 ' entity='' 2024-02-16T22:23:30.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:30 smithi173 ceph-mon[37280]: mgrmap e33: smithi134.ordace(active, since 2m), standbys: smithi173.kbofaa 2024-02-16T22:23:37.111 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:36 smithi173 ceph-mon[37280]: Standby manager daemon smithi173.kbofaa restarted 2024-02-16T22:23:37.111 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:36 smithi173 ceph-mon[37280]: Standby manager daemon smithi173.kbofaa started 2024-02-16T22:23:37.111 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:36 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/932969940' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/crt"}]: dispatch 2024-02-16T22:23:37.111 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:36 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/932969940' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-16T22:23:37.111 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:36 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/932969940' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/key"}]: dispatch 2024-02-16T22:23:37.111 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:36 smithi173 ceph-mon[37280]: from='mgr.? 172.21.15.173:0/932969940' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-16T22:23:37.112 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:36 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173[37249]: 2024-02-16T22:23:36.983+0000 7f083205e700 -1 mon.smithi173@1(peon).osd e49 update_from_paxos full map CRC mismatch, resetting to canonical 2024-02-16T22:23:37.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:36 smithi134 ceph-mon[112514]: Standby manager daemon smithi173.kbofaa restarted 2024-02-16T22:23:37.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:36 smithi134 ceph-mon[112514]: Standby manager daemon smithi173.kbofaa started 2024-02-16T22:23:37.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:36 smithi134 ceph-mon[112514]: from='mgr.? 172.21.15.173:0/932969940' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/crt"}]: dispatch 2024-02-16T22:23:37.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:36 smithi134 ceph-mon[112514]: from='mgr.? 172.21.15.173:0/932969940' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-16T22:23:37.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:36 smithi134 ceph-mon[112514]: from='mgr.? 172.21.15.173:0/932969940' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi173.kbofaa/key"}]: dispatch 2024-02-16T22:23:37.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:36 smithi134 ceph-mon[112514]: from='mgr.? 172.21.15.173:0/932969940' entity='mgr.smithi173.kbofaa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-16T22:23:38.205 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: mgrmap e34: smithi134.ordace(active, since 2m), standbys: smithi173.kbofaa 2024-02-16T22:23:38.206 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: Active manager daemon smithi134.ordace restarted 2024-02-16T22:23:38.206 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: Activating manager daemon smithi134.ordace 2024-02-16T22:23:38.206 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: osdmap e49: 6 total, 6 up, 6 in 2024-02-16T22:23:38.206 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: mgrmap e35: smithi134.ordace(active, starting, since 0.00648522s), standbys: smithi173.kbofaa 2024-02-16T22:23:38.206 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: failed to encode map e49 with expected crc 2024-02-16T22:23:38.206 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:23:38.206 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:23:38.206 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jyajef"}]: dispatch 2024-02-16T22:23:38.206 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:23:38.206 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.qljqef"}]: dispatch 2024-02-16T22:23:38.206 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.phstvm"}]: dispatch 2024-02-16T22:23:38.207 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr metadata", "who": "smithi134.ordace", "id": "smithi134.ordace"}]: dispatch 2024-02-16T22:23:38.207 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr metadata", "who": "smithi173.kbofaa", "id": "smithi173.kbofaa"}]: dispatch 2024-02-16T22:23:38.207 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:23:38.207 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:23:38.207 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:23:38.207 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:23:38.207 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:23:38.207 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:23:38.207 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-16T22:23:38.207 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-16T22:23:38.207 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-16T22:23:38.207 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: Manager daemon smithi134.ordace is now available 2024-02-16T22:23:38.207 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:23:38.207 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:23:38.208 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:23:38.208 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/mirror_snapshot_schedule"}]: dispatch 2024-02-16T22:23:38.208 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/trash_purge_schedule"}]: dispatch 2024-02-16T22:23:38.208 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:37 smithi173 ceph-mon[37280]: failed to encode map e49 with expected crc 2024-02-16T22:23:38.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: mgrmap e34: smithi134.ordace(active, since 2m), standbys: smithi173.kbofaa 2024-02-16T22:23:38.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: Active manager daemon smithi134.ordace restarted 2024-02-16T22:23:38.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: Activating manager daemon smithi134.ordace 2024-02-16T22:23:38.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: osdmap e49: 6 total, 6 up, 6 in 2024-02-16T22:23:38.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: mgrmap e35: smithi134.ordace(active, starting, since 0.00648522s), standbys: smithi173.kbofaa 2024-02-16T22:23:38.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: failed to encode map e49 with expected crc 2024-02-16T22:23:38.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:23:38.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:23:38.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jyajef"}]: dispatch 2024-02-16T22:23:38.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:23:38.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.qljqef"}]: dispatch 2024-02-16T22:23:38.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.phstvm"}]: dispatch 2024-02-16T22:23:38.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr metadata", "who": "smithi134.ordace", "id": "smithi134.ordace"}]: dispatch 2024-02-16T22:23:38.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr metadata", "who": "smithi173.kbofaa", "id": "smithi173.kbofaa"}]: dispatch 2024-02-16T22:23:38.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:23:38.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:23:38.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:23:38.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:23:38.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:23:38.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:23:38.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-16T22:23:38.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-16T22:23:38.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-16T22:23:38.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: Manager daemon smithi134.ordace is now available 2024-02-16T22:23:38.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:23:38.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:23:38.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:23:38.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/mirror_snapshot_schedule"}]: dispatch 2024-02-16T22:23:38.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.ordace/trash_purge_schedule"}]: dispatch 2024-02-16T22:23:38.229 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:37 smithi134 ceph-mon[112514]: failed to encode map e49 with expected crc 2024-02-16T22:23:38.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:38 smithi173 ceph-mon[37280]: failed to encode map e49 with expected crc 2024-02-16T22:23:38.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:38 smithi173 ceph-mon[37280]: failed to encode map e49 with expected crc 2024-02-16T22:23:38.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:38 smithi173 ceph-mon[37280]: [16/Feb/2024:22:23:37] ENGINE Bus STARTING 2024-02-16T22:23:38.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:38 smithi173 ceph-mon[37280]: [16/Feb/2024:22:23:37] ENGINE Serving on http://172.21.15.134:8765 2024-02-16T22:23:38.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:38 smithi173 ceph-mon[37280]: [16/Feb/2024:22:23:37] ENGINE Serving on https://172.21.15.134:7150 2024-02-16T22:23:38.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:38 smithi173 ceph-mon[37280]: [16/Feb/2024:22:23:37] ENGINE Bus STARTED 2024-02-16T22:23:38.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:38 smithi173 ceph-mon[37280]: mgrmap e36: smithi134.ordace(active, since 1.01086s), standbys: smithi173.kbofaa 2024-02-16T22:23:38.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:38 smithi173 ceph-mon[37280]: pgmap v3: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:38 smithi134 ceph-mon[112514]: failed to encode map e49 with expected crc 2024-02-16T22:23:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:38 smithi134 ceph-mon[112514]: failed to encode map e49 with expected crc 2024-02-16T22:23:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:38 smithi134 ceph-mon[112514]: [16/Feb/2024:22:23:37] ENGINE Bus STARTING 2024-02-16T22:23:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:38 smithi134 ceph-mon[112514]: [16/Feb/2024:22:23:37] ENGINE Serving on http://172.21.15.134:8765 2024-02-16T22:23:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:38 smithi134 ceph-mon[112514]: [16/Feb/2024:22:23:37] ENGINE Serving on https://172.21.15.134:7150 2024-02-16T22:23:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:38 smithi134 ceph-mon[112514]: [16/Feb/2024:22:23:37] ENGINE Bus STARTED 2024-02-16T22:23:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:38 smithi134 ceph-mon[112514]: mgrmap e36: smithi134.ordace(active, since 1.01086s), standbys: smithi173.kbofaa 2024-02-16T22:23:39.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:38 smithi134 ceph-mon[112514]: pgmap v3: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:40.346 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:39 smithi134 ceph-mon[112514]: pgmap v4: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:39 smithi173 ceph-mon[37280]: pgmap v4: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:41.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:40 smithi134 ceph-mon[112514]: mgrmap e37: smithi134.ordace(active, since 3s), standbys: smithi173.kbofaa 2024-02-16T22:23:41.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:40 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:41.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:40 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:41.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:40 smithi173 ceph-mon[37280]: mgrmap e37: smithi134.ordace(active, since 3s), standbys: smithi173.kbofaa 2024-02-16T22:23:41.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:40 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:41.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:40 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:42.231 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:42 smithi134 ceph-mon[112514]: pgmap v5: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:42.232 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:42 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:42.232 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:42 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:42.232 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:42 smithi134 ceph-mon[112514]: mgrmap e38: smithi134.ordace(active, since 5s), standbys: smithi173.kbofaa 2024-02-16T22:23:42.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:42 smithi173 ceph-mon[37280]: pgmap v5: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:42.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:42 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:42.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:42 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:42.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:42 smithi173 ceph-mon[37280]: mgrmap e38: smithi134.ordace(active, since 5s), standbys: smithi173.kbofaa 2024-02-16T22:23:43.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:43 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:43.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:43 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:43.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:43 smithi134 ceph-mon[112514]: pgmap v6: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:43.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:43 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:43.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:43 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:43.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:43 smithi173 ceph-mon[37280]: pgmap v6: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:44.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:44 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:44.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:44 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:44 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:44 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:45.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:45 smithi134 ceph-mon[112514]: pgmap v7: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-16T22:23:45.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:45 smithi173 ceph-mon[37280]: pgmap v7: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-16T22:23:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: Detected new or changed devices on smithi134 2024-02-16T22:23:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:23:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:23:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: Updating smithi134:/etc/ceph/ceph.conf 2024-02-16T22:23:48.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: Updating smithi173:/etc/ceph/ceph.conf 2024-02-16T22:23:48.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: pgmap v8: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-16T22:23:48.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:23:48.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:23:48.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:48.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:48.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:48.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:48.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:47 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: Detected new or changed devices on smithi134 2024-02-16T22:23:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:23:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:23:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: Updating smithi134:/etc/ceph/ceph.conf 2024-02-16T22:23:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: Updating smithi173:/etc/ceph/ceph.conf 2024-02-16T22:23:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: pgmap v8: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-16T22:23:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:23:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-16T22:23:48.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:48.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:48.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:48.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:48.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:47 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:48.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:48 smithi134 ceph-mon[112514]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:23:48.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:48 smithi134 ceph-mon[112514]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:23:48.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:48 smithi134 ceph-mon[112514]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-16T22:23:48.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:48 smithi134 ceph-mon[112514]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-16T22:23:48.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:48 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:23:48.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:48 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:23:48.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:48 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-16T22:23:48.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:48 smithi173 ceph-mon[37280]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:23:48.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:48 smithi173 ceph-mon[37280]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-02-16T22:23:48.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:48 smithi173 ceph-mon[37280]: Updating smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-16T22:23:48.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:48 smithi173 ceph-mon[37280]: Updating smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-16T22:23:48.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:48 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:23:48.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:48 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:23:48.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:48 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-16T22:23:50.143 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:49 smithi173 ceph-mon[37280]: pgmap v9: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-16T22:23:50.144 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:49 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:50.144 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:49 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-16T22:23:50.144 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:49 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-16T22:23:50.144 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:49 smithi173 ceph-mon[37280]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:23:50.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:49 smithi134 ceph-mon[112514]: pgmap v9: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-16T22:23:50.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:50.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-16T22:23:50.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-16T22:23:50.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:23:50.937 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:50 smithi173 ceph-mon[37280]: Upgrade: Updating mon.smithi173 2024-02-16T22:23:50.937 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:50 smithi173 ceph-mon[37280]: Deploying daemon mon.smithi173 on smithi173 2024-02-16T22:23:51.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:50 smithi134 ceph-mon[112514]: Upgrade: Updating mon.smithi173 2024-02-16T22:23:51.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:50 smithi134 ceph-mon[112514]: Deploying daemon mon.smithi173 on smithi173 2024-02-16T22:23:51.507 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:51 smithi173 systemd[1]: Stopping Ceph mon.smithi173 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:23:51.899 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:51 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173[37249]: 2024-02-16T22:23:51.504+0000 7f0837869700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi173 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:23:51.899 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:51 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173[37249]: 2024-02-16T22:23:51.504+0000 7f0837869700 -1 mon.smithi173@1(peon) e2 *** Got Signal Terminated *** 2024-02-16T22:23:51.899 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:51 smithi173 podman[83539]: 2024-02-16 22:23:51.617860642 +0000 UTC m=+0.235973654 container died cfbef35950efd23965a6ab47d04c9eed9c0500f6e1ecc17366145df2552f0d69 (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, RELEASE=quincy-b88fae6, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-16T22:23:52.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:51 smithi173 podman[83539]: 2024-02-16 22:23:51.996650882 +0000 UTC m=+0.614763900 container cleanup cfbef35950efd23965a6ab47d04c9eed9c0500f6e1ecc17366145df2552f0d69 (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-b88fae6, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-02-16T22:23:52.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:51 smithi173 bash[83539]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173 2024-02-16T22:23:52.555 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:52 smithi173 podman[83553]: 2024-02-16 22:23:52.231224397 +0000 UTC m=+0.609736172 container remove cfbef35950efd23965a6ab47d04c9eed9c0500f6e1ecc17366145df2552f0d69 (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-b88fae6, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2) 2024-02-16T22:23:52.555 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:52 smithi173 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi173.service: Deactivated successfully. 2024-02-16T22:23:52.555 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:52 smithi173 systemd[1]: Stopped Ceph mon.smithi173 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:23:52.555 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:52 smithi173 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi173.service: Consumed 7.125s CPU time. 2024-02-16T22:23:52.874 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:52 smithi173 systemd[1]: Starting Ceph mon.smithi173 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:23:52.875 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:52 smithi173 podman[83684]: 2024-02-16 22:23:52.670705882 +0000 UTC m=+0.017693890 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:23:52.875 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:52 smithi173 podman[83684]: 2024-02-16 22:23:52.774210865 +0000 UTC m=+0.121198872 container create dd7cf2f31226861e276dcbe1b73025354ff34eb8380a21eb7f0a2caf7ca7bfde (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:23:53.024 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:52 smithi173 podman[83684]: 2024-02-16 22:23:52.986316953 +0000 UTC m=+0.333304961 container init dd7cf2f31226861e276dcbe1b73025354ff34eb8380a21eb7f0a2caf7ca7bfde (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:23:53.024 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:52 smithi173 podman[83684]: 2024-02-16 22:23:52.990060916 +0000 UTC m=+0.337048933 container start dd7cf2f31226861e276dcbe1b73025354ff34eb8380a21eb7f0a2caf7ca7bfde (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:23:53.024 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: set uid:gid to 167:167 (ceph:ceph) 2024-02-16T22:23:53.024 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev), process ceph-mon, pid 2 2024-02-16T22:23:53.024 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: pidfile_write: ignore empty --pid-file 2024-02-16T22:23:53.024 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: load: jerasure load: lrc 2024-02-16T22:23:53.024 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: RocksDB version: 7.9.2 2024-02-16T22:23:53.024 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Git sha 0 2024-02-16T22:23:53.024 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Compile date 2024-02-15 18:05:23 2024-02-16T22:23:53.025 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: DB SUMMARY 2024-02-16T22:23:53.025 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: DB Session ID: 1LAHSP0LCUG47PHZY3G7 2024-02-16T22:23:53.025 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: CURRENT file: CURRENT 2024-02-16T22:23:53.025 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: IDENTITY file: IDENTITY 2024-02-16T22:23:53.025 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1095 Bytes 2024-02-16T22:23:53.025 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi173/store.db dir, Total Num: 1, files: 000027.sst 2024-02-16T22:23:53.025 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi173/store.db: 000025.log size: 9949846 ; 2024-02-16T22:23:53.025 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.error_if_exists: 0 2024-02-16T22:23:53.025 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.create_if_missing: 0 2024-02-16T22:23:53.025 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.paranoid_checks: 1 2024-02-16T22:23:53.025 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-16T22:23:53.025 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-16T22:23:53.025 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-16T22:23:53.025 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.env: 0x557374269ae0 2024-02-16T22:23:53.026 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.fs: PosixFileSystem 2024-02-16T22:23:53.026 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.info_log: 0x5573768a5760 2024-02-16T22:23:53.026 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_file_opening_threads: 16 2024-02-16T22:23:53.027 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.statistics: (nil) 2024-02-16T22:23:53.027 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.use_fsync: 0 2024-02-16T22:23:53.027 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_log_file_size: 0 2024-02-16T22:23:53.027 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-16T22:23:53.027 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-16T22:23:53.027 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.keep_log_file_num: 1000 2024-02-16T22:23:53.027 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.recycle_log_file_num: 0 2024-02-16T22:23:53.027 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.allow_fallocate: 1 2024-02-16T22:23:53.027 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.allow_mmap_reads: 0 2024-02-16T22:23:53.027 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.allow_mmap_writes: 0 2024-02-16T22:23:53.027 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.use_direct_reads: 0 2024-02-16T22:23:53.028 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-16T22:23:53.028 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.create_missing_column_families: 0 2024-02-16T22:23:53.028 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.db_log_dir: 2024-02-16T22:23:53.028 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.wal_dir: 2024-02-16T22:23:53.028 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-16T22:23:53.028 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-16T22:23:53.028 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-16T22:23:53.028 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-16T22:23:53.028 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-16T22:23:53.028 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-16T22:23:53.028 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.advise_random_on_open: 1 2024-02-16T22:23:53.028 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.db_write_buffer_size: 0 2024-02-16T22:23:53.028 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.write_buffer_manager: 0x557376879400 2024-02-16T22:23:53.028 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.rate_limiter: (nil) 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.wal_recovery_mode: 2 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.enable_thread_tracking: 0 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.enable_pipelined_write: 0 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.unordered_write: 0 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.row_cache: None 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.wal_filter: None 2024-02-16T22:23:53.029 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.allow_ingest_behind: 0 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.two_write_queues: 0 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.manual_wal_flush: 0 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.wal_compression: 0 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.atomic_flush: 0 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.log_readahead_size: 0 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.best_efforts_recovery: 0 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.allow_data_in_errors: 0 2024-02-16T22:23:53.030 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.db_host_id: __hostname__ 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_background_jobs: 2 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_background_compactions: -1 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_subcompactions: 1 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_total_wal_size: 0 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_open_files: -1 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.bytes_per_sync: 0 2024-02-16T22:23:53.031 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-16T22:23:53.032 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-16T22:23:53.032 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compaction_readahead_size: 0 2024-02-16T22:23:53.032 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_background_flushes: -1 2024-02-16T22:23:53.032 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Compression algorithms supported: 2024-02-16T22:23:53.032 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-16T22:23:53.032 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: kZSTD supported: 0 2024-02-16T22:23:53.032 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: kXpressCompression supported: 0 2024-02-16T22:23:53.032 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: kLZ4HCCompression supported: 1 2024-02-16T22:23:53.032 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: kZlibCompression supported: 1 2024-02-16T22:23:53.032 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: kSnappyCompression supported: 1 2024-02-16T22:23:53.032 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: kLZ4Compression supported: 1 2024-02-16T22:23:53.032 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: kBZip2Compression supported: 0 2024-02-16T22:23:53.033 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-16T22:23:53.033 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-16T22:23:53.033 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi173/store.db/MANIFEST-000009 2024-02-16T22:23:53.033 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-16T22:23:53.033 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-16T22:23:53.033 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.merge_operator: 2024-02-16T22:23:53.033 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compaction_filter: None 2024-02-16T22:23:53.033 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compaction_filter_factory: None 2024-02-16T22:23:53.033 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.sst_partitioner_factory: None 2024-02-16T22:23:53.033 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-16T22:23:53.033 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-16T22:23:53.033 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5573768a5880) 2024-02-16T22:23:53.033 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: cache_index_and_filter_blocks: 1 2024-02-16T22:23:53.033 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: pin_top_level_index_and_filter: 1 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: index_type: 0 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: data_block_index_type: 0 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: index_shortening: 1 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: checksum: 4 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: no_block_cache: 0 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: block_cache: 0x5573768a9090 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: block_cache_name: BinnedLRUCache 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: block_cache_options: 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: capacity : 536870912 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: num_shard_bits : 4 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: strict_capacity_limit : 0 2024-02-16T22:23:53.034 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: high_pri_pool_ratio: 0.000 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: block_cache_compressed: (nil) 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: persistent_cache: (nil) 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: block_size: 4096 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: block_size_deviation: 10 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: block_restart_interval: 16 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: index_block_restart_interval: 1 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: metadata_block_size: 4096 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: partition_filters: 0 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: use_delta_encoding: 1 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: filter_policy: bloomfilter 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: whole_key_filtering: 1 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: verify_compression: 0 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: read_amp_bytes_per_bit: 0 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: format_version: 5 2024-02-16T22:23:53.035 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: enable_index_compression: 1 2024-02-16T22:23:53.036 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: block_align: 0 2024-02-16T22:23:53.036 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: max_auto_readahead_size: 262144 2024-02-16T22:23:53.036 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: prepopulate_block_cache: 0 2024-02-16T22:23:53.036 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: initial_auto_readahead_size: 8192 2024-02-16T22:23:53.036 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: num_file_reads_for_auto_readahead: 2 2024-02-16T22:23:53.036 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.write_buffer_size: 33554432 2024-02-16T22:23:53.036 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_write_buffer_number: 2 2024-02-16T22:23:53.036 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compression: NoCompression 2024-02-16T22:23:53.036 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.bottommost_compression: Disabled 2024-02-16T22:23:53.036 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.prefix_extractor: nullptr 2024-02-16T22:23:53.036 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-16T22:23:53.036 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.num_levels: 7 2024-02-16T22:23:53.036 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-16T22:23:53.036 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-16T22:23:53.037 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-16T22:23:53.037 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-16T22:23:53.037 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-16T22:23:53.037 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-16T22:23:53.037 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-16T22:23:53.037 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-16T22:23:53.037 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-16T22:23:53.037 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-16T22:23:53.037 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-16T22:23:53.037 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-16T22:23:53.037 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-16T22:23:53.037 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compression_opts.level: 32767 2024-02-16T22:23:53.037 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compression_opts.strategy: 0 2024-02-16T22:23:53.037 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compression_opts.enabled: false 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.target_file_size_base: 67108864 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-16T22:23:53.038 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-16T22:23:53.039 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-16T22:23:53.039 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-16T22:23:53.039 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-16T22:23:53.039 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-16T22:23:53.039 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-16T22:23:53.039 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-16T22:23:53.039 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-16T22:23:53.039 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-16T22:23:53.039 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.arena_block_size: 1048576 2024-02-16T22:23:53.039 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-16T22:23:53.039 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-16T22:23:53.039 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.disable_auto_compactions: 0 2024-02-16T22:23:53.039 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-16T22:23:53.039 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.table_properties_collectors: 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.inplace_update_support: 0 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-16T22:23:53.040 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.bloom_locality: 0 2024-02-16T22:23:53.041 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.max_successive_merges: 0 2024-02-16T22:23:53.041 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-16T22:23:53.041 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.paranoid_file_checks: 0 2024-02-16T22:23:53.041 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.force_consistency_checks: 1 2024-02-16T22:23:53.041 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.report_bg_io_stats: 0 2024-02-16T22:23:53.041 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.ttl: 2592000 2024-02-16T22:23:53.041 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-16T22:23:53.041 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-16T22:23:53.041 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-16T22:23:53.041 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.enable_blob_files: false 2024-02-16T22:23:53.041 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.min_blob_size: 0 2024-02-16T22:23:53.041 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.blob_file_size: 268435456 2024-02-16T22:23:53.041 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-16T22:23:53.041 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-16T22:23:53.042 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-16T22:23:53.042 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-16T22:23:53.042 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-16T22:23:53.042 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.blob_file_starting_level: 0 2024-02-16T22:23:53.042 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-16T22:23:53.042 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-02-16T22:23:53.042 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-16T22:23:53.042 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi173/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12190, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-16T22:23:53.043 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-02-16T22:23:53.043 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 95cfa113-c413-44d5-958f-0cbaf559a4aa 2024-02-16T22:23:53.043 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708122233019665, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-02-16T22:23:53.043 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-02-16T22:23:53.400 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708122233045532, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 5916981, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12195, "largest_seqno": 16175, "table_properties": {"data_size": 5902610, "index_size": 9190, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 4165, "raw_key_size": 37189, "raw_average_key_size": 22, "raw_value_size": 5869743, "raw_average_value_size": 3529, "num_data_blocks": 412, "num_entries": 1663, "num_filter_entries": 1663, "num_deletions": 260, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708122233, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "95cfa113-c413-44d5-958f-0cbaf559a4aa", "db_session_id": "1LAHSP0LCUG47PHZY3G7", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-02-16T22:23:53.400 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708122233045656, "job": 1, "event": "recovery_finished"} 2024-02-16T22:23:53.400 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-02-16T22:23:53.400 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-16T22:23:53.400 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi173/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-16T22:23:53.400 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557376998000 2024-02-16T22:23:53.401 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: DB pointer 0x557376984000 2024-02-16T22:23:53.401 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-16T22:23:53.401 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-16T22:23:53.401 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: ** DB Stats ** 2024-02-16T22:23:53.401 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-16T22:23:53.401 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-16T22:23:53.401 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-16T22:23:53.401 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-16T22:23:53.401 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-16T22:23:53.401 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-16T22:23:53.401 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-16T22:23:53.401 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: 2024-02-16T22:23:53.401 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: ** Compaction Stats [default] ** 2024-02-16T22:23:53.401 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-16T22:23:53.402 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-16T22:23:53.402 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: L0 1/0 5.64 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 557.9 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-02-16T22:23:53.402 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: L6 1/0 4.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-16T22:23:53.402 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Sum 2/0 10.42 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 557.9 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-02-16T22:23:53.402 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 557.9 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-02-16T22:23:53.402 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: 2024-02-16T22:23:53.402 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: ** Compaction Stats [default] ** 2024-02-16T22:23:53.402 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-16T22:23:53.402 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-16T22:23:53.402 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 557.9 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-02-16T22:23:53.402 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: 2024-02-16T22:23:53.402 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-16T22:23:53.402 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: 2024-02-16T22:23:53.402 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Flush(GB): cumulative 0.006, interval 0.006 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Cumulative compaction: 0.01 GB write, 187.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Interval compaction: 0.01 GB write, 187.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Block cache BinnedLRUCache@0x5573768a9090#2 capacity: 512.00 MB usage: 13.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.53 KB,0.000864267%) IndexBlock(1,9.08 KB,0.00173151%) Misc(1,0.00 KB,0%) 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: starting mon.smithi173 rank 1 at public addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] at bind addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi173 fsid f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: mon.smithi173@-1(???) e2 preinit fsid f29a5372-cd17-11ee-95ba-87774f69a715 2024-02-16T22:23:53.403 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: mon.smithi173@-1(???).mds e20 new map 2024-02-16T22:23:53.404 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: mon.smithi173@-1(???).mds e20 print_map 2024-02-16T22:23:53.404 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: e20 2024-02-16T22:23:53.404 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:23:53.404 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:23:53.404 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: legacy client fscid: 1 2024-02-16T22:23:53.404 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: 2024-02-16T22:23:53.404 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Filesystem 'cephfs' (1) 2024-02-16T22:23:53.404 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: fs_name cephfs 2024-02-16T22:23:53.404 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: epoch 20 2024-02-16T22:23:53.404 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-16T22:23:53.404 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:23:53.404 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: modified 2024-02-16T22:23:22.543229+0000 2024-02-16T22:23:53.404 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: tableserver 0 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: root 0 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: session_timeout 60 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: session_autoclose 300 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: max_file_size 1099511627776 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: max_xattr_size 65536 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: required_client_features {} 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: last_failure 0 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: last_failure_osd_epoch 46 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: max_mds 2 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: in 0,1 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: up {0=14478,1=24269} 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: failed 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: damaged 2024-02-16T22:23:53.405 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: stopped 2024-02-16T22:23:53.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: data_pools [3] 2024-02-16T22:23:53.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: metadata_pool 2 2024-02-16T22:23:53.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: inline_data disabled 2024-02-16T22:23:53.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: balancer 2024-02-16T22:23:53.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: bal_rank_mask -1 2024-02-16T22:23:53.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: standby_count_wanted 1 2024-02-16T22:23:53.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: [mds.cephfs.smithi134.jyajef{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:53.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: [mds.cephfs.smithi173.qljqef{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:53.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: 2024-02-16T22:23:53.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: 2024-02-16T22:23:53.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: Standby daemons: 2024-02-16T22:23:53.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: 2024-02-16T22:23:53.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: [mds.cephfs.smithi134.cygfxr{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2804816044,v1:172.21.15.134:6827/2804816044] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:53.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout: [mds.cephfs.smithi173.phstvm{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:53.407 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: mon.smithi173@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-16T22:23:53.407 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: mon.smithi173@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-16T22:23:53.407 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: mon.smithi173@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-16T22:23:53.407 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: mon.smithi173@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-16T22:23:53.407 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 ceph-mon[83703]: mon.smithi173@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-02-16T22:23:53.407 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 bash[83684]: dd7cf2f31226861e276dcbe1b73025354ff34eb8380a21eb7f0a2caf7ca7bfde 2024-02-16T22:23:53.407 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:53 smithi173 systemd[1]: Started Ceph mon.smithi173 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:23:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:54 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:23:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:54 smithi173 ceph-mon[83703]: mon.smithi134 calling monitor election 2024-02-16T22:23:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:54 smithi173 ceph-mon[83703]: mon.smithi173 calling monitor election 2024-02-16T22:23:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:54 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:23:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:54 smithi173 ceph-mon[83703]: mon.smithi134 is new leader, mons smithi134,smithi173 in quorum (ranks 0,1) 2024-02-16T22:23:54.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:54 smithi173 ceph-mon[83703]: monmap e3: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi173=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-16T22:23:54.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:54 smithi173 ceph-mon[83703]: fsmap cephfs:2 {0=cephfs.smithi134.jyajef=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:23:54.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:54 smithi173 ceph-mon[83703]: osdmap e49: 6 total, 6 up, 6 in 2024-02-16T22:23:54.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:54 smithi173 ceph-mon[83703]: mgrmap e38: smithi134.ordace(active, since 16s), standbys: smithi173.kbofaa 2024-02-16T22:23:54.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:54 smithi173 ceph-mon[83703]: overall HEALTH_OK 2024-02-16T22:23:54.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:54 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:54.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:54 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:54.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:54 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:23:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:54 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-02-16T22:23:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:54 smithi134 ceph-mon[112514]: mon.smithi134 calling monitor election 2024-02-16T22:23:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:54 smithi134 ceph-mon[112514]: mon.smithi173 calling monitor election 2024-02-16T22:23:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:54 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mon metadata", "id": "smithi173"}]: dispatch 2024-02-16T22:23:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:54 smithi134 ceph-mon[112514]: mon.smithi134 is new leader, mons smithi134,smithi173 in quorum (ranks 0,1) 2024-02-16T22:23:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:54 smithi134 ceph-mon[112514]: monmap e3: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi173=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-16T22:23:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:54 smithi134 ceph-mon[112514]: fsmap cephfs:2 {0=cephfs.smithi134.jyajef=up:active,1=cephfs.smithi173.qljqef=up:active} 2 up:standby 2024-02-16T22:23:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:54 smithi134 ceph-mon[112514]: osdmap e49: 6 total, 6 up, 6 in 2024-02-16T22:23:54.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:54 smithi134 ceph-mon[112514]: mgrmap e38: smithi134.ordace(active, since 16s), standbys: smithi173.kbofaa 2024-02-16T22:23:54.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:54 smithi134 ceph-mon[112514]: overall HEALTH_OK 2024-02-16T22:23:54.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:54 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:54.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:54 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:54.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:54 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:23:55.577 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:55 smithi173 ceph-mon[83703]: pgmap v12: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-16T22:23:55.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:55 smithi134 ceph-mon[112514]: pgmap v12: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-16T22:23:55.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.783+0000 7fa636490700 1 -- 172.21.15.134:0/2994376782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6301038f0 msgr2=0x7fa6300fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:55.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.784+0000 7fa636490700 1 --2- 172.21.15.134:0/2994376782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6301038f0 0x7fa6300fcf60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa624004940 tx=0x7fa624009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:55.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.784+0000 7fa636490700 1 -- 172.21.15.134:0/2994376782 shutdown_connections 2024-02-16T22:23:55.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.784+0000 7fa636490700 1 --2- 172.21.15.134:0/2994376782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6301038f0 0x7fa6300fcf60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:55.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.784+0000 7fa636490700 1 --2- 172.21.15.134:0/2994376782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa630102f50 0x7fa630103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:55.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.784+0000 7fa636490700 1 -- 172.21.15.134:0/2994376782 >> 172.21.15.134:0/2994376782 conn(0x7fa6300f8ae0 msgr2=0x7fa6300faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:55.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.784+0000 7fa636490700 1 -- 172.21.15.134:0/2994376782 shutdown_connections 2024-02-16T22:23:55.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.784+0000 7fa636490700 1 -- 172.21.15.134:0/2994376782 wait complete. 2024-02-16T22:23:55.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.784+0000 7fa636490700 1 Processor -- start 2024-02-16T22:23:55.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.784+0000 7fa636490700 1 -- start start 2024-02-16T22:23:55.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa636490700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa630102f50 0x7fa630113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:55.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa636490700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6301038f0 0x7fa630113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:55.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa636490700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa630114620 con 0x7fa630102f50 2024-02-16T22:23:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa636490700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63010d950 con 0x7fa6301038f0 2024-02-16T22:23:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa630102f50 0x7fa630113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa630102f50 0x7fa630113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42780/0 (socket says 172.21.15.134:42780) 2024-02-16T22:23:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62ffff700 1 -- 172.21.15.134:0/3441997194 learned_addr learned my addr 172.21.15.134:0/3441997194 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62f7fe700 1 --2- 172.21.15.134:0/3441997194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6301038f0 0x7fa630113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62f7fe700 1 -- 172.21.15.134:0/3441997194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6301038f0 msgr2=0x7fa630113fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-16T22:23:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62f7fe700 1 -- 172.21.15.134:0/3441997194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6301038f0 msgr2=0x7fa630113fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-16T22:23:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62f7fe700 1 --2- 172.21.15.134:0/3441997194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6301038f0 0x7fa630113fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-16T22:23:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62f7fe700 1 --2- 172.21.15.134:0/3441997194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6301038f0 0x7fa630113fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T22:23:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62ffff700 1 -- 172.21.15.134:0/3441997194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6301038f0 msgr2=0x7fa630113fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-16T22:23:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62ffff700 1 --2- 172.21.15.134:0/3441997194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6301038f0 0x7fa630113fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62ffff700 1 -- 172.21.15.134:0/3441997194 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624005040 con 0x7fa630102f50 2024-02-16T22:23:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62ffff700 1 --2- 172.21.15.134:0/3441997194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa630102f50 0x7fa630113a90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa620002a50 tx=0x7fa6200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62cff9700 1 -- 172.21.15.134:0/3441997194 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa620007cc0 con 0x7fa630102f50 2024-02-16T22:23:55.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62cff9700 1 -- 172.21.15.134:0/3441997194 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa62000f040 con 0x7fa630102f50 2024-02-16T22:23:55.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa62cff9700 1 -- 172.21.15.134:0/3441997194 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa620009640 con 0x7fa630102f50 2024-02-16T22:23:55.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.785+0000 7fa636490700 1 -- 172.21.15.134:0/3441997194 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63010dc30 con 0x7fa630102f50 2024-02-16T22:23:55.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.786+0000 7fa636490700 1 -- 172.21.15.134:0/3441997194 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63010e140 con 0x7fa630102f50 2024-02-16T22:23:55.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.787+0000 7fa636490700 1 -- 172.21.15.134:0/3441997194 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa630105420 con 0x7fa630102f50 2024-02-16T22:23:55.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.787+0000 7fa62cff9700 1 -- 172.21.15.134:0/3441997194 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fa6200097a0 con 0x7fa630102f50 2024-02-16T22:23:55.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.787+0000 7fa62cff9700 1 --2- 172.21.15.134:0/3441997194 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa61806d900 0x7fa61806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:55.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.788+0000 7fa62f7fe700 1 --2- 172.21.15.134:0/3441997194 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa61806d900 0x7fa61806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:55.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.788+0000 7fa62cff9700 1 -- 172.21.15.134:0/3441997194 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa62008ce10 con 0x7fa630102f50 2024-02-16T22:23:55.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.788+0000 7fa62f7fe700 1 --2- 172.21.15.134:0/3441997194 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa61806d900 0x7fa61806fdb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa63010ec80 tx=0x7fa624009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:55.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:55.793+0000 7fa62cff9700 1 -- 172.21.15.134:0/3441997194 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa62005a040 con 0x7fa630102f50 2024-02-16T22:23:56.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.006+0000 7fa636490700 1 -- 172.21.15.134:0/3441997194 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa63004bf40 con 0x7fa61806d900 2024-02-16T22:23:56.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.007+0000 7fa62cff9700 1 -- 172.21.15.134:0/3441997194 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fa63004bf40 con 0x7fa61806d900 2024-02-16T22:23:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.009+0000 7fa636490700 1 -- 172.21.15.134:0/3441997194 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa61806d900 msgr2=0x7fa61806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.009+0000 7fa636490700 1 --2- 172.21.15.134:0/3441997194 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa61806d900 0x7fa61806fdb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa63010ec80 tx=0x7fa624009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.009+0000 7fa636490700 1 -- 172.21.15.134:0/3441997194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa630102f50 msgr2=0x7fa630113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.009+0000 7fa636490700 1 --2- 172.21.15.134:0/3441997194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa630102f50 0x7fa630113a90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa620002a50 tx=0x7fa6200046b0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.009+0000 7fa636490700 1 -- 172.21.15.134:0/3441997194 shutdown_connections 2024-02-16T22:23:56.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.009+0000 7fa636490700 1 --2- 172.21.15.134:0/3441997194 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa61806d900 0x7fa61806fdb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.009+0000 7fa636490700 1 --2- 172.21.15.134:0/3441997194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa630102f50 0x7fa630113a90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.009+0000 7fa636490700 1 --2- 172.21.15.134:0/3441997194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6301038f0 0x7fa630113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.009+0000 7fa636490700 1 -- 172.21.15.134:0/3441997194 >> 172.21.15.134:0/3441997194 conn(0x7fa6300f8ae0 msgr2=0x7fa6300fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.009+0000 7fa636490700 1 -- 172.21.15.134:0/3441997194 shutdown_connections 2024-02-16T22:23:56.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.009+0000 7fa636490700 1 -- 172.21.15.134:0/3441997194 wait complete. 2024-02-16T22:23:56.021 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:23:56.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.111+0000 7f9ec65e3700 1 -- 172.21.15.134:0/1684786314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ec01016b0 msgr2=0x7f9ec0101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:56.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.111+0000 7f9ec65e3700 1 --2- 172.21.15.134:0/1684786314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ec01016b0 0x7f9ec0101a80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0004940 tx=0x7f9eb0009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:56.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.111+0000 7f9ec65e3700 1 -- 172.21.15.134:0/1684786314 shutdown_connections 2024-02-16T22:23:56.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.111+0000 7f9ec65e3700 1 --2- 172.21.15.134:0/1684786314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec00fb6c0 0x7f9ec00fbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.111+0000 7f9ec65e3700 1 --2- 172.21.15.134:0/1684786314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ec01016b0 0x7f9ec0101a80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.111+0000 7f9ec65e3700 1 -- 172.21.15.134:0/1684786314 >> 172.21.15.134:0/1684786314 conn(0x7f9ec0071560 msgr2=0x7f9ec0071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:56.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.112+0000 7f9ec65e3700 1 -- 172.21.15.134:0/1684786314 shutdown_connections 2024-02-16T22:23:56.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.112+0000 7f9ec65e3700 1 -- 172.21.15.134:0/1684786314 wait complete. 2024-02-16T22:23:56.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.112+0000 7f9ec65e3700 1 Processor -- start 2024-02-16T22:23:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ec65e3700 1 -- start start 2024-02-16T22:23:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ec65e3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec00fb6c0 0x7f9ec010eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ec65e3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ec01016b0 0x7f9ec010f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ec65e3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec010f5e0 con 0x7f9ec01016b0 2024-02-16T22:23:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ec65e3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec010f720 con 0x7f9ec00fb6c0 2024-02-16T22:23:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ebf7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ec01016b0 0x7f9ec010f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ebffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec00fb6c0 0x7f9ec010eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ebf7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ec01016b0 0x7f9ec010f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42792/0 (socket says 172.21.15.134:42792) 2024-02-16T22:23:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ebf7fe700 1 -- 172.21.15.134:0/184942343 learned_addr learned my addr 172.21.15.134:0/184942343 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ebffff700 1 -- 172.21.15.134:0/184942343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec00fb6c0 msgr2=0x7f9ec010eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-16T22:23:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ebffff700 1 -- 172.21.15.134:0/184942343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec00fb6c0 msgr2=0x7f9ec010eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-16T22:23:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ebffff700 1 --2- 172.21.15.134:0/184942343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec00fb6c0 0x7f9ec010eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-16T22:23:56.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ebffff700 1 --2- 172.21.15.134:0/184942343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec00fb6c0 0x7f9ec010eb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T22:23:56.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ebf7fe700 1 -- 172.21.15.134:0/184942343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec00fb6c0 msgr2=0x7f9ec010eb10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-16T22:23:56.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ebf7fe700 1 --2- 172.21.15.134:0/184942343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec00fb6c0 0x7f9ec010eb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ebf7fe700 1 -- 172.21.15.134:0/184942343 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb0005040 con 0x7f9ec01016b0 2024-02-16T22:23:56.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.113+0000 7f9ebf7fe700 1 --2- 172.21.15.134:0/184942343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ec01016b0 0x7f9ec010f050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40041d0 tx=0x7f9eb40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:56.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.114+0000 7f9ebcff9700 1 -- 172.21.15.134:0/184942343 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb4007cc0 con 0x7f9ec01016b0 2024-02-16T22:23:56.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.114+0000 7f9ebcff9700 1 -- 172.21.15.134:0/184942343 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9eb400f040 con 0x7f9ec01016b0 2024-02-16T22:23:56.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.114+0000 7f9ec65e3700 1 -- 172.21.15.134:0/184942343 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec0117a80 con 0x7f9ec01016b0 2024-02-16T22:23:56.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.114+0000 7f9ebcff9700 1 -- 172.21.15.134:0/184942343 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb400dbe0 con 0x7f9ec01016b0 2024-02-16T22:23:56.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.114+0000 7f9ec65e3700 1 -- 172.21.15.134:0/184942343 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec0117f90 con 0x7f9ec01016b0 2024-02-16T22:23:56.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.115+0000 7f9ec65e3700 1 -- 172.21.15.134:0/184942343 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec0103b30 con 0x7f9ec01016b0 2024-02-16T22:23:56.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.115+0000 7f9ebcff9700 1 -- 172.21.15.134:0/184942343 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f9eb400dd40 con 0x7f9ec01016b0 2024-02-16T22:23:56.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.115+0000 7f9ebcff9700 1 --2- 172.21.15.134:0/184942343 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9ea806d900 0x7f9ea806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:56.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.116+0000 7f9ebcff9700 1 -- 172.21.15.134:0/184942343 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f9eb408c910 con 0x7f9ec01016b0 2024-02-16T22:23:56.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.116+0000 7f9ebffff700 1 --2- 172.21.15.134:0/184942343 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9ea806d900 0x7f9ea806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:56.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.116+0000 7f9ebffff700 1 --2- 172.21.15.134:0/184942343 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9ea806d900 0x7f9ea806fdb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0004560 tx=0x7f9eb0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:56.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.120+0000 7f9ebcff9700 1 -- 172.21.15.134:0/184942343 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9eb4055fa0 con 0x7f9ec01016b0 2024-02-16T22:23:56.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.334+0000 7f9ec65e3700 1 -- 172.21.15.134:0/184942343 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ec0106c30 con 0x7f9ea806d900 2024-02-16T22:23:56.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.335+0000 7f9ebcff9700 1 -- 172.21.15.134:0/184942343 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f9ec0106c30 con 0x7f9ea806d900 2024-02-16T22:23:56.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.337+0000 7f9ec65e3700 1 -- 172.21.15.134:0/184942343 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9ea806d900 msgr2=0x7f9ea806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:56.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.337+0000 7f9ec65e3700 1 --2- 172.21.15.134:0/184942343 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9ea806d900 0x7f9ea806fdb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0004560 tx=0x7f9eb0009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:56.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.337+0000 7f9ec65e3700 1 -- 172.21.15.134:0/184942343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ec01016b0 msgr2=0x7f9ec010f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:56.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.337+0000 7f9ec65e3700 1 --2- 172.21.15.134:0/184942343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ec01016b0 0x7f9ec010f050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40041d0 tx=0x7f9eb40046b0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.337+0000 7f9ec65e3700 1 -- 172.21.15.134:0/184942343 shutdown_connections 2024-02-16T22:23:56.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.337+0000 7f9ec65e3700 1 --2- 172.21.15.134:0/184942343 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9ea806d900 0x7f9ea806fdb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.337+0000 7f9ec65e3700 1 --2- 172.21.15.134:0/184942343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec00fb6c0 0x7f9ec010eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.337+0000 7f9ec65e3700 1 --2- 172.21.15.134:0/184942343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ec01016b0 0x7f9ec010f050 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.337+0000 7f9ec65e3700 1 -- 172.21.15.134:0/184942343 >> 172.21.15.134:0/184942343 conn(0x7f9ec0071560 msgr2=0x7f9ec00fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:56.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.338+0000 7f9ec65e3700 1 -- 172.21.15.134:0/184942343 shutdown_connections 2024-02-16T22:23:56.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.338+0000 7f9ec65e3700 1 -- 172.21.15.134:0/184942343 wait complete. 2024-02-16T22:23:56.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.440+0000 7f7e56041700 1 -- 172.21.15.134:0/3844930827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e50103140 msgr2=0x7f7e50103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:56.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.440+0000 7f7e56041700 1 --2- 172.21.15.134:0/3844930827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e50103140 0x7f7e50103510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7e40004940 tx=0x7f7e40009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:56.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.440+0000 7f7e56041700 1 -- 172.21.15.134:0/3844930827 shutdown_connections 2024-02-16T22:23:56.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.440+0000 7f7e56041700 1 --2- 172.21.15.134:0/3844930827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e500fb570 0x7f7e500fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.440+0000 7f7e56041700 1 --2- 172.21.15.134:0/3844930827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e50103140 0x7f7e50103510 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.440+0000 7f7e56041700 1 -- 172.21.15.134:0/3844930827 >> 172.21.15.134:0/3844930827 conn(0x7f7e50071560 msgr2=0x7f7e50071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:56.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.440+0000 7f7e56041700 1 -- 172.21.15.134:0/3844930827 shutdown_connections 2024-02-16T22:23:56.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.441+0000 7f7e56041700 1 -- 172.21.15.134:0/3844930827 wait complete. 2024-02-16T22:23:56.443 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:56 smithi134 ceph-mon[112514]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:56.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.441+0000 7f7e56041700 1 Processor -- start 2024-02-16T22:23:56.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.441+0000 7f7e56041700 1 -- start start 2024-02-16T22:23:56.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e56041700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e500fb570 0x7f7e50113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:56.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e56041700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e50103140 0x7f7e50114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:56.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e56041700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e501146a0 con 0x7f7e50103140 2024-02-16T22:23:56.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e56041700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5010d9d0 con 0x7f7e500fb570 2024-02-16T22:23:56.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e4f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e500fb570 0x7f7e50113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:56.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e4effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e50103140 0x7f7e50114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e4f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e500fb570 0x7f7e50113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.134:38534/0 (socket says 172.21.15.134:38534) 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e4effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e50103140 0x7f7e50114050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42820/0 (socket says 172.21.15.134:42820) 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e4f7fe700 1 -- 172.21.15.134:0/2614349478 learned_addr learned my addr 172.21.15.134:0/2614349478 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e4f7fe700 1 -- 172.21.15.134:0/2614349478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e500fb570 msgr2=0x7f7e50113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e4f7fe700 1 -- 172.21.15.134:0/2614349478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e500fb570 msgr2=0x7f7e50113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e4f7fe700 1 --2- 172.21.15.134:0/2614349478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e500fb570 0x7f7e50113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e4f7fe700 1 --2- 172.21.15.134:0/2614349478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e500fb570 0x7f7e50113b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e4effd700 1 -- 172.21.15.134:0/2614349478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e500fb570 msgr2=0x7f7e50113b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e4effd700 1 --2- 172.21.15.134:0/2614349478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e500fb570 0x7f7e50113b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e4effd700 1 -- 172.21.15.134:0/2614349478 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e40005040 con 0x7f7e50103140 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.442+0000 7f7e4effd700 1 --2- 172.21.15.134:0/2614349478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e50103140 0x7f7e50114050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7e44002820 tx=0x7f7e44004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.443+0000 7f7e37fff700 1 -- 172.21.15.134:0/2614349478 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e44007cc0 con 0x7f7e50103140 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.443+0000 7f7e56041700 1 -- 172.21.15.134:0/2614349478 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5010dcb0 con 0x7f7e50103140 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.443+0000 7f7e37fff700 1 -- 172.21.15.134:0/2614349478 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e4400f040 con 0x7f7e50103140 2024-02-16T22:23:56.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.443+0000 7f7e37fff700 1 -- 172.21.15.134:0/2614349478 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e440094b0 con 0x7f7e50103140 2024-02-16T22:23:56.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.443+0000 7f7e56041700 1 -- 172.21.15.134:0/2614349478 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5010e1f0 con 0x7f7e50103140 2024-02-16T22:23:56.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.444+0000 7f7e56041700 1 -- 172.21.15.134:0/2614349478 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e50100310 con 0x7f7e50103140 2024-02-16T22:23:56.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.444+0000 7f7e37fff700 1 -- 172.21.15.134:0/2614349478 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f7e44009770 con 0x7f7e50103140 2024-02-16T22:23:56.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.444+0000 7f7e37fff700 1 --2- 172.21.15.134:0/2614349478 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f7e3806d900 0x7f7e3806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:56.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.445+0000 7f7e37fff700 1 -- 172.21.15.134:0/2614349478 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7e4408cea0 con 0x7f7e50103140 2024-02-16T22:23:56.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.445+0000 7f7e4f7fe700 1 --2- 172.21.15.134:0/2614349478 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f7e3806d900 0x7f7e3806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:56.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.445+0000 7f7e4f7fe700 1 --2- 172.21.15.134:0/2614349478 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f7e3806d900 0x7f7e3806fdb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009fd0 tx=0x7f7e40009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:56.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.449+0000 7f7e37fff700 1 -- 172.21.15.134:0/2614349478 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7e4405a050 con 0x7f7e50103140 2024-02-16T22:23:56.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.653+0000 7f7e56041700 1 -- 172.21.15.134:0/2614349478 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e5010a1b0 con 0x7f7e3806d900 2024-02-16T22:23:56.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.663+0000 7f7e37fff700 1 -- 172.21.15.134:0/2614349478 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7e5010a1b0 con 0x7f7e3806d900 2024-02-16T22:23:56.665 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:23:56.665 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (105s) 14s ago 12m 17.4M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:23:56.665 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (13m) 14s ago 13m 6660k - 17.2.7-513-gb88fae66 870a0944ccb8 a0d53bc0a925 2024-02-16T22:23:56.665 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (11m) 0s ago 11m 6669k - 17.2.7-513-gb88fae66 870a0944ccb8 a8d69537e08a 2024-02-16T22:23:56.665 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (88s) 14s ago 12m 84.9M - 9.4.12 a0ea5e3c46d9 29d29cf667e7 2024-02-16T22:23:56.665 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (7m) 14s ago 7m 13.5M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:23:56.665 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (7m) 14s ago 7m 125M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (7m) 0s ago 7m 16.7M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (7m) 0s ago 7m 118M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (3m) 14s ago 14m 472M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (2m) 0s ago 11m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (28s) 14s ago 14m 28.0M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2903b3988442 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (3s) 0s ago 11m 28.8M 2048M 19.0.0-1450-gf78a58c0 f081f847070a dd7cf2f31226 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (2m) 14s ago 13m 16.4M - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (2m) 0s ago 11m 14.9M - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (11m) 14s ago 11m 219M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 099f0b29d202 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (10m) 14s ago 10m 232M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (10m) 14s ago 10m 190M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (9m) 0s ago 9m 266M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (9m) 0s ago 9m 237M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (8m) 0s ago 8m 231M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:23:56.666 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (2m) 14s ago 12m 57.2M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:23:56.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.665+0000 7f7e56041700 1 -- 172.21.15.134:0/2614349478 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f7e3806d900 msgr2=0x7f7e3806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:56.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.665+0000 7f7e56041700 1 --2- 172.21.15.134:0/2614349478 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f7e3806d900 0x7f7e3806fdb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009fd0 tx=0x7f7e40009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:56.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.665+0000 7f7e56041700 1 -- 172.21.15.134:0/2614349478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e50103140 msgr2=0x7f7e50114050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:56.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.665+0000 7f7e56041700 1 --2- 172.21.15.134:0/2614349478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e50103140 0x7f7e50114050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7e44002820 tx=0x7f7e44004570 comp rx=0 tx=0).stop 2024-02-16T22:23:56.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.665+0000 7f7e56041700 1 -- 172.21.15.134:0/2614349478 shutdown_connections 2024-02-16T22:23:56.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.665+0000 7f7e56041700 1 --2- 172.21.15.134:0/2614349478 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f7e3806d900 0x7f7e3806fdb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.665+0000 7f7e56041700 1 --2- 172.21.15.134:0/2614349478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e500fb570 0x7f7e50113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.665+0000 7f7e56041700 1 --2- 172.21.15.134:0/2614349478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e50103140 0x7f7e50114050 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.665+0000 7f7e56041700 1 -- 172.21.15.134:0/2614349478 >> 172.21.15.134:0/2614349478 conn(0x7f7e50071560 msgr2=0x7f7e500fa5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:56.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.666+0000 7f7e56041700 1 -- 172.21.15.134:0/2614349478 shutdown_connections 2024-02-16T22:23:56.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.666+0000 7f7e56041700 1 -- 172.21.15.134:0/2614349478 wait complete. 2024-02-16T22:23:56.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:56 smithi173 ceph-mon[83703]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:56.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.765+0000 7f95fdca6700 1 -- 172.21.15.134:0/417690081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f8102880 msgr2=0x7f95f80fc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:56.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.765+0000 7f95fdca6700 1 --2- 172.21.15.134:0/417690081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f8102880 0x7f95f80fc680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f95e8004940 tx=0x7f95e8009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:56.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.765+0000 7f95fdca6700 1 -- 172.21.15.134:0/417690081 shutdown_connections 2024-02-16T22:23:56.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.765+0000 7f95fdca6700 1 --2- 172.21.15.134:0/417690081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f8102880 0x7f95f80fc680 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.765+0000 7f95fdca6700 1 --2- 172.21.15.134:0/417690081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f8101ee0 0x7f95f81022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.765+0000 7f95fdca6700 1 -- 172.21.15.134:0/417690081 >> 172.21.15.134:0/417690081 conn(0x7f95f8071560 msgr2=0x7f95f8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:56.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.765+0000 7f95fdca6700 1 -- 172.21.15.134:0/417690081 shutdown_connections 2024-02-16T22:23:56.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.765+0000 7f95fdca6700 1 -- 172.21.15.134:0/417690081 wait complete. 2024-02-16T22:23:56.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.766+0000 7f95fdca6700 1 Processor -- start 2024-02-16T22:23:56.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.766+0000 7f95fdca6700 1 -- start start 2024-02-16T22:23:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.766+0000 7f95fdca6700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f8101ee0 0x7f95f81129f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.766+0000 7f95fdca6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f8102880 0x7f95f8112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.766+0000 7f95fdca6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8113580 con 0x7f95f8102880 2024-02-16T22:23:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.766+0000 7f95fdca6700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f810c8b0 con 0x7f95f8101ee0 2024-02-16T22:23:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.766+0000 7f95f6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f8102880 0x7f95f8112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.766+0000 7f95f6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f8102880 0x7f95f8112f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42830/0 (socket says 172.21.15.134:42830) 2024-02-16T22:23:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.766+0000 7f95f6ffd700 1 -- 172.21.15.134:0/1499035060 learned_addr learned my addr 172.21.15.134:0/1499035060 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.766+0000 7f95f77fe700 1 --2- 172.21.15.134:0/1499035060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f8101ee0 0x7f95f81129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.767+0000 7f95f77fe700 1 -- 172.21.15.134:0/1499035060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f8101ee0 msgr2=0x7f95f81129f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-16T22:23:56.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.767+0000 7f95f77fe700 1 -- 172.21.15.134:0/1499035060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f8101ee0 msgr2=0x7f95f81129f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-16T22:23:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.767+0000 7f95f77fe700 1 --2- 172.21.15.134:0/1499035060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f8101ee0 0x7f95f81129f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-16T22:23:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.767+0000 7f95f77fe700 1 --2- 172.21.15.134:0/1499035060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f8101ee0 0x7f95f81129f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T22:23:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.767+0000 7f95f6ffd700 1 -- 172.21.15.134:0/1499035060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f8101ee0 msgr2=0x7f95f81129f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-16T22:23:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.767+0000 7f95f6ffd700 1 --2- 172.21.15.134:0/1499035060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f8101ee0 0x7f95f81129f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.767+0000 7f95f6ffd700 1 -- 172.21.15.134:0/1499035060 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e8005040 con 0x7f95f8102880 2024-02-16T22:23:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.767+0000 7f95f6ffd700 1 --2- 172.21.15.134:0/1499035060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f8102880 0x7f95f8112f30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009150 tx=0x7f95e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.767+0000 7f95dffff700 1 -- 172.21.15.134:0/1499035060 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95e800e040 con 0x7f95f8102880 2024-02-16T22:23:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.767+0000 7f95dffff700 1 -- 172.21.15.134:0/1499035060 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f95e800bbf0 con 0x7f95f8102880 2024-02-16T22:23:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.767+0000 7f95fdca6700 1 -- 172.21.15.134:0/1499035060 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f810cb30 con 0x7f95f8102880 2024-02-16T22:23:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.767+0000 7f95dffff700 1 -- 172.21.15.134:0/1499035060 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95e801c630 con 0x7f95f8102880 2024-02-16T22:23:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.767+0000 7f95fdca6700 1 -- 172.21.15.134:0/1499035060 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f810d070 con 0x7f95f8102880 2024-02-16T22:23:56.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.768+0000 7f95fdca6700 1 -- 172.21.15.134:0/1499035060 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f81043b0 con 0x7f95f8102880 2024-02-16T22:23:56.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.768+0000 7f95dffff700 1 -- 172.21.15.134:0/1499035060 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f95e800bd60 con 0x7f95f8102880 2024-02-16T22:23:56.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.769+0000 7f95dffff700 1 --2- 172.21.15.134:0/1499035060 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f95e006d900 0x7f95e006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:56.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.769+0000 7f95dffff700 1 -- 172.21.15.134:0/1499035060 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f95e808e500 con 0x7f95f8102880 2024-02-16T22:23:56.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.769+0000 7f95f77fe700 1 --2- 172.21.15.134:0/1499035060 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f95e006d900 0x7f95e006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:56.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.769+0000 7f95f77fe700 1 --2- 172.21.15.134:0/1499035060 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f95e006d900 0x7f95e006fdb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009c30 tx=0x7f95f000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:56.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:56.774+0000 7f95dffff700 1 -- 172.21.15.134:0/1499035060 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f95e805b730 con 0x7f95f8102880 2024-02-16T22:23:57.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.053+0000 7f95fdca6700 1 -- 172.21.15.134:0/1499035060 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f95f8108fc0 con 0x7f95f8102880 2024-02-16T22:23:57.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.053+0000 7f95dffff700 1 -- 172.21.15.134:0/1499035060 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f95e805b2c0 con 0x7f95f8102880 2024-02-16T22:23:57.055 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:23:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:23:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:23:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:23:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:23:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:23:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:23:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:23:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 6 2024-02-16T22:23:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:23:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:23:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:23:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:23:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:23:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 10, 2024-02-16T22:23:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-16T22:23:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:23:57.057 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:23:57.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.056+0000 7f95fdca6700 1 -- 172.21.15.134:0/1499035060 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f95e006d900 msgr2=0x7f95e006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:57.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.056+0000 7f95fdca6700 1 --2- 172.21.15.134:0/1499035060 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f95e006d900 0x7f95e006fdb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009c30 tx=0x7f95f000b040 comp rx=0 tx=0).stop 2024-02-16T22:23:57.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.056+0000 7f95fdca6700 1 -- 172.21.15.134:0/1499035060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f8102880 msgr2=0x7f95f8112f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:57.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.056+0000 7f95fdca6700 1 --2- 172.21.15.134:0/1499035060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f8102880 0x7f95f8112f30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009150 tx=0x7f95e8009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:57.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.056+0000 7f95fdca6700 1 -- 172.21.15.134:0/1499035060 shutdown_connections 2024-02-16T22:23:57.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.056+0000 7f95fdca6700 1 --2- 172.21.15.134:0/1499035060 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f95e006d900 0x7f95e006fdb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.056+0000 7f95fdca6700 1 --2- 172.21.15.134:0/1499035060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f8101ee0 0x7f95f81129f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.056+0000 7f95fdca6700 1 --2- 172.21.15.134:0/1499035060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f8102880 0x7f95f8112f30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.056+0000 7f95fdca6700 1 -- 172.21.15.134:0/1499035060 >> 172.21.15.134:0/1499035060 conn(0x7f95f8071560 msgr2=0x7f95f80fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:57.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.057+0000 7f95fdca6700 1 -- 172.21.15.134:0/1499035060 shutdown_connections 2024-02-16T22:23:57.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.057+0000 7f95fdca6700 1 -- 172.21.15.134:0/1499035060 wait complete. 2024-02-16T22:23:57.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.157+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2565338216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5e0101e60 msgr2=0x7fd5e0102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.157+0000 7fd5e79ac700 1 --2- 172.21.15.134:0/2565338216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5e0101e60 0x7fd5e0102230 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc004940 tx=0x7fd5dc009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2565338216 shutdown_connections 2024-02-16T22:23:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e79ac700 1 --2- 172.21.15.134:0/2565338216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0102800 0x7fd5e00fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e79ac700 1 --2- 172.21.15.134:0/2565338216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5e0101e60 0x7fd5e0102230 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2565338216 >> 172.21.15.134:0/2565338216 conn(0x7fd5e00f7a10 msgr2=0x7fd5e00f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2565338216 shutdown_connections 2024-02-16T22:23:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2565338216 wait complete. 2024-02-16T22:23:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e79ac700 1 Processor -- start 2024-02-16T22:23:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e79ac700 1 -- start start 2024-02-16T22:23:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e79ac700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0101e60 0x7fd5e010ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e79ac700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5e0102800 0x7fd5e010f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e79ac700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e010f6a0 con 0x7fd5e0102800 2024-02-16T22:23:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e79ac700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e010f810 con 0x7fd5e0101e60 2024-02-16T22:23:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e4f47700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5e0102800 0x7fd5e010f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e4f47700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5e0102800 0x7fd5e010f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42844/0 (socket says 172.21.15.134:42844) 2024-02-16T22:23:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.158+0000 7fd5e4f47700 1 -- 172.21.15.134:0/2952090130 learned_addr learned my addr 172.21.15.134:0/2952090130 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.159+0000 7fd5e5748700 1 --2- 172.21.15.134:0/2952090130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0101e60 0x7fd5e010ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.159+0000 7fd5e5748700 1 -- 172.21.15.134:0/2952090130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0101e60 msgr2=0x7fd5e010ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-16T22:23:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.159+0000 7fd5e5748700 1 -- 172.21.15.134:0/2952090130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0101e60 msgr2=0x7fd5e010ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-16T22:23:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.159+0000 7fd5e5748700 1 --2- 172.21.15.134:0/2952090130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0101e60 0x7fd5e010ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-16T22:23:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.159+0000 7fd5e5748700 1 --2- 172.21.15.134:0/2952090130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0101e60 0x7fd5e010ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T22:23:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.159+0000 7fd5e4f47700 1 -- 172.21.15.134:0/2952090130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0101e60 msgr2=0x7fd5e010ebb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-16T22:23:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.159+0000 7fd5e4f47700 1 --2- 172.21.15.134:0/2952090130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0101e60 0x7fd5e010ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.159+0000 7fd5e4f47700 1 -- 172.21.15.134:0/2952090130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc005040 con 0x7fd5e0102800 2024-02-16T22:23:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.159+0000 7fd5e4f47700 1 --2- 172.21.15.134:0/2952090130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5e0102800 0x7fd5e010f0f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0002a50 tx=0x7fd5d0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:57.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.159+0000 7fd5d5ffb700 1 -- 172.21.15.134:0/2952090130 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5d0007cc0 con 0x7fd5e0102800 2024-02-16T22:23:57.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.159+0000 7fd5d5ffb700 1 -- 172.21.15.134:0/2952090130 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5d000f040 con 0x7fd5e0102800 2024-02-16T22:23:57.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.159+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2952090130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e0117b80 con 0x7fd5e0102800 2024-02-16T22:23:57.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.159+0000 7fd5d5ffb700 1 -- 172.21.15.134:0/2952090130 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5d000da40 con 0x7fd5e0102800 2024-02-16T22:23:57.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.159+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2952090130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e0118090 con 0x7fd5e0102800 2024-02-16T22:23:57.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.160+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2952090130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e00ff170 con 0x7fd5e0102800 2024-02-16T22:23:57.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.161+0000 7fd5d5ffb700 1 -- 172.21.15.134:0/2952090130 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fd5d00097c0 con 0x7fd5e0102800 2024-02-16T22:23:57.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.161+0000 7fd5d5ffb700 1 --2- 172.21.15.134:0/2952090130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd5cc06d900 0x7fd5cc06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:57.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.161+0000 7fd5d5ffb700 1 -- 172.21.15.134:0/2952090130 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd5d008cef0 con 0x7fd5e0102800 2024-02-16T22:23:57.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.161+0000 7fd5e5748700 1 --2- 172.21.15.134:0/2952090130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd5cc06d900 0x7fd5cc06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:57.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.161+0000 7fd5e5748700 1 --2- 172.21.15.134:0/2952090130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd5cc06d900 0x7fd5cc06fdb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc004560 tx=0x7fd5dc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:57.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.166+0000 7fd5d5ffb700 1 -- 172.21.15.134:0/2952090130 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd5d005a0a0 con 0x7fd5e0102800 2024-02-16T22:23:57.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.403+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2952090130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd5e00fb610 con 0x7fd5e0102800 2024-02-16T22:23:57.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.404+0000 7fd5d5ffb700 1 -- 172.21.15.134:0/2952090130 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1860 (secure 0 0 0) 0x7fd5d0059c30 con 0x7fd5e0102800 2024-02-16T22:23:57.406 INFO:teuthology.orchestra.run.smithi134.stdout:e20 2024-02-16T22:23:57.406 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:23:57.406 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:23:57.406 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-02-16T22:23:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:23:57.406 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-02-16T22:23:57.406 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-02-16T22:23:57.406 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 20 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-02-16T22:23:22.543229+0000 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 2 2024-02-16T22:23:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:in 0,1 2024-02-16T22:23:57.408 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14478,1=24269} 2024-02-16T22:23:57.408 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-02-16T22:23:57.408 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-02-16T22:23:57.408 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-02-16T22:23:57.408 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-02-16T22:23:57.408 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-02-16T22:23:57.408 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-02-16T22:23:57.408 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-02-16T22:23:57.408 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-02-16T22:23:57.408 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-02-16T22:23:57.408 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.jyajef{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:57.408 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.qljqef{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:23:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:23:57.409 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-02-16T22:23:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:23:57.409 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.cygfxr{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2804816044,v1:172.21.15.134:6827/2804816044] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:57.409 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.phstvm{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:23:57.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.406+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2952090130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd5cc06d900 msgr2=0x7fd5cc06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:57.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.406+0000 7fd5e79ac700 1 --2- 172.21.15.134:0/2952090130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd5cc06d900 0x7fd5cc06fdb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc004560 tx=0x7fd5dc009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:57.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.406+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2952090130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5e0102800 msgr2=0x7fd5e010f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:57.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.406+0000 7fd5e79ac700 1 --2- 172.21.15.134:0/2952090130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5e0102800 0x7fd5e010f0f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0002a50 tx=0x7fd5d0004600 comp rx=0 tx=0).stop 2024-02-16T22:23:57.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.406+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2952090130 shutdown_connections 2024-02-16T22:23:57.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.406+0000 7fd5e79ac700 1 --2- 172.21.15.134:0/2952090130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd5cc06d900 0x7fd5cc06fdb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.406+0000 7fd5e79ac700 1 --2- 172.21.15.134:0/2952090130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0101e60 0x7fd5e010ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.406+0000 7fd5e79ac700 1 --2- 172.21.15.134:0/2952090130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5e0102800 0x7fd5e010f0f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.406+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2952090130 >> 172.21.15.134:0/2952090130 conn(0x7fd5e00f7a10 msgr2=0x7fd5e00f9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:57.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.406+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2952090130 shutdown_connections 2024-02-16T22:23:57.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.406+0000 7fd5e79ac700 1 -- 172.21.15.134:0/2952090130 wait complete. 2024-02-16T22:23:57.410 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 20 2024-02-16T22:23:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.507+0000 7f62f0410700 1 -- 172.21.15.134:0/2575789481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e8102f50 msgr2=0x7f62e8103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.507+0000 7f62f0410700 1 --2- 172.21.15.134:0/2575789481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e8102f50 0x7f62e8103320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f62e4004940 tx=0x7f62e4009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.507+0000 7f62f0410700 1 -- 172.21.15.134:0/2575789481 shutdown_connections 2024-02-16T22:23:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.507+0000 7f62f0410700 1 --2- 172.21.15.134:0/2575789481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e81038f0 0x7f62e80fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.507+0000 7f62f0410700 1 --2- 172.21.15.134:0/2575789481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e8102f50 0x7f62e8103320 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.507+0000 7f62f0410700 1 -- 172.21.15.134:0/2575789481 >> 172.21.15.134:0/2575789481 conn(0x7f62e80f8ae0 msgr2=0x7f62e80faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.508+0000 7f62f0410700 1 -- 172.21.15.134:0/2575789481 shutdown_connections 2024-02-16T22:23:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.508+0000 7f62f0410700 1 -- 172.21.15.134:0/2575789481 wait complete. 2024-02-16T22:23:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.508+0000 7f62f0410700 1 Processor -- start 2024-02-16T22:23:57.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.508+0000 7f62f0410700 1 -- start start 2024-02-16T22:23:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.508+0000 7f62f0410700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e8102f50 0x7f62e8113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.508+0000 7f62f0410700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e81038f0 0x7f62e8113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.508+0000 7f62f0410700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e81145f0 con 0x7f62e81038f0 2024-02-16T22:23:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.508+0000 7f62f0410700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e810d920 con 0x7f62e8102f50 2024-02-16T22:23:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.508+0000 7f62ed9ab700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e81038f0 0x7f62e8113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.508+0000 7f62ed9ab700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e81038f0 0x7f62e8113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42858/0 (socket says 172.21.15.134:42858) 2024-02-16T22:23:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.508+0000 7f62ed9ab700 1 -- 172.21.15.134:0/400230344 learned_addr learned my addr 172.21.15.134:0/400230344 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.508+0000 7f62ee1ac700 1 --2- 172.21.15.134:0/400230344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e8102f50 0x7f62e8113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.509+0000 7f62ee1ac700 1 -- 172.21.15.134:0/400230344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e8102f50 msgr2=0x7f62e8113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-16T22:23:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.509+0000 7f62ee1ac700 1 -- 172.21.15.134:0/400230344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e8102f50 msgr2=0x7f62e8113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-16T22:23:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.509+0000 7f62ee1ac700 1 --2- 172.21.15.134:0/400230344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e8102f50 0x7f62e8113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-16T22:23:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.509+0000 7f62ee1ac700 1 --2- 172.21.15.134:0/400230344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e8102f50 0x7f62e8113a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T22:23:57.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.509+0000 7f62ed9ab700 1 -- 172.21.15.134:0/400230344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e8102f50 msgr2=0x7f62e8113a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-16T22:23:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.509+0000 7f62ed9ab700 1 --2- 172.21.15.134:0/400230344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e8102f50 0x7f62e8113a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.509+0000 7f62ed9ab700 1 -- 172.21.15.134:0/400230344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e4005040 con 0x7f62e81038f0 2024-02-16T22:23:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.509+0000 7f62ed9ab700 1 --2- 172.21.15.134:0/400230344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e81038f0 0x7f62e8113fa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62d8002a50 tx=0x7f62d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.509+0000 7f62deffd700 1 -- 172.21.15.134:0/400230344 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62d8007cc0 con 0x7f62e81038f0 2024-02-16T22:23:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.509+0000 7f62deffd700 1 -- 172.21.15.134:0/400230344 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62d800f040 con 0x7f62e81038f0 2024-02-16T22:23:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.509+0000 7f62f0410700 1 -- 172.21.15.134:0/400230344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e810dc00 con 0x7f62e81038f0 2024-02-16T22:23:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.509+0000 7f62deffd700 1 -- 172.21.15.134:0/400230344 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62d800da40 con 0x7f62e81038f0 2024-02-16T22:23:57.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.509+0000 7f62f0410700 1 -- 172.21.15.134:0/400230344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e810e140 con 0x7f62e81038f0 2024-02-16T22:23:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.510+0000 7f62f0410700 1 -- 172.21.15.134:0/400230344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e8100260 con 0x7f62e81038f0 2024-02-16T22:23:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.511+0000 7f62deffd700 1 -- 172.21.15.134:0/400230344 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f62d80097c0 con 0x7f62e81038f0 2024-02-16T22:23:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.511+0000 7f62deffd700 1 --2- 172.21.15.134:0/400230344 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f62d406d900 0x7f62d406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.511+0000 7f62deffd700 1 -- 172.21.15.134:0/400230344 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f62d808cef0 con 0x7f62e81038f0 2024-02-16T22:23:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.511+0000 7f62ee1ac700 1 --2- 172.21.15.134:0/400230344 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f62d406d900 0x7f62d406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:57.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.512+0000 7f62ee1ac700 1 --2- 172.21.15.134:0/400230344 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f62d406d900 0x7f62d406fdb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f62e4004560 tx=0x7f62e4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:57.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.516+0000 7f62deffd700 1 -- 172.21.15.134:0/400230344 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f62d8059e10 con 0x7f62e81038f0 2024-02-16T22:23:57.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:57 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:57.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:57 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:57.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:57 smithi134 ceph-mon[112514]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:57.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:57 smithi134 ceph-mon[112514]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:57.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:57 smithi134 ceph-mon[112514]: pgmap v13: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:57.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:57 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1499035060' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:23:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:57 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:57 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:57 smithi173 ceph-mon[83703]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:57 smithi173 ceph-mon[83703]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:57 smithi173 ceph-mon[83703]: pgmap v13: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:57 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1499035060' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:23:57.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.730+0000 7f62f0410700 1 -- 172.21.15.134:0/400230344 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62e8113730 con 0x7f62d406d900 2024-02-16T22:23:57.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.731+0000 7f62deffd700 1 -- 172.21.15.134:0/400230344 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f62e8113730 con 0x7f62d406d900 2024-02-16T22:23:57.733 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:23:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:23:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:23:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-16T22:23:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-02-16T22:23:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-02-16T22:23:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-02-16T22:23:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-02-16T22:23:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "4/21 daemons upgraded", 2024-02-16T22:23:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mon daemons", 2024-02-16T22:23:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:23:57.734 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:23:57.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.733+0000 7f62f0410700 1 -- 172.21.15.134:0/400230344 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f62d406d900 msgr2=0x7f62d406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:57.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.733+0000 7f62f0410700 1 --2- 172.21.15.134:0/400230344 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f62d406d900 0x7f62d406fdb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f62e4004560 tx=0x7f62e4009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:57.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.733+0000 7f62f0410700 1 -- 172.21.15.134:0/400230344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e81038f0 msgr2=0x7f62e8113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:57.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.733+0000 7f62f0410700 1 --2- 172.21.15.134:0/400230344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e81038f0 0x7f62e8113fa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62d8002a50 tx=0x7f62d8004600 comp rx=0 tx=0).stop 2024-02-16T22:23:57.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.733+0000 7f62f0410700 1 -- 172.21.15.134:0/400230344 shutdown_connections 2024-02-16T22:23:57.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.733+0000 7f62f0410700 1 --2- 172.21.15.134:0/400230344 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f62d406d900 0x7f62d406fdb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.733+0000 7f62f0410700 1 --2- 172.21.15.134:0/400230344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e8102f50 0x7f62e8113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.733+0000 7f62f0410700 1 --2- 172.21.15.134:0/400230344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e81038f0 0x7f62e8113fa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.733+0000 7f62f0410700 1 -- 172.21.15.134:0/400230344 >> 172.21.15.134:0/400230344 conn(0x7f62e80f8ae0 msgr2=0x7f62e80fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:57.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.733+0000 7f62f0410700 1 -- 172.21.15.134:0/400230344 shutdown_connections 2024-02-16T22:23:57.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.733+0000 7f62f0410700 1 -- 172.21.15.134:0/400230344 wait complete. 2024-02-16T22:23:57.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.833+0000 7f1ee8776700 1 -- 172.21.15.134:0/1885211917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee01038f0 msgr2=0x7f1ee00fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:57.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.833+0000 7f1ee8776700 1 --2- 172.21.15.134:0/1885211917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee01038f0 0x7f1ee00fcf60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0004940 tx=0x7f1ed0009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:57.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee8776700 1 -- 172.21.15.134:0/1885211917 shutdown_connections 2024-02-16T22:23:57.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee8776700 1 --2- 172.21.15.134:0/1885211917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee01038f0 0x7f1ee00fcf60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee8776700 1 --2- 172.21.15.134:0/1885211917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee0102f50 0x7f1ee0103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee8776700 1 -- 172.21.15.134:0/1885211917 >> 172.21.15.134:0/1885211917 conn(0x7f1ee00f8ae0 msgr2=0x7f1ee00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:57.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee8776700 1 -- 172.21.15.134:0/1885211917 shutdown_connections 2024-02-16T22:23:57.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee8776700 1 -- 172.21.15.134:0/1885211917 wait complete. 2024-02-16T22:23:57.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee8776700 1 Processor -- start 2024-02-16T22:23:57.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee8776700 1 -- start start 2024-02-16T22:23:57.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee8776700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee0102f50 0x7f1ee0113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:57.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee8776700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee01038f0 0x7f1ee0113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:57.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee8776700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee0114640 con 0x7f1ee0102f50 2024-02-16T22:23:57.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee8776700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee010d970 con 0x7f1ee01038f0 2024-02-16T22:23:57.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee6512700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee0102f50 0x7f1ee0113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee6512700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee0102f50 0x7f1ee0113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42874/0 (socket says 172.21.15.134:42874) 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee6512700 1 -- 172.21.15.134:0/3567966747 learned_addr learned my addr 172.21.15.134:0/3567966747 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.834+0000 7f1ee5d11700 1 --2- 172.21.15.134:0/3567966747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee01038f0 0x7f1ee0113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.835+0000 7f1ee5d11700 1 -- 172.21.15.134:0/3567966747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee01038f0 msgr2=0x7f1ee0113ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.835+0000 7f1ee5d11700 1 -- 172.21.15.134:0/3567966747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee01038f0 msgr2=0x7f1ee0113ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.835+0000 7f1ee5d11700 1 --2- 172.21.15.134:0/3567966747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee01038f0 0x7f1ee0113ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.835+0000 7f1ee5d11700 1 --2- 172.21.15.134:0/3567966747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee01038f0 0x7f1ee0113ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.835+0000 7f1ee6512700 1 -- 172.21.15.134:0/3567966747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee01038f0 msgr2=0x7f1ee0113ff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.835+0000 7f1ee6512700 1 --2- 172.21.15.134:0/3567966747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee01038f0 0x7f1ee0113ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.835+0000 7f1ee6512700 1 -- 172.21.15.134:0/3567966747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed0005040 con 0x7f1ee0102f50 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.835+0000 7f1ee6512700 1 --2- 172.21.15.134:0/3567966747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee0102f50 0x7f1ee0113ab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1edc002a50 tx=0x7f1edc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.835+0000 7f1ed6ffd700 1 -- 172.21.15.134:0/3567966747 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1edc007cc0 con 0x7f1ee0102f50 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.835+0000 7f1ed6ffd700 1 -- 172.21.15.134:0/3567966747 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1edc00f040 con 0x7f1ee0102f50 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.835+0000 7f1ee8776700 1 -- 172.21.15.134:0/3567966747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee010dc50 con 0x7f1ee0102f50 2024-02-16T22:23:57.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.835+0000 7f1ed6ffd700 1 -- 172.21.15.134:0/3567966747 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1edc00db70 con 0x7f1ee0102f50 2024-02-16T22:23:57.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.835+0000 7f1ee8776700 1 -- 172.21.15.134:0/3567966747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee010e190 con 0x7f1ee0102f50 2024-02-16T22:23:57.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.836+0000 7f1ee8776700 1 -- 172.21.15.134:0/3567966747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee0105420 con 0x7f1ee0102f50 2024-02-16T22:23:57.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.836+0000 7f1ed6ffd700 1 -- 172.21.15.134:0/3567966747 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f1edc00dd10 con 0x7f1ee0102f50 2024-02-16T22:23:57.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.837+0000 7f1ed6ffd700 1 --2- 172.21.15.134:0/3567966747 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1ecc06d900 0x7f1ecc06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:23:57.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.837+0000 7f1ed6ffd700 1 -- 172.21.15.134:0/3567966747 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f1edc08c810 con 0x7f1ee0102f50 2024-02-16T22:23:57.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.837+0000 7f1ee5d11700 1 --2- 172.21.15.134:0/3567966747 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1ecc06d900 0x7f1ecc06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:23:57.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.837+0000 7f1ee5d11700 1 --2- 172.21.15.134:0/3567966747 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1ecc06d900 0x7f1ecc06fdb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1ee010f2e0 tx=0x7f1ed0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:23:57.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:57.841+0000 7f1ed6ffd700 1 -- 172.21.15.134:0/3567966747 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1edc0599c0 con 0x7f1ee0102f50 2024-02-16T22:23:58.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:58.121+0000 7f1ee8776700 1 -- 172.21.15.134:0/3567966747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1ee004bed0 con 0x7f1ee0102f50 2024-02-16T22:23:58.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:58.121+0000 7f1ed6ffd700 1 -- 172.21.15.134:0/3567966747 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1edc059550 con 0x7f1ee0102f50 2024-02-16T22:23:58.124 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-02-16T22:23:58.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:58.124+0000 7f1ee8776700 1 -- 172.21.15.134:0/3567966747 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1ecc06d900 msgr2=0x7f1ecc06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:58.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:58.124+0000 7f1ee8776700 1 --2- 172.21.15.134:0/3567966747 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1ecc06d900 0x7f1ecc06fdb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1ee010f2e0 tx=0x7f1ed0009e30 comp rx=0 tx=0).stop 2024-02-16T22:23:58.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:58.124+0000 7f1ee8776700 1 -- 172.21.15.134:0/3567966747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee0102f50 msgr2=0x7f1ee0113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:23:58.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:58.124+0000 7f1ee8776700 1 --2- 172.21.15.134:0/3567966747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee0102f50 0x7f1ee0113ab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1edc002a50 tx=0x7f1edc0046b0 comp rx=0 tx=0).stop 2024-02-16T22:23:58.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:58.124+0000 7f1ee8776700 1 -- 172.21.15.134:0/3567966747 shutdown_connections 2024-02-16T22:23:58.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:58.124+0000 7f1ee8776700 1 --2- 172.21.15.134:0/3567966747 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1ecc06d900 0x7f1ecc06fdb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:58.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:58.124+0000 7f1ee8776700 1 --2- 172.21.15.134:0/3567966747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee0102f50 0x7f1ee0113ab0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:58.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:58.124+0000 7f1ee8776700 1 --2- 172.21.15.134:0/3567966747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee01038f0 0x7f1ee0113ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:23:58.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:58.124+0000 7f1ee8776700 1 -- 172.21.15.134:0/3567966747 >> 172.21.15.134:0/3567966747 conn(0x7f1ee00f8ae0 msgr2=0x7f1ee00fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:23:58.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:58.124+0000 7f1ee8776700 1 -- 172.21.15.134:0/3567966747 shutdown_connections 2024-02-16T22:23:58.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:23:58.124+0000 7f1ee8776700 1 -- 172.21.15.134:0/3567966747 wait complete. 2024-02-16T22:23:58.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:58 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:58.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:58 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:58.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:58 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2952090130' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:23:58.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:58 smithi173 ceph-mon[83703]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:58.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:58 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/3567966747' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:23:58.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:58 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:58.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:58 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:23:58.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:58 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2952090130' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:23:58.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:58 smithi134 ceph-mon[112514]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:23:58.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:58 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/3567966747' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:23:59.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:23:59 smithi134 ceph-mon[112514]: pgmap v14: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:23:59.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:23:59 smithi173 ceph-mon[83703]: pgmap v14: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:01 smithi134 ceph-mon[112514]: Detected new or changed devices on smithi173 2024-02-16T22:24:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:01 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:01 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:01 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:01 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:24:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:01 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:02.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:01 smithi134 ceph-mon[112514]: Reconfiguring mon.smithi134 (monmap changed)... 2024-02-16T22:24:02.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:01 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-16T22:24:02.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:01 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-16T22:24:02.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:01 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:02.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:01 smithi134 ceph-mon[112514]: Reconfiguring daemon mon.smithi134 on smithi134 2024-02-16T22:24:02.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:01 smithi134 ceph-mon[112514]: pgmap v15: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:02.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:01 smithi173 ceph-mon[83703]: Detected new or changed devices on smithi173 2024-02-16T22:24:02.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:01 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:02.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:01 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:02.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:01 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:02.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:01 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:24:02.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:01 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:02.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:01 smithi173 ceph-mon[83703]: Reconfiguring mon.smithi134 (monmap changed)... 2024-02-16T22:24:02.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:01 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-16T22:24:02.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:01 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-16T22:24:02.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:01 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:02.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:01 smithi173 ceph-mon[83703]: Reconfiguring daemon mon.smithi134 on smithi134 2024-02-16T22:24:02.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:01 smithi173 ceph-mon[83703]: pgmap v15: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:03 smithi134 ceph-mon[112514]: Reconfiguring mgr.smithi134.ordace (monmap changed)... 2024-02-16T22:24:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.ordace", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:24:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:24:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:03 smithi134 ceph-mon[112514]: Reconfiguring daemon mgr.smithi134.ordace on smithi134 2024-02-16T22:24:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:03 smithi134 ceph-mon[112514]: pgmap v16: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:03.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:03.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:03.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:03 smithi173 ceph-mon[83703]: Reconfiguring mgr.smithi134.ordace (monmap changed)... 2024-02-16T22:24:03.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.ordace", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:24:03.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:24:03.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:03.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:03 smithi173 ceph-mon[83703]: Reconfiguring daemon mgr.smithi134.ordace on smithi134 2024-02-16T22:24:03.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:03 smithi173 ceph-mon[83703]: pgmap v16: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:05.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:05 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:05.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:05 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:05.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:05 smithi134 ceph-mon[112514]: Reconfiguring crash.smithi134 (monmap changed)... 2024-02-16T22:24:05.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:05 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-16T22:24:05.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:05 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:05.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:05 smithi134 ceph-mon[112514]: Reconfiguring daemon crash.smithi134 on smithi134 2024-02-16T22:24:05.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:05 smithi134 ceph-mon[112514]: pgmap v17: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:05 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:05 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:05 smithi173 ceph-mon[83703]: Reconfiguring crash.smithi134 (monmap changed)... 2024-02-16T22:24:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:05 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-16T22:24:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:05 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:05 smithi173 ceph-mon[83703]: Reconfiguring daemon crash.smithi134 on smithi134 2024-02-16T22:24:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:05 smithi173 ceph-mon[83703]: pgmap v17: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:06 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:06 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:06 smithi134 ceph-mon[112514]: Reconfiguring osd.0 (monmap changed)... 2024-02-16T22:24:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:06 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-16T22:24:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:06 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:06.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:06 smithi134 ceph-mon[112514]: Reconfiguring daemon osd.0 on smithi134 2024-02-16T22:24:07.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:06 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:07.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:06 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:07.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:06 smithi173 ceph-mon[83703]: Reconfiguring osd.0 (monmap changed)... 2024-02-16T22:24:07.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:06 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-16T22:24:07.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:06 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:07.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:06 smithi173 ceph-mon[83703]: Reconfiguring daemon osd.0 on smithi134 2024-02-16T22:24:08.056 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:07 smithi134 ceph-mon[112514]: pgmap v18: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:08.056 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:07 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:24:08.056 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:07 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:08.056 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:07 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:08.056 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:07 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-16T22:24:08.056 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:07 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:08.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:07 smithi173 ceph-mon[83703]: pgmap v18: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:08.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:07 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:24:08.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:07 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:08.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:07 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:08.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:07 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-16T22:24:08.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:07 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:08.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:08 smithi134 ceph-mon[112514]: Reconfiguring osd.1 (monmap changed)... 2024-02-16T22:24:08.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:08 smithi134 ceph-mon[112514]: Reconfiguring daemon osd.1 on smithi134 2024-02-16T22:24:09.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:08 smithi173 ceph-mon[83703]: Reconfiguring osd.1 (monmap changed)... 2024-02-16T22:24:09.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:08 smithi173 ceph-mon[83703]: Reconfiguring daemon osd.1 on smithi134 2024-02-16T22:24:09.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:09 smithi134 ceph-mon[112514]: pgmap v19: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:09.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:09 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:09.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:09 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:09.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:09 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-16T22:24:09.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:09 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:10.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:09 smithi173 ceph-mon[83703]: pgmap v19: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:10.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:09 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:10.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:09 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:10.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:09 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-16T22:24:10.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:09 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:11.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:10 smithi134 ceph-mon[112514]: Reconfiguring osd.2 (monmap changed)... 2024-02-16T22:24:11.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:10 smithi134 ceph-mon[112514]: Reconfiguring daemon osd.2 on smithi134 2024-02-16T22:24:11.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:10 smithi173 ceph-mon[83703]: Reconfiguring osd.2 (monmap changed)... 2024-02-16T22:24:11.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:10 smithi173 ceph-mon[83703]: Reconfiguring daemon osd.2 on smithi134 2024-02-16T22:24:12.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:12.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:12.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:11 smithi134 ceph-mon[112514]: Reconfiguring mds.cephfs.smithi134.cygfxr (monmap changed)... 2024-02-16T22:24:12.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.cygfxr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:24:12.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:12.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:11 smithi134 ceph-mon[112514]: Reconfiguring daemon mds.cephfs.smithi134.cygfxr on smithi134 2024-02-16T22:24:12.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:11 smithi134 ceph-mon[112514]: pgmap v20: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:12.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:12.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:12.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:11 smithi173 ceph-mon[83703]: Reconfiguring mds.cephfs.smithi134.cygfxr (monmap changed)... 2024-02-16T22:24:12.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.cygfxr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:24:12.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:12.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:11 smithi173 ceph-mon[83703]: Reconfiguring daemon mds.cephfs.smithi134.cygfxr on smithi134 2024-02-16T22:24:12.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:11 smithi173 ceph-mon[83703]: pgmap v20: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:13 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:13 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:13 smithi134 ceph-mon[112514]: Reconfiguring mds.cephfs.smithi134.jyajef (monmap changed)... 2024-02-16T22:24:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:13 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jyajef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:24:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:13 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:13 smithi134 ceph-mon[112514]: Reconfiguring daemon mds.cephfs.smithi134.jyajef on smithi134 2024-02-16T22:24:13.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:13 smithi134 ceph-mon[112514]: pgmap v21: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:13.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:13 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:13.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:13 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:13.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:13 smithi173 ceph-mon[83703]: Reconfiguring mds.cephfs.smithi134.jyajef (monmap changed)... 2024-02-16T22:24:13.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:13 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jyajef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:24:13.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:13 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:13.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:13 smithi173 ceph-mon[83703]: Reconfiguring daemon mds.cephfs.smithi134.jyajef on smithi134 2024-02-16T22:24:13.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:13 smithi173 ceph-mon[83703]: pgmap v21: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:15.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:15 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:15.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:15 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:15.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:15 smithi134 ceph-mon[112514]: Reconfiguring crash.smithi173 (monmap changed)... 2024-02-16T22:24:15.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:15 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi173", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-16T22:24:15.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:15 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:15.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:15 smithi134 ceph-mon[112514]: Reconfiguring daemon crash.smithi173 on smithi173 2024-02-16T22:24:15.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:15 smithi134 ceph-mon[112514]: pgmap v22: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:15.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:15 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:15.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:15 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:15.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:15 smithi173 ceph-mon[83703]: Reconfiguring crash.smithi173 (monmap changed)... 2024-02-16T22:24:15.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:15 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi173", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-16T22:24:15.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:15 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:15.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:15 smithi173 ceph-mon[83703]: Reconfiguring daemon crash.smithi173 on smithi173 2024-02-16T22:24:15.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:15 smithi173 ceph-mon[83703]: pgmap v22: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:16.958 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:16 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:16.958 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:16 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:16.958 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:16 smithi173 ceph-mon[83703]: Reconfiguring mgr.smithi173.kbofaa (monmap changed)... 2024-02-16T22:24:16.958 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:16 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi173.kbofaa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:24:16.958 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:16 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:24:16.959 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:16 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:16.959 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:16 smithi173 ceph-mon[83703]: Reconfiguring daemon mgr.smithi173.kbofaa on smithi173 2024-02-16T22:24:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:16 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:16 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:16 smithi134 ceph-mon[112514]: Reconfiguring mgr.smithi173.kbofaa (monmap changed)... 2024-02-16T22:24:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:16 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi173.kbofaa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-16T22:24:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:16 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-16T22:24:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:16 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:16.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:16 smithi134 ceph-mon[112514]: Reconfiguring daemon mgr.smithi173.kbofaa on smithi173 2024-02-16T22:24:17.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:17 smithi134 ceph-mon[112514]: pgmap v23: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:17.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:17 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:17.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:17 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:17.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:17 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-16T22:24:17.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:17 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-16T22:24:17.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:17 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:17.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:17 smithi173 ceph-mon[83703]: pgmap v23: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:17.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:17 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:17.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:17 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:17.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:17 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-16T22:24:17.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:17 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-16T22:24:17.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:17 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:18.958 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:18 smithi173 ceph-mon[83703]: Reconfiguring mon.smithi173 (monmap changed)... 2024-02-16T22:24:18.958 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:18 smithi173 ceph-mon[83703]: Reconfiguring daemon mon.smithi173 on smithi173 2024-02-16T22:24:18.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:18 smithi134 ceph-mon[112514]: Reconfiguring mon.smithi173 (monmap changed)... 2024-02-16T22:24:18.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:18 smithi134 ceph-mon[112514]: Reconfiguring daemon mon.smithi173 on smithi173 2024-02-16T22:24:20.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:20 smithi173 ceph-mon[83703]: pgmap v24: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:20.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:20 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:20.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:20 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:20.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:20 smithi173 ceph-mon[83703]: Reconfiguring osd.3 (monmap changed)... 2024-02-16T22:24:20.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:20 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-16T22:24:20.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:20 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:20.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:20 smithi173 ceph-mon[83703]: Reconfiguring daemon osd.3 on smithi173 2024-02-16T22:24:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:20 smithi134 ceph-mon[112514]: pgmap v24: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:20 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:20 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:20 smithi134 ceph-mon[112514]: Reconfiguring osd.3 (monmap changed)... 2024-02-16T22:24:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:20 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-16T22:24:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:20 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:20 smithi134 ceph-mon[112514]: Reconfiguring daemon osd.3 on smithi173 2024-02-16T22:24:21.887 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:21 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:21.887 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:21 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:21.887 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:21 smithi173 ceph-mon[83703]: Reconfiguring osd.4 (monmap changed)... 2024-02-16T22:24:21.887 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:21 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-16T22:24:21.888 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:21 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:21.888 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:21 smithi173 ceph-mon[83703]: Reconfiguring daemon osd.4 on smithi173 2024-02-16T22:24:21.888 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:21 smithi173 ceph-mon[83703]: pgmap v25: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:21.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:21 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:21.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:21 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:21.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:21 smithi134 ceph-mon[112514]: Reconfiguring osd.4 (monmap changed)... 2024-02-16T22:24:21.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:21 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-16T22:24:21.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:21 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:21.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:21 smithi134 ceph-mon[112514]: Reconfiguring daemon osd.4 on smithi173 2024-02-16T22:24:21.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:21 smithi134 ceph-mon[112514]: pgmap v25: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:22.881 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:22 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:24:22.927 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:22 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:22.927 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:22 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:22.927 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:22 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-16T22:24:22.927 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:22 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:22.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:22 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:24:22.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:22 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:22.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:22 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:22.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:22 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-16T22:24:22.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:22 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:23.908 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:23 smithi173 ceph-mon[83703]: Reconfiguring osd.5 (monmap changed)... 2024-02-16T22:24:23.908 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:23 smithi173 ceph-mon[83703]: Reconfiguring daemon osd.5 on smithi173 2024-02-16T22:24:23.908 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:23 smithi173 ceph-mon[83703]: pgmap v26: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:23.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:23 smithi134 ceph-mon[112514]: Reconfiguring osd.5 (monmap changed)... 2024-02-16T22:24:23.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:23 smithi134 ceph-mon[112514]: Reconfiguring daemon osd.5 on smithi173 2024-02-16T22:24:23.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:23 smithi134 ceph-mon[112514]: pgmap v26: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:25.174 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:24 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:25.174 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:24 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:25.174 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:24 smithi173 ceph-mon[83703]: Reconfiguring mds.cephfs.smithi173.qljqef (monmap changed)... 2024-02-16T22:24:25.174 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:24 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.qljqef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:24:25.174 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:24 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:25.174 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:24 smithi173 ceph-mon[83703]: Reconfiguring daemon mds.cephfs.smithi173.qljqef on smithi173 2024-02-16T22:24:25.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:24 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:25.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:24 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:25.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:24 smithi134 ceph-mon[112514]: Reconfiguring mds.cephfs.smithi173.qljqef (monmap changed)... 2024-02-16T22:24:25.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:24 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.qljqef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:24:25.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:24 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:25.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:24 smithi134 ceph-mon[112514]: Reconfiguring daemon mds.cephfs.smithi173.qljqef on smithi173 2024-02-16T22:24:25.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:25 smithi173 ceph-mon[83703]: pgmap v27: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:25.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:25 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:25.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:25 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:25.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:25 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.phstvm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:24:25.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:25 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:26.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:25 smithi134 ceph-mon[112514]: pgmap v27: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:26.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:25 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:26.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:25 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:26.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:25 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.phstvm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:24:26.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:25 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:27.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:26 smithi134 ceph-mon[112514]: Reconfiguring mds.cephfs.smithi173.phstvm (monmap changed)... 2024-02-16T22:24:27.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:26 smithi134 ceph-mon[112514]: Reconfiguring daemon mds.cephfs.smithi173.phstvm on smithi173 2024-02-16T22:24:27.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:26 smithi173 ceph-mon[83703]: Reconfiguring mds.cephfs.smithi173.phstvm (monmap changed)... 2024-02-16T22:24:27.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:26 smithi173 ceph-mon[83703]: Reconfiguring daemon mds.cephfs.smithi173.phstvm on smithi173 2024-02-16T22:24:28.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:27 smithi134 ceph-mon[112514]: pgmap v28: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:28.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:27 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:28.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:27 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:28.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:27 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:24:28.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:27 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:24:28.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:27 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:24:28.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:27 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:28.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:27 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]: dispatch 2024-02-16T22:24:28.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:27 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]': finished 2024-02-16T22:24:28.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:27 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi173"}]: dispatch 2024-02-16T22:24:28.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:27 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi173"}]': finished 2024-02-16T22:24:28.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:27 smithi173 ceph-mon[83703]: pgmap v28: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:28.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:27 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:28.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:27 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:28.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:27 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:24:28.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:27 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:24:28.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:27 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:24:28.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:27 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:28.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:27 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]: dispatch 2024-02-16T22:24:28.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:27 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]': finished 2024-02-16T22:24:28.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:27 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi173"}]: dispatch 2024-02-16T22:24:28.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:27 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi173"}]': finished 2024-02-16T22:24:28.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.232+0000 7f93f063f700 1 -- 172.21.15.134:0/37393484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e8101e40 msgr2=0x7f93e8102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:28.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.232+0000 7f93f063f700 1 --2- 172.21.15.134:0/37393484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e8101e40 0x7f93e8102210 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93e4004940 tx=0x7f93e4009e30 comp rx=0 tx=0).stop 2024-02-16T22:24:28.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.232+0000 7f93f063f700 1 -- 172.21.15.134:0/37393484 shutdown_connections 2024-02-16T22:24:28.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.232+0000 7f93f063f700 1 --2- 172.21.15.134:0/37393484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93e81027e0 0x7f93e80fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.232+0000 7f93f063f700 1 --2- 172.21.15.134:0/37393484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e8101e40 0x7f93e8102210 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.232+0000 7f93f063f700 1 -- 172.21.15.134:0/37393484 >> 172.21.15.134:0/37393484 conn(0x7f93e8071d90 msgr2=0x7f93e8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:24:28.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.232+0000 7f93f063f700 1 -- 172.21.15.134:0/37393484 shutdown_connections 2024-02-16T22:24:28.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.232+0000 7f93f063f700 1 -- 172.21.15.134:0/37393484 wait complete. 2024-02-16T22:24:28.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.233+0000 7f93f063f700 1 Processor -- start 2024-02-16T22:24:28.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.233+0000 7f93f063f700 1 -- start start 2024-02-16T22:24:28.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.233+0000 7f93f063f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e8101e40 0x7f93e81030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:28.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.233+0000 7f93f063f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93e81027e0 0x7f93e81035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:28.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.233+0000 7f93f063f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e8103bf0 con 0x7f93e8101e40 2024-02-16T22:24:28.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.233+0000 7f93f063f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e8103d60 con 0x7f93e81027e0 2024-02-16T22:24:28.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.233+0000 7f93ee3db700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e8101e40 0x7f93e81030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:28.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.233+0000 7f93ee3db700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e8101e40 0x7f93e81030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57082/0 (socket says 172.21.15.134:57082) 2024-02-16T22:24:28.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.233+0000 7f93ee3db700 1 -- 172.21.15.134:0/3705197261 learned_addr learned my addr 172.21.15.134:0/3705197261 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:24:28.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.233+0000 7f93edbda700 1 --2- 172.21.15.134:0/3705197261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93e81027e0 0x7f93e81035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:28.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.234+0000 7f93ee3db700 1 -- 172.21.15.134:0/3705197261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93e81027e0 msgr2=0x7f93e81035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:28.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.234+0000 7f93ee3db700 1 --2- 172.21.15.134:0/3705197261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93e81027e0 0x7f93e81035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.234+0000 7f93ee3db700 1 -- 172.21.15.134:0/3705197261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e4005040 con 0x7f93e8101e40 2024-02-16T22:24:28.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.234+0000 7f93ee3db700 1 --2- 172.21.15.134:0/3705197261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e8101e40 0x7f93e81030b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f93e4000c00 tx=0x7f93e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:24:28.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.234+0000 7f93deffd700 1 -- 172.21.15.134:0/3705197261 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e4021070 con 0x7f93e8101e40 2024-02-16T22:24:28.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.234+0000 7f93f063f700 1 -- 172.21.15.134:0/3705197261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e8119bd0 con 0x7f93e8101e40 2024-02-16T22:24:28.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.234+0000 7f93deffd700 1 -- 172.21.15.134:0/3705197261 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93e4013d00 con 0x7f93e8101e40 2024-02-16T22:24:28.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.234+0000 7f93deffd700 1 -- 172.21.15.134:0/3705197261 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e400e070 con 0x7f93e8101e40 2024-02-16T22:24:28.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.234+0000 7f93f063f700 1 -- 172.21.15.134:0/3705197261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e8119fd0 con 0x7f93e8101e40 2024-02-16T22:24:28.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.235+0000 7f93f063f700 1 -- 172.21.15.134:0/3705197261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e80738b0 con 0x7f93e8101e40 2024-02-16T22:24:28.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.236+0000 7f93deffd700 1 -- 172.21.15.134:0/3705197261 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f93e401caf0 con 0x7f93e8101e40 2024-02-16T22:24:28.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.236+0000 7f93deffd700 1 --2- 172.21.15.134:0/3705197261 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f93d406d900 0x7f93d406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:28.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.236+0000 7f93deffd700 1 -- 172.21.15.134:0/3705197261 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f93e408e560 con 0x7f93e8101e40 2024-02-16T22:24:28.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.236+0000 7f93edbda700 1 --2- 172.21.15.134:0/3705197261 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f93d406d900 0x7f93d406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:28.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.237+0000 7f93edbda700 1 --2- 172.21.15.134:0/3705197261 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f93d406d900 0x7f93d406fdb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f93e8104ab0 tx=0x7f93d800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:24:28.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.245+0000 7f93deffd700 1 -- 172.21.15.134:0/3705197261 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f93e4057c60 con 0x7f93e8101e40 2024-02-16T22:24:28.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.461+0000 7f93f063f700 1 -- 172.21.15.134:0/3705197261 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93e80fac10 con 0x7f93d406d900 2024-02-16T22:24:28.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.463+0000 7f93deffd700 1 -- 172.21.15.134:0/3705197261 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f93e80fac10 con 0x7f93d406d900 2024-02-16T22:24:28.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.465+0000 7f93f063f700 1 -- 172.21.15.134:0/3705197261 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f93d406d900 msgr2=0x7f93d406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:28.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.465+0000 7f93f063f700 1 --2- 172.21.15.134:0/3705197261 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f93d406d900 0x7f93d406fdb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f93e8104ab0 tx=0x7f93d800b040 comp rx=0 tx=0).stop 2024-02-16T22:24:28.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.465+0000 7f93f063f700 1 -- 172.21.15.134:0/3705197261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e8101e40 msgr2=0x7f93e81030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:28.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.465+0000 7f93f063f700 1 --2- 172.21.15.134:0/3705197261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e8101e40 0x7f93e81030b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f93e4000c00 tx=0x7f93e4009e30 comp rx=0 tx=0).stop 2024-02-16T22:24:28.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.465+0000 7f93f063f700 1 -- 172.21.15.134:0/3705197261 shutdown_connections 2024-02-16T22:24:28.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.465+0000 7f93f063f700 1 --2- 172.21.15.134:0/3705197261 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f93d406d900 0x7f93d406fdb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.465+0000 7f93f063f700 1 --2- 172.21.15.134:0/3705197261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e8101e40 0x7f93e81030b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.465+0000 7f93f063f700 1 --2- 172.21.15.134:0/3705197261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93e81027e0 0x7f93e81035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.465+0000 7f93f063f700 1 -- 172.21.15.134:0/3705197261 >> 172.21.15.134:0/3705197261 conn(0x7f93e8071d90 msgr2=0x7f93e81051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:24:28.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.465+0000 7f93f063f700 1 -- 172.21.15.134:0/3705197261 shutdown_connections 2024-02-16T22:24:28.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.465+0000 7f93f063f700 1 -- 172.21.15.134:0/3705197261 wait complete. 2024-02-16T22:24:28.478 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:24:28.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.569+0000 7f52487d1700 1 -- 172.21.15.134:0/3814387191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5240103140 msgr2=0x7f5240103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.569+0000 7f52487d1700 1 --2- 172.21.15.134:0/3814387191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5240103140 0x7f5240103510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f523c004940 tx=0x7f523c009e30 comp rx=0 tx=0).stop 2024-02-16T22:24:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.569+0000 7f52487d1700 1 -- 172.21.15.134:0/3814387191 shutdown_connections 2024-02-16T22:24:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.569+0000 7f52487d1700 1 --2- 172.21.15.134:0/3814387191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52400fb570 0x7f52400fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.569+0000 7f52487d1700 1 --2- 172.21.15.134:0/3814387191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5240103140 0x7f5240103510 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.569+0000 7f52487d1700 1 -- 172.21.15.134:0/3814387191 >> 172.21.15.134:0/3814387191 conn(0x7f5240071560 msgr2=0x7f5240071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:24:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.569+0000 7f52487d1700 1 -- 172.21.15.134:0/3814387191 shutdown_connections 2024-02-16T22:24:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.569+0000 7f52487d1700 1 -- 172.21.15.134:0/3814387191 wait complete. 2024-02-16T22:24:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.570+0000 7f52487d1700 1 Processor -- start 2024-02-16T22:24:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.570+0000 7f52487d1700 1 -- start start 2024-02-16T22:24:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.570+0000 7f52487d1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52400fb570 0x7f52400fc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.570+0000 7f52487d1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5240103140 0x7f52400fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.570+0000 7f52487d1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52400fd320 con 0x7f5240103140 2024-02-16T22:24:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.570+0000 7f52487d1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52400fd490 con 0x7f52400fb570 2024-02-16T22:24:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.570+0000 7f5245d6c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5240103140 0x7f52400fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.570+0000 7f5245d6c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5240103140 0x7f52400fcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57092/0 (socket says 172.21.15.134:57092) 2024-02-16T22:24:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.570+0000 7f5245d6c700 1 -- 172.21.15.134:0/4028914537 learned_addr learned my addr 172.21.15.134:0/4028914537 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:24:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.570+0000 7f524656d700 1 --2- 172.21.15.134:0/4028914537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52400fb570 0x7f52400fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.570+0000 7f5245d6c700 1 -- 172.21.15.134:0/4028914537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52400fb570 msgr2=0x7f52400fc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.570+0000 7f5245d6c700 1 --2- 172.21.15.134:0/4028914537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52400fb570 0x7f52400fc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.570+0000 7f5245d6c700 1 -- 172.21.15.134:0/4028914537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c005040 con 0x7f5240103140 2024-02-16T22:24:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.570+0000 7f524656d700 1 --2- 172.21.15.134:0/4028914537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52400fb570 0x7f52400fc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:24:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.571+0000 7f5245d6c700 1 --2- 172.21.15.134:0/4028914537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5240103140 0x7f52400fcc90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f523000b790 tx=0x7f5230009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:24:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.571+0000 7f5236ffd700 1 -- 172.21.15.134:0/4028914537 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523000f770 con 0x7f5240103140 2024-02-16T22:24:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.571+0000 7f5236ffd700 1 -- 172.21.15.134:0/4028914537 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f523000fda0 con 0x7f5240103140 2024-02-16T22:24:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.571+0000 7f5236ffd700 1 -- 172.21.15.134:0/4028914537 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523000d310 con 0x7f5240103140 2024-02-16T22:24:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.571+0000 7f52487d1700 1 -- 172.21.15.134:0/4028914537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5240119e30 con 0x7f5240103140 2024-02-16T22:24:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.571+0000 7f52487d1700 1 -- 172.21.15.134:0/4028914537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524011a2a0 con 0x7f5240103140 2024-02-16T22:24:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.572+0000 7f52487d1700 1 -- 172.21.15.134:0/4028914537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5240073080 con 0x7f5240103140 2024-02-16T22:24:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.572+0000 7f5236ffd700 1 -- 172.21.15.134:0/4028914537 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f5230010420 con 0x7f5240103140 2024-02-16T22:24:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.573+0000 7f5236ffd700 1 --2- 172.21.15.134:0/4028914537 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f522c06d900 0x7f522c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.573+0000 7f5236ffd700 1 -- 172.21.15.134:0/4028914537 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f523008d010 con 0x7f5240103140 2024-02-16T22:24:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.573+0000 7f524656d700 1 --2- 172.21.15.134:0/4028914537 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f522c06d900 0x7f522c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.573+0000 7f524656d700 1 --2- 172.21.15.134:0/4028914537 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f522c06d900 0x7f522c06fdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f523c004560 tx=0x7f523c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:24:28.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.577+0000 7f5236ffd700 1 -- 172.21.15.134:0/4028914537 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5230056820 con 0x7f5240103140 2024-02-16T22:24:28.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.795+0000 7f52487d1700 1 -- 172.21.15.134:0/4028914537 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f524004bf40 con 0x7f522c06d900 2024-02-16T22:24:28.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.796+0000 7f5236ffd700 1 -- 172.21.15.134:0/4028914537 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f524004bf40 con 0x7f522c06d900 2024-02-16T22:24:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.798+0000 7f52487d1700 1 -- 172.21.15.134:0/4028914537 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f522c06d900 msgr2=0x7f522c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.798+0000 7f52487d1700 1 --2- 172.21.15.134:0/4028914537 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f522c06d900 0x7f522c06fdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f523c004560 tx=0x7f523c009e30 comp rx=0 tx=0).stop 2024-02-16T22:24:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.798+0000 7f52487d1700 1 -- 172.21.15.134:0/4028914537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5240103140 msgr2=0x7f52400fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.798+0000 7f52487d1700 1 --2- 172.21.15.134:0/4028914537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5240103140 0x7f52400fcc90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f523000b790 tx=0x7f5230009250 comp rx=0 tx=0).stop 2024-02-16T22:24:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.799+0000 7f52487d1700 1 -- 172.21.15.134:0/4028914537 shutdown_connections 2024-02-16T22:24:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.799+0000 7f52487d1700 1 --2- 172.21.15.134:0/4028914537 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f522c06d900 0x7f522c06fdb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.799+0000 7f52487d1700 1 --2- 172.21.15.134:0/4028914537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52400fb570 0x7f52400fc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.799+0000 7f52487d1700 1 --2- 172.21.15.134:0/4028914537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5240103140 0x7f52400fcc90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.799+0000 7f52487d1700 1 -- 172.21.15.134:0/4028914537 >> 172.21.15.134:0/4028914537 conn(0x7f5240071560 msgr2=0x7f52400f9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:24:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.799+0000 7f52487d1700 1 -- 172.21.15.134:0/4028914537 shutdown_connections 2024-02-16T22:24:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.799+0000 7f52487d1700 1 -- 172.21.15.134:0/4028914537 wait complete. 2024-02-16T22:24:28.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.901+0000 7fa75b077700 1 -- 172.21.15.134:0/2096821198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7540fb570 msgr2=0x7fa7540fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:28.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.901+0000 7fa75b077700 1 --2- 172.21.15.134:0/2096821198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7540fb570 0x7fa7540fb9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa740004940 tx=0x7fa740009e30 comp rx=0 tx=0).stop 2024-02-16T22:24:28.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.901+0000 7fa75b077700 1 -- 172.21.15.134:0/2096821198 shutdown_connections 2024-02-16T22:24:28.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.901+0000 7fa75b077700 1 --2- 172.21.15.134:0/2096821198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7540fb570 0x7fa7540fb9c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.901+0000 7fa75b077700 1 --2- 172.21.15.134:0/2096821198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa754103140 0x7fa754103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.901+0000 7fa75b077700 1 -- 172.21.15.134:0/2096821198 >> 172.21.15.134:0/2096821198 conn(0x7fa754071560 msgr2=0x7fa754071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:24:28.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.901+0000 7fa75b077700 1 -- 172.21.15.134:0/2096821198 shutdown_connections 2024-02-16T22:24:28.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.902+0000 7fa75b077700 1 -- 172.21.15.134:0/2096821198 wait complete. 2024-02-16T22:24:28.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.902+0000 7fa75b077700 1 Processor -- start 2024-02-16T22:24:28.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.902+0000 7fa75b077700 1 -- start start 2024-02-16T22:24:28.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.902+0000 7fa75b077700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7540fb570 0x7fa7540fc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:28.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.902+0000 7fa75b077700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa754103140 0x7fa7540fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:28.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.902+0000 7fa75b077700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540fd290 con 0x7fa754103140 2024-02-16T22:24:28.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.902+0000 7fa75b077700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540fd400 con 0x7fa7540fb570 2024-02-16T22:24:28.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.903+0000 7fa753fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa754103140 0x7fa7540fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:28.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.903+0000 7fa753fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa754103140 0x7fa7540fcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57108/0 (socket says 172.21.15.134:57108) 2024-02-16T22:24:28.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.903+0000 7fa753fff700 1 -- 172.21.15.134:0/2838309921 learned_addr learned my addr 172.21.15.134:0/2838309921 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:24:28.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.903+0000 7fa758e13700 1 --2- 172.21.15.134:0/2838309921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7540fb570 0x7fa7540fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:28.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.903+0000 7fa753fff700 1 -- 172.21.15.134:0/2838309921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7540fb570 msgr2=0x7fa7540fc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:28.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.903+0000 7fa753fff700 1 --2- 172.21.15.134:0/2838309921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7540fb570 0x7fa7540fc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:28.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.903+0000 7fa753fff700 1 -- 172.21.15.134:0/2838309921 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa740005040 con 0x7fa754103140 2024-02-16T22:24:28.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.903+0000 7fa753fff700 1 --2- 172.21.15.134:0/2838309921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa754103140 0x7fa7540fcc90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa74000b3b0 tx=0x7fa740009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:24:28.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.903+0000 7fa7517fa700 1 -- 172.21.15.134:0/2838309921 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa74000e040 con 0x7fa754103140 2024-02-16T22:24:28.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.903+0000 7fa75b077700 1 -- 172.21.15.134:0/2838309921 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa754119dc0 con 0x7fa754103140 2024-02-16T22:24:28.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.903+0000 7fa7517fa700 1 -- 172.21.15.134:0/2838309921 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa74000bbf0 con 0x7fa754103140 2024-02-16T22:24:28.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.903+0000 7fa7517fa700 1 -- 172.21.15.134:0/2838309921 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa74001c3f0 con 0x7fa754103140 2024-02-16T22:24:28.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.903+0000 7fa75b077700 1 -- 172.21.15.134:0/2838309921 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75411a220 con 0x7fa754103140 2024-02-16T22:24:28.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.905+0000 7fa75b077700 1 -- 172.21.15.134:0/2838309921 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7541054d0 con 0x7fa754103140 2024-02-16T22:24:28.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.905+0000 7fa7517fa700 1 -- 172.21.15.134:0/2838309921 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fa74000bd60 con 0x7fa754103140 2024-02-16T22:24:28.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.905+0000 7fa7517fa700 1 --2- 172.21.15.134:0/2838309921 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa74406d900 0x7fa74406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:28.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.905+0000 7fa7517fa700 1 -- 172.21.15.134:0/2838309921 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa74008e360 con 0x7fa754103140 2024-02-16T22:24:28.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.905+0000 7fa758e13700 1 --2- 172.21.15.134:0/2838309921 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa74406d900 0x7fa74406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:28.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.906+0000 7fa758e13700 1 --2- 172.21.15.134:0/2838309921 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa74406d900 0x7fa74406fdb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa748004f40 tx=0x7fa74800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:24:28.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:28.910+0000 7fa7517fa700 1 -- 172.21.15.134:0/2838309921 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa740057b00 con 0x7fa754103140 2024-02-16T22:24:29.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.138+0000 7fa75b077700 1 -- 172.21.15.134:0/2838309921 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa754073050 con 0x7fa74406d900 2024-02-16T22:24:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.148+0000 7fa7517fa700 1 -- 172.21.15.134:0/2838309921 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa754073050 con 0x7fa74406d900 2024-02-16T22:24:29.152 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:24:29.152 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (2m) 46s ago 13m 17.4M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:24:29.152 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (13m) 46s ago 13m 6660k - 17.2.7-513-gb88fae66 870a0944ccb8 a0d53bc0a925 2024-02-16T22:24:29.152 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (12m) 32s ago 12m 6669k - 17.2.7-513-gb88fae66 870a0944ccb8 a8d69537e08a 2024-02-16T22:24:29.152 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (2m) 46s ago 13m 84.9M - 9.4.12 a0ea5e3c46d9 29d29cf667e7 2024-02-16T22:24:29.152 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (7m) 46s ago 7m 13.5M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:24:29.152 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (7m) 46s ago 7m 125M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:24:29.152 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (7m) 32s ago 7m 16.7M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:24:29.152 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (7m) 32s ago 7m 118M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:24:29.152 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (3m) 46s ago 14m 472M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:24:29.152 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (3m) 32s ago 12m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:24:29.152 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (60s) 46s ago 15m 28.0M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2903b3988442 2024-02-16T22:24:29.152 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (36s) 32s ago 12m 28.8M 2048M 19.0.0-1450-gf78a58c0 f081f847070a dd7cf2f31226 2024-02-16T22:24:29.152 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (2m) 46s ago 13m 16.4M - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:24:29.153 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (2m) 32s ago 12m 14.9M - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:24:29.153 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (11m) 46s ago 11m 219M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 099f0b29d202 2024-02-16T22:24:29.153 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (11m) 46s ago 11m 232M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:24:29.153 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (10m) 46s ago 10m 190M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:24:29.153 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (10m) 32s ago 10m 266M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:24:29.153 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (9m) 32s ago 9m 237M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:24:29.153 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (9m) 32s ago 9m 231M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:24:29.153 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (2m) 46s ago 12m 57.2M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:24:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.150+0000 7fa75b077700 1 -- 172.21.15.134:0/2838309921 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa74406d900 msgr2=0x7fa74406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.150+0000 7fa75b077700 1 --2- 172.21.15.134:0/2838309921 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa74406d900 0x7fa74406fdb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa748004f40 tx=0x7fa74800b040 comp rx=0 tx=0).stop 2024-02-16T22:24:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.150+0000 7fa75b077700 1 -- 172.21.15.134:0/2838309921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa754103140 msgr2=0x7fa7540fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.150+0000 7fa75b077700 1 --2- 172.21.15.134:0/2838309921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa754103140 0x7fa7540fcc90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa74000b3b0 tx=0x7fa740009e30 comp rx=0 tx=0).stop 2024-02-16T22:24:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.151+0000 7fa75b077700 1 -- 172.21.15.134:0/2838309921 shutdown_connections 2024-02-16T22:24:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.151+0000 7fa75b077700 1 --2- 172.21.15.134:0/2838309921 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa74406d900 0x7fa74406fdb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.151+0000 7fa75b077700 1 --2- 172.21.15.134:0/2838309921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7540fb570 0x7fa7540fc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.151+0000 7fa75b077700 1 --2- 172.21.15.134:0/2838309921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa754103140 0x7fa7540fcc90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.151+0000 7fa75b077700 1 -- 172.21.15.134:0/2838309921 >> 172.21.15.134:0/2838309921 conn(0x7fa754071560 msgr2=0x7fa7540f97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:24:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.151+0000 7fa75b077700 1 -- 172.21.15.134:0/2838309921 shutdown_connections 2024-02-16T22:24:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.151+0000 7fa75b077700 1 -- 172.21.15.134:0/2838309921 wait complete. 2024-02-16T22:24:29.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:28 smithi134 ceph-mon[112514]: Upgrade: Setting container_image for all mon 2024-02-16T22:24:29.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:28 smithi173 ceph-mon[83703]: Upgrade: Setting container_image for all mon 2024-02-16T22:24:29.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.255+0000 7f8bdba0b700 1 -- 172.21.15.134:0/316614611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd41027e0 msgr2=0x7f8bd40fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:29.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.255+0000 7f8bdba0b700 1 --2- 172.21.15.134:0/316614611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd41027e0 0x7f8bd40fbea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4004940 tx=0x7f8bc4009e30 comp rx=0 tx=0).stop 2024-02-16T22:24:29.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.255+0000 7f8bdba0b700 1 -- 172.21.15.134:0/316614611 shutdown_connections 2024-02-16T22:24:29.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.255+0000 7f8bdba0b700 1 --2- 172.21.15.134:0/316614611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd41027e0 0x7f8bd40fbea0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.255+0000 7f8bdba0b700 1 --2- 172.21.15.134:0/316614611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd4101e40 0x7f8bd4102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.255+0000 7f8bdba0b700 1 -- 172.21.15.134:0/316614611 >> 172.21.15.134:0/316614611 conn(0x7f8bd4071d90 msgr2=0x7f8bd4072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:24:29.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.255+0000 7f8bdba0b700 1 -- 172.21.15.134:0/316614611 shutdown_connections 2024-02-16T22:24:29.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.255+0000 7f8bdba0b700 1 -- 172.21.15.134:0/316614611 wait complete. 2024-02-16T22:24:29.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.256+0000 7f8bdba0b700 1 Processor -- start 2024-02-16T22:24:29.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.256+0000 7f8bdba0b700 1 -- start start 2024-02-16T22:24:29.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.256+0000 7f8bdba0b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd4101e40 0x7f8bd410eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:29.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.256+0000 7f8bdba0b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd41027e0 0x7f8bd410eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:29.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.256+0000 7f8bdba0b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd410f5f0 con 0x7f8bd4101e40 2024-02-16T22:24:29.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.256+0000 7f8bdba0b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd410f760 con 0x7f8bd41027e0 2024-02-16T22:24:29.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.256+0000 7f8bd97a7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd4101e40 0x7f8bd410eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:29.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.256+0000 7f8bd97a7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd4101e40 0x7f8bd410eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57114/0 (socket says 172.21.15.134:57114) 2024-02-16T22:24:29.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.256+0000 7f8bd97a7700 1 -- 172.21.15.134:0/3071320776 learned_addr learned my addr 172.21.15.134:0/3071320776 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:24:29.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.256+0000 7f8bd8fa6700 1 --2- 172.21.15.134:0/3071320776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd41027e0 0x7f8bd410eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:29.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.256+0000 7f8bd97a7700 1 -- 172.21.15.134:0/3071320776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd41027e0 msgr2=0x7f8bd410eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:29.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.256+0000 7f8bd97a7700 1 --2- 172.21.15.134:0/3071320776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd41027e0 0x7f8bd410eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.256+0000 7f8bd97a7700 1 -- 172.21.15.134:0/3071320776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc4005040 con 0x7f8bd4101e40 2024-02-16T22:24:29.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.257+0000 7f8bd97a7700 1 --2- 172.21.15.134:0/3071320776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd4101e40 0x7f8bd410eab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0002a50 tx=0x7f8bd00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:24:29.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.257+0000 7f8bc9ffb700 1 -- 172.21.15.134:0/3071320776 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd0007cc0 con 0x7f8bd4101e40 2024-02-16T22:24:29.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.257+0000 7f8bc9ffb700 1 -- 172.21.15.134:0/3071320776 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8bd000f040 con 0x7f8bd4101e40 2024-02-16T22:24:29.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.257+0000 7f8bc9ffb700 1 -- 172.21.15.134:0/3071320776 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd000d9d0 con 0x7f8bd4101e40 2024-02-16T22:24:29.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.257+0000 7f8bdba0b700 1 -- 172.21.15.134:0/3071320776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd4117ab0 con 0x7f8bd4101e40 2024-02-16T22:24:29.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.257+0000 7f8bdba0b700 1 -- 172.21.15.134:0/3071320776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd4117fc0 con 0x7f8bd4101e40 2024-02-16T22:24:29.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.258+0000 7f8bdba0b700 1 -- 172.21.15.134:0/3071320776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd4104310 con 0x7f8bd4101e40 2024-02-16T22:24:29.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.258+0000 7f8bc9ffb700 1 -- 172.21.15.134:0/3071320776 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f8bd000db30 con 0x7f8bd4101e40 2024-02-16T22:24:29.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.259+0000 7f8bc9ffb700 1 --2- 172.21.15.134:0/3071320776 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8bc006d900 0x7f8bc006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:29.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.259+0000 7f8bc9ffb700 1 -- 172.21.15.134:0/3071320776 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8bd008cdd0 con 0x7f8bd4101e40 2024-02-16T22:24:29.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.259+0000 7f8bd8fa6700 1 --2- 172.21.15.134:0/3071320776 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8bc006d900 0x7f8bc006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:29.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.259+0000 7f8bd8fa6700 1 --2- 172.21.15.134:0/3071320776 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8bc006d900 0x7f8bc006fdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400b3b0 tx=0x7f8bc4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:24:29.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.263+0000 7f8bc9ffb700 1 -- 172.21.15.134:0/3071320776 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8bd00564d0 con 0x7f8bd4101e40 2024-02-16T22:24:29.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.557+0000 7f8bdba0b700 1 -- 172.21.15.134:0/3071320776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8bd404bed0 con 0x7f8bd4101e40 2024-02-16T22:24:29.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.557+0000 7f8bc9ffb700 1 -- 172.21.15.134:0/3071320776 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f8bd0059b90 con 0x7f8bd4101e40 2024-02-16T22:24:29.560 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:24:29.560 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:24:29.560 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:24:29.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:24:29.560 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:24:29.560 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:24:29.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:24:29.561 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:24:29.561 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 6 2024-02-16T22:24:29.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:24:29.561 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:24:29.561 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:24:29.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:24:29.561 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:24:29.561 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 10, 2024-02-16T22:24:29.561 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-16T22:24:29.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:24:29.561 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:24:29.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.559+0000 7f8bdba0b700 1 -- 172.21.15.134:0/3071320776 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8bc006d900 msgr2=0x7f8bc006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:29.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.559+0000 7f8bdba0b700 1 --2- 172.21.15.134:0/3071320776 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8bc006d900 0x7f8bc006fdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400b3b0 tx=0x7f8bc4009e30 comp rx=0 tx=0).stop 2024-02-16T22:24:29.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.559+0000 7f8bdba0b700 1 -- 172.21.15.134:0/3071320776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd4101e40 msgr2=0x7f8bd410eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:29.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.559+0000 7f8bdba0b700 1 --2- 172.21.15.134:0/3071320776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd4101e40 0x7f8bd410eab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0002a50 tx=0x7f8bd00046b0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.560+0000 7f8bdba0b700 1 -- 172.21.15.134:0/3071320776 shutdown_connections 2024-02-16T22:24:29.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.560+0000 7f8bdba0b700 1 --2- 172.21.15.134:0/3071320776 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8bc006d900 0x7f8bc006fdb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.560+0000 7f8bdba0b700 1 --2- 172.21.15.134:0/3071320776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bd4101e40 0x7f8bd410eab0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.560+0000 7f8bdba0b700 1 --2- 172.21.15.134:0/3071320776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd41027e0 0x7f8bd410eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.560+0000 7f8bdba0b700 1 -- 172.21.15.134:0/3071320776 >> 172.21.15.134:0/3071320776 conn(0x7f8bd4071d90 msgr2=0x7f8bd40fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:24:29.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.560+0000 7f8bdba0b700 1 -- 172.21.15.134:0/3071320776 shutdown_connections 2024-02-16T22:24:29.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.560+0000 7f8bdba0b700 1 -- 172.21.15.134:0/3071320776 wait complete. 2024-02-16T22:24:29.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.666+0000 7f0dfb263700 1 -- 172.21.15.134:0/3092693559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df4103910 msgr2=0x7f0df40fb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:29.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.666+0000 7f0dfb263700 1 --2- 172.21.15.134:0/3092693559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df4103910 0x7f0df40fb510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0de0004940 tx=0x7f0de0009e30 comp rx=0 tx=0).stop 2024-02-16T22:24:29.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.666+0000 7f0dfb263700 1 -- 172.21.15.134:0/3092693559 shutdown_connections 2024-02-16T22:24:29.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.666+0000 7f0dfb263700 1 --2- 172.21.15.134:0/3092693559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df4103910 0x7f0df40fb510 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.666+0000 7f0dfb263700 1 --2- 172.21.15.134:0/3092693559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df4102f70 0x7f0df4103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.666+0000 7f0dfb263700 1 -- 172.21.15.134:0/3092693559 >> 172.21.15.134:0/3092693559 conn(0x7f0df4071500 msgr2=0x7f0df4071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:24:29.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.666+0000 7f0dfb263700 1 -- 172.21.15.134:0/3092693559 shutdown_connections 2024-02-16T22:24:29.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.666+0000 7f0dfb263700 1 -- 172.21.15.134:0/3092693559 wait complete. 2024-02-16T22:24:29.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.667+0000 7f0dfb263700 1 Processor -- start 2024-02-16T22:24:29.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.667+0000 7f0dfb263700 1 -- start start 2024-02-16T22:24:29.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.667+0000 7f0dfb263700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df4102f70 0x7f0df4113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:29.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.667+0000 7f0dfb263700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df4103910 0x7f0df4113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:29.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.667+0000 7f0dfb263700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df41145c0 con 0x7f0df4103910 2024-02-16T22:24:29.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.667+0000 7f0dfb263700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df410d8f0 con 0x7f0df4102f70 2024-02-16T22:24:29.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.667+0000 7f0df3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df4103910 0x7f0df4113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:29.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.667+0000 7f0df3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df4103910 0x7f0df4113f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57122/0 (socket says 172.21.15.134:57122) 2024-02-16T22:24:29.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.667+0000 7f0df3fff700 1 -- 172.21.15.134:0/283678847 learned_addr learned my addr 172.21.15.134:0/283678847 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:24:29.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.667+0000 7f0df3fff700 1 -- 172.21.15.134:0/283678847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df4102f70 msgr2=0x7f0df4113a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:29.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.667+0000 7f0df3fff700 1 --2- 172.21.15.134:0/283678847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df4102f70 0x7f0df4113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.667+0000 7f0df3fff700 1 -- 172.21.15.134:0/283678847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de0005040 con 0x7f0df4103910 2024-02-16T22:24:29.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.668+0000 7f0df3fff700 1 --2- 172.21.15.134:0/283678847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df4103910 0x7f0df4113f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0de00090d0 tx=0x7f0de0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:24:29.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.668+0000 7f0df17fa700 1 -- 172.21.15.134:0/283678847 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0de000e040 con 0x7f0df4103910 2024-02-16T22:24:29.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.668+0000 7f0dfb263700 1 -- 172.21.15.134:0/283678847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df410db70 con 0x7f0df4103910 2024-02-16T22:24:29.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.668+0000 7f0df17fa700 1 -- 172.21.15.134:0/283678847 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0de000bbf0 con 0x7f0df4103910 2024-02-16T22:24:29.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.668+0000 7f0df17fa700 1 -- 172.21.15.134:0/283678847 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0de001c630 con 0x7f0df4103910 2024-02-16T22:24:29.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.668+0000 7f0dfb263700 1 -- 172.21.15.134:0/283678847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df410e0b0 con 0x7f0df4103910 2024-02-16T22:24:29.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.669+0000 7f0dfb263700 1 -- 172.21.15.134:0/283678847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df41002b0 con 0x7f0df4103910 2024-02-16T22:24:29.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.669+0000 7f0df17fa700 1 -- 172.21.15.134:0/283678847 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f0de000bd60 con 0x7f0df4103910 2024-02-16T22:24:29.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.670+0000 7f0df17fa700 1 --2- 172.21.15.134:0/283678847 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0de406d900 0x7f0de406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:29.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.670+0000 7f0df17fa700 1 -- 172.21.15.134:0/283678847 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0de008e480 con 0x7f0df4103910 2024-02-16T22:24:29.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.670+0000 7f0df8fff700 1 --2- 172.21.15.134:0/283678847 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0de406d900 0x7f0de406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:29.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.670+0000 7f0df8fff700 1 --2- 172.21.15.134:0/283678847 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0de406d900 0x7f0de406fdb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0de80041d0 tx=0x7f0de8004160 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:24:29.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.675+0000 7f0df17fa700 1 -- 172.21.15.134:0/283678847 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0de005b6b0 con 0x7f0df4103910 2024-02-16T22:24:29.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.925+0000 7f0dfb263700 1 -- 172.21.15.134:0/283678847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0df410a070 con 0x7f0df4103910 2024-02-16T22:24:29.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.926+0000 7f0df17fa700 1 -- 172.21.15.134:0/283678847 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1860 (secure 0 0 0) 0x7f0de0013e60 con 0x7f0df4103910 2024-02-16T22:24:29.929 INFO:teuthology.orchestra.run.smithi134.stdout:e20 2024-02-16T22:24:29.929 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:24:29.929 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:24:29.929 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-02-16T22:24:29.929 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:24:29.929 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-02-16T22:24:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-02-16T22:24:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 20 2024-02-16T22:24:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-16T22:24:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:24:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-02-16T22:23:22.543229+0000 2024-02-16T22:24:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-02-16T22:24:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-02-16T22:24:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-02-16T22:24:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-02-16T22:24:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-02-16T22:24:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-02-16T22:24:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-02-16T22:24:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-02-16T22:24:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-02-16T22:24:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:24:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 2 2024-02-16T22:24:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:in 0,1 2024-02-16T22:24:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14478,1=24269} 2024-02-16T22:24:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-02-16T22:24:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-02-16T22:24:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-02-16T22:24:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-02-16T22:24:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-02-16T22:24:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-02-16T22:24:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-02-16T22:24:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-02-16T22:24:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-02-16T22:24:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.jyajef{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:24:29.932 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.qljqef{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:24:29.932 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:24:29.932 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:24:29.932 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-02-16T22:24:29.932 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:24:29.932 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.cygfxr{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2804816044,v1:172.21.15.134:6827/2804816044] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:24:29.932 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.phstvm{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:24:29.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.928+0000 7f0dfb263700 1 -- 172.21.15.134:0/283678847 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0de406d900 msgr2=0x7f0de406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:29.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.928+0000 7f0dfb263700 1 --2- 172.21.15.134:0/283678847 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0de406d900 0x7f0de406fdb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0de80041d0 tx=0x7f0de8004160 comp rx=0 tx=0).stop 2024-02-16T22:24:29.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.928+0000 7f0dfb263700 1 -- 172.21.15.134:0/283678847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df4103910 msgr2=0x7f0df4113f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:29.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.928+0000 7f0dfb263700 1 --2- 172.21.15.134:0/283678847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df4103910 0x7f0df4113f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0de00090d0 tx=0x7f0de0009e30 comp rx=0 tx=0).stop 2024-02-16T22:24:29.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.928+0000 7f0dfb263700 1 -- 172.21.15.134:0/283678847 shutdown_connections 2024-02-16T22:24:29.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.928+0000 7f0dfb263700 1 --2- 172.21.15.134:0/283678847 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0de406d900 0x7f0de406fdb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.928+0000 7f0dfb263700 1 --2- 172.21.15.134:0/283678847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df4102f70 0x7f0df4113a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.928+0000 7f0dfb263700 1 --2- 172.21.15.134:0/283678847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df4103910 0x7f0df4113f70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:29.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.928+0000 7f0dfb263700 1 -- 172.21.15.134:0/283678847 >> 172.21.15.134:0/283678847 conn(0x7f0df4071500 msgr2=0x7f0df40fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:24:29.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.928+0000 7f0dfb263700 1 -- 172.21.15.134:0/283678847 shutdown_connections 2024-02-16T22:24:29.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:29.928+0000 7f0dfb263700 1 -- 172.21.15.134:0/283678847 wait complete. 2024-02-16T22:24:29.934 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 20 2024-02-16T22:24:30.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.034+0000 7f1c3f032700 1 -- 172.21.15.134:0/656594122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c38101e60 msgr2=0x7f1c38102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:30.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.034+0000 7f1c3f032700 1 --2- 172.21.15.134:0/656594122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c38101e60 0x7f1c38102230 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c004940 tx=0x7f1c2c009e30 comp rx=0 tx=0).stop 2024-02-16T22:24:30.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.034+0000 7f1c3f032700 1 -- 172.21.15.134:0/656594122 shutdown_connections 2024-02-16T22:24:30.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.034+0000 7f1c3f032700 1 --2- 172.21.15.134:0/656594122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c38102800 0x7f1c380fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:30.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.034+0000 7f1c3f032700 1 --2- 172.21.15.134:0/656594122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c38101e60 0x7f1c38102230 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:30.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.034+0000 7f1c3f032700 1 -- 172.21.15.134:0/656594122 >> 172.21.15.134:0/656594122 conn(0x7f1c380f7a10 msgr2=0x7f1c380f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:24:30.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.034+0000 7f1c3f032700 1 -- 172.21.15.134:0/656594122 shutdown_connections 2024-02-16T22:24:30.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.034+0000 7f1c3f032700 1 -- 172.21.15.134:0/656594122 wait complete. 2024-02-16T22:24:30.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.034+0000 7f1c3f032700 1 Processor -- start 2024-02-16T22:24:30.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.034+0000 7f1c3f032700 1 -- start start 2024-02-16T22:24:30.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.035+0000 7f1c3f032700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c38101e60 0x7f1c3810eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:30.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.035+0000 7f1c3f032700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c38102800 0x7f1c3810f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:30.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.035+0000 7f1c3f032700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3810f5d0 con 0x7f1c38101e60 2024-02-16T22:24:30.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.035+0000 7f1c3f032700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3810f710 con 0x7f1c38102800 2024-02-16T22:24:30.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.035+0000 7f1c3cdce700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c38101e60 0x7f1c3810eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:30.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.035+0000 7f1c3cdce700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c38101e60 0x7f1c3810eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57150/0 (socket says 172.21.15.134:57150) 2024-02-16T22:24:30.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.035+0000 7f1c3cdce700 1 -- 172.21.15.134:0/3803397826 learned_addr learned my addr 172.21.15.134:0/3803397826 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:24:30.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.035+0000 7f1c37fff700 1 --2- 172.21.15.134:0/3803397826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c38102800 0x7f1c3810f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:30.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.035+0000 7f1c3cdce700 1 -- 172.21.15.134:0/3803397826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c38102800 msgr2=0x7f1c3810f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:30.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.035+0000 7f1c3cdce700 1 --2- 172.21.15.134:0/3803397826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c38102800 0x7f1c3810f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:30.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.035+0000 7f1c3cdce700 1 -- 172.21.15.134:0/3803397826 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c005040 con 0x7f1c38101e60 2024-02-16T22:24:30.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.036+0000 7f1c3cdce700 1 --2- 172.21.15.134:0/3803397826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c38101e60 0x7f1c3810eb00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009fd0 tx=0x7f1c2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:24:30.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.036+0000 7f1c357fa700 1 -- 172.21.15.134:0/3803397826 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c2c00e040 con 0x7f1c38101e60 2024-02-16T22:24:30.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.036+0000 7f1c357fa700 1 -- 172.21.15.134:0/3803397826 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c2c00bbf0 con 0x7f1c38101e60 2024-02-16T22:24:30.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.036+0000 7f1c3f032700 1 -- 172.21.15.134:0/3803397826 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c38117a10 con 0x7f1c38101e60 2024-02-16T22:24:30.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.036+0000 7f1c357fa700 1 -- 172.21.15.134:0/3803397826 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c2c01c630 con 0x7f1c38101e60 2024-02-16T22:24:30.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.036+0000 7f1c3f032700 1 -- 172.21.15.134:0/3803397826 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c38117e60 con 0x7f1c38101e60 2024-02-16T22:24:30.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.037+0000 7f1c3f032700 1 -- 172.21.15.134:0/3803397826 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c380fb610 con 0x7f1c38101e60 2024-02-16T22:24:30.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.037+0000 7f1c357fa700 1 -- 172.21.15.134:0/3803397826 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f1c2c00bd60 con 0x7f1c38101e60 2024-02-16T22:24:30.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.038+0000 7f1c357fa700 1 --2- 172.21.15.134:0/3803397826 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1c2806d900 0x7f1c2806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:30.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.038+0000 7f1c357fa700 1 -- 172.21.15.134:0/3803397826 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f1c2c08e1f0 con 0x7f1c38101e60 2024-02-16T22:24:30.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.038+0000 7f1c37fff700 1 --2- 172.21.15.134:0/3803397826 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1c2806d900 0x7f1c2806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:30.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.038+0000 7f1c37fff700 1 --2- 172.21.15.134:0/3803397826 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1c2806d900 0x7f1c2806fdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1c38066a10 tx=0x7f1c240043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:24:30.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.042+0000 7f1c357fa700 1 -- 172.21.15.134:0/3803397826 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1c2c057990 con 0x7f1c38101e60 2024-02-16T22:24:30.148 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:30 smithi134 ceph-mon[112514]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:24:30.148 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:30 smithi134 ceph-mon[112514]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:24:30.148 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:30 smithi134 ceph-mon[112514]: pgmap v29: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:30.148 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:30 smithi134 ceph-mon[112514]: Upgrade: Updating crash.smithi134 (1/2) 2024-02-16T22:24:30.148 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:30 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:30.148 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:30 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-16T22:24:30.148 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:30 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:30.148 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:30 smithi134 ceph-mon[112514]: Deploying daemon crash.smithi134 on smithi134 2024-02-16T22:24:30.148 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:30 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/3071320776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:24:30.148 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:30 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/283678847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:24:30.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.267+0000 7f1c3f032700 1 -- 172.21.15.134:0/3803397826 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c380f9b40 con 0x7f1c2806d900 2024-02-16T22:24:30.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.268+0000 7f1c357fa700 1 -- 172.21.15.134:0/3803397826 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f1c380f9b40 con 0x7f1c2806d900 2024-02-16T22:24:30.270 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:24:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:24:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:24:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-16T22:24:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-02-16T22:24:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-02-16T22:24:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-02-16T22:24:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-02-16T22:24:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "4/21 daemons upgraded", 2024-02-16T22:24:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading crash daemons", 2024-02-16T22:24:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:24:30.271 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:24:30.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.270+0000 7f1c3f032700 1 -- 172.21.15.134:0/3803397826 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1c2806d900 msgr2=0x7f1c2806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:30.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.270+0000 7f1c3f032700 1 --2- 172.21.15.134:0/3803397826 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1c2806d900 0x7f1c2806fdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1c38066a10 tx=0x7f1c240043c0 comp rx=0 tx=0).stop 2024-02-16T22:24:30.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.270+0000 7f1c3f032700 1 -- 172.21.15.134:0/3803397826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c38101e60 msgr2=0x7f1c3810eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:30.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.270+0000 7f1c3f032700 1 --2- 172.21.15.134:0/3803397826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c38101e60 0x7f1c3810eb00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009fd0 tx=0x7f1c2c009e30 comp rx=0 tx=0).stop 2024-02-16T22:24:30.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.270+0000 7f1c3f032700 1 -- 172.21.15.134:0/3803397826 shutdown_connections 2024-02-16T22:24:30.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.270+0000 7f1c3f032700 1 --2- 172.21.15.134:0/3803397826 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1c2806d900 0x7f1c2806fdb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:30.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.270+0000 7f1c3f032700 1 --2- 172.21.15.134:0/3803397826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c38101e60 0x7f1c3810eb00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:30.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.270+0000 7f1c3f032700 1 --2- 172.21.15.134:0/3803397826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c38102800 0x7f1c3810f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:30.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.270+0000 7f1c3f032700 1 -- 172.21.15.134:0/3803397826 >> 172.21.15.134:0/3803397826 conn(0x7f1c380f7a10 msgr2=0x7f1c380f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:24:30.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.271+0000 7f1c3f032700 1 -- 172.21.15.134:0/3803397826 shutdown_connections 2024-02-16T22:24:30.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.271+0000 7f1c3f032700 1 -- 172.21.15.134:0/3803397826 wait complete. 2024-02-16T22:24:30.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.372+0000 7f37a6885700 1 -- 172.21.15.134:0/3550974974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a0102800 msgr2=0x7f37a00fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:30.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.372+0000 7f37a6885700 1 --2- 172.21.15.134:0/3550974974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a0102800 0x7f37a00fbe70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3794004940 tx=0x7f3794009e30 comp rx=0 tx=0).stop 2024-02-16T22:24:30.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.372+0000 7f37a6885700 1 -- 172.21.15.134:0/3550974974 shutdown_connections 2024-02-16T22:24:30.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.372+0000 7f37a6885700 1 --2- 172.21.15.134:0/3550974974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a0102800 0x7f37a00fbe70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:30.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.372+0000 7f37a6885700 1 --2- 172.21.15.134:0/3550974974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37a0101e60 0x7f37a0102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:30.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.372+0000 7f37a6885700 1 -- 172.21.15.134:0/3550974974 >> 172.21.15.134:0/3550974974 conn(0x7f37a00f7a10 msgr2=0x7f37a00f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:24:30.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.372+0000 7f37a6885700 1 -- 172.21.15.134:0/3550974974 shutdown_connections 2024-02-16T22:24:30.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.372+0000 7f37a6885700 1 -- 172.21.15.134:0/3550974974 wait complete. 2024-02-16T22:24:30.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.373+0000 7f37a6885700 1 Processor -- start 2024-02-16T22:24:30.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.373+0000 7f37a6885700 1 -- start start 2024-02-16T22:24:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.373+0000 7f37a6885700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a0101e60 0x7f37a010ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.373+0000 7f37a6885700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37a0102800 0x7f37a010f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.373+0000 7f37a6885700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a010f690 con 0x7f37a0101e60 2024-02-16T22:24:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.373+0000 7f37a6885700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a010f7d0 con 0x7f37a0102800 2024-02-16T22:24:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.373+0000 7f379ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a0101e60 0x7f37a010ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.373+0000 7f379ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a0101e60 0x7f37a010ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57158/0 (socket says 172.21.15.134:57158) 2024-02-16T22:24:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.373+0000 7f379ffff700 1 -- 172.21.15.134:0/148077096 learned_addr learned my addr 172.21.15.134:0/148077096 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:24:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.374+0000 7f379f7fe700 1 --2- 172.21.15.134:0/148077096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37a0102800 0x7f37a010f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.374+0000 7f379ffff700 1 -- 172.21.15.134:0/148077096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37a0102800 msgr2=0x7f37a010f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.374+0000 7f379ffff700 1 --2- 172.21.15.134:0/148077096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37a0102800 0x7f37a010f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:30.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.374+0000 7f379ffff700 1 -- 172.21.15.134:0/148077096 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3794005040 con 0x7f37a0101e60 2024-02-16T22:24:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.374+0000 7f379f7fe700 1 --2- 172.21.15.134:0/148077096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37a0102800 0x7f37a010f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:24:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.374+0000 7f379ffff700 1 --2- 172.21.15.134:0/148077096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a0101e60 0x7f37a010ebc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3790002a50 tx=0x7f37900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:24:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.374+0000 7f379cff9700 1 -- 172.21.15.134:0/148077096 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3790007cc0 con 0x7f37a0101e60 2024-02-16T22:24:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.374+0000 7f379cff9700 1 -- 172.21.15.134:0/148077096 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f379000f040 con 0x7f37a0101e60 2024-02-16T22:24:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.374+0000 7f37a6885700 1 -- 172.21.15.134:0/148077096 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a0117b30 con 0x7f37a0101e60 2024-02-16T22:24:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.374+0000 7f379cff9700 1 -- 172.21.15.134:0/148077096 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f379000db70 con 0x7f37a0101e60 2024-02-16T22:24:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.374+0000 7f37a6885700 1 -- 172.21.15.134:0/148077096 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a0118040 con 0x7f37a0101e60 2024-02-16T22:24:30.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.375+0000 7f37a6885700 1 -- 172.21.15.134:0/148077096 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a0104330 con 0x7f37a0101e60 2024-02-16T22:24:30.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.375+0000 7f379cff9700 1 -- 172.21.15.134:0/148077096 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f379000dcf0 con 0x7f37a0101e60 2024-02-16T22:24:30.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.376+0000 7f379cff9700 1 --2- 172.21.15.134:0/148077096 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f378806d900 0x7f378806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:24:30.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.376+0000 7f379f7fe700 1 --2- 172.21.15.134:0/148077096 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f378806d900 0x7f378806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:24:30.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.376+0000 7f379cff9700 1 -- 172.21.15.134:0/148077096 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f379008c7e0 con 0x7f37a0101e60 2024-02-16T22:24:30.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.376+0000 7f379f7fe700 1 --2- 172.21.15.134:0/148077096 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f378806d900 0x7f378806fdb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3794009fd0 tx=0x7f3794009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:24:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.381+0000 7f379cff9700 1 -- 172.21.15.134:0/148077096 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3790055e60 con 0x7f37a0101e60 2024-02-16T22:24:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:30 smithi173 ceph-mon[83703]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:24:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:30 smithi173 ceph-mon[83703]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:24:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:30 smithi173 ceph-mon[83703]: pgmap v29: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:30 smithi173 ceph-mon[83703]: Upgrade: Updating crash.smithi134 (1/2) 2024-02-16T22:24:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:30 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:30 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-16T22:24:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:30 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:30 smithi173 ceph-mon[83703]: Deploying daemon crash.smithi134 on smithi134 2024-02-16T22:24:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:30 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/3071320776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:24:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:30 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/283678847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:24:30.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.664+0000 7f37a6885700 1 -- 172.21.15.134:0/148077096 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f37a0066750 con 0x7f37a0101e60 2024-02-16T22:24:30.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.664+0000 7f379cff9700 1 -- 172.21.15.134:0/148077096 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3790059520 con 0x7f37a0101e60 2024-02-16T22:24:30.666 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-02-16T22:24:30.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.666+0000 7f37a6885700 1 -- 172.21.15.134:0/148077096 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f378806d900 msgr2=0x7f378806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:30.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.666+0000 7f37a6885700 1 --2- 172.21.15.134:0/148077096 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f378806d900 0x7f378806fdb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3794009fd0 tx=0x7f3794009e30 comp rx=0 tx=0).stop 2024-02-16T22:24:30.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.666+0000 7f37a6885700 1 -- 172.21.15.134:0/148077096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a0101e60 msgr2=0x7f37a010ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:24:30.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.666+0000 7f37a6885700 1 --2- 172.21.15.134:0/148077096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a0101e60 0x7f37a010ebc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3790002a50 tx=0x7f37900046b0 comp rx=0 tx=0).stop 2024-02-16T22:24:30.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.666+0000 7f37a6885700 1 -- 172.21.15.134:0/148077096 shutdown_connections 2024-02-16T22:24:30.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.666+0000 7f37a6885700 1 --2- 172.21.15.134:0/148077096 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f378806d900 0x7f378806fdb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:30.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.666+0000 7f37a6885700 1 --2- 172.21.15.134:0/148077096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37a0101e60 0x7f37a010ebc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:30.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.666+0000 7f37a6885700 1 --2- 172.21.15.134:0/148077096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37a0102800 0x7f37a010f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:24:30.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.666+0000 7f37a6885700 1 -- 172.21.15.134:0/148077096 >> 172.21.15.134:0/148077096 conn(0x7f37a00f7a10 msgr2=0x7f37a00f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:24:30.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.666+0000 7f37a6885700 1 -- 172.21.15.134:0/148077096 shutdown_connections 2024-02-16T22:24:30.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:24:30.666+0000 7f37a6885700 1 -- 172.21.15.134:0/148077096 wait complete. 2024-02-16T22:24:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:31 smithi134 ceph-mon[112514]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:24:31.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:31 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/148077096' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:24:31.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:31 smithi173 ceph-mon[83703]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:24:31.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:31 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/148077096' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:24:32.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:32 smithi134 ceph-mon[112514]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:24:32.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:32 smithi134 ceph-mon[112514]: pgmap v30: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:32.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:32 smithi173 ceph-mon[83703]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:24:32.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:32 smithi173 ceph-mon[83703]: pgmap v30: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:34.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:34 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:34.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:34 smithi173 ceph-mon[83703]: pgmap v31: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:34.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:34 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:34.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:34 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:34.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:34 smithi134 ceph-mon[112514]: pgmap v31: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:34.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:34 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:35.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:35 smithi173 ceph-mon[83703]: Upgrade: Updating crash.smithi173 (2/2) 2024-02-16T22:24:35.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:35 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:35.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:35 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi173", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-16T22:24:35.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:35 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:35.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:35 smithi173 ceph-mon[83703]: Deploying daemon crash.smithi173 on smithi173 2024-02-16T22:24:35.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:35 smithi173 ceph-mon[83703]: pgmap v32: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:35.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:35 smithi134 ceph-mon[112514]: Upgrade: Updating crash.smithi173 (2/2) 2024-02-16T22:24:35.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:35 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:35.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:35 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi173", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-16T22:24:35.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:35 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:35.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:35 smithi134 ceph-mon[112514]: Deploying daemon crash.smithi173 on smithi173 2024-02-16T22:24:35.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:35 smithi134 ceph-mon[112514]: pgmap v32: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:38.213 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:38 smithi173 ceph-mon[83703]: pgmap v33: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:38.213 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:38 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:24:38.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:38 smithi134 ceph-mon[112514]: pgmap v33: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:38.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:38 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:24:39.425 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:39 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:39.425 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:39 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:39.425 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:39 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:24:39.425 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:39 smithi173 ceph-mon[83703]: pgmap v34: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:39.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:39 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:39.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:39 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:39.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:39 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:24:39.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:39 smithi134 ceph-mon[112514]: pgmap v34: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:42.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:42 smithi134 ceph-mon[112514]: pgmap v35: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:42.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:42 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:42.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:42 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:42.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:42 smithi173 ceph-mon[83703]: pgmap v35: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:42.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:42 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:42.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:42 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:43.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:43 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:43.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:43 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:43.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:43 smithi134 ceph-mon[112514]: pgmap v36: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:43.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:43 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:43.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:43 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:43.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:43 smithi173 ceph-mon[83703]: pgmap v36: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:44.877 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:44 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:44.877 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:44 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:44.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:44 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:44.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:44 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:45.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:45 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:45.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:45 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:45.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:45 smithi173 ceph-mon[83703]: pgmap v37: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:45.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:45 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:45.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:45 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:45.959 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:45 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:45.959 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:45 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:45.959 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:45 smithi134 ceph-mon[112514]: pgmap v37: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:45.960 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:45 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:45.960 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:45 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:48.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:48 smithi134 ceph-mon[112514]: pgmap v38: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:48.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:48 smithi173 ceph-mon[83703]: pgmap v38: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:49.707 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:49.707 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:49.707 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:49.707 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:24:49.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:49.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:24:49.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:24:49.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:24:49.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:24:49.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: Upgrade: Setting container_image for all crash 2024-02-16T22:24:49.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:49.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]: dispatch 2024-02-16T22:24:49.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]': finished 2024-02-16T22:24:49.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi173"}]: dispatch 2024-02-16T22:24:49.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi173"}]': finished 2024-02-16T22:24:49.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-16T22:24:49.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-16T22:24:49.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: Upgrade: osd.0 is safe to restart 2024-02-16T22:24:49.709 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:49 smithi134 ceph-mon[112514]: pgmap v39: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:49.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:49.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:49.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:49.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:24:49.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:49.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:24:49.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:24:49.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:24:49.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:24:49.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: Upgrade: Setting container_image for all crash 2024-02-16T22:24:49.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:49.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]: dispatch 2024-02-16T22:24:49.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]': finished 2024-02-16T22:24:49.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi173"}]: dispatch 2024-02-16T22:24:49.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi173"}]': finished 2024-02-16T22:24:49.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-16T22:24:49.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-16T22:24:49.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: Upgrade: osd.0 is safe to restart 2024-02-16T22:24:49.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:49 smithi173 ceph-mon[83703]: pgmap v39: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:51.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:51 smithi134 ceph-mon[112514]: Upgrade: Updating osd.0 2024-02-16T22:24:51.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:51 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:51.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:51 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-16T22:24:51.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:51 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:51.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:51 smithi134 ceph-mon[112514]: Deploying daemon osd.0 on smithi134 2024-02-16T22:24:51.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:51 smithi134 ceph-mon[112514]: pgmap v40: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:51.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:51 smithi173 ceph-mon[83703]: Upgrade: Updating osd.0 2024-02-16T22:24:51.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:51 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:24:51.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:51 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-16T22:24:51.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:51 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:24:51.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:51 smithi173 ceph-mon[83703]: Deploying daemon osd.0 on smithi134 2024-02-16T22:24:51.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:51 smithi173 ceph-mon[83703]: pgmap v40: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:52.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:52 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:24:52.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:52 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:24:53.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:53 smithi134 ceph-mon[112514]: pgmap v41: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:53.727 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:53 smithi134 systemd[1]: Stopping Ceph osd.0 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:24:53.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:53 smithi173 ceph-mon[83703]: pgmap v41: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:54.227 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:53 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0[47993]: 2024-02-16T22:24:53.895+0000 7f450fe06700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:24:54.227 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:53 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0[47993]: 2024-02-16T22:24:53.895+0000 7f450fe06700 -1 osd.0 49 *** Got signal Terminated *** 2024-02-16T22:24:54.227 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:53 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0[47993]: 2024-02-16T22:24:53.895+0000 7f450fe06700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-16T22:24:54.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:54 smithi134 ceph-mon[112514]: osd.0 marked itself down and dead 2024-02-16T22:24:54.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:54 smithi173 ceph-mon[83703]: osd.0 marked itself down and dead 2024-02-16T22:24:55.040 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:54 smithi134 podman[123566]: 2024-02-16 22:24:54.734203102 +0000 UTC m=+0.938553249 container died 099f0b29d202fd6c0ece27ed6b81d3584dc67f3831d35e2dd8947f7c5371fbac (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-b88fae6, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:24:55.314 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:55 smithi134 podman[123566]: 2024-02-16 22:24:55.129667102 +0000 UTC m=+1.334017250 container cleanup 099f0b29d202fd6c0ece27ed6b81d3584dc67f3831d35e2dd8947f7c5371fbac (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=quincy-b88fae6, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-02-16T22:24:55.314 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:55 smithi134 bash[123566]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0 2024-02-16T22:24:55.632 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:55 smithi173 ceph-mon[83703]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-16T22:24:55.632 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:55 smithi173 ceph-mon[83703]: failed to encode map e50 with expected crc 2024-02-16T22:24:55.633 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:55 smithi173 ceph-mon[83703]: osdmap e50: 6 total, 5 up, 6 in 2024-02-16T22:24:55.633 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:55 smithi173 ceph-mon[83703]: pgmap v43: 65 pgs: 9 stale+active+clean, 56 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:55.699 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:55 smithi134 ceph-mon[112514]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-16T22:24:55.699 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:55 smithi134 ceph-mon[112514]: failed to encode map e50 with expected crc 2024-02-16T22:24:55.699 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:55 smithi134 ceph-mon[112514]: osdmap e50: 6 total, 5 up, 6 in 2024-02-16T22:24:55.699 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:55 smithi134 ceph-mon[112514]: pgmap v43: 65 pgs: 9 stale+active+clean, 56 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:55.699 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:55 smithi134 podman[123585]: 2024-02-16 22:24:55.381218152 +0000 UTC m=+0.642495752 container remove 099f0b29d202fd6c0ece27ed6b81d3584dc67f3831d35e2dd8947f7c5371fbac (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-b88fae6, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, ceph=True) 2024-02-16T22:24:55.977 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:55 smithi134 podman[123678]: 2024-02-16 22:24:55.601292433 +0000 UTC m=+0.018945596 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:24:55.977 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:55 smithi134 podman[123678]: 2024-02-16 22:24:55.71580224 +0000 UTC m=+0.133465123 container create 611d481a064f3f41d9a4a63ccd052ae466f11e884c0ee0821705ddfd01703cc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-16T22:24:56.297 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:56 smithi134 podman[123678]: 2024-02-16 22:24:56.001959749 +0000 UTC m=+0.419612907 container init 611d481a064f3f41d9a4a63ccd052ae466f11e884c0ee0821705ddfd01703cc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-02-16T22:24:56.298 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:56 smithi134 podman[123678]: 2024-02-16 22:24:56.005280995 +0000 UTC m=+0.422934161 container start 611d481a064f3f41d9a4a63ccd052ae466f11e884c0ee0821705ddfd01703cc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2) 2024-02-16T22:24:56.298 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:56 smithi134 podman[123678]: 2024-02-16 22:24:56.076853307 +0000 UTC m=+0.494506479 container attach 611d481a064f3f41d9a4a63ccd052ae466f11e884c0ee0821705ddfd01703cc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:24:56.598 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:56 smithi134 podman[123678]: 2024-02-16 22:24:56.296774632 +0000 UTC m=+0.714427794 container died 611d481a064f3f41d9a4a63ccd052ae466f11e884c0ee0821705ddfd01703cc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:24:56.598 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:56 smithi134 ceph-mon[112514]: failed to encode map e51 with expected crc 2024-02-16T22:24:56.598 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:56 smithi134 ceph-mon[112514]: osdmap e51: 6 total, 5 up, 6 in 2024-02-16T22:24:56.598 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:56 smithi134 ceph-mon[112514]: failed to encode map e51 with expected crc 2024-02-16T22:24:56.598 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:56 smithi134 ceph-mon[112514]: failed to encode map e51 with expected crc 2024-02-16T22:24:56.598 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:56 smithi134 ceph-mon[112514]: failed to encode map e51 with expected crc 2024-02-16T22:24:56.598 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:56 smithi134 ceph-mon[112514]: failed to encode map e51 with expected crc 2024-02-16T22:24:56.598 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:56 smithi134 ceph-mon[112514]: failed to encode map e51 with expected crc 2024-02-16T22:24:56.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:56 smithi173 ceph-mon[83703]: failed to encode map e51 with expected crc 2024-02-16T22:24:56.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:56 smithi173 ceph-mon[83703]: osdmap e51: 6 total, 5 up, 6 in 2024-02-16T22:24:56.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:56 smithi173 ceph-mon[83703]: failed to encode map e51 with expected crc 2024-02-16T22:24:56.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:56 smithi173 ceph-mon[83703]: failed to encode map e51 with expected crc 2024-02-16T22:24:56.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:56 smithi173 ceph-mon[83703]: failed to encode map e51 with expected crc 2024-02-16T22:24:56.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:56 smithi173 ceph-mon[83703]: failed to encode map e51 with expected crc 2024-02-16T22:24:56.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:56 smithi173 ceph-mon[83703]: failed to encode map e51 with expected crc 2024-02-16T22:24:57.227 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:56 smithi134 podman[123704]: 2024-02-16 22:24:56.880641871 +0000 UTC m=+0.578461715 container remove 611d481a064f3f41d9a4a63ccd052ae466f11e884c0ee0821705ddfd01703cc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-deactivate, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-02-16T22:24:57.227 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:56 smithi134 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.0.service: Deactivated successfully. 2024-02-16T22:24:57.227 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:56 smithi134 systemd[1]: Stopped Ceph osd.0 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:24:57.227 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:56 smithi134 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.0.service: Consumed 55.202s CPU time. 2024-02-16T22:24:57.227 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:57 smithi134 systemd[1]: Starting Ceph osd.0 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:24:57.582 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:57 smithi134 ceph-mon[112514]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:57.582 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:57 smithi134 podman[123808]: 2024-02-16 22:24:57.231546267 +0000 UTC m=+0.017840689 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:24:57.582 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:57 smithi134 podman[123808]: 2024-02-16 22:24:57.340254561 +0000 UTC m=+0.126548981 container create 929ab0df36c584ee79e7035c92be75a21dde419f773357bdd6f213e44b07b257 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-16T22:24:57.582 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:57 smithi134 podman[123808]: 2024-02-16 22:24:57.57644654 +0000 UTC m=+0.362740959 container init 929ab0df36c584ee79e7035c92be75a21dde419f773357bdd6f213e44b07b257 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux ) 2024-02-16T22:24:57.582 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:57 smithi134 podman[123808]: 2024-02-16 22:24:57.579507724 +0000 UTC m=+0.365802150 container start 929ab0df36c584ee79e7035c92be75a21dde419f773357bdd6f213e44b07b257 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-02-16T22:24:57.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:57 smithi173 ceph-mon[83703]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:24:57.977 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:57 smithi134 podman[123808]: 2024-02-16 22:24:57.676645318 +0000 UTC m=+0.462939754 container attach 929ab0df36c584ee79e7035c92be75a21dde419f773357bdd6f213e44b07b257 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-activate, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:24:58.344 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-activate[123822]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-16T22:24:58.345 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-activate[123822]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-16T22:24:58.345 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 bash[123808]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-16T22:24:58.345 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 bash[123808]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-16T22:24:58.345 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 bash[123808]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-16T22:24:58.345 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 bash[123808]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-16T22:24:58.345 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 bash[123808]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-16T22:24:58.345 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 bash[123808]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-16T22:24:58.345 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 bash[123808]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-16T22:24:58.345 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-activate[123822]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-16T22:24:58.345 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-activate[123822]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-16T22:24:58.345 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-activate[123822]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-16T22:24:58.345 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-activate[123822]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-16T22:24:58.345 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-activate[123822]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-16T22:24:58.346 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 podman[123808]: 2024-02-16 22:24:58.043699416 +0000 UTC m=+0.829993829 container died 929ab0df36c584ee79e7035c92be75a21dde419f773357bdd6f213e44b07b257 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:24:58.916 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 podman[123960]: 2024-02-16 22:24:58.655764534 +0000 UTC m=+0.606957183 container remove 929ab0df36c584ee79e7035c92be75a21dde419f773357bdd6f213e44b07b257 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-activate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-02-16T22:24:58.916 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 podman[124023]: 2024-02-16 22:24:58.771254907 +0000 UTC m=+0.017745217 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:24:58.916 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:58 smithi134 podman[124023]: 2024-02-16 22:24:58.915310879 +0000 UTC m=+0.161801221 container create d0153b47ae7ea82550d847dc804cba182c6b6d801ca6c43167ad136ce25c79c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-02-16T22:24:59.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:24:59 smithi134 ceph-mon[112514]: Health check failed: Degraded data redundancy: 70/357 objects degraded (19.608%), 19 pgs degraded (PG_DEGRADED) 2024-02-16T22:24:59.202 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:59 smithi134 podman[124023]: 2024-02-16 22:24:59.109930341 +0000 UTC m=+0.356420649 container init d0153b47ae7ea82550d847dc804cba182c6b6d801ca6c43167ad136ce25c79c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-16T22:24:59.203 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:59 smithi134 podman[124023]: 2024-02-16 22:24:59.113403381 +0000 UTC m=+0.359893683 container start d0153b47ae7ea82550d847dc804cba182c6b6d801ca6c43167ad136ce25c79c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-02-16T22:24:59.203 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:59 smithi134 ceph-osd[124042]: -- 172.21.15.134:0/1637901998 <== mon.0 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b7859291e0 con 0x55b7858fac00 2024-02-16T22:24:59.477 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:59 smithi134 bash[124023]: d0153b47ae7ea82550d847dc804cba182c6b6d801ca6c43167ad136ce25c79c4 2024-02-16T22:24:59.477 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:59 smithi134 systemd[1]: Started Ceph osd.0 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:24:59.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:24:59 smithi173 ceph-mon[83703]: Health check failed: Degraded data redundancy: 70/357 objects degraded (19.608%), 19 pgs degraded (PG_DEGRADED) 2024-02-16T22:24:59.966 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:24:59 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0[124038]: 2024-02-16T22:24:59.659+0000 7f1bde2087c0 -1 Falling back to public interface 2024-02-16T22:25:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:00 smithi134 ceph-mon[112514]: pgmap v46: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2024-02-16T22:25:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:00 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:00 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:00 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:25:00.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:00 smithi173 ceph-mon[83703]: pgmap v46: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2024-02-16T22:25:00.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:00 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:00.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:00 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:00.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:00 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:25:00.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.782+0000 7f9fba1d2700 1 -- 172.21.15.134:0/2183463923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fb4102800 msgr2=0x7f9fb40fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:00.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.782+0000 7f9fba1d2700 1 --2- 172.21.15.134:0/2183463923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fb4102800 0x7f9fb40fbe70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8004940 tx=0x7f9fa8009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:00.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.782+0000 7f9fba1d2700 1 -- 172.21.15.134:0/2183463923 shutdown_connections 2024-02-16T22:25:00.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.782+0000 7f9fba1d2700 1 --2- 172.21.15.134:0/2183463923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fb4102800 0x7f9fb40fbe70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:00.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.782+0000 7f9fba1d2700 1 --2- 172.21.15.134:0/2183463923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb4101e60 0x7f9fb4102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:00.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.782+0000 7f9fba1d2700 1 -- 172.21.15.134:0/2183463923 >> 172.21.15.134:0/2183463923 conn(0x7f9fb40f7a10 msgr2=0x7f9fb40f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:00.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.782+0000 7f9fba1d2700 1 -- 172.21.15.134:0/2183463923 shutdown_connections 2024-02-16T22:25:00.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.782+0000 7f9fba1d2700 1 -- 172.21.15.134:0/2183463923 wait complete. 2024-02-16T22:25:00.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.782+0000 7f9fba1d2700 1 Processor -- start 2024-02-16T22:25:00.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.782+0000 7f9fba1d2700 1 -- start start 2024-02-16T22:25:00.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9fba1d2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb4101e60 0x7f9fb410eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:00.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9fba1d2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fb4102800 0x7f9fb410f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:00.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9fba1d2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb410f610 con 0x7f9fb4102800 2024-02-16T22:25:00.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9fba1d2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb410f780 con 0x7f9fb4101e60 2024-02-16T22:25:00.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9fb2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fb4102800 0x7f9fb410f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:00.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9fb2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fb4102800 0x7f9fb410f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51928/0 (socket says 172.21.15.134:51928) 2024-02-16T22:25:00.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9fb2ffd700 1 -- 172.21.15.134:0/1134806763 learned_addr learned my addr 172.21.15.134:0/1134806763 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:25:00.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9fb37fe700 1 --2- 172.21.15.134:0/1134806763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb4101e60 0x7f9fb410eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:00.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9fb2ffd700 1 -- 172.21.15.134:0/1134806763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb4101e60 msgr2=0x7f9fb410eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:00.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9fb2ffd700 1 --2- 172.21.15.134:0/1134806763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb4101e60 0x7f9fb410eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:00.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9fb2ffd700 1 -- 172.21.15.134:0/1134806763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa8005040 con 0x7f9fb4102800 2024-02-16T22:25:00.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9fb2ffd700 1 --2- 172.21.15.134:0/1134806763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fb4102800 0x7f9fb410f080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80090d0 tx=0x7f9fa8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:00.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9f9bfff700 1 -- 172.21.15.134:0/1134806763 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fa800e040 con 0x7f9fb4102800 2024-02-16T22:25:00.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9fba1d2700 1 -- 172.21.15.134:0/1134806763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb4117ab0 con 0x7f9fb4102800 2024-02-16T22:25:00.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.783+0000 7f9f9bfff700 1 -- 172.21.15.134:0/1134806763 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fa8009430 con 0x7f9fb4102800 2024-02-16T22:25:00.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.784+0000 7f9f9bfff700 1 -- 172.21.15.134:0/1134806763 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fa801c3f0 con 0x7f9fb4102800 2024-02-16T22:25:00.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.784+0000 7f9fba1d2700 1 -- 172.21.15.134:0/1134806763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb4117fa0 con 0x7f9fb4102800 2024-02-16T22:25:00.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.785+0000 7f9fba1d2700 1 -- 172.21.15.134:0/1134806763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb4104330 con 0x7f9fb4102800 2024-02-16T22:25:00.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.785+0000 7f9f9bfff700 1 -- 172.21.15.134:0/1134806763 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f9fa800bbf0 con 0x7f9fb4102800 2024-02-16T22:25:00.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.786+0000 7f9f9bfff700 1 --2- 172.21.15.134:0/1134806763 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9f9c06d900 0x7f9f9c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:00.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.786+0000 7f9f9bfff700 1 -- 172.21.15.134:0/1134806763 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f9fa808e3a0 con 0x7f9fb4102800 2024-02-16T22:25:00.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.786+0000 7f9fb37fe700 1 --2- 172.21.15.134:0/1134806763 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9f9c06d900 0x7f9f9c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:00.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.786+0000 7f9fb37fe700 1 --2- 172.21.15.134:0/1134806763 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9f9c06d900 0x7f9f9c06fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4004eb0 tx=0x7f9fa400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:00.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:00.790+0000 7f9f9bfff700 1 -- 172.21.15.134:0/1134806763 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9fa8057aa0 con 0x7f9fb4102800 2024-02-16T22:25:01.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.009+0000 7f9fba1d2700 1 -- 172.21.15.134:0/1134806763 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fb40667b0 con 0x7f9f9c06d900 2024-02-16T22:25:01.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.011+0000 7f9f9bfff700 1 -- 172.21.15.134:0/1134806763 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9fb40667b0 con 0x7f9f9c06d900 2024-02-16T22:25:01.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.013+0000 7f9fba1d2700 1 -- 172.21.15.134:0/1134806763 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9f9c06d900 msgr2=0x7f9f9c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:01.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.013+0000 7f9fba1d2700 1 --2- 172.21.15.134:0/1134806763 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9f9c06d900 0x7f9f9c06fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4004eb0 tx=0x7f9fa400b040 comp rx=0 tx=0).stop 2024-02-16T22:25:01.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.013+0000 7f9fba1d2700 1 -- 172.21.15.134:0/1134806763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fb4102800 msgr2=0x7f9fb410f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:01.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.013+0000 7f9fba1d2700 1 --2- 172.21.15.134:0/1134806763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fb4102800 0x7f9fb410f080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80090d0 tx=0x7f9fa8009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:01.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.013+0000 7f9fba1d2700 1 -- 172.21.15.134:0/1134806763 shutdown_connections 2024-02-16T22:25:01.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.013+0000 7f9fba1d2700 1 --2- 172.21.15.134:0/1134806763 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9f9c06d900 0x7f9f9c06fdb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.013+0000 7f9fba1d2700 1 --2- 172.21.15.134:0/1134806763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb4101e60 0x7f9fb410eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.013+0000 7f9fba1d2700 1 --2- 172.21.15.134:0/1134806763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fb4102800 0x7f9fb410f080 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.013+0000 7f9fba1d2700 1 -- 172.21.15.134:0/1134806763 >> 172.21.15.134:0/1134806763 conn(0x7f9fb40f7a10 msgr2=0x7f9fb40f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:01.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.013+0000 7f9fba1d2700 1 -- 172.21.15.134:0/1134806763 shutdown_connections 2024-02-16T22:25:01.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.013+0000 7f9fba1d2700 1 -- 172.21.15.134:0/1134806763 wait complete. 2024-02-16T22:25:01.026 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:25:01.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.118+0000 7f9f926bc700 1 -- 172.21.15.134:0/1192248800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f8c1027e0 msgr2=0x7f9f8c0fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:01.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.118+0000 7f9f926bc700 1 --2- 172.21.15.134:0/1192248800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f8c1027e0 0x7f9f8c0fbea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9f80004940 tx=0x7f9f80009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:01.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.118+0000 7f9f926bc700 1 -- 172.21.15.134:0/1192248800 shutdown_connections 2024-02-16T22:25:01.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.118+0000 7f9f926bc700 1 --2- 172.21.15.134:0/1192248800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f8c1027e0 0x7f9f8c0fbea0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.118+0000 7f9f926bc700 1 --2- 172.21.15.134:0/1192248800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f8c101e40 0x7f9f8c102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.118+0000 7f9f926bc700 1 -- 172.21.15.134:0/1192248800 >> 172.21.15.134:0/1192248800 conn(0x7f9f8c071d90 msgr2=0x7f9f8c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:01.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.118+0000 7f9f926bc700 1 -- 172.21.15.134:0/1192248800 shutdown_connections 2024-02-16T22:25:01.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.118+0000 7f9f926bc700 1 -- 172.21.15.134:0/1192248800 wait complete. 2024-02-16T22:25:01.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.118+0000 7f9f926bc700 1 Processor -- start 2024-02-16T22:25:01.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.119+0000 7f9f926bc700 1 -- start start 2024-02-16T22:25:01.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.119+0000 7f9f926bc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f8c101e40 0x7f9f8c10eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:01.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.119+0000 7f9f926bc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f8c1027e0 0x7f9f8c10f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:01.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.119+0000 7f9f926bc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c10f600 con 0x7f9f8c1027e0 2024-02-16T22:25:01.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.119+0000 7f9f926bc700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c10f770 con 0x7f9f8c101e40 2024-02-16T22:25:01.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.119+0000 7f9f8b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f8c1027e0 0x7f9f8c10f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:01.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.119+0000 7f9f8b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f8c1027e0 0x7f9f8c10f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51948/0 (socket says 172.21.15.134:51948) 2024-02-16T22:25:01.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.119+0000 7f9f8b7fe700 1 -- 172.21.15.134:0/3946586498 learned_addr learned my addr 172.21.15.134:0/3946586498 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:25:01.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.119+0000 7f9f8bfff700 1 --2- 172.21.15.134:0/3946586498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f8c101e40 0x7f9f8c10eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:01.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.119+0000 7f9f8b7fe700 1 -- 172.21.15.134:0/3946586498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f8c101e40 msgr2=0x7f9f8c10eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:01.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.119+0000 7f9f8b7fe700 1 --2- 172.21.15.134:0/3946586498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f8c101e40 0x7f9f8c10eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.119+0000 7f9f8b7fe700 1 -- 172.21.15.134:0/3946586498 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80005040 con 0x7f9f8c1027e0 2024-02-16T22:25:01.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.119+0000 7f9f8b7fe700 1 --2- 172.21.15.134:0/3946586498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f8c1027e0 0x7f9f8c10f050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009100 tx=0x7f9f80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:01.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.119+0000 7f9f88ff9700 1 -- 172.21.15.134:0/3946586498 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f8000e040 con 0x7f9f8c1027e0 2024-02-16T22:25:01.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.120+0000 7f9f88ff9700 1 -- 172.21.15.134:0/3946586498 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f80004290 con 0x7f9f8c1027e0 2024-02-16T22:25:01.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.120+0000 7f9f88ff9700 1 -- 172.21.15.134:0/3946586498 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f8001c3f0 con 0x7f9f8c1027e0 2024-02-16T22:25:01.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.120+0000 7f9f926bc700 1 -- 172.21.15.134:0/3946586498 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8c117a80 con 0x7f9f8c1027e0 2024-02-16T22:25:01.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.120+0000 7f9f926bc700 1 -- 172.21.15.134:0/3946586498 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c117f90 con 0x7f9f8c1027e0 2024-02-16T22:25:01.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.120+0000 7f9f926bc700 1 -- 172.21.15.134:0/3946586498 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8c104310 con 0x7f9f8c1027e0 2024-02-16T22:25:01.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.121+0000 7f9f88ff9700 1 -- 172.21.15.134:0/3946586498 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f9f8000bbf0 con 0x7f9f8c1027e0 2024-02-16T22:25:01.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.122+0000 7f9f88ff9700 1 --2- 172.21.15.134:0/3946586498 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9f7406d900 0x7f9f7406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:01.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.122+0000 7f9f8bfff700 1 --2- 172.21.15.134:0/3946586498 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9f7406d900 0x7f9f7406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:01.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.122+0000 7f9f88ff9700 1 -- 172.21.15.134:0/3946586498 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f9f8008e1f0 con 0x7f9f8c1027e0 2024-02-16T22:25:01.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.122+0000 7f9f8bfff700 1 --2- 172.21.15.134:0/3946586498 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9f7406d900 0x7f9f7406fdb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c004f40 tx=0x7f9f7c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:01.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.128+0000 7f9f88ff9700 1 -- 172.21.15.134:0/3946586498 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9f80057990 con 0x7f9f8c1027e0 2024-02-16T22:25:01.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.344+0000 7f9f926bc700 1 -- 172.21.15.134:0/3946586498 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f8c117c10 con 0x7f9f7406d900 2024-02-16T22:25:01.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.345+0000 7f9f88ff9700 1 -- 172.21.15.134:0/3946586498 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9f8c117c10 con 0x7f9f7406d900 2024-02-16T22:25:01.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.347+0000 7f9f926bc700 1 -- 172.21.15.134:0/3946586498 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9f7406d900 msgr2=0x7f9f7406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:01.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.347+0000 7f9f926bc700 1 --2- 172.21.15.134:0/3946586498 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9f7406d900 0x7f9f7406fdb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c004f40 tx=0x7f9f7c00b040 comp rx=0 tx=0).stop 2024-02-16T22:25:01.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.347+0000 7f9f926bc700 1 -- 172.21.15.134:0/3946586498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f8c1027e0 msgr2=0x7f9f8c10f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:01.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.347+0000 7f9f926bc700 1 --2- 172.21.15.134:0/3946586498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f8c1027e0 0x7f9f8c10f050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009100 tx=0x7f9f80009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:01.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.347+0000 7f9f926bc700 1 -- 172.21.15.134:0/3946586498 shutdown_connections 2024-02-16T22:25:01.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.347+0000 7f9f926bc700 1 --2- 172.21.15.134:0/3946586498 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9f7406d900 0x7f9f7406fdb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.347+0000 7f9f926bc700 1 --2- 172.21.15.134:0/3946586498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f8c101e40 0x7f9f8c10eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.347+0000 7f9f926bc700 1 --2- 172.21.15.134:0/3946586498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f8c1027e0 0x7f9f8c10f050 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.347+0000 7f9f926bc700 1 -- 172.21.15.134:0/3946586498 >> 172.21.15.134:0/3946586498 conn(0x7f9f8c071d90 msgr2=0x7f9f8c0fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:01.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.347+0000 7f9f926bc700 1 -- 172.21.15.134:0/3946586498 shutdown_connections 2024-02-16T22:25:01.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.347+0000 7f9f926bc700 1 -- 172.21.15.134:0/3946586498 wait complete. 2024-02-16T22:25:01.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.450+0000 7f262419a700 1 -- 172.21.15.134:0/3612646523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f261c1027f0 msgr2=0x7f261c0fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:01.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.450+0000 7f262419a700 1 --2- 172.21.15.134:0/3612646523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f261c1027f0 0x7f261c0fbe60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2618004940 tx=0x7f2618009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:01.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.450+0000 7f262419a700 1 -- 172.21.15.134:0/3612646523 shutdown_connections 2024-02-16T22:25:01.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.450+0000 7f262419a700 1 --2- 172.21.15.134:0/3612646523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f261c1027f0 0x7f261c0fbe60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.450+0000 7f262419a700 1 --2- 172.21.15.134:0/3612646523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f261c101e50 0x7f261c102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.450+0000 7f262419a700 1 -- 172.21.15.134:0/3612646523 >> 172.21.15.134:0/3612646523 conn(0x7f261c0f79e0 msgr2=0x7f261c0f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:01.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.450+0000 7f262419a700 1 -- 172.21.15.134:0/3612646523 shutdown_connections 2024-02-16T22:25:01.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.450+0000 7f262419a700 1 -- 172.21.15.134:0/3612646523 wait complete. 2024-02-16T22:25:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.451+0000 7f262419a700 1 Processor -- start 2024-02-16T22:25:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.451+0000 7f262419a700 1 -- start start 2024-02-16T22:25:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.451+0000 7f262419a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f261c101e50 0x7f261c10eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.451+0000 7f262419a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f261c1027f0 0x7f261c10efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.451+0000 7f262419a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c10f570 con 0x7f261c1027f0 2024-02-16T22:25:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.451+0000 7f262419a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c10f6b0 con 0x7f261c101e50 2024-02-16T22:25:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.452+0000 7f2621735700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f261c1027f0 0x7f261c10efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.452+0000 7f2621735700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f261c1027f0 0x7f261c10efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44526/0 (socket says 172.21.15.134:44526) 2024-02-16T22:25:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.452+0000 7f2621735700 1 -- 172.21.15.134:0/4176746266 learned_addr learned my addr 172.21.15.134:0/4176746266 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:25:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.452+0000 7f2621f36700 1 --2- 172.21.15.134:0/4176746266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f261c101e50 0x7f261c10eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.452+0000 7f2621735700 1 -- 172.21.15.134:0/4176746266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f261c101e50 msgr2=0x7f261c10eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.452+0000 7f2621735700 1 --2- 172.21.15.134:0/4176746266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f261c101e50 0x7f261c10eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.452+0000 7f2621735700 1 -- 172.21.15.134:0/4176746266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618005040 con 0x7f261c1027f0 2024-02-16T22:25:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.452+0000 7f2621f36700 1 --2- 172.21.15.134:0/4176746266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f261c101e50 0x7f261c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:25:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.452+0000 7f2621735700 1 --2- 172.21.15.134:0/4176746266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f261c1027f0 0x7f261c10efe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2618000c00 tx=0x7f2618009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.452+0000 7f26127fc700 1 -- 172.21.15.134:0/4176746266 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2618021070 con 0x7f261c1027f0 2024-02-16T22:25:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.452+0000 7f26127fc700 1 -- 172.21.15.134:0/4176746266 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2618013d00 con 0x7f261c1027f0 2024-02-16T22:25:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.452+0000 7f26127fc700 1 -- 172.21.15.134:0/4176746266 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f261800e070 con 0x7f261c1027f0 2024-02-16T22:25:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.452+0000 7f262419a700 1 -- 172.21.15.134:0/4176746266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c1179b0 con 0x7f261c1027f0 2024-02-16T22:25:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.452+0000 7f262419a700 1 -- 172.21.15.134:0/4176746266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c117e60 con 0x7f261c1027f0 2024-02-16T22:25:01.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.454+0000 7f262419a700 1 -- 172.21.15.134:0/4176746266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c104320 con 0x7f261c1027f0 2024-02-16T22:25:01.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.454+0000 7f26127fc700 1 -- 172.21.15.134:0/4176746266 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f261801caf0 con 0x7f261c1027f0 2024-02-16T22:25:01.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.454+0000 7f26127fc700 1 --2- 172.21.15.134:0/4176746266 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f260806d900 0x7f260806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:01.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.455+0000 7f26127fc700 1 -- 172.21.15.134:0/4176746266 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f261808e5d0 con 0x7f261c1027f0 2024-02-16T22:25:01.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.455+0000 7f2621f36700 1 --2- 172.21.15.134:0/4176746266 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f260806d900 0x7f260806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:01.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.455+0000 7f2621f36700 1 --2- 172.21.15.134:0/4176746266 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f260806d900 0x7f260806fdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f260c009b80 tx=0x7f260c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:01.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.460+0000 7f26127fc700 1 -- 172.21.15.134:0/4176746266 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2618057c70 con 0x7f261c1027f0 2024-02-16T22:25:01.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.680+0000 7f262419a700 1 -- 172.21.15.134:0/4176746266 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f261c04bf40 con 0x7f260806d900 2024-02-16T22:25:01.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.690+0000 7f26127fc700 1 -- 172.21.15.134:0/4176746266 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f261c04bf40 con 0x7f260806d900 2024-02-16T22:25:01.692 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:25:01.692 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (2m) 18s ago 13m 26.8M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:25:01.692 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (29s) 18s ago 14m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 429739bfee94 2024-02-16T22:25:01.692 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (23s) 20s ago 13m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 1e81cd2fd510 2024-02-16T22:25:01.692 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (2m) 18s ago 13m 84.5M - 9.4.12 a0ea5e3c46d9 29d29cf667e7 2024-02-16T22:25:01.692 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (8m) 18s ago 8m 13.9M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:25:01.692 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (8m) 18s ago 8m 125M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:25:01.692 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (8m) 20s ago 8m 16.9M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:25:01.692 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (8m) 20s ago 8m 118M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:25:01.693 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (4m) 18s ago 15m 494M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:25:01.693 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (3m) 20s ago 12m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:25:01.693 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (93s) 18s ago 15m 42.8M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2903b3988442 2024-02-16T22:25:01.693 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (69s) 20s ago 12m 39.0M 2048M 19.0.0-1450-gf78a58c0 f081f847070a dd7cf2f31226 2024-02-16T22:25:01.693 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (3m) 18s ago 14m 16.6M - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:25:01.693 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (3m) 20s ago 12m 14.6M - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:25:01.693 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 starting - - - 1557M 2024-02-16T22:25:01.693 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (11m) 18s ago 11m 233M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:25:01.693 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (11m) 18s ago 11m 190M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:25:01.693 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (10m) 20s ago 10m 267M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:25:01.693 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (10m) 20s ago 10m 237M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:25:01.694 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (9m) 20s ago 9m 231M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:25:01.694 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (3m) 18s ago 13m 59.4M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:25:01.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.692+0000 7f262419a700 1 -- 172.21.15.134:0/4176746266 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f260806d900 msgr2=0x7f260806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:01.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.692+0000 7f262419a700 1 --2- 172.21.15.134:0/4176746266 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f260806d900 0x7f260806fdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f260c009b80 tx=0x7f260c00b040 comp rx=0 tx=0).stop 2024-02-16T22:25:01.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.692+0000 7f262419a700 1 -- 172.21.15.134:0/4176746266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f261c1027f0 msgr2=0x7f261c10efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:01.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.692+0000 7f262419a700 1 --2- 172.21.15.134:0/4176746266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f261c1027f0 0x7f261c10efe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2618000c00 tx=0x7f2618009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:01.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.692+0000 7f262419a700 1 -- 172.21.15.134:0/4176746266 shutdown_connections 2024-02-16T22:25:01.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.692+0000 7f262419a700 1 --2- 172.21.15.134:0/4176746266 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f260806d900 0x7f260806fdb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.692+0000 7f262419a700 1 --2- 172.21.15.134:0/4176746266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f261c101e50 0x7f261c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.692+0000 7f262419a700 1 --2- 172.21.15.134:0/4176746266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f261c1027f0 0x7f261c10efe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.692+0000 7f262419a700 1 -- 172.21.15.134:0/4176746266 >> 172.21.15.134:0/4176746266 conn(0x7f261c0f79e0 msgr2=0x7f261c0f93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:01.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.692+0000 7f262419a700 1 -- 172.21.15.134:0/4176746266 shutdown_connections 2024-02-16T22:25:01.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.692+0000 7f262419a700 1 -- 172.21.15.134:0/4176746266 wait complete. 2024-02-16T22:25:01.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.799+0000 7fc222714700 1 -- 172.21.15.134:0/1146039759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc21c1038f0 msgr2=0x7fc21c0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:01.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.799+0000 7fc222714700 1 --2- 172.21.15.134:0/1146039759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc21c1038f0 0x7fc21c0fcf60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc20c004940 tx=0x7fc20c009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.799+0000 7fc222714700 1 -- 172.21.15.134:0/1146039759 shutdown_connections 2024-02-16T22:25:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.799+0000 7fc222714700 1 --2- 172.21.15.134:0/1146039759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc21c1038f0 0x7fc21c0fcf60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.799+0000 7fc222714700 1 --2- 172.21.15.134:0/1146039759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc21c102f50 0x7fc21c103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.799+0000 7fc222714700 1 -- 172.21.15.134:0/1146039759 >> 172.21.15.134:0/1146039759 conn(0x7fc21c0f8ae0 msgr2=0x7fc21c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.799+0000 7fc222714700 1 -- 172.21.15.134:0/1146039759 shutdown_connections 2024-02-16T22:25:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.799+0000 7fc222714700 1 -- 172.21.15.134:0/1146039759 wait complete. 2024-02-16T22:25:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.800+0000 7fc222714700 1 Processor -- start 2024-02-16T22:25:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.800+0000 7fc222714700 1 -- start start 2024-02-16T22:25:01.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.800+0000 7fc222714700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc21c102f50 0x7fc21c115d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:01.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.800+0000 7fc222714700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc21c1038f0 0x7fc21c116240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:01.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.800+0000 7fc222714700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c116890 con 0x7fc21c102f50 2024-02-16T22:25:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.800+0000 7fc222714700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c10fba0 con 0x7fc21c1038f0 2024-02-16T22:25:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.800+0000 7fc21bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc21c102f50 0x7fc21c115d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.800+0000 7fc21bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc21c102f50 0x7fc21c115d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44542/0 (socket says 172.21.15.134:44542) 2024-02-16T22:25:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.800+0000 7fc21bfff700 1 -- 172.21.15.134:0/76997366 learned_addr learned my addr 172.21.15.134:0/76997366 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:25:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.800+0000 7fc21b7fe700 1 --2- 172.21.15.134:0/76997366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc21c1038f0 0x7fc21c116240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.801+0000 7fc21bfff700 1 -- 172.21.15.134:0/76997366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc21c1038f0 msgr2=0x7fc21c116240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.801+0000 7fc21bfff700 1 --2- 172.21.15.134:0/76997366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc21c1038f0 0x7fc21c116240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.801+0000 7fc21bfff700 1 -- 172.21.15.134:0/76997366 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c005040 con 0x7fc21c102f50 2024-02-16T22:25:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.801+0000 7fc21b7fe700 1 --2- 172.21.15.134:0/76997366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc21c1038f0 0x7fc21c116240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:25:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.801+0000 7fc21bfff700 1 --2- 172.21.15.134:0/76997366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc21c102f50 0x7fc21c115d00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc210002a50 tx=0x7fc2100046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.801+0000 7fc218ff9700 1 -- 172.21.15.134:0/76997366 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc210007cc0 con 0x7fc21c102f50 2024-02-16T22:25:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.801+0000 7fc218ff9700 1 -- 172.21.15.134:0/76997366 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc21000f040 con 0x7fc21c102f50 2024-02-16T22:25:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.801+0000 7fc222714700 1 -- 172.21.15.134:0/76997366 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c10fe80 con 0x7fc21c102f50 2024-02-16T22:25:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.801+0000 7fc218ff9700 1 -- 172.21.15.134:0/76997366 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc21000db70 con 0x7fc21c102f50 2024-02-16T22:25:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.801+0000 7fc222714700 1 -- 172.21.15.134:0/76997366 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c1103c0 con 0x7fc21c102f50 2024-02-16T22:25:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.802+0000 7fc222714700 1 -- 172.21.15.134:0/76997366 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c0fc6e0 con 0x7fc21c102f50 2024-02-16T22:25:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.802+0000 7fc218ff9700 1 -- 172.21.15.134:0/76997366 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fc21000dd10 con 0x7fc21c102f50 2024-02-16T22:25:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.803+0000 7fc218ff9700 1 --2- 172.21.15.134:0/76997366 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc20406d900 0x7fc20406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.803+0000 7fc218ff9700 1 -- 172.21.15.134:0/76997366 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc21008c730 con 0x7fc21c102f50 2024-02-16T22:25:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.803+0000 7fc21b7fe700 1 --2- 172.21.15.134:0/76997366 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc20406d900 0x7fc20406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.803+0000 7fc21b7fe700 1 --2- 172.21.15.134:0/76997366 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc20406d900 0x7fc20406fdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009fd0 tx=0x7fc20c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:01.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:01.807+0000 7fc218ff9700 1 -- 172.21.15.134:0/76997366 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc210059960 con 0x7fc21c102f50 2024-02-16T22:25:02.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.095+0000 7fc222714700 1 -- 172.21.15.134:0/76997366 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc21c111380 con 0x7fc21c102f50 2024-02-16T22:25:02.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.096+0000 7fc218ff9700 1 -- 172.21.15.134:0/76997366 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fc2100594f0 con 0x7fc21c102f50 2024-02-16T22:25:02.098 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:25:02.098 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:25:02.098 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:25:02.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:25:02.098 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:25:02.099 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:25:02.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:25:02.099 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:25:02.099 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 5 2024-02-16T22:25:02.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:25:02.099 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:25:02.099 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:25:02.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:25:02.099 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:25:02.099 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 9, 2024-02-16T22:25:02.099 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-16T22:25:02.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:25:02.099 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:25:02.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.099+0000 7fc222714700 1 -- 172.21.15.134:0/76997366 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc20406d900 msgr2=0x7fc20406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:02.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.099+0000 7fc222714700 1 --2- 172.21.15.134:0/76997366 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc20406d900 0x7fc20406fdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009fd0 tx=0x7fc20c009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:02.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.099+0000 7fc222714700 1 -- 172.21.15.134:0/76997366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc21c102f50 msgr2=0x7fc21c115d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:02.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.099+0000 7fc222714700 1 --2- 172.21.15.134:0/76997366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc21c102f50 0x7fc21c115d00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc210002a50 tx=0x7fc2100046b0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.099+0000 7fc222714700 1 -- 172.21.15.134:0/76997366 shutdown_connections 2024-02-16T22:25:02.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.099+0000 7fc222714700 1 --2- 172.21.15.134:0/76997366 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc20406d900 0x7fc20406fdb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.099+0000 7fc222714700 1 --2- 172.21.15.134:0/76997366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc21c102f50 0x7fc21c115d00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.099+0000 7fc222714700 1 --2- 172.21.15.134:0/76997366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc21c1038f0 0x7fc21c116240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.099+0000 7fc222714700 1 -- 172.21.15.134:0/76997366 >> 172.21.15.134:0/76997366 conn(0x7fc21c0f8ae0 msgr2=0x7fc21c0fa490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:02.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.099+0000 7fc222714700 1 -- 172.21.15.134:0/76997366 shutdown_connections 2024-02-16T22:25:02.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.099+0000 7fc222714700 1 -- 172.21.15.134:0/76997366 wait complete. 2024-02-16T22:25:02.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.213+0000 7f613df01700 1 -- 172.21.15.134:0/1843073505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61381027e0 msgr2=0x7f61380fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:02.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.213+0000 7f613df01700 1 --2- 172.21.15.134:0/1843073505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61381027e0 0x7f61380fbea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f612c004940 tx=0x7f612c009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:02.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.213+0000 7f613df01700 1 -- 172.21.15.134:0/1843073505 shutdown_connections 2024-02-16T22:25:02.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.213+0000 7f613df01700 1 --2- 172.21.15.134:0/1843073505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61381027e0 0x7f61380fbea0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.213+0000 7f613df01700 1 --2- 172.21.15.134:0/1843073505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6138101e40 0x7f6138102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.213+0000 7f613df01700 1 -- 172.21.15.134:0/1843073505 >> 172.21.15.134:0/1843073505 conn(0x7f6138071d90 msgr2=0x7f6138072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:02.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.213+0000 7f613df01700 1 -- 172.21.15.134:0/1843073505 shutdown_connections 2024-02-16T22:25:02.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.213+0000 7f613df01700 1 -- 172.21.15.134:0/1843073505 wait complete. 2024-02-16T22:25:02.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.214+0000 7f613df01700 1 Processor -- start 2024-02-16T22:25:02.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.214+0000 7f613df01700 1 -- start start 2024-02-16T22:25:02.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.215+0000 7f613df01700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6138101e40 0x7f6138112970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:02.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.215+0000 7f613df01700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61381027e0 0x7f6138112eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:02.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.215+0000 7f613df01700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6138113500 con 0x7f61381027e0 2024-02-16T22:25:02.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.215+0000 7f613df01700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613810c830 con 0x7f6138101e40 2024-02-16T22:25:02.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.215+0000 7f6136ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61381027e0 0x7f6138112eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:02.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.215+0000 7f6136ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61381027e0 0x7f6138112eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44556/0 (socket says 172.21.15.134:44556) 2024-02-16T22:25:02.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.215+0000 7f6136ffd700 1 -- 172.21.15.134:0/661077547 learned_addr learned my addr 172.21.15.134:0/661077547 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:25:02.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.215+0000 7f61377fe700 1 --2- 172.21.15.134:0/661077547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6138101e40 0x7f6138112970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:02.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.215+0000 7f6136ffd700 1 -- 172.21.15.134:0/661077547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6138101e40 msgr2=0x7f6138112970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:02.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.215+0000 7f6136ffd700 1 --2- 172.21.15.134:0/661077547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6138101e40 0x7f6138112970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.215+0000 7f6136ffd700 1 -- 172.21.15.134:0/661077547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c005040 con 0x7f61381027e0 2024-02-16T22:25:02.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.215+0000 7f61377fe700 1 --2- 172.21.15.134:0/661077547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6138101e40 0x7f6138112970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:25:02.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.215+0000 7f6136ffd700 1 --2- 172.21.15.134:0/661077547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61381027e0 0x7f6138112eb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f612c009100 tx=0x7f612c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:02.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.216+0000 7f611ffff700 1 -- 172.21.15.134:0/661077547 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f612c00e040 con 0x7f61381027e0 2024-02-16T22:25:02.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.216+0000 7f611ffff700 1 -- 172.21.15.134:0/661077547 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f612c004290 con 0x7f61381027e0 2024-02-16T22:25:02.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.216+0000 7f611ffff700 1 -- 172.21.15.134:0/661077547 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f612c01c3f0 con 0x7f61381027e0 2024-02-16T22:25:02.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.216+0000 7f613df01700 1 -- 172.21.15.134:0/661077547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613810cab0 con 0x7f61381027e0 2024-02-16T22:25:02.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.216+0000 7f613df01700 1 -- 172.21.15.134:0/661077547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613810cff0 con 0x7f61381027e0 2024-02-16T22:25:02.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.217+0000 7f613df01700 1 -- 172.21.15.134:0/661077547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6138104310 con 0x7f61381027e0 2024-02-16T22:25:02.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.217+0000 7f611ffff700 1 -- 172.21.15.134:0/661077547 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f612c013420 con 0x7f61381027e0 2024-02-16T22:25:02.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.218+0000 7f611ffff700 1 --2- 172.21.15.134:0/661077547 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f612006d900 0x7f612006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:02.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.218+0000 7f611ffff700 1 -- 172.21.15.134:0/661077547 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f612c08e280 con 0x7f61381027e0 2024-02-16T22:25:02.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.218+0000 7f61377fe700 1 --2- 172.21.15.134:0/661077547 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f612006d900 0x7f612006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:02.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.218+0000 7f61377fe700 1 --2- 172.21.15.134:0/661077547 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f612006d900 0x7f612006fdb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6128010520 tx=0x7f612800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:02.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.223+0000 7f611ffff700 1 -- 172.21.15.134:0/661077547 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f612c05b550 con 0x7f61381027e0 2024-02-16T22:25:02.468 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:02 smithi134 ceph-mon[112514]: pgmap v47: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2024-02-16T22:25:02.469 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:02 smithi134 ceph-mon[112514]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:02.469 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:02 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/76997366' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:02.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.474+0000 7f613df01700 1 -- 172.21.15.134:0/661077547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6138108f20 con 0x7f61381027e0 2024-02-16T22:25:02.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.475+0000 7f611ffff700 1 -- 172.21.15.134:0/661077547 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1860 (secure 0 0 0) 0x7f612c05b0e0 con 0x7f61381027e0 2024-02-16T22:25:02.477 INFO:teuthology.orchestra.run.smithi134.stdout:e20 2024-02-16T22:25:02.477 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:25:02.477 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:25:02.477 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-02-16T22:25:02.477 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:25:02.477 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-02-16T22:25:02.477 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-02-16T22:25:02.477 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 20 2024-02-16T22:25:02.477 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-16T22:25:02.477 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-02-16T22:23:22.543229+0000 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 2 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:in 0,1 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14478,1=24269} 2024-02-16T22:25:02.478 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-02-16T22:25:02.479 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-02-16T22:25:02.479 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-02-16T22:25:02.479 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-02-16T22:25:02.479 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-02-16T22:25:02.479 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-02-16T22:25:02.479 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-02-16T22:25:02.479 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-02-16T22:25:02.479 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-02-16T22:25:02.479 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.jyajef{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:25:02.479 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.qljqef{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:25:02.479 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:25:02.479 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:25:02.479 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-02-16T22:25:02.479 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:25:02.480 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.cygfxr{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2804816044,v1:172.21.15.134:6827/2804816044] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:25:02.480 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.phstvm{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:25:02.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.478+0000 7f613df01700 1 -- 172.21.15.134:0/661077547 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f612006d900 msgr2=0x7f612006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:02.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.478+0000 7f613df01700 1 --2- 172.21.15.134:0/661077547 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f612006d900 0x7f612006fdb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6128010520 tx=0x7f612800b040 comp rx=0 tx=0).stop 2024-02-16T22:25:02.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.478+0000 7f613df01700 1 -- 172.21.15.134:0/661077547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61381027e0 msgr2=0x7f6138112eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:02.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.478+0000 7f613df01700 1 --2- 172.21.15.134:0/661077547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61381027e0 0x7f6138112eb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f612c009100 tx=0x7f612c009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:02.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.478+0000 7f613df01700 1 -- 172.21.15.134:0/661077547 shutdown_connections 2024-02-16T22:25:02.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.478+0000 7f613df01700 1 --2- 172.21.15.134:0/661077547 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f612006d900 0x7f612006fdb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.478+0000 7f613df01700 1 --2- 172.21.15.134:0/661077547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6138101e40 0x7f6138112970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.478+0000 7f613df01700 1 --2- 172.21.15.134:0/661077547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61381027e0 0x7f6138112eb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.478+0000 7f613df01700 1 -- 172.21.15.134:0/661077547 >> 172.21.15.134:0/661077547 conn(0x7f6138071d90 msgr2=0x7f61380fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:02.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.478+0000 7f613df01700 1 -- 172.21.15.134:0/661077547 shutdown_connections 2024-02-16T22:25:02.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.478+0000 7f613df01700 1 -- 172.21.15.134:0/661077547 wait complete. 2024-02-16T22:25:02.481 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 20 2024-02-16T22:25:02.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:02 smithi173 ceph-mon[83703]: pgmap v47: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2024-02-16T22:25:02.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:02 smithi173 ceph-mon[83703]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:02.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:02 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/76997366' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:02.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.587+0000 7f0460947700 1 -- 172.21.15.134:0/506010441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c103140 msgr2=0x7f045c103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:02.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.587+0000 7f0460947700 1 --2- 172.21.15.134:0/506010441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c103140 0x7f045c103510 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f044c004940 tx=0x7f044c009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:02.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.587+0000 7f0460947700 1 -- 172.21.15.134:0/506010441 shutdown_connections 2024-02-16T22:25:02.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.587+0000 7f0460947700 1 --2- 172.21.15.134:0/506010441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f045c0fb570 0x7f045c0fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.587+0000 7f0460947700 1 --2- 172.21.15.134:0/506010441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c103140 0x7f045c103510 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.587+0000 7f0460947700 1 -- 172.21.15.134:0/506010441 >> 172.21.15.134:0/506010441 conn(0x7f045c071560 msgr2=0x7f045c071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:02.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.587+0000 7f0460947700 1 -- 172.21.15.134:0/506010441 shutdown_connections 2024-02-16T22:25:02.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.587+0000 7f0460947700 1 -- 172.21.15.134:0/506010441 wait complete. 2024-02-16T22:25:02.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.587+0000 7f0460947700 1 Processor -- start 2024-02-16T22:25:02.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.587+0000 7f0460947700 1 -- start start 2024-02-16T22:25:02.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f0460947700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f045c0fb570 0x7f045c113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:02.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f0460947700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c103140 0x7f045c114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:02.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f0460947700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c1146c0 con 0x7f045c103140 2024-02-16T22:25:02.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f0460947700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c10d9f0 con 0x7f045c0fb570 2024-02-16T22:25:02.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f0459d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c103140 0x7f045c114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:02.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f0459d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c103140 0x7f045c114070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44566/0 (socket says 172.21.15.134:44566) 2024-02-16T22:25:02.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f0459d9b700 1 -- 172.21.15.134:0/3184689615 learned_addr learned my addr 172.21.15.134:0/3184689615 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:25:02.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f045a59c700 1 --2- 172.21.15.134:0/3184689615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f045c0fb570 0x7f045c113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:02.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f0459d9b700 1 -- 172.21.15.134:0/3184689615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f045c0fb570 msgr2=0x7f045c113b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:02.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f0459d9b700 1 --2- 172.21.15.134:0/3184689615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f045c0fb570 0x7f045c113b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f0459d9b700 1 -- 172.21.15.134:0/3184689615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c005040 con 0x7f045c103140 2024-02-16T22:25:02.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f0459d9b700 1 --2- 172.21.15.134:0/3184689615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c103140 0x7f045c114070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f045000eb40 tx=0x7f045000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:02.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f044affd700 1 -- 172.21.15.134:0/3184689615 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0450007cc0 con 0x7f045c103140 2024-02-16T22:25:02.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f0460947700 1 -- 172.21.15.134:0/3184689615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045c10dc70 con 0x7f045c103140 2024-02-16T22:25:02.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f0460947700 1 -- 172.21.15.134:0/3184689615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045c10e1b0 con 0x7f045c103140 2024-02-16T22:25:02.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.588+0000 7f044affd700 1 -- 172.21.15.134:0/3184689615 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f045000f040 con 0x7f045c103140 2024-02-16T22:25:02.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.589+0000 7f044affd700 1 -- 172.21.15.134:0/3184689615 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f045000ca10 con 0x7f045c103140 2024-02-16T22:25:02.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.590+0000 7f0460947700 1 -- 172.21.15.134:0/3184689615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c0052e0 con 0x7f045c103140 2024-02-16T22:25:02.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.590+0000 7f044affd700 1 -- 172.21.15.134:0/3184689615 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f045000cb70 con 0x7f045c103140 2024-02-16T22:25:02.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.590+0000 7f044affd700 1 --2- 172.21.15.134:0/3184689615 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f044406d900 0x7f044406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:02.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.590+0000 7f044affd700 1 -- 172.21.15.134:0/3184689615 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f045008caf0 con 0x7f045c103140 2024-02-16T22:25:02.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.590+0000 7f045a59c700 1 --2- 172.21.15.134:0/3184689615 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f044406d900 0x7f044406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:02.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.591+0000 7f045a59c700 1 --2- 172.21.15.134:0/3184689615 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f044406d900 0x7f044406fdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f044c00b0d0 tx=0x7f044c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:02.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.596+0000 7f044affd700 1 -- 172.21.15.134:0/3184689615 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0450059dd0 con 0x7f045c103140 2024-02-16T22:25:02.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.819+0000 7f0460947700 1 -- 172.21.15.134:0/3184689615 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f043c000bf0 con 0x7f044406d900 2024-02-16T22:25:02.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.820+0000 7f044affd700 1 -- 172.21.15.134:0/3184689615 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f043c000bf0 con 0x7f044406d900 2024-02-16T22:25:02.822 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:25:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:25:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:25:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-16T22:25:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-02-16T22:25:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-02-16T22:25:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-02-16T22:25:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-02-16T22:25:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-02-16T22:25:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "6/21 daemons upgraded", 2024-02-16T22:25:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-02-16T22:25:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:25:02.823 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:25:02.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.823+0000 7f0460947700 1 -- 172.21.15.134:0/3184689615 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f044406d900 msgr2=0x7f044406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:02.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.823+0000 7f0460947700 1 --2- 172.21.15.134:0/3184689615 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f044406d900 0x7f044406fdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f044c00b0d0 tx=0x7f044c009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:02.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.823+0000 7f0460947700 1 -- 172.21.15.134:0/3184689615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c103140 msgr2=0x7f045c114070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:02.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.823+0000 7f0460947700 1 --2- 172.21.15.134:0/3184689615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c103140 0x7f045c114070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f045000eb40 tx=0x7f045000b040 comp rx=0 tx=0).stop 2024-02-16T22:25:02.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.823+0000 7f0460947700 1 -- 172.21.15.134:0/3184689615 shutdown_connections 2024-02-16T22:25:02.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.823+0000 7f0460947700 1 --2- 172.21.15.134:0/3184689615 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f044406d900 0x7f044406fdb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.823+0000 7f0460947700 1 --2- 172.21.15.134:0/3184689615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f045c0fb570 0x7f045c113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.823+0000 7f0460947700 1 --2- 172.21.15.134:0/3184689615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c103140 0x7f045c114070 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.823+0000 7f0460947700 1 -- 172.21.15.134:0/3184689615 >> 172.21.15.134:0/3184689615 conn(0x7f045c071560 msgr2=0x7f045c0fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:02.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.823+0000 7f0460947700 1 -- 172.21.15.134:0/3184689615 shutdown_connections 2024-02-16T22:25:02.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.823+0000 7f0460947700 1 -- 172.21.15.134:0/3184689615 wait complete. 2024-02-16T22:25:02.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.932+0000 7f020bc02700 1 -- 172.21.15.134:0/2893405504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0204101e40 msgr2=0x7f0204102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:02.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.932+0000 7f020bc02700 1 --2- 172.21.15.134:0/2893405504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0204101e40 0x7f0204102210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0200004940 tx=0x7f0200009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.933+0000 7f020bc02700 1 -- 172.21.15.134:0/2893405504 shutdown_connections 2024-02-16T22:25:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.933+0000 7f020bc02700 1 --2- 172.21.15.134:0/2893405504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02041027e0 0x7f02040fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.933+0000 7f020bc02700 1 --2- 172.21.15.134:0/2893405504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0204101e40 0x7f0204102210 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.933+0000 7f020bc02700 1 -- 172.21.15.134:0/2893405504 >> 172.21.15.134:0/2893405504 conn(0x7f0204071d90 msgr2=0x7f0204072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.933+0000 7f020bc02700 1 -- 172.21.15.134:0/2893405504 shutdown_connections 2024-02-16T22:25:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.933+0000 7f020bc02700 1 -- 172.21.15.134:0/2893405504 wait complete. 2024-02-16T22:25:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.933+0000 7f020bc02700 1 Processor -- start 2024-02-16T22:25:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.933+0000 7f020bc02700 1 -- start start 2024-02-16T22:25:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.933+0000 7f020bc02700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0204101e40 0x7f020410ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.933+0000 7f020bc02700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02041027e0 0x7f020410efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.933+0000 7f020bc02700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020410f550 con 0x7f0204101e40 2024-02-16T22:25:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.933+0000 7f020bc02700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020410f6c0 con 0x7f02041027e0 2024-02-16T22:25:02.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.934+0000 7f020999e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0204101e40 0x7f020410ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.934+0000 7f020999e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0204101e40 0x7f020410ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44594/0 (socket says 172.21.15.134:44594) 2024-02-16T22:25:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.934+0000 7f020999e700 1 -- 172.21.15.134:0/2198032491 learned_addr learned my addr 172.21.15.134:0/2198032491 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:25:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.934+0000 7f020919d700 1 --2- 172.21.15.134:0/2198032491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02041027e0 0x7f020410efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.934+0000 7f020999e700 1 -- 172.21.15.134:0/2198032491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02041027e0 msgr2=0x7f020410efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.934+0000 7f020999e700 1 --2- 172.21.15.134:0/2198032491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02041027e0 0x7f020410efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:02.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.934+0000 7f020999e700 1 -- 172.21.15.134:0/2198032491 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0200005040 con 0x7f0204101e40 2024-02-16T22:25:02.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.934+0000 7f020999e700 1 --2- 172.21.15.134:0/2198032491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0204101e40 0x7f020410ea80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f020000b3b0 tx=0x7f0200009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:02.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.934+0000 7f01fa7fc700 1 -- 172.21.15.134:0/2198032491 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f020000e040 con 0x7f0204101e40 2024-02-16T22:25:02.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.934+0000 7f01fa7fc700 1 -- 172.21.15.134:0/2198032491 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f020000bbf0 con 0x7f0204101e40 2024-02-16T22:25:02.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.934+0000 7f020bc02700 1 -- 172.21.15.134:0/2198032491 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02041179f0 con 0x7f0204101e40 2024-02-16T22:25:02.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.934+0000 7f020bc02700 1 -- 172.21.15.134:0/2198032491 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0204117ee0 con 0x7f0204101e40 2024-02-16T22:25:02.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.934+0000 7f01fa7fc700 1 -- 172.21.15.134:0/2198032491 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f020001c3f0 con 0x7f0204101e40 2024-02-16T22:25:02.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.935+0000 7f020bc02700 1 -- 172.21.15.134:0/2198032491 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e80052e0 con 0x7f0204101e40 2024-02-16T22:25:02.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.936+0000 7f01fa7fc700 1 -- 172.21.15.134:0/2198032491 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f020000bd60 con 0x7f0204101e40 2024-02-16T22:25:02.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.936+0000 7f01fa7fc700 1 --2- 172.21.15.134:0/2198032491 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f01f006d900 0x7f01f006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:02.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.937+0000 7f01fa7fc700 1 -- 172.21.15.134:0/2198032491 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f020008e310 con 0x7f0204101e40 2024-02-16T22:25:02.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.937+0000 7f020919d700 1 --2- 172.21.15.134:0/2198032491 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f01f006d900 0x7f01f006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:02.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.937+0000 7f020919d700 1 --2- 172.21.15.134:0/2198032491 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f01f006d900 0x7f01f006fdb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f02040661e0 tx=0x7f01f400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:02.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:02.941+0000 7f01fa7fc700 1 -- 172.21.15.134:0/2198032491 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0200057ab0 con 0x7f0204101e40 2024-02-16T22:25:03.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:03 smithi134 ceph-mon[112514]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:03.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:03 smithi134 ceph-mon[112514]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:03.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:03 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/661077547' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:25:03.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:03.236+0000 7f020bc02700 1 -- 172.21.15.134:0/2198032491 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f01e8005860 con 0x7f0204101e40 2024-02-16T22:25:03.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:03.236+0000 7f01fa7fc700 1 -- 172.21.15.134:0/2198032491 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1328 (secure 0 0 0) 0x7f020005b170 con 0x7f0204101e40 2024-02-16T22:25:03.238 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 70/357 objects degraded (19.608%), 19 pgs degraded 2024-02-16T22:25:03.238 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-16T22:25:03.238 INFO:teuthology.orchestra.run.smithi134.stdout: osd.0 (root=default,host=smithi134) is down 2024-02-16T22:25:03.238 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 70/357 objects degraded (19.608%), 19 pgs degraded 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-02-16T22:25:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-02-16T22:25:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-02-16T22:25:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-02-16T22:25:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-02-16T22:25:03.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:03.238+0000 7f020bc02700 1 -- 172.21.15.134:0/2198032491 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f01f006d900 msgr2=0x7f01f006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:03.238+0000 7f020bc02700 1 --2- 172.21.15.134:0/2198032491 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f01f006d900 0x7f01f006fdb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f02040661e0 tx=0x7f01f400b040 comp rx=0 tx=0).stop 2024-02-16T22:25:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:03.238+0000 7f020bc02700 1 -- 172.21.15.134:0/2198032491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0204101e40 msgr2=0x7f020410ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:03.238+0000 7f020bc02700 1 --2- 172.21.15.134:0/2198032491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0204101e40 0x7f020410ea80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f020000b3b0 tx=0x7f0200009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:03.239+0000 7f020bc02700 1 -- 172.21.15.134:0/2198032491 shutdown_connections 2024-02-16T22:25:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:03.239+0000 7f020bc02700 1 --2- 172.21.15.134:0/2198032491 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f01f006d900 0x7f01f006fdb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:03.239+0000 7f020bc02700 1 --2- 172.21.15.134:0/2198032491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0204101e40 0x7f020410ea80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:03.239+0000 7f020bc02700 1 --2- 172.21.15.134:0/2198032491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02041027e0 0x7f020410efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:03.239+0000 7f020bc02700 1 -- 172.21.15.134:0/2198032491 >> 172.21.15.134:0/2198032491 conn(0x7f0204071d90 msgr2=0x7f02040fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:03.239+0000 7f020bc02700 1 -- 172.21.15.134:0/2198032491 shutdown_connections 2024-02-16T22:25:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:03.239+0000 7f020bc02700 1 -- 172.21.15.134:0/2198032491 wait complete. 2024-02-16T22:25:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:03 smithi173 ceph-mon[83703]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:03 smithi173 ceph-mon[83703]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:03 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/661077547' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:25:03.977 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:25:03 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0[124038]: 2024-02-16T22:25:03.838+0000 7f1bde2087c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-02-16T22:25:04.398 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:25:04 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0[124038]: 2024-02-16T22:25:04.278+0000 7f1bde2087c0 -1 osd.0 49 log_to_monitors true 2024-02-16T22:25:04.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:04 smithi134 ceph-mon[112514]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:04.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:04 smithi134 ceph-mon[112514]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2024-02-16T22:25:04.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:04 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2198032491' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:25:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:04 smithi173 ceph-mon[83703]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:04 smithi173 ceph-mon[83703]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2024-02-16T22:25:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:04 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2198032491' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:25:05.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:05 smithi134 ceph-mon[112514]: from='osd.0 [v2:172.21.15.134:6802/2886656462,v1:172.21.15.134:6803/2886656462]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-16T22:25:05.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:05 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:05.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:05 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:05.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:05 smithi134 ceph-mon[112514]: pgmap v49: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2024-02-16T22:25:05.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:05 smithi173 ceph-mon[83703]: from='osd.0 [v2:172.21.15.134:6802/2886656462,v1:172.21.15.134:6803/2886656462]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-16T22:25:05.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:05 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:05.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:05 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:05.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:05 smithi173 ceph-mon[83703]: pgmap v49: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2024-02-16T22:25:06.227 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:25:05 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0[124038]: 2024-02-16T22:25:05.966+0000 7f1bcb658700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T22:25:06.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:06 smithi134 ceph-mon[112514]: from='osd.0 [v2:172.21.15.134:6802/2886656462,v1:172.21.15.134:6803/2886656462]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-16T22:25:06.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:06 smithi134 ceph-mon[112514]: failed to encode map e52 with expected crc 2024-02-16T22:25:06.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:06 smithi134 ceph-mon[112514]: osdmap e52: 6 total, 5 up, 6 in 2024-02-16T22:25:06.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:06 smithi134 ceph-mon[112514]: from='osd.0 [v2:172.21.15.134:6802/2886656462,v1:172.21.15.134:6803/2886656462]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-02-16T22:25:06.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:06 smithi134 ceph-mon[112514]: from='osd.0 [v2:172.21.15.134:6802/2886656462,v1:172.21.15.134:6803/2886656462]' entity='osd.0' 2024-02-16T22:25:06.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:06 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:06.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:06 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:06 smithi173 ceph-mon[83703]: from='osd.0 [v2:172.21.15.134:6802/2886656462,v1:172.21.15.134:6803/2886656462]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-16T22:25:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:06 smithi173 ceph-mon[83703]: failed to encode map e52 with expected crc 2024-02-16T22:25:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:06 smithi173 ceph-mon[83703]: osdmap e52: 6 total, 5 up, 6 in 2024-02-16T22:25:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:06 smithi173 ceph-mon[83703]: from='osd.0 [v2:172.21.15.134:6802/2886656462,v1:172.21.15.134:6803/2886656462]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-02-16T22:25:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:06 smithi173 ceph-mon[83703]: from='osd.0 [v2:172.21.15.134:6802/2886656462,v1:172.21.15.134:6803/2886656462]' entity='osd.0' 2024-02-16T22:25:06.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:06 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:06.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:06 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:07.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:07 smithi173 ceph-mon[83703]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-16T22:25:07.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:07 smithi173 ceph-mon[83703]: osd.0 [v2:172.21.15.134:6802/2886656462,v1:172.21.15.134:6803/2886656462] boot 2024-02-16T22:25:07.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:07 smithi173 ceph-mon[83703]: osdmap e53: 6 total, 6 up, 6 in 2024-02-16T22:25:07.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:07 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:25:07.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:07 smithi173 ceph-mon[83703]: pgmap v52: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2024-02-16T22:25:07.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:07 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:07.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:07 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:25:07.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:07 smithi134 ceph-mon[112514]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-16T22:25:07.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:07 smithi134 ceph-mon[112514]: osd.0 [v2:172.21.15.134:6802/2886656462,v1:172.21.15.134:6803/2886656462] boot 2024-02-16T22:25:07.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:07 smithi134 ceph-mon[112514]: osdmap e53: 6 total, 6 up, 6 in 2024-02-16T22:25:07.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:07 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-16T22:25:07.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:07 smithi134 ceph-mon[112514]: pgmap v52: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2024-02-16T22:25:07.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:07 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:07.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:07 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:25:08.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:08 smithi134 ceph-mon[112514]: failed to encode map e53 with expected crc 2024-02-16T22:25:08.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:08 smithi134 ceph-mon[112514]: failed to encode map e54 with expected crc 2024-02-16T22:25:08.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:08 smithi134 ceph-mon[112514]: osdmap e54: 6 total, 6 up, 6 in 2024-02-16T22:25:08.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:08 smithi134 ceph-mon[112514]: failed to encode map e54 with expected crc 2024-02-16T22:25:08.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:08 smithi134 ceph-mon[112514]: failed to encode map e54 with expected crc 2024-02-16T22:25:08.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:08 smithi134 ceph-mon[112514]: failed to encode map e54 with expected crc 2024-02-16T22:25:08.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:08 smithi134 ceph-mon[112514]: failed to encode map e54 with expected crc 2024-02-16T22:25:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:08 smithi173 ceph-mon[83703]: failed to encode map e53 with expected crc 2024-02-16T22:25:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:08 smithi173 ceph-mon[83703]: failed to encode map e54 with expected crc 2024-02-16T22:25:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:08 smithi173 ceph-mon[83703]: osdmap e54: 6 total, 6 up, 6 in 2024-02-16T22:25:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:08 smithi173 ceph-mon[83703]: failed to encode map e54 with expected crc 2024-02-16T22:25:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:08 smithi173 ceph-mon[83703]: failed to encode map e54 with expected crc 2024-02-16T22:25:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:08 smithi173 ceph-mon[83703]: failed to encode map e54 with expected crc 2024-02-16T22:25:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:08 smithi173 ceph-mon[83703]: failed to encode map e54 with expected crc 2024-02-16T22:25:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:09 smithi134 ceph-mon[112514]: failed to encode map e54 with expected crc 2024-02-16T22:25:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:09 smithi134 ceph-mon[112514]: failed to encode map e54 with expected crc 2024-02-16T22:25:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:09 smithi134 ceph-mon[112514]: pgmap v54: 65 pgs: 5 activating, 3 active+undersized+degraded, 6 active+undersized, 51 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s; 14/357 objects degraded (3.922%) 2024-02-16T22:25:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:09 smithi173 ceph-mon[83703]: failed to encode map e54 with expected crc 2024-02-16T22:25:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:09 smithi173 ceph-mon[83703]: failed to encode map e54 with expected crc 2024-02-16T22:25:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:09 smithi173 ceph-mon[83703]: pgmap v54: 65 pgs: 5 activating, 3 active+undersized+degraded, 6 active+undersized, 51 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s; 14/357 objects degraded (3.922%) 2024-02-16T22:25:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:10 smithi134 ceph-mon[112514]: Health check update: Degraded data redundancy: 14/357 objects degraded (3.922%), 3 pgs degraded (PG_DEGRADED) 2024-02-16T22:25:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:25:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:25:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:25:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-16T22:25:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:10 smithi134 ceph-mon[112514]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-16T22:25:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:10 smithi134 ceph-mon[112514]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-02-16T22:25:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:10 smithi173 ceph-mon[83703]: Health check update: Degraded data redundancy: 14/357 objects degraded (3.922%), 3 pgs degraded (PG_DEGRADED) 2024-02-16T22:25:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:25:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:25:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:25:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-16T22:25:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:10 smithi173 ceph-mon[83703]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-16T22:25:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:10 smithi173 ceph-mon[83703]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-02-16T22:25:11.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:11 smithi134 ceph-mon[112514]: mgrmap e39: smithi134.ordace(active, since 93s), standbys: smithi173.kbofaa 2024-02-16T22:25:11.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:11 smithi134 ceph-mon[112514]: pgmap v55: 65 pgs: 5 activating, 60 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-16T22:25:11.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:11 smithi173 ceph-mon[83703]: mgrmap e39: smithi134.ordace(active, since 93s), standbys: smithi173.kbofaa 2024-02-16T22:25:11.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:11 smithi173 ceph-mon[83703]: pgmap v55: 65 pgs: 5 activating, 60 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-16T22:25:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:12 smithi134 ceph-mon[112514]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/357 objects degraded (3.922%), 3 pgs degraded) 2024-02-16T22:25:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:12 smithi134 ceph-mon[112514]: Cluster is now healthy 2024-02-16T22:25:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:12 smithi173 ceph-mon[83703]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/357 objects degraded (3.922%), 3 pgs degraded) 2024-02-16T22:25:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:12 smithi173 ceph-mon[83703]: Cluster is now healthy 2024-02-16T22:25:13.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:13 smithi134 ceph-mon[112514]: pgmap v56: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 649 B/s wr, 0 op/s 2024-02-16T22:25:13.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:13 smithi173 ceph-mon[83703]: pgmap v56: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 649 B/s wr, 0 op/s 2024-02-16T22:25:16.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:16 smithi134 ceph-mon[112514]: pgmap v57: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 635 B/s wr, 0 op/s 2024-02-16T22:25:16.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:16 smithi173 ceph-mon[83703]: pgmap v57: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 635 B/s wr, 0 op/s 2024-02-16T22:25:18.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:18 smithi134 ceph-mon[112514]: pgmap v58: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:25:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:18 smithi173 ceph-mon[83703]: pgmap v58: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-16T22:25:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:20 smithi134 ceph-mon[112514]: pgmap v59: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 463 B/s wr, 0 op/s 2024-02-16T22:25:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:20 smithi173 ceph-mon[83703]: pgmap v59: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 463 B/s wr, 0 op/s 2024-02-16T22:25:22.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:22 smithi134 ceph-mon[112514]: pgmap v60: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-16T22:25:22.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:22 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:22.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:22 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:25:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:22 smithi173 ceph-mon[83703]: pgmap v60: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-16T22:25:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:22 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:22 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:25:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:24.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:24 smithi134 ceph-mon[112514]: pgmap v61: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:24.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:24 smithi173 ceph-mon[83703]: pgmap v61: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:25.382 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:25 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-16T22:25:25.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:25 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-16T22:25:26.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:26 smithi134 ceph-mon[112514]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-16T22:25:26.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:26 smithi134 ceph-mon[112514]: Upgrade: osd.1 is safe to restart 2024-02-16T22:25:26.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:26 smithi134 ceph-mon[112514]: pgmap v62: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:26.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:26 smithi173 ceph-mon[83703]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-16T22:25:26.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:26 smithi173 ceph-mon[83703]: Upgrade: osd.1 is safe to restart 2024-02-16T22:25:26.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:26 smithi173 ceph-mon[83703]: pgmap v62: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:27.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:27 smithi134 ceph-mon[112514]: Upgrade: Updating osd.1 2024-02-16T22:25:27.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:27 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:27.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:27 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-16T22:25:27.688 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:27 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:25:27.688 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:27 smithi134 ceph-mon[112514]: Deploying daemon osd.1 on smithi134 2024-02-16T22:25:27.688 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:27 smithi134 ceph-mon[112514]: pgmap v63: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:27.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:27 smithi173 ceph-mon[83703]: Upgrade: Updating osd.1 2024-02-16T22:25:27.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:27 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:27.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:27 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-16T22:25:27.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:27 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:25:27.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:27 smithi173 ceph-mon[83703]: Deploying daemon osd.1 on smithi134 2024-02-16T22:25:27.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:27 smithi173 ceph-mon[83703]: pgmap v63: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:29.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:29 smithi134 ceph-mon[112514]: pgmap v64: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:29.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:29 smithi173 ceph-mon[83703]: pgmap v64: 65 pgs: 65 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:30.227 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:29 smithi134 systemd[1]: Stopping Ceph osd.1 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:25:30.227 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:30 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1[55671]: 2024-02-16T22:25:30.055+0000 7fcfea103700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:25:30.227 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:30 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1[55671]: 2024-02-16T22:25:30.056+0000 7fcfea103700 -1 osd.1 54 *** Got signal Terminated *** 2024-02-16T22:25:30.227 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:30 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1[55671]: 2024-02-16T22:25:30.056+0000 7fcfea103700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-16T22:25:30.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:30 smithi134 ceph-mon[112514]: osd.1 marked itself down and dead 2024-02-16T22:25:30.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:30 smithi173 ceph-mon[83703]: osd.1 marked itself down and dead 2024-02-16T22:25:31.392 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:31 smithi134 podman[129402]: 2024-02-16 22:25:31.099036798 +0000 UTC m=+1.144833688 container died faa7573d94b5386827b1dc4786ccbf89d113974404bc6233796ddcd4cf028f0c (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1, org.label-schema.schema-version=1.0, RELEASE=quincy-b88fae6, GIT_CLEAN=True, org.label-schema.build-date=20240214, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-16T22:25:31.727 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:31 smithi134 podman[129402]: 2024-02-16 22:25:31.614831936 +0000 UTC m=+1.660628818 container cleanup faa7573d94b5386827b1dc4786ccbf89d113974404bc6233796ddcd4cf028f0c (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=quincy-b88fae6, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-02-16T22:25:31.727 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:31 smithi134 bash[129402]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1 2024-02-16T22:25:31.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:31 smithi134 ceph-mon[112514]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-16T22:25:31.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:31 smithi134 ceph-mon[112514]: osdmap e55: 6 total, 5 up, 6 in 2024-02-16T22:25:31.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:31 smithi134 ceph-mon[112514]: failed to encode map e55 with expected crc 2024-02-16T22:25:31.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:31 smithi134 ceph-mon[112514]: failed to encode map e55 with expected crc 2024-02-16T22:25:31.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:31 smithi134 ceph-mon[112514]: failed to encode map e55 with expected crc 2024-02-16T22:25:31.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:31 smithi134 ceph-mon[112514]: failed to encode map e55 with expected crc 2024-02-16T22:25:31.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:31 smithi134 ceph-mon[112514]: pgmap v66: 65 pgs: 12 stale+active+clean, 53 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:31.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:31 smithi173 ceph-mon[83703]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-16T22:25:31.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:31 smithi173 ceph-mon[83703]: osdmap e55: 6 total, 5 up, 6 in 2024-02-16T22:25:31.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:31 smithi173 ceph-mon[83703]: failed to encode map e55 with expected crc 2024-02-16T22:25:31.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:31 smithi173 ceph-mon[83703]: failed to encode map e55 with expected crc 2024-02-16T22:25:31.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:31 smithi173 ceph-mon[83703]: failed to encode map e55 with expected crc 2024-02-16T22:25:31.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:31 smithi173 ceph-mon[83703]: failed to encode map e55 with expected crc 2024-02-16T22:25:31.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:31 smithi173 ceph-mon[83703]: pgmap v66: 65 pgs: 12 stale+active+clean, 53 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:32.227 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:31 smithi134 podman[129419]: 2024-02-16 22:25:31.858290943 +0000 UTC m=+0.757330127 container remove faa7573d94b5386827b1dc4786ccbf89d113974404bc6233796ddcd4cf028f0c (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-b88fae6, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-02-16T22:25:32.596 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:32 smithi134 podman[129514]: 2024-02-16 22:25:32.170554363 +0000 UTC m=+0.017886431 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:25:32.596 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:32 smithi134 podman[129514]: 2024-02-16 22:25:32.300863607 +0000 UTC m=+0.148195669 container create 88e81803a68718c983926fd004faffb37ec3c15fcf5de4c52997060de81fcd86 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-02-16T22:25:32.596 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:32 smithi134 podman[129514]: 2024-02-16 22:25:32.51160531 +0000 UTC m=+0.358937377 container init 88e81803a68718c983926fd004faffb37ec3c15fcf5de4c52997060de81fcd86 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-16T22:25:32.596 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:32 smithi134 podman[129514]: 2024-02-16 22:25:32.514737383 +0000 UTC m=+0.362069456 container start 88e81803a68718c983926fd004faffb37ec3c15fcf5de4c52997060de81fcd86 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2) 2024-02-16T22:25:32.596 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:32 smithi134 podman[129514]: 2024-02-16 22:25:32.594951621 +0000 UTC m=+0.442283708 container attach 88e81803a68718c983926fd004faffb37ec3c15fcf5de4c52997060de81fcd86 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, ceph=True) 2024-02-16T22:25:32.977 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:32 smithi134 podman[129514]: 2024-02-16 22:25:32.811656434 +0000 UTC m=+0.658988509 container died 88e81803a68718c983926fd004faffb37ec3c15fcf5de4c52997060de81fcd86 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-16T22:25:32.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:32 smithi134 ceph-mon[112514]: failed to encode map e56 with expected crc 2024-02-16T22:25:32.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:32 smithi134 ceph-mon[112514]: osdmap e56: 6 total, 5 up, 6 in 2024-02-16T22:25:32.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:32 smithi134 ceph-mon[112514]: failed to encode map e56 with expected crc 2024-02-16T22:25:32.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:32 smithi134 ceph-mon[112514]: failed to encode map e56 with expected crc 2024-02-16T22:25:32.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:32 smithi134 ceph-mon[112514]: failed to encode map e56 with expected crc 2024-02-16T22:25:32.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:32 smithi134 ceph-mon[112514]: failed to encode map e56 with expected crc 2024-02-16T22:25:32.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:32 smithi134 ceph-mon[112514]: failed to encode map e56 with expected crc 2024-02-16T22:25:32.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:32 smithi173 ceph-mon[83703]: failed to encode map e56 with expected crc 2024-02-16T22:25:32.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:32 smithi173 ceph-mon[83703]: osdmap e56: 6 total, 5 up, 6 in 2024-02-16T22:25:32.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:32 smithi173 ceph-mon[83703]: failed to encode map e56 with expected crc 2024-02-16T22:25:32.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:32 smithi173 ceph-mon[83703]: failed to encode map e56 with expected crc 2024-02-16T22:25:32.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:32 smithi173 ceph-mon[83703]: failed to encode map e56 with expected crc 2024-02-16T22:25:32.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:32 smithi173 ceph-mon[83703]: failed to encode map e56 with expected crc 2024-02-16T22:25:32.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:32 smithi173 ceph-mon[83703]: failed to encode map e56 with expected crc 2024-02-16T22:25:33.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.346+0000 7f4afda17700 1 -- 172.21.15.134:0/3152865438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4af8103990 msgr2=0x7f4af80fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:33.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.346+0000 7f4afda17700 1 --2- 172.21.15.134:0/3152865438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4af8103990 0x7f4af80fb590 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0004940 tx=0x7f4ae0009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:33.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.346+0000 7f4afda17700 1 -- 172.21.15.134:0/3152865438 shutdown_connections 2024-02-16T22:25:33.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.346+0000 7f4afda17700 1 --2- 172.21.15.134:0/3152865438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4af8103990 0x7f4af80fb590 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:33.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.346+0000 7f4afda17700 1 --2- 172.21.15.134:0/3152865438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af8102ff0 0x7f4af81033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:33.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.346+0000 7f4afda17700 1 -- 172.21.15.134:0/3152865438 >> 172.21.15.134:0/3152865438 conn(0x7f4af8071560 msgr2=0x7f4af8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:33.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.346+0000 7f4afda17700 1 -- 172.21.15.134:0/3152865438 shutdown_connections 2024-02-16T22:25:33.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.346+0000 7f4afda17700 1 -- 172.21.15.134:0/3152865438 wait complete. 2024-02-16T22:25:33.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.346+0000 7f4afda17700 1 Processor -- start 2024-02-16T22:25:33.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.347+0000 7f4afda17700 1 -- start start 2024-02-16T22:25:33.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.347+0000 7f4afda17700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4af8102ff0 0x7f4af8113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:33.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.347+0000 7f4afda17700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af8103990 0x7f4af8113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:33.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.347+0000 7f4afda17700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af81145c0 con 0x7f4af8102ff0 2024-02-16T22:25:33.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.347+0000 7f4afda17700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af810d8f0 con 0x7f4af8103990 2024-02-16T22:25:33.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.347+0000 7f4af6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4af8102ff0 0x7f4af8113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:33.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.347+0000 7f4af6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4af8102ff0 0x7f4af8113a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51392/0 (socket says 172.21.15.134:51392) 2024-02-16T22:25:33.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.347+0000 7f4af6ffd700 1 -- 172.21.15.134:0/4271639018 learned_addr learned my addr 172.21.15.134:0/4271639018 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:25:33.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.347+0000 7f4af67fc700 1 --2- 172.21.15.134:0/4271639018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af8103990 0x7f4af8113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:33.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.347+0000 7f4af6ffd700 1 -- 172.21.15.134:0/4271639018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af8103990 msgr2=0x7f4af8113f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:33.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.347+0000 7f4af6ffd700 1 --2- 172.21.15.134:0/4271639018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af8103990 0x7f4af8113f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:33.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.347+0000 7f4af6ffd700 1 -- 172.21.15.134:0/4271639018 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae0005040 con 0x7f4af8102ff0 2024-02-16T22:25:33.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.347+0000 7f4af6ffd700 1 --2- 172.21.15.134:0/4271639018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4af8102ff0 0x7f4af8113a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800ecb0 tx=0x7f4ae800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:33.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.347+0000 7f4aef7fe700 1 -- 172.21.15.134:0/4271639018 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ae800ee60 con 0x7f4af8102ff0 2024-02-16T22:25:33.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.348+0000 7f4aef7fe700 1 -- 172.21.15.134:0/4271639018 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ae800f040 con 0x7f4af8102ff0 2024-02-16T22:25:33.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.348+0000 7f4afda17700 1 -- 172.21.15.134:0/4271639018 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af810dbd0 con 0x7f4af8102ff0 2024-02-16T22:25:33.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.348+0000 7f4aef7fe700 1 -- 172.21.15.134:0/4271639018 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ae8009680 con 0x7f4af8102ff0 2024-02-16T22:25:33.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.348+0000 7f4afda17700 1 -- 172.21.15.134:0/4271639018 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af810e0e0 con 0x7f4af8102ff0 2024-02-16T22:25:33.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.349+0000 7f4afda17700 1 -- 172.21.15.134:0/4271639018 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af8100330 con 0x7f4af8102ff0 2024-02-16T22:25:33.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.349+0000 7f4aef7fe700 1 -- 172.21.15.134:0/4271639018 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f4ae8007920 con 0x7f4af8102ff0 2024-02-16T22:25:33.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.349+0000 7f4aef7fe700 1 --2- 172.21.15.134:0/4271639018 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4ae406d7e0 0x7f4ae406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:33.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.350+0000 7f4aef7fe700 1 -- 172.21.15.134:0/4271639018 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4ae808cf30 con 0x7f4af8102ff0 2024-02-16T22:25:33.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.350+0000 7f4af67fc700 1 --2- 172.21.15.134:0/4271639018 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4ae406d7e0 0x7f4ae406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:33.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.350+0000 7f4af67fc700 1 --2- 172.21.15.134:0/4271639018 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4ae406d7e0 0x7f4ae406fc90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009b30 tx=0x7f4ae0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:33.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.354+0000 7f4aef7fe700 1 -- 172.21.15.134:0/4271639018 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4ae80c0d20 con 0x7f4af8102ff0 2024-02-16T22:25:33.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.581+0000 7f4afda17700 1 -- 172.21.15.134:0/4271639018 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4af804bed0 con 0x7f4ae406d7e0 2024-02-16T22:25:33.584 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:33 smithi134 podman[129540]: 2024-02-16 22:25:33.474145886 +0000 UTC m=+0.656766790 container remove 88e81803a68718c983926fd004faffb37ec3c15fcf5de4c52997060de81fcd86 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS) 2024-02-16T22:25:33.584 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:33 smithi134 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.1.service: Deactivated successfully. 2024-02-16T22:25:33.584 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:33 smithi134 systemd[1]: Stopped Ceph osd.1 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:25:33.584 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:33 smithi134 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.1.service: Consumed 1min 345ms CPU time. 2024-02-16T22:25:33.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.583+0000 7f4aef7fe700 1 -- 172.21.15.134:0/4271639018 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4af804bed0 con 0x7f4ae406d7e0 2024-02-16T22:25:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.585+0000 7f4afda17700 1 -- 172.21.15.134:0/4271639018 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4ae406d7e0 msgr2=0x7f4ae406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.585+0000 7f4afda17700 1 --2- 172.21.15.134:0/4271639018 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4ae406d7e0 0x7f4ae406fc90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009b30 tx=0x7f4ae0009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.585+0000 7f4afda17700 1 -- 172.21.15.134:0/4271639018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4af8102ff0 msgr2=0x7f4af8113a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.585+0000 7f4afda17700 1 --2- 172.21.15.134:0/4271639018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4af8102ff0 0x7f4af8113a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800ecb0 tx=0x7f4ae800b040 comp rx=0 tx=0).stop 2024-02-16T22:25:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.585+0000 7f4afda17700 1 -- 172.21.15.134:0/4271639018 shutdown_connections 2024-02-16T22:25:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.585+0000 7f4afda17700 1 --2- 172.21.15.134:0/4271639018 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4ae406d7e0 0x7f4ae406fc90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.585+0000 7f4afda17700 1 --2- 172.21.15.134:0/4271639018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4af8102ff0 0x7f4af8113a30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.585+0000 7f4afda17700 1 --2- 172.21.15.134:0/4271639018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af8103990 0x7f4af8113f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.585+0000 7f4afda17700 1 -- 172.21.15.134:0/4271639018 >> 172.21.15.134:0/4271639018 conn(0x7f4af8071560 msgr2=0x7f4af80faab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:33.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.585+0000 7f4afda17700 1 -- 172.21.15.134:0/4271639018 shutdown_connections 2024-02-16T22:25:33.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.585+0000 7f4afda17700 1 -- 172.21.15.134:0/4271639018 wait complete. 2024-02-16T22:25:33.598 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:25:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.693+0000 7f722d73a700 1 -- 172.21.15.134:0/3779307243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72281038e0 msgr2=0x7f72280fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.693+0000 7f722d73a700 1 --2- 172.21.15.134:0/3779307243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72281038e0 0x7f72280fcf50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7218004940 tx=0x7f7218009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.693+0000 7f722d73a700 1 -- 172.21.15.134:0/3779307243 shutdown_connections 2024-02-16T22:25:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.693+0000 7f722d73a700 1 --2- 172.21.15.134:0/3779307243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72281038e0 0x7f72280fcf50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.693+0000 7f722d73a700 1 --2- 172.21.15.134:0/3779307243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7228102f40 0x7f7228103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.693+0000 7f722d73a700 1 -- 172.21.15.134:0/3779307243 >> 172.21.15.134:0/3779307243 conn(0x7f72280f8af0 msgr2=0x7f72280faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.693+0000 7f722d73a700 1 -- 172.21.15.134:0/3779307243 shutdown_connections 2024-02-16T22:25:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.693+0000 7f722d73a700 1 -- 172.21.15.134:0/3779307243 wait complete. 2024-02-16T22:25:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.694+0000 7f722d73a700 1 Processor -- start 2024-02-16T22:25:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.694+0000 7f722d73a700 1 -- start start 2024-02-16T22:25:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.694+0000 7f722d73a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7228102f40 0x7f7228070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.694+0000 7f722d73a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72281038e0 0x7f72280707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.694+0000 7f722d73a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7228070dd0 con 0x7f72281038e0 2024-02-16T22:25:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.694+0000 7f722d73a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7228070f40 con 0x7f7228102f40 2024-02-16T22:25:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.694+0000 7f72267fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72281038e0 0x7f72280707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.694+0000 7f72267fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72281038e0 0x7f72280707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51408/0 (socket says 172.21.15.134:51408) 2024-02-16T22:25:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.694+0000 7f72267fc700 1 -- 172.21.15.134:0/1475230862 learned_addr learned my addr 172.21.15.134:0/1475230862 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:25:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.694+0000 7f7226ffd700 1 --2- 172.21.15.134:0/1475230862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7228102f40 0x7f7228070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:33.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.694+0000 7f72267fc700 1 -- 172.21.15.134:0/1475230862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7228102f40 msgr2=0x7f7228070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:33.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.694+0000 7f72267fc700 1 --2- 172.21.15.134:0/1475230862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7228102f40 0x7f7228070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:33.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.694+0000 7f72267fc700 1 -- 172.21.15.134:0/1475230862 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7218005040 con 0x7f72281038e0 2024-02-16T22:25:33.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.695+0000 7f7226ffd700 1 --2- 172.21.15.134:0/1475230862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7228102f40 0x7f7228070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:25:33.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.695+0000 7f72267fc700 1 --2- 172.21.15.134:0/1475230862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72281038e0 0x7f72280707d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7218009150 tx=0x7f7218009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:33.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.695+0000 7f720f7fe700 1 -- 172.21.15.134:0/1475230862 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f721800e040 con 0x7f72281038e0 2024-02-16T22:25:33.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.695+0000 7f720f7fe700 1 -- 172.21.15.134:0/1475230862 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f721800bbf0 con 0x7f72281038e0 2024-02-16T22:25:33.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.695+0000 7f722d73a700 1 -- 172.21.15.134:0/1475230862 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7228119ca0 con 0x7f72281038e0 2024-02-16T22:25:33.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.695+0000 7f720f7fe700 1 -- 172.21.15.134:0/1475230862 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f721801c630 con 0x7f72281038e0 2024-02-16T22:25:33.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.695+0000 7f722d73a700 1 -- 172.21.15.134:0/1475230862 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f722811a100 con 0x7f72281038e0 2024-02-16T22:25:33.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.696+0000 7f722d73a700 1 -- 172.21.15.134:0/1475230862 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7228105410 con 0x7f72281038e0 2024-02-16T22:25:33.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.697+0000 7f720f7fe700 1 -- 172.21.15.134:0/1475230862 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f721800bd60 con 0x7f72281038e0 2024-02-16T22:25:33.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.697+0000 7f720f7fe700 1 --2- 172.21.15.134:0/1475230862 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f721006d7e0 0x7f721006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:33.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.697+0000 7f7226ffd700 1 --2- 172.21.15.134:0/1475230862 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f721006d7e0 0x7f721006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:33.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.697+0000 7f720f7fe700 1 -- 172.21.15.134:0/1475230862 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f721808e250 con 0x7f72281038e0 2024-02-16T22:25:33.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.698+0000 7f7226ffd700 1 --2- 172.21.15.134:0/1475230862 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f721006d7e0 0x7f721006fc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f721c007fd0 tx=0x7f721c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:33.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.702+0000 7f720f7fe700 1 -- 172.21.15.134:0/1475230862 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7218057b70 con 0x7f72281038e0 2024-02-16T22:25:33.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:33 smithi134 ceph-mon[112514]: pgmap v68: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 48/357 objects degraded (13.445%) 2024-02-16T22:25:33.947 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:33 smithi134 systemd[1]: Starting Ceph osd.1 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:25:33.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.947+0000 7f722d73a700 1 -- 172.21.15.134:0/1475230862 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f72280719d0 con 0x7f721006d7e0 2024-02-16T22:25:33.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.948+0000 7f720f7fe700 1 -- 172.21.15.134:0/1475230862 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f72280719d0 con 0x7f721006d7e0 2024-02-16T22:25:33.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.950+0000 7f722d73a700 1 -- 172.21.15.134:0/1475230862 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f721006d7e0 msgr2=0x7f721006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:33.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.950+0000 7f722d73a700 1 --2- 172.21.15.134:0/1475230862 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f721006d7e0 0x7f721006fc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f721c007fd0 tx=0x7f721c009040 comp rx=0 tx=0).stop 2024-02-16T22:25:33.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.950+0000 7f722d73a700 1 -- 172.21.15.134:0/1475230862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72281038e0 msgr2=0x7f72280707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:33.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.950+0000 7f722d73a700 1 --2- 172.21.15.134:0/1475230862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72281038e0 0x7f72280707d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7218009150 tx=0x7f7218009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:33.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.950+0000 7f722d73a700 1 -- 172.21.15.134:0/1475230862 shutdown_connections 2024-02-16T22:25:33.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.950+0000 7f722d73a700 1 --2- 172.21.15.134:0/1475230862 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f721006d7e0 0x7f721006fc90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:33.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.950+0000 7f722d73a700 1 --2- 172.21.15.134:0/1475230862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7228102f40 0x7f7228070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:33.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.950+0000 7f722d73a700 1 --2- 172.21.15.134:0/1475230862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72281038e0 0x7f72280707d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:33.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.950+0000 7f722d73a700 1 -- 172.21.15.134:0/1475230862 >> 172.21.15.134:0/1475230862 conn(0x7f72280f8af0 msgr2=0x7f72280fa660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:33.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.951+0000 7f722d73a700 1 -- 172.21.15.134:0/1475230862 shutdown_connections 2024-02-16T22:25:33.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:33.951+0000 7f722d73a700 1 -- 172.21.15.134:0/1475230862 wait complete. 2024-02-16T22:25:33.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:33 smithi173 ceph-mon[83703]: pgmap v68: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 48/357 objects degraded (13.445%) 2024-02-16T22:25:34.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.054+0000 7fa1433b8700 1 -- 172.21.15.134:0/2791202068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c102f50 msgr2=0x7fa13c103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:34.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.054+0000 7fa1433b8700 1 --2- 172.21.15.134:0/2791202068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c102f50 0x7fa13c103320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa138004940 tx=0x7fa138009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:34.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.054+0000 7fa1433b8700 1 -- 172.21.15.134:0/2791202068 shutdown_connections 2024-02-16T22:25:34.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.054+0000 7fa1433b8700 1 --2- 172.21.15.134:0/2791202068 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa13c1038f0 0x7fa13c0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.054+0000 7fa1433b8700 1 --2- 172.21.15.134:0/2791202068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c102f50 0x7fa13c103320 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.054+0000 7fa1433b8700 1 -- 172.21.15.134:0/2791202068 >> 172.21.15.134:0/2791202068 conn(0x7fa13c0f8ae0 msgr2=0x7fa13c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:34.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.054+0000 7fa1433b8700 1 -- 172.21.15.134:0/2791202068 shutdown_connections 2024-02-16T22:25:34.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.054+0000 7fa1433b8700 1 -- 172.21.15.134:0/2791202068 wait complete. 2024-02-16T22:25:34.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.054+0000 7fa1433b8700 1 Processor -- start 2024-02-16T22:25:34.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.054+0000 7fa1433b8700 1 -- start start 2024-02-16T22:25:34.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.054+0000 7fa1433b8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c102f50 0x7fa13c113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:34.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa1433b8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa13c1038f0 0x7fa13c114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:34.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa1433b8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c114700 con 0x7fa13c102f50 2024-02-16T22:25:34.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa1433b8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c10d9a0 con 0x7fa13c1038f0 2024-02-16T22:25:34.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa141154700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c102f50 0x7fa13c113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:34.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa141154700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c102f50 0x7fa13c113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51430/0 (socket says 172.21.15.134:51430) 2024-02-16T22:25:34.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa141154700 1 -- 172.21.15.134:0/3416484347 learned_addr learned my addr 172.21.15.134:0/3416484347 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:25:34.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa140953700 1 --2- 172.21.15.134:0/3416484347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa13c1038f0 0x7fa13c114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:34.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa141154700 1 -- 172.21.15.134:0/3416484347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa13c1038f0 msgr2=0x7fa13c114020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:34.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa141154700 1 --2- 172.21.15.134:0/3416484347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa13c1038f0 0x7fa13c114020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa141154700 1 -- 172.21.15.134:0/3416484347 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa138005040 con 0x7fa13c102f50 2024-02-16T22:25:34.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa140953700 1 --2- 172.21.15.134:0/3416484347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa13c1038f0 0x7fa13c114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:25:34.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa141154700 1 --2- 172.21.15.134:0/3416484347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c102f50 0x7fa13c113ae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa13800b3b0 tx=0x7fa138009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:34.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa131ffb700 1 -- 172.21.15.134:0/3416484347 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa13800e040 con 0x7fa13c102f50 2024-02-16T22:25:34.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa131ffb700 1 -- 172.21.15.134:0/3416484347 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa13800bbf0 con 0x7fa13c102f50 2024-02-16T22:25:34.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa1433b8700 1 -- 172.21.15.134:0/3416484347 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13c10dc20 con 0x7fa13c102f50 2024-02-16T22:25:34.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa131ffb700 1 -- 172.21.15.134:0/3416484347 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa13801c630 con 0x7fa13c102f50 2024-02-16T22:25:34.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.055+0000 7fa1433b8700 1 -- 172.21.15.134:0/3416484347 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13c10e160 con 0x7fa13c102f50 2024-02-16T22:25:34.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.056+0000 7fa1433b8700 1 -- 172.21.15.134:0/3416484347 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13c0fc6e0 con 0x7fa13c102f50 2024-02-16T22:25:34.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.057+0000 7fa131ffb700 1 -- 172.21.15.134:0/3416484347 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa13800bd60 con 0x7fa13c102f50 2024-02-16T22:25:34.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.057+0000 7fa131ffb700 1 --2- 172.21.15.134:0/3416484347 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa12806d7e0 0x7fa12806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:34.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.057+0000 7fa131ffb700 1 -- 172.21.15.134:0/3416484347 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa13808e2a0 con 0x7fa13c102f50 2024-02-16T22:25:34.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.057+0000 7fa140953700 1 --2- 172.21.15.134:0/3416484347 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa12806d7e0 0x7fa12806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:34.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.058+0000 7fa140953700 1 --2- 172.21.15.134:0/3416484347 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa12806d7e0 0x7fa12806fc90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa13c10f310 tx=0x7fa12c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:34.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.062+0000 7fa131ffb700 1 -- 172.21.15.134:0/3416484347 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa13805b6f0 con 0x7fa13c102f50 2024-02-16T22:25:34.213 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:33 smithi134 podman[129685]: 2024-02-16 22:25:33.848394888 +0000 UTC m=+0.018691884 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:25:34.213 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:33 smithi134 podman[129685]: 2024-02-16 22:25:33.950114511 +0000 UTC m=+0.120411496 container create affbfc887de1179fb3d11a7ff96f76b65da7cf86085040ca183b290e23d6a317 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-activate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-02-16T22:25:34.213 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 podman[129685]: 2024-02-16 22:25:34.212428022 +0000 UTC m=+0.382725010 container init affbfc887de1179fb3d11a7ff96f76b65da7cf86085040ca183b290e23d6a317 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True) 2024-02-16T22:25:34.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.280+0000 7fa1433b8700 1 -- 172.21.15.134:0/3416484347 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa13c10f130 con 0x7fa12806d7e0 2024-02-16T22:25:34.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.290+0000 7fa131ffb700 1 -- 172.21.15.134:0/3416484347 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fa13c10f130 con 0x7fa12806d7e0 2024-02-16T22:25:34.292 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:25:34.292 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (3m) 29s ago 14m 26.8M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:25:34.292 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (61s) 29s ago 14m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 429739bfee94 2024-02-16T22:25:34.292 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (56s) 53s ago 13m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 1e81cd2fd510 2024-02-16T22:25:34.292 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (3m) 29s ago 14m 84.6M - 9.4.12 a0ea5e3c46d9 29d29cf667e7 2024-02-16T22:25:34.292 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (8m) 29s ago 8m 14.0M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:25:34.292 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (8m) 29s ago 8m 125M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:25:34.292 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (8m) 53s ago 8m 16.9M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:25:34.292 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (8m) 53s ago 8m 118M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:25:34.292 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (4m) 29s ago 16m 496M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:25:34.292 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (4m) 53s ago 13m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:25:34.292 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (2m) 29s ago 16m 43.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2903b3988442 2024-02-16T22:25:34.293 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (101s) 53s ago 13m 39.0M 2048M 19.0.0-1450-gf78a58c0 f081f847070a dd7cf2f31226 2024-02-16T22:25:34.293 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (4m) 29s ago 14m 16.3M - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:25:34.293 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (3m) 53s ago 13m 14.6M - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:25:34.293 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (35s) 29s ago 12m 11.5M 1557M 19.0.0-1450-gf78a58c0 f081f847070a d0153b47ae7e 2024-02-16T22:25:34.293 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (12m) 29s ago 12m 234M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 faa7573d94b5 2024-02-16T22:25:34.293 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (11m) 29s ago 11m 190M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:25:34.293 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (11m) 53s ago 11m 267M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:25:34.293 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (10m) 53s ago 10m 237M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:25:34.293 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (10m) 53s ago 10m 231M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:25:34.293 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (3m) 29s ago 13m 59.4M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:25:34.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.292+0000 7fa1433b8700 1 -- 172.21.15.134:0/3416484347 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa12806d7e0 msgr2=0x7fa12806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:34.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.292+0000 7fa1433b8700 1 --2- 172.21.15.134:0/3416484347 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa12806d7e0 0x7fa12806fc90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa13c10f310 tx=0x7fa12c008040 comp rx=0 tx=0).stop 2024-02-16T22:25:34.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.292+0000 7fa1433b8700 1 -- 172.21.15.134:0/3416484347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c102f50 msgr2=0x7fa13c113ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:34.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.292+0000 7fa1433b8700 1 --2- 172.21.15.134:0/3416484347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c102f50 0x7fa13c113ae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa13800b3b0 tx=0x7fa138009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:34.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.292+0000 7fa1433b8700 1 -- 172.21.15.134:0/3416484347 shutdown_connections 2024-02-16T22:25:34.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.292+0000 7fa1433b8700 1 --2- 172.21.15.134:0/3416484347 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa12806d7e0 0x7fa12806fc90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.292+0000 7fa1433b8700 1 --2- 172.21.15.134:0/3416484347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c102f50 0x7fa13c113ae0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.292+0000 7fa1433b8700 1 --2- 172.21.15.134:0/3416484347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa13c1038f0 0x7fa13c114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.292+0000 7fa1433b8700 1 -- 172.21.15.134:0/3416484347 >> 172.21.15.134:0/3416484347 conn(0x7fa13c0f8ae0 msgr2=0x7fa13c0fa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:34.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.292+0000 7fa1433b8700 1 -- 172.21.15.134:0/3416484347 shutdown_connections 2024-02-16T22:25:34.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.292+0000 7fa1433b8700 1 -- 172.21.15.134:0/3416484347 wait complete. 2024-02-16T22:25:34.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.395+0000 7fe268052700 1 -- 172.21.15.134:0/3178599998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe260101e40 msgr2=0x7fe260102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:34.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.395+0000 7fe268052700 1 --2- 172.21.15.134:0/3178599998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe260101e40 0x7fe260102210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe25c004940 tx=0x7fe25c009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:34.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.395+0000 7fe268052700 1 -- 172.21.15.134:0/3178599998 shutdown_connections 2024-02-16T22:25:34.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.395+0000 7fe268052700 1 --2- 172.21.15.134:0/3178599998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2601027e0 0x7fe2600fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.395+0000 7fe268052700 1 --2- 172.21.15.134:0/3178599998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe260101e40 0x7fe260102210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.395+0000 7fe268052700 1 -- 172.21.15.134:0/3178599998 >> 172.21.15.134:0/3178599998 conn(0x7fe260071d90 msgr2=0x7fe260072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:34.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.395+0000 7fe268052700 1 -- 172.21.15.134:0/3178599998 shutdown_connections 2024-02-16T22:25:34.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.396+0000 7fe268052700 1 -- 172.21.15.134:0/3178599998 wait complete. 2024-02-16T22:25:34.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.396+0000 7fe268052700 1 Processor -- start 2024-02-16T22:25:34.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.396+0000 7fe268052700 1 -- start start 2024-02-16T22:25:34.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.396+0000 7fe268052700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe260101e40 0x7fe260112940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:34.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.396+0000 7fe268052700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2601027e0 0x7fe260112e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:34.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.396+0000 7fe268052700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2601134d0 con 0x7fe260101e40 2024-02-16T22:25:34.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.396+0000 7fe268052700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26010c800 con 0x7fe2601027e0 2024-02-16T22:25:34.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.396+0000 7fe265dee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe260101e40 0x7fe260112940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:34.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.396+0000 7fe265dee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe260101e40 0x7fe260112940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51446/0 (socket says 172.21.15.134:51446) 2024-02-16T22:25:34.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.396+0000 7fe265dee700 1 -- 172.21.15.134:0/2805179353 learned_addr learned my addr 172.21.15.134:0/2805179353 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:25:34.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.397+0000 7fe2655ed700 1 --2- 172.21.15.134:0/2805179353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2601027e0 0x7fe260112e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:34.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.397+0000 7fe265dee700 1 -- 172.21.15.134:0/2805179353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2601027e0 msgr2=0x7fe260112e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:34.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.397+0000 7fe265dee700 1 --2- 172.21.15.134:0/2805179353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2601027e0 0x7fe260112e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.397+0000 7fe265dee700 1 -- 172.21.15.134:0/2805179353 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c005040 con 0x7fe260101e40 2024-02-16T22:25:34.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.397+0000 7fe265dee700 1 --2- 172.21.15.134:0/2805179353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe260101e40 0x7fe260112940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00b3b0 tx=0x7fe25c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:34.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.397+0000 7fe2567fc700 1 -- 172.21.15.134:0/2805179353 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe25c00e040 con 0x7fe260101e40 2024-02-16T22:25:34.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.397+0000 7fe2567fc700 1 -- 172.21.15.134:0/2805179353 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe25c00bbf0 con 0x7fe260101e40 2024-02-16T22:25:34.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.397+0000 7fe268052700 1 -- 172.21.15.134:0/2805179353 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26010ca80 con 0x7fe260101e40 2024-02-16T22:25:34.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.397+0000 7fe2567fc700 1 -- 172.21.15.134:0/2805179353 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe25c01c630 con 0x7fe260101e40 2024-02-16T22:25:34.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.397+0000 7fe268052700 1 -- 172.21.15.134:0/2805179353 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26010cfc0 con 0x7fe260101e40 2024-02-16T22:25:34.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.398+0000 7fe268052700 1 -- 172.21.15.134:0/2805179353 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2600ff150 con 0x7fe260101e40 2024-02-16T22:25:34.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.399+0000 7fe2567fc700 1 -- 172.21.15.134:0/2805179353 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fe25c00bd60 con 0x7fe260101e40 2024-02-16T22:25:34.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.399+0000 7fe2567fc700 1 --2- 172.21.15.134:0/2805179353 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe24c06d7e0 0x7fe24c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:34.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.399+0000 7fe2655ed700 1 --2- 172.21.15.134:0/2805179353 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe24c06d7e0 0x7fe24c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:34.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.399+0000 7fe2567fc700 1 -- 172.21.15.134:0/2805179353 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe25c08e160 con 0x7fe260101e40 2024-02-16T22:25:34.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.400+0000 7fe2655ed700 1 --2- 172.21.15.134:0/2805179353 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe24c06d7e0 0x7fe24c06fc90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe26010e170 tx=0x7fe250009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:34.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.404+0000 7fe2567fc700 1 -- 172.21.15.134:0/2805179353 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe25c05b650 con 0x7fe260101e40 2024-02-16T22:25:34.477 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 podman[129685]: 2024-02-16 22:25:34.21589363 +0000 UTC m=+0.386190624 container start affbfc887de1179fb3d11a7ff96f76b65da7cf86085040ca183b290e23d6a317 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-02-16T22:25:34.477 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 podman[129685]: 2024-02-16 22:25:34.303000456 +0000 UTC m=+0.473297462 container attach affbfc887de1179fb3d11a7ff96f76b65da7cf86085040ca183b290e23d6a317 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-activate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-02-16T22:25:34.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.695+0000 7fe268052700 1 -- 172.21.15.134:0/2805179353 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe26004bed0 con 0x7fe260101e40 2024-02-16T22:25:34.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.696+0000 7fe2567fc700 1 -- 172.21.15.134:0/2805179353 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fe25c05b1e0 con 0x7fe260101e40 2024-02-16T22:25:34.698 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:25:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:25:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:25:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:25:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:25:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:25:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:25:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:25:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4, 2024-02-16T22:25:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-16T22:25:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:25:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:25:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:25:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:25:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:25:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 8, 2024-02-16T22:25:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 5 2024-02-16T22:25:34.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:25:34.700 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:25:34.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.699+0000 7fe268052700 1 -- 172.21.15.134:0/2805179353 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe24c06d7e0 msgr2=0x7fe24c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:34.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.699+0000 7fe268052700 1 --2- 172.21.15.134:0/2805179353 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe24c06d7e0 0x7fe24c06fc90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe26010e170 tx=0x7fe250009040 comp rx=0 tx=0).stop 2024-02-16T22:25:34.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.699+0000 7fe268052700 1 -- 172.21.15.134:0/2805179353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe260101e40 msgr2=0x7fe260112940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:34.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.699+0000 7fe268052700 1 --2- 172.21.15.134:0/2805179353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe260101e40 0x7fe260112940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00b3b0 tx=0x7fe25c009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:34.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.699+0000 7fe268052700 1 -- 172.21.15.134:0/2805179353 shutdown_connections 2024-02-16T22:25:34.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.699+0000 7fe268052700 1 --2- 172.21.15.134:0/2805179353 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe24c06d7e0 0x7fe24c06fc90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.699+0000 7fe268052700 1 --2- 172.21.15.134:0/2805179353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe260101e40 0x7fe260112940 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.699+0000 7fe268052700 1 --2- 172.21.15.134:0/2805179353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2601027e0 0x7fe260112e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.699+0000 7fe268052700 1 -- 172.21.15.134:0/2805179353 >> 172.21.15.134:0/2805179353 conn(0x7fe260071d90 msgr2=0x7fe2600fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:34.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.699+0000 7fe268052700 1 -- 172.21.15.134:0/2805179353 shutdown_connections 2024-02-16T22:25:34.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.699+0000 7fe268052700 1 -- 172.21.15.134:0/2805179353 wait complete. 2024-02-16T22:25:34.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.803+0000 7feddc768700 1 -- 172.21.15.134:0/2226861403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd4101e60 msgr2=0x7fedd4102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:34.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.803+0000 7feddc768700 1 --2- 172.21.15.134:0/2226861403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd4101e60 0x7fedd4102230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fedd0004940 tx=0x7fedd0009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:34.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.803+0000 7feddc768700 1 -- 172.21.15.134:0/2226861403 shutdown_connections 2024-02-16T22:25:34.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.803+0000 7feddc768700 1 --2- 172.21.15.134:0/2226861403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedd4102800 0x7fedd40fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.803+0000 7feddc768700 1 --2- 172.21.15.134:0/2226861403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd4101e60 0x7fedd4102230 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.803+0000 7feddc768700 1 -- 172.21.15.134:0/2226861403 >> 172.21.15.134:0/2226861403 conn(0x7fedd40f7a10 msgr2=0x7fedd40f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:34.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.803+0000 7feddc768700 1 -- 172.21.15.134:0/2226861403 shutdown_connections 2024-02-16T22:25:34.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.803+0000 7feddc768700 1 -- 172.21.15.134:0/2226861403 wait complete. 2024-02-16T22:25:34.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.804+0000 7feddc768700 1 Processor -- start 2024-02-16T22:25:34.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.804+0000 7feddc768700 1 -- start start 2024-02-16T22:25:34.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.804+0000 7feddc768700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedd4101e60 0x7fedd4113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:34.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.804+0000 7feddc768700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd4102800 0x7fedd4113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:34.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.804+0000 7feddc768700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd41146d0 con 0x7fedd4102800 2024-02-16T22:25:34.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.804+0000 7feddc768700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd410d970 con 0x7fedd4101e60 2024-02-16T22:25:34.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.804+0000 7fedd9d03700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd4102800 0x7fedd4113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:34.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.804+0000 7fedd9d03700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd4102800 0x7fedd4113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51462/0 (socket says 172.21.15.134:51462) 2024-02-16T22:25:34.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.804+0000 7fedd9d03700 1 -- 172.21.15.134:0/3501864579 learned_addr learned my addr 172.21.15.134:0/3501864579 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:25:34.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.804+0000 7fedda504700 1 --2- 172.21.15.134:0/3501864579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedd4101e60 0x7fedd4113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:34.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.804+0000 7fedd9d03700 1 -- 172.21.15.134:0/3501864579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedd4101e60 msgr2=0x7fedd4113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:34.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.804+0000 7fedd9d03700 1 --2- 172.21.15.134:0/3501864579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedd4101e60 0x7fedd4113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:34.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.804+0000 7fedd9d03700 1 -- 172.21.15.134:0/3501864579 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd0005040 con 0x7fedd4102800 2024-02-16T22:25:34.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.804+0000 7fedd9d03700 1 --2- 172.21.15.134:0/3501864579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd4102800 0x7fedd4113ff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fedc400b790 tx=0x7fedc4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:34.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.805+0000 7fedcaffd700 1 -- 172.21.15.134:0/3501864579 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedc400f6f0 con 0x7fedd4102800 2024-02-16T22:25:34.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.805+0000 7fedcaffd700 1 -- 172.21.15.134:0/3501864579 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fedc400fd20 con 0x7fedd4102800 2024-02-16T22:25:34.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.805+0000 7fedcaffd700 1 -- 172.21.15.134:0/3501864579 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedc40103a0 con 0x7fedd4102800 2024-02-16T22:25:34.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.805+0000 7feddc768700 1 -- 172.21.15.134:0/3501864579 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd410dc50 con 0x7fedd4102800 2024-02-16T22:25:34.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.805+0000 7feddc768700 1 -- 172.21.15.134:0/3501864579 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd410e190 con 0x7fedd4102800 2024-02-16T22:25:34.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.805+0000 7feddc768700 1 -- 172.21.15.134:0/3501864579 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd40fb610 con 0x7fedd4102800 2024-02-16T22:25:34.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.806+0000 7fedcaffd700 1 -- 172.21.15.134:0/3501864579 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fedc4011400 con 0x7fedd4102800 2024-02-16T22:25:34.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.806+0000 7fedcaffd700 1 --2- 172.21.15.134:0/3501864579 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fedc006d7e0 0x7fedc006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:34.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.807+0000 7fedcaffd700 1 -- 172.21.15.134:0/3501864579 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fedc408cc50 con 0x7fedd4102800 2024-02-16T22:25:34.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.807+0000 7fedda504700 1 --2- 172.21.15.134:0/3501864579 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fedc006d7e0 0x7fedc006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:34.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.807+0000 7fedda504700 1 --2- 172.21.15.134:0/3501864579 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fedc006d7e0 0x7fedc006fc90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fedd0004560 tx=0x7fedd0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:34.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:34.811+0000 7fedcaffd700 1 -- 172.21.15.134:0/3501864579 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fedc405a0a0 con 0x7fedd4102800 2024-02-16T22:25:34.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:34 smithi134 ceph-mon[112514]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:34.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:34 smithi134 ceph-mon[112514]: Health check failed: Degraded data redundancy: 48/357 objects degraded (13.445%), 14 pgs degraded (PG_DEGRADED) 2024-02-16T22:25:34.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:34 smithi134 ceph-mon[112514]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:34.978 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-activate[129724]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-16T22:25:34.978 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-activate[129724]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-16T22:25:34.978 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 bash[129685]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-16T22:25:34.978 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 bash[129685]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-16T22:25:34.978 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 bash[129685]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-16T22:25:34.978 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 bash[129685]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-16T22:25:34.978 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 bash[129685]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-16T22:25:34.978 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 bash[129685]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-16T22:25:34.978 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 bash[129685]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-16T22:25:34.978 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-activate[129724]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-16T22:25:34.978 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-activate[129724]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-16T22:25:34.978 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-activate[129724]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-16T22:25:34.979 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-activate[129724]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-16T22:25:34.979 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-activate[129724]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-16T22:25:34.979 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:34 smithi134 podman[129685]: 2024-02-16 22:25:34.69764043 +0000 UTC m=+0.867937427 container died affbfc887de1179fb3d11a7ff96f76b65da7cf86085040ca183b290e23d6a317 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-activate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-02-16T22:25:34.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:34 smithi173 ceph-mon[83703]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:34.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:34 smithi173 ceph-mon[83703]: Health check failed: Degraded data redundancy: 48/357 objects degraded (13.445%), 14 pgs degraded (PG_DEGRADED) 2024-02-16T22:25:34.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:34 smithi173 ceph-mon[83703]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:35.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.058+0000 7feddc768700 1 -- 172.21.15.134:0/3501864579 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fedd410f090 con 0x7fedd4102800 2024-02-16T22:25:35.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.059+0000 7fedcaffd700 1 -- 172.21.15.134:0/3501864579 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1860 (secure 0 0 0) 0x7fedc4059c30 con 0x7fedd4102800 2024-02-16T22:25:35.061 INFO:teuthology.orchestra.run.smithi134.stdout:e20 2024-02-16T22:25:35.061 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:25:35.061 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:25:35.061 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-02-16T22:25:35.061 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 20 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-02-16T22:23:22.543229+0000 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-02-16T22:25:35.062 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 2 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout:in 0,1 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14478,1=24269} 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.jyajef{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.qljqef{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:25:35.063 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:25:35.064 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:25:35.064 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-02-16T22:25:35.064 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:25:35.064 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.cygfxr{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2804816044,v1:172.21.15.134:6827/2804816044] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:25:35.064 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.phstvm{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:25:35.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.061+0000 7feddc768700 1 -- 172.21.15.134:0/3501864579 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fedc006d7e0 msgr2=0x7fedc006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:35.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.061+0000 7feddc768700 1 --2- 172.21.15.134:0/3501864579 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fedc006d7e0 0x7fedc006fc90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fedd0004560 tx=0x7fedd0009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:35.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.061+0000 7feddc768700 1 -- 172.21.15.134:0/3501864579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd4102800 msgr2=0x7fedd4113ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:35.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.061+0000 7feddc768700 1 --2- 172.21.15.134:0/3501864579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd4102800 0x7fedd4113ff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fedc400b790 tx=0x7fedc4009220 comp rx=0 tx=0).stop 2024-02-16T22:25:35.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.061+0000 7feddc768700 1 -- 172.21.15.134:0/3501864579 shutdown_connections 2024-02-16T22:25:35.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.061+0000 7feddc768700 1 --2- 172.21.15.134:0/3501864579 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fedc006d7e0 0x7fedc006fc90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.061+0000 7feddc768700 1 --2- 172.21.15.134:0/3501864579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedd4101e60 0x7fedd4113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.061+0000 7feddc768700 1 --2- 172.21.15.134:0/3501864579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd4102800 0x7fedd4113ff0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.061+0000 7feddc768700 1 -- 172.21.15.134:0/3501864579 >> 172.21.15.134:0/3501864579 conn(0x7fedd40f7a10 msgr2=0x7fedd4065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:35.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.061+0000 7feddc768700 1 -- 172.21.15.134:0/3501864579 shutdown_connections 2024-02-16T22:25:35.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.061+0000 7feddc768700 1 -- 172.21.15.134:0/3501864579 wait complete. 2024-02-16T22:25:35.065 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 20 2024-02-16T22:25:35.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.164+0000 7f8814bbc700 1 -- 172.21.15.134:0/430191558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8810102f50 msgr2=0x7f8810103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:35.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.164+0000 7f8814bbc700 1 --2- 172.21.15.134:0/430191558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8810102f50 0x7f8810103320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8800004940 tx=0x7f8800009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:35.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.165+0000 7f8814bbc700 1 -- 172.21.15.134:0/430191558 shutdown_connections 2024-02-16T22:25:35.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.165+0000 7f8814bbc700 1 --2- 172.21.15.134:0/430191558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88101038f0 0x7f88100fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.165+0000 7f8814bbc700 1 --2- 172.21.15.134:0/430191558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8810102f50 0x7f8810103320 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.165+0000 7f8814bbc700 1 -- 172.21.15.134:0/430191558 >> 172.21.15.134:0/430191558 conn(0x7f88100f8ae0 msgr2=0x7f88100faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:35.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.165+0000 7f8814bbc700 1 -- 172.21.15.134:0/430191558 shutdown_connections 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.165+0000 7f8814bbc700 1 -- 172.21.15.134:0/430191558 wait complete. 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.165+0000 7f8814bbc700 1 Processor -- start 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.165+0000 7f8814bbc700 1 -- start start 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.165+0000 7f8814bbc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8810102f50 0x7f8810113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.165+0000 7f8814bbc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88101038f0 0x7f8810113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.165+0000 7f8814bbc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88101145f0 con 0x7f88101038f0 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.165+0000 7f8814bbc700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881010d920 con 0x7f8810102f50 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.165+0000 7f880dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88101038f0 0x7f8810113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.165+0000 7f880dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88101038f0 0x7f8810113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51484/0 (socket says 172.21.15.134:51484) 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.166+0000 7f880dd9b700 1 -- 172.21.15.134:0/2072974855 learned_addr learned my addr 172.21.15.134:0/2072974855 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.166+0000 7f880e59c700 1 --2- 172.21.15.134:0/2072974855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8810102f50 0x7f8810113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.166+0000 7f880dd9b700 1 -- 172.21.15.134:0/2072974855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8810102f50 msgr2=0x7f8810113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.166+0000 7f880dd9b700 1 --2- 172.21.15.134:0/2072974855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8810102f50 0x7f8810113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.166+0000 7f880dd9b700 1 -- 172.21.15.134:0/2072974855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8800005040 con 0x7f88101038f0 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.166+0000 7f880e59c700 1 --2- 172.21.15.134:0/2072974855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8810102f50 0x7f8810113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:25:35.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.166+0000 7f880dd9b700 1 --2- 172.21.15.134:0/2072974855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88101038f0 0x7f8810113fa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8804002a50 tx=0x7f8804004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:35.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.166+0000 7f87feffd700 1 -- 172.21.15.134:0/2072974855 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8804007cc0 con 0x7f88101038f0 2024-02-16T22:25:35.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.166+0000 7f87feffd700 1 -- 172.21.15.134:0/2072974855 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f880400f040 con 0x7f88101038f0 2024-02-16T22:25:35.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.166+0000 7f8814bbc700 1 -- 172.21.15.134:0/2072974855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881010dc00 con 0x7f88101038f0 2024-02-16T22:25:35.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.166+0000 7f87feffd700 1 -- 172.21.15.134:0/2072974855 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f880400daf0 con 0x7f88101038f0 2024-02-16T22:25:35.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.166+0000 7f8814bbc700 1 -- 172.21.15.134:0/2072974855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881010e140 con 0x7f88101038f0 2024-02-16T22:25:35.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.167+0000 7f8814bbc700 1 -- 172.21.15.134:0/2072974855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8810100260 con 0x7f88101038f0 2024-02-16T22:25:35.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.168+0000 7f87feffd700 1 -- 172.21.15.134:0/2072974855 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f8804009810 con 0x7f88101038f0 2024-02-16T22:25:35.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.168+0000 7f87feffd700 1 --2- 172.21.15.134:0/2072974855 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f87f806d7e0 0x7f87f806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:35.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.168+0000 7f87feffd700 1 -- 172.21.15.134:0/2072974855 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f880408cb40 con 0x7f88101038f0 2024-02-16T22:25:35.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.168+0000 7f880e59c700 1 --2- 172.21.15.134:0/2072974855 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f87f806d7e0 0x7f87f806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:35.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.169+0000 7f880e59c700 1 --2- 172.21.15.134:0/2072974855 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f87f806d7e0 0x7f87f806fc90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8800004f90 tx=0x7f8800009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:35.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.173+0000 7f87feffd700 1 -- 172.21.15.134:0/2072974855 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8804059f90 con 0x7f88101038f0 2024-02-16T22:25:35.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.395+0000 7f8814bbc700 1 -- 172.21.15.134:0/2072974855 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8810113730 con 0x7f87f806d7e0 2024-02-16T22:25:35.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.396+0000 7f87feffd700 1 -- 172.21.15.134:0/2072974855 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8810113730 con 0x7f87f806d7e0 2024-02-16T22:25:35.398 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:25:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:25:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:25:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-16T22:25:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-02-16T22:25:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-02-16T22:25:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-02-16T22:25:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-02-16T22:25:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-02-16T22:25:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "7/21 daemons upgraded", 2024-02-16T22:25:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-02-16T22:25:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:25:35.398 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:25:35.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.398+0000 7f8814bbc700 1 -- 172.21.15.134:0/2072974855 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f87f806d7e0 msgr2=0x7f87f806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:35.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.398+0000 7f8814bbc700 1 --2- 172.21.15.134:0/2072974855 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f87f806d7e0 0x7f87f806fc90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8800004f90 tx=0x7f8800009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:35.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.398+0000 7f8814bbc700 1 -- 172.21.15.134:0/2072974855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88101038f0 msgr2=0x7f8810113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:35.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.398+0000 7f8814bbc700 1 --2- 172.21.15.134:0/2072974855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88101038f0 0x7f8810113fa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8804002a50 tx=0x7f8804004600 comp rx=0 tx=0).stop 2024-02-16T22:25:35.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.398+0000 7f8814bbc700 1 -- 172.21.15.134:0/2072974855 shutdown_connections 2024-02-16T22:25:35.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.398+0000 7f8814bbc700 1 --2- 172.21.15.134:0/2072974855 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f87f806d7e0 0x7f87f806fc90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.398+0000 7f8814bbc700 1 --2- 172.21.15.134:0/2072974855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8810102f50 0x7f8810113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.398+0000 7f8814bbc700 1 --2- 172.21.15.134:0/2072974855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88101038f0 0x7f8810113fa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.398+0000 7f8814bbc700 1 -- 172.21.15.134:0/2072974855 >> 172.21.15.134:0/2072974855 conn(0x7f88100f8ae0 msgr2=0x7f88100fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:35.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.399+0000 7f8814bbc700 1 -- 172.21.15.134:0/2072974855 shutdown_connections 2024-02-16T22:25:35.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.399+0000 7f8814bbc700 1 -- 172.21.15.134:0/2072974855 wait complete. 2024-02-16T22:25:35.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.514+0000 7f91c0de5700 1 -- 172.21.15.134:0/555897977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc101e60 msgr2=0x7f91bc102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:35.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.514+0000 7f91c0de5700 1 --2- 172.21.15.134:0/555897977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc101e60 0x7f91bc102230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f91b4004940 tx=0x7f91b4009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:35.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.514+0000 7f91c0de5700 1 -- 172.21.15.134:0/555897977 shutdown_connections 2024-02-16T22:25:35.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.514+0000 7f91c0de5700 1 --2- 172.21.15.134:0/555897977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91bc102800 0x7f91bc0fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.514+0000 7f91c0de5700 1 --2- 172.21.15.134:0/555897977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc101e60 0x7f91bc102230 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.514+0000 7f91c0de5700 1 -- 172.21.15.134:0/555897977 >> 172.21.15.134:0/555897977 conn(0x7f91bc0f7a10 msgr2=0x7f91bc0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:35.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.514+0000 7f91c0de5700 1 -- 172.21.15.134:0/555897977 shutdown_connections 2024-02-16T22:25:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.514+0000 7f91c0de5700 1 -- 172.21.15.134:0/555897977 wait complete. 2024-02-16T22:25:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.514+0000 7f91c0de5700 1 Processor -- start 2024-02-16T22:25:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.514+0000 7f91c0de5700 1 -- start start 2024-02-16T22:25:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91c0de5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91bc101e60 0x7f91bc10c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91c0de5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc102800 0x7f91bc10cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91c0de5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc10d150 con 0x7f91bc102800 2024-02-16T22:25:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91c0de5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc10d2c0 con 0x7f91bc101e60 2024-02-16T22:25:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91b9d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc102800 0x7f91bc10cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91b9d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc102800 0x7f91bc10cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51504/0 (socket says 172.21.15.134:51504) 2024-02-16T22:25:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91b9d9b700 1 -- 172.21.15.134:0/1350475102 learned_addr learned my addr 172.21.15.134:0/1350475102 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:25:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91ba59c700 1 --2- 172.21.15.134:0/1350475102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91bc101e60 0x7f91bc10c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:35.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91b9d9b700 1 -- 172.21.15.134:0/1350475102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91bc101e60 msgr2=0x7f91bc10c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:35.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91b9d9b700 1 --2- 172.21.15.134:0/1350475102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91bc101e60 0x7f91bc10c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91b9d9b700 1 -- 172.21.15.134:0/1350475102 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b4005040 con 0x7f91bc102800 2024-02-16T22:25:35.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91b9d9b700 1 --2- 172.21.15.134:0/1350475102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc102800 0x7f91bc10cc10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f91a400eb40 tx=0x7f91a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:35.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91b2ffd700 1 -- 172.21.15.134:0/1350475102 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91a4007cc0 con 0x7f91bc102800 2024-02-16T22:25:35.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91c0de5700 1 -- 172.21.15.134:0/1350475102 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc10d540 con 0x7f91bc102800 2024-02-16T22:25:35.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91b2ffd700 1 -- 172.21.15.134:0/1350475102 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91a400f040 con 0x7f91bc102800 2024-02-16T22:25:35.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91b2ffd700 1 -- 172.21.15.134:0/1350475102 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91a40095e0 con 0x7f91bc102800 2024-02-16T22:25:35.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.515+0000 7f91c0de5700 1 -- 172.21.15.134:0/1350475102 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc11a0f0 con 0x7f91bc102800 2024-02-16T22:25:35.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.516+0000 7f91c0de5700 1 -- 172.21.15.134:0/1350475102 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91bc0fb610 con 0x7f91bc102800 2024-02-16T22:25:35.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.517+0000 7f91b2ffd700 1 -- 172.21.15.134:0/1350475102 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f91a4009740 con 0x7f91bc102800 2024-02-16T22:25:35.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.517+0000 7f91b2ffd700 1 --2- 172.21.15.134:0/1350475102 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f91a806d7e0 0x7f91a806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:25:35.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.517+0000 7f91b2ffd700 1 -- 172.21.15.134:0/1350475102 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f91a408c7b0 con 0x7f91bc102800 2024-02-16T22:25:35.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.517+0000 7f91ba59c700 1 --2- 172.21.15.134:0/1350475102 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f91a806d7e0 0x7f91a806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:25:35.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.518+0000 7f91ba59c700 1 --2- 172.21.15.134:0/1350475102 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f91a806d7e0 0x7f91a806fc90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f91b400b0d0 tx=0x7f91b4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:25:35.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.522+0000 7f91b2ffd700 1 -- 172.21.15.134:0/1350475102 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f91a4059c30 con 0x7f91bc102800 2024-02-16T22:25:35.643 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:35 smithi134 podman[129887]: 2024-02-16 22:25:35.357435529 +0000 UTC m=+0.653641261 container remove affbfc887de1179fb3d11a7ff96f76b65da7cf86085040ca183b290e23d6a317 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-activate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214) 2024-02-16T22:25:35.643 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:35 smithi134 podman[129997]: 2024-02-16 22:25:35.477738183 +0000 UTC m=+0.022023850 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:25:35.643 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:35 smithi134 podman[129997]: 2024-02-16 22:25:35.600280078 +0000 UTC m=+0.144565731 container create dd1faac850b0b84abddb203369e862d934c91d11c36107ef4dd870fae858de13 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:25:35.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.823+0000 7f91c0de5700 1 -- 172.21.15.134:0/1350475102 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f91bc10d4e0 con 0x7f91bc102800 2024-02-16T22:25:35.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.823+0000 7f91b2ffd700 1 -- 172.21.15.134:0/1350475102 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1049 (secure 0 0 0) 0x7f91a40597c0 con 0x7f91bc102800 2024-02-16T22:25:35.826 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 48/357 objects degraded (13.445%), 14 pgs degraded 2024-02-16T22:25:35.826 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-16T22:25:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: osd.1 (root=default,host=smithi134) is down 2024-02-16T22:25:35.826 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 48/357 objects degraded (13.445%), 14 pgs degraded 2024-02-16T22:25:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-02-16T22:25:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-02-16T22:25:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-02-16T22:25:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-02-16T22:25:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-02-16T22:25:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-02-16T22:25:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-02-16T22:25:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-02-16T22:25:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-02-16T22:25:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-02-16T22:25:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-02-16T22:25:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-02-16T22:25:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-02-16T22:25:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-02-16T22:25:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.826+0000 7f91c0de5700 1 -- 172.21.15.134:0/1350475102 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f91a806d7e0 msgr2=0x7f91a806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.826+0000 7f91c0de5700 1 --2- 172.21.15.134:0/1350475102 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f91a806d7e0 0x7f91a806fc90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f91b400b0d0 tx=0x7f91b4009e30 comp rx=0 tx=0).stop 2024-02-16T22:25:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.826+0000 7f91c0de5700 1 -- 172.21.15.134:0/1350475102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc102800 msgr2=0x7f91bc10cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:25:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.826+0000 7f91c0de5700 1 --2- 172.21.15.134:0/1350475102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc102800 0x7f91bc10cc10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f91a400eb40 tx=0x7f91a400b040 comp rx=0 tx=0).stop 2024-02-16T22:25:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.826+0000 7f91c0de5700 1 -- 172.21.15.134:0/1350475102 shutdown_connections 2024-02-16T22:25:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.826+0000 7f91c0de5700 1 --2- 172.21.15.134:0/1350475102 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f91a806d7e0 0x7f91a806fc90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.826+0000 7f91c0de5700 1 --2- 172.21.15.134:0/1350475102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91bc101e60 0x7f91bc10c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.826+0000 7f91c0de5700 1 --2- 172.21.15.134:0/1350475102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc102800 0x7f91bc10cc10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:25:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.826+0000 7f91c0de5700 1 -- 172.21.15.134:0/1350475102 >> 172.21.15.134:0/1350475102 conn(0x7f91bc0f7a10 msgr2=0x7f91bc0f93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:25:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.826+0000 7f91c0de5700 1 -- 172.21.15.134:0/1350475102 shutdown_connections 2024-02-16T22:25:35.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:25:35.826+0000 7f91c0de5700 1 -- 172.21.15.134:0/1350475102 wait complete. 2024-02-16T22:25:35.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:35 smithi134 ceph-mon[112514]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:35.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:35 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2805179353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:35.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:35 smithi134 ceph-mon[112514]: pgmap v69: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 48/357 objects degraded (13.445%) 2024-02-16T22:25:35.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:35 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/3501864579' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:25:35.929 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:35 smithi134 podman[129997]: 2024-02-16 22:25:35.811310539 +0000 UTC m=+0.355596205 container init dd1faac850b0b84abddb203369e862d934c91d11c36107ef4dd870fae858de13 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-16T22:25:35.929 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:35 smithi134 podman[129997]: 2024-02-16 22:25:35.814799156 +0000 UTC m=+0.359084811 container start dd1faac850b0b84abddb203369e862d934c91d11c36107ef4dd870fae858de13 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-02-16T22:25:35.929 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:35 smithi134 ceph-osd[130036]: -- 172.21.15.134:0/389550464 <== mon.0 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5617edd791e0 con 0x5617edd4ac00 2024-02-16T22:25:35.930 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:35 smithi134 bash[129997]: dd1faac850b0b84abddb203369e862d934c91d11c36107ef4dd870fae858de13 2024-02-16T22:25:35.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:35 smithi173 ceph-mon[83703]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:35.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:35 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2805179353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:35.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:35 smithi173 ceph-mon[83703]: pgmap v69: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 48/357 objects degraded (13.445%) 2024-02-16T22:25:35.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:35 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/3501864579' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:25:36.227 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:35 smithi134 systemd[1]: Started Ceph osd.1 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:25:36.645 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:36 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1[130032]: 2024-02-16T22:25:36.359+0000 7ff43d0ec7c0 -1 Falling back to public interface 2024-02-16T22:25:36.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:36 smithi134 ceph-mon[112514]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:36.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:36 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1350475102' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:25:36.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:36 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:36.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:36 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:36.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:36 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:25:36.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:36 smithi173 ceph-mon[83703]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:25:36.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:36 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1350475102' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:25:36.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:36 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:36.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:36 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:36.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:36 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:25:38.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:38 smithi134 ceph-mon[112514]: pgmap v70: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-16T22:25:38.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:38 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:38.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:38 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:25:38.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:38 smithi173 ceph-mon[83703]: pgmap v70: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-16T22:25:38.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:38 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:38.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:38 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:25:40.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:40 smithi134 ceph-mon[112514]: pgmap v71: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-16T22:25:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:40 smithi173 ceph-mon[83703]: pgmap v71: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-16T22:25:41.226 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:40 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1[130032]: 2024-02-16T22:25:40.903+0000 7ff43d0ec7c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-02-16T22:25:41.977 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:41 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1[130032]: 2024-02-16T22:25:41.565+0000 7ff43d0ec7c0 -1 osd.1 54 log_to_monitors true 2024-02-16T22:25:42.477 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:25:42 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1[130032]: 2024-02-16T22:25:42.232+0000 7ff42e544700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T22:25:42.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:42 smithi134 ceph-mon[112514]: pgmap v72: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-16T22:25:42.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:42 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:42.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:42 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:42.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:42 smithi134 ceph-mon[112514]: from='osd.1 [v2:172.21.15.134:6810/180212709,v1:172.21.15.134:6811/180212709]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-16T22:25:42.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:42 smithi173 ceph-mon[83703]: pgmap v72: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-16T22:25:42.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:42 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:42.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:42 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:42.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:42 smithi173 ceph-mon[83703]: from='osd.1 [v2:172.21.15.134:6810/180212709,v1:172.21.15.134:6811/180212709]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-16T22:25:43.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:43 smithi134 ceph-mon[112514]: from='osd.1 [v2:172.21.15.134:6810/180212709,v1:172.21.15.134:6811/180212709]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-16T22:25:43.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:43 smithi134 ceph-mon[112514]: osdmap e57: 6 total, 5 up, 6 in 2024-02-16T22:25:43.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:43 smithi134 ceph-mon[112514]: from='osd.1 [v2:172.21.15.134:6810/180212709,v1:172.21.15.134:6811/180212709]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-02-16T22:25:43.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:43 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:43.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:43 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:43.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:43 smithi134 ceph-mon[112514]: pgmap v74: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-16T22:25:43.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:43 smithi173 ceph-mon[83703]: from='osd.1 [v2:172.21.15.134:6810/180212709,v1:172.21.15.134:6811/180212709]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-16T22:25:43.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:43 smithi173 ceph-mon[83703]: osdmap e57: 6 total, 5 up, 6 in 2024-02-16T22:25:43.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:43 smithi173 ceph-mon[83703]: from='osd.1 [v2:172.21.15.134:6810/180212709,v1:172.21.15.134:6811/180212709]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-02-16T22:25:43.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:43 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:43.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:43 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:43.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:43 smithi173 ceph-mon[83703]: pgmap v74: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-16T22:25:44.494 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:44 smithi134 ceph-mon[112514]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-16T22:25:44.494 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:44 smithi134 ceph-mon[112514]: failed to encode map e57 with expected crc 2024-02-16T22:25:44.494 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:44 smithi134 ceph-mon[112514]: osd.1 [v2:172.21.15.134:6810/180212709,v1:172.21.15.134:6811/180212709] boot 2024-02-16T22:25:44.494 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:44 smithi134 ceph-mon[112514]: osdmap e58: 6 total, 6 up, 6 in 2024-02-16T22:25:44.494 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:44 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:25:44.494 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:44 smithi134 ceph-mon[112514]: Health check update: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded (PG_DEGRADED) 2024-02-16T22:25:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:44 smithi173 ceph-mon[83703]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-16T22:25:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:44 smithi173 ceph-mon[83703]: failed to encode map e57 with expected crc 2024-02-16T22:25:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:44 smithi173 ceph-mon[83703]: osd.1 [v2:172.21.15.134:6810/180212709,v1:172.21.15.134:6811/180212709] boot 2024-02-16T22:25:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:44 smithi173 ceph-mon[83703]: osdmap e58: 6 total, 6 up, 6 in 2024-02-16T22:25:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:44 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-16T22:25:44.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:44 smithi173 ceph-mon[83703]: Health check update: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded (PG_DEGRADED) 2024-02-16T22:25:45.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:45 smithi134 ceph-mon[112514]: osdmap e59: 6 total, 6 up, 6 in 2024-02-16T22:25:45.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:45 smithi134 ceph-mon[112514]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:45 smithi134 ceph-mon[112514]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:45 smithi134 ceph-mon[112514]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:45 smithi134 ceph-mon[112514]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:45 smithi134 ceph-mon[112514]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:45 smithi134 ceph-mon[112514]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:45 smithi134 ceph-mon[112514]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:45 smithi134 ceph-mon[112514]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:45 smithi134 ceph-mon[112514]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:45 smithi134 ceph-mon[112514]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.452 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:45 smithi134 ceph-mon[112514]: pgmap v77: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-16T22:25:45.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:45 smithi173 ceph-mon[83703]: osdmap e59: 6 total, 6 up, 6 in 2024-02-16T22:25:45.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:45 smithi173 ceph-mon[83703]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:45 smithi173 ceph-mon[83703]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:45 smithi173 ceph-mon[83703]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:45 smithi173 ceph-mon[83703]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:45 smithi173 ceph-mon[83703]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:45 smithi173 ceph-mon[83703]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:45 smithi173 ceph-mon[83703]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:45 smithi173 ceph-mon[83703]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:45 smithi173 ceph-mon[83703]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:45 smithi173 ceph-mon[83703]: failed to encode map e59 with expected crc 2024-02-16T22:25:45.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:45 smithi173 ceph-mon[83703]: pgmap v77: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-16T22:25:47.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:47.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:47.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:25:47.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:25:47.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:47.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:25:47.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:47.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:47.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:47.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-16T22:25:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:25:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:25:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:25:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:47.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:25:47.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-16T22:25:48.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:47 smithi134 ceph-mon[112514]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-16T22:25:48.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:47 smithi134 ceph-mon[112514]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-02-16T22:25:48.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:47 smithi134 ceph-mon[112514]: pgmap v78: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-16T22:25:48.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:47 smithi173 ceph-mon[83703]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-16T22:25:48.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:47 smithi173 ceph-mon[83703]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-02-16T22:25:48.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:47 smithi173 ceph-mon[83703]: pgmap v78: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-16T22:25:49.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:49 smithi134 ceph-mon[112514]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded) 2024-02-16T22:25:49.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:49 smithi134 ceph-mon[112514]: Cluster is now healthy 2024-02-16T22:25:49.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:49 smithi173 ceph-mon[83703]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded) 2024-02-16T22:25:49.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:49 smithi173 ceph-mon[83703]: Cluster is now healthy 2024-02-16T22:25:50.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:50 smithi134 ceph-mon[112514]: pgmap v79: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:50.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:50 smithi173 ceph-mon[83703]: pgmap v79: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:51.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:51 smithi134 ceph-mon[112514]: pgmap v80: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:51.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:51 smithi173 ceph-mon[83703]: pgmap v80: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:53.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:53 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:53.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:53 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:25:53.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:53 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:53.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:53 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:25:54.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:54 smithi134 ceph-mon[112514]: pgmap v81: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:54 smithi173 ceph-mon[83703]: pgmap v81: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:56.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:56 smithi134 ceph-mon[112514]: pgmap v82: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:56.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:56 smithi173 ceph-mon[83703]: pgmap v82: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:58.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:58 smithi134 ceph-mon[112514]: pgmap v83: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:58.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:25:58 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:25:58.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:58 smithi173 ceph-mon[83703]: pgmap v83: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:25:58.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:25:58 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:00.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:00 smithi134 ceph-mon[112514]: pgmap v84: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:26:00.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:00 smithi173 ceph-mon[83703]: pgmap v84: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:26:02.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:02 smithi134 ceph-mon[112514]: pgmap v85: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:26:02.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:02 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-16T22:26:02.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:02 smithi173 ceph-mon[83703]: pgmap v85: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:26:02.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:02 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-16T22:26:03.364 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:03 smithi134 ceph-mon[112514]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-16T22:26:03.364 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:03 smithi134 ceph-mon[112514]: Upgrade: osd.2 is safe to restart 2024-02-16T22:26:03.364 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:03.364 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-16T22:26:03.364 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:26:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:03 smithi173 ceph-mon[83703]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-16T22:26:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:03 smithi173 ceph-mon[83703]: Upgrade: osd.2 is safe to restart 2024-02-16T22:26:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-16T22:26:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:26:04.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:04 smithi134 ceph-mon[112514]: Upgrade: Updating osd.2 2024-02-16T22:26:04.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:04 smithi134 ceph-mon[112514]: Deploying daemon osd.2 on smithi134 2024-02-16T22:26:04.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:04 smithi134 ceph-mon[112514]: pgmap v86: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:26:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:04 smithi173 ceph-mon[83703]: Upgrade: Updating osd.2 2024-02-16T22:26:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:04 smithi173 ceph-mon[83703]: Deploying daemon osd.2 on smithi134 2024-02-16T22:26:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:04 smithi173 ceph-mon[83703]: pgmap v86: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:26:05.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.934+0000 7fd882c80700 1 -- 172.21.15.134:0/1689701064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd87c0fe8f0 msgr2=0x7fd87c107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:05.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.934+0000 7fd882c80700 1 --2- 172.21.15.134:0/1689701064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd87c0fe8f0 0x7fd87c107050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd868004970 tx=0x7fd868009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:05.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.934+0000 7fd882c80700 1 -- 172.21.15.134:0/1689701064 shutdown_connections 2024-02-16T22:26:05.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.934+0000 7fd882c80700 1 --2- 172.21.15.134:0/1689701064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd87c0fe8f0 0x7fd87c107050 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:05.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.934+0000 7fd882c80700 1 --2- 172.21.15.134:0/1689701064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd87c0fdfe0 0x7fd87c0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:05.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.934+0000 7fd882c80700 1 -- 172.21.15.134:0/1689701064 >> 172.21.15.134:0/1689701064 conn(0x7fd87c071d90 msgr2=0x7fd87c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.934+0000 7fd882c80700 1 -- 172.21.15.134:0/1689701064 shutdown_connections 2024-02-16T22:26:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.934+0000 7fd882c80700 1 -- 172.21.15.134:0/1689701064 wait complete. 2024-02-16T22:26:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.934+0000 7fd882c80700 1 Processor -- start 2024-02-16T22:26:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.934+0000 7fd882c80700 1 -- start start 2024-02-16T22:26:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.935+0000 7fd882c80700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd87c0fdfe0 0x7fd87c1139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.935+0000 7fd882c80700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd87c0fe8f0 0x7fd87c113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.935+0000 7fd882c80700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c114580 con 0x7fd87c0fdfe0 2024-02-16T22:26:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.935+0000 7fd882c80700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c10d8b0 con 0x7fd87c0fe8f0 2024-02-16T22:26:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.935+0000 7fd880a1c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd87c0fdfe0 0x7fd87c1139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.935+0000 7fd880a1c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd87c0fdfe0 0x7fd87c1139f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45684/0 (socket says 172.21.15.134:45684) 2024-02-16T22:26:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.935+0000 7fd880a1c700 1 -- 172.21.15.134:0/2408199197 learned_addr learned my addr 172.21.15.134:0/2408199197 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:26:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.935+0000 7fd87bfff700 1 --2- 172.21.15.134:0/2408199197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd87c0fe8f0 0x7fd87c113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.935+0000 7fd880a1c700 1 -- 172.21.15.134:0/2408199197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd87c0fe8f0 msgr2=0x7fd87c113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.935+0000 7fd880a1c700 1 --2- 172.21.15.134:0/2408199197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd87c0fe8f0 0x7fd87c113f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:05.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.935+0000 7fd880a1c700 1 -- 172.21.15.134:0/2408199197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd868005040 con 0x7fd87c0fdfe0 2024-02-16T22:26:05.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.935+0000 7fd87bfff700 1 --2- 172.21.15.134:0/2408199197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd87c0fe8f0 0x7fd87c113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:26:05.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.935+0000 7fd880a1c700 1 --2- 172.21.15.134:0/2408199197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd87c0fdfe0 0x7fd87c1139f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd870002a50 tx=0x7fd8700046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:05.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.936+0000 7fd8797fa700 1 -- 172.21.15.134:0/2408199197 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd870007cc0 con 0x7fd87c0fdfe0 2024-02-16T22:26:05.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.936+0000 7fd8797fa700 1 -- 172.21.15.134:0/2408199197 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd87000f040 con 0x7fd87c0fdfe0 2024-02-16T22:26:05.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.936+0000 7fd882c80700 1 -- 172.21.15.134:0/2408199197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87c10db90 con 0x7fd87c0fdfe0 2024-02-16T22:26:05.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.936+0000 7fd8797fa700 1 -- 172.21.15.134:0/2408199197 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd870009640 con 0x7fd87c0fdfe0 2024-02-16T22:26:05.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.936+0000 7fd882c80700 1 -- 172.21.15.134:0/2408199197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87c10e0a0 con 0x7fd87c0fdfe0 2024-02-16T22:26:05.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.937+0000 7fd882c80700 1 -- 172.21.15.134:0/2408199197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87c1046c0 con 0x7fd87c0fdfe0 2024-02-16T22:26:05.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.937+0000 7fd8797fa700 1 -- 172.21.15.134:0/2408199197 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fd8700097a0 con 0x7fd87c0fdfe0 2024-02-16T22:26:05.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.938+0000 7fd8797fa700 1 --2- 172.21.15.134:0/2408199197 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd86c06d7e0 0x7fd86c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:05.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.938+0000 7fd8797fa700 1 -- 172.21.15.134:0/2408199197 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd87008cb80 con 0x7fd87c0fdfe0 2024-02-16T22:26:05.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.938+0000 7fd87bfff700 1 --2- 172.21.15.134:0/2408199197 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd86c06d7e0 0x7fd86c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:05.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.938+0000 7fd87bfff700 1 --2- 172.21.15.134:0/2408199197 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd86c06d7e0 0x7fd86c06fc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd87c10ebe0 tx=0x7fd868009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:05.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:05.943+0000 7fd8797fa700 1 -- 172.21.15.134:0/2408199197 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd870059fd0 con 0x7fd87c0fdfe0 2024-02-16T22:26:06.180 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:06 smithi134 ceph-mon[112514]: pgmap v87: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:26:06.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.178+0000 7fd882c80700 1 -- 172.21.15.134:0/2408199197 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd87c04bf40 con 0x7fd86c06d7e0 2024-02-16T22:26:06.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.180+0000 7fd8797fa700 1 -- 172.21.15.134:0/2408199197 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd87c04bf40 con 0x7fd86c06d7e0 2024-02-16T22:26:06.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.182+0000 7fd882c80700 1 -- 172.21.15.134:0/2408199197 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd86c06d7e0 msgr2=0x7fd86c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:06.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.182+0000 7fd882c80700 1 --2- 172.21.15.134:0/2408199197 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd86c06d7e0 0x7fd86c06fc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd87c10ebe0 tx=0x7fd868009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:06.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.182+0000 7fd882c80700 1 -- 172.21.15.134:0/2408199197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd87c0fdfe0 msgr2=0x7fd87c1139f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:06.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.182+0000 7fd882c80700 1 --2- 172.21.15.134:0/2408199197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd87c0fdfe0 0x7fd87c1139f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd870002a50 tx=0x7fd8700046b0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.183+0000 7fd882c80700 1 -- 172.21.15.134:0/2408199197 shutdown_connections 2024-02-16T22:26:06.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.183+0000 7fd882c80700 1 --2- 172.21.15.134:0/2408199197 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd86c06d7e0 0x7fd86c06fc90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.183+0000 7fd882c80700 1 --2- 172.21.15.134:0/2408199197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd87c0fdfe0 0x7fd87c1139f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.183+0000 7fd882c80700 1 --2- 172.21.15.134:0/2408199197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd87c0fe8f0 0x7fd87c113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.183+0000 7fd882c80700 1 -- 172.21.15.134:0/2408199197 >> 172.21.15.134:0/2408199197 conn(0x7fd87c071d90 msgr2=0x7fd87c101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:06.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.183+0000 7fd882c80700 1 -- 172.21.15.134:0/2408199197 shutdown_connections 2024-02-16T22:26:06.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.183+0000 7fd882c80700 1 -- 172.21.15.134:0/2408199197 wait complete. 2024-02-16T22:26:06.195 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:26:06.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.288+0000 7f760df6d700 1 -- 172.21.15.134:0/179603715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76080fe8f0 msgr2=0x7f7608107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:06.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.288+0000 7f760df6d700 1 --2- 172.21.15.134:0/179603715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76080fe8f0 0x7f7608107050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f75fc004970 tx=0x7f75fc009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:06.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.288+0000 7f760df6d700 1 -- 172.21.15.134:0/179603715 shutdown_connections 2024-02-16T22:26:06.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.288+0000 7f760df6d700 1 --2- 172.21.15.134:0/179603715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76080fe8f0 0x7f7608107050 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.288+0000 7f760df6d700 1 --2- 172.21.15.134:0/179603715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76080fdfe0 0x7f76080fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.288+0000 7f760df6d700 1 -- 172.21.15.134:0/179603715 >> 172.21.15.134:0/179603715 conn(0x7f7608071d90 msgr2=0x7f7608072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:06.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.288+0000 7f760df6d700 1 -- 172.21.15.134:0/179603715 shutdown_connections 2024-02-16T22:26:06.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.288+0000 7f760df6d700 1 -- 172.21.15.134:0/179603715 wait complete. 2024-02-16T22:26:06.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.289+0000 7f760df6d700 1 Processor -- start 2024-02-16T22:26:06.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.289+0000 7f760df6d700 1 -- start start 2024-02-16T22:26:06.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.289+0000 7f760df6d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76080fdfe0 0x7f76081139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:06.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.289+0000 7f760df6d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76080fe8f0 0x7f7608113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:06.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.289+0000 7f760df6d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7608114580 con 0x7f76080fe8f0 2024-02-16T22:26:06.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.289+0000 7f760df6d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760810d8b0 con 0x7f76080fdfe0 2024-02-16T22:26:06.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.289+0000 7f7606ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76080fe8f0 0x7f7608113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:06.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.289+0000 7f7606ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76080fe8f0 0x7f7608113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45704/0 (socket says 172.21.15.134:45704) 2024-02-16T22:26:06.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.289+0000 7f7606ffd700 1 -- 172.21.15.134:0/3496836496 learned_addr learned my addr 172.21.15.134:0/3496836496 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:26:06.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.290+0000 7f76077fe700 1 --2- 172.21.15.134:0/3496836496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76080fdfe0 0x7f76081139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:06.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.290+0000 7f7606ffd700 1 -- 172.21.15.134:0/3496836496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76080fdfe0 msgr2=0x7f76081139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:06.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.290+0000 7f7606ffd700 1 --2- 172.21.15.134:0/3496836496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76080fdfe0 0x7f76081139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.290+0000 7f7606ffd700 1 -- 172.21.15.134:0/3496836496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc005040 con 0x7f76080fe8f0 2024-02-16T22:26:06.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.290+0000 7f7606ffd700 1 --2- 172.21.15.134:0/3496836496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76080fe8f0 0x7f7608113f30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f75fc005010 tx=0x7f75fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:06.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.290+0000 7f75effff700 1 -- 172.21.15.134:0/3496836496 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75fc00e040 con 0x7f76080fe8f0 2024-02-16T22:26:06.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.290+0000 7f760df6d700 1 -- 172.21.15.134:0/3496836496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760810db30 con 0x7f76080fe8f0 2024-02-16T22:26:06.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.290+0000 7f75effff700 1 -- 172.21.15.134:0/3496836496 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75fc013420 con 0x7f76080fe8f0 2024-02-16T22:26:06.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.290+0000 7f75effff700 1 -- 172.21.15.134:0/3496836496 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75fc01c610 con 0x7f76080fe8f0 2024-02-16T22:26:06.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.290+0000 7f760df6d700 1 -- 172.21.15.134:0/3496836496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760810e070 con 0x7f76080fe8f0 2024-02-16T22:26:06.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.291+0000 7f760df6d700 1 -- 172.21.15.134:0/3496836496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76081046c0 con 0x7f76080fe8f0 2024-02-16T22:26:06.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.293+0000 7f75effff700 1 -- 172.21.15.134:0/3496836496 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f75fc013590 con 0x7f76080fe8f0 2024-02-16T22:26:06.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.293+0000 7f75effff700 1 --2- 172.21.15.134:0/3496836496 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f75f006d7e0 0x7f75f006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:06.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.293+0000 7f75effff700 1 -- 172.21.15.134:0/3496836496 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f75fc08e100 con 0x7f76080fe8f0 2024-02-16T22:26:06.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.293+0000 7f76077fe700 1 --2- 172.21.15.134:0/3496836496 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f75f006d7e0 0x7f75f006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:06.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.294+0000 7f76077fe700 1 --2- 172.21.15.134:0/3496836496 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f75f006d7e0 0x7f75f006fc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009b80 tx=0x7f75f800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:06.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.298+0000 7f75effff700 1 -- 172.21.15.134:0/3496836496 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f75fc05b550 con 0x7f76080fe8f0 2024-02-16T22:26:06.477 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:06 smithi134 systemd[1]: Stopping Ceph osd.2 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:26:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:06 smithi173 ceph-mon[83703]: pgmap v87: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:26:06.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.525+0000 7f760df6d700 1 -- 172.21.15.134:0/3496836496 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f760810a080 con 0x7f75f006d7e0 2024-02-16T22:26:06.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.526+0000 7f75effff700 1 -- 172.21.15.134:0/3496836496 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f760810a080 con 0x7f75f006d7e0 2024-02-16T22:26:06.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.528+0000 7f760df6d700 1 -- 172.21.15.134:0/3496836496 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f75f006d7e0 msgr2=0x7f75f006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:06.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.528+0000 7f760df6d700 1 --2- 172.21.15.134:0/3496836496 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f75f006d7e0 0x7f75f006fc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009b80 tx=0x7f75f800b040 comp rx=0 tx=0).stop 2024-02-16T22:26:06.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.528+0000 7f760df6d700 1 -- 172.21.15.134:0/3496836496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76080fe8f0 msgr2=0x7f7608113f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:06.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.528+0000 7f760df6d700 1 --2- 172.21.15.134:0/3496836496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76080fe8f0 0x7f7608113f30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f75fc005010 tx=0x7f75fc009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:06.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.528+0000 7f760df6d700 1 -- 172.21.15.134:0/3496836496 shutdown_connections 2024-02-16T22:26:06.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.528+0000 7f760df6d700 1 --2- 172.21.15.134:0/3496836496 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f75f006d7e0 0x7f75f006fc90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.528+0000 7f760df6d700 1 --2- 172.21.15.134:0/3496836496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76080fdfe0 0x7f76081139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.528+0000 7f760df6d700 1 --2- 172.21.15.134:0/3496836496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76080fe8f0 0x7f7608113f30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.528+0000 7f760df6d700 1 -- 172.21.15.134:0/3496836496 >> 172.21.15.134:0/3496836496 conn(0x7f7608071d90 msgr2=0x7f7608101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:06.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.528+0000 7f760df6d700 1 -- 172.21.15.134:0/3496836496 shutdown_connections 2024-02-16T22:26:06.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.528+0000 7f760df6d700 1 -- 172.21.15.134:0/3496836496 wait complete. 2024-02-16T22:26:06.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.631+0000 7fe874a03700 1 -- 172.21.15.134:0/6486748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8701016b0 msgr2=0x7fe870101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:06.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.631+0000 7fe874a03700 1 --2- 172.21.15.134:0/6486748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8701016b0 0x7fe870101a80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe868004940 tx=0x7fe868009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:06.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.631+0000 7fe874a03700 1 -- 172.21.15.134:0/6486748 shutdown_connections 2024-02-16T22:26:06.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.631+0000 7fe874a03700 1 --2- 172.21.15.134:0/6486748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8700fb6c0 0x7fe8700fbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.631+0000 7fe874a03700 1 --2- 172.21.15.134:0/6486748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8701016b0 0x7fe870101a80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.631+0000 7fe874a03700 1 -- 172.21.15.134:0/6486748 >> 172.21.15.134:0/6486748 conn(0x7fe870071560 msgr2=0x7fe870071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:06.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.631+0000 7fe874a03700 1 -- 172.21.15.134:0/6486748 shutdown_connections 2024-02-16T22:26:06.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.631+0000 7fe874a03700 1 -- 172.21.15.134:0/6486748 wait complete. 2024-02-16T22:26:06.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.632+0000 7fe874a03700 1 Processor -- start 2024-02-16T22:26:06.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.632+0000 7fe874a03700 1 -- start start 2024-02-16T22:26:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.632+0000 7fe874a03700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8700fb6c0 0x7fe87010ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.632+0000 7fe874a03700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8701016b0 0x7fe87010ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.632+0000 7fe874a03700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87010f4e0 con 0x7fe8701016b0 2024-02-16T22:26:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.632+0000 7fe874a03700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87010f650 con 0x7fe8700fb6c0 2024-02-16T22:26:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.632+0000 7fe86dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8701016b0 0x7fe87010ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.632+0000 7fe86dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8701016b0 0x7fe87010ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45720/0 (socket says 172.21.15.134:45720) 2024-02-16T22:26:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.632+0000 7fe86dd9b700 1 -- 172.21.15.134:0/2462602268 learned_addr learned my addr 172.21.15.134:0/2462602268 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:26:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.632+0000 7fe86e59c700 1 --2- 172.21.15.134:0/2462602268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8700fb6c0 0x7fe87010ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.632+0000 7fe86dd9b700 1 -- 172.21.15.134:0/2462602268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8700fb6c0 msgr2=0x7fe87010ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.632+0000 7fe86dd9b700 1 --2- 172.21.15.134:0/2462602268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8700fb6c0 0x7fe87010ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.632+0000 7fe86dd9b700 1 -- 172.21.15.134:0/2462602268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868005040 con 0x7fe8701016b0 2024-02-16T22:26:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.633+0000 7fe86dd9b700 1 --2- 172.21.15.134:0/2462602268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8701016b0 0x7fe87010ef50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe86400ec90 tx=0x7fe86400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.633+0000 7fe85effd700 1 -- 172.21.15.134:0/2462602268 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe86400eea0 con 0x7fe8701016b0 2024-02-16T22:26:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.633+0000 7fe85effd700 1 -- 172.21.15.134:0/2462602268 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe86400f040 con 0x7fe8701016b0 2024-02-16T22:26:06.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.633+0000 7fe874a03700 1 -- 172.21.15.134:0/2462602268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8701179e0 con 0x7fe8701016b0 2024-02-16T22:26:06.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.633+0000 7fe85effd700 1 -- 172.21.15.134:0/2462602268 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe864009640 con 0x7fe8701016b0 2024-02-16T22:26:06.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.633+0000 7fe874a03700 1 -- 172.21.15.134:0/2462602268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe870117ed0 con 0x7fe8701016b0 2024-02-16T22:26:06.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.634+0000 7fe874a03700 1 -- 172.21.15.134:0/2462602268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe870073080 con 0x7fe8701016b0 2024-02-16T22:26:06.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.634+0000 7fe85effd700 1 -- 172.21.15.134:0/2462602268 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fe86400c940 con 0x7fe8701016b0 2024-02-16T22:26:06.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.635+0000 7fe85effd700 1 --2- 172.21.15.134:0/2462602268 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe85806d7f0 0x7fe85806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:06.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.635+0000 7fe85effd700 1 -- 172.21.15.134:0/2462602268 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe86408d380 con 0x7fe8701016b0 2024-02-16T22:26:06.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.635+0000 7fe86e59c700 1 --2- 172.21.15.134:0/2462602268 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe85806d7f0 0x7fe85806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:06.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.635+0000 7fe86e59c700 1 --2- 172.21.15.134:0/2462602268 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe85806d7f0 0x7fe85806fca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe868000c00 tx=0x7fe868009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:06.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.639+0000 7fe85effd700 1 -- 172.21.15.134:0/2462602268 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe864056ca0 con 0x7fe8701016b0 2024-02-16T22:26:06.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.845+0000 7fe874a03700 1 -- 172.21.15.134:0/2462602268 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe870106d00 con 0x7fe85806d7f0 2024-02-16T22:26:06.847 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:06 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2[63186]: 2024-02-16T22:26:06.588+0000 7fb8269d0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:26:06.847 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:06 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2[63186]: 2024-02-16T22:26:06.588+0000 7fb8269d0700 -1 osd.2 59 *** Got signal Terminated *** 2024-02-16T22:26:06.847 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:06 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2[63186]: 2024-02-16T22:26:06.588+0000 7fb8269d0700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-16T22:26:06.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.856+0000 7fe85effd700 1 -- 172.21.15.134:0/2462602268 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe870106d00 con 0x7fe85806d7f0 2024-02-16T22:26:06.858 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:26:06.858 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (3m) 25s ago 15m 26.8M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:26:06.858 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (94s) 25s ago 15m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 429739bfee94 2024-02-16T22:26:06.858 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (89s) 85s ago 14m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 1e81cd2fd510 2024-02-16T22:26:06.858 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (3m) 25s ago 14m 84.6M - 9.4.12 a0ea5e3c46d9 29d29cf667e7 2024-02-16T22:26:06.858 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (9m) 25s ago 9m 14.1M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (9m) 25s ago 9m 125M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (9m) 85s ago 9m 16.9M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (9m) 85s ago 9m 118M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (5m) 25s ago 16m 498M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (4m) 85s ago 14m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (2m) 25s ago 16m 46.0M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2903b3988442 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (2m) 85s ago 13m 39.0M 2048M 19.0.0-1450-gf78a58c0 f081f847070a dd7cf2f31226 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (4m) 25s ago 15m 16.5M - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (4m) 85s ago 14m 14.6M - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (68s) 25s ago 13m 90.5M 1557M 19.0.0-1450-gf78a58c0 f081f847070a d0153b47ae7e 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (31s) 25s ago 12m 12.6M 1557M 19.0.0-1450-gf78a58c0 f081f847070a dd1faac850b0 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (12m) 25s ago 12m 190M 1557M 17.2.7-513-gb88fae66 870a0944ccb8 b77bd11d8091 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (11m) 85s ago 11m 267M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (11m) 85s ago 11m 237M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:26:06.859 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (10m) 85s ago 10m 231M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:26:06.860 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (4m) 25s ago 14m 61.5M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:26:06.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.858+0000 7fe874a03700 1 -- 172.21.15.134:0/2462602268 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe85806d7f0 msgr2=0x7fe85806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:06.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.858+0000 7fe874a03700 1 --2- 172.21.15.134:0/2462602268 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe85806d7f0 0x7fe85806fca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe868000c00 tx=0x7fe868009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:06.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.858+0000 7fe874a03700 1 -- 172.21.15.134:0/2462602268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8701016b0 msgr2=0x7fe87010ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:06.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.858+0000 7fe874a03700 1 --2- 172.21.15.134:0/2462602268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8701016b0 0x7fe87010ef50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe86400ec90 tx=0x7fe86400b040 comp rx=0 tx=0).stop 2024-02-16T22:26:06.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.858+0000 7fe874a03700 1 -- 172.21.15.134:0/2462602268 shutdown_connections 2024-02-16T22:26:06.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.858+0000 7fe874a03700 1 --2- 172.21.15.134:0/2462602268 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe85806d7f0 0x7fe85806fca0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.858+0000 7fe874a03700 1 --2- 172.21.15.134:0/2462602268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8700fb6c0 0x7fe87010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.858+0000 7fe874a03700 1 --2- 172.21.15.134:0/2462602268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8701016b0 0x7fe87010ef50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.858+0000 7fe874a03700 1 -- 172.21.15.134:0/2462602268 >> 172.21.15.134:0/2462602268 conn(0x7fe870071560 msgr2=0x7fe8700fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:06.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.858+0000 7fe874a03700 1 -- 172.21.15.134:0/2462602268 shutdown_connections 2024-02-16T22:26:06.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.858+0000 7fe874a03700 1 -- 172.21.15.134:0/2462602268 wait complete. 2024-02-16T22:26:06.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.959+0000 7fdb188e4700 1 -- 172.21.15.134:0/2734964092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102f50 msgr2=0x7fdb14103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.959+0000 7fdb188e4700 1 --2- 172.21.15.134:0/2734964092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102f50 0x7fdb14103320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009ce0 tx=0x7fdb0c004d10 comp rx=0 tx=0).stop 2024-02-16T22:26:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.959+0000 7fdb188e4700 1 -- 172.21.15.134:0/2734964092 shutdown_connections 2024-02-16T22:26:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.959+0000 7fdb188e4700 1 --2- 172.21.15.134:0/2734964092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb141038f0 0x7fdb140fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.959+0000 7fdb188e4700 1 --2- 172.21.15.134:0/2734964092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102f50 0x7fdb14103320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.959+0000 7fdb188e4700 1 -- 172.21.15.134:0/2734964092 >> 172.21.15.134:0/2734964092 conn(0x7fdb140f8ae0 msgr2=0x7fdb140faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.959+0000 7fdb188e4700 1 -- 172.21.15.134:0/2734964092 shutdown_connections 2024-02-16T22:26:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.959+0000 7fdb188e4700 1 -- 172.21.15.134:0/2734964092 wait complete. 2024-02-16T22:26:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.960+0000 7fdb188e4700 1 Processor -- start 2024-02-16T22:26:06.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.960+0000 7fdb188e4700 1 -- start start 2024-02-16T22:26:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.960+0000 7fdb188e4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102f50 0x7fdb14113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.960+0000 7fdb188e4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb141038f0 0x7fdb14114150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.960+0000 7fdb188e4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb141147a0 con 0x7fdb14102f50 2024-02-16T22:26:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.960+0000 7fdb188e4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1410daf0 con 0x7fdb141038f0 2024-02-16T22:26:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.960+0000 7fdb1259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102f50 0x7fdb14113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.960+0000 7fdb1259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102f50 0x7fdb14113c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45726/0 (socket says 172.21.15.134:45726) 2024-02-16T22:26:06.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.960+0000 7fdb1259c700 1 -- 172.21.15.134:0/2993322843 learned_addr learned my addr 172.21.15.134:0/2993322843 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:26:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.960+0000 7fdb1259c700 1 -- 172.21.15.134:0/2993322843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb141038f0 msgr2=0x7fdb14114150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.960+0000 7fdb1259c700 1 --2- 172.21.15.134:0/2993322843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb141038f0 0x7fdb14114150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.961+0000 7fdb1259c700 1 -- 172.21.15.134:0/2993322843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c009940 con 0x7fdb14102f50 2024-02-16T22:26:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.961+0000 7fdb1259c700 1 --2- 172.21.15.134:0/2993322843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102f50 0x7fdb14113c10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00be90 tx=0x7fdb0c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.961+0000 7fdb0affd700 1 -- 172.21.15.134:0/2993322843 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb0c00e040 con 0x7fdb14102f50 2024-02-16T22:26:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.961+0000 7fdb0affd700 1 -- 172.21.15.134:0/2993322843 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb0c008ea0 con 0x7fdb14102f50 2024-02-16T22:26:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.961+0000 7fdb188e4700 1 -- 172.21.15.134:0/2993322843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1410dd70 con 0x7fdb14102f50 2024-02-16T22:26:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.961+0000 7fdb0affd700 1 -- 172.21.15.134:0/2993322843 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb0c01c7a0 con 0x7fdb14102f50 2024-02-16T22:26:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.961+0000 7fdb188e4700 1 -- 172.21.15.134:0/2993322843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1410e2b0 con 0x7fdb14102f50 2024-02-16T22:26:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.962+0000 7fdb188e4700 1 -- 172.21.15.134:0/2993322843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb140fc6e0 con 0x7fdb14102f50 2024-02-16T22:26:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.962+0000 7fdb0affd700 1 -- 172.21.15.134:0/2993322843 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fdb0c012410 con 0x7fdb14102f50 2024-02-16T22:26:06.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.963+0000 7fdb0affd700 1 --2- 172.21.15.134:0/2993322843 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdb0006d7e0 0x7fdb0006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.963+0000 7fdb0affd700 1 -- 172.21.15.134:0/2993322843 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fdb0c08ead0 con 0x7fdb14102f50 2024-02-16T22:26:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.963+0000 7fdb11d9b700 1 --2- 172.21.15.134:0/2993322843 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdb0006d7e0 0x7fdb0006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:06.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.963+0000 7fdb11d9b700 1 --2- 172.21.15.134:0/2993322843 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdb0006d7e0 0x7fdb0006fc90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb1410f4b0 tx=0x7fdafc009ce0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:06.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:06.967+0000 7fdb0affd700 1 -- 172.21.15.134:0/2993322843 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdb0c058370 con 0x7fdb14102f50 2024-02-16T22:26:07.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.255+0000 7fdb188e4700 1 -- 172.21.15.134:0/2993322843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdb1410f1f0 con 0x7fdb14102f50 2024-02-16T22:26:07.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.256+0000 7fdb0affd700 1 -- 172.21.15.134:0/2993322843 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fdb0c004e10 con 0x7fdb14102f50 2024-02-16T22:26:07.258 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:26:07.258 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:26:07.258 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:26:07.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:26:07.258 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:26:07.258 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:26:07.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:26:07.258 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:26:07.258 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 3, 2024-02-16T22:26:07.258 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:26:07.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:26:07.258 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:26:07.258 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:26:07.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:26:07.259 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:26:07.259 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 7, 2024-02-16T22:26:07.259 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-16T22:26:07.259 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:26:07.259 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:26:07.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.258+0000 7fdb188e4700 1 -- 172.21.15.134:0/2993322843 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdb0006d7e0 msgr2=0x7fdb0006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:07.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.258+0000 7fdb188e4700 1 --2- 172.21.15.134:0/2993322843 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdb0006d7e0 0x7fdb0006fc90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb1410f4b0 tx=0x7fdafc009ce0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.258+0000 7fdb188e4700 1 -- 172.21.15.134:0/2993322843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102f50 msgr2=0x7fdb14113c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:07.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.258+0000 7fdb188e4700 1 --2- 172.21.15.134:0/2993322843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102f50 0x7fdb14113c10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00be90 tx=0x7fdb0c004d10 comp rx=0 tx=0).stop 2024-02-16T22:26:07.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.258+0000 7fdb188e4700 1 -- 172.21.15.134:0/2993322843 shutdown_connections 2024-02-16T22:26:07.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.258+0000 7fdb188e4700 1 --2- 172.21.15.134:0/2993322843 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdb0006d7e0 0x7fdb0006fc90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.258+0000 7fdb188e4700 1 --2- 172.21.15.134:0/2993322843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102f50 0x7fdb14113c10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.258+0000 7fdb188e4700 1 --2- 172.21.15.134:0/2993322843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb141038f0 0x7fdb14114150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.258+0000 7fdb188e4700 1 -- 172.21.15.134:0/2993322843 >> 172.21.15.134:0/2993322843 conn(0x7fdb140f8ae0 msgr2=0x7fdb140fa540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:07.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.258+0000 7fdb188e4700 1 -- 172.21.15.134:0/2993322843 shutdown_connections 2024-02-16T22:26:07.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.258+0000 7fdb188e4700 1 -- 172.21.15.134:0/2993322843 wait complete. 2024-02-16T22:26:07.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.360+0000 7fb9aded1700 1 -- 172.21.15.134:0/3664922569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a8101e40 msgr2=0x7fb9a8102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:07.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.360+0000 7fb9aded1700 1 --2- 172.21.15.134:0/3664922569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a8101e40 0x7fb9a8102210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009ce0 tx=0x7fb9a0004d10 comp rx=0 tx=0).stop 2024-02-16T22:26:07.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.360+0000 7fb9aded1700 1 -- 172.21.15.134:0/3664922569 shutdown_connections 2024-02-16T22:26:07.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.360+0000 7fb9aded1700 1 --2- 172.21.15.134:0/3664922569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a81027e0 0x7fb9a80fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.360+0000 7fb9aded1700 1 --2- 172.21.15.134:0/3664922569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a8101e40 0x7fb9a8102210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.360+0000 7fb9aded1700 1 -- 172.21.15.134:0/3664922569 >> 172.21.15.134:0/3664922569 conn(0x7fb9a8071d90 msgr2=0x7fb9a8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:07.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.360+0000 7fb9aded1700 1 -- 172.21.15.134:0/3664922569 shutdown_connections 2024-02-16T22:26:07.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.360+0000 7fb9aded1700 1 -- 172.21.15.134:0/3664922569 wait complete. 2024-02-16T22:26:07.363 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:07 smithi134 ceph-mon[112514]: osd.2 marked itself down and dead 2024-02-16T22:26:07.363 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:07 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:26:07.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.361+0000 7fb9aded1700 1 Processor -- start 2024-02-16T22:26:07.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.361+0000 7fb9aded1700 1 -- start start 2024-02-16T22:26:07.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.361+0000 7fb9aded1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a8101e40 0x7fb9a8115e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:07.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.361+0000 7fb9aded1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a81027e0 0x7fb9a8116360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:07.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.361+0000 7fb9aded1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a81169b0 con 0x7fb9a81027e0 2024-02-16T22:26:07.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.361+0000 7fb9aded1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a810fcc0 con 0x7fb9a8101e40 2024-02-16T22:26:07.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.361+0000 7fb9a6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a81027e0 0x7fb9a8116360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:07.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.361+0000 7fb9a6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a81027e0 0x7fb9a8116360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45756/0 (socket says 172.21.15.134:45756) 2024-02-16T22:26:07.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.361+0000 7fb9a6ffd700 1 -- 172.21.15.134:0/2700321858 learned_addr learned my addr 172.21.15.134:0/2700321858 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:26:07.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.361+0000 7fb9a77fe700 1 --2- 172.21.15.134:0/2700321858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a8101e40 0x7fb9a8115e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:07.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.361+0000 7fb9a6ffd700 1 -- 172.21.15.134:0/2700321858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a8101e40 msgr2=0x7fb9a8115e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:07.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.361+0000 7fb9a6ffd700 1 --2- 172.21.15.134:0/2700321858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a8101e40 0x7fb9a8115e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.361+0000 7fb9a6ffd700 1 -- 172.21.15.134:0/2700321858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a0009940 con 0x7fb9a81027e0 2024-02-16T22:26:07.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.362+0000 7fb9a6ffd700 1 --2- 172.21.15.134:0/2700321858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a81027e0 0x7fb9a8116360 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb990002a50 tx=0x7fb990004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:07.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.362+0000 7fb99ffff700 1 -- 172.21.15.134:0/2700321858 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb990007cc0 con 0x7fb9a81027e0 2024-02-16T22:26:07.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.362+0000 7fb99ffff700 1 -- 172.21.15.134:0/2700321858 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb99000f040 con 0x7fb9a81027e0 2024-02-16T22:26:07.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.362+0000 7fb9aded1700 1 -- 172.21.15.134:0/2700321858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a810ffa0 con 0x7fb9a81027e0 2024-02-16T22:26:07.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.362+0000 7fb99ffff700 1 -- 172.21.15.134:0/2700321858 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb99000da40 con 0x7fb9a81027e0 2024-02-16T22:26:07.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.362+0000 7fb9aded1700 1 -- 172.21.15.134:0/2700321858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a81104e0 con 0x7fb9a81027e0 2024-02-16T22:26:07.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.363+0000 7fb9aded1700 1 -- 172.21.15.134:0/2700321858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a80738b0 con 0x7fb9a81027e0 2024-02-16T22:26:07.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.363+0000 7fb99ffff700 1 -- 172.21.15.134:0/2700321858 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fb99000dcb0 con 0x7fb9a81027e0 2024-02-16T22:26:07.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.364+0000 7fb99ffff700 1 --2- 172.21.15.134:0/2700321858 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb99406d7e0 0x7fb99406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:07.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.364+0000 7fb99ffff700 1 -- 172.21.15.134:0/2700321858 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb99008ccd0 con 0x7fb9a81027e0 2024-02-16T22:26:07.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.364+0000 7fb9a77fe700 1 --2- 172.21.15.134:0/2700321858 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb99406d7e0 0x7fb99406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:07.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.364+0000 7fb9a77fe700 1 --2- 172.21.15.134:0/2700321858 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb99406d7e0 0x7fb99406fc90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0015040 tx=0x7fb9a0004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:07.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.368+0000 7fb99ffff700 1 -- 172.21.15.134:0/2700321858 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb990059e10 con 0x7fb9a81027e0 2024-02-16T22:26:07.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:07 smithi173 ceph-mon[83703]: osd.2 marked itself down and dead 2024-02-16T22:26:07.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:07 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:26:07.613 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:07 smithi134 podman[135275]: 2024-02-16 22:26:07.454265274 +0000 UTC m=+0.996280004 container died b77bd11d80916ba22d37cb5f81c0cc326459584f5685ab26d8f62c37f7c1a15a (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=quincy-b88fae6, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-16T22:26:07.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.611+0000 7fb9aded1700 1 -- 172.21.15.134:0/2700321858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb9a8111400 con 0x7fb9a81027e0 2024-02-16T22:26:07.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.611+0000 7fb99ffff700 1 -- 172.21.15.134:0/2700321858 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1860 (secure 0 0 0) 0x7fb990059c30 con 0x7fb9a81027e0 2024-02-16T22:26:07.614 INFO:teuthology.orchestra.run.smithi134.stdout:e20 2024-02-16T22:26:07.614 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:26:07.614 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:26:07.614 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-02-16T22:26:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:26:07.614 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-02-16T22:26:07.614 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-02-16T22:26:07.614 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 20 2024-02-16T22:26:07.614 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-16T22:26:07.614 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:26:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-02-16T22:23:22.543229+0000 2024-02-16T22:26:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-02-16T22:26:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-02-16T22:26:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-02-16T22:26:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-02-16T22:26:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-02-16T22:26:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-02-16T22:26:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-02-16T22:26:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-02-16T22:26:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-02-16T22:26:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:26:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 2 2024-02-16T22:26:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:in 0,1 2024-02-16T22:26:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14478,1=24269} 2024-02-16T22:26:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-02-16T22:26:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-02-16T22:26:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-02-16T22:26:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-02-16T22:26:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-02-16T22:26:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-02-16T22:26:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-02-16T22:26:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-02-16T22:26:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-02-16T22:26:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.jyajef{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:26:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.qljqef{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:26:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:26:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:26:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-02-16T22:26:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:26:07.617 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.cygfxr{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2804816044,v1:172.21.15.134:6827/2804816044] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:26:07.617 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.phstvm{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:26:07.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.614+0000 7fb9aded1700 1 -- 172.21.15.134:0/2700321858 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb99406d7e0 msgr2=0x7fb99406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.614+0000 7fb9aded1700 1 --2- 172.21.15.134:0/2700321858 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb99406d7e0 0x7fb99406fc90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0015040 tx=0x7fb9a0004d10 comp rx=0 tx=0).stop 2024-02-16T22:26:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.614+0000 7fb9aded1700 1 -- 172.21.15.134:0/2700321858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a81027e0 msgr2=0x7fb9a8116360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.614+0000 7fb9aded1700 1 --2- 172.21.15.134:0/2700321858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a81027e0 0x7fb9a8116360 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb990002a50 tx=0x7fb990004600 comp rx=0 tx=0).stop 2024-02-16T22:26:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.614+0000 7fb9aded1700 1 -- 172.21.15.134:0/2700321858 shutdown_connections 2024-02-16T22:26:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.614+0000 7fb9aded1700 1 --2- 172.21.15.134:0/2700321858 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb99406d7e0 0x7fb99406fc90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.614+0000 7fb9aded1700 1 --2- 172.21.15.134:0/2700321858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a8101e40 0x7fb9a8115e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.614+0000 7fb9aded1700 1 --2- 172.21.15.134:0/2700321858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a81027e0 0x7fb9a8116360 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.614+0000 7fb9aded1700 1 -- 172.21.15.134:0/2700321858 >> 172.21.15.134:0/2700321858 conn(0x7fb9a8071d90 msgr2=0x7fb9a80656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.614+0000 7fb9aded1700 1 -- 172.21.15.134:0/2700321858 shutdown_connections 2024-02-16T22:26:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.614+0000 7fb9aded1700 1 -- 172.21.15.134:0/2700321858 wait complete. 2024-02-16T22:26:07.618 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 20 2024-02-16T22:26:07.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.717+0000 7f160419b700 1 -- 172.21.15.134:0/2204441661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fe8f0 msgr2=0x7f15fc106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:07.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.717+0000 7f160419b700 1 --2- 172.21.15.134:0/2204441661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fe8f0 0x7f15fc106fc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f15ec004940 tx=0x7f15ec009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:07.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.717+0000 7f160419b700 1 -- 172.21.15.134:0/2204441661 shutdown_connections 2024-02-16T22:26:07.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.717+0000 7f160419b700 1 --2- 172.21.15.134:0/2204441661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fe8f0 0x7f15fc106fc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.717+0000 7f160419b700 1 --2- 172.21.15.134:0/2204441661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc0fdf50 0x7f15fc0fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.717+0000 7f160419b700 1 -- 172.21.15.134:0/2204441661 >> 172.21.15.134:0/2204441661 conn(0x7f15fc0f7a10 msgr2=0x7f15fc0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:07.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.717+0000 7f160419b700 1 -- 172.21.15.134:0/2204441661 shutdown_connections 2024-02-16T22:26:07.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.717+0000 7f160419b700 1 -- 172.21.15.134:0/2204441661 wait complete. 2024-02-16T22:26:07.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.718+0000 7f160419b700 1 Processor -- start 2024-02-16T22:26:07.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.718+0000 7f160419b700 1 -- start start 2024-02-16T22:26:07.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.718+0000 7f160419b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc0fdf50 0x7f15fc113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.718+0000 7f160419b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fe8f0 0x7f15fc113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.718+0000 7f160419b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc114640 con 0x7f15fc0fe8f0 2024-02-16T22:26:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.718+0000 7f160419b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc10d970 con 0x7f15fc0fdf50 2024-02-16T22:26:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.718+0000 7f1601736700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fe8f0 0x7f15fc113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.718+0000 7f1601736700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fe8f0 0x7f15fc113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45774/0 (socket says 172.21.15.134:45774) 2024-02-16T22:26:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.718+0000 7f1601736700 1 -- 172.21.15.134:0/2166485815 learned_addr learned my addr 172.21.15.134:0/2166485815 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:26:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.719+0000 7f1601f37700 1 --2- 172.21.15.134:0/2166485815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc0fdf50 0x7f15fc113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.719+0000 7f1601736700 1 -- 172.21.15.134:0/2166485815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc0fdf50 msgr2=0x7f15fc113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.719+0000 7f1601736700 1 --2- 172.21.15.134:0/2166485815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc0fdf50 0x7f15fc113ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.719+0000 7f1601736700 1 -- 172.21.15.134:0/2166485815 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec005040 con 0x7f15fc0fe8f0 2024-02-16T22:26:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.719+0000 7f1601736700 1 --2- 172.21.15.134:0/2166485815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fe8f0 0x7f15fc113ff0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f15ec004890 tx=0x7f15ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.719+0000 7f15f27fc700 1 -- 172.21.15.134:0/2166485815 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15ec00e040 con 0x7f15fc0fe8f0 2024-02-16T22:26:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.719+0000 7f15f27fc700 1 -- 172.21.15.134:0/2166485815 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15ec004290 con 0x7f15fc0fe8f0 2024-02-16T22:26:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.719+0000 7f160419b700 1 -- 172.21.15.134:0/2166485815 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15fc10dbf0 con 0x7f15fc0fe8f0 2024-02-16T22:26:07.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.719+0000 7f15f27fc700 1 -- 172.21.15.134:0/2166485815 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15ec01c3f0 con 0x7f15fc0fe8f0 2024-02-16T22:26:07.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.719+0000 7f160419b700 1 -- 172.21.15.134:0/2166485815 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15fc10e130 con 0x7f15fc0fe8f0 2024-02-16T22:26:07.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.720+0000 7f160419b700 1 -- 172.21.15.134:0/2166485815 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15fc104620 con 0x7f15fc0fe8f0 2024-02-16T22:26:07.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.721+0000 7f15f27fc700 1 -- 172.21.15.134:0/2166485815 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f15ec00bbf0 con 0x7f15fc0fe8f0 2024-02-16T22:26:07.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.721+0000 7f15f27fc700 1 --2- 172.21.15.134:0/2166485815 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f15e806d7e0 0x7f15e806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:07.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.721+0000 7f1601f37700 1 --2- 172.21.15.134:0/2166485815 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f15e806d7e0 0x7f15e806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:07.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.721+0000 7f15f27fc700 1 -- 172.21.15.134:0/2166485815 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f15ec08e250 con 0x7f15fc0fe8f0 2024-02-16T22:26:07.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.721+0000 7f1601f37700 1 --2- 172.21.15.134:0/2166485815 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f15e806d7e0 0x7f15e806fc90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15f8007fd0 tx=0x7f15f8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:07.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.726+0000 7f15f27fc700 1 -- 172.21.15.134:0/2166485815 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f15ec05b600 con 0x7f15fc0fe8f0 2024-02-16T22:26:07.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.941+0000 7f160419b700 1 -- 172.21.15.134:0/2166485815 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15fc109fe0 con 0x7f15e806d7e0 2024-02-16T22:26:07.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.942+0000 7f15f27fc700 1 -- 172.21.15.134:0/2166485815 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f15fc109fe0 con 0x7f15e806d7e0 2024-02-16T22:26:07.944 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:26:07.944 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:26:07.944 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:26:07.944 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-16T22:26:07.944 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-02-16T22:26:07.945 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-02-16T22:26:07.945 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-02-16T22:26:07.945 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-02-16T22:26:07.945 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-02-16T22:26:07.945 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "8/21 daemons upgraded", 2024-02-16T22:26:07.945 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-02-16T22:26:07.945 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:26:07.945 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:26:07.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.945+0000 7f160419b700 1 -- 172.21.15.134:0/2166485815 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f15e806d7e0 msgr2=0x7f15e806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:07.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.945+0000 7f160419b700 1 --2- 172.21.15.134:0/2166485815 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f15e806d7e0 0x7f15e806fc90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15f8007fd0 tx=0x7f15f8009040 comp rx=0 tx=0).stop 2024-02-16T22:26:07.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.945+0000 7f160419b700 1 -- 172.21.15.134:0/2166485815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fe8f0 msgr2=0x7f15fc113ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:07.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.945+0000 7f160419b700 1 --2- 172.21.15.134:0/2166485815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fe8f0 0x7f15fc113ff0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f15ec004890 tx=0x7f15ec009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:07.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.945+0000 7f160419b700 1 -- 172.21.15.134:0/2166485815 shutdown_connections 2024-02-16T22:26:07.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.945+0000 7f160419b700 1 --2- 172.21.15.134:0/2166485815 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f15e806d7e0 0x7f15e806fc90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.945+0000 7f160419b700 1 --2- 172.21.15.134:0/2166485815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc0fdf50 0x7f15fc113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.945+0000 7f160419b700 1 --2- 172.21.15.134:0/2166485815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fe8f0 0x7f15fc113ff0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:07.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.945+0000 7f160419b700 1 -- 172.21.15.134:0/2166485815 >> 172.21.15.134:0/2166485815 conn(0x7f15fc0f7a10 msgr2=0x7f15fc1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:07.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.945+0000 7f160419b700 1 -- 172.21.15.134:0/2166485815 shutdown_connections 2024-02-16T22:26:07.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:07.945+0000 7f160419b700 1 -- 172.21.15.134:0/2166485815 wait complete. 2024-02-16T22:26:08.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.062+0000 7f95be54b700 1 -- 172.21.15.134:0/1244953126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b80fe8d0 msgr2=0x7f95b8106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.062+0000 7f95be54b700 1 --2- 172.21.15.134:0/1244953126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b80fe8d0 0x7f95b8106fa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f95ac004940 tx=0x7f95ac009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.062+0000 7f95be54b700 1 -- 172.21.15.134:0/1244953126 shutdown_connections 2024-02-16T22:26:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.062+0000 7f95be54b700 1 --2- 172.21.15.134:0/1244953126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b80fe8d0 0x7f95b8106fa0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.062+0000 7f95be54b700 1 --2- 172.21.15.134:0/1244953126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b80fdf30 0x7f95b80fe300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.062+0000 7f95be54b700 1 -- 172.21.15.134:0/1244953126 >> 172.21.15.134:0/1244953126 conn(0x7f95b80f79d0 msgr2=0x7f95b80f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.062+0000 7f95be54b700 1 -- 172.21.15.134:0/1244953126 shutdown_connections 2024-02-16T22:26:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.062+0000 7f95be54b700 1 -- 172.21.15.134:0/1244953126 wait complete. 2024-02-16T22:26:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.063+0000 7f95be54b700 1 Processor -- start 2024-02-16T22:26:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.063+0000 7f95be54b700 1 -- start start 2024-02-16T22:26:08.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.063+0000 7f95be54b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b80fdf30 0x7f95b81139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:08.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.063+0000 7f95be54b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b80fe8d0 0x7f95b8113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:08.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.063+0000 7f95be54b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b8114580 con 0x7f95b80fdf30 2024-02-16T22:26:08.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.063+0000 7f95be54b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b810d8b0 con 0x7f95b80fe8d0 2024-02-16T22:26:08.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.063+0000 7f95b7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b80fdf30 0x7f95b81139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:08.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.063+0000 7f95b7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b80fdf30 0x7f95b81139f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45790/0 (socket says 172.21.15.134:45790) 2024-02-16T22:26:08.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.063+0000 7f95b7fff700 1 -- 172.21.15.134:0/763026432 learned_addr learned my addr 172.21.15.134:0/763026432 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:26:08.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.064+0000 7f95b77fe700 1 --2- 172.21.15.134:0/763026432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b80fe8d0 0x7f95b8113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:08.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.064+0000 7f95b7fff700 1 -- 172.21.15.134:0/763026432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b80fe8d0 msgr2=0x7f95b8113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:08.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.064+0000 7f95b7fff700 1 --2- 172.21.15.134:0/763026432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b80fe8d0 0x7f95b8113f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:08.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.064+0000 7f95b7fff700 1 -- 172.21.15.134:0/763026432 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac005040 con 0x7f95b80fdf30 2024-02-16T22:26:08.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.064+0000 7f95b77fe700 1 --2- 172.21.15.134:0/763026432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b80fe8d0 0x7f95b8113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:26:08.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.064+0000 7f95b7fff700 1 --2- 172.21.15.134:0/763026432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b80fdf30 0x7f95b81139f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f95a8002a80 tx=0x7f95a80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:08.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.065+0000 7f95b4ff9700 1 -- 172.21.15.134:0/763026432 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95a8007cc0 con 0x7f95b80fdf30 2024-02-16T22:26:08.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.065+0000 7f95be54b700 1 -- 172.21.15.134:0/763026432 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b810db90 con 0x7f95b80fdf30 2024-02-16T22:26:08.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.065+0000 7f95b4ff9700 1 -- 172.21.15.134:0/763026432 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f95a800f040 con 0x7f95b80fdf30 2024-02-16T22:26:08.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.065+0000 7f95b4ff9700 1 -- 172.21.15.134:0/763026432 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95a80096f0 con 0x7f95b80fdf30 2024-02-16T22:26:08.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.065+0000 7f95be54b700 1 -- 172.21.15.134:0/763026432 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b810e0d0 con 0x7f95b80fdf30 2024-02-16T22:26:08.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.066+0000 7f95be54b700 1 -- 172.21.15.134:0/763026432 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b8104600 con 0x7f95b80fdf30 2024-02-16T22:26:08.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.066+0000 7f95b4ff9700 1 -- 172.21.15.134:0/763026432 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f95a800d690 con 0x7f95b80fdf30 2024-02-16T22:26:08.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.067+0000 7f95b4ff9700 1 --2- 172.21.15.134:0/763026432 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f95a006d7e0 0x7f95a006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:08.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.067+0000 7f95b4ff9700 1 -- 172.21.15.134:0/763026432 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f95a808c660 con 0x7f95b80fdf30 2024-02-16T22:26:08.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.067+0000 7f95b77fe700 1 --2- 172.21.15.134:0/763026432 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f95a006d7e0 0x7f95a006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:08.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.067+0000 7f95b77fe700 1 --2- 172.21.15.134:0/763026432 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f95a006d7e0 0x7f95a006fc90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f95b810f220 tx=0x7f95ac009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:08.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.076+0000 7f95b4ff9700 1 -- 172.21.15.134:0/763026432 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f95a8059a30 con 0x7f95b80fdf30 2024-02-16T22:26:08.227 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:07 smithi134 podman[135275]: 2024-02-16 22:26:07.96131309 +0000 UTC m=+1.503327818 container cleanup b77bd11d80916ba22d37cb5f81c0cc326459584f5685ab26d8f62c37f7c1a15a (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2, ceph=True, org.label-schema.license=GPLv2, RELEASE=quincy-b88fae6, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-16T22:26:08.227 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:07 smithi134 bash[135275]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2 2024-02-16T22:26:08.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:08 smithi134 ceph-mon[112514]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:08.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:08 smithi134 ceph-mon[112514]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:08.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:08 smithi134 ceph-mon[112514]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:08.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:08 smithi134 ceph-mon[112514]: pgmap v88: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:26:08.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:08 smithi134 ceph-mon[112514]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-16T22:26:08.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:08 smithi134 ceph-mon[112514]: osdmap e60: 6 total, 5 up, 6 in 2024-02-16T22:26:08.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:08 smithi134 ceph-mon[112514]: failed to encode map e60 with expected crc 2024-02-16T22:26:08.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:08 smithi134 ceph-mon[112514]: failed to encode map e60 with expected crc 2024-02-16T22:26:08.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:08 smithi134 ceph-mon[112514]: failed to encode map e60 with expected crc 2024-02-16T22:26:08.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:08 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2993322843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:08.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:08 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2700321858' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:26:08.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.389+0000 7f95be54b700 1 -- 172.21.15.134:0/763026432 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f95b804bed0 con 0x7f95b80fdf30 2024-02-16T22:26:08.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.390+0000 7f95b4ff9700 1 -- 172.21.15.134:0/763026432 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7f95a80595c0 con 0x7f95b80fdf30 2024-02-16T22:26:08.392 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 osds down 2024-02-16T22:26:08.392 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-16T22:26:08.392 INFO:teuthology.orchestra.run.smithi134.stdout: osd.2 (root=default,host=smithi134) is down 2024-02-16T22:26:08.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.392+0000 7f95be54b700 1 -- 172.21.15.134:0/763026432 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f95a006d7e0 msgr2=0x7f95a006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:08.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.392+0000 7f95be54b700 1 --2- 172.21.15.134:0/763026432 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f95a006d7e0 0x7f95a006fc90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f95b810f220 tx=0x7f95ac009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:08.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.392+0000 7f95be54b700 1 -- 172.21.15.134:0/763026432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b80fdf30 msgr2=0x7f95b81139f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:08.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.392+0000 7f95be54b700 1 --2- 172.21.15.134:0/763026432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b80fdf30 0x7f95b81139f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f95a8002a80 tx=0x7f95a80046b0 comp rx=0 tx=0).stop 2024-02-16T22:26:08.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.392+0000 7f95be54b700 1 -- 172.21.15.134:0/763026432 shutdown_connections 2024-02-16T22:26:08.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.392+0000 7f95be54b700 1 --2- 172.21.15.134:0/763026432 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f95a006d7e0 0x7f95a006fc90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:08.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.392+0000 7f95be54b700 1 --2- 172.21.15.134:0/763026432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95b80fdf30 0x7f95b81139f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:08.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.392+0000 7f95be54b700 1 --2- 172.21.15.134:0/763026432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b80fe8d0 0x7f95b8113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:08.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.392+0000 7f95be54b700 1 -- 172.21.15.134:0/763026432 >> 172.21.15.134:0/763026432 conn(0x7f95b80f79d0 msgr2=0x7f95b8101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:08.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.392+0000 7f95be54b700 1 -- 172.21.15.134:0/763026432 shutdown_connections 2024-02-16T22:26:08.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:08.392+0000 7f95be54b700 1 -- 172.21.15.134:0/763026432 wait complete. 2024-02-16T22:26:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:08 smithi173 ceph-mon[83703]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:08 smithi173 ceph-mon[83703]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:08 smithi173 ceph-mon[83703]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:08 smithi173 ceph-mon[83703]: pgmap v88: 65 pgs: 65 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:26:08.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:08 smithi173 ceph-mon[83703]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-16T22:26:08.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:08 smithi173 ceph-mon[83703]: osdmap e60: 6 total, 5 up, 6 in 2024-02-16T22:26:08.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:08 smithi173 ceph-mon[83703]: failed to encode map e60 with expected crc 2024-02-16T22:26:08.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:08 smithi173 ceph-mon[83703]: failed to encode map e60 with expected crc 2024-02-16T22:26:08.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:08 smithi173 ceph-mon[83703]: failed to encode map e60 with expected crc 2024-02-16T22:26:08.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:08 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2993322843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:08.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:08 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2700321858' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:26:08.543 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:08 smithi134 podman[135361]: 2024-02-16 22:26:08.232977673 +0000 UTC m=+0.780543698 container remove b77bd11d80916ba22d37cb5f81c0cc326459584f5685ab26d8f62c37f7c1a15a (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-b88fae6, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-02-16T22:26:08.804 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:08 smithi134 podman[135501]: 2024-02-16 22:26:08.54224697 +0000 UTC m=+0.100124073 container create 702481e11a099b79449e165948953e6306ab549e94f399efb32af7fd213521d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-16T22:26:08.805 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:08 smithi134 podman[135501]: 2024-02-16 22:26:08.460256918 +0000 UTC m=+0.018134037 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:26:08.805 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:08 smithi134 podman[135501]: 2024-02-16 22:26:08.803653155 +0000 UTC m=+0.361530259 container init 702481e11a099b79449e165948953e6306ab549e94f399efb32af7fd213521d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-02-16T22:26:09.093 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:08 smithi134 podman[135501]: 2024-02-16 22:26:08.806870098 +0000 UTC m=+0.364747210 container start 702481e11a099b79449e165948953e6306ab549e94f399efb32af7fd213521d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-02-16T22:26:09.093 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:08 smithi134 podman[135501]: 2024-02-16 22:26:08.903845343 +0000 UTC m=+0.461722456 container attach 702481e11a099b79449e165948953e6306ab549e94f399efb32af7fd213521d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:26:09.477 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:09 smithi134 podman[135501]: 2024-02-16 22:26:09.092748848 +0000 UTC m=+0.650625954 container died 702481e11a099b79449e165948953e6306ab549e94f399efb32af7fd213521d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-02-16T22:26:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:09 smithi134 ceph-mon[112514]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:09 smithi134 ceph-mon[112514]: failed to encode map e61 with expected crc 2024-02-16T22:26:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:09 smithi134 ceph-mon[112514]: failed to encode map e61 with expected crc 2024-02-16T22:26:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:09 smithi134 ceph-mon[112514]: osdmap e61: 6 total, 5 up, 6 in 2024-02-16T22:26:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:09 smithi134 ceph-mon[112514]: failed to encode map e61 with expected crc 2024-02-16T22:26:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:09 smithi134 ceph-mon[112514]: failed to encode map e61 with expected crc 2024-02-16T22:26:09.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:09 smithi134 ceph-mon[112514]: failed to encode map e61 with expected crc 2024-02-16T22:26:09.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:09 smithi134 ceph-mon[112514]: failed to encode map e61 with expected crc 2024-02-16T22:26:09.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:09 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/763026432' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:26:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:09 smithi173 ceph-mon[83703]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:09 smithi173 ceph-mon[83703]: failed to encode map e61 with expected crc 2024-02-16T22:26:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:09 smithi173 ceph-mon[83703]: failed to encode map e61 with expected crc 2024-02-16T22:26:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:09 smithi173 ceph-mon[83703]: osdmap e61: 6 total, 5 up, 6 in 2024-02-16T22:26:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:09 smithi173 ceph-mon[83703]: failed to encode map e61 with expected crc 2024-02-16T22:26:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:09 smithi173 ceph-mon[83703]: failed to encode map e61 with expected crc 2024-02-16T22:26:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:09 smithi173 ceph-mon[83703]: failed to encode map e61 with expected crc 2024-02-16T22:26:09.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:09 smithi173 ceph-mon[83703]: failed to encode map e61 with expected crc 2024-02-16T22:26:09.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:09 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/763026432' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:26:10.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:10 smithi134 ceph-mon[112514]: pgmap v91: 65 pgs: 19 peering, 3 stale+active+clean, 43 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:26:10.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:10 smithi134 ceph-mon[112514]: Health check failed: Reduced data availability: 1 pg inactive, 6 pgs peering (PG_AVAILABILITY) 2024-02-16T22:26:10.227 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:09 smithi134 podman[135527]: 2024-02-16 22:26:09.940832313 +0000 UTC m=+0.838401896 container remove 702481e11a099b79449e165948953e6306ab549e94f399efb32af7fd213521d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-02-16T22:26:10.228 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:09 smithi134 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.2.service: Deactivated successfully. 2024-02-16T22:26:10.228 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:09 smithi134 systemd[1]: Stopped Ceph osd.2 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:26:10.228 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:09 smithi134 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.2.service: Consumed 49.882s CPU time. 2024-02-16T22:26:10.228 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:10 smithi134 systemd[1]: Starting Ceph osd.2 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:26:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:10 smithi173 ceph-mon[83703]: pgmap v91: 65 pgs: 19 peering, 3 stale+active+clean, 43 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-16T22:26:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:10 smithi173 ceph-mon[83703]: Health check failed: Reduced data availability: 1 pg inactive, 6 pgs peering (PG_AVAILABILITY) 2024-02-16T22:26:10.687 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:10 smithi134 podman[135628]: 2024-02-16 22:26:10.287339687 +0000 UTC m=+0.017970045 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:26:10.687 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:10 smithi134 podman[135628]: 2024-02-16 22:26:10.408587314 +0000 UTC m=+0.139217673 container create 8561a3ae30d89cf816f3a475a3391c7daa73defba33254f142441a7616ed5a6e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-activate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-16T22:26:10.687 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:10 smithi134 podman[135628]: 2024-02-16 22:26:10.685951374 +0000 UTC m=+0.416581735 container init 8561a3ae30d89cf816f3a475a3391c7daa73defba33254f142441a7616ed5a6e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-activate, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:26:10.977 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:10 smithi134 podman[135628]: 2024-02-16 22:26:10.689226671 +0000 UTC m=+0.419857030 container start 8561a3ae30d89cf816f3a475a3391c7daa73defba33254f142441a7616ed5a6e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-02-16T22:26:10.977 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:10 smithi134 podman[135628]: 2024-02-16 22:26:10.802795104 +0000 UTC m=+0.533425478 container attach 8561a3ae30d89cf816f3a475a3391c7daa73defba33254f142441a7616ed5a6e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS) 2024-02-16T22:26:11.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:11 smithi134 ceph-mon[112514]: pgmap v92: 65 pgs: 4 active+undersized+degraded, 19 peering, 4 active+undersized, 38 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 15/357 objects degraded (4.202%) 2024-02-16T22:26:11.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:11 smithi134 ceph-mon[112514]: Health check failed: Degraded data redundancy: 15/357 objects degraded (4.202%), 4 pgs degraded (PG_DEGRADED) 2024-02-16T22:26:11.450 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-activate[135643]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-16T22:26:11.450 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-activate[135643]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-16T22:26:11.450 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 bash[135628]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-16T22:26:11.450 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 bash[135628]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-16T22:26:11.450 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 bash[135628]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-16T22:26:11.450 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 bash[135628]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-16T22:26:11.450 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 bash[135628]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-16T22:26:11.450 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 bash[135628]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-16T22:26:11.450 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 bash[135628]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-16T22:26:11.450 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-activate[135643]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-16T22:26:11.450 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-activate[135643]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-16T22:26:11.451 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-activate[135643]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-16T22:26:11.451 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-activate[135643]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-16T22:26:11.451 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-activate[135643]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-16T22:26:11.451 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 podman[135628]: 2024-02-16 22:26:11.157792569 +0000 UTC m=+0.888422918 container died 8561a3ae30d89cf816f3a475a3391c7daa73defba33254f142441a7616ed5a6e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-activate, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214) 2024-02-16T22:26:11.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:11 smithi173 ceph-mon[83703]: pgmap v92: 65 pgs: 4 active+undersized+degraded, 19 peering, 4 active+undersized, 38 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 15/357 objects degraded (4.202%) 2024-02-16T22:26:11.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:11 smithi173 ceph-mon[83703]: Health check failed: Degraded data redundancy: 15/357 objects degraded (4.202%), 4 pgs degraded (PG_DEGRADED) 2024-02-16T22:26:12.141 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:11 smithi134 podman[135781]: 2024-02-16 22:26:11.823633768 +0000 UTC m=+0.660359016 container remove 8561a3ae30d89cf816f3a475a3391c7daa73defba33254f142441a7616ed5a6e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-activate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:26:12.141 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:12 smithi134 podman[135846]: 2024-02-16 22:26:11.941643348 +0000 UTC m=+0.019000596 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:26:12.141 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:12 smithi134 podman[135846]: 2024-02-16 22:26:12.041074359 +0000 UTC m=+0.118431604 container create 0e349c665c734993ae31e2c89ca84a3c7ea4ef429a3a9a9ebec3325255a05b66 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux ) 2024-02-16T22:26:12.727 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:12 smithi134 podman[135846]: 2024-02-16 22:26:12.237342769 +0000 UTC m=+0.314700011 container init 0e349c665c734993ae31e2c89ca84a3c7ea4ef429a3a9a9ebec3325255a05b66 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True) 2024-02-16T22:26:12.727 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:12 smithi134 podman[135846]: 2024-02-16 22:26:12.240559487 +0000 UTC m=+0.317916732 container start 0e349c665c734993ae31e2c89ca84a3c7ea4ef429a3a9a9ebec3325255a05b66 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-16T22:26:12.727 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:12 smithi134 ceph-osd[135865]: -- 172.21.15.134:0/1556202562 <== mon.0 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5654843a11e0 con 0x565484373000 2024-02-16T22:26:12.727 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:12 smithi134 bash[135846]: 0e349c665c734993ae31e2c89ca84a3c7ea4ef429a3a9a9ebec3325255a05b66 2024-02-16T22:26:12.727 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:12 smithi134 systemd[1]: Started Ceph osd.2 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:26:13.227 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:12 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2[135861]: 2024-02-16T22:26:12.788+0000 7f20301497c0 -1 Falling back to public interface 2024-02-16T22:26:13.489 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:13 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:13.489 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:13 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:13.489 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:13 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:26:13.490 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:13 smithi134 ceph-mon[112514]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-16T22:26:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:13 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:13 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:13 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:26:13.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:13 smithi173 ceph-mon[83703]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-16T22:26:14.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:14 smithi134 ceph-mon[112514]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 6 pgs peering) 2024-02-16T22:26:14.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:14 smithi173 ceph-mon[83703]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 6 pgs peering) 2024-02-16T22:26:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:15 smithi134 ceph-mon[112514]: pgmap v94: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-16T22:26:15.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:15 smithi173 ceph-mon[83703]: pgmap v94: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-16T22:26:16.977 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:16 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2[135861]: 2024-02-16T22:26:16.691+0000 7f20301497c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-02-16T22:26:17.375 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:17 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2[135861]: 2024-02-16T22:26:17.118+0000 7f20301497c0 -1 osd.2 59 log_to_monitors true 2024-02-16T22:26:18.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:18 smithi134 ceph-mon[112514]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-16T22:26:18.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:18 smithi134 ceph-mon[112514]: from='osd.2 [v2:172.21.15.134:6818/1465167236,v1:172.21.15.134:6819/1465167236]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-16T22:26:18.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:18 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:18.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:18 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:18 smithi173 ceph-mon[83703]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 302 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-16T22:26:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:18 smithi173 ceph-mon[83703]: from='osd.2 [v2:172.21.15.134:6818/1465167236,v1:172.21.15.134:6819/1465167236]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-16T22:26:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:18 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:18 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:19.227 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:26:18 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2[135861]: 2024-02-16T22:26:18.993+0000 7f201d599700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T22:26:19.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:19 smithi134 ceph-mon[112514]: from='osd.2 [v2:172.21.15.134:6818/1465167236,v1:172.21.15.134:6819/1465167236]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-16T22:26:19.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:19 smithi134 ceph-mon[112514]: osdmap e62: 6 total, 5 up, 6 in 2024-02-16T22:26:19.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:19 smithi134 ceph-mon[112514]: from='osd.2 [v2:172.21.15.134:6818/1465167236,v1:172.21.15.134:6819/1465167236]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-02-16T22:26:19.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:19 smithi134 ceph-mon[112514]: Health check update: Degraded data redundancy: 44/357 objects degraded (12.325%), 12 pgs degraded (PG_DEGRADED) 2024-02-16T22:26:19.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:19 smithi134 ceph-mon[112514]: failed to encode map e62 with expected crc 2024-02-16T22:26:19.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:19 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:19.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:19 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:19.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:19 smithi134 ceph-mon[112514]: from='osd.2 [v2:172.21.15.134:6818/1465167236,v1:172.21.15.134:6819/1465167236]' entity='osd.2' 2024-02-16T22:26:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:19 smithi173 ceph-mon[83703]: from='osd.2 [v2:172.21.15.134:6818/1465167236,v1:172.21.15.134:6819/1465167236]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-16T22:26:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:19 smithi173 ceph-mon[83703]: osdmap e62: 6 total, 5 up, 6 in 2024-02-16T22:26:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:19 smithi173 ceph-mon[83703]: from='osd.2 [v2:172.21.15.134:6818/1465167236,v1:172.21.15.134:6819/1465167236]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-02-16T22:26:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:19 smithi173 ceph-mon[83703]: Health check update: Degraded data redundancy: 44/357 objects degraded (12.325%), 12 pgs degraded (PG_DEGRADED) 2024-02-16T22:26:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:19 smithi173 ceph-mon[83703]: failed to encode map e62 with expected crc 2024-02-16T22:26:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:19 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:19 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:19.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:19 smithi173 ceph-mon[83703]: from='osd.2 [v2:172.21.15.134:6818/1465167236,v1:172.21.15.134:6819/1465167236]' entity='osd.2' 2024-02-16T22:26:20.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:20 smithi134 ceph-mon[112514]: pgmap v97: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 302 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-16T22:26:20.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:20 smithi134 ceph-mon[112514]: failed to encode map e62 with expected crc 2024-02-16T22:26:20.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:20 smithi134 ceph-mon[112514]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-16T22:26:20.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:20 smithi134 ceph-mon[112514]: osd.2 [v2:172.21.15.134:6818/1465167236,v1:172.21.15.134:6819/1465167236] boot 2024-02-16T22:26:20.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:20 smithi134 ceph-mon[112514]: osdmap e63: 6 total, 6 up, 6 in 2024-02-16T22:26:20.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:20 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:26:20.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:20 smithi134 ceph-mon[112514]: failed to encode map e63 with expected crc 2024-02-16T22:26:20.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:20 smithi134 ceph-mon[112514]: failed to encode map e62 with expected crc 2024-02-16T22:26:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:20 smithi173 ceph-mon[83703]: pgmap v97: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 302 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-16T22:26:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:20 smithi173 ceph-mon[83703]: failed to encode map e62 with expected crc 2024-02-16T22:26:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:20 smithi173 ceph-mon[83703]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-16T22:26:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:20 smithi173 ceph-mon[83703]: osd.2 [v2:172.21.15.134:6818/1465167236,v1:172.21.15.134:6819/1465167236] boot 2024-02-16T22:26:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:20 smithi173 ceph-mon[83703]: osdmap e63: 6 total, 6 up, 6 in 2024-02-16T22:26:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:20 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-16T22:26:20.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:20 smithi173 ceph-mon[83703]: failed to encode map e63 with expected crc 2024-02-16T22:26:20.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:20 smithi173 ceph-mon[83703]: failed to encode map e62 with expected crc 2024-02-16T22:26:22.182 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:22 smithi134 ceph-mon[112514]: failed to encode map e63 with expected crc 2024-02-16T22:26:22.182 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:22 smithi134 ceph-mon[112514]: failed to encode map e64 with expected crc 2024-02-16T22:26:22.182 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:22 smithi134 ceph-mon[112514]: osdmap e64: 6 total, 6 up, 6 in 2024-02-16T22:26:22.182 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:22 smithi134 ceph-mon[112514]: failed to encode map e64 with expected crc 2024-02-16T22:26:22.182 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:22 smithi134 ceph-mon[112514]: failed to encode map e64 with expected crc 2024-02-16T22:26:22.183 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:22 smithi134 ceph-mon[112514]: failed to encode map e64 with expected crc 2024-02-16T22:26:22.183 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:22 smithi134 ceph-mon[112514]: pgmap v100: 65 pgs: 5 peering, 10 active+undersized+degraded, 12 active+undersized, 38 active+clean; 302 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 34/357 objects degraded (9.524%) 2024-02-16T22:26:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:22 smithi173 ceph-mon[83703]: failed to encode map e63 with expected crc 2024-02-16T22:26:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:22 smithi173 ceph-mon[83703]: failed to encode map e64 with expected crc 2024-02-16T22:26:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:22 smithi173 ceph-mon[83703]: osdmap e64: 6 total, 6 up, 6 in 2024-02-16T22:26:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:22 smithi173 ceph-mon[83703]: failed to encode map e64 with expected crc 2024-02-16T22:26:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:22 smithi173 ceph-mon[83703]: failed to encode map e64 with expected crc 2024-02-16T22:26:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:22 smithi173 ceph-mon[83703]: failed to encode map e64 with expected crc 2024-02-16T22:26:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:22 smithi173 ceph-mon[83703]: pgmap v100: 65 pgs: 5 peering, 10 active+undersized+degraded, 12 active+undersized, 38 active+clean; 302 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 34/357 objects degraded (9.524%) 2024-02-16T22:26:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:23 smithi134 ceph-mon[112514]: failed to encode map e64 with expected crc 2024-02-16T22:26:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:26:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:26:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:26:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:23.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:26:23.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:23.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:23.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:23.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-16T22:26:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:23 smithi173 ceph-mon[83703]: failed to encode map e64 with expected crc 2024-02-16T22:26:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:26:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:23.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:26:23.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:26:23.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:23.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:26:23.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:23.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:23.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:23.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-16T22:26:24.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:24 smithi134 ceph-mon[112514]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-16T22:26:24.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:24 smithi134 ceph-mon[112514]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-16T22:26:24.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:24 smithi134 ceph-mon[112514]: pgmap v101: 65 pgs: 5 peering, 4 active+undersized+degraded, 5 active+undersized, 51 active+clean; 302 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 15/357 objects degraded (4.202%) 2024-02-16T22:26:24.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:24 smithi134 ceph-mon[112514]: Health check update: Degraded data redundancy: 34/357 objects degraded (9.524%), 10 pgs degraded (PG_DEGRADED) 2024-02-16T22:26:24.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:24 smithi173 ceph-mon[83703]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-16T22:26:24.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:24 smithi173 ceph-mon[83703]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-16T22:26:24.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:24 smithi173 ceph-mon[83703]: pgmap v101: 65 pgs: 5 peering, 4 active+undersized+degraded, 5 active+undersized, 51 active+clean; 302 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 15/357 objects degraded (4.202%) 2024-02-16T22:26:24.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:24 smithi173 ceph-mon[83703]: Health check update: Degraded data redundancy: 34/357 objects degraded (9.524%), 10 pgs degraded (PG_DEGRADED) 2024-02-16T22:26:25.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:25 smithi134 ceph-mon[112514]: pgmap v102: 65 pgs: 5 peering, 60 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:25.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:25 smithi134 ceph-mon[112514]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/357 objects degraded (4.202%), 4 pgs degraded) 2024-02-16T22:26:25.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:25 smithi134 ceph-mon[112514]: Cluster is now healthy 2024-02-16T22:26:25.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:25 smithi173 ceph-mon[83703]: pgmap v102: 65 pgs: 5 peering, 60 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:25.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:25 smithi173 ceph-mon[83703]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/357 objects degraded (4.202%), 4 pgs degraded) 2024-02-16T22:26:25.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:25 smithi173 ceph-mon[83703]: Cluster is now healthy 2024-02-16T22:26:28.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:28 smithi134 ceph-mon[112514]: pgmap v103: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:28.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:28 smithi173 ceph-mon[83703]: pgmap v103: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:30.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:30 smithi134 ceph-mon[112514]: pgmap v104: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:30 smithi173 ceph-mon[83703]: pgmap v104: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:32.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:32 smithi134 ceph-mon[112514]: pgmap v105: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:32.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:32 smithi173 ceph-mon[83703]: pgmap v105: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:33.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:33 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:33.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:33 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:34.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:34 smithi134 ceph-mon[112514]: pgmap v106: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:34.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:34 smithi173 ceph-mon[83703]: pgmap v106: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:36.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:36 smithi134 ceph-mon[112514]: pgmap v107: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:36.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:36 smithi173 ceph-mon[83703]: pgmap v107: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:38.327 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:38 smithi173 ceph-mon[83703]: pgmap v108: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:38.327 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:38 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:38.327 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:38 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:26:38.327 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:38 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-16T22:26:38.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:38 smithi134 ceph-mon[112514]: pgmap v108: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:38.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:38 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:38.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:38 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:26:38.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:38 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-16T22:26:38.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.506+0000 7f8f3a240700 1 -- 172.21.15.134:0/3500027980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f34101e60 msgr2=0x7f8f34102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:38.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.506+0000 7f8f3a240700 1 --2- 172.21.15.134:0/3500027980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f34101e60 0x7f8f34102230 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8f24004940 tx=0x7f8f24009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:38.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.506+0000 7f8f3a240700 1 -- 172.21.15.134:0/3500027980 shutdown_connections 2024-02-16T22:26:38.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.506+0000 7f8f3a240700 1 --2- 172.21.15.134:0/3500027980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f34102800 0x7f8f340fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:38.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.506+0000 7f8f3a240700 1 --2- 172.21.15.134:0/3500027980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f34101e60 0x7f8f34102230 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:38.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.506+0000 7f8f3a240700 1 -- 172.21.15.134:0/3500027980 >> 172.21.15.134:0/3500027980 conn(0x7f8f340f7a10 msgr2=0x7f8f340f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:38.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.506+0000 7f8f3a240700 1 -- 172.21.15.134:0/3500027980 shutdown_connections 2024-02-16T22:26:38.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.506+0000 7f8f3a240700 1 -- 172.21.15.134:0/3500027980 wait complete. 2024-02-16T22:26:38.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.506+0000 7f8f3a240700 1 Processor -- start 2024-02-16T22:26:38.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.507+0000 7f8f3a240700 1 -- start start 2024-02-16T22:26:38.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.507+0000 7f8f3a240700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f34101e60 0x7f8f34112900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:38.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.507+0000 7f8f3a240700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f34102800 0x7f8f34112e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:38.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.507+0000 7f8f3a240700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34113490 con 0x7f8f34102800 2024-02-16T22:26:38.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.507+0000 7f8f3a240700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3410c7c0 con 0x7f8f34101e60 2024-02-16T22:26:38.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.507+0000 7f8f32ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f34102800 0x7f8f34112e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:38.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.507+0000 7f8f32ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f34102800 0x7f8f34112e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44008/0 (socket says 172.21.15.134:44008) 2024-02-16T22:26:38.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.507+0000 7f8f32ffd700 1 -- 172.21.15.134:0/398254028 learned_addr learned my addr 172.21.15.134:0/398254028 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:26:38.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.507+0000 7f8f337fe700 1 --2- 172.21.15.134:0/398254028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f34101e60 0x7f8f34112900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:38.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.507+0000 7f8f32ffd700 1 -- 172.21.15.134:0/398254028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f34101e60 msgr2=0x7f8f34112900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:38.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.507+0000 7f8f32ffd700 1 --2- 172.21.15.134:0/398254028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f34101e60 0x7f8f34112900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:38.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.507+0000 7f8f32ffd700 1 -- 172.21.15.134:0/398254028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f24005040 con 0x7f8f34102800 2024-02-16T22:26:38.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.507+0000 7f8f32ffd700 1 --2- 172.21.15.134:0/398254028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f34102800 0x7f8f34112e40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8f28002a50 tx=0x7f8f280046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:38.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.508+0000 7f8f1bfff700 1 -- 172.21.15.134:0/398254028 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f28007cc0 con 0x7f8f34102800 2024-02-16T22:26:38.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.508+0000 7f8f1bfff700 1 -- 172.21.15.134:0/398254028 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f2800f040 con 0x7f8f34102800 2024-02-16T22:26:38.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.508+0000 7f8f3a240700 1 -- 172.21.15.134:0/398254028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3410caa0 con 0x7f8f34102800 2024-02-16T22:26:38.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.508+0000 7f8f1bfff700 1 -- 172.21.15.134:0/398254028 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2800db30 con 0x7f8f34102800 2024-02-16T22:26:38.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.508+0000 7f8f3a240700 1 -- 172.21.15.134:0/398254028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3410cfe0 con 0x7f8f34102800 2024-02-16T22:26:38.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.509+0000 7f8f3a240700 1 -- 172.21.15.134:0/398254028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f340fb610 con 0x7f8f34102800 2024-02-16T22:26:38.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.509+0000 7f8f1bfff700 1 -- 172.21.15.134:0/398254028 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f8f2800dc90 con 0x7f8f34102800 2024-02-16T22:26:38.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.510+0000 7f8f1bfff700 1 --2- 172.21.15.134:0/398254028 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8f1c06d7e0 0x7f8f1c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:38.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.510+0000 7f8f337fe700 1 --2- 172.21.15.134:0/398254028 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8f1c06d7e0 0x7f8f1c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:38.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.510+0000 7f8f1bfff700 1 -- 172.21.15.134:0/398254028 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8f2808cb20 con 0x7f8f34102800 2024-02-16T22:26:38.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.510+0000 7f8f337fe700 1 --2- 172.21.15.134:0/398254028 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8f1c06d7e0 0x7f8f1c06fc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f24004f90 tx=0x7f8f24009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:38.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.515+0000 7f8f1bfff700 1 -- 172.21.15.134:0/398254028 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8f28059f70 con 0x7f8f34102800 2024-02-16T22:26:38.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.729+0000 7f8f3a240700 1 -- 172.21.15.134:0/398254028 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f3404bed0 con 0x7f8f1c06d7e0 2024-02-16T22:26:38.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.731+0000 7f8f1bfff700 1 -- 172.21.15.134:0/398254028 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8f3404bed0 con 0x7f8f1c06d7e0 2024-02-16T22:26:38.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.733+0000 7f8f3a240700 1 -- 172.21.15.134:0/398254028 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8f1c06d7e0 msgr2=0x7f8f1c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:38.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.733+0000 7f8f3a240700 1 --2- 172.21.15.134:0/398254028 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8f1c06d7e0 0x7f8f1c06fc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f24004f90 tx=0x7f8f24009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:38.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.733+0000 7f8f3a240700 1 -- 172.21.15.134:0/398254028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f34102800 msgr2=0x7f8f34112e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:38.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.733+0000 7f8f3a240700 1 --2- 172.21.15.134:0/398254028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f34102800 0x7f8f34112e40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8f28002a50 tx=0x7f8f280046b0 comp rx=0 tx=0).stop 2024-02-16T22:26:38.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.733+0000 7f8f3a240700 1 -- 172.21.15.134:0/398254028 shutdown_connections 2024-02-16T22:26:38.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.733+0000 7f8f3a240700 1 --2- 172.21.15.134:0/398254028 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8f1c06d7e0 0x7f8f1c06fc90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:38.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.733+0000 7f8f3a240700 1 --2- 172.21.15.134:0/398254028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f34101e60 0x7f8f34112900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:38.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.733+0000 7f8f3a240700 1 --2- 172.21.15.134:0/398254028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f34102800 0x7f8f34112e40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:38.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.733+0000 7f8f3a240700 1 -- 172.21.15.134:0/398254028 >> 172.21.15.134:0/398254028 conn(0x7f8f340f7a10 msgr2=0x7f8f340f93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:38.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.733+0000 7f8f3a240700 1 -- 172.21.15.134:0/398254028 shutdown_connections 2024-02-16T22:26:38.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.733+0000 7f8f3a240700 1 -- 172.21.15.134:0/398254028 wait complete. 2024-02-16T22:26:38.746 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:26:38.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.835+0000 7f124cdb7700 1 -- 172.21.15.134:0/3683633380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1248102800 msgr2=0x7f12480fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:38.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.835+0000 7f124cdb7700 1 --2- 172.21.15.134:0/3683633380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1248102800 0x7f12480fbe70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1238004940 tx=0x7f1238009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:38.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.835+0000 7f124cdb7700 1 -- 172.21.15.134:0/3683633380 shutdown_connections 2024-02-16T22:26:38.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.835+0000 7f124cdb7700 1 --2- 172.21.15.134:0/3683633380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1248102800 0x7f12480fbe70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:38.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.835+0000 7f124cdb7700 1 --2- 172.21.15.134:0/3683633380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1248101e60 0x7f1248102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:38.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.835+0000 7f124cdb7700 1 -- 172.21.15.134:0/3683633380 >> 172.21.15.134:0/3683633380 conn(0x7f12480f7a10 msgr2=0x7f12480f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:38.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.835+0000 7f124cdb7700 1 -- 172.21.15.134:0/3683633380 shutdown_connections 2024-02-16T22:26:38.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.835+0000 7f124cdb7700 1 -- 172.21.15.134:0/3683633380 wait complete. 2024-02-16T22:26:38.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.836+0000 7f124cdb7700 1 Processor -- start 2024-02-16T22:26:38.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.836+0000 7f124cdb7700 1 -- start start 2024-02-16T22:26:38.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.836+0000 7f124cdb7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1248101e60 0x7f1248112a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:38.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.836+0000 7f124cdb7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1248102800 0x7f1248112f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:38.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f124cdb7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1248113590 con 0x7f1248102800 2024-02-16T22:26:38.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f124cdb7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124810c8c0 con 0x7f1248101e60 2024-02-16T22:26:38.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f1245d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1248102800 0x7f1248112f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:38.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f1245d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1248102800 0x7f1248112f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44022/0 (socket says 172.21.15.134:44022) 2024-02-16T22:26:38.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f1245d9b700 1 -- 172.21.15.134:0/2943732823 learned_addr learned my addr 172.21.15.134:0/2943732823 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:26:38.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f124659c700 1 --2- 172.21.15.134:0/2943732823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1248101e60 0x7f1248112a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:38.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f1245d9b700 1 -- 172.21.15.134:0/2943732823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1248101e60 msgr2=0x7f1248112a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:38.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f1245d9b700 1 --2- 172.21.15.134:0/2943732823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1248101e60 0x7f1248112a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:38.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f1245d9b700 1 -- 172.21.15.134:0/2943732823 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1238005040 con 0x7f1248102800 2024-02-16T22:26:38.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f124659c700 1 --2- 172.21.15.134:0/2943732823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1248101e60 0x7f1248112a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:26:38.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f1245d9b700 1 --2- 172.21.15.134:0/2943732823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1248102800 0x7f1248112f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f12380090d0 tx=0x7f1238009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:38.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f1236ffd700 1 -- 172.21.15.134:0/2943732823 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f123800e040 con 0x7f1248102800 2024-02-16T22:26:38.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f124cdb7700 1 -- 172.21.15.134:0/2943732823 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124810cb40 con 0x7f1248102800 2024-02-16T22:26:38.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f1236ffd700 1 -- 172.21.15.134:0/2943732823 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1238009430 con 0x7f1248102800 2024-02-16T22:26:38.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f124cdb7700 1 -- 172.21.15.134:0/2943732823 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124810d080 con 0x7f1248102800 2024-02-16T22:26:38.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.837+0000 7f1236ffd700 1 -- 172.21.15.134:0/2943732823 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f123801c3f0 con 0x7f1248102800 2024-02-16T22:26:38.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.839+0000 7f124cdb7700 1 -- 172.21.15.134:0/2943732823 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1248104330 con 0x7f1248102800 2024-02-16T22:26:38.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.839+0000 7f1236ffd700 1 -- 172.21.15.134:0/2943732823 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f1238013420 con 0x7f1248102800 2024-02-16T22:26:38.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.839+0000 7f1236ffd700 1 --2- 172.21.15.134:0/2943732823 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f123006d7e0 0x7f123006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:38.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.839+0000 7f1236ffd700 1 -- 172.21.15.134:0/2943732823 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f123808e050 con 0x7f1248102800 2024-02-16T22:26:38.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.839+0000 7f124659c700 1 --2- 172.21.15.134:0/2943732823 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f123006d7e0 0x7f123006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:38.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.840+0000 7f124659c700 1 --2- 172.21.15.134:0/2943732823 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f123006d7e0 0x7f123006fc90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f123c004fd0 tx=0x7f123c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:38.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:38.844+0000 7f1236ffd700 1 -- 172.21.15.134:0/2943732823 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f123805b540 con 0x7f1248102800 2024-02-16T22:26:39.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.057+0000 7f124cdb7700 1 -- 172.21.15.134:0/2943732823 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12481126d0 con 0x7f123006d7e0 2024-02-16T22:26:39.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.058+0000 7f1236ffd700 1 -- 172.21.15.134:0/2943732823 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f12481126d0 con 0x7f123006d7e0 2024-02-16T22:26:39.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.060+0000 7f124cdb7700 1 -- 172.21.15.134:0/2943732823 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f123006d7e0 msgr2=0x7f123006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:39.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.060+0000 7f124cdb7700 1 --2- 172.21.15.134:0/2943732823 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f123006d7e0 0x7f123006fc90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f123c004fd0 tx=0x7f123c00b040 comp rx=0 tx=0).stop 2024-02-16T22:26:39.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.060+0000 7f124cdb7700 1 -- 172.21.15.134:0/2943732823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1248102800 msgr2=0x7f1248112f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:39.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.060+0000 7f124cdb7700 1 --2- 172.21.15.134:0/2943732823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1248102800 0x7f1248112f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f12380090d0 tx=0x7f1238009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:39.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.061+0000 7f124cdb7700 1 -- 172.21.15.134:0/2943732823 shutdown_connections 2024-02-16T22:26:39.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.061+0000 7f124cdb7700 1 --2- 172.21.15.134:0/2943732823 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f123006d7e0 0x7f123006fc90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.061+0000 7f124cdb7700 1 --2- 172.21.15.134:0/2943732823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1248101e60 0x7f1248112a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.061+0000 7f124cdb7700 1 --2- 172.21.15.134:0/2943732823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1248102800 0x7f1248112f40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.061+0000 7f124cdb7700 1 -- 172.21.15.134:0/2943732823 >> 172.21.15.134:0/2943732823 conn(0x7f12480f7a10 msgr2=0x7f12480f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:39.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.061+0000 7f124cdb7700 1 -- 172.21.15.134:0/2943732823 shutdown_connections 2024-02-16T22:26:39.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.061+0000 7f124cdb7700 1 -- 172.21.15.134:0/2943732823 wait complete. 2024-02-16T22:26:39.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.162+0000 7fad4c0b7700 1 -- 172.21.15.134:0/1857291584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad44102f50 msgr2=0x7fad44103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:39.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.162+0000 7fad4c0b7700 1 --2- 172.21.15.134:0/1857291584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad44102f50 0x7fad44103320 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad40004940 tx=0x7fad40009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:39.165 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:39 smithi134 ceph-mon[112514]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-16T22:26:39.165 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:39 smithi134 ceph-mon[112514]: Upgrade: osd.3 is safe to restart 2024-02-16T22:26:39.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.163+0000 7fad4c0b7700 1 -- 172.21.15.134:0/1857291584 shutdown_connections 2024-02-16T22:26:39.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.163+0000 7fad4c0b7700 1 --2- 172.21.15.134:0/1857291584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad441038f0 0x7fad440fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.163+0000 7fad4c0b7700 1 --2- 172.21.15.134:0/1857291584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad44102f50 0x7fad44103320 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.163+0000 7fad4c0b7700 1 -- 172.21.15.134:0/1857291584 >> 172.21.15.134:0/1857291584 conn(0x7fad440f8ae0 msgr2=0x7fad440faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:39.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.163+0000 7fad4c0b7700 1 -- 172.21.15.134:0/1857291584 shutdown_connections 2024-02-16T22:26:39.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.163+0000 7fad4c0b7700 1 -- 172.21.15.134:0/1857291584 wait complete. 2024-02-16T22:26:39.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.163+0000 7fad4c0b7700 1 Processor -- start 2024-02-16T22:26:39.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.163+0000 7fad4c0b7700 1 -- start start 2024-02-16T22:26:39.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.163+0000 7fad4c0b7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad44102f50 0x7fad441139d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:39.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad4c0b7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad441038f0 0x7fad44113f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:39.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad4c0b7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad44114560 con 0x7fad441038f0 2024-02-16T22:26:39.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad4c0b7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4410d890 con 0x7fad44102f50 2024-02-16T22:26:39.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad49652700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad441038f0 0x7fad44113f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:39.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad49652700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad441038f0 0x7fad44113f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44042/0 (socket says 172.21.15.134:44042) 2024-02-16T22:26:39.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad49652700 1 -- 172.21.15.134:0/3063997628 learned_addr learned my addr 172.21.15.134:0/3063997628 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:26:39.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad49e53700 1 --2- 172.21.15.134:0/3063997628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad44102f50 0x7fad441139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:39.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad49652700 1 -- 172.21.15.134:0/3063997628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad44102f50 msgr2=0x7fad441139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:39.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad49652700 1 --2- 172.21.15.134:0/3063997628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad44102f50 0x7fad441139d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad49652700 1 -- 172.21.15.134:0/3063997628 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad40005040 con 0x7fad441038f0 2024-02-16T22:26:39.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad49e53700 1 --2- 172.21.15.134:0/3063997628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad44102f50 0x7fad441139d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:26:39.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad49652700 1 --2- 172.21.15.134:0/3063997628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad441038f0 0x7fad44113f10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fad3400eb40 tx=0x7fad3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:39.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad3a7fc700 1 -- 172.21.15.134:0/3063997628 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad34007cc0 con 0x7fad441038f0 2024-02-16T22:26:39.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad3a7fc700 1 -- 172.21.15.134:0/3063997628 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad3400f040 con 0x7fad441038f0 2024-02-16T22:26:39.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad4c0b7700 1 -- 172.21.15.134:0/3063997628 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4410db10 con 0x7fad441038f0 2024-02-16T22:26:39.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.164+0000 7fad4c0b7700 1 -- 172.21.15.134:0/3063997628 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4410e050 con 0x7fad441038f0 2024-02-16T22:26:39.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.165+0000 7fad3a7fc700 1 -- 172.21.15.134:0/3063997628 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad34009580 con 0x7fad441038f0 2024-02-16T22:26:39.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.165+0000 7fad4c0b7700 1 -- 172.21.15.134:0/3063997628 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad440fc6e0 con 0x7fad441038f0 2024-02-16T22:26:39.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.166+0000 7fad3a7fc700 1 -- 172.21.15.134:0/3063997628 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fad340096e0 con 0x7fad441038f0 2024-02-16T22:26:39.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.167+0000 7fad3a7fc700 1 --2- 172.21.15.134:0/3063997628 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fad3006d7e0 0x7fad3006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:39.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.167+0000 7fad49e53700 1 --2- 172.21.15.134:0/3063997628 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fad3006d7e0 0x7fad3006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:39.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.167+0000 7fad3a7fc700 1 -- 172.21.15.134:0/3063997628 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fad3408c950 con 0x7fad441038f0 2024-02-16T22:26:39.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.167+0000 7fad49e53700 1 --2- 172.21.15.134:0/3063997628 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fad3006d7e0 0x7fad3006fc90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad4000b0d0 tx=0x7fad40009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:39.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.171+0000 7fad3a7fc700 1 -- 172.21.15.134:0/3063997628 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fad34059dd0 con 0x7fad441038f0 2024-02-16T22:26:39.336 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:39 smithi173 ceph-mon[83703]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-16T22:26:39.336 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:39 smithi173 ceph-mon[83703]: Upgrade: osd.3 is safe to restart 2024-02-16T22:26:39.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.375+0000 7fad4c0b7700 1 -- 172.21.15.134:0/3063997628 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fad441136a0 con 0x7fad3006d7e0 2024-02-16T22:26:39.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.385+0000 7fad3a7fc700 1 -- 172.21.15.134:0/3063997628 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fad441136a0 con 0x7fad3006d7e0 2024-02-16T22:26:39.387 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:26:39.387 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (4m) 21s ago 15m 26.5M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:26:39.387 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (2m) 21s ago 15m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 429739bfee94 2024-02-16T22:26:39.387 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (2m) 118s ago 14m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 1e81cd2fd510 2024-02-16T22:26:39.387 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (4m) 21s ago 15m 87.0M - 9.4.12 a0ea5e3c46d9 29d29cf667e7 2024-02-16T22:26:39.387 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (10m) 21s ago 10m 14.3M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:26:39.387 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (9m) 21s ago 9m 125M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:26:39.387 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (9m) 118s ago 9m 16.9M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:26:39.387 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (10m) 118s ago 10m 118M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:26:39.388 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (5m) 21s ago 17m 503M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:26:39.388 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (5m) 118s ago 14m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:26:39.388 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (3m) 21s ago 17m 46.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2903b3988442 2024-02-16T22:26:39.388 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (2m) 118s ago 14m 39.0M 2048M 19.0.0-1450-gf78a58c0 f081f847070a dd7cf2f31226 2024-02-16T22:26:39.388 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 21s ago 15m 16.4M - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:26:39.388 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (5m) 118s ago 14m 14.6M - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:26:39.388 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (100s) 21s ago 13m 91.9M 1557M 19.0.0-1450-gf78a58c0 f081f847070a d0153b47ae7e 2024-02-16T22:26:39.388 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (63s) 21s ago 13m 91.4M 1557M 19.0.0-1450-gf78a58c0 f081f847070a dd1faac850b0 2024-02-16T22:26:39.388 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (27s) 21s ago 12m 12.6M 1557M 19.0.0-1450-gf78a58c0 f081f847070a 0e349c665c73 2024-02-16T22:26:39.388 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (12m) 118s ago 12m 267M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 b108a8edded4 2024-02-16T22:26:39.388 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (11m) 118s ago 11m 237M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:26:39.389 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (11m) 118s ago 11m 231M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:26:39.389 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (4m) 21s ago 15m 61.6M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:26:39.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.387+0000 7fad4c0b7700 1 -- 172.21.15.134:0/3063997628 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fad3006d7e0 msgr2=0x7fad3006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:39.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.387+0000 7fad4c0b7700 1 --2- 172.21.15.134:0/3063997628 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fad3006d7e0 0x7fad3006fc90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad4000b0d0 tx=0x7fad40009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:39.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.387+0000 7fad4c0b7700 1 -- 172.21.15.134:0/3063997628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad441038f0 msgr2=0x7fad44113f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:39.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.387+0000 7fad4c0b7700 1 --2- 172.21.15.134:0/3063997628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad441038f0 0x7fad44113f10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fad3400eb40 tx=0x7fad3400b040 comp rx=0 tx=0).stop 2024-02-16T22:26:39.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.387+0000 7fad4c0b7700 1 -- 172.21.15.134:0/3063997628 shutdown_connections 2024-02-16T22:26:39.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.387+0000 7fad4c0b7700 1 --2- 172.21.15.134:0/3063997628 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fad3006d7e0 0x7fad3006fc90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.387+0000 7fad4c0b7700 1 --2- 172.21.15.134:0/3063997628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad44102f50 0x7fad441139d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.387+0000 7fad4c0b7700 1 --2- 172.21.15.134:0/3063997628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad441038f0 0x7fad44113f10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.387+0000 7fad4c0b7700 1 -- 172.21.15.134:0/3063997628 >> 172.21.15.134:0/3063997628 conn(0x7fad440f8ae0 msgr2=0x7fad440fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:39.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.387+0000 7fad4c0b7700 1 -- 172.21.15.134:0/3063997628 shutdown_connections 2024-02-16T22:26:39.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.387+0000 7fad4c0b7700 1 -- 172.21.15.134:0/3063997628 wait complete. 2024-02-16T22:26:39.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.487+0000 7f0a45a3e700 1 -- 172.21.15.134:0/541083703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a40101e50 msgr2=0x7f0a40102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:39.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.487+0000 7f0a45a3e700 1 --2- 172.21.15.134:0/541083703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a40101e50 0x7f0a40102220 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0a30004940 tx=0x7f0a30009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:39.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.487+0000 7f0a45a3e700 1 -- 172.21.15.134:0/541083703 shutdown_connections 2024-02-16T22:26:39.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.487+0000 7f0a45a3e700 1 --2- 172.21.15.134:0/541083703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a401027f0 0x7f0a400fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.487+0000 7f0a45a3e700 1 --2- 172.21.15.134:0/541083703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a40101e50 0x7f0a40102220 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.487+0000 7f0a45a3e700 1 -- 172.21.15.134:0/541083703 >> 172.21.15.134:0/541083703 conn(0x7f0a400f79c0 msgr2=0x7f0a400f9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:39.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.487+0000 7f0a45a3e700 1 -- 172.21.15.134:0/541083703 shutdown_connections 2024-02-16T22:26:39.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.487+0000 7f0a45a3e700 1 -- 172.21.15.134:0/541083703 wait complete. 2024-02-16T22:26:39.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.488+0000 7f0a45a3e700 1 Processor -- start 2024-02-16T22:26:39.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.488+0000 7f0a45a3e700 1 -- start start 2024-02-16T22:26:39.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.488+0000 7f0a45a3e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a40101e50 0x7f0a401128f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:39.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.488+0000 7f0a45a3e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a401027f0 0x7f0a40112e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:39.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.488+0000 7f0a45a3e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a40113480 con 0x7f0a401027f0 2024-02-16T22:26:39.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.488+0000 7f0a45a3e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4010c7b0 con 0x7f0a40101e50 2024-02-16T22:26:39.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.488+0000 7f0a3e7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a401027f0 0x7f0a40112e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:39.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.488+0000 7f0a3e7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a401027f0 0x7f0a40112e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44062/0 (socket says 172.21.15.134:44062) 2024-02-16T22:26:39.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.488+0000 7f0a3e7fc700 1 -- 172.21.15.134:0/2638368407 learned_addr learned my addr 172.21.15.134:0/2638368407 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:26:39.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.488+0000 7f0a3effd700 1 --2- 172.21.15.134:0/2638368407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a40101e50 0x7f0a401128f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:39.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.489+0000 7f0a3e7fc700 1 -- 172.21.15.134:0/2638368407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a40101e50 msgr2=0x7f0a401128f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:39.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.489+0000 7f0a3e7fc700 1 --2- 172.21.15.134:0/2638368407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a40101e50 0x7f0a401128f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.489+0000 7f0a3e7fc700 1 -- 172.21.15.134:0/2638368407 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a30005040 con 0x7f0a401027f0 2024-02-16T22:26:39.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.489+0000 7f0a3e7fc700 1 --2- 172.21.15.134:0/2638368407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a401027f0 0x7f0a40112e30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400fce0 tx=0x7f0a340046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:39.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.489+0000 7f0a277fe700 1 -- 172.21.15.134:0/2638368407 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a34007ea0 con 0x7f0a401027f0 2024-02-16T22:26:39.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.489+0000 7f0a45a3e700 1 -- 172.21.15.134:0/2638368407 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4010ca30 con 0x7f0a401027f0 2024-02-16T22:26:39.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.489+0000 7f0a277fe700 1 -- 172.21.15.134:0/2638368407 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a3400dda0 con 0x7f0a401027f0 2024-02-16T22:26:39.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.489+0000 7f0a277fe700 1 -- 172.21.15.134:0/2638368407 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a340126a0 con 0x7f0a401027f0 2024-02-16T22:26:39.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.489+0000 7f0a45a3e700 1 -- 172.21.15.134:0/2638368407 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4010cf70 con 0x7f0a401027f0 2024-02-16T22:26:39.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.490+0000 7f0a45a3e700 1 -- 172.21.15.134:0/2638368407 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a400fb5e0 con 0x7f0a401027f0 2024-02-16T22:26:39.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.491+0000 7f0a277fe700 1 -- 172.21.15.134:0/2638368407 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f0a3400d8d0 con 0x7f0a401027f0 2024-02-16T22:26:39.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.491+0000 7f0a277fe700 1 --2- 172.21.15.134:0/2638368407 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0a2806d7f0 0x7f0a2806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:39.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.491+0000 7f0a277fe700 1 -- 172.21.15.134:0/2638368407 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0a3408f620 con 0x7f0a401027f0 2024-02-16T22:26:39.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.491+0000 7f0a3effd700 1 --2- 172.21.15.134:0/2638368407 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0a2806d7f0 0x7f0a2806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:39.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.492+0000 7f0a3effd700 1 --2- 172.21.15.134:0/2638368407 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0a2806d7f0 0x7f0a2806fca0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a300043d0 tx=0x7f0a30009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:39.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.496+0000 7f0a277fe700 1 -- 172.21.15.134:0/2638368407 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0a3405c9f0 con 0x7f0a401027f0 2024-02-16T22:26:39.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.773+0000 7f0a45a3e700 1 -- 172.21.15.134:0/2638368407 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0a4004bed0 con 0x7f0a401027f0 2024-02-16T22:26:39.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.773+0000 7f0a277fe700 1 -- 172.21.15.134:0/2638368407 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f0a3405c580 con 0x7f0a401027f0 2024-02-16T22:26:39.775 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:26:39.775 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:26:39.775 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:26:39.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:26:39.775 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:26:39.775 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:26:39.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:26:39.776 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:26:39.776 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 3, 2024-02-16T22:26:39.776 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 3 2024-02-16T22:26:39.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:26:39.776 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:26:39.776 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:26:39.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:26:39.776 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:26:39.776 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 7, 2024-02-16T22:26:39.776 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 7 2024-02-16T22:26:39.776 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:26:39.776 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:26:39.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.776+0000 7f0a45a3e700 1 -- 172.21.15.134:0/2638368407 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0a2806d7f0 msgr2=0x7f0a2806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:39.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.776+0000 7f0a45a3e700 1 --2- 172.21.15.134:0/2638368407 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0a2806d7f0 0x7f0a2806fca0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a300043d0 tx=0x7f0a30009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:39.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.776+0000 7f0a45a3e700 1 -- 172.21.15.134:0/2638368407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a401027f0 msgr2=0x7f0a40112e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:39.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.776+0000 7f0a45a3e700 1 --2- 172.21.15.134:0/2638368407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a401027f0 0x7f0a40112e30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400fce0 tx=0x7f0a340046b0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.776+0000 7f0a45a3e700 1 -- 172.21.15.134:0/2638368407 shutdown_connections 2024-02-16T22:26:39.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.776+0000 7f0a45a3e700 1 --2- 172.21.15.134:0/2638368407 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0a2806d7f0 0x7f0a2806fca0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.776+0000 7f0a45a3e700 1 --2- 172.21.15.134:0/2638368407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a40101e50 0x7f0a401128f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.776+0000 7f0a45a3e700 1 --2- 172.21.15.134:0/2638368407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a401027f0 0x7f0a40112e30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.776+0000 7f0a45a3e700 1 -- 172.21.15.134:0/2638368407 >> 172.21.15.134:0/2638368407 conn(0x7f0a400f79c0 msgr2=0x7f0a400f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:39.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.776+0000 7f0a45a3e700 1 -- 172.21.15.134:0/2638368407 shutdown_connections 2024-02-16T22:26:39.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.776+0000 7f0a45a3e700 1 -- 172.21.15.134:0/2638368407 wait complete. 2024-02-16T22:26:39.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.877+0000 7f629b918700 1 -- 172.21.15.134:0/26897387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62941038f0 msgr2=0x7f62940fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:39.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.877+0000 7f629b918700 1 --2- 172.21.15.134:0/26897387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62941038f0 0x7f62940fcf60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6290004940 tx=0x7f6290009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:39.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.877+0000 7f629b918700 1 -- 172.21.15.134:0/26897387 shutdown_connections 2024-02-16T22:26:39.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.877+0000 7f629b918700 1 --2- 172.21.15.134:0/26897387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62941038f0 0x7f62940fcf60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.877+0000 7f629b918700 1 --2- 172.21.15.134:0/26897387 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6294102f50 0x7f6294103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.877+0000 7f629b918700 1 -- 172.21.15.134:0/26897387 >> 172.21.15.134:0/26897387 conn(0x7f62940f8ae0 msgr2=0x7f62940faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:39.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.877+0000 7f629b918700 1 -- 172.21.15.134:0/26897387 shutdown_connections 2024-02-16T22:26:39.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.877+0000 7f629b918700 1 -- 172.21.15.134:0/26897387 wait complete. 2024-02-16T22:26:39.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.877+0000 7f629b918700 1 Processor -- start 2024-02-16T22:26:39.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.877+0000 7f629b918700 1 -- start start 2024-02-16T22:26:39.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.877+0000 7f629b918700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6294102f50 0x7f6294113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:39.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.877+0000 7f629b918700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62941038f0 0x7f6294113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:39.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.877+0000 7f629b918700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6294114620 con 0x7f6294102f50 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.877+0000 7f629b918700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629410d950 con 0x7f62941038f0 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.878+0000 7f62996b4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6294102f50 0x7f6294113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.878+0000 7f6298eb3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62941038f0 0x7f6294113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.878+0000 7f62996b4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6294102f50 0x7f6294113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44088/0 (socket says 172.21.15.134:44088) 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.878+0000 7f62996b4700 1 -- 172.21.15.134:0/2703958626 learned_addr learned my addr 172.21.15.134:0/2703958626 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.878+0000 7f62996b4700 1 -- 172.21.15.134:0/2703958626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62941038f0 msgr2=0x7f6294113fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.878+0000 7f62996b4700 1 --2- 172.21.15.134:0/2703958626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62941038f0 0x7f6294113fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.878+0000 7f62996b4700 1 -- 172.21.15.134:0/2703958626 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290005040 con 0x7f6294102f50 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.878+0000 7f62996b4700 1 --2- 172.21.15.134:0/2703958626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6294102f50 0x7f6294113a90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f628400c830 tx=0x7f6284004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.878+0000 7f6289ffb700 1 -- 172.21.15.134:0/2703958626 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62840106f0 con 0x7f6294102f50 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.878+0000 7f6289ffb700 1 -- 172.21.15.134:0/2703958626 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6284010d20 con 0x7f6294102f50 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.878+0000 7f629b918700 1 -- 172.21.15.134:0/2703958626 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629410dc30 con 0x7f6294102f50 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.878+0000 7f6289ffb700 1 -- 172.21.15.134:0/2703958626 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62840113a0 con 0x7f6294102f50 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.878+0000 7f629b918700 1 -- 172.21.15.134:0/2703958626 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629410e140 con 0x7f6294102f50 2024-02-16T22:26:39.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.880+0000 7f629b918700 1 -- 172.21.15.134:0/2703958626 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6294105420 con 0x7f6294102f50 2024-02-16T22:26:39.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.880+0000 7f6289ffb700 1 -- 172.21.15.134:0/2703958626 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f6284012400 con 0x7f6294102f50 2024-02-16T22:26:39.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.880+0000 7f6289ffb700 1 --2- 172.21.15.134:0/2703958626 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f628006d7e0 0x7f628006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:39.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.880+0000 7f6289ffb700 1 -- 172.21.15.134:0/2703958626 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f628408cde0 con 0x7f6294102f50 2024-02-16T22:26:39.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.880+0000 7f6298eb3700 1 --2- 172.21.15.134:0/2703958626 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f628006d7e0 0x7f628006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:39.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.881+0000 7f6298eb3700 1 --2- 172.21.15.134:0/2703958626 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f628006d7e0 0x7f628006fc90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f629000b3b0 tx=0x7f6290009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:39.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:39.885+0000 7f6289ffb700 1 -- 172.21.15.134:0/2703958626 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f628405a230 con 0x7f6294102f50 2024-02-16T22:26:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.123+0000 7f629b918700 1 -- 172.21.15.134:0/2703958626 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f629404bed0 con 0x7f6294102f50 2024-02-16T22:26:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.123+0000 7f6289ffb700 1 -- 172.21.15.134:0/2703958626 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1860 (secure 0 0 0) 0x7f6284059dc0 con 0x7f6294102f50 2024-02-16T22:26:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:e20 2024-02-16T22:26:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:26:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:26:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-02-16T22:26:40.126 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:26:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-02-16T22:26:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-02-16T22:26:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 20 2024-02-16T22:26:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-16T22:26:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:26:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-02-16T22:23:22.543229+0000 2024-02-16T22:26:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-02-16T22:26:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-02-16T22:26:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-02-16T22:26:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-02-16T22:26:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-02-16T22:26:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-02-16T22:26:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-02-16T22:26:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-02-16T22:26:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-02-16T22:26:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:26:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 2 2024-02-16T22:26:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:in 0,1 2024-02-16T22:26:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14478,1=24269} 2024-02-16T22:26:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-02-16T22:26:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-02-16T22:26:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-02-16T22:26:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-02-16T22:26:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-02-16T22:26:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-02-16T22:26:40.128 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-02-16T22:26:40.128 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-02-16T22:26:40.128 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-02-16T22:26:40.128 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.jyajef{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:26:40.128 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.qljqef{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:26:40.128 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:26:40.128 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:26:40.128 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-02-16T22:26:40.128 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:26:40.128 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.cygfxr{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2804816044,v1:172.21.15.134:6827/2804816044] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:26:40.128 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.phstvm{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:26:40.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.126+0000 7f629b918700 1 -- 172.21.15.134:0/2703958626 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f628006d7e0 msgr2=0x7f628006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:40.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.126+0000 7f629b918700 1 --2- 172.21.15.134:0/2703958626 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f628006d7e0 0x7f628006fc90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f629000b3b0 tx=0x7f6290009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:40.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.126+0000 7f629b918700 1 -- 172.21.15.134:0/2703958626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6294102f50 msgr2=0x7f6294113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:40.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.126+0000 7f629b918700 1 --2- 172.21.15.134:0/2703958626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6294102f50 0x7f6294113a90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f628400c830 tx=0x7f6284004470 comp rx=0 tx=0).stop 2024-02-16T22:26:40.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.126+0000 7f629b918700 1 -- 172.21.15.134:0/2703958626 shutdown_connections 2024-02-16T22:26:40.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.126+0000 7f629b918700 1 --2- 172.21.15.134:0/2703958626 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f628006d7e0 0x7f628006fc90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.126+0000 7f629b918700 1 --2- 172.21.15.134:0/2703958626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6294102f50 0x7f6294113a90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.126+0000 7f629b918700 1 --2- 172.21.15.134:0/2703958626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62941038f0 0x7f6294113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.126+0000 7f629b918700 1 -- 172.21.15.134:0/2703958626 >> 172.21.15.134:0/2703958626 conn(0x7f62940f8ae0 msgr2=0x7f62940fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:40.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.126+0000 7f629b918700 1 -- 172.21.15.134:0/2703958626 shutdown_connections 2024-02-16T22:26:40.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.126+0000 7f629b918700 1 -- 172.21.15.134:0/2703958626 wait complete. 2024-02-16T22:26:40.130 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 20 2024-02-16T22:26:40.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.229+0000 7f725972b700 1 -- 172.21.15.134:0/632415486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72541038f0 msgr2=0x7f72540fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:40.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.229+0000 7f725972b700 1 --2- 172.21.15.134:0/632415486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72541038f0 0x7f72540fcf60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7244004940 tx=0x7f7244009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:40.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.229+0000 7f725972b700 1 -- 172.21.15.134:0/632415486 shutdown_connections 2024-02-16T22:26:40.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.229+0000 7f725972b700 1 --2- 172.21.15.134:0/632415486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72541038f0 0x7f72540fcf60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.229+0000 7f725972b700 1 --2- 172.21.15.134:0/632415486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7254102f50 0x7f7254103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.229+0000 7f725972b700 1 -- 172.21.15.134:0/632415486 >> 172.21.15.134:0/632415486 conn(0x7f72540f8ae0 msgr2=0x7f72540faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:40.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.229+0000 7f725972b700 1 -- 172.21.15.134:0/632415486 shutdown_connections 2024-02-16T22:26:40.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.229+0000 7f725972b700 1 -- 172.21.15.134:0/632415486 wait complete. 2024-02-16T22:26:40.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.230+0000 7f725972b700 1 Processor -- start 2024-02-16T22:26:40.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.230+0000 7f725972b700 1 -- start start 2024-02-16T22:26:40.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.230+0000 7f725972b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7254102f50 0x7f7254070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:40.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.230+0000 7f725972b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72541038f0 0x7f72540707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:40.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.230+0000 7f725972b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7254070dd0 con 0x7f7254102f50 2024-02-16T22:26:40.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.230+0000 7f725972b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7254070f40 con 0x7f72541038f0 2024-02-16T22:26:40.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.230+0000 7f7252ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7254102f50 0x7f7254070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:40.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.230+0000 7f7252ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7254102f50 0x7f7254070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44112/0 (socket says 172.21.15.134:44112) 2024-02-16T22:26:40.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.230+0000 7f7252ffd700 1 -- 172.21.15.134:0/1178856603 learned_addr learned my addr 172.21.15.134:0/1178856603 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:26:40.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.230+0000 7f72527fc700 1 --2- 172.21.15.134:0/1178856603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72541038f0 0x7f72540707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:40.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.230+0000 7f7252ffd700 1 -- 172.21.15.134:0/1178856603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72541038f0 msgr2=0x7f72540707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:40.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.230+0000 7f7252ffd700 1 --2- 172.21.15.134:0/1178856603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72541038f0 0x7f72540707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.230+0000 7f7252ffd700 1 -- 172.21.15.134:0/1178856603 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7244005040 con 0x7f7254102f50 2024-02-16T22:26:40.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.230+0000 7f7252ffd700 1 --2- 172.21.15.134:0/1178856603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7254102f50 0x7f7254070290 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7248002a80 tx=0x7f72480046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:40.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.231+0000 7f723b7fe700 1 -- 172.21.15.134:0/1178856603 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7248007cc0 con 0x7f7254102f50 2024-02-16T22:26:40.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.231+0000 7f723b7fe700 1 -- 172.21.15.134:0/1178856603 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f724800f040 con 0x7f7254102f50 2024-02-16T22:26:40.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.231+0000 7f725972b700 1 -- 172.21.15.134:0/1178856603 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7254119c40 con 0x7f7254102f50 2024-02-16T22:26:40.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.231+0000 7f723b7fe700 1 -- 172.21.15.134:0/1178856603 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f724800dac0 con 0x7f7254102f50 2024-02-16T22:26:40.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.231+0000 7f725972b700 1 -- 172.21.15.134:0/1178856603 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725411a0f0 con 0x7f7254102f50 2024-02-16T22:26:40.235 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:40 smithi173 ceph-mon[83703]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:40.235 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:40 smithi173 ceph-mon[83703]: pgmap v109: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:40.235 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:40 smithi173 ceph-mon[83703]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:40.235 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:40 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:40.235 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:40 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-16T22:26:40.236 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:40 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:26:40.236 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:40 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2638368407' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:40.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.232+0000 7f725972b700 1 -- 172.21.15.134:0/1178856603 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7254105420 con 0x7f7254102f50 2024-02-16T22:26:40.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.232+0000 7f723b7fe700 1 -- 172.21.15.134:0/1178856603 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f724800dc20 con 0x7f7254102f50 2024-02-16T22:26:40.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.233+0000 7f723b7fe700 1 --2- 172.21.15.134:0/1178856603 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f723c06d7e0 0x7f723c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:40.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.233+0000 7f723b7fe700 1 -- 172.21.15.134:0/1178856603 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f724808cad0 con 0x7f7254102f50 2024-02-16T22:26:40.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.233+0000 7f72527fc700 1 --2- 172.21.15.134:0/1178856603 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f723c06d7e0 0x7f723c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:40.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.233+0000 7f72527fc700 1 --2- 172.21.15.134:0/1178856603 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f723c06d7e0 0x7f723c06fc90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72540723a0 tx=0x7f7244009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:40.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.237+0000 7f723b7fe700 1 -- 172.21.15.134:0/1178856603 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7248056370 con 0x7f7254102f50 2024-02-16T22:26:40.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.450+0000 7f725972b700 1 -- 172.21.15.134:0/1178856603 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f72540719d0 con 0x7f723c06d7e0 2024-02-16T22:26:40.452 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:40 smithi134 ceph-mon[112514]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:40.452 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:40 smithi134 ceph-mon[112514]: pgmap v109: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:40.452 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:40 smithi134 ceph-mon[112514]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:40.452 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:40 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:40.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:40 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-16T22:26:40.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:40 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:26:40.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:40 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2638368407' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:40.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.451+0000 7f723b7fe700 1 -- 172.21.15.134:0/1178856603 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f72540719d0 con 0x7f723c06d7e0 2024-02-16T22:26:40.453 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:26:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:26:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:26:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-16T22:26:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-02-16T22:26:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-02-16T22:26:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-02-16T22:26:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-02-16T22:26:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-02-16T22:26:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "9/21 daemons upgraded", 2024-02-16T22:26:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-02-16T22:26:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:26:40.454 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:26:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.454+0000 7f725972b700 1 -- 172.21.15.134:0/1178856603 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f723c06d7e0 msgr2=0x7f723c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.454+0000 7f725972b700 1 --2- 172.21.15.134:0/1178856603 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f723c06d7e0 0x7f723c06fc90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72540723a0 tx=0x7f7244009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.454+0000 7f725972b700 1 -- 172.21.15.134:0/1178856603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7254102f50 msgr2=0x7f7254070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.454+0000 7f725972b700 1 --2- 172.21.15.134:0/1178856603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7254102f50 0x7f7254070290 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7248002a80 tx=0x7f72480046b0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.454+0000 7f725972b700 1 -- 172.21.15.134:0/1178856603 shutdown_connections 2024-02-16T22:26:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.454+0000 7f725972b700 1 --2- 172.21.15.134:0/1178856603 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f723c06d7e0 0x7f723c06fc90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.454+0000 7f725972b700 1 --2- 172.21.15.134:0/1178856603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7254102f50 0x7f7254070290 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.454+0000 7f725972b700 1 --2- 172.21.15.134:0/1178856603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72541038f0 0x7f72540707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.454+0000 7f725972b700 1 -- 172.21.15.134:0/1178856603 >> 172.21.15.134:0/1178856603 conn(0x7f72540f8ae0 msgr2=0x7f72540fa490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.454+0000 7f725972b700 1 -- 172.21.15.134:0/1178856603 shutdown_connections 2024-02-16T22:26:40.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.454+0000 7f725972b700 1 -- 172.21.15.134:0/1178856603 wait complete. 2024-02-16T22:26:40.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.556+0000 7f327ce61700 1 -- 172.21.15.134:0/1880949426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32781038e0 msgr2=0x7f32780fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:40.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.556+0000 7f327ce61700 1 --2- 172.21.15.134:0/1880949426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32781038e0 0x7f32780fcf50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3268004940 tx=0x7f3268009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:40.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.556+0000 7f327ce61700 1 -- 172.21.15.134:0/1880949426 shutdown_connections 2024-02-16T22:26:40.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.556+0000 7f327ce61700 1 --2- 172.21.15.134:0/1880949426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32781038e0 0x7f32780fcf50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.556+0000 7f327ce61700 1 --2- 172.21.15.134:0/1880949426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3278102f40 0x7f3278103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.556+0000 7f327ce61700 1 -- 172.21.15.134:0/1880949426 >> 172.21.15.134:0/1880949426 conn(0x7f32780f8af0 msgr2=0x7f32780faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:40.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.556+0000 7f327ce61700 1 -- 172.21.15.134:0/1880949426 shutdown_connections 2024-02-16T22:26:40.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.556+0000 7f327ce61700 1 -- 172.21.15.134:0/1880949426 wait complete. 2024-02-16T22:26:40.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.557+0000 7f327ce61700 1 Processor -- start 2024-02-16T22:26:40.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.557+0000 7f327ce61700 1 -- start start 2024-02-16T22:26:40.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.557+0000 7f327ce61700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3278102f40 0x7f32781139d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:40.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.557+0000 7f327ce61700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32781038e0 0x7f3278113f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:40.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.557+0000 7f327ce61700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3278114560 con 0x7f32781038e0 2024-02-16T22:26:40.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.557+0000 7f327ce61700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327810d890 con 0x7f3278102f40 2024-02-16T22:26:40.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.557+0000 7f3275d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32781038e0 0x7f3278113f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:40.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.557+0000 7f3275d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32781038e0 0x7f3278113f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44116/0 (socket says 172.21.15.134:44116) 2024-02-16T22:26:40.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.557+0000 7f3275d9b700 1 -- 172.21.15.134:0/1666566617 learned_addr learned my addr 172.21.15.134:0/1666566617 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:26:40.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.558+0000 7f327659c700 1 --2- 172.21.15.134:0/1666566617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3278102f40 0x7f32781139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:40.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.558+0000 7f3275d9b700 1 -- 172.21.15.134:0/1666566617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3278102f40 msgr2=0x7f32781139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:40.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.558+0000 7f3275d9b700 1 --2- 172.21.15.134:0/1666566617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3278102f40 0x7f32781139d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.558+0000 7f3275d9b700 1 -- 172.21.15.134:0/1666566617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3268005040 con 0x7f32781038e0 2024-02-16T22:26:40.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.558+0000 7f3275d9b700 1 --2- 172.21.15.134:0/1666566617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32781038e0 0x7f3278113f10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3268009150 tx=0x7f3268009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:40.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.558+0000 7f3266ffd700 1 -- 172.21.15.134:0/1666566617 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f326800e040 con 0x7f32781038e0 2024-02-16T22:26:40.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.558+0000 7f3266ffd700 1 -- 172.21.15.134:0/1666566617 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f326800bbf0 con 0x7f32781038e0 2024-02-16T22:26:40.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.558+0000 7f327ce61700 1 -- 172.21.15.134:0/1666566617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327810db10 con 0x7f32781038e0 2024-02-16T22:26:40.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.558+0000 7f3266ffd700 1 -- 172.21.15.134:0/1666566617 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f326801c3f0 con 0x7f32781038e0 2024-02-16T22:26:40.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.558+0000 7f327ce61700 1 -- 172.21.15.134:0/1666566617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327810e050 con 0x7f32781038e0 2024-02-16T22:26:40.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.559+0000 7f327ce61700 1 -- 172.21.15.134:0/1666566617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32780fc6f0 con 0x7f32781038e0 2024-02-16T22:26:40.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.559+0000 7f3266ffd700 1 -- 172.21.15.134:0/1666566617 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f326800bd60 con 0x7f32781038e0 2024-02-16T22:26:40.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.560+0000 7f3266ffd700 1 --2- 172.21.15.134:0/1666566617 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f326006d7e0 0x7f326006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:26:40.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.560+0000 7f3266ffd700 1 -- 172.21.15.134:0/1666566617 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f326808e120 con 0x7f32781038e0 2024-02-16T22:26:40.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.560+0000 7f327659c700 1 --2- 172.21.15.134:0/1666566617 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f326006d7e0 0x7f326006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:26:40.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.560+0000 7f327659c700 1 --2- 172.21.15.134:0/1666566617 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f326006d7e0 0x7f326006fc90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f326c009fd0 tx=0x7f326c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:26:40.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.564+0000 7f3266ffd700 1 -- 172.21.15.134:0/1666566617 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f326805b610 con 0x7f32781038e0 2024-02-16T22:26:40.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.839+0000 7f327ce61700 1 -- 172.21.15.134:0/1666566617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f327810efb0 con 0x7f32781038e0 2024-02-16T22:26:40.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.839+0000 7f3266ffd700 1 -- 172.21.15.134:0/1666566617 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f326805b1a0 con 0x7f32781038e0 2024-02-16T22:26:40.841 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-02-16T22:26:40.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.841+0000 7f327ce61700 1 -- 172.21.15.134:0/1666566617 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f326006d7e0 msgr2=0x7f326006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:40.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.841+0000 7f327ce61700 1 --2- 172.21.15.134:0/1666566617 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f326006d7e0 0x7f326006fc90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f326c009fd0 tx=0x7f326c00b040 comp rx=0 tx=0).stop 2024-02-16T22:26:40.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.841+0000 7f327ce61700 1 -- 172.21.15.134:0/1666566617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32781038e0 msgr2=0x7f3278113f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:26:40.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.841+0000 7f327ce61700 1 --2- 172.21.15.134:0/1666566617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32781038e0 0x7f3278113f10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3268009150 tx=0x7f3268009e30 comp rx=0 tx=0).stop 2024-02-16T22:26:40.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.841+0000 7f327ce61700 1 -- 172.21.15.134:0/1666566617 shutdown_connections 2024-02-16T22:26:40.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.841+0000 7f327ce61700 1 --2- 172.21.15.134:0/1666566617 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f326006d7e0 0x7f326006fc90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.841+0000 7f327ce61700 1 --2- 172.21.15.134:0/1666566617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3278102f40 0x7f32781139d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.841+0000 7f327ce61700 1 --2- 172.21.15.134:0/1666566617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32781038e0 0x7f3278113f10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:26:40.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.841+0000 7f327ce61700 1 -- 172.21.15.134:0/1666566617 >> 172.21.15.134:0/1666566617 conn(0x7f32780f8af0 msgr2=0x7f32780fa430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:26:40.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.842+0000 7f327ce61700 1 -- 172.21.15.134:0/1666566617 shutdown_connections 2024-02-16T22:26:40.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:26:40.842+0000 7f327ce61700 1 -- 172.21.15.134:0/1666566617 wait complete. 2024-02-16T22:26:41.214 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:41 smithi173 ceph-mon[83703]: Upgrade: Updating osd.3 2024-02-16T22:26:41.214 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:41 smithi173 ceph-mon[83703]: Deploying daemon osd.3 on smithi173 2024-02-16T22:26:41.214 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:41 smithi173 ceph-mon[83703]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:41.214 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:41 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2703958626' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:26:41.214 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:41 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1666566617' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:26:41.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:41 smithi134 ceph-mon[112514]: Upgrade: Updating osd.3 2024-02-16T22:26:41.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:41 smithi134 ceph-mon[112514]: Deploying daemon osd.3 on smithi173 2024-02-16T22:26:41.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:41 smithi134 ceph-mon[112514]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:41.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:41 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2703958626' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:26:41.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:41 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1666566617' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:26:42.215 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:42 smithi173 ceph-mon[83703]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:42.215 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:42 smithi173 ceph-mon[83703]: pgmap v110: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:42.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:42 smithi134 ceph-mon[112514]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:26:42.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:42 smithi134 ceph-mon[112514]: pgmap v110: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:42.828 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:42 smithi173 systemd[1]: Stopping Ceph osd.3 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:26:43.090 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:42 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3[42728]: 2024-02-16T22:26:42.826+0000 7ff1f0618700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:26:43.090 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:42 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3[42728]: 2024-02-16T22:26:42.826+0000 7ff1f0618700 -1 osd.3 64 *** Got signal Terminated *** 2024-02-16T22:26:43.090 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:42 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3[42728]: 2024-02-16T22:26:42.826+0000 7ff1f0618700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-16T22:26:43.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:43 smithi134 ceph-mon[112514]: osd.3 marked itself down and dead 2024-02-16T22:26:43.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:43 smithi173 ceph-mon[83703]: osd.3 marked itself down and dead 2024-02-16T22:26:43.746 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:43 smithi173 podman[92931]: 2024-02-16 22:26:43.487838833 +0000 UTC m=+0.759804536 container died b108a8edded4cb4361b066ba51fc4e0fcb8ede8014d5f4888b220488e72f52a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=quincy-b88fae6, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214) 2024-02-16T22:26:44.091 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:43 smithi173 podman[92931]: 2024-02-16 22:26:43.927541371 +0000 UTC m=+1.199507129 container cleanup b108a8edded4cb4361b066ba51fc4e0fcb8ede8014d5f4888b220488e72f52a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, RELEASE=quincy-b88fae6, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-16T22:26:44.091 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:43 smithi173 bash[92931]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3 2024-02-16T22:26:44.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:44 smithi134 ceph-mon[112514]: pgmap v111: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:44.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:44 smithi134 ceph-mon[112514]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-16T22:26:44.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:44 smithi134 ceph-mon[112514]: failed to encode map e65 with expected crc 2024-02-16T22:26:44.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:44 smithi134 ceph-mon[112514]: osdmap e65: 6 total, 5 up, 6 in 2024-02-16T22:26:44.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:44 smithi173 ceph-mon[83703]: pgmap v111: 65 pgs: 65 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:44.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:44 smithi173 ceph-mon[83703]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-16T22:26:44.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:44 smithi173 ceph-mon[83703]: failed to encode map e65 with expected crc 2024-02-16T22:26:44.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:44 smithi173 ceph-mon[83703]: osdmap e65: 6 total, 5 up, 6 in 2024-02-16T22:26:44.481 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:44 smithi173 podman[92959]: 2024-02-16 22:26:44.12326009 +0000 UTC m=+0.637117522 container remove b108a8edded4cb4361b066ba51fc4e0fcb8ede8014d5f4888b220488e72f52a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3, GIT_CLEAN=True, RELEASE=quincy-b88fae6, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-02-16T22:26:44.787 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:44 smithi173 podman[93051]: 2024-02-16 22:26:44.436279017 +0000 UTC m=+0.018681189 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:26:44.787 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:44 smithi173 podman[93051]: 2024-02-16 22:26:44.538560104 +0000 UTC m=+0.120962277 container create 11c09daca5166de59e5b91c9b0a549cf2f8ed6c321390bce87e8c978007d959b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0) 2024-02-16T22:26:44.787 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:44 smithi173 podman[93051]: 2024-02-16 22:26:44.782838973 +0000 UTC m=+0.365241145 container init 11c09daca5166de59e5b91c9b0a549cf2f8ed6c321390bce87e8c978007d959b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-16T22:26:44.787 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:44 smithi173 podman[93051]: 2024-02-16 22:26:44.785993033 +0000 UTC m=+0.368395208 container start 11c09daca5166de59e5b91c9b0a549cf2f8ed6c321390bce87e8c978007d959b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-deactivate, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=) 2024-02-16T22:26:45.078 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:44 smithi173 podman[93051]: 2024-02-16 22:26:44.908113036 +0000 UTC m=+0.490515238 container attach 11c09daca5166de59e5b91c9b0a549cf2f8ed6c321390bce87e8c978007d959b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:26:45.363 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:45 smithi173 podman[93051]: 2024-02-16 22:26:45.07765975 +0000 UTC m=+0.660061924 container died 11c09daca5166de59e5b91c9b0a549cf2f8ed6c321390bce87e8c978007d959b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-02-16T22:26:45.364 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:45 smithi173 ceph-mon[83703]: osdmap e66: 6 total, 5 up, 6 in 2024-02-16T22:26:45.364 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:45 smithi173 ceph-mon[83703]: failed to encode map e66 with expected crc 2024-02-16T22:26:45.364 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:45 smithi173 ceph-mon[83703]: failed to encode map e66 with expected crc 2024-02-16T22:26:45.364 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:45 smithi173 ceph-mon[83703]: failed to encode map e66 with expected crc 2024-02-16T22:26:45.364 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:45 smithi173 ceph-mon[83703]: failed to encode map e66 with expected crc 2024-02-16T22:26:45.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:45 smithi134 ceph-mon[112514]: osdmap e66: 6 total, 5 up, 6 in 2024-02-16T22:26:45.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:45 smithi134 ceph-mon[112514]: failed to encode map e66 with expected crc 2024-02-16T22:26:45.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:45 smithi134 ceph-mon[112514]: failed to encode map e66 with expected crc 2024-02-16T22:26:45.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:45 smithi134 ceph-mon[112514]: failed to encode map e66 with expected crc 2024-02-16T22:26:45.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:45 smithi134 ceph-mon[112514]: failed to encode map e66 with expected crc 2024-02-16T22:26:45.615 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:45 smithi173 podman[93077]: 2024-02-16 22:26:45.612423293 +0000 UTC m=+0.529243722 container remove 11c09daca5166de59e5b91c9b0a549cf2f8ed6c321390bce87e8c978007d959b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-deactivate, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=) 2024-02-16T22:26:45.981 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:45 smithi173 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.3.service: Deactivated successfully. 2024-02-16T22:26:45.981 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:45 smithi173 systemd[1]: Stopped Ceph osd.3 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:26:45.981 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:45 smithi173 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.3.service: Consumed 1min 8.189s CPU time. 2024-02-16T22:26:45.981 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:45 smithi173 systemd[1]: Starting Ceph osd.3 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:26:46.342 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:46 smithi173 ceph-mon[83703]: pgmap v114: 65 pgs: 4 peering, 15 stale+active+clean, 46 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:46.342 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:46 smithi173 ceph-mon[83703]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-16T22:26:46.342 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 podman[93186]: 2024-02-16 22:26:45.958226393 +0000 UTC m=+0.017282589 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:26:46.342 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 podman[93186]: 2024-02-16 22:26:46.071877331 +0000 UTC m=+0.130933569 container create 09d35eba5b1ae23ee645da33d4a26b5e55e5016cec0b2f6f89aa94ea2640e58e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True) 2024-02-16T22:26:46.343 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 podman[93186]: 2024-02-16 22:26:46.341339251 +0000 UTC m=+0.400395454 container init 09d35eba5b1ae23ee645da33d4a26b5e55e5016cec0b2f6f89aa94ea2640e58e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-activate, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-02-16T22:26:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:46 smithi134 ceph-mon[112514]: pgmap v114: 65 pgs: 4 peering, 15 stale+active+clean, 46 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:26:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:46 smithi134 ceph-mon[112514]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-16T22:26:46.731 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 podman[93186]: 2024-02-16 22:26:46.344426676 +0000 UTC m=+0.403482881 container start 09d35eba5b1ae23ee645da33d4a26b5e55e5016cec0b2f6f89aa94ea2640e58e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-activate, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=) 2024-02-16T22:26:46.731 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 podman[93186]: 2024-02-16 22:26:46.416210904 +0000 UTC m=+0.475267115 container attach 09d35eba5b1ae23ee645da33d4a26b5e55e5016cec0b2f6f89aa94ea2640e58e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-activate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-16T22:26:47.121 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-activate[93201]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-16T22:26:47.121 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-activate[93201]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-16T22:26:47.121 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 bash[93186]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-16T22:26:47.121 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 bash[93186]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-16T22:26:47.121 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 bash[93186]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-16T22:26:47.121 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 bash[93186]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-16T22:26:47.121 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 bash[93186]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-16T22:26:47.121 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 bash[93186]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-16T22:26:47.121 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 bash[93186]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-16T22:26:47.121 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-activate[93201]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-16T22:26:47.121 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-activate[93201]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-16T22:26:47.121 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-activate[93201]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-16T22:26:47.121 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-activate[93201]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-16T22:26:47.122 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-activate[93201]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-16T22:26:47.122 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:46 smithi173 podman[93186]: 2024-02-16 22:26:46.811625604 +0000 UTC m=+0.870681801 container died 09d35eba5b1ae23ee645da33d4a26b5e55e5016cec0b2f6f89aa94ea2640e58e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-02-16T22:26:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:47 smithi134 ceph-mon[112514]: pgmap v115: 65 pgs: 3 active+undersized+degraded, 4 peering, 12 stale+active+clean, 4 active+undersized, 42 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 8/357 objects degraded (2.241%) 2024-02-16T22:26:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:47 smithi134 ceph-mon[112514]: Health check failed: Degraded data redundancy: 8/357 objects degraded (2.241%), 3 pgs degraded (PG_DEGRADED) 2024-02-16T22:26:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:47 smithi173 ceph-mon[83703]: pgmap v115: 65 pgs: 3 active+undersized+degraded, 4 peering, 12 stale+active+clean, 4 active+undersized, 42 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 8/357 objects degraded (2.241%) 2024-02-16T22:26:47.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:47 smithi173 ceph-mon[83703]: Health check failed: Degraded data redundancy: 8/357 objects degraded (2.241%), 3 pgs degraded (PG_DEGRADED) 2024-02-16T22:26:47.481 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:47 smithi173 podman[93336]: 2024-02-16 22:26:47.33714923 +0000 UTC m=+0.519825454 container remove 09d35eba5b1ae23ee645da33d4a26b5e55e5016cec0b2f6f89aa94ea2640e58e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-16T22:26:47.816 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:47 smithi173 podman[93401]: 2024-02-16 22:26:47.451478676 +0000 UTC m=+0.017615006 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:26:47.817 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:47 smithi173 podman[93401]: 2024-02-16 22:26:47.563258656 +0000 UTC m=+0.129394978 container create 1f4624a5418b8fed6f1107151cc928a2b3533d41545822964f6b86df91a3d4ce (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3, ceph=True, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-16T22:26:47.817 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:47 smithi173 podman[93401]: 2024-02-16 22:26:47.815597749 +0000 UTC m=+0.381734072 container init 1f4624a5418b8fed6f1107151cc928a2b3533d41545822964f6b86df91a3d4ce (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-02-16T22:26:48.231 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:47 smithi173 podman[93401]: 2024-02-16 22:26:47.818661601 +0000 UTC m=+0.384797933 container start 1f4624a5418b8fed6f1107151cc928a2b3533d41545822964f6b86df91a3d4ce (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-02-16T22:26:48.231 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:47 smithi173 ceph-osd[93420]: -- 172.21.15.173:0/2948132724 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562c966271e0 con 0x562c965f8c00 2024-02-16T22:26:48.231 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:47 smithi173 bash[93401]: 1f4624a5418b8fed6f1107151cc928a2b3533d41545822964f6b86df91a3d4ce 2024-02-16T22:26:48.231 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:47 smithi173 systemd[1]: Started Ceph osd.3 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:26:48.731 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:48 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3[93416]: 2024-02-16T22:26:48.360+0000 7f9bc30d67c0 -1 Falling back to public interface 2024-02-16T22:26:49.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:48 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:49.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:48 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:49.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:48 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:26:49.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:48 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:49.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:48 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:49.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:48 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:26:50.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:49 smithi134 ceph-mon[112514]: pgmap v116: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/357 objects degraded (20.448%) 2024-02-16T22:26:50.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:49 smithi173 ceph-mon[83703]: pgmap v116: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/357 objects degraded (20.448%) 2024-02-16T22:26:51.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:50 smithi134 ceph-mon[112514]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-16T22:26:51.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:50 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:51.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:50 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:51.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:50 smithi173 ceph-mon[83703]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-16T22:26:51.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:50 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:51.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:50 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:52.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:51 smithi134 ceph-mon[112514]: pgmap v117: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/357 objects degraded (20.448%) 2024-02-16T22:26:52.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:51 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:52.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:51 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:52.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:51 smithi173 ceph-mon[83703]: pgmap v117: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/357 objects degraded (20.448%) 2024-02-16T22:26:52.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:51 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:52.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:51 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:53.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:53 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:53.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:53 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:26:53.231 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:52 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3[93416]: 2024-02-16T22:26:52.961+0000 7f9bc30d67c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-02-16T22:26:53.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:53 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:53.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:53 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:26:53.537 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:53 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3[93416]: 2024-02-16T22:26:53.478+0000 7f9bc30d67c0 -1 osd.3 64 log_to_monitors true 2024-02-16T22:26:54.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:54 smithi134 ceph-mon[112514]: pgmap v118: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/357 objects degraded (20.448%) 2024-02-16T22:26:54.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:54 smithi134 ceph-mon[112514]: from='osd.3 [v2:172.21.15.173:6800/1507653386,v1:172.21.15.173:6801/1507653386]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-16T22:26:54.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:54 smithi134 ceph-mon[112514]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-16T22:26:54.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:54 smithi134 ceph-mon[112514]: Health check update: Degraded data redundancy: 73/357 objects degraded (20.448%), 19 pgs degraded (PG_DEGRADED) 2024-02-16T22:26:54.481 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:26:54 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3[93416]: 2024-02-16T22:26:54.106+0000 7f9bb452e700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T22:26:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:54 smithi173 ceph-mon[83703]: pgmap v118: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 302 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/357 objects degraded (20.448%) 2024-02-16T22:26:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:54 smithi173 ceph-mon[83703]: from='osd.3 [v2:172.21.15.173:6800/1507653386,v1:172.21.15.173:6801/1507653386]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-16T22:26:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:54 smithi173 ceph-mon[83703]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-16T22:26:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:54 smithi173 ceph-mon[83703]: Health check update: Degraded data redundancy: 73/357 objects degraded (20.448%), 19 pgs degraded (PG_DEGRADED) 2024-02-16T22:26:55.262 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:55 smithi173 ceph-mon[83703]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-16T22:26:55.262 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:55 smithi173 ceph-mon[83703]: from='osd.3 [v2:172.21.15.173:6800/1507653386,v1:172.21.15.173:6801/1507653386]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:26:55.262 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:55 smithi173 ceph-mon[83703]: osdmap e67: 6 total, 5 up, 6 in 2024-02-16T22:26:55.262 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:55 smithi173 ceph-mon[83703]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:26:55.470 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:55 smithi134 ceph-mon[112514]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-16T22:26:55.470 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:55 smithi134 ceph-mon[112514]: from='osd.3 [v2:172.21.15.173:6800/1507653386,v1:172.21.15.173:6801/1507653386]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:26:55.470 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:55 smithi134 ceph-mon[112514]: osdmap e67: 6 total, 5 up, 6 in 2024-02-16T22:26:55.470 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:55 smithi134 ceph-mon[112514]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:26:56.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: pgmap v120: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 73/357 objects degraded (20.448%) 2024-02-16T22:26:56.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-16T22:26:56.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: failed to encode map e67 with expected crc 2024-02-16T22:26:56.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: osd.3 [v2:172.21.15.173:6800/1507653386,v1:172.21.15.173:6801/1507653386] boot 2024-02-16T22:26:56.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: osdmap e68: 6 total, 6 up, 6 in 2024-02-16T22:26:56.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:26:56.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:56.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:56.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:26:56.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:26:56.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:56.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:26:56.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:56.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:56.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:56.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-16T22:26:56.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:56 smithi134 ceph-mon[112514]: osdmap e69: 6 total, 6 up, 6 in 2024-02-16T22:26:56.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: pgmap v120: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 73/357 objects degraded (20.448%) 2024-02-16T22:26:56.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-16T22:26:56.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: failed to encode map e67 with expected crc 2024-02-16T22:26:56.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: osd.3 [v2:172.21.15.173:6800/1507653386,v1:172.21.15.173:6801/1507653386] boot 2024-02-16T22:26:56.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: osdmap e68: 6 total, 6 up, 6 in 2024-02-16T22:26:56.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-16T22:26:56.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:56.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:56.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:26:56.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:26:56.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:26:56.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:26:56.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:56.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:56.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:26:56.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-16T22:26:56.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:56 smithi173 ceph-mon[83703]: osdmap e69: 6 total, 6 up, 6 in 2024-02-16T22:26:57.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:57 smithi134 ceph-mon[112514]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-16T22:26:57.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:57 smithi134 ceph-mon[112514]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-16T22:26:57.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:57 smithi134 ceph-mon[112514]: failed to encode map e69 with expected crc 2024-02-16T22:26:57.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:57 smithi134 ceph-mon[112514]: failed to encode map e69 with expected crc 2024-02-16T22:26:57.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:57 smithi134 ceph-mon[112514]: failed to encode map e69 with expected crc 2024-02-16T22:26:57.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:57 smithi134 ceph-mon[112514]: failed to encode map e69 with expected crc 2024-02-16T22:26:57.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:57 smithi134 ceph-mon[112514]: failed to encode map e69 with expected crc 2024-02-16T22:26:57.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:57 smithi134 ceph-mon[112514]: failed to encode map e69 with expected crc 2024-02-16T22:26:57.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:57 smithi173 ceph-mon[83703]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-16T22:26:57.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:57 smithi173 ceph-mon[83703]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-16T22:26:57.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:57 smithi173 ceph-mon[83703]: failed to encode map e69 with expected crc 2024-02-16T22:26:57.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:57 smithi173 ceph-mon[83703]: failed to encode map e69 with expected crc 2024-02-16T22:26:57.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:57 smithi173 ceph-mon[83703]: failed to encode map e69 with expected crc 2024-02-16T22:26:57.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:57 smithi173 ceph-mon[83703]: failed to encode map e69 with expected crc 2024-02-16T22:26:57.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:57 smithi173 ceph-mon[83703]: failed to encode map e69 with expected crc 2024-02-16T22:26:57.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:57 smithi173 ceph-mon[83703]: failed to encode map e69 with expected crc 2024-02-16T22:26:58.382 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:58 smithi173 ceph-mon[83703]: pgmap v123: 65 pgs: 4 peering, 18 active+undersized+degraded, 16 active+undersized, 27 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 69/357 objects degraded (19.328%) 2024-02-16T22:26:58.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:58 smithi134 ceph-mon[112514]: pgmap v123: 65 pgs: 4 peering, 18 active+undersized+degraded, 16 active+undersized, 27 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 69/357 objects degraded (19.328%) 2024-02-16T22:26:59.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:26:59 smithi134 ceph-mon[112514]: Health check update: Degraded data redundancy: 69/357 objects degraded (19.328%), 18 pgs degraded (PG_DEGRADED) 2024-02-16T22:26:59.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:26:59 smithi173 ceph-mon[83703]: Health check update: Degraded data redundancy: 69/357 objects degraded (19.328%), 18 pgs degraded (PG_DEGRADED) 2024-02-16T22:27:00.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:00 smithi134 ceph-mon[112514]: pgmap v124: 65 pgs: 4 peering, 10 active+undersized+degraded, 6 active+undersized, 45 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-16T22:27:00.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:00 smithi173 ceph-mon[83703]: pgmap v124: 65 pgs: 4 peering, 10 active+undersized+degraded, 6 active+undersized, 45 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-16T22:27:01.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:01 smithi134 ceph-mon[112514]: pgmap v125: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:01.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:01 smithi134 ceph-mon[112514]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/357 objects degraded (12.325%), 10 pgs degraded) 2024-02-16T22:27:01.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:01 smithi134 ceph-mon[112514]: Cluster is now healthy 2024-02-16T22:27:01.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:01 smithi173 ceph-mon[83703]: pgmap v125: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:01.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:01 smithi173 ceph-mon[83703]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/357 objects degraded (12.325%), 10 pgs degraded) 2024-02-16T22:27:01.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:01 smithi173 ceph-mon[83703]: Cluster is now healthy 2024-02-16T22:27:04.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:04 smithi134 ceph-mon[112514]: pgmap v126: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:04 smithi173 ceph-mon[83703]: pgmap v126: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:06.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:06 smithi134 ceph-mon[112514]: pgmap v127: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:06 smithi173 ceph-mon[83703]: pgmap v127: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:08.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:08 smithi134 ceph-mon[112514]: pgmap v128: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:08.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:08 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:08.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:08 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:27:08.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:08 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:08 smithi173 ceph-mon[83703]: pgmap v128: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:08 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:08 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:27:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:08 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:10 smithi134 ceph-mon[112514]: pgmap v129: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:10 smithi173 ceph-mon[83703]: pgmap v129: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:10.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.956+0000 7ff281056700 1 -- 172.21.15.134:0/2605895553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c103140 msgr2=0x7ff27c103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:10.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.956+0000 7ff281056700 1 --2- 172.21.15.134:0/2605895553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c103140 0x7ff27c103510 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff270004940 tx=0x7ff270009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:10.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.956+0000 7ff281056700 1 -- 172.21.15.134:0/2605895553 shutdown_connections 2024-02-16T22:27:10.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.956+0000 7ff281056700 1 --2- 172.21.15.134:0/2605895553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff27c0fb570 0x7ff27c0fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:10.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.956+0000 7ff281056700 1 --2- 172.21.15.134:0/2605895553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c103140 0x7ff27c103510 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:10.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.956+0000 7ff281056700 1 -- 172.21.15.134:0/2605895553 >> 172.21.15.134:0/2605895553 conn(0x7ff27c071560 msgr2=0x7ff27c071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:10.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.956+0000 7ff281056700 1 -- 172.21.15.134:0/2605895553 shutdown_connections 2024-02-16T22:27:10.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.956+0000 7ff281056700 1 -- 172.21.15.134:0/2605895553 wait complete. 2024-02-16T22:27:10.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.957+0000 7ff281056700 1 Processor -- start 2024-02-16T22:27:10.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.957+0000 7ff281056700 1 -- start start 2024-02-16T22:27:10.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.957+0000 7ff281056700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff27c0fb570 0x7ff27c113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:10.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.957+0000 7ff281056700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c103140 0x7ff27c114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:10.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.957+0000 7ff281056700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c114810 con 0x7ff27c103140 2024-02-16T22:27:10.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.957+0000 7ff281056700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c10dab0 con 0x7ff27c0fb570 2024-02-16T22:27:10.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.957+0000 7ff27a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c103140 0x7ff27c114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:10.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.957+0000 7ff27a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c103140 0x7ff27c114130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50536/0 (socket says 172.21.15.134:50536) 2024-02-16T22:27:10.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.957+0000 7ff27a59c700 1 -- 172.21.15.134:0/3429723485 learned_addr learned my addr 172.21.15.134:0/3429723485 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:27:10.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.957+0000 7ff27ad9d700 1 --2- 172.21.15.134:0/3429723485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff27c0fb570 0x7ff27c113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:10.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.958+0000 7ff27a59c700 1 -- 172.21.15.134:0/3429723485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff27c0fb570 msgr2=0x7ff27c113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:10.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.958+0000 7ff27a59c700 1 --2- 172.21.15.134:0/3429723485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff27c0fb570 0x7ff27c113bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:10.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.958+0000 7ff27a59c700 1 -- 172.21.15.134:0/3429723485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270005040 con 0x7ff27c103140 2024-02-16T22:27:10.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.958+0000 7ff27a59c700 1 --2- 172.21.15.134:0/3429723485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c103140 0x7ff27c114130 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00b790 tx=0x7ff26c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:10.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.958+0000 7ff2637fe700 1 -- 172.21.15.134:0/3429723485 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff26c00f6f0 con 0x7ff27c103140 2024-02-16T22:27:10.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.958+0000 7ff281056700 1 -- 172.21.15.134:0/3429723485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27c10dd90 con 0x7ff27c103140 2024-02-16T22:27:10.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.958+0000 7ff2637fe700 1 -- 172.21.15.134:0/3429723485 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff26c00fd20 con 0x7ff27c103140 2024-02-16T22:27:10.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.958+0000 7ff2637fe700 1 -- 172.21.15.134:0/3429723485 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff26c0103a0 con 0x7ff27c103140 2024-02-16T22:27:10.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.958+0000 7ff281056700 1 -- 172.21.15.134:0/3429723485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27c10e2d0 con 0x7ff27c103140 2024-02-16T22:27:10.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.959+0000 7ff281056700 1 -- 172.21.15.134:0/3429723485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27c073080 con 0x7ff27c103140 2024-02-16T22:27:10.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.959+0000 7ff2637fe700 1 -- 172.21.15.134:0/3429723485 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff26c011400 con 0x7ff27c103140 2024-02-16T22:27:10.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.960+0000 7ff2637fe700 1 --2- 172.21.15.134:0/3429723485 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff26406d7e0 0x7ff26406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:10.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.960+0000 7ff2637fe700 1 -- 172.21.15.134:0/3429723485 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff26c08cc70 con 0x7ff27c103140 2024-02-16T22:27:10.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.960+0000 7ff27ad9d700 1 --2- 172.21.15.134:0/3429723485 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff26406d7e0 0x7ff26406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:10.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.960+0000 7ff27ad9d700 1 --2- 172.21.15.134:0/3429723485 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff26406d7e0 0x7ff26406fc90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff270004f90 tx=0x7ff270009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:10.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:10.965+0000 7ff2637fe700 1 -- 172.21.15.134:0/3429723485 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff26c05a0c0 con 0x7ff27c103140 2024-02-16T22:27:11.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.178+0000 7ff281056700 1 -- 172.21.15.134:0/3429723485 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff27c1138c0 con 0x7ff26406d7e0 2024-02-16T22:27:11.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.180+0000 7ff2637fe700 1 -- 172.21.15.134:0/3429723485 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff27c1138c0 con 0x7ff26406d7e0 2024-02-16T22:27:11.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.182+0000 7ff281056700 1 -- 172.21.15.134:0/3429723485 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff26406d7e0 msgr2=0x7ff26406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:11.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.182+0000 7ff281056700 1 --2- 172.21.15.134:0/3429723485 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff26406d7e0 0x7ff26406fc90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff270004f90 tx=0x7ff270009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:11.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.182+0000 7ff281056700 1 -- 172.21.15.134:0/3429723485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c103140 msgr2=0x7ff27c114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:11.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.182+0000 7ff281056700 1 --2- 172.21.15.134:0/3429723485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c103140 0x7ff27c114130 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00b790 tx=0x7ff26c009250 comp rx=0 tx=0).stop 2024-02-16T22:27:11.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.182+0000 7ff281056700 1 -- 172.21.15.134:0/3429723485 shutdown_connections 2024-02-16T22:27:11.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.182+0000 7ff281056700 1 --2- 172.21.15.134:0/3429723485 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff26406d7e0 0x7ff26406fc90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.182+0000 7ff281056700 1 --2- 172.21.15.134:0/3429723485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff27c0fb570 0x7ff27c113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.182+0000 7ff281056700 1 --2- 172.21.15.134:0/3429723485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff27c103140 0x7ff27c114130 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.182+0000 7ff281056700 1 -- 172.21.15.134:0/3429723485 >> 172.21.15.134:0/3429723485 conn(0x7ff27c071560 msgr2=0x7ff27c0f96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:11.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.182+0000 7ff281056700 1 -- 172.21.15.134:0/3429723485 shutdown_connections 2024-02-16T22:27:11.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.182+0000 7ff281056700 1 -- 172.21.15.134:0/3429723485 wait complete. 2024-02-16T22:27:11.194 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:27:11.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-16T22:27:11.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.286+0000 7f863c69a700 1 -- 172.21.15.134:0/2941092899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8634101e50 msgr2=0x7f8634102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:11.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.286+0000 7f863c69a700 1 --2- 172.21.15.134:0/2941092899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8634101e50 0x7f8634102220 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8630009ce0 tx=0x7f8630004d10 comp rx=0 tx=0).stop 2024-02-16T22:27:11.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.286+0000 7f863c69a700 1 -- 172.21.15.134:0/2941092899 shutdown_connections 2024-02-16T22:27:11.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.286+0000 7f863c69a700 1 --2- 172.21.15.134:0/2941092899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86341027f0 0x7f86340fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.286+0000 7f863c69a700 1 --2- 172.21.15.134:0/2941092899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8634101e50 0x7f8634102220 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.286+0000 7f863c69a700 1 -- 172.21.15.134:0/2941092899 >> 172.21.15.134:0/2941092899 conn(0x7f86340f79e0 msgr2=0x7f86340f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.286+0000 7f863c69a700 1 -- 172.21.15.134:0/2941092899 shutdown_connections 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.286+0000 7f863c69a700 1 -- 172.21.15.134:0/2941092899 wait complete. 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.286+0000 7f863c69a700 1 Processor -- start 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.286+0000 7f863c69a700 1 -- start start 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f863c69a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8634101e50 0x7f863410ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f863c69a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86341027f0 0x7f863410f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f863c69a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863410f870 con 0x7f86341027f0 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f863c69a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863410f9b0 con 0x7f8634101e50 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f8639c35700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86341027f0 0x7f863410f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f8639c35700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86341027f0 0x7f863410f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50550/0 (socket says 172.21.15.134:50550) 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f8639c35700 1 -- 172.21.15.134:0/569474145 learned_addr learned my addr 172.21.15.134:0/569474145 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f863a436700 1 --2- 172.21.15.134:0/569474145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8634101e50 0x7f863410ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f8639c35700 1 -- 172.21.15.134:0/569474145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8634101e50 msgr2=0x7f863410ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f8639c35700 1 --2- 172.21.15.134:0/569474145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8634101e50 0x7f863410ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f8639c35700 1 -- 172.21.15.134:0/569474145 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8630009940 con 0x7f86341027f0 2024-02-16T22:27:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f863a436700 1 --2- 172.21.15.134:0/569474145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8634101e50 0x7f863410ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:27:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f8639c35700 1 --2- 172.21.15.134:0/569474145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86341027f0 0x7f863410f250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f862400b7c0 tx=0x7f8624009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f862affd700 1 -- 172.21.15.134:0/569474145 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f862400f6f0 con 0x7f86341027f0 2024-02-16T22:27:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f862affd700 1 -- 172.21.15.134:0/569474145 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f862400fd20 con 0x7f86341027f0 2024-02-16T22:27:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.287+0000 7f863c69a700 1 -- 172.21.15.134:0/569474145 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8634117ce0 con 0x7f86341027f0 2024-02-16T22:27:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.288+0000 7f862affd700 1 -- 172.21.15.134:0/569474145 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86240103a0 con 0x7f86341027f0 2024-02-16T22:27:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.288+0000 7f863c69a700 1 -- 172.21.15.134:0/569474145 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8634118220 con 0x7f86341027f0 2024-02-16T22:27:11.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.289+0000 7f863c69a700 1 -- 172.21.15.134:0/569474145 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86340ff160 con 0x7f86341027f0 2024-02-16T22:27:11.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.289+0000 7f862affd700 1 -- 172.21.15.134:0/569474145 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f8624011400 con 0x7f86341027f0 2024-02-16T22:27:11.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.289+0000 7f862affd700 1 --2- 172.21.15.134:0/569474145 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f862006d7e0 0x7f862006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:11.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.289+0000 7f862affd700 1 -- 172.21.15.134:0/569474145 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f862408cc60 con 0x7f86341027f0 2024-02-16T22:27:11.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.290+0000 7f863a436700 1 --2- 172.21.15.134:0/569474145 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f862006d7e0 0x7f862006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:11.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.290+0000 7f863a436700 1 --2- 172.21.15.134:0/569474145 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f862006d7e0 0x7f862006fc90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f863000b740 tx=0x7f8630004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:11.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.294+0000 7f862affd700 1 -- 172.21.15.134:0/569474145 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8624056580 con 0x7f86341027f0 2024-02-16T22:27:11.381 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-16T22:27:11.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.505+0000 7f863c69a700 1 -- 172.21.15.134:0/569474145 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f863404bf40 con 0x7f862006d7e0 2024-02-16T22:27:11.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.507+0000 7f862affd700 1 -- 172.21.15.134:0/569474145 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f863404bf40 con 0x7f862006d7e0 2024-02-16T22:27:11.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.509+0000 7f863c69a700 1 -- 172.21.15.134:0/569474145 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f862006d7e0 msgr2=0x7f862006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:11.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.509+0000 7f863c69a700 1 --2- 172.21.15.134:0/569474145 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f862006d7e0 0x7f862006fc90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f863000b740 tx=0x7f8630004d10 comp rx=0 tx=0).stop 2024-02-16T22:27:11.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.509+0000 7f863c69a700 1 -- 172.21.15.134:0/569474145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86341027f0 msgr2=0x7f863410f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:11.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.509+0000 7f863c69a700 1 --2- 172.21.15.134:0/569474145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86341027f0 0x7f863410f250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f862400b7c0 tx=0x7f8624009220 comp rx=0 tx=0).stop 2024-02-16T22:27:11.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.509+0000 7f863c69a700 1 -- 172.21.15.134:0/569474145 shutdown_connections 2024-02-16T22:27:11.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.509+0000 7f863c69a700 1 --2- 172.21.15.134:0/569474145 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f862006d7e0 0x7f862006fc90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.509+0000 7f863c69a700 1 --2- 172.21.15.134:0/569474145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8634101e50 0x7f863410ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.509+0000 7f863c69a700 1 --2- 172.21.15.134:0/569474145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86341027f0 0x7f863410f250 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.509+0000 7f863c69a700 1 -- 172.21.15.134:0/569474145 >> 172.21.15.134:0/569474145 conn(0x7f86340f79e0 msgr2=0x7f86340f9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:11.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.509+0000 7f863c69a700 1 -- 172.21.15.134:0/569474145 shutdown_connections 2024-02-16T22:27:11.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.509+0000 7f863c69a700 1 -- 172.21.15.134:0/569474145 wait complete. 2024-02-16T22:27:11.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.610+0000 7fb5914e1700 1 -- 172.21.15.134:0/1761216984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb58c101e40 msgr2=0x7fb58c102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:11.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.610+0000 7fb5914e1700 1 --2- 172.21.15.134:0/1761216984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb58c101e40 0x7fb58c102210 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb57c004940 tx=0x7fb57c009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:11.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.610+0000 7fb5914e1700 1 -- 172.21.15.134:0/1761216984 shutdown_connections 2024-02-16T22:27:11.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.610+0000 7fb5914e1700 1 --2- 172.21.15.134:0/1761216984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58c1027e0 0x7fb58c0fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.610+0000 7fb5914e1700 1 --2- 172.21.15.134:0/1761216984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb58c101e40 0x7fb58c102210 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.610+0000 7fb5914e1700 1 -- 172.21.15.134:0/1761216984 >> 172.21.15.134:0/1761216984 conn(0x7fb58c071d90 msgr2=0x7fb58c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:11.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.610+0000 7fb5914e1700 1 -- 172.21.15.134:0/1761216984 shutdown_connections 2024-02-16T22:27:11.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.610+0000 7fb5914e1700 1 -- 172.21.15.134:0/1761216984 wait complete. 2024-02-16T22:27:11.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.610+0000 7fb5914e1700 1 Processor -- start 2024-02-16T22:27:11.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.611+0000 7fb5914e1700 1 -- start start 2024-02-16T22:27:11.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.611+0000 7fb5914e1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58c101e40 0x7fb58c1128b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:11.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.611+0000 7fb5914e1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb58c1027e0 0x7fb58c112df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:11.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.611+0000 7fb5914e1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c113440 con 0x7fb58c1027e0 2024-02-16T22:27:11.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.611+0000 7fb5914e1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c10c770 con 0x7fb58c101e40 2024-02-16T22:27:11.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.611+0000 7fb5827fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb58c1027e0 0x7fb58c112df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:11.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.611+0000 7fb5827fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb58c1027e0 0x7fb58c112df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52192/0 (socket says 172.21.15.134:52192) 2024-02-16T22:27:11.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.611+0000 7fb5827fc700 1 -- 172.21.15.134:0/2302553820 learned_addr learned my addr 172.21.15.134:0/2302553820 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:27:11.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.611+0000 7fb58affd700 1 --2- 172.21.15.134:0/2302553820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58c101e40 0x7fb58c1128b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:11.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.611+0000 7fb5827fc700 1 -- 172.21.15.134:0/2302553820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58c101e40 msgr2=0x7fb58c1128b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:11.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.611+0000 7fb5827fc700 1 --2- 172.21.15.134:0/2302553820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58c101e40 0x7fb58c1128b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.611+0000 7fb5827fc700 1 -- 172.21.15.134:0/2302553820 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c005040 con 0x7fb58c1027e0 2024-02-16T22:27:11.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.611+0000 7fb58affd700 1 --2- 172.21.15.134:0/2302553820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58c101e40 0x7fb58c1128b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:27:11.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.612+0000 7fb5827fc700 1 --2- 172.21.15.134:0/2302553820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb58c1027e0 0x7fb58c112df0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb574010d50 tx=0x7fb57400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:11.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.612+0000 7fb583fff700 1 -- 172.21.15.134:0/2302553820 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb57400ed60 con 0x7fb58c1027e0 2024-02-16T22:27:11.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.612+0000 7fb5914e1700 1 -- 172.21.15.134:0/2302553820 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58c10c9f0 con 0x7fb58c1027e0 2024-02-16T22:27:11.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.612+0000 7fb583fff700 1 -- 172.21.15.134:0/2302553820 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5740090d0 con 0x7fb58c1027e0 2024-02-16T22:27:11.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.612+0000 7fb583fff700 1 -- 172.21.15.134:0/2302553820 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb574012670 con 0x7fb58c1027e0 2024-02-16T22:27:11.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.612+0000 7fb5914e1700 1 -- 172.21.15.134:0/2302553820 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58c10cf30 con 0x7fb58c1027e0 2024-02-16T22:27:11.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.613+0000 7fb5914e1700 1 -- 172.21.15.134:0/2302553820 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58c0738b0 con 0x7fb58c1027e0 2024-02-16T22:27:11.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.613+0000 7fb583fff700 1 -- 172.21.15.134:0/2302553820 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fb574018030 con 0x7fb58c1027e0 2024-02-16T22:27:11.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.614+0000 7fb583fff700 1 --2- 172.21.15.134:0/2302553820 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb57806d7e0 0x7fb57806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:11.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.614+0000 7fb58affd700 1 --2- 172.21.15.134:0/2302553820 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb57806d7e0 0x7fb57806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:11.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.614+0000 7fb583fff700 1 -- 172.21.15.134:0/2302553820 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb574016070 con 0x7fb58c1027e0 2024-02-16T22:27:11.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.614+0000 7fb58affd700 1 --2- 172.21.15.134:0/2302553820 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb57806d7e0 0x7fb57806fc90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00b0d0 tx=0x7fb57c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:11.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.619+0000 7fb583fff700 1 -- 172.21.15.134:0/2302553820 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb57405c6b0 con 0x7fb58c1027e0 2024-02-16T22:27:11.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.822+0000 7fb5914e1700 1 -- 172.21.15.134:0/2302553820 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb58c10d150 con 0x7fb57806d7e0 2024-02-16T22:27:11.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.832+0000 7fb583fff700 1 -- 172.21.15.134:0/2302553820 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb58c10d150 con 0x7fb57806d7e0 2024-02-16T22:27:11.834 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:27:11.835 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (5m) 54s ago 16m 26.5M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:27:11.835 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (2m) 54s ago 16m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 429739bfee94 2024-02-16T22:27:11.835 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (2m) 21s ago 15m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 1e81cd2fd510 2024-02-16T22:27:11.835 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (4m) 54s ago 15m 87.0M - 9.4.12 a0ea5e3c46d9 29d29cf667e7 2024-02-16T22:27:11.835 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (10m) 54s ago 10m 14.3M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:27:11.835 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (10m) 54s ago 10m 125M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:27:11.835 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (10m) 21s ago 10m 17.5M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:27:11.835 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (10m) 21s ago 10m 118M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:27:11.835 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (6m) 54s ago 17m 503M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:27:11.836 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (5m) 21s ago 15m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:27:11.836 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (3m) 54s ago 17m 46.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2903b3988442 2024-02-16T22:27:11.836 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (3m) 21s ago 15m 40.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a dd7cf2f31226 2024-02-16T22:27:11.836 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 54s ago 16m 16.4M - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:27:11.836 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (5m) 21s ago 15m 15.2M - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:27:11.836 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (2m) 54s ago 14m 91.9M 1557M 19.0.0-1450-gf78a58c0 f081f847070a d0153b47ae7e 2024-02-16T22:27:11.836 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (96s) 54s ago 13m 91.4M 1557M 19.0.0-1450-gf78a58c0 f081f847070a dd1faac850b0 2024-02-16T22:27:11.836 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (59s) 54s ago 13m 12.6M 1557M 19.0.0-1450-gf78a58c0 f081f847070a 0e349c665c73 2024-02-16T22:27:11.836 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (24s) 21s ago 12m 15.1M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 1f4624a5418b 2024-02-16T22:27:11.836 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (12m) 21s ago 12m 238M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 d510aa5563f6 2024-02-16T22:27:11.836 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (12m) 21s ago 12m 233M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:27:11.837 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 54s ago 15m 61.6M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:27:11.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.834+0000 7fb5914e1700 1 -- 172.21.15.134:0/2302553820 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb57806d7e0 msgr2=0x7fb57806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:11.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.834+0000 7fb5914e1700 1 --2- 172.21.15.134:0/2302553820 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb57806d7e0 0x7fb57806fc90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00b0d0 tx=0x7fb57c009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:11.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.834+0000 7fb5914e1700 1 -- 172.21.15.134:0/2302553820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb58c1027e0 msgr2=0x7fb58c112df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:11.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.834+0000 7fb5914e1700 1 --2- 172.21.15.134:0/2302553820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb58c1027e0 0x7fb58c112df0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb574010d50 tx=0x7fb57400b040 comp rx=0 tx=0).stop 2024-02-16T22:27:11.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.834+0000 7fb5914e1700 1 -- 172.21.15.134:0/2302553820 shutdown_connections 2024-02-16T22:27:11.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.834+0000 7fb5914e1700 1 --2- 172.21.15.134:0/2302553820 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb57806d7e0 0x7fb57806fc90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.834+0000 7fb5914e1700 1 --2- 172.21.15.134:0/2302553820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58c101e40 0x7fb58c1128b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.834+0000 7fb5914e1700 1 --2- 172.21.15.134:0/2302553820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb58c1027e0 0x7fb58c112df0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.834+0000 7fb5914e1700 1 -- 172.21.15.134:0/2302553820 >> 172.21.15.134:0/2302553820 conn(0x7fb58c071d90 msgr2=0x7fb58c0facb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:11.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.834+0000 7fb5914e1700 1 -- 172.21.15.134:0/2302553820 shutdown_connections 2024-02-16T22:27:11.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.834+0000 7fb5914e1700 1 -- 172.21.15.134:0/2302553820 wait complete. 2024-02-16T22:27:11.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.935+0000 7f873ee64700 1 -- 172.21.15.134:0/3091673660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87380fc6e0 msgr2=0x7f8738100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:11.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.935+0000 7f873ee64700 1 --2- 172.21.15.134:0/3091673660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87380fc6e0 0x7f8738100e20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8724004940 tx=0x7f8724009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:11.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.935+0000 7f873ee64700 1 -- 172.21.15.134:0/3091673660 shutdown_connections 2024-02-16T22:27:11.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.935+0000 7f873ee64700 1 --2- 172.21.15.134:0/3091673660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87380fc6e0 0x7f8738100e20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.935+0000 7f873ee64700 1 --2- 172.21.15.134:0/3091673660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87380fbdd0 0x7f87380fc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.935+0000 7f873ee64700 1 -- 172.21.15.134:0/3091673660 >> 172.21.15.134:0/3091673660 conn(0x7f8738071d90 msgr2=0x7f8738072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:11.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.935+0000 7f873ee64700 1 -- 172.21.15.134:0/3091673660 shutdown_connections 2024-02-16T22:27:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.935+0000 7f873ee64700 1 -- 172.21.15.134:0/3091673660 wait complete. 2024-02-16T22:27:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.936+0000 7f873ee64700 1 Processor -- start 2024-02-16T22:27:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.936+0000 7f873ee64700 1 -- start start 2024-02-16T22:27:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.936+0000 7f873ee64700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87380fbdd0 0x7f873811a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.936+0000 7f873ee64700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87380fc6e0 0x7f873811a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.936+0000 7f873ee64700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873811aca0 con 0x7f87380fc6e0 2024-02-16T22:27:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.936+0000 7f873ee64700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8738113fb0 con 0x7f87380fbdd0 2024-02-16T22:27:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.936+0000 7f8737fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87380fc6e0 0x7f873811a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.936+0000 7f8737fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87380fc6e0 0x7f873811a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52214/0 (socket says 172.21.15.134:52214) 2024-02-16T22:27:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.936+0000 7f8737fff700 1 -- 172.21.15.134:0/1768136858 learned_addr learned my addr 172.21.15.134:0/1768136858 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:27:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.936+0000 7f873cc00700 1 --2- 172.21.15.134:0/1768136858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87380fbdd0 0x7f873811a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.936+0000 7f8737fff700 1 -- 172.21.15.134:0/1768136858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87380fbdd0 msgr2=0x7f873811a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.936+0000 7f8737fff700 1 --2- 172.21.15.134:0/1768136858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87380fbdd0 0x7f873811a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.937+0000 7f8737fff700 1 -- 172.21.15.134:0/1768136858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8724005040 con 0x7f87380fc6e0 2024-02-16T22:27:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.937+0000 7f8737fff700 1 --2- 172.21.15.134:0/1768136858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87380fc6e0 0x7f873811a650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f872400b3b0 tx=0x7f8724009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.937+0000 7f87357fa700 1 -- 172.21.15.134:0/1768136858 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f872400e040 con 0x7f87380fc6e0 2024-02-16T22:27:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.937+0000 7f87357fa700 1 -- 172.21.15.134:0/1768136858 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f872400bbf0 con 0x7f87380fc6e0 2024-02-16T22:27:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.937+0000 7f87357fa700 1 -- 172.21.15.134:0/1768136858 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f872401c3f0 con 0x7f87380fc6e0 2024-02-16T22:27:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.937+0000 7f873ee64700 1 -- 172.21.15.134:0/1768136858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8738114230 con 0x7f87380fc6e0 2024-02-16T22:27:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.937+0000 7f873ee64700 1 -- 172.21.15.134:0/1768136858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8738114770 con 0x7f87380fc6e0 2024-02-16T22:27:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.938+0000 7f873ee64700 1 -- 172.21.15.134:0/1768136858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87380fe540 con 0x7f87380fc6e0 2024-02-16T22:27:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.939+0000 7f87357fa700 1 -- 172.21.15.134:0/1768136858 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f872400bd60 con 0x7f87380fc6e0 2024-02-16T22:27:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.939+0000 7f87357fa700 1 --2- 172.21.15.134:0/1768136858 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f872806d7e0 0x7f872806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.939+0000 7f87357fa700 1 -- 172.21.15.134:0/1768136858 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f872408e1d0 con 0x7f87380fc6e0 2024-02-16T22:27:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.939+0000 7f873cc00700 1 --2- 172.21.15.134:0/1768136858 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f872806d7e0 0x7f872806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:11.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.939+0000 7f873cc00700 1 --2- 172.21.15.134:0/1768136858 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f872806d7e0 0x7f872806fc90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f872c004f60 tx=0x7f872c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:11.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:11.944+0000 7f87357fa700 1 -- 172.21.15.134:0/1768136858 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f872405b620 con 0x7f87380fc6e0 2024-02-16T22:27:12.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:12 smithi134 ceph-mon[112514]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-16T22:27:12.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:12 smithi134 ceph-mon[112514]: Upgrade: osd.4 is safe to restart 2024-02-16T22:27:12.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:12 smithi134 ceph-mon[112514]: pgmap v130: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:12.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:12 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:12.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:12 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-16T22:27:12.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:12 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:27:12.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.227+0000 7f873ee64700 1 -- 172.21.15.134:0/1768136858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f87380738b0 con 0x7f87380fc6e0 2024-02-16T22:27:12.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.228+0000 7f87357fa700 1 -- 172.21.15.134:0/1768136858 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f872405b1b0 con 0x7f87380fc6e0 2024-02-16T22:27:12.230 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:27:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:27:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:27:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:27:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:27:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:27:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:27:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:27:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 2, 2024-02-16T22:27:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-16T22:27:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:27:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:27:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:27:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:27:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:27:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 6, 2024-02-16T22:27:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 8 2024-02-16T22:27:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:27:12.231 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:27:12.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.230+0000 7f873ee64700 1 -- 172.21.15.134:0/1768136858 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f872806d7e0 msgr2=0x7f872806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:12.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.230+0000 7f873ee64700 1 --2- 172.21.15.134:0/1768136858 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f872806d7e0 0x7f872806fc90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f872c004f60 tx=0x7f872c00b040 comp rx=0 tx=0).stop 2024-02-16T22:27:12.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.230+0000 7f873ee64700 1 -- 172.21.15.134:0/1768136858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87380fc6e0 msgr2=0x7f873811a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:12.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.230+0000 7f873ee64700 1 --2- 172.21.15.134:0/1768136858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87380fc6e0 0x7f873811a650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f872400b3b0 tx=0x7f8724009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:12.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.230+0000 7f873ee64700 1 -- 172.21.15.134:0/1768136858 shutdown_connections 2024-02-16T22:27:12.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.230+0000 7f873ee64700 1 --2- 172.21.15.134:0/1768136858 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f872806d7e0 0x7f872806fc90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.230+0000 7f873ee64700 1 --2- 172.21.15.134:0/1768136858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87380fbdd0 0x7f873811a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.230+0000 7f873ee64700 1 --2- 172.21.15.134:0/1768136858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87380fc6e0 0x7f873811a650 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.230+0000 7f873ee64700 1 -- 172.21.15.134:0/1768136858 >> 172.21.15.134:0/1768136858 conn(0x7f8738071d90 msgr2=0x7f873810d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:12.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.230+0000 7f873ee64700 1 -- 172.21.15.134:0/1768136858 shutdown_connections 2024-02-16T22:27:12.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.230+0000 7f873ee64700 1 -- 172.21.15.134:0/1768136858 wait complete. 2024-02-16T22:27:12.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.333+0000 7f4fd725c700 1 -- 172.21.15.134:0/2084975956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fd0102f50 msgr2=0x7f4fd0103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:12.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.333+0000 7f4fd725c700 1 --2- 172.21.15.134:0/2084975956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fd0102f50 0x7f4fd0103320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009ce0 tx=0x7f4fcc004d10 comp rx=0 tx=0).stop 2024-02-16T22:27:12.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.333+0000 7f4fd725c700 1 -- 172.21.15.134:0/2084975956 shutdown_connections 2024-02-16T22:27:12.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.333+0000 7f4fd725c700 1 --2- 172.21.15.134:0/2084975956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fd01038f0 0x7f4fd00fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.333+0000 7f4fd725c700 1 --2- 172.21.15.134:0/2084975956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fd0102f50 0x7f4fd0103320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.333+0000 7f4fd725c700 1 -- 172.21.15.134:0/2084975956 >> 172.21.15.134:0/2084975956 conn(0x7f4fd00f8ae0 msgr2=0x7f4fd00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:12.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.333+0000 7f4fd725c700 1 -- 172.21.15.134:0/2084975956 shutdown_connections 2024-02-16T22:27:12.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.333+0000 7f4fd725c700 1 -- 172.21.15.134:0/2084975956 wait complete. 2024-02-16T22:27:12.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.333+0000 7f4fd725c700 1 Processor -- start 2024-02-16T22:27:12.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.334+0000 7f4fd725c700 1 -- start start 2024-02-16T22:27:12.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.334+0000 7f4fd725c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fd0102f50 0x7f4fd0113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:12.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.334+0000 7f4fd725c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fd01038f0 0x7f4fd0113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:12.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.334+0000 7f4fd725c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd01145f0 con 0x7f4fd01038f0 2024-02-16T22:27:12.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.334+0000 7f4fd725c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd010d920 con 0x7f4fd0102f50 2024-02-16T22:27:12.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.334+0000 7f4fc7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fd01038f0 0x7f4fd0113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:12.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.334+0000 7f4fc7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fd01038f0 0x7f4fd0113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52240/0 (socket says 172.21.15.134:52240) 2024-02-16T22:27:12.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.334+0000 7f4fc7fff700 1 -- 172.21.15.134:0/2766983027 learned_addr learned my addr 172.21.15.134:0/2766983027 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:27:12.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.334+0000 7f4fd4ff8700 1 --2- 172.21.15.134:0/2766983027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fd0102f50 0x7f4fd0113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:12.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.334+0000 7f4fc7fff700 1 -- 172.21.15.134:0/2766983027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fd0102f50 msgr2=0x7f4fd0113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.334+0000 7f4fc7fff700 1 --2- 172.21.15.134:0/2766983027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fd0102f50 0x7f4fd0113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.334+0000 7f4fc7fff700 1 -- 172.21.15.134:0/2766983027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc009940 con 0x7f4fd01038f0 2024-02-16T22:27:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.334+0000 7f4fc7fff700 1 --2- 172.21.15.134:0/2766983027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fd01038f0 0x7f4fd0113fa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000eb40 tx=0x7f4fc000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.335+0000 7f4fc57fa700 1 -- 172.21.15.134:0/2766983027 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fc0007cc0 con 0x7f4fd01038f0 2024-02-16T22:27:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.335+0000 7f4fd725c700 1 -- 172.21.15.134:0/2766983027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd010dba0 con 0x7f4fd01038f0 2024-02-16T22:27:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.335+0000 7f4fc57fa700 1 -- 172.21.15.134:0/2766983027 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4fc000f040 con 0x7f4fd01038f0 2024-02-16T22:27:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.335+0000 7f4fc57fa700 1 -- 172.21.15.134:0/2766983027 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fc000c9d0 con 0x7f4fd01038f0 2024-02-16T22:27:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.335+0000 7f4fd725c700 1 -- 172.21.15.134:0/2766983027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd010e0e0 con 0x7f4fd01038f0 2024-02-16T22:27:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.336+0000 7f4fd725c700 1 -- 172.21.15.134:0/2766983027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd0100260 con 0x7f4fd01038f0 2024-02-16T22:27:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.336+0000 7f4fc57fa700 1 -- 172.21.15.134:0/2766983027 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f4fc000cb30 con 0x7f4fd01038f0 2024-02-16T22:27:12.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.337+0000 7f4fc57fa700 1 --2- 172.21.15.134:0/2766983027 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4fb806d7e0 0x7f4fb806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:12.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.337+0000 7f4fc57fa700 1 -- 172.21.15.134:0/2766983027 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4fc008c770 con 0x7f4fd01038f0 2024-02-16T22:27:12.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.337+0000 7f4fd4ff8700 1 --2- 172.21.15.134:0/2766983027 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4fb806d7e0 0x7f4fb806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:12.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.337+0000 7f4fd4ff8700 1 --2- 172.21.15.134:0/2766983027 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4fb806d7e0 0x7f4fb806fc90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00b460 tx=0x7f4fcc004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:12.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.341+0000 7f4fc57fa700 1 -- 172.21.15.134:0/2766983027 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4fc0059c70 con 0x7f4fd01038f0 2024-02-16T22:27:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:12 smithi173 ceph-mon[83703]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-16T22:27:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:12 smithi173 ceph-mon[83703]: Upgrade: osd.4 is safe to restart 2024-02-16T22:27:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:12 smithi173 ceph-mon[83703]: pgmap v130: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:12 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:12 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-16T22:27:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:12 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:27:12.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.578+0000 7f4fd725c700 1 -- 172.21.15.134:0/2766983027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4fd004bed0 con 0x7f4fd01038f0 2024-02-16T22:27:12.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.578+0000 7f4fc57fa700 1 -- 172.21.15.134:0/2766983027 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1860 (secure 0 0 0) 0x7f4fc005ee60 con 0x7f4fd01038f0 2024-02-16T22:27:12.580 INFO:teuthology.orchestra.run.smithi134.stdout:e20 2024-02-16T22:27:12.580 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:27:12.580 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:27:12.581 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-02-16T22:27:12.581 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:27:12.581 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-02-16T22:27:12.581 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-02-16T22:27:12.581 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 20 2024-02-16T22:27:12.581 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-16T22:27:12.581 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:27:12.581 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-02-16T22:23:22.543229+0000 2024-02-16T22:27:12.581 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-02-16T22:27:12.581 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-02-16T22:27:12.581 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-02-16T22:27:12.581 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-02-16T22:27:12.581 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-02-16T22:27:12.581 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 2 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:in 0,1 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14478,1=24269} 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-02-16T22:27:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-02-16T22:27:12.583 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-02-16T22:27:12.583 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.jyajef{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:27:12.583 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.qljqef{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:27:12.583 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:27:12.583 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:27:12.583 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-02-16T22:27:12.583 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:27:12.583 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.cygfxr{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2804816044,v1:172.21.15.134:6827/2804816044] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:27:12.583 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.phstvm{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:27:12.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.581+0000 7f4fd725c700 1 -- 172.21.15.134:0/2766983027 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4fb806d7e0 msgr2=0x7f4fb806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:12.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.581+0000 7f4fd725c700 1 --2- 172.21.15.134:0/2766983027 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4fb806d7e0 0x7f4fb806fc90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00b460 tx=0x7f4fcc004d10 comp rx=0 tx=0).stop 2024-02-16T22:27:12.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.581+0000 7f4fd725c700 1 -- 172.21.15.134:0/2766983027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fd01038f0 msgr2=0x7f4fd0113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:12.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.581+0000 7f4fd725c700 1 --2- 172.21.15.134:0/2766983027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fd01038f0 0x7f4fd0113fa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000eb40 tx=0x7f4fc000b040 comp rx=0 tx=0).stop 2024-02-16T22:27:12.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.582+0000 7f4fd725c700 1 -- 172.21.15.134:0/2766983027 shutdown_connections 2024-02-16T22:27:12.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.582+0000 7f4fd725c700 1 --2- 172.21.15.134:0/2766983027 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4fb806d7e0 0x7f4fb806fc90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.582+0000 7f4fd725c700 1 --2- 172.21.15.134:0/2766983027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fd0102f50 0x7f4fd0113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.582+0000 7f4fd725c700 1 --2- 172.21.15.134:0/2766983027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fd01038f0 0x7f4fd0113fa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.582+0000 7f4fd725c700 1 -- 172.21.15.134:0/2766983027 >> 172.21.15.134:0/2766983027 conn(0x7f4fd00f8ae0 msgr2=0x7f4fd00fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:12.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.582+0000 7f4fd725c700 1 -- 172.21.15.134:0/2766983027 shutdown_connections 2024-02-16T22:27:12.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.582+0000 7f4fd725c700 1 -- 172.21.15.134:0/2766983027 wait complete. 2024-02-16T22:27:12.585 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 20 2024-02-16T22:27:12.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.684+0000 7fec720eb700 1 -- 172.21.15.134:0/656134662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c0fe900 msgr2=0x7fec6c106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:12.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.684+0000 7fec720eb700 1 --2- 172.21.15.134:0/656134662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c0fe900 0x7fec6c106f40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fec54004940 tx=0x7fec54009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:12.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.684+0000 7fec720eb700 1 -- 172.21.15.134:0/656134662 shutdown_connections 2024-02-16T22:27:12.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.684+0000 7fec720eb700 1 --2- 172.21.15.134:0/656134662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c0fe900 0x7fec6c106f40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.684+0000 7fec720eb700 1 --2- 172.21.15.134:0/656134662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec6c0fdf60 0x7fec6c0fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.684+0000 7fec720eb700 1 -- 172.21.15.134:0/656134662 >> 172.21.15.134:0/656134662 conn(0x7fec6c0f7a10 msgr2=0x7fec6c0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:12.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.684+0000 7fec720eb700 1 -- 172.21.15.134:0/656134662 shutdown_connections 2024-02-16T22:27:12.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.684+0000 7fec720eb700 1 -- 172.21.15.134:0/656134662 wait complete. 2024-02-16T22:27:12.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.685+0000 7fec720eb700 1 Processor -- start 2024-02-16T22:27:12.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.685+0000 7fec720eb700 1 -- start start 2024-02-16T22:27:12.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.685+0000 7fec720eb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c0fdf60 0x7fec6c113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:12.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.685+0000 7fec720eb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec6c0fe900 0x7fec6c114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:12.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.685+0000 7fec720eb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c114730 con 0x7fec6c0fdf60 2024-02-16T22:27:12.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.685+0000 7fec720eb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c10d9d0 con 0x7fec6c0fe900 2024-02-16T22:27:12.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.685+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c0fdf60 0x7fec6c113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:12.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.685+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c0fdf60 0x7fec6c113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52266/0 (socket says 172.21.15.134:52266) 2024-02-16T22:27:12.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.685+0000 7fec6b7fe700 1 -- 172.21.15.134:0/2470051355 learned_addr learned my addr 172.21.15.134:0/2470051355 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:27:12.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.685+0000 7fec63fff700 1 --2- 172.21.15.134:0/2470051355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec6c0fe900 0x7fec6c114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:12.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.685+0000 7fec6b7fe700 1 -- 172.21.15.134:0/2470051355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec6c0fe900 msgr2=0x7fec6c114050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:12.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.685+0000 7fec6b7fe700 1 --2- 172.21.15.134:0/2470051355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec6c0fe900 0x7fec6c114050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.685+0000 7fec6b7fe700 1 -- 172.21.15.134:0/2470051355 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec54005040 con 0x7fec6c0fdf60 2024-02-16T22:27:12.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.685+0000 7fec6b7fe700 1 --2- 172.21.15.134:0/2470051355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c0fdf60 0x7fec6c113b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00b790 tx=0x7fec5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:12.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.686+0000 7fec68ff9700 1 -- 172.21.15.134:0/2470051355 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec5c00f770 con 0x7fec6c0fdf60 2024-02-16T22:27:12.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.686+0000 7fec68ff9700 1 -- 172.21.15.134:0/2470051355 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec5c00fda0 con 0x7fec6c0fdf60 2024-02-16T22:27:12.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.686+0000 7fec720eb700 1 -- 172.21.15.134:0/2470051355 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6c10dcb0 con 0x7fec6c0fdf60 2024-02-16T22:27:12.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.686+0000 7fec68ff9700 1 -- 172.21.15.134:0/2470051355 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec5c00d310 con 0x7fec6c0fdf60 2024-02-16T22:27:12.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.686+0000 7fec720eb700 1 -- 172.21.15.134:0/2470051355 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c10e1f0 con 0x7fec6c0fdf60 2024-02-16T22:27:12.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.687+0000 7fec720eb700 1 -- 172.21.15.134:0/2470051355 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6c104550 con 0x7fec6c0fdf60 2024-02-16T22:27:12.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.687+0000 7fec68ff9700 1 -- 172.21.15.134:0/2470051355 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fec5c010420 con 0x7fec6c0fdf60 2024-02-16T22:27:12.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.687+0000 7fec68ff9700 1 --2- 172.21.15.134:0/2470051355 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fec5806d7e0 0x7fec5806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:12.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.688+0000 7fec68ff9700 1 -- 172.21.15.134:0/2470051355 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fec5c08cdf0 con 0x7fec6c0fdf60 2024-02-16T22:27:12.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.688+0000 7fec63fff700 1 --2- 172.21.15.134:0/2470051355 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fec5806d7e0 0x7fec5806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:12.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.688+0000 7fec63fff700 1 --2- 172.21.15.134:0/2470051355 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fec5806d7e0 0x7fec5806fc90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fec6c10f340 tx=0x7fec54009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:12.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.692+0000 7fec68ff9700 1 -- 172.21.15.134:0/2470051355 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fec5c05a2e0 con 0x7fec6c0fdf60 2024-02-16T22:27:12.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.905+0000 7fec720eb700 1 -- 172.21.15.134:0/2470051355 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec6c04bed0 con 0x7fec5806d7e0 2024-02-16T22:27:12.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.906+0000 7fec68ff9700 1 -- 172.21.15.134:0/2470051355 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fec6c04bed0 con 0x7fec5806d7e0 2024-02-16T22:27:12.908 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:27:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:27:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:27:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-16T22:27:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-02-16T22:27:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-02-16T22:27:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-02-16T22:27:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-02-16T22:27:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-02-16T22:27:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "10/21 daemons upgraded", 2024-02-16T22:27:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-02-16T22:27:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:27:12.909 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:27:12.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.908+0000 7fec720eb700 1 -- 172.21.15.134:0/2470051355 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fec5806d7e0 msgr2=0x7fec5806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:12.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.908+0000 7fec720eb700 1 --2- 172.21.15.134:0/2470051355 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fec5806d7e0 0x7fec5806fc90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fec6c10f340 tx=0x7fec54009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:12.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.908+0000 7fec720eb700 1 -- 172.21.15.134:0/2470051355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c0fdf60 msgr2=0x7fec6c113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:12.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.908+0000 7fec720eb700 1 --2- 172.21.15.134:0/2470051355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c0fdf60 0x7fec6c113b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00b790 tx=0x7fec5c009250 comp rx=0 tx=0).stop 2024-02-16T22:27:12.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.908+0000 7fec720eb700 1 -- 172.21.15.134:0/2470051355 shutdown_connections 2024-02-16T22:27:12.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.908+0000 7fec720eb700 1 --2- 172.21.15.134:0/2470051355 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fec5806d7e0 0x7fec5806fc90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.908+0000 7fec720eb700 1 --2- 172.21.15.134:0/2470051355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c0fdf60 0x7fec6c113b10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.908+0000 7fec720eb700 1 --2- 172.21.15.134:0/2470051355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec6c0fe900 0x7fec6c114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:12.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.908+0000 7fec720eb700 1 -- 172.21.15.134:0/2470051355 >> 172.21.15.134:0/2470051355 conn(0x7fec6c0f7a10 msgr2=0x7fec6c1016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:12.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.908+0000 7fec720eb700 1 -- 172.21.15.134:0/2470051355 shutdown_connections 2024-02-16T22:27:12.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:12.908+0000 7fec720eb700 1 -- 172.21.15.134:0/2470051355 wait complete. 2024-02-16T22:27:13.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.010+0000 7f045962c700 1 -- 172.21.15.134:0/338068443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04540fb560 msgr2=0x7f04540fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:13.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.010+0000 7f045962c700 1 --2- 172.21.15.134:0/338068443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04540fb560 0x7f04540fb9d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0444004940 tx=0x7f0444009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:13.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.010+0000 7f045962c700 1 -- 172.21.15.134:0/338068443 shutdown_connections 2024-02-16T22:27:13.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.010+0000 7f045962c700 1 --2- 172.21.15.134:0/338068443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04540fb560 0x7f04540fb9d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:13.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.010+0000 7f045962c700 1 --2- 172.21.15.134:0/338068443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0454102fe0 0x7f04541033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:13.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.010+0000 7f045962c700 1 -- 172.21.15.134:0/338068443 >> 172.21.15.134:0/338068443 conn(0x7f0454071500 msgr2=0x7f0454071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:13.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.010+0000 7f045962c700 1 -- 172.21.15.134:0/338068443 shutdown_connections 2024-02-16T22:27:13.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.010+0000 7f045962c700 1 -- 172.21.15.134:0/338068443 wait complete. 2024-02-16T22:27:13.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.010+0000 7f045962c700 1 Processor -- start 2024-02-16T22:27:13.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.011+0000 7f045962c700 1 -- start start 2024-02-16T22:27:13.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.011+0000 7f045962c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04540fb560 0x7f0454113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:13.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.011+0000 7f045962c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0454102fe0 0x7f0454113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:13.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.011+0000 7f045962c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0454114630 con 0x7f0454102fe0 2024-02-16T22:27:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.011+0000 7f045962c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045410d960 con 0x7f04540fb560 2024-02-16T22:27:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.011+0000 7f04527fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0454102fe0 0x7f0454113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.011+0000 7f0452ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04540fb560 0x7f0454113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.011+0000 7f04527fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0454102fe0 0x7f0454113fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52288/0 (socket says 172.21.15.134:52288) 2024-02-16T22:27:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.011+0000 7f0452ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04540fb560 0x7f0454113aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.134:59926/0 (socket says 172.21.15.134:59926) 2024-02-16T22:27:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.011+0000 7f04527fc700 1 -- 172.21.15.134:0/2236352765 learned_addr learned my addr 172.21.15.134:0/2236352765 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:27:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.011+0000 7f04527fc700 1 -- 172.21.15.134:0/2236352765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04540fb560 msgr2=0x7f0454113aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.011+0000 7f04527fc700 1 --2- 172.21.15.134:0/2236352765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04540fb560 0x7f0454113aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.011+0000 7f04527fc700 1 -- 172.21.15.134:0/2236352765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0444005040 con 0x7f0454102fe0 2024-02-16T22:27:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.011+0000 7f04527fc700 1 --2- 172.21.15.134:0/2236352765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0454102fe0 0x7f0454113fe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0444009100 tx=0x7f0444009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.012+0000 7f043b7fe700 1 -- 172.21.15.134:0/2236352765 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f044400e040 con 0x7f0454102fe0 2024-02-16T22:27:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.012+0000 7f043b7fe700 1 -- 172.21.15.134:0/2236352765 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0444013420 con 0x7f0454102fe0 2024-02-16T22:27:13.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.012+0000 7f045962c700 1 -- 172.21.15.134:0/2236352765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045410dbe0 con 0x7f0454102fe0 2024-02-16T22:27:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.012+0000 7f043b7fe700 1 -- 172.21.15.134:0/2236352765 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f044400bee0 con 0x7f0454102fe0 2024-02-16T22:27:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.012+0000 7f045962c700 1 -- 172.21.15.134:0/2236352765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045410e120 con 0x7f0454102fe0 2024-02-16T22:27:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.013+0000 7f045962c700 1 -- 172.21.15.134:0/2236352765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04541053c0 con 0x7f0454102fe0 2024-02-16T22:27:13.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.013+0000 7f043b7fe700 1 -- 172.21.15.134:0/2236352765 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f044400ba10 con 0x7f0454102fe0 2024-02-16T22:27:13.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.014+0000 7f043b7fe700 1 --2- 172.21.15.134:0/2236352765 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f043c06d7e0 0x7f043c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:13.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.014+0000 7f043b7fe700 1 -- 172.21.15.134:0/2236352765 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f044408e180 con 0x7f0454102fe0 2024-02-16T22:27:13.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.014+0000 7f0452ffd700 1 --2- 172.21.15.134:0/2236352765 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f043c06d7e0 0x7f043c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:13.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.014+0000 7f0452ffd700 1 --2- 172.21.15.134:0/2236352765 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f043c06d7e0 0x7f043c06fc90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04540658f0 tx=0x7f044800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.018+0000 7f043b7fe700 1 -- 172.21.15.134:0/2236352765 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f044405b5d0 con 0x7f0454102fe0 2024-02-16T22:27:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:13 smithi134 ceph-mon[112514]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:13 smithi134 ceph-mon[112514]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:13 smithi134 ceph-mon[112514]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:13 smithi134 ceph-mon[112514]: Upgrade: Updating osd.4 2024-02-16T22:27:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:13 smithi134 ceph-mon[112514]: Deploying daemon osd.4 on smithi173 2024-02-16T22:27:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:13 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1768136858' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:27:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:13 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2766983027' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:27:13.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.296+0000 7f045962c700 1 -- 172.21.15.134:0/2236352765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f045410a130 con 0x7f0454102fe0 2024-02-16T22:27:13.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.296+0000 7f043b7fe700 1 -- 172.21.15.134:0/2236352765 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f044405b160 con 0x7f0454102fe0 2024-02-16T22:27:13.299 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-02-16T22:27:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.298+0000 7f045962c700 1 -- 172.21.15.134:0/2236352765 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f043c06d7e0 msgr2=0x7f043c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.298+0000 7f045962c700 1 --2- 172.21.15.134:0/2236352765 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f043c06d7e0 0x7f043c06fc90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04540658f0 tx=0x7f044800b040 comp rx=0 tx=0).stop 2024-02-16T22:27:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.299+0000 7f045962c700 1 -- 172.21.15.134:0/2236352765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0454102fe0 msgr2=0x7f0454113fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.299+0000 7f045962c700 1 --2- 172.21.15.134:0/2236352765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0454102fe0 0x7f0454113fe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0444009100 tx=0x7f0444009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.299+0000 7f045962c700 1 -- 172.21.15.134:0/2236352765 shutdown_connections 2024-02-16T22:27:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.299+0000 7f045962c700 1 --2- 172.21.15.134:0/2236352765 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f043c06d7e0 0x7f043c06fc90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.299+0000 7f045962c700 1 --2- 172.21.15.134:0/2236352765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04540fb560 0x7f0454113aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.299+0000 7f045962c700 1 --2- 172.21.15.134:0/2236352765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0454102fe0 0x7f0454113fe0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.299+0000 7f045962c700 1 -- 172.21.15.134:0/2236352765 >> 172.21.15.134:0/2236352765 conn(0x7f0454071500 msgr2=0x7f04540fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.299+0000 7f045962c700 1 -- 172.21.15.134:0/2236352765 shutdown_connections 2024-02-16T22:27:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:13.299+0000 7f045962c700 1 -- 172.21.15.134:0/2236352765 wait complete. 2024-02-16T22:27:13.377 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:13 smithi173 ceph-mon[83703]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:13.378 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:13 smithi173 ceph-mon[83703]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:13.378 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:13 smithi173 ceph-mon[83703]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:13.378 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:13 smithi173 ceph-mon[83703]: Upgrade: Updating osd.4 2024-02-16T22:27:13.378 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:13 smithi173 ceph-mon[83703]: Deploying daemon osd.4 on smithi173 2024-02-16T22:27:13.378 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:13 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1768136858' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:27:13.378 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:13 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2766983027' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:27:14.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:14 smithi173 ceph-mon[83703]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:14.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:14 smithi173 ceph-mon[83703]: pgmap v131: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:14.406 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:14 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2236352765' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:27:14.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:14 smithi134 ceph-mon[112514]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:14.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:14 smithi134 ceph-mon[112514]: pgmap v131: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:14.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:14 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2236352765' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:27:15.407 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:15 smithi173 systemd[1]: Stopping Ceph osd.4 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:27:15.731 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:15 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[49320]: 2024-02-16T22:27:15.404+0000 7fd0e6874700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:27:15.731 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:15 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[49320]: 2024-02-16T22:27:15.404+0000 7fd0e6874700 -1 osd.4 69 *** Got signal Terminated *** 2024-02-16T22:27:15.731 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:15 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[49320]: 2024-02-16T22:27:15.404+0000 7fd0e6874700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-16T22:27:16.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:16 smithi134 ceph-mon[112514]: pgmap v132: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:16.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:16 smithi134 ceph-mon[112514]: osd.4 marked itself down and dead 2024-02-16T22:27:16.479 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:16 smithi173 ceph-mon[83703]: pgmap v132: 65 pgs: 65 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:16.479 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:16 smithi173 ceph-mon[83703]: osd.4 marked itself down and dead 2024-02-16T22:27:16.731 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:16 smithi173 podman[97833]: 2024-02-16 22:27:16.478366106 +0000 UTC m=+1.194567918 container died d510aa5563f6c5b2af33ef6f331b9af2ef764dd8150fded3a125e8e2f9c50f46 (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4, org.label-schema.build-date=20240214, RELEASE=quincy-b88fae6, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-02-16T22:27:17.091 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:16 smithi173 podman[97833]: 2024-02-16 22:27:16.863839199 +0000 UTC m=+1.580041017 container cleanup d510aa5563f6c5b2af33ef6f331b9af2ef764dd8150fded3a125e8e2f9c50f46 (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4, RELEASE=quincy-b88fae6, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-02-16T22:27:17.091 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:16 smithi173 bash[97833]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4 2024-02-16T22:27:17.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:17 smithi134 ceph-mon[112514]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-16T22:27:17.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:17 smithi134 ceph-mon[112514]: failed to encode map e70 with expected crc 2024-02-16T22:27:17.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:17 smithi134 ceph-mon[112514]: osdmap e70: 6 total, 5 up, 6 in 2024-02-16T22:27:17.412 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:17 smithi173 ceph-mon[83703]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-16T22:27:17.412 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:17 smithi173 ceph-mon[83703]: failed to encode map e70 with expected crc 2024-02-16T22:27:17.412 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:17 smithi173 ceph-mon[83703]: osdmap e70: 6 total, 5 up, 6 in 2024-02-16T22:27:17.413 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:17 smithi173 podman[97853]: 2024-02-16 22:27:17.090332692 +0000 UTC m=+0.612989335 container remove d510aa5563f6c5b2af33ef6f331b9af2ef764dd8150fded3a125e8e2f9c50f46 (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=quincy-b88fae6, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:27:17.695 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:17 smithi173 podman[97941]: 2024-02-16 22:27:17.314704635 +0000 UTC m=+0.017893465 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:27:17.695 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:17 smithi173 podman[97941]: 2024-02-16 22:27:17.433239497 +0000 UTC m=+0.136428324 container create 5582096c3f2540ff33767a2d24e218eb07fc331bb842065c70ec8386bad620f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214) 2024-02-16T22:27:17.695 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:17 smithi173 podman[97941]: 2024-02-16 22:27:17.694108884 +0000 UTC m=+0.397297712 container init 5582096c3f2540ff33767a2d24e218eb07fc331bb842065c70ec8386bad620f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-deactivate, ceph=True, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-16T22:27:17.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:17 smithi173 podman[97941]: 2024-02-16 22:27:17.69732905 +0000 UTC m=+0.400517880 container start 5582096c3f2540ff33767a2d24e218eb07fc331bb842065c70ec8386bad620f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True) 2024-02-16T22:27:17.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:17 smithi173 podman[97941]: 2024-02-16 22:27:17.777536657 +0000 UTC m=+0.480725500 container attach 5582096c3f2540ff33767a2d24e218eb07fc331bb842065c70ec8386bad620f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-deactivate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS) 2024-02-16T22:27:18.282 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:17 smithi173 podman[97941]: 2024-02-16 22:27:17.984252998 +0000 UTC m=+0.687441828 container died 5582096c3f2540ff33767a2d24e218eb07fc331bb842065c70ec8386bad620f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True) 2024-02-16T22:27:18.283 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:18 smithi173 ceph-mon[83703]: pgmap v134: 65 pgs: 6 stale+active+clean, 59 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:18.283 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:18 smithi173 ceph-mon[83703]: failed to encode map e71 with expected crc 2024-02-16T22:27:18.283 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:18 smithi173 ceph-mon[83703]: osdmap e71: 6 total, 5 up, 6 in 2024-02-16T22:27:18.283 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:18 smithi173 ceph-mon[83703]: failed to encode map e71 with expected crc 2024-02-16T22:27:18.283 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:18 smithi173 ceph-mon[83703]: failed to encode map e71 with expected crc 2024-02-16T22:27:18.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:18 smithi134 ceph-mon[112514]: pgmap v134: 65 pgs: 6 stale+active+clean, 59 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:18.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:18 smithi134 ceph-mon[112514]: failed to encode map e71 with expected crc 2024-02-16T22:27:18.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:18 smithi134 ceph-mon[112514]: osdmap e71: 6 total, 5 up, 6 in 2024-02-16T22:27:18.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:18 smithi134 ceph-mon[112514]: failed to encode map e71 with expected crc 2024-02-16T22:27:18.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:18 smithi134 ceph-mon[112514]: failed to encode map e71 with expected crc 2024-02-16T22:27:18.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:18 smithi173 podman[97967]: 2024-02-16 22:27:18.565123664 +0000 UTC m=+0.575601295 container remove 5582096c3f2540ff33767a2d24e218eb07fc331bb842065c70ec8386bad620f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-02-16T22:27:18.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:18 smithi173 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.4.service: Deactivated successfully. 2024-02-16T22:27:18.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:18 smithi173 systemd[1]: Stopped Ceph osd.4 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:27:18.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:18 smithi173 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.4.service: Consumed 59.074s CPU time. 2024-02-16T22:27:18.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:18 smithi173 systemd[1]: Starting Ceph osd.4 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:27:19.270 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:19 smithi173 ceph-mon[83703]: pgmap v136: 65 pgs: 6 active+undersized+degraded, 3 stale+active+clean, 9 active+undersized, 47 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 17/357 objects degraded (4.762%) 2024-02-16T22:27:19.270 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:19 smithi173 ceph-mon[83703]: Health check failed: Degraded data redundancy: 17/357 objects degraded (4.762%), 6 pgs degraded (PG_DEGRADED) 2024-02-16T22:27:19.270 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:18 smithi173 podman[98073]: 2024-02-16 22:27:18.982912539 +0000 UTC m=+0.098390493 container create 75047802718c6ddcc63e36d076bcb6df60397b5de43a06f16669e0fac440ea08 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-activate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-16T22:27:19.270 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 podman[98073]: 2024-02-16 22:27:18.902234709 +0000 UTC m=+0.017712661 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:27:19.270 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 podman[98073]: 2024-02-16 22:27:19.194723946 +0000 UTC m=+0.310201901 container init 75047802718c6ddcc63e36d076bcb6df60397b5de43a06f16669e0fac440ea08 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:27:19.270 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 podman[98073]: 2024-02-16 22:27:19.198025756 +0000 UTC m=+0.313503717 container start 75047802718c6ddcc63e36d076bcb6df60397b5de43a06f16669e0fac440ea08 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:27:19.270 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 podman[98073]: 2024-02-16 22:27:19.26899572 +0000 UTC m=+0.384473672 container attach 75047802718c6ddcc63e36d076bcb6df60397b5de43a06f16669e0fac440ea08 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-02-16T22:27:19.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:19 smithi134 ceph-mon[112514]: pgmap v136: 65 pgs: 6 active+undersized+degraded, 3 stale+active+clean, 9 active+undersized, 47 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 17/357 objects degraded (4.762%) 2024-02-16T22:27:19.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:19 smithi134 ceph-mon[112514]: Health check failed: Degraded data redundancy: 17/357 objects degraded (4.762%), 6 pgs degraded (PG_DEGRADED) 2024-02-16T22:27:19.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-activate[98087]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-16T22:27:19.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 bash[98073]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-16T22:27:19.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 bash[98073]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-16T22:27:19.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 bash[98073]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-16T22:27:19.982 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 bash[98073]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-16T22:27:19.982 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 bash[98073]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-16T22:27:19.982 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 bash[98073]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-16T22:27:19.982 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 bash[98073]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-16T22:27:19.982 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-activate[98087]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-16T22:27:19.982 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-activate[98087]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-16T22:27:19.982 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-activate[98087]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-16T22:27:19.983 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-activate[98087]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-16T22:27:19.983 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-activate[98087]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-16T22:27:19.983 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-activate[98087]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-16T22:27:19.983 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:19 smithi173 podman[98073]: 2024-02-16 22:27:19.663544424 +0000 UTC m=+0.779022368 container died 75047802718c6ddcc63e36d076bcb6df60397b5de43a06f16669e0fac440ea08 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:27:20.632 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:20 smithi173 podman[98222]: 2024-02-16 22:27:20.281724215 +0000 UTC m=+0.613035585 container remove 75047802718c6ddcc63e36d076bcb6df60397b5de43a06f16669e0fac440ea08 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:27:20.633 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:20 smithi173 podman[98282]: 2024-02-16 22:27:20.397409714 +0000 UTC m=+0.017978328 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:27:20.633 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:20 smithi173 podman[98282]: 2024-02-16 22:27:20.508174189 +0000 UTC m=+0.128742841 container create 640d021c13b09ed634bff3adfd54c9dedd6528e4cd1909471a972467c5a0ddbe (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True) 2024-02-16T22:27:20.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:20 smithi173 podman[98282]: 2024-02-16 22:27:20.744331572 +0000 UTC m=+0.364900190 container init 640d021c13b09ed634bff3adfd54c9dedd6528e4cd1909471a972467c5a0ddbe (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-02-16T22:27:20.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:20 smithi173 podman[98282]: 2024-02-16 22:27:20.747584544 +0000 UTC m=+0.368153159 container start 640d021c13b09ed634bff3adfd54c9dedd6528e4cd1909471a972467c5a0ddbe (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214) 2024-02-16T22:27:20.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:20 smithi173 ceph-osd[98302]: -- 172.21.15.173:0/3330645948 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557de9b7f1e0 con 0x557de9b50c00 2024-02-16T22:27:20.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:20 smithi173 bash[98282]: 640d021c13b09ed634bff3adfd54c9dedd6528e4cd1909471a972467c5a0ddbe 2024-02-16T22:27:20.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:20 smithi173 systemd[1]: Started Ceph osd.4 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:27:21.731 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:21 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:27:21.290+0000 7f377209f7c0 -1 Falling back to public interface 2024-02-16T22:27:21.999 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:21 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:21.999 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:21 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:21.999 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:21 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:27:21.999 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:21 smithi173 ceph-mon[83703]: pgmap v137: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/357 objects degraded (17.087%) 2024-02-16T22:27:22.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:21 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:22.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:21 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:22.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:21 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:27:22.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:21 smithi134 ceph-mon[112514]: pgmap v137: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/357 objects degraded (17.087%) 2024-02-16T22:27:23.407 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:23.407 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:27:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:27:24.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:24 smithi134 ceph-mon[112514]: pgmap v138: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/357 objects degraded (17.087%) 2024-02-16T22:27:24.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:24 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:24.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:24 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:24.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:24 smithi173 ceph-mon[83703]: pgmap v138: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/357 objects degraded (17.087%) 2024-02-16T22:27:24.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:24 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:24.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:24 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:25.966 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:25 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:27:25.883+0000 7f377209f7c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-02-16T22:27:26.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:25 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:26.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:25 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:26.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:25 smithi134 ceph-mon[112514]: pgmap v139: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/357 objects degraded (17.087%) 2024-02-16T22:27:26.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:25 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:26.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:25 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:26.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:25 smithi173 ceph-mon[83703]: pgmap v139: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/357 objects degraded (17.087%) 2024-02-16T22:27:26.657 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:26 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:27:26.394+0000 7f377209f7c0 -1 osd.4 69 log_to_monitors true 2024-02-16T22:27:27.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:26 smithi134 ceph-mon[112514]: from='osd.4 [v2:172.21.15.173:6808/787878754,v1:172.21.15.173:6809/787878754]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-16T22:27:27.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:26 smithi134 ceph-mon[112514]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-16T22:27:27.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:26 smithi173 ceph-mon[83703]: from='osd.4 [v2:172.21.15.173:6808/787878754,v1:172.21.15.173:6809/787878754]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-16T22:27:27.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:26 smithi173 ceph-mon[83703]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-16T22:27:28.133 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:27:27 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:27:27.831+0000 7f375f4ef700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T22:27:28.133 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:27 smithi173 ceph-mon[83703]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-16T22:27:28.133 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:27 smithi173 ceph-mon[83703]: failed to encode map e72 with expected crc 2024-02-16T22:27:28.133 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:27 smithi173 ceph-mon[83703]: osdmap e72: 6 total, 5 up, 6 in 2024-02-16T22:27:28.134 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:27 smithi173 ceph-mon[83703]: from='osd.4 [v2:172.21.15.173:6808/787878754,v1:172.21.15.173:6809/787878754]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:27:28.134 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:27 smithi173 ceph-mon[83703]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:27:28.134 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:27 smithi173 ceph-mon[83703]: pgmap v141: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61/357 objects degraded (17.087%) 2024-02-16T22:27:28.134 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:27 smithi173 ceph-mon[83703]: from='osd.4 ' entity='osd.4' 2024-02-16T22:27:28.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:27 smithi134 ceph-mon[112514]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-16T22:27:28.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:27 smithi134 ceph-mon[112514]: failed to encode map e72 with expected crc 2024-02-16T22:27:28.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:27 smithi134 ceph-mon[112514]: osdmap e72: 6 total, 5 up, 6 in 2024-02-16T22:27:28.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:27 smithi134 ceph-mon[112514]: from='osd.4 [v2:172.21.15.173:6808/787878754,v1:172.21.15.173:6809/787878754]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:27:28.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:27 smithi134 ceph-mon[112514]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:27:28.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:27 smithi134 ceph-mon[112514]: pgmap v141: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61/357 objects degraded (17.087%) 2024-02-16T22:27:28.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:27 smithi134 ceph-mon[112514]: from='osd.4 ' entity='osd.4' 2024-02-16T22:27:29.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: Health check update: Degraded data redundancy: 61/357 objects degraded (17.087%), 16 pgs degraded (PG_DEGRADED) 2024-02-16T22:27:29.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:29.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:29.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:27:29.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:27:29.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:29.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:27:29.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:27:29.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:27:29.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:27:29.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-16T22:27:29.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-16T22:27:29.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: osd.4 [v2:172.21.15.173:6808/787878754,v1:172.21.15.173:6809/787878754] boot 2024-02-16T22:27:29.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: osdmap e73: 6 total, 6 up, 6 in 2024-02-16T22:27:29.228 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:28 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:27:29.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: Health check update: Degraded data redundancy: 61/357 objects degraded (17.087%), 16 pgs degraded (PG_DEGRADED) 2024-02-16T22:27:29.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:29.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:29.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:27:29.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:27:29.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:29.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:27:29.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:27:29.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:27:29.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:27:29.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-16T22:27:29.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-16T22:27:29.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: osd.4 [v2:172.21.15.173:6808/787878754,v1:172.21.15.173:6809/787878754] boot 2024-02-16T22:27:29.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: osdmap e73: 6 total, 6 up, 6 in 2024-02-16T22:27:29.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:28 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-16T22:27:30.053 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:29 smithi173 ceph-mon[83703]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-16T22:27:30.053 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:29 smithi173 ceph-mon[83703]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-16T22:27:30.053 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:29 smithi173 ceph-mon[83703]: failed to encode map e73 with expected crc 2024-02-16T22:27:30.053 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:29 smithi173 ceph-mon[83703]: failed to encode map e73 with expected crc 2024-02-16T22:27:30.053 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:29 smithi173 ceph-mon[83703]: pgmap v143: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61/357 objects degraded (17.087%) 2024-02-16T22:27:30.053 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:29 smithi173 ceph-mon[83703]: osdmap e74: 6 total, 6 up, 6 in 2024-02-16T22:27:30.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:29 smithi134 ceph-mon[112514]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-16T22:27:30.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:29 smithi134 ceph-mon[112514]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-16T22:27:30.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:29 smithi134 ceph-mon[112514]: failed to encode map e73 with expected crc 2024-02-16T22:27:30.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:29 smithi134 ceph-mon[112514]: failed to encode map e73 with expected crc 2024-02-16T22:27:30.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:29 smithi134 ceph-mon[112514]: pgmap v143: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61/357 objects degraded (17.087%) 2024-02-16T22:27:30.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:29 smithi134 ceph-mon[112514]: osdmap e74: 6 total, 6 up, 6 in 2024-02-16T22:27:31.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:30 smithi173 ceph-mon[83703]: failed to encode map e74 with expected crc 2024-02-16T22:27:31.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:30 smithi173 ceph-mon[83703]: failed to encode map e74 with expected crc 2024-02-16T22:27:31.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:30 smithi173 ceph-mon[83703]: failed to encode map e74 with expected crc 2024-02-16T22:27:31.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:30 smithi134 ceph-mon[112514]: failed to encode map e74 with expected crc 2024-02-16T22:27:31.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:30 smithi134 ceph-mon[112514]: failed to encode map e74 with expected crc 2024-02-16T22:27:31.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:30 smithi134 ceph-mon[112514]: failed to encode map e74 with expected crc 2024-02-16T22:27:32.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:31 smithi134 ceph-mon[112514]: pgmap v145: 65 pgs: 10 peering, 8 active+undersized+degraded, 10 active+undersized, 37 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 22/357 objects degraded (6.162%) 2024-02-16T22:27:32.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:31 smithi173 ceph-mon[83703]: pgmap v145: 65 pgs: 10 peering, 8 active+undersized+degraded, 10 active+undersized, 37 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 22/357 objects degraded (6.162%) 2024-02-16T22:27:33.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:33 smithi134 ceph-mon[112514]: pgmap v146: 65 pgs: 10 peering, 1 active+undersized, 54 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:33.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:33 smithi134 ceph-mon[112514]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/357 objects degraded (6.162%), 8 pgs degraded) 2024-02-16T22:27:33.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:33 smithi134 ceph-mon[112514]: Cluster is now healthy 2024-02-16T22:27:33.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:33 smithi173 ceph-mon[83703]: pgmap v146: 65 pgs: 10 peering, 1 active+undersized, 54 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:33.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:33 smithi173 ceph-mon[83703]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/357 objects degraded (6.162%), 8 pgs degraded) 2024-02-16T22:27:33.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:33 smithi173 ceph-mon[83703]: Cluster is now healthy 2024-02-16T22:27:36.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:36 smithi134 ceph-mon[112514]: pgmap v147: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:36.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:36 smithi173 ceph-mon[83703]: pgmap v147: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:38.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:38 smithi134 ceph-mon[112514]: pgmap v148: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:38.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:38 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:38.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:38 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:27:38.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:38 smithi173 ceph-mon[83703]: pgmap v148: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:38.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:38 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:38.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:38 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:27:40.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:40 smithi134 ceph-mon[112514]: pgmap v149: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:40.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:40 smithi173 ceph-mon[83703]: pgmap v149: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:42.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:42 smithi134 ceph-mon[112514]: pgmap v150: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:42.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:42 smithi173 ceph-mon[83703]: pgmap v150: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:43.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.416+0000 7f76bbd07700 1 -- 172.21.15.134:0/2891754399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b41038f0 msgr2=0x7f76b40fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:43.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.416+0000 7f76bbd07700 1 --2- 172.21.15.134:0/2891754399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b41038f0 0x7f76b40fcf60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f76a8004940 tx=0x7f76a8009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:43.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:43 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.416+0000 7f76bbd07700 1 -- 172.21.15.134:0/2891754399 shutdown_connections 2024-02-16T22:27:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.416+0000 7f76bbd07700 1 --2- 172.21.15.134:0/2891754399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b41038f0 0x7f76b40fcf60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.416+0000 7f76bbd07700 1 --2- 172.21.15.134:0/2891754399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76b4102f50 0x7f76b4103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.416+0000 7f76bbd07700 1 -- 172.21.15.134:0/2891754399 >> 172.21.15.134:0/2891754399 conn(0x7f76b40f8ae0 msgr2=0x7f76b40faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.416+0000 7f76bbd07700 1 -- 172.21.15.134:0/2891754399 shutdown_connections 2024-02-16T22:27:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.416+0000 7f76bbd07700 1 -- 172.21.15.134:0/2891754399 wait complete. 2024-02-16T22:27:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.417+0000 7f76bbd07700 1 Processor -- start 2024-02-16T22:27:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.417+0000 7f76bbd07700 1 -- start start 2024-02-16T22:27:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.417+0000 7f76bbd07700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b4102f50 0x7f76b4113a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.417+0000 7f76bbd07700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76b41038f0 0x7f76b4113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.417+0000 7f76bbd07700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b41145a0 con 0x7f76b4102f50 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.417+0000 7f76bbd07700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b410d940 con 0x7f76b41038f0 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.417+0000 7f76b9aa3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b4102f50 0x7f76b4113a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.417+0000 7f76b9aa3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b4102f50 0x7f76b4113a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52084/0 (socket says 172.21.15.134:52084) 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.417+0000 7f76b9aa3700 1 -- 172.21.15.134:0/1834142219 learned_addr learned my addr 172.21.15.134:0/1834142219 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.417+0000 7f76b9aa3700 1 -- 172.21.15.134:0/1834142219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76b41038f0 msgr2=0x7f76b4113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.417+0000 7f76b9aa3700 1 --2- 172.21.15.134:0/1834142219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76b41038f0 0x7f76b4113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.417+0000 7f76b9aa3700 1 -- 172.21.15.134:0/1834142219 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a8005040 con 0x7f76b4102f50 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.417+0000 7f76b9aa3700 1 --2- 172.21.15.134:0/1834142219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b4102f50 0x7f76b4113a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76ac002a50 tx=0x7f76ac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.417+0000 7f76b27fc700 1 -- 172.21.15.134:0/1834142219 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76ac007cc0 con 0x7f76b4102f50 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.418+0000 7f76bbd07700 1 -- 172.21.15.134:0/1834142219 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b410dc20 con 0x7f76b4102f50 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.418+0000 7f76b27fc700 1 -- 172.21.15.134:0/1834142219 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f76ac00f040 con 0x7f76b4102f50 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.418+0000 7f76b27fc700 1 -- 172.21.15.134:0/1834142219 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76ac009640 con 0x7f76b4102f50 2024-02-16T22:27:43.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.418+0000 7f76bbd07700 1 -- 172.21.15.134:0/1834142219 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b410e160 con 0x7f76b4102f50 2024-02-16T22:27:43.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.419+0000 7f76bbd07700 1 -- 172.21.15.134:0/1834142219 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b4105420 con 0x7f76b4102f50 2024-02-16T22:27:43.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.419+0000 7f76b27fc700 1 -- 172.21.15.134:0/1834142219 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f76ac0097a0 con 0x7f76b4102f50 2024-02-16T22:27:43.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.419+0000 7f76b27fc700 1 --2- 172.21.15.134:0/1834142219 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f769c06d7e0 0x7f769c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:43.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.420+0000 7f76b27fc700 1 -- 172.21.15.134:0/1834142219 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f76ac08cc40 con 0x7f76b4102f50 2024-02-16T22:27:43.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.420+0000 7f76b92a2700 1 --2- 172.21.15.134:0/1834142219 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f769c06d7e0 0x7f769c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:43.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.420+0000 7f76b92a2700 1 --2- 172.21.15.134:0/1834142219 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f769c06d7e0 0x7f769c06fc90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f76a800b3b0 tx=0x7f76a8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:43.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.424+0000 7f76b27fc700 1 -- 172.21.15.134:0/1834142219 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f76ac05a010 con 0x7f76b4102f50 2024-02-16T22:27:43.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:43 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:43.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.637+0000 7f76bbd07700 1 -- 172.21.15.134:0/1834142219 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76b410a0a0 con 0x7f769c06d7e0 2024-02-16T22:27:43.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.639+0000 7f76b27fc700 1 -- 172.21.15.134:0/1834142219 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f76b410a0a0 con 0x7f769c06d7e0 2024-02-16T22:27:43.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.641+0000 7f76bbd07700 1 -- 172.21.15.134:0/1834142219 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f769c06d7e0 msgr2=0x7f769c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:43.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.641+0000 7f76bbd07700 1 --2- 172.21.15.134:0/1834142219 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f769c06d7e0 0x7f769c06fc90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f76a800b3b0 tx=0x7f76a8009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.641+0000 7f76bbd07700 1 -- 172.21.15.134:0/1834142219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b4102f50 msgr2=0x7f76b4113a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.641+0000 7f76bbd07700 1 --2- 172.21.15.134:0/1834142219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b4102f50 0x7f76b4113a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76ac002a50 tx=0x7f76ac0046b0 comp rx=0 tx=0).stop 2024-02-16T22:27:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.641+0000 7f76bbd07700 1 -- 172.21.15.134:0/1834142219 shutdown_connections 2024-02-16T22:27:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.641+0000 7f76bbd07700 1 --2- 172.21.15.134:0/1834142219 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f769c06d7e0 0x7f769c06fc90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.641+0000 7f76bbd07700 1 --2- 172.21.15.134:0/1834142219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b4102f50 0x7f76b4113a10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.641+0000 7f76bbd07700 1 --2- 172.21.15.134:0/1834142219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76b41038f0 0x7f76b4113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.641+0000 7f76bbd07700 1 -- 172.21.15.134:0/1834142219 >> 172.21.15.134:0/1834142219 conn(0x7f76b40f8ae0 msgr2=0x7f76b40fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.641+0000 7f76bbd07700 1 -- 172.21.15.134:0/1834142219 shutdown_connections 2024-02-16T22:27:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.641+0000 7f76bbd07700 1 -- 172.21.15.134:0/1834142219 wait complete. 2024-02-16T22:27:43.653 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:27:43.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.742+0000 7f74352dd700 1 -- 172.21.15.134:0/2537365013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7430101e60 msgr2=0x7f7430102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:43.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.742+0000 7f74352dd700 1 --2- 172.21.15.134:0/2537365013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7430101e60 0x7f7430102230 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7420004940 tx=0x7f7420009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:43.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.742+0000 7f74352dd700 1 -- 172.21.15.134:0/2537365013 shutdown_connections 2024-02-16T22:27:43.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.742+0000 7f74352dd700 1 --2- 172.21.15.134:0/2537365013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7430102800 0x7f74300fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:43.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.742+0000 7f74352dd700 1 --2- 172.21.15.134:0/2537365013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7430101e60 0x7f7430102230 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:43.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.742+0000 7f74352dd700 1 -- 172.21.15.134:0/2537365013 >> 172.21.15.134:0/2537365013 conn(0x7f74300f7a10 msgr2=0x7f74300f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:43.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.742+0000 7f74352dd700 1 -- 172.21.15.134:0/2537365013 shutdown_connections 2024-02-16T22:27:43.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.742+0000 7f74352dd700 1 -- 172.21.15.134:0/2537365013 wait complete. 2024-02-16T22:27:43.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.743+0000 7f74352dd700 1 Processor -- start 2024-02-16T22:27:43.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.743+0000 7f74352dd700 1 -- start start 2024-02-16T22:27:43.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.743+0000 7f74352dd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7430101e60 0x7f743010ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:43.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.743+0000 7f74352dd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7430102800 0x7f743010f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:43.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.743+0000 7f74352dd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743010f6a0 con 0x7f7430101e60 2024-02-16T22:27:43.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.743+0000 7f74352dd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743010f810 con 0x7f7430102800 2024-02-16T22:27:43.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.743+0000 7f742effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7430101e60 0x7f743010ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:43.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.743+0000 7f742effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7430101e60 0x7f743010ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52102/0 (socket says 172.21.15.134:52102) 2024-02-16T22:27:43.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.743+0000 7f742effd700 1 -- 172.21.15.134:0/3951777601 learned_addr learned my addr 172.21.15.134:0/3951777601 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:27:43.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.744+0000 7f742e7fc700 1 --2- 172.21.15.134:0/3951777601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7430102800 0x7f743010f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:43.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.744+0000 7f742effd700 1 -- 172.21.15.134:0/3951777601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7430102800 msgr2=0x7f743010f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:43.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.744+0000 7f742effd700 1 --2- 172.21.15.134:0/3951777601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7430102800 0x7f743010f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:43.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.744+0000 7f742effd700 1 -- 172.21.15.134:0/3951777601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7420005040 con 0x7f7430101e60 2024-02-16T22:27:43.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.744+0000 7f742effd700 1 --2- 172.21.15.134:0/3951777601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7430101e60 0x7f743010ebb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f742000b3b0 tx=0x7f7420009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:43.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.744+0000 7f74177fe700 1 -- 172.21.15.134:0/3951777601 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f742000e040 con 0x7f7430101e60 2024-02-16T22:27:43.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.744+0000 7f74177fe700 1 -- 172.21.15.134:0/3951777601 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f742000bbf0 con 0x7f7430101e60 2024-02-16T22:27:43.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.744+0000 7f74352dd700 1 -- 172.21.15.134:0/3951777601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7430117b20 con 0x7f7430101e60 2024-02-16T22:27:43.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.744+0000 7f74177fe700 1 -- 172.21.15.134:0/3951777601 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f742001c3f0 con 0x7f7430101e60 2024-02-16T22:27:43.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.744+0000 7f74352dd700 1 -- 172.21.15.134:0/3951777601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7430118030 con 0x7f7430101e60 2024-02-16T22:27:43.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.745+0000 7f74352dd700 1 -- 172.21.15.134:0/3951777601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74300ff170 con 0x7f7430101e60 2024-02-16T22:27:43.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.746+0000 7f74177fe700 1 -- 172.21.15.134:0/3951777601 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f742000bd60 con 0x7f7430101e60 2024-02-16T22:27:43.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.746+0000 7f74177fe700 1 --2- 172.21.15.134:0/3951777601 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f741806d7e0 0x7f741806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:43.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.746+0000 7f74177fe700 1 -- 172.21.15.134:0/3951777601 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f742008e1d0 con 0x7f7430101e60 2024-02-16T22:27:43.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.746+0000 7f742e7fc700 1 --2- 172.21.15.134:0/3951777601 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f741806d7e0 0x7f741806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:43.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.746+0000 7f742e7fc700 1 --2- 172.21.15.134:0/3951777601 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f741806d7e0 0x7f741806fc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7430066a10 tx=0x7f742400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:43.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.751+0000 7f74177fe700 1 -- 172.21.15.134:0/3951777601 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7420057af0 con 0x7f7430101e60 2024-02-16T22:27:43.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.963+0000 7f74352dd700 1 -- 172.21.15.134:0/3951777601 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7430066750 con 0x7f741806d7e0 2024-02-16T22:27:43.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.964+0000 7f74177fe700 1 -- 172.21.15.134:0/3951777601 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f7430066750 con 0x7f741806d7e0 2024-02-16T22:27:43.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.966+0000 7f74352dd700 1 -- 172.21.15.134:0/3951777601 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f741806d7e0 msgr2=0x7f741806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:43.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.966+0000 7f74352dd700 1 --2- 172.21.15.134:0/3951777601 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f741806d7e0 0x7f741806fc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7430066a10 tx=0x7f742400b040 comp rx=0 tx=0).stop 2024-02-16T22:27:43.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.966+0000 7f74352dd700 1 -- 172.21.15.134:0/3951777601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7430101e60 msgr2=0x7f743010ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:43.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.966+0000 7f74352dd700 1 --2- 172.21.15.134:0/3951777601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7430101e60 0x7f743010ebb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f742000b3b0 tx=0x7f7420009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:43.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.966+0000 7f74352dd700 1 -- 172.21.15.134:0/3951777601 shutdown_connections 2024-02-16T22:27:43.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.966+0000 7f74352dd700 1 --2- 172.21.15.134:0/3951777601 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f741806d7e0 0x7f741806fc90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:43.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.966+0000 7f74352dd700 1 --2- 172.21.15.134:0/3951777601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7430101e60 0x7f743010ebb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:43.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.966+0000 7f74352dd700 1 --2- 172.21.15.134:0/3951777601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7430102800 0x7f743010f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:43.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.966+0000 7f74352dd700 1 -- 172.21.15.134:0/3951777601 >> 172.21.15.134:0/3951777601 conn(0x7f74300f7a10 msgr2=0x7f74300f9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:43.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.966+0000 7f74352dd700 1 -- 172.21.15.134:0/3951777601 shutdown_connections 2024-02-16T22:27:43.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:43.966+0000 7f74352dd700 1 -- 172.21.15.134:0/3951777601 wait complete. 2024-02-16T22:27:44.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.066+0000 7f2043b00700 1 -- 172.21.15.134:0/2948738225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c102f50 msgr2=0x7f203c103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:44.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.066+0000 7f2043b00700 1 --2- 172.21.15.134:0/2948738225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c102f50 0x7f203c103320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2038004940 tx=0x7f2038009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:44.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.066+0000 7f2043b00700 1 -- 172.21.15.134:0/2948738225 shutdown_connections 2024-02-16T22:27:44.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.066+0000 7f2043b00700 1 --2- 172.21.15.134:0/2948738225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f203c1038f0 0x7f203c0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.066+0000 7f2043b00700 1 --2- 172.21.15.134:0/2948738225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c102f50 0x7f203c103320 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.066+0000 7f2043b00700 1 -- 172.21.15.134:0/2948738225 >> 172.21.15.134:0/2948738225 conn(0x7f203c0f8ae0 msgr2=0x7f203c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:44.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.066+0000 7f2043b00700 1 -- 172.21.15.134:0/2948738225 shutdown_connections 2024-02-16T22:27:44.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.066+0000 7f2043b00700 1 -- 172.21.15.134:0/2948738225 wait complete. 2024-02-16T22:27:44.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.067+0000 7f2043b00700 1 Processor -- start 2024-02-16T22:27:44.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.067+0000 7f2043b00700 1 -- start start 2024-02-16T22:27:44.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.067+0000 7f2043b00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c102f50 0x7f203c113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:44.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.067+0000 7f2043b00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f203c1038f0 0x7f203c113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:44.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.067+0000 7f2043b00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c1145f0 con 0x7f203c102f50 2024-02-16T22:27:44.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.067+0000 7f2043b00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c10d920 con 0x7f203c1038f0 2024-02-16T22:27:44.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.068+0000 7f204189c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c102f50 0x7f203c113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:44.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.068+0000 7f204189c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c102f50 0x7f203c113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52114/0 (socket says 172.21.15.134:52114) 2024-02-16T22:27:44.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.068+0000 7f204109b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f203c1038f0 0x7f203c113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:44.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.068+0000 7f204189c700 1 -- 172.21.15.134:0/506495944 learned_addr learned my addr 172.21.15.134:0/506495944 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:27:44.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.068+0000 7f204189c700 1 -- 172.21.15.134:0/506495944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f203c1038f0 msgr2=0x7f203c113fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:44.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.068+0000 7f204189c700 1 --2- 172.21.15.134:0/506495944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f203c1038f0 0x7f203c113fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.068+0000 7f204189c700 1 -- 172.21.15.134:0/506495944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038005040 con 0x7f203c102f50 2024-02-16T22:27:44.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.068+0000 7f204189c700 1 --2- 172.21.15.134:0/506495944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c102f50 0x7f203c113a60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2038009100 tx=0x7f2038009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:44.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.068+0000 7f20327fc700 1 -- 172.21.15.134:0/506495944 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f203800e040 con 0x7f203c102f50 2024-02-16T22:27:44.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.068+0000 7f2043b00700 1 -- 172.21.15.134:0/506495944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c10dba0 con 0x7f203c102f50 2024-02-16T22:27:44.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.068+0000 7f2043b00700 1 -- 172.21.15.134:0/506495944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c10e0e0 con 0x7f203c102f50 2024-02-16T22:27:44.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.068+0000 7f20327fc700 1 -- 172.21.15.134:0/506495944 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2038013420 con 0x7f203c102f50 2024-02-16T22:27:44.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.068+0000 7f20327fc700 1 -- 172.21.15.134:0/506495944 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f203800bee0 con 0x7f203c102f50 2024-02-16T22:27:44.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.069+0000 7f2043b00700 1 -- 172.21.15.134:0/506495944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203c100260 con 0x7f203c102f50 2024-02-16T22:27:44.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.070+0000 7f20327fc700 1 -- 172.21.15.134:0/506495944 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f203800ba10 con 0x7f203c102f50 2024-02-16T22:27:44.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.070+0000 7f20327fc700 1 --2- 172.21.15.134:0/506495944 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f202806d7e0 0x7f202806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:44.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.070+0000 7f20327fc700 1 -- 172.21.15.134:0/506495944 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f203808e170 con 0x7f203c102f50 2024-02-16T22:27:44.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.070+0000 7f204109b700 1 --2- 172.21.15.134:0/506495944 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f202806d7e0 0x7f202806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:44.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.071+0000 7f204109b700 1 --2- 172.21.15.134:0/506495944 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f202806d7e0 0x7f202806fc90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f203c10f290 tx=0x7f202c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:44.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.075+0000 7f20327fc700 1 -- 172.21.15.134:0/506495944 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f203805b5c0 con 0x7f203c102f50 2024-02-16T22:27:44.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.282+0000 7f2043b00700 1 -- 172.21.15.134:0/506495944 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f203c04bed0 con 0x7f202806d7e0 2024-02-16T22:27:44.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.292+0000 7f20327fc700 1 -- 172.21.15.134:0/506495944 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f203c04bed0 con 0x7f202806d7e0 2024-02-16T22:27:44.294 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:27:44.294 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (5m) 86s ago 16m 26.5M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:27:44.294 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (3m) 86s ago 16m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 429739bfee94 2024-02-16T22:27:44.294 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (3m) 20s ago 15m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 1e81cd2fd510 2024-02-16T22:27:44.294 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (5m) 86s ago 16m 87.0M - 9.4.12 a0ea5e3c46d9 29d29cf667e7 2024-02-16T22:27:44.294 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (11m) 86s ago 11m 14.3M - 17.2.7-513-gb88fae66 870a0944ccb8 3c47d55778c5 2024-02-16T22:27:44.294 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (11m) 86s ago 11m 125M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:27:44.294 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (10m) 20s ago 10m 17.6M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:27:44.294 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (11m) 20s ago 11m 118M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:27:44.294 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (6m) 86s ago 18m 503M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:27:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (6m) 20s ago 15m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:27:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (4m) 86s ago 18m 46.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2903b3988442 2024-02-16T22:27:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (3m) 20s ago 15m 40.5M 2048M 19.0.0-1450-gf78a58c0 f081f847070a dd7cf2f31226 2024-02-16T22:27:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 86s ago 16m 16.4M - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:27:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (6m) 20s ago 15m 14.6M - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:27:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (2m) 86s ago 14m 91.9M 1557M 19.0.0-1450-gf78a58c0 f081f847070a d0153b47ae7e 2024-02-16T22:27:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (2m) 86s ago 14m 91.4M 1557M 19.0.0-1450-gf78a58c0 f081f847070a dd1faac850b0 2024-02-16T22:27:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (92s) 86s ago 13m 12.6M 1557M 19.0.0-1450-gf78a58c0 f081f847070a 0e349c665c73 2024-02-16T22:27:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (56s) 20s ago 13m 97.4M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 1f4624a5418b 2024-02-16T22:27:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (23s) 20s ago 13m 12.6M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 640d021c13b0 2024-02-16T22:27:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (12m) 20s ago 12m 233M 2581M 17.2.7-513-gb88fae66 870a0944ccb8 2cfbc060624b 2024-02-16T22:27:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 86s ago 16m 61.6M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:27:44.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.294+0000 7f2043b00700 1 -- 172.21.15.134:0/506495944 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f202806d7e0 msgr2=0x7f202806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:44.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.294+0000 7f2043b00700 1 --2- 172.21.15.134:0/506495944 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f202806d7e0 0x7f202806fc90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f203c10f290 tx=0x7f202c00b040 comp rx=0 tx=0).stop 2024-02-16T22:27:44.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.294+0000 7f2043b00700 1 -- 172.21.15.134:0/506495944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c102f50 msgr2=0x7f203c113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:44.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.294+0000 7f2043b00700 1 --2- 172.21.15.134:0/506495944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c102f50 0x7f203c113a60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2038009100 tx=0x7f2038009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:44.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.294+0000 7f2043b00700 1 -- 172.21.15.134:0/506495944 shutdown_connections 2024-02-16T22:27:44.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.294+0000 7f2043b00700 1 --2- 172.21.15.134:0/506495944 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f202806d7e0 0x7f202806fc90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.294+0000 7f2043b00700 1 --2- 172.21.15.134:0/506495944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c102f50 0x7f203c113a60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.294+0000 7f2043b00700 1 --2- 172.21.15.134:0/506495944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f203c1038f0 0x7f203c113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.294+0000 7f2043b00700 1 -- 172.21.15.134:0/506495944 >> 172.21.15.134:0/506495944 conn(0x7f203c0f8ae0 msgr2=0x7f203c0fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:44.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.294+0000 7f2043b00700 1 -- 172.21.15.134:0/506495944 shutdown_connections 2024-02-16T22:27:44.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.294+0000 7f2043b00700 1 -- 172.21.15.134:0/506495944 wait complete. 2024-02-16T22:27:44.394 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:44 smithi173 ceph-mon[83703]: pgmap v151: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:44.395 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:44 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-16T22:27:44.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.394+0000 7f34bb916700 1 -- 172.21.15.134:0/4268262128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b4103140 msgr2=0x7f34b4103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:44.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.394+0000 7f34bb916700 1 --2- 172.21.15.134:0/4268262128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b4103140 0x7f34b4103510 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009ce0 tx=0x7f34ac004d10 comp rx=0 tx=0).stop 2024-02-16T22:27:44.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.394+0000 7f34bb916700 1 -- 172.21.15.134:0/4268262128 shutdown_connections 2024-02-16T22:27:44.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.394+0000 7f34bb916700 1 --2- 172.21.15.134:0/4268262128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34b40fb570 0x7f34b40fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.394+0000 7f34bb916700 1 --2- 172.21.15.134:0/4268262128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b4103140 0x7f34b4103510 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.394+0000 7f34bb916700 1 -- 172.21.15.134:0/4268262128 >> 172.21.15.134:0/4268262128 conn(0x7f34b4071560 msgr2=0x7f34b4071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:44.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.394+0000 7f34bb916700 1 -- 172.21.15.134:0/4268262128 shutdown_connections 2024-02-16T22:27:44.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.394+0000 7f34bb916700 1 -- 172.21.15.134:0/4268262128 wait complete. 2024-02-16T22:27:44.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:44 smithi134 ceph-mon[112514]: pgmap v151: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:44.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:44 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-16T22:27:44.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.395+0000 7f34bb916700 1 Processor -- start 2024-02-16T22:27:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.395+0000 7f34bb916700 1 -- start start 2024-02-16T22:27:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.395+0000 7f34bb916700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b40fb570 0x7f34b4113b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.395+0000 7f34bb916700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34b4103140 0x7f34b4114080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.395+0000 7f34bb916700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b41146d0 con 0x7f34b40fb570 2024-02-16T22:27:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.395+0000 7f34bb916700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b410da00 con 0x7f34b4103140 2024-02-16T22:27:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.395+0000 7f34b96b2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b40fb570 0x7f34b4113b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.396+0000 7f34b96b2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b40fb570 0x7f34b4113b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52128/0 (socket says 172.21.15.134:52128) 2024-02-16T22:27:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.396+0000 7f34b8eb1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34b4103140 0x7f34b4114080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.396+0000 7f34b96b2700 1 -- 172.21.15.134:0/324400818 learned_addr learned my addr 172.21.15.134:0/324400818 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:27:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.396+0000 7f34b8eb1700 1 -- 172.21.15.134:0/324400818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b40fb570 msgr2=0x7f34b4113b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.396+0000 7f34b8eb1700 1 --2- 172.21.15.134:0/324400818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b40fb570 0x7f34b4113b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.396+0000 7f34b8eb1700 1 -- 172.21.15.134:0/324400818 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac009940 con 0x7f34b4103140 2024-02-16T22:27:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.396+0000 7f34b96b2700 1 --2- 172.21.15.134:0/324400818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b40fb570 0x7f34b4113b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:27:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.396+0000 7f34b8eb1700 1 --2- 172.21.15.134:0/324400818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34b4103140 0x7f34b4114080 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009fd0 tx=0x7f34a400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.396+0000 7f34a9ffb700 1 -- 172.21.15.134:0/324400818 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34a4004e70 con 0x7f34b4103140 2024-02-16T22:27:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.396+0000 7f34bb916700 1 -- 172.21.15.134:0/324400818 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b410dc80 con 0x7f34b4103140 2024-02-16T22:27:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.396+0000 7f34a9ffb700 1 -- 172.21.15.134:0/324400818 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f34a400f040 con 0x7f34b4103140 2024-02-16T22:27:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.396+0000 7f34a9ffb700 1 -- 172.21.15.134:0/324400818 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34a400c980 con 0x7f34b4103140 2024-02-16T22:27:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.396+0000 7f34bb916700 1 -- 172.21.15.134:0/324400818 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b410e1c0 con 0x7f34b4103140 2024-02-16T22:27:44.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.397+0000 7f34bb916700 1 -- 172.21.15.134:0/324400818 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b4073080 con 0x7f34b4103140 2024-02-16T22:27:44.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.398+0000 7f34a9ffb700 1 -- 172.21.15.134:0/324400818 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f34a400cbf0 con 0x7f34b4103140 2024-02-16T22:27:44.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.398+0000 7f34a9ffb700 1 --2- 172.21.15.134:0/324400818 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f34a006d7e0 0x7f34a006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:44.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.398+0000 7f34a9ffb700 1 -- 172.21.15.134:0/324400818 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f34a408ca40 con 0x7f34b4103140 2024-02-16T22:27:44.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.398+0000 7f34b96b2700 1 --2- 172.21.15.134:0/324400818 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f34a006d7e0 0x7f34a006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:44.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.399+0000 7f34b96b2700 1 --2- 172.21.15.134:0/324400818 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f34a006d7e0 0x7f34a006fc90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00b460 tx=0x7f34ac004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:44.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.403+0000 7f34a9ffb700 1 -- 172.21.15.134:0/324400818 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f34a4059e10 con 0x7f34b4103140 2024-02-16T22:27:44.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.677+0000 7f34bb916700 1 -- 172.21.15.134:0/324400818 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f34b410a1d0 con 0x7f34b4103140 2024-02-16T22:27:44.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.678+0000 7f34a9ffb700 1 -- 172.21.15.134:0/324400818 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f34a40599a0 con 0x7f34b4103140 2024-02-16T22:27:44.679 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:27:44.680 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:27:44.680 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:27:44.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:27:44.680 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:27:44.680 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:27:44.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:27:44.680 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:27:44.680 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 1, 2024-02-16T22:27:44.680 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 5 2024-02-16T22:27:44.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:27:44.680 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:27:44.680 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 4 2024-02-16T22:27:44.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:27:44.681 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:27:44.681 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 5, 2024-02-16T22:27:44.681 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 9 2024-02-16T22:27:44.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:27:44.681 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:27:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.680+0000 7f34bb916700 1 -- 172.21.15.134:0/324400818 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f34a006d7e0 msgr2=0x7f34a006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.680+0000 7f34bb916700 1 --2- 172.21.15.134:0/324400818 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f34a006d7e0 0x7f34a006fc90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00b460 tx=0x7f34ac004d10 comp rx=0 tx=0).stop 2024-02-16T22:27:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.680+0000 7f34bb916700 1 -- 172.21.15.134:0/324400818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34b4103140 msgr2=0x7f34b4114080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.680+0000 7f34bb916700 1 --2- 172.21.15.134:0/324400818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34b4103140 0x7f34b4114080 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009fd0 tx=0x7f34a400b040 comp rx=0 tx=0).stop 2024-02-16T22:27:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.680+0000 7f34bb916700 1 -- 172.21.15.134:0/324400818 shutdown_connections 2024-02-16T22:27:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.680+0000 7f34bb916700 1 --2- 172.21.15.134:0/324400818 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f34a006d7e0 0x7f34a006fc90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.680+0000 7f34bb916700 1 --2- 172.21.15.134:0/324400818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34b40fb570 0x7f34b4113b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.680+0000 7f34bb916700 1 --2- 172.21.15.134:0/324400818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34b4103140 0x7f34b4114080 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.680+0000 7f34bb916700 1 -- 172.21.15.134:0/324400818 >> 172.21.15.134:0/324400818 conn(0x7f34b4071560 msgr2=0x7f34b40f9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:44.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.680+0000 7f34bb916700 1 -- 172.21.15.134:0/324400818 shutdown_connections 2024-02-16T22:27:44.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.680+0000 7f34bb916700 1 -- 172.21.15.134:0/324400818 wait complete. 2024-02-16T22:27:44.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.782+0000 7fd35be93700 1 -- 172.21.15.134:0/2124101508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3541027e0 msgr2=0x7fd3540fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:44.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.782+0000 7fd35be93700 1 --2- 172.21.15.134:0/2124101508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3541027e0 0x7fd3540fbea0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd344004940 tx=0x7fd344009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:44.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.782+0000 7fd35be93700 1 -- 172.21.15.134:0/2124101508 shutdown_connections 2024-02-16T22:27:44.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.782+0000 7fd35be93700 1 --2- 172.21.15.134:0/2124101508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3541027e0 0x7fd3540fbea0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.782+0000 7fd35be93700 1 --2- 172.21.15.134:0/2124101508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd354101e40 0x7fd354102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.782+0000 7fd35be93700 1 -- 172.21.15.134:0/2124101508 >> 172.21.15.134:0/2124101508 conn(0x7fd354071d90 msgr2=0x7fd354072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:44.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.782+0000 7fd35be93700 1 -- 172.21.15.134:0/2124101508 shutdown_connections 2024-02-16T22:27:44.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.782+0000 7fd35be93700 1 -- 172.21.15.134:0/2124101508 wait complete. 2024-02-16T22:27:44.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.782+0000 7fd35be93700 1 Processor -- start 2024-02-16T22:27:44.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.782+0000 7fd35be93700 1 -- start start 2024-02-16T22:27:44.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd35be93700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd354101e40 0x7fd35410eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:44.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd35be93700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3541027e0 0x7fd35410f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:44.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd35be93700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35410f680 con 0x7fd354101e40 2024-02-16T22:27:44.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd35be93700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35410f7f0 con 0x7fd3541027e0 2024-02-16T22:27:44.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd359c2f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd354101e40 0x7fd35410eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:44.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd359c2f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd354101e40 0x7fd35410eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52140/0 (socket says 172.21.15.134:52140) 2024-02-16T22:27:44.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd359c2f700 1 -- 172.21.15.134:0/81730429 learned_addr learned my addr 172.21.15.134:0/81730429 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:27:44.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd35942e700 1 --2- 172.21.15.134:0/81730429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3541027e0 0x7fd35410f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:44.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd359c2f700 1 -- 172.21.15.134:0/81730429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3541027e0 msgr2=0x7fd35410f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:44.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd359c2f700 1 --2- 172.21.15.134:0/81730429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3541027e0 0x7fd35410f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:44.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd359c2f700 1 -- 172.21.15.134:0/81730429 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd344005040 con 0x7fd354101e40 2024-02-16T22:27:44.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd359c2f700 1 --2- 172.21.15.134:0/81730429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd354101e40 0x7fd35410eaf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd35000c8f0 tx=0x7fd3500044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:44.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd34a7fc700 1 -- 172.21.15.134:0/81730429 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd35000a760 con 0x7fd354101e40 2024-02-16T22:27:44.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd34a7fc700 1 -- 172.21.15.134:0/81730429 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd35000ad90 con 0x7fd354101e40 2024-02-16T22:27:44.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd34a7fc700 1 -- 172.21.15.134:0/81730429 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3500113a0 con 0x7fd354101e40 2024-02-16T22:27:44.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd35be93700 1 -- 172.21.15.134:0/81730429 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd354117ac0 con 0x7fd354101e40 2024-02-16T22:27:44.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.783+0000 7fd35be93700 1 -- 172.21.15.134:0/81730429 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd354118000 con 0x7fd354101e40 2024-02-16T22:27:44.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.784+0000 7fd35be93700 1 -- 172.21.15.134:0/81730429 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd354104310 con 0x7fd354101e40 2024-02-16T22:27:44.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.785+0000 7fd34a7fc700 1 -- 172.21.15.134:0/81730429 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fd350012400 con 0x7fd354101e40 2024-02-16T22:27:44.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.785+0000 7fd34a7fc700 1 --2- 172.21.15.134:0/81730429 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd34006d7e0 0x7fd34006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:44.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.785+0000 7fd34a7fc700 1 -- 172.21.15.134:0/81730429 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd35008cdc0 con 0x7fd354101e40 2024-02-16T22:27:44.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.785+0000 7fd35942e700 1 --2- 172.21.15.134:0/81730429 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd34006d7e0 0x7fd34006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:44.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.786+0000 7fd35942e700 1 --2- 172.21.15.134:0/81730429 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd34006d7e0 0x7fd34006fc90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd3540661a0 tx=0x7fd344009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:44.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:44.790+0000 7fd34a7fc700 1 -- 172.21.15.134:0/81730429 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd350056780 con 0x7fd354101e40 2024-02-16T22:27:45.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.026+0000 7fd35be93700 1 -- 172.21.15.134:0/81730429 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd354065ee0 con 0x7fd354101e40 2024-02-16T22:27:45.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.026+0000 7fd34a7fc700 1 -- 172.21.15.134:0/81730429 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1860 (secure 0 0 0) 0x7fd350059e40 con 0x7fd354101e40 2024-02-16T22:27:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:e20 2024-02-16T22:27:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:27:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:27:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-02-16T22:27:45.029 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:27:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-02-16T22:27:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-02-16T22:27:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 20 2024-02-16T22:27:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-16T22:27:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:27:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-02-16T22:23:22.543229+0000 2024-02-16T22:27:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-02-16T22:27:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-02-16T22:27:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-02-16T22:27:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-02-16T22:27:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-02-16T22:27:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-02-16T22:27:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-02-16T22:27:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-02-16T22:27:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-02-16T22:27:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:27:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 2 2024-02-16T22:27:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:in 0,1 2024-02-16T22:27:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14478,1=24269} 2024-02-16T22:27:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-02-16T22:27:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-02-16T22:27:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-02-16T22:27:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-02-16T22:27:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-02-16T22:27:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-02-16T22:27:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-02-16T22:27:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-02-16T22:27:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-02-16T22:27:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.jyajef{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.134:6828/3374248278,v1:172.21.15.134:6829/3374248278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:27:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.qljqef{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.173:6824/122132522,v1:172.21.15.173:6825/122132522] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:27:45.031 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:27:45.031 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:27:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-02-16T22:27:45.031 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:27:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.cygfxr{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2804816044,v1:172.21.15.134:6827/2804816044] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:27:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.phstvm{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:27:45.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.028+0000 7fd35be93700 1 -- 172.21.15.134:0/81730429 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd34006d7e0 msgr2=0x7fd34006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:45.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.028+0000 7fd35be93700 1 --2- 172.21.15.134:0/81730429 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd34006d7e0 0x7fd34006fc90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd3540661a0 tx=0x7fd344009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:45.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.028+0000 7fd35be93700 1 -- 172.21.15.134:0/81730429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd354101e40 msgr2=0x7fd35410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:45.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.028+0000 7fd35be93700 1 --2- 172.21.15.134:0/81730429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd354101e40 0x7fd35410eaf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd35000c8f0 tx=0x7fd3500044c0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.028+0000 7fd35be93700 1 -- 172.21.15.134:0/81730429 shutdown_connections 2024-02-16T22:27:45.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.028+0000 7fd35be93700 1 --2- 172.21.15.134:0/81730429 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd34006d7e0 0x7fd34006fc90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.028+0000 7fd35be93700 1 --2- 172.21.15.134:0/81730429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd354101e40 0x7fd35410eaf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.028+0000 7fd35be93700 1 --2- 172.21.15.134:0/81730429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3541027e0 0x7fd35410f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.029+0000 7fd35be93700 1 -- 172.21.15.134:0/81730429 >> 172.21.15.134:0/81730429 conn(0x7fd354071d90 msgr2=0x7fd3540fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:45.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.029+0000 7fd35be93700 1 -- 172.21.15.134:0/81730429 shutdown_connections 2024-02-16T22:27:45.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.029+0000 7fd35be93700 1 -- 172.21.15.134:0/81730429 wait complete. 2024-02-16T22:27:45.033 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 20 2024-02-16T22:27:45.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.135+0000 7ff76860b700 1 -- 172.21.15.134:0/3660040103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7600fbd40 msgr2=0x7ff7600fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.135+0000 7ff76860b700 1 --2- 172.21.15.134:0/3660040103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7600fbd40 0x7ff7600fc110 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff75c004940 tx=0x7ff75c009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.135+0000 7ff76860b700 1 -- 172.21.15.134:0/3660040103 shutdown_connections 2024-02-16T22:27:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.135+0000 7ff76860b700 1 --2- 172.21.15.134:0/3660040103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7600fc6e0 0x7ff760100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.135+0000 7ff76860b700 1 --2- 172.21.15.134:0/3660040103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7600fbd40 0x7ff7600fc110 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.135+0000 7ff76860b700 1 -- 172.21.15.134:0/3660040103 >> 172.21.15.134:0/3660040103 conn(0x7ff7600f79e0 msgr2=0x7ff7600f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.135+0000 7ff76860b700 1 -- 172.21.15.134:0/3660040103 shutdown_connections 2024-02-16T22:27:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.135+0000 7ff76860b700 1 -- 172.21.15.134:0/3660040103 wait complete. 2024-02-16T22:27:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.135+0000 7ff76860b700 1 Processor -- start 2024-02-16T22:27:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.135+0000 7ff76860b700 1 -- start start 2024-02-16T22:27:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff76860b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7600fbd40 0x7ff76011a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff76860b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7600fc6e0 0x7ff76011a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff76860b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76011ac00 con 0x7ff7600fc6e0 2024-02-16T22:27:45.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff76860b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff760113f10 con 0x7ff7600fbd40 2024-02-16T22:27:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff765ba6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7600fc6e0 0x7ff76011a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff765ba6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7600fc6e0 0x7ff76011a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52164/0 (socket says 172.21.15.134:52164) 2024-02-16T22:27:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff765ba6700 1 -- 172.21.15.134:0/1493753321 learned_addr learned my addr 172.21.15.134:0/1493753321 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:27:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff7663a7700 1 --2- 172.21.15.134:0/1493753321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7600fbd40 0x7ff76011a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff765ba6700 1 -- 172.21.15.134:0/1493753321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7600fbd40 msgr2=0x7ff76011a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff765ba6700 1 --2- 172.21.15.134:0/1493753321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7600fbd40 0x7ff76011a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff765ba6700 1 -- 172.21.15.134:0/1493753321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c005040 con 0x7ff7600fc6e0 2024-02-16T22:27:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff7663a7700 1 --2- 172.21.15.134:0/1493753321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7600fbd40 0x7ff76011a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:27:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff765ba6700 1 --2- 172.21.15.134:0/1493753321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7600fc6e0 0x7ff76011a5b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff75000eb40 tx=0x7ff75000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff756ffd700 1 -- 172.21.15.134:0/1493753321 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff750007cc0 con 0x7ff7600fc6e0 2024-02-16T22:27:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff756ffd700 1 -- 172.21.15.134:0/1493753321 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff75000f040 con 0x7ff7600fc6e0 2024-02-16T22:27:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff76860b700 1 -- 172.21.15.134:0/1493753321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff760114190 con 0x7ff7600fc6e0 2024-02-16T22:27:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.136+0000 7ff756ffd700 1 -- 172.21.15.134:0/1493753321 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff750009620 con 0x7ff7600fc6e0 2024-02-16T22:27:45.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.137+0000 7ff76860b700 1 -- 172.21.15.134:0/1493753321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7601146d0 con 0x7ff7600fc6e0 2024-02-16T22:27:45.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.137+0000 7ff76860b700 1 -- 172.21.15.134:0/1493753321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7600fe420 con 0x7ff7600fc6e0 2024-02-16T22:27:45.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.138+0000 7ff756ffd700 1 -- 172.21.15.134:0/1493753321 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff750009780 con 0x7ff7600fc6e0 2024-02-16T22:27:45.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.138+0000 7ff756ffd700 1 --2- 172.21.15.134:0/1493753321 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff74c06d7f0 0x7ff74c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:45.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.138+0000 7ff756ffd700 1 -- 172.21.15.134:0/1493753321 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff75008ca60 con 0x7ff7600fc6e0 2024-02-16T22:27:45.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.138+0000 7ff7663a7700 1 --2- 172.21.15.134:0/1493753321 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff74c06d7f0 0x7ff74c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:45.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.139+0000 7ff7663a7700 1 --2- 172.21.15.134:0/1493753321 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff74c06d7f0 0x7ff74c06fca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff75c000c00 tx=0x7ff75c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:45.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.143+0000 7ff756ffd700 1 -- 172.21.15.134:0/1493753321 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff750059f60 con 0x7ff7600fc6e0 2024-02-16T22:27:45.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.356+0000 7ff76860b700 1 -- 172.21.15.134:0/1493753321 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff76004bf40 con 0x7ff74c06d7f0 2024-02-16T22:27:45.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:45 smithi134 ceph-mon[112514]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:45.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:45 smithi134 ceph-mon[112514]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-16T22:27:45.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:45 smithi134 ceph-mon[112514]: Upgrade: osd.5 is safe to restart 2024-02-16T22:27:45.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:45 smithi134 ceph-mon[112514]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:45.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:45 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/324400818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:27:45.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:45 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/81730429' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:27:45.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.357+0000 7ff756ffd700 1 -- 172.21.15.134:0/1493753321 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff76004bf40 con 0x7ff74c06d7f0 2024-02-16T22:27:45.359 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:27:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:27:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:27:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-16T22:27:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-02-16T22:27:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-02-16T22:27:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-02-16T22:27:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-02-16T22:27:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-02-16T22:27:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "11/21 daemons upgraded", 2024-02-16T22:27:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-02-16T22:27:45.360 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:27:45.360 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:27:45.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.359+0000 7ff76860b700 1 -- 172.21.15.134:0/1493753321 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff74c06d7f0 msgr2=0x7ff74c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:45.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.359+0000 7ff76860b700 1 --2- 172.21.15.134:0/1493753321 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff74c06d7f0 0x7ff74c06fca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff75c000c00 tx=0x7ff75c009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:45.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.359+0000 7ff76860b700 1 -- 172.21.15.134:0/1493753321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7600fc6e0 msgr2=0x7ff76011a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:45.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.359+0000 7ff76860b700 1 --2- 172.21.15.134:0/1493753321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7600fc6e0 0x7ff76011a5b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff75000eb40 tx=0x7ff75000b040 comp rx=0 tx=0).stop 2024-02-16T22:27:45.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.359+0000 7ff76860b700 1 -- 172.21.15.134:0/1493753321 shutdown_connections 2024-02-16T22:27:45.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.359+0000 7ff76860b700 1 --2- 172.21.15.134:0/1493753321 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff74c06d7f0 0x7ff74c06fca0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.359+0000 7ff76860b700 1 --2- 172.21.15.134:0/1493753321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7600fbd40 0x7ff76011a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.359+0000 7ff76860b700 1 --2- 172.21.15.134:0/1493753321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7600fc6e0 0x7ff76011a5b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.359+0000 7ff76860b700 1 -- 172.21.15.134:0/1493753321 >> 172.21.15.134:0/1493753321 conn(0x7ff7600f79e0 msgr2=0x7ff76010d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:45.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.359+0000 7ff76860b700 1 -- 172.21.15.134:0/1493753321 shutdown_connections 2024-02-16T22:27:45.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.359+0000 7ff76860b700 1 -- 172.21.15.134:0/1493753321 wait complete. 2024-02-16T22:27:45.445 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:45 smithi173 ceph-mon[83703]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:45.445 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:45 smithi173 ceph-mon[83703]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-16T22:27:45.445 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:45 smithi173 ceph-mon[83703]: Upgrade: osd.5 is safe to restart 2024-02-16T22:27:45.445 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:45 smithi173 ceph-mon[83703]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:45.445 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:45 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/324400818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:27:45.445 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:45 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/81730429' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:27:45.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.462+0000 7febd6e64700 1 -- 172.21.15.134:0/2344419597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febd01027e0 msgr2=0x7febd00fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:45.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.462+0000 7febd6e64700 1 --2- 172.21.15.134:0/2344419597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febd01027e0 0x7febd00fbea0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7febbc004940 tx=0x7febbc009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:45.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.462+0000 7febd6e64700 1 -- 172.21.15.134:0/2344419597 shutdown_connections 2024-02-16T22:27:45.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.462+0000 7febd6e64700 1 --2- 172.21.15.134:0/2344419597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febd01027e0 0x7febd00fbea0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.462+0000 7febd6e64700 1 --2- 172.21.15.134:0/2344419597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febd0101e40 0x7febd0102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.462+0000 7febd6e64700 1 -- 172.21.15.134:0/2344419597 >> 172.21.15.134:0/2344419597 conn(0x7febd0071d90 msgr2=0x7febd0072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:45.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.462+0000 7febd6e64700 1 -- 172.21.15.134:0/2344419597 shutdown_connections 2024-02-16T22:27:45.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.462+0000 7febd6e64700 1 -- 172.21.15.134:0/2344419597 wait complete. 2024-02-16T22:27:45.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.463+0000 7febd6e64700 1 Processor -- start 2024-02-16T22:27:45.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.463+0000 7febd6e64700 1 -- start start 2024-02-16T22:27:45.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.463+0000 7febd6e64700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febd0101e40 0x7febd0112990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:45.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.463+0000 7febd6e64700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febd01027e0 0x7febd0112ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:45.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.463+0000 7febd6e64700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd0113520 con 0x7febd01027e0 2024-02-16T22:27:45.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.463+0000 7febd6e64700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd010c850 con 0x7febd0101e40 2024-02-16T22:27:45.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.463+0000 7febcffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febd01027e0 0x7febd0112ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:45.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.463+0000 7febcffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febd01027e0 0x7febd0112ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52182/0 (socket says 172.21.15.134:52182) 2024-02-16T22:27:45.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.463+0000 7febcffff700 1 -- 172.21.15.134:0/1032759224 learned_addr learned my addr 172.21.15.134:0/1032759224 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:27:45.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.463+0000 7febd4c00700 1 --2- 172.21.15.134:0/1032759224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febd0101e40 0x7febd0112990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:45.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.464+0000 7febcffff700 1 -- 172.21.15.134:0/1032759224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febd0101e40 msgr2=0x7febd0112990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:45.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.464+0000 7febcffff700 1 --2- 172.21.15.134:0/1032759224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febd0101e40 0x7febd0112990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.464+0000 7febcffff700 1 -- 172.21.15.134:0/1032759224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc005040 con 0x7febd01027e0 2024-02-16T22:27:45.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.464+0000 7febcffff700 1 --2- 172.21.15.134:0/1032759224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febd01027e0 0x7febd0112ed0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7febbc009100 tx=0x7febbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:45.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.464+0000 7febcd7fa700 1 -- 172.21.15.134:0/1032759224 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febbc00e040 con 0x7febd01027e0 2024-02-16T22:27:45.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.464+0000 7febcd7fa700 1 -- 172.21.15.134:0/1032759224 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7febbc00be00 con 0x7febd01027e0 2024-02-16T22:27:45.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.464+0000 7febd6e64700 1 -- 172.21.15.134:0/1032759224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd010cad0 con 0x7febd01027e0 2024-02-16T22:27:45.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.464+0000 7febcd7fa700 1 -- 172.21.15.134:0/1032759224 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febbc013620 con 0x7febd01027e0 2024-02-16T22:27:45.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.464+0000 7febd6e64700 1 -- 172.21.15.134:0/1032759224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd010cfb0 con 0x7febd01027e0 2024-02-16T22:27:45.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.465+0000 7febd6e64700 1 -- 172.21.15.134:0/1032759224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd00738b0 con 0x7febd01027e0 2024-02-16T22:27:45.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.466+0000 7febcd7fa700 1 -- 172.21.15.134:0/1032759224 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7febbc01ea80 con 0x7febd01027e0 2024-02-16T22:27:45.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.466+0000 7febcd7fa700 1 --2- 172.21.15.134:0/1032759224 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7febc006d7e0 0x7febc006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:27:45.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.466+0000 7febcd7fa700 1 -- 172.21.15.134:0/1032759224 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6328+0+0 (secure 0 0 0) 0x7febbc090c40 con 0x7febd01027e0 2024-02-16T22:27:45.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.466+0000 7febd4c00700 1 --2- 172.21.15.134:0/1032759224 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7febc006d7e0 0x7febc006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:27:45.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.466+0000 7febd4c00700 1 --2- 172.21.15.134:0/1032759224 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7febc006d7e0 0x7febc006fc90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7febc4004ed0 tx=0x7febc400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:27:45.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.471+0000 7febcd7fa700 1 -- 172.21.15.134:0/1032759224 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7febbc05e090 con 0x7febd01027e0 2024-02-16T22:27:45.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.744+0000 7febd6e64700 1 -- 172.21.15.134:0/1032759224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7febd010df70 con 0x7febd01027e0 2024-02-16T22:27:45.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.744+0000 7febcd7fa700 1 -- 172.21.15.134:0/1032759224 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7febbc05dc20 con 0x7febd01027e0 2024-02-16T22:27:45.746 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-02-16T22:27:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.746+0000 7febd6e64700 1 -- 172.21.15.134:0/1032759224 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7febc006d7e0 msgr2=0x7febc006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.746+0000 7febd6e64700 1 --2- 172.21.15.134:0/1032759224 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7febc006d7e0 0x7febc006fc90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7febc4004ed0 tx=0x7febc400b040 comp rx=0 tx=0).stop 2024-02-16T22:27:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.746+0000 7febd6e64700 1 -- 172.21.15.134:0/1032759224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febd01027e0 msgr2=0x7febd0112ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:27:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.746+0000 7febd6e64700 1 --2- 172.21.15.134:0/1032759224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febd01027e0 0x7febd0112ed0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7febbc009100 tx=0x7febbc009e30 comp rx=0 tx=0).stop 2024-02-16T22:27:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.746+0000 7febd6e64700 1 -- 172.21.15.134:0/1032759224 shutdown_connections 2024-02-16T22:27:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.746+0000 7febd6e64700 1 --2- 172.21.15.134:0/1032759224 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7febc006d7e0 0x7febc006fc90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.746+0000 7febd6e64700 1 --2- 172.21.15.134:0/1032759224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febd0101e40 0x7febd0112990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.746+0000 7febd6e64700 1 --2- 172.21.15.134:0/1032759224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febd01027e0 0x7febd0112ed0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:27:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.746+0000 7febd6e64700 1 -- 172.21.15.134:0/1032759224 >> 172.21.15.134:0/1032759224 conn(0x7febd0071d90 msgr2=0x7febd00fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:27:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.746+0000 7febd6e64700 1 -- 172.21.15.134:0/1032759224 shutdown_connections 2024-02-16T22:27:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:27:45.747+0000 7febd6e64700 1 -- 172.21.15.134:0/1032759224 wait complete. 2024-02-16T22:27:46.226 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:46 smithi173 ceph-mon[83703]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:46.226 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:46 smithi173 ceph-mon[83703]: pgmap v152: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:46.226 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:46.226 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-16T22:27:46.226 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:27:46.226 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:46 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1032759224' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:27:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:46 smithi134 ceph-mon[112514]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:46 smithi134 ceph-mon[112514]: pgmap v152: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-16T22:27:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:27:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:46 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1032759224' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:27:47.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:47 smithi173 ceph-mon[83703]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:47.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:47 smithi173 ceph-mon[83703]: Upgrade: Updating osd.5 2024-02-16T22:27:47.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:47 smithi173 ceph-mon[83703]: Deploying daemon osd.5 on smithi173 2024-02-16T22:27:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:47 smithi134 ceph-mon[112514]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:27:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:47 smithi134 ceph-mon[112514]: Upgrade: Updating osd.5 2024-02-16T22:27:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:47 smithi134 ceph-mon[112514]: Deploying daemon osd.5 on smithi173 2024-02-16T22:27:48.179 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:48 smithi173 ceph-mon[83703]: pgmap v153: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:48.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:48 smithi134 ceph-mon[112514]: pgmap v153: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:48.819 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:48 smithi173 systemd[1]: Stopping Ceph osd.5 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:27:49.231 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:48 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[56132]: 2024-02-16T22:27:48.816+0000 7f6a1a6be700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:27:49.231 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:48 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[56132]: 2024-02-16T22:27:48.816+0000 7f6a1a6be700 -1 osd.5 74 *** Got signal Terminated *** 2024-02-16T22:27:49.231 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:48 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[56132]: 2024-02-16T22:27:48.816+0000 7f6a1a6be700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-16T22:27:49.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:49 smithi134 ceph-mon[112514]: osd.5 marked itself down and dead 2024-02-16T22:27:49.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:49 smithi134 ceph-mon[112514]: pgmap v154: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:49.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:49 smithi173 ceph-mon[83703]: osd.5 marked itself down and dead 2024-02-16T22:27:49.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:49 smithi173 ceph-mon[83703]: pgmap v154: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:50.468 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:50 smithi173 podman[102714]: 2024-02-16 22:27:50.160339593 +0000 UTC m=+1.448615625 container died 2cfbc060624b8bf75532319b8a1b9a761a1ffeb40cf3a758ab04557d499db86d (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=quincy-b88fae6) 2024-02-16T22:27:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:50 smithi173 ceph-mon[83703]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-16T22:27:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:50 smithi173 ceph-mon[83703]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-16T22:27:50.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:50 smithi173 ceph-mon[83703]: osdmap e75: 6 total, 5 up, 6 in 2024-02-16T22:27:50.731 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:50 smithi173 podman[102714]: 2024-02-16 22:27:50.549912038 +0000 UTC m=+1.838188072 container cleanup 2cfbc060624b8bf75532319b8a1b9a761a1ffeb40cf3a758ab04557d499db86d (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=quincy-b88fae6, org.label-schema.build-date=20240214, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:27:50.731 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:50 smithi173 bash[102714]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5 2024-02-16T22:27:50.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:50 smithi134 ceph-mon[112514]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-16T22:27:50.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:50 smithi134 ceph-mon[112514]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-16T22:27:50.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:50 smithi134 ceph-mon[112514]: osdmap e75: 6 total, 5 up, 6 in 2024-02-16T22:27:51.169 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:50 smithi173 podman[102742]: 2024-02-16 22:27:50.826622694 +0000 UTC m=+0.657773218 container remove 2cfbc060624b8bf75532319b8a1b9a761a1ffeb40cf3a758ab04557d499db86d (image=quay.ceph.io/ceph-ci/ceph@sha256:bd04e78e52e49fa75ab32885b8568e6cedc3b0022775783fd0d608060059f38c, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=quincy-b88fae6, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-02-16T22:27:51.439 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:51 smithi173 podman[102834]: 2024-02-16 22:27:51.070815937 +0000 UTC m=+0.019313176 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:27:51.439 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:51 smithi173 podman[102834]: 2024-02-16 22:27:51.177444514 +0000 UTC m=+0.125941736 container create 1325de3b1e8059d2fe87dcd46ca8d4c1f3f6f4d0d90926c9ca228d90775f3ace (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-02-16T22:27:51.440 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:51 smithi173 podman[102834]: 2024-02-16 22:27:51.355889033 +0000 UTC m=+0.304386256 container init 1325de3b1e8059d2fe87dcd46ca8d4c1f3f6f4d0d90926c9ca228d90775f3ace (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-16T22:27:51.440 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:51 smithi173 podman[102834]: 2024-02-16 22:27:51.359086719 +0000 UTC m=+0.307583941 container start 1325de3b1e8059d2fe87dcd46ca8d4c1f3f6f4d0d90926c9ca228d90775f3ace (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-02-16T22:27:51.440 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:51 smithi173 podman[102834]: 2024-02-16 22:27:51.438622007 +0000 UTC m=+0.387119242 container attach 1325de3b1e8059d2fe87dcd46ca8d4c1f3f6f4d0d90926c9ca228d90775f3ace (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-16T22:27:51.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:51 smithi173 ceph-mon[83703]: osdmap e76: 6 total, 5 up, 6 in 2024-02-16T22:27:51.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:51 smithi173 ceph-mon[83703]: pgmap v157: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:51.731 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:51 smithi173 podman[102834]: 2024-02-16 22:27:51.649166442 +0000 UTC m=+0.597663669 container died 1325de3b1e8059d2fe87dcd46ca8d4c1f3f6f4d0d90926c9ca228d90775f3ace (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-16T22:27:51.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:51 smithi134 ceph-mon[112514]: osdmap e76: 6 total, 5 up, 6 in 2024-02-16T22:27:51.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:51 smithi134 ceph-mon[112514]: pgmap v157: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:27:52.481 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:52 smithi173 podman[102861]: 2024-02-16 22:27:52.217735767 +0000 UTC m=+0.562764860 container remove 1325de3b1e8059d2fe87dcd46ca8d4c1f3f6f4d0d90926c9ca228d90775f3ace (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:27:52.481 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:52 smithi173 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.5.service: Deactivated successfully. 2024-02-16T22:27:52.481 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:52 smithi173 systemd[1]: Stopped Ceph osd.5 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:27:52.481 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:52 smithi173 systemd[1]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.5.service: Consumed 1min 291ms CPU time. 2024-02-16T22:27:52.481 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:52 smithi173 systemd[1]: Starting Ceph osd.5 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:27:52.930 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:52 smithi173 ceph-mon[83703]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-16T22:27:52.931 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:52 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:52.931 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:52 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:27:52.931 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:52 smithi173 podman[102962]: 2024-02-16 22:27:52.551366926 +0000 UTC m=+0.017462859 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:27:52.931 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:52 smithi173 podman[102962]: 2024-02-16 22:27:52.652196673 +0000 UTC m=+0.118292643 container create 913286cc4f764601068ca8f691f0ed94135af25eee0527bfde98a50fc88a3550 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-16T22:27:52.931 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:52 smithi173 podman[102962]: 2024-02-16 22:27:52.86320326 +0000 UTC m=+0.329299188 container init 913286cc4f764601068ca8f691f0ed94135af25eee0527bfde98a50fc88a3550 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-activate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-16T22:27:52.931 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:52 smithi173 podman[102962]: 2024-02-16 22:27:52.866757125 +0000 UTC m=+0.332853053 container start 913286cc4f764601068ca8f691f0ed94135af25eee0527bfde98a50fc88a3550 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-activate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-02-16T22:27:52.931 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:52 smithi173 podman[102962]: 2024-02-16 22:27:52.930041115 +0000 UTC m=+0.396137044 container attach 913286cc4f764601068ca8f691f0ed94135af25eee0527bfde98a50fc88a3550 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-02-16T22:27:52.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:52 smithi134 ceph-mon[112514]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-16T22:27:52.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:52 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:52.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:52 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:27:53.634 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-activate[102977]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-16T22:27:53.634 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-activate[102977]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-16T22:27:53.635 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 bash[102962]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-16T22:27:53.635 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 bash[102962]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-16T22:27:53.635 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 bash[102962]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-16T22:27:53.635 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 bash[102962]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-16T22:27:53.635 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 bash[102962]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-16T22:27:53.635 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 bash[102962]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-16T22:27:53.635 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 bash[102962]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-16T22:27:53.635 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-activate[102977]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-16T22:27:53.635 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-activate[102977]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-16T22:27:53.635 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-activate[102977]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-16T22:27:53.635 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-activate[102977]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-16T22:27:53.635 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-activate[102977]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-16T22:27:53.635 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:53 smithi173 podman[102962]: 2024-02-16 22:27:53.337615455 +0000 UTC m=+0.803711384 container died 913286cc4f764601068ca8f691f0ed94135af25eee0527bfde98a50fc88a3550 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-activate, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-02-16T22:27:53.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:53 smithi134 ceph-mon[112514]: pgmap v158: 65 pgs: 5 active+undersized+degraded, 3 peering, 6 stale+active+clean, 5 active+undersized, 46 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 14/357 objects degraded (3.922%) 2024-02-16T22:27:53.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:53 smithi173 ceph-mon[83703]: pgmap v158: 65 pgs: 5 active+undersized+degraded, 3 peering, 6 stale+active+clean, 5 active+undersized, 46 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 14/357 objects degraded (3.922%) 2024-02-16T22:27:54.448 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:54 smithi173 podman[103112]: 2024-02-16 22:27:54.075946824 +0000 UTC m=+0.728911269 container remove 913286cc4f764601068ca8f691f0ed94135af25eee0527bfde98a50fc88a3550 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240214, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-02-16T22:27:54.449 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:54 smithi173 podman[103174]: 2024-02-16 22:27:54.190275892 +0000 UTC m=+0.017231188 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:27:54.449 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:54 smithi173 podman[103174]: 2024-02-16 22:27:54.318570002 +0000 UTC m=+0.145525296 container create 8ee59c4c43194ae02c75a9f49f1c695a277737a481e61fcc64f770c9ee89e6be (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-02-16T22:27:54.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:54 smithi134 ceph-mon[112514]: Health check failed: Degraded data redundancy: 14/357 objects degraded (3.922%), 5 pgs degraded (PG_DEGRADED) 2024-02-16T22:27:54.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:54 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:54.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:54 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:54.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:54 smithi173 ceph-mon[83703]: Health check failed: Degraded data redundancy: 14/357 objects degraded (3.922%), 5 pgs degraded (PG_DEGRADED) 2024-02-16T22:27:54.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:54 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:54.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:54 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:54.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:54 smithi173 podman[103174]: 2024-02-16 22:27:54.537979157 +0000 UTC m=+0.364934451 container init 8ee59c4c43194ae02c75a9f49f1c695a277737a481e61fcc64f770c9ee89e6be (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS) 2024-02-16T22:27:54.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:54 smithi173 podman[103174]: 2024-02-16 22:27:54.541084041 +0000 UTC m=+0.368039341 container start 8ee59c4c43194ae02c75a9f49f1c695a277737a481e61fcc64f770c9ee89e6be (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-02-16T22:27:54.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:54 smithi173 ceph-osd[103194]: -- 172.21.15.173:0/396853051 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5622756ef1e0 con 0x5622756c1000 2024-02-16T22:27:54.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:54 smithi173 bash[103174]: 8ee59c4c43194ae02c75a9f49f1c695a277737a481e61fcc64f770c9ee89e6be 2024-02-16T22:27:54.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:54 smithi173 systemd[1]: Started Ceph osd.5 for f29a5372-cd17-11ee-95ba-87774f69a715. 2024-02-16T22:27:55.452 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:55 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:27:55.086+0000 7fac1fe3f7c0 -1 Falling back to public interface 2024-02-16T22:27:55.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:55 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:27:55.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:55 smithi173 ceph-mon[83703]: pgmap v159: 65 pgs: 14 active+undersized+degraded, 3 peering, 11 active+undersized, 37 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-16T22:27:55.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:55 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:27:55.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:55 smithi134 ceph-mon[112514]: pgmap v159: 65 pgs: 14 active+undersized+degraded, 3 peering, 11 active+undersized, 37 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-16T22:27:57.325 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:57 smithi173 ceph-mon[83703]: pgmap v160: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-16T22:27:57.325 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:57 smithi173 ceph-mon[83703]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-02-16T22:27:57.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:57 smithi134 ceph-mon[112514]: pgmap v160: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-16T22:27:57.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:57 smithi134 ceph-mon[112514]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-02-16T22:27:58.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:58 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:58.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:58 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:58.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:58 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:58.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:58 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:59.630 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:59 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:27:59.284+0000 7fac1fe3f7c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-02-16T22:27:59.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:59 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:59.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:59 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:27:59.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:59 smithi173 ceph-mon[83703]: pgmap v161: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-16T22:27:59.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:59 smithi173 ceph-mon[83703]: from='osd.5 [v2:172.21.15.173:6816/4051147258,v1:172.21.15.173:6817/4051147258]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-16T22:27:59.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:27:59 smithi173 ceph-mon[83703]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-16T22:27:59.982 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:59 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:27:59.731+0000 7fac1fe3f7c0 -1 osd.5 74 log_to_monitors true 2024-02-16T22:27:59.982 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:27:59 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:27:59.771+0000 7fac11297700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T22:28:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:59 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:59 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:59 smithi134 ceph-mon[112514]: pgmap v161: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-16T22:28:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:59 smithi134 ceph-mon[112514]: from='osd.5 [v2:172.21.15.173:6816/4051147258,v1:172.21.15.173:6817/4051147258]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-16T22:28:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:27:59 smithi134 ceph-mon[112514]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-16T22:28:01.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:00 smithi134 ceph-mon[112514]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-16T22:28:01.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:00 smithi134 ceph-mon[112514]: osdmap e77: 6 total, 5 up, 6 in 2024-02-16T22:28:01.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:00 smithi134 ceph-mon[112514]: from='osd.5 [v2:172.21.15.173:6816/4051147258,v1:172.21.15.173:6817/4051147258]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:28:01.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:00 smithi134 ceph-mon[112514]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:28:01.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:00 smithi173 ceph-mon[83703]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-16T22:28:01.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:00 smithi173 ceph-mon[83703]: osdmap e77: 6 total, 5 up, 6 in 2024-02-16T22:28:01.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:00 smithi173 ceph-mon[83703]: from='osd.5 [v2:172.21.15.173:6816/4051147258,v1:172.21.15.173:6817/4051147258]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:28:01.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:00 smithi173 ceph-mon[83703]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-02-16T22:28:01.896 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:01 smithi173 ceph-mon[83703]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-16T22:28:01.897 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:01 smithi173 ceph-mon[83703]: osd.5 [v2:172.21.15.173:6816/4051147258,v1:172.21.15.173:6817/4051147258] boot 2024-02-16T22:28:01.897 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:01 smithi173 ceph-mon[83703]: osdmap e78: 6 total, 6 up, 6 in 2024-02-16T22:28:01.897 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:01 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:28:01.897 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:01 smithi173 ceph-mon[83703]: pgmap v164: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-16T22:28:01.897 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:01 smithi173 ceph-mon[83703]: osdmap e79: 6 total, 6 up, 6 in 2024-02-16T22:28:01.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:01 smithi134 ceph-mon[112514]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-16T22:28:01.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:01 smithi134 ceph-mon[112514]: osd.5 [v2:172.21.15.173:6816/4051147258,v1:172.21.15.173:6817/4051147258] boot 2024-02-16T22:28:01.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:01 smithi134 ceph-mon[112514]: osdmap e78: 6 total, 6 up, 6 in 2024-02-16T22:28:01.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:01 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-16T22:28:01.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:01 smithi134 ceph-mon[112514]: pgmap v164: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-16T22:28:01.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:01 smithi134 ceph-mon[112514]: osdmap e79: 6 total, 6 up, 6 in 2024-02-16T22:28:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:28:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:28:03.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:03.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:03.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:03.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:03.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: Upgrade: Setting container_image for all osd 2024-02-16T22:28:03.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:03.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-16T22:28:03.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-16T22:28:03.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-16T22:28:03.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-16T22:28:03.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-16T22:28:03.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-16T22:28:03.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-16T22:28:03.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-16T22:28:03.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-16T22:28:03.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-16T22:28:03.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-16T22:28:03.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-16T22:28:03.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: Upgrade: Setting require_osd_release to 19 squid 2024-02-16T22:28:03.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-16T22:28:03.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-mon[112514]: pgmap v166: 65 pgs: 11 active+undersized+degraded, 12 active+undersized, 42 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/357 objects degraded (12.885%) 2024-02-16T22:28:03.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:03 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134[112510]: 2024-02-16T22:28:03.433+0000 7ff9fc795700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-16T22:28:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:28:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:28:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: Upgrade: Setting container_image for all osd 2024-02-16T22:28:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-16T22:28:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-16T22:28:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-16T22:28:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-16T22:28:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-16T22:28:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-16T22:28:03.732 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-16T22:28:03.733 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-16T22:28:03.733 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-16T22:28:03.733 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-16T22:28:03.733 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-16T22:28:03.733 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-16T22:28:03.733 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: Upgrade: Setting require_osd_release to 19 squid 2024-02-16T22:28:03.733 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-16T22:28:03.733 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:03 smithi173 ceph-mon[83703]: pgmap v166: 65 pgs: 11 active+undersized+degraded, 12 active+undersized, 42 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/357 objects degraded (12.885%) 2024-02-16T22:28:04.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:04 smithi134 ceph-mon[112514]: Health check update: Degraded data redundancy: 46/357 objects degraded (12.885%), 11 pgs degraded (PG_DEGRADED) 2024-02-16T22:28:04.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:04 smithi134 ceph-mon[112514]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-16T22:28:04.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:04 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-16T22:28:04.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:04 smithi134 ceph-mon[112514]: osdmap e80: 6 total, 6 up, 6 in 2024-02-16T22:28:04.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:04 smithi134 ceph-mon[112514]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-02-16T22:28:04.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:04 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-16T22:28:04.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:04 smithi134 ceph-mon[112514]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-16T22:28:04.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:04 smithi134 ceph-mon[112514]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-16T22:28:04.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:04 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-16T22:28:04.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:04 smithi134 ceph-mon[112514]: osdmap e81: 6 total, 6 up, 6 in 2024-02-16T22:28:04.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:04 smithi134 ceph-mon[112514]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-02-16T22:28:04.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:04 smithi173 ceph-mon[83703]: Health check update: Degraded data redundancy: 46/357 objects degraded (12.885%), 11 pgs degraded (PG_DEGRADED) 2024-02-16T22:28:04.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:04 smithi173 ceph-mon[83703]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-16T22:28:04.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:04 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-16T22:28:04.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:04 smithi173 ceph-mon[83703]: osdmap e80: 6 total, 6 up, 6 in 2024-02-16T22:28:04.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:04 smithi173 ceph-mon[83703]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-02-16T22:28:04.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:04 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-16T22:28:04.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:04 smithi173 ceph-mon[83703]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-16T22:28:04.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:04 smithi173 ceph-mon[83703]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-16T22:28:04.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:04 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-16T22:28:04.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:04 smithi173 ceph-mon[83703]: osdmap e81: 6 total, 6 up, 6 in 2024-02-16T22:28:04.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:04 smithi173 ceph-mon[83703]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-02-16T22:28:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:05 smithi134 ceph-mon[112514]: mds.? [v2:172.21.15.173:6824/1069817513,v1:172.21.15.173:6825/1069817513] up:boot 2024-02-16T22:28:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:05 smithi134 ceph-mon[112514]: mds.? [v2:172.21.15.134:6828/3228039321,v1:172.21.15.134:6829/3228039321] up:boot 2024-02-16T22:28:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:05 smithi134 ceph-mon[112514]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-16T22:28:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:05 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jyajef"}]: dispatch 2024-02-16T22:28:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:05 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.qljqef"}]: dispatch 2024-02-16T22:28:05.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:05 smithi134 ceph-mon[112514]: pgmap v169: 65 pgs: 1 active+undersized, 64 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:05.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:05 smithi134 ceph-mon[112514]: Upgrade: Updating mds.cephfs.smithi134.cygfxr 2024-02-16T22:28:05.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:05 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:05.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:05 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.cygfxr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:28:05.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:05 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:05.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:05 smithi134 ceph-mon[112514]: Deploying daemon mds.cephfs.smithi134.cygfxr on smithi134 2024-02-16T22:28:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:05 smithi173 ceph-mon[83703]: mds.? [v2:172.21.15.173:6824/1069817513,v1:172.21.15.173:6825/1069817513] up:boot 2024-02-16T22:28:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:05 smithi173 ceph-mon[83703]: mds.? [v2:172.21.15.134:6828/3228039321,v1:172.21.15.134:6829/3228039321] up:boot 2024-02-16T22:28:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:05 smithi173 ceph-mon[83703]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-16T22:28:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:05 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jyajef"}]: dispatch 2024-02-16T22:28:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:05 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.qljqef"}]: dispatch 2024-02-16T22:28:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:05 smithi173 ceph-mon[83703]: pgmap v169: 65 pgs: 1 active+undersized, 64 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:05 smithi173 ceph-mon[83703]: Upgrade: Updating mds.cephfs.smithi134.cygfxr 2024-02-16T22:28:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:05 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:05 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.cygfxr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:28:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:05 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:05.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:05 smithi173 ceph-mon[83703]: Deploying daemon mds.cephfs.smithi134.cygfxr on smithi134 2024-02-16T22:28:06.689 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:06 smithi134 ceph-mon[112514]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/357 objects degraded (12.885%), 11 pgs degraded) 2024-02-16T22:28:06.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:06 smithi173 ceph-mon[83703]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/357 objects degraded (12.885%), 11 pgs degraded) 2024-02-16T22:28:08.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:08 smithi134 ceph-mon[112514]: pgmap v170: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:08.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:08 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:08.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:08 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:28:08.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:08 smithi134 ceph-mon[112514]: osdmap e82: 6 total, 6 up, 6 in 2024-02-16T22:28:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:08 smithi173 ceph-mon[83703]: pgmap v170: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:08 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:08 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:28:08.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:08 smithi173 ceph-mon[83703]: osdmap e82: 6 total, 6 up, 6 in 2024-02-16T22:28:09.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:09 smithi134 ceph-mon[112514]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-16T22:28:09.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:09 smithi173 ceph-mon[83703]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-16T22:28:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:10 smithi134 ceph-mon[112514]: pgmap v172: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:10 smithi173 ceph-mon[83703]: pgmap v172: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:12.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:12 smithi134 ceph-mon[112514]: pgmap v173: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:12 smithi173 ceph-mon[83703]: pgmap v173: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:13 smithi134 ceph-mon[112514]: mds.? [v2:172.21.15.134:6826/845650190,v1:172.21.15.134:6827/845650190] up:boot 2024-02-16T22:28:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:13 smithi134 ceph-mon[112514]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-16T22:28:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:13 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:28:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:13 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:13 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:13 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:13.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:13 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:28:13.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:13 smithi173 ceph-mon[83703]: mds.? [v2:172.21.15.134:6826/845650190,v1:172.21.15.134:6827/845650190] up:boot 2024-02-16T22:28:13.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:13 smithi173 ceph-mon[83703]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-16T22:28:13.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:13 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:28:13.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:13 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:13.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:13 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:13.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:13 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:13.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:13 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:28:14.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:14 smithi134 ceph-mon[112514]: pgmap v174: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:14.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:14 smithi173 ceph-mon[83703]: pgmap v174: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:15.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.853+0000 7f4094bc3700 1 -- 172.21.15.134:0/3477079894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4090102780 msgr2=0x7f40900fbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:15.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.853+0000 7f4094bc3700 1 --2- 172.21.15.134:0/3477079894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4090102780 0x7f40900fbe00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4084004940 tx=0x7f4084009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:15.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.853+0000 7f4094bc3700 1 -- 172.21.15.134:0/3477079894 shutdown_connections 2024-02-16T22:28:15.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.853+0000 7f4094bc3700 1 --2- 172.21.15.134:0/3477079894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4090102780 0x7f40900fbe00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:15.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.853+0000 7f4094bc3700 1 --2- 172.21.15.134:0/3477079894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4090101de0 0x7f40901021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:15.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.853+0000 7f4094bc3700 1 -- 172.21.15.134:0/3477079894 >> 172.21.15.134:0/3477079894 conn(0x7f4090071d50 msgr2=0x7f4090072150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:15.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.853+0000 7f4094bc3700 1 -- 172.21.15.134:0/3477079894 shutdown_connections 2024-02-16T22:28:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.853+0000 7f4094bc3700 1 -- 172.21.15.134:0/3477079894 wait complete. 2024-02-16T22:28:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.854+0000 7f4094bc3700 1 Processor -- start 2024-02-16T22:28:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.854+0000 7f4094bc3700 1 -- start start 2024-02-16T22:28:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.854+0000 7f4094bc3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4090101de0 0x7f409010ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.854+0000 7f4094bc3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4090102780 0x7f409010ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.854+0000 7f4094bc3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409010f590 con 0x7f4090102780 2024-02-16T22:28:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.854+0000 7f4094bc3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409010f700 con 0x7f4090101de0 2024-02-16T22:28:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.854+0000 7f408dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4090102780 0x7f409010ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.854+0000 7f408dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4090102780 0x7f409010ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34374/0 (socket says 172.21.15.134:34374) 2024-02-16T22:28:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.854+0000 7f408dd9b700 1 -- 172.21.15.134:0/627244413 learned_addr learned my addr 172.21.15.134:0/627244413 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:28:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.855+0000 7f408e59c700 1 --2- 172.21.15.134:0/627244413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4090101de0 0x7f409010ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.855+0000 7f408dd9b700 1 -- 172.21.15.134:0/627244413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4090101de0 msgr2=0x7f409010ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.855+0000 7f408dd9b700 1 --2- 172.21.15.134:0/627244413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4090101de0 0x7f409010ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:15.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.855+0000 7f408dd9b700 1 -- 172.21.15.134:0/627244413 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4084005040 con 0x7f4090102780 2024-02-16T22:28:15.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.855+0000 7f408dd9b700 1 --2- 172.21.15.134:0/627244413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4090102780 0x7f409010ef40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4084009100 tx=0x7f4084009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:15.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.855+0000 7f407effd700 1 -- 172.21.15.134:0/627244413 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f408400e040 con 0x7f4090102780 2024-02-16T22:28:15.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.855+0000 7f407effd700 1 -- 172.21.15.134:0/627244413 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f408400bbf0 con 0x7f4090102780 2024-02-16T22:28:15.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.855+0000 7f4094bc3700 1 -- 172.21.15.134:0/627244413 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4090117970 con 0x7f4090102780 2024-02-16T22:28:15.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.855+0000 7f407effd700 1 -- 172.21.15.134:0/627244413 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f408401c630 con 0x7f4090102780 2024-02-16T22:28:15.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.855+0000 7f4094bc3700 1 -- 172.21.15.134:0/627244413 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4090117eb0 con 0x7f4090102780 2024-02-16T22:28:15.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.857+0000 7f4094bc3700 1 -- 172.21.15.134:0/627244413 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4090075ca0 con 0x7f4090102780 2024-02-16T22:28:15.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.857+0000 7f407effd700 1 -- 172.21.15.134:0/627244413 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f408400bd60 con 0x7f4090102780 2024-02-16T22:28:15.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.858+0000 7f407effd700 1 --2- 172.21.15.134:0/627244413 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f407806d7e0 0x7f407806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:15.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.858+0000 7f407effd700 1 -- 172.21.15.134:0/627244413 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f408408e300 con 0x7f4090102780 2024-02-16T22:28:15.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.858+0000 7f408e59c700 1 --2- 172.21.15.134:0/627244413 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f407806d7e0 0x7f407806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:15.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.858+0000 7f408e59c700 1 --2- 172.21.15.134:0/627244413 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f407806d7e0 0x7f407806fc90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f40800041d0 tx=0x7f4080009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:15.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:15.863+0000 7f407effd700 1 -- 172.21.15.134:0/627244413 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4084057ad0 con 0x7f4090102780 2024-02-16T22:28:16.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.090+0000 7f4094bc3700 1 -- 172.21.15.134:0/627244413 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4090065f50 con 0x7f407806d7e0 2024-02-16T22:28:16.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.092+0000 7f407effd700 1 -- 172.21.15.134:0/627244413 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4090065f50 con 0x7f407806d7e0 2024-02-16T22:28:16.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.094+0000 7f4094bc3700 1 -- 172.21.15.134:0/627244413 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f407806d7e0 msgr2=0x7f407806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:16.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.094+0000 7f4094bc3700 1 --2- 172.21.15.134:0/627244413 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f407806d7e0 0x7f407806fc90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f40800041d0 tx=0x7f4080009040 comp rx=0 tx=0).stop 2024-02-16T22:28:16.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.094+0000 7f4094bc3700 1 -- 172.21.15.134:0/627244413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4090102780 msgr2=0x7f409010ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:16.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.094+0000 7f4094bc3700 1 --2- 172.21.15.134:0/627244413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4090102780 0x7f409010ef40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4084009100 tx=0x7f4084009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:16.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.094+0000 7f4094bc3700 1 -- 172.21.15.134:0/627244413 shutdown_connections 2024-02-16T22:28:16.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.094+0000 7f4094bc3700 1 --2- 172.21.15.134:0/627244413 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f407806d7e0 0x7f407806fc90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.094+0000 7f4094bc3700 1 --2- 172.21.15.134:0/627244413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4090101de0 0x7f409010ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.094+0000 7f4094bc3700 1 --2- 172.21.15.134:0/627244413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4090102780 0x7f409010ef40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.094+0000 7f4094bc3700 1 -- 172.21.15.134:0/627244413 >> 172.21.15.134:0/627244413 conn(0x7f4090071d50 msgr2=0x7f40900fabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:16.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.094+0000 7f4094bc3700 1 -- 172.21.15.134:0/627244413 shutdown_connections 2024-02-16T22:28:16.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.094+0000 7f4094bc3700 1 -- 172.21.15.134:0/627244413 wait complete. 2024-02-16T22:28:16.107 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.198+0000 7fdcdaede700 1 -- 172.21.15.134:0/3907653186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd4103140 msgr2=0x7fdcd4103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.198+0000 7fdcdaede700 1 --2- 172.21.15.134:0/3907653186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd4103140 0x7fdcd4103510 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8004940 tx=0x7fdcc8009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.198+0000 7fdcdaede700 1 -- 172.21.15.134:0/3907653186 shutdown_connections 2024-02-16T22:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.198+0000 7fdcdaede700 1 --2- 172.21.15.134:0/3907653186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcd40fb570 0x7fdcd40fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.198+0000 7fdcdaede700 1 --2- 172.21.15.134:0/3907653186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd4103140 0x7fdcd4103510 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.198+0000 7fdcdaede700 1 -- 172.21.15.134:0/3907653186 >> 172.21.15.134:0/3907653186 conn(0x7fdcd4071560 msgr2=0x7fdcd4071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.198+0000 7fdcdaede700 1 -- 172.21.15.134:0/3907653186 shutdown_connections 2024-02-16T22:28:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.198+0000 7fdcdaede700 1 -- 172.21.15.134:0/3907653186 wait complete. 2024-02-16T22:28:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.198+0000 7fdcdaede700 1 Processor -- start 2024-02-16T22:28:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.198+0000 7fdcdaede700 1 -- start start 2024-02-16T22:28:16.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcdaede700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcd40fb570 0x7fdcd4113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:16.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcdaede700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd4103140 0x7fdcd4114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:16.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcdaede700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd41146a0 con 0x7fdcd4103140 2024-02-16T22:28:16.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcdaede700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd410d9d0 con 0x7fdcd40fb570 2024-02-16T22:28:16.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcd3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd4103140 0x7fdcd4114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcd3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd4103140 0x7fdcd4114050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34382/0 (socket says 172.21.15.134:34382) 2024-02-16T22:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcd3fff700 1 -- 172.21.15.134:0/3412642557 learned_addr learned my addr 172.21.15.134:0/3412642557 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcd8c7a700 1 --2- 172.21.15.134:0/3412642557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcd40fb570 0x7fdcd4113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcd3fff700 1 -- 172.21.15.134:0/3412642557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcd40fb570 msgr2=0x7fdcd4113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcd3fff700 1 --2- 172.21.15.134:0/3412642557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcd40fb570 0x7fdcd4113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcd3fff700 1 -- 172.21.15.134:0/3412642557 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc8005040 con 0x7fdcd4103140 2024-02-16T22:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcd3fff700 1 --2- 172.21.15.134:0/3412642557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd4103140 0x7fdcd4114050 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000c830 tx=0x7fdcc0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcd17fa700 1 -- 172.21.15.134:0/3412642557 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcc00106f0 con 0x7fdcd4103140 2024-02-16T22:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcd17fa700 1 -- 172.21.15.134:0/3412642557 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdcc0010d20 con 0x7fdcd4103140 2024-02-16T22:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcdaede700 1 -- 172.21.15.134:0/3412642557 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd410dcb0 con 0x7fdcd4103140 2024-02-16T22:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.199+0000 7fdcd17fa700 1 -- 172.21.15.134:0/3412642557 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcc00113a0 con 0x7fdcd4103140 2024-02-16T22:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.200+0000 7fdcdaede700 1 -- 172.21.15.134:0/3412642557 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd410e1f0 con 0x7fdcd4103140 2024-02-16T22:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.201+0000 7fdcdaede700 1 -- 172.21.15.134:0/3412642557 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd4100310 con 0x7fdcd4103140 2024-02-16T22:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.201+0000 7fdcd17fa700 1 -- 172.21.15.134:0/3412642557 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fdcc0012400 con 0x7fdcd4103140 2024-02-16T22:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.201+0000 7fdcd17fa700 1 --2- 172.21.15.134:0/3412642557 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdcc406d7e0 0x7fdcc406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.201+0000 7fdcd17fa700 1 -- 172.21.15.134:0/3412642557 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fdcc008ce00 con 0x7fdcd4103140 2024-02-16T22:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.201+0000 7fdcd8c7a700 1 --2- 172.21.15.134:0/3412642557 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdcc406d7e0 0x7fdcc406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.202+0000 7fdcd8c7a700 1 --2- 172.21.15.134:0/3412642557 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdcc406d7e0 0x7fdcc406fc90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8004f90 tx=0x7fdcc8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.206+0000 7fdcd17fa700 1 -- 172.21.15.134:0/3412642557 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdcc005a240 con 0x7fdcd4103140 2024-02-16T22:28:16.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.431+0000 7fdcdaede700 1 -- 172.21.15.134:0/3412642557 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcd410a1b0 con 0x7fdcc406d7e0 2024-02-16T22:28:16.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:16 smithi134 ceph-mon[112514]: pgmap v175: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:16.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.433+0000 7fdcd17fa700 1 -- 172.21.15.134:0/3412642557 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdcd410a1b0 con 0x7fdcc406d7e0 2024-02-16T22:28:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.435+0000 7fdcdaede700 1 -- 172.21.15.134:0/3412642557 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdcc406d7e0 msgr2=0x7fdcc406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.435+0000 7fdcdaede700 1 --2- 172.21.15.134:0/3412642557 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdcc406d7e0 0x7fdcc406fc90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8004f90 tx=0x7fdcc8009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.435+0000 7fdcdaede700 1 -- 172.21.15.134:0/3412642557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd4103140 msgr2=0x7fdcd4114050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.435+0000 7fdcdaede700 1 --2- 172.21.15.134:0/3412642557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd4103140 0x7fdcd4114050 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000c830 tx=0x7fdcc0004470 comp rx=0 tx=0).stop 2024-02-16T22:28:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.435+0000 7fdcdaede700 1 -- 172.21.15.134:0/3412642557 shutdown_connections 2024-02-16T22:28:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.435+0000 7fdcdaede700 1 --2- 172.21.15.134:0/3412642557 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdcc406d7e0 0x7fdcc406fc90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.435+0000 7fdcdaede700 1 --2- 172.21.15.134:0/3412642557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcd40fb570 0x7fdcd4113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.435+0000 7fdcdaede700 1 --2- 172.21.15.134:0/3412642557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd4103140 0x7fdcd4114050 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.435+0000 7fdcdaede700 1 -- 172.21.15.134:0/3412642557 >> 172.21.15.134:0/3412642557 conn(0x7fdcd4071560 msgr2=0x7fdcd40fa5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.435+0000 7fdcdaede700 1 -- 172.21.15.134:0/3412642557 shutdown_connections 2024-02-16T22:28:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.435+0000 7fdcdaede700 1 -- 172.21.15.134:0/3412642557 wait complete. 2024-02-16T22:28:16.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:16 smithi173 ceph-mon[83703]: pgmap v175: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:16.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.545+0000 7f86ae1a1700 1 -- 172.21.15.134:0/182628401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a80fb570 msgr2=0x7f86a80fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.545+0000 7f86ae1a1700 1 --2- 172.21.15.134:0/182628401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a80fb570 0x7f86a80fb9c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f869c004940 tx=0x7f869c009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.545+0000 7f86ae1a1700 1 -- 172.21.15.134:0/182628401 shutdown_connections 2024-02-16T22:28:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.545+0000 7f86ae1a1700 1 --2- 172.21.15.134:0/182628401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a80fb570 0x7f86a80fb9c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.545+0000 7f86ae1a1700 1 --2- 172.21.15.134:0/182628401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86a8103140 0x7f86a8103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.546+0000 7f86ae1a1700 1 -- 172.21.15.134:0/182628401 >> 172.21.15.134:0/182628401 conn(0x7f86a8071560 msgr2=0x7f86a8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.546+0000 7f86ae1a1700 1 -- 172.21.15.134:0/182628401 shutdown_connections 2024-02-16T22:28:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.546+0000 7f86ae1a1700 1 -- 172.21.15.134:0/182628401 wait complete. 2024-02-16T22:28:16.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.546+0000 7f86ae1a1700 1 Processor -- start 2024-02-16T22:28:16.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.546+0000 7f86ae1a1700 1 -- start start 2024-02-16T22:28:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.547+0000 7f86ae1a1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a80fb570 0x7f86a8113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.547+0000 7f86ae1a1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86a8103140 0x7f86a81140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.547+0000 7f86ae1a1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a8114720 con 0x7f86a80fb570 2024-02-16T22:28:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.547+0000 7f86ae1a1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a810da50 con 0x7f86a8103140 2024-02-16T22:28:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.547+0000 7f86a77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a80fb570 0x7f86a8113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.547+0000 7f86a77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a80fb570 0x7f86a8113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34398/0 (socket says 172.21.15.134:34398) 2024-02-16T22:28:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.547+0000 7f86a77fe700 1 -- 172.21.15.134:0/2102645982 learned_addr learned my addr 172.21.15.134:0/2102645982 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:28:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.547+0000 7f86a6ffd700 1 --2- 172.21.15.134:0/2102645982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86a8103140 0x7f86a81140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.547+0000 7f86a77fe700 1 -- 172.21.15.134:0/2102645982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86a8103140 msgr2=0x7f86a81140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.547+0000 7f86a77fe700 1 --2- 172.21.15.134:0/2102645982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86a8103140 0x7f86a81140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.547+0000 7f86a77fe700 1 -- 172.21.15.134:0/2102645982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c005040 con 0x7f86a80fb570 2024-02-16T22:28:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.547+0000 7f86a6ffd700 1 --2- 172.21.15.134:0/2102645982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86a8103140 0x7f86a81140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:28:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.547+0000 7f86a77fe700 1 --2- 172.21.15.134:0/2102645982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a80fb570 0x7f86a8113b90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f869800eb40 tx=0x7f869800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.548+0000 7f868ffff700 1 -- 172.21.15.134:0/2102645982 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8698007cc0 con 0x7f86a80fb570 2024-02-16T22:28:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.548+0000 7f86ae1a1700 1 -- 172.21.15.134:0/2102645982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a810dcd0 con 0x7f86a80fb570 2024-02-16T22:28:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.548+0000 7f868ffff700 1 -- 172.21.15.134:0/2102645982 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f869800f040 con 0x7f86a80fb570 2024-02-16T22:28:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.548+0000 7f868ffff700 1 -- 172.21.15.134:0/2102645982 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f869800ca10 con 0x7f86a80fb570 2024-02-16T22:28:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.548+0000 7f86ae1a1700 1 -- 172.21.15.134:0/2102645982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a810e0e0 con 0x7f86a80fb570 2024-02-16T22:28:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.549+0000 7f86ae1a1700 1 -- 172.21.15.134:0/2102645982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a81054d0 con 0x7f86a80fb570 2024-02-16T22:28:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.549+0000 7f868ffff700 1 -- 172.21.15.134:0/2102645982 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f869800cc80 con 0x7f86a80fb570 2024-02-16T22:28:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.550+0000 7f868ffff700 1 --2- 172.21.15.134:0/2102645982 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f869006d7f0 0x7f869006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.550+0000 7f868ffff700 1 -- 172.21.15.134:0/2102645982 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f869808cb10 con 0x7f86a80fb570 2024-02-16T22:28:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.550+0000 7f86a6ffd700 1 --2- 172.21.15.134:0/2102645982 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f869006d7f0 0x7f869006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.550+0000 7f86a6ffd700 1 --2- 172.21.15.134:0/2102645982 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f869006d7f0 0x7f869006fca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f86a810f3c0 tx=0x7f869c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.555+0000 7f868ffff700 1 -- 172.21.15.134:0/2102645982 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8698059ee0 con 0x7f86a80fb570 2024-02-16T22:28:16.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.763+0000 7f86ae1a1700 1 -- 172.21.15.134:0/2102645982 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f86a804bed0 con 0x7f869006d7f0 2024-02-16T22:28:16.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.773+0000 7f868ffff700 1 -- 172.21.15.134:0/2102645982 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f86a804bed0 con 0x7f869006d7f0 2024-02-16T22:28:16.775 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:28:16.775 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (6m) 119s ago 17m 26.5M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:28:16.775 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (3m) 119s ago 17m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 429739bfee94 2024-02-16T22:28:16.776 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (3m) 19s ago 16m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 1e81cd2fd510 2024-02-16T22:28:16.776 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (5m) 119s ago 16m 87.0M - 9.4.12 a0ea5e3c46d9 29d29cf667e7 2024-02-16T22:28:16.776 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 starting - - - - 2024-02-16T22:28:16.776 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (11m) 119s ago 11m 125M - 17.2.7-513-gb88fae66 870a0944ccb8 84ed020a4a47 2024-02-16T22:28:16.776 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (11m) 19s ago 11m 17.7M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:28:16.776 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (11m) 19s ago 11m 118M - 17.2.7-513-gb88fae66 870a0944ccb8 c34aec22fb13 2024-02-16T22:28:16.776 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (7m) 119s ago 18m 503M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:28:16.776 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (6m) 19s ago 16m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:28:16.776 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (4m) 119s ago 18m 46.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2903b3988442 2024-02-16T22:28:16.776 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (4m) 19s ago 16m 41.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a dd7cf2f31226 2024-02-16T22:28:16.777 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 119s ago 17m 16.4M - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:28:16.777 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (6m) 19s ago 16m 14.7M - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:28:16.777 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (3m) 119s ago 15m 91.9M 1557M 19.0.0-1450-gf78a58c0 f081f847070a d0153b47ae7e 2024-02-16T22:28:16.777 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (2m) 119s ago 14m 91.4M 1557M 19.0.0-1450-gf78a58c0 f081f847070a dd1faac850b0 2024-02-16T22:28:16.777 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (2m) 119s ago 14m 12.6M 1557M 19.0.0-1450-gf78a58c0 f081f847070a 0e349c665c73 2024-02-16T22:28:16.777 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (89s) 19s ago 13m 99.3M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 1f4624a5418b 2024-02-16T22:28:16.777 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (56s) 19s ago 13m 99.8M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 640d021c13b0 2024-02-16T22:28:16.777 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (22s) 19s ago 13m 13.5M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 8ee59c4c4319 2024-02-16T22:28:16.777 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (6m) 119s ago 16m 61.6M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:28:16.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.775+0000 7f86ae1a1700 1 -- 172.21.15.134:0/2102645982 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f869006d7f0 msgr2=0x7f869006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:16.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.775+0000 7f86ae1a1700 1 --2- 172.21.15.134:0/2102645982 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f869006d7f0 0x7f869006fca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f86a810f3c0 tx=0x7f869c009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:16.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.775+0000 7f86ae1a1700 1 -- 172.21.15.134:0/2102645982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a80fb570 msgr2=0x7f86a8113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:16.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.775+0000 7f86ae1a1700 1 --2- 172.21.15.134:0/2102645982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a80fb570 0x7f86a8113b90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f869800eb40 tx=0x7f869800b040 comp rx=0 tx=0).stop 2024-02-16T22:28:16.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.775+0000 7f86ae1a1700 1 -- 172.21.15.134:0/2102645982 shutdown_connections 2024-02-16T22:28:16.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.775+0000 7f86ae1a1700 1 --2- 172.21.15.134:0/2102645982 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f869006d7f0 0x7f869006fca0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.775+0000 7f86ae1a1700 1 --2- 172.21.15.134:0/2102645982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a80fb570 0x7f86a8113b90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.775+0000 7f86ae1a1700 1 --2- 172.21.15.134:0/2102645982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86a8103140 0x7f86a81140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.775+0000 7f86ae1a1700 1 -- 172.21.15.134:0/2102645982 >> 172.21.15.134:0/2102645982 conn(0x7f86a8071560 msgr2=0x7f86a80f97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:16.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.776+0000 7f86ae1a1700 1 -- 172.21.15.134:0/2102645982 shutdown_connections 2024-02-16T22:28:16.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.776+0000 7f86ae1a1700 1 -- 172.21.15.134:0/2102645982 wait complete. 2024-02-16T22:28:16.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.880+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3948526312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc1016b0 msgr2=0x7f2ebc101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:16.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.880+0000 7f2ec3c8b700 1 --2- 172.21.15.134:0/3948526312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc1016b0 0x7f2ebc101a80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8004a50 tx=0x7f2eb800af40 comp rx=0 tx=0).stop 2024-02-16T22:28:16.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.880+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3948526312 shutdown_connections 2024-02-16T22:28:16.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.880+0000 7f2ec3c8b700 1 --2- 172.21.15.134:0/3948526312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ebc0fb6c0 0x7f2ebc0fbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.880+0000 7f2ec3c8b700 1 --2- 172.21.15.134:0/3948526312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc1016b0 0x7f2ebc101a80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.880+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3948526312 >> 172.21.15.134:0/3948526312 conn(0x7f2ebc071560 msgr2=0x7f2ebc071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:16.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.880+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3948526312 shutdown_connections 2024-02-16T22:28:16.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.880+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3948526312 wait complete. 2024-02-16T22:28:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.881+0000 7f2ec3c8b700 1 Processor -- start 2024-02-16T22:28:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.881+0000 7f2ec3c8b700 1 -- start start 2024-02-16T22:28:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.881+0000 7f2ec3c8b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc0fb6c0 0x7f2ebc111860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.881+0000 7f2ec3c8b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ebc1016b0 0x7f2ebc111da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.881+0000 7f2ec3c8b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc1123f0 con 0x7f2ebc0fb6c0 2024-02-16T22:28:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.881+0000 7f2ec3c8b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc10b720 con 0x7f2ebc1016b0 2024-02-16T22:28:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.882+0000 7f2ec1a27700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc0fb6c0 0x7f2ebc111860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.882+0000 7f2ec1a27700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc0fb6c0 0x7f2ebc111860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34418/0 (socket says 172.21.15.134:34418) 2024-02-16T22:28:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.882+0000 7f2ec1a27700 1 -- 172.21.15.134:0/3523364315 learned_addr learned my addr 172.21.15.134:0/3523364315 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:28:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.882+0000 7f2ec1226700 1 --2- 172.21.15.134:0/3523364315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ebc1016b0 0x7f2ebc111da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.882+0000 7f2ec1a27700 1 -- 172.21.15.134:0/3523364315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ebc1016b0 msgr2=0x7f2ebc111da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:16.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.882+0000 7f2ec1a27700 1 --2- 172.21.15.134:0/3523364315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ebc1016b0 0x7f2ebc111da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:16.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.882+0000 7f2ec1a27700 1 -- 172.21.15.134:0/3523364315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8005040 con 0x7f2ebc0fb6c0 2024-02-16T22:28:16.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.882+0000 7f2ec1226700 1 --2- 172.21.15.134:0/3523364315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ebc1016b0 0x7f2ebc111da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:28:16.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.882+0000 7f2ec1a27700 1 --2- 172.21.15.134:0/3523364315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc0fb6c0 0x7f2ebc111860 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800aaf0 tx=0x7f2eb800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:16.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.882+0000 7f2eb27fc700 1 -- 172.21.15.134:0/3523364315 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb800f040 con 0x7f2ebc0fb6c0 2024-02-16T22:28:16.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.882+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3523364315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc10b9a0 con 0x7f2ebc0fb6c0 2024-02-16T22:28:16.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.882+0000 7f2eb27fc700 1 -- 172.21.15.134:0/3523364315 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2eb800ac00 con 0x7f2ebc0fb6c0 2024-02-16T22:28:16.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.882+0000 7f2eb27fc700 1 -- 172.21.15.134:0/3523364315 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb801e650 con 0x7f2ebc0fb6c0 2024-02-16T22:28:16.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.882+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3523364315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc10bee0 con 0x7f2ebc0fb6c0 2024-02-16T22:28:16.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.883+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3523364315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc103b30 con 0x7f2ebc0fb6c0 2024-02-16T22:28:16.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.884+0000 7f2eb27fc700 1 -- 172.21.15.134:0/3523364315 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2eb8014980 con 0x7f2ebc0fb6c0 2024-02-16T22:28:16.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.885+0000 7f2eb27fc700 1 --2- 172.21.15.134:0/3523364315 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f2ea806d7e0 0x7f2ea806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:16.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.885+0000 7f2ec1226700 1 --2- 172.21.15.134:0/3523364315 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f2ea806d7e0 0x7f2ea806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:16.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.885+0000 7f2eb27fc700 1 -- 172.21.15.134:0/3523364315 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2eb8090c20 con 0x7f2ebc0fb6c0 2024-02-16T22:28:16.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.885+0000 7f2ec1226700 1 --2- 172.21.15.134:0/3523364315 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f2ea806d7e0 0x7f2ea806fc90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009fd0 tx=0x7f2eac009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:16.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:16.889+0000 7f2eb27fc700 1 -- 172.21.15.134:0/3523364315 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2eb805dff0 con 0x7f2ebc0fb6c0 2024-02-16T22:28:17.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.174+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3523364315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2ebc04bed0 con 0x7f2ebc0fb6c0 2024-02-16T22:28:17.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.174+0000 7f2eb27fc700 1 -- 172.21.15.134:0/3523364315 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f2eb805db80 con 0x7f2ebc0fb6c0 2024-02-16T22:28:17.176 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:28:17.176 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:28:17.176 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:28:17.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:28:17.177 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:28:17.177 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:28:17.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:28:17.177 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:28:17.177 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-16T22:28:17.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:28:17.177 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:28:17.177 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 3, 2024-02-16T22:28:17.177 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-16T22:28:17.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:28:17.177 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:28:17.177 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 3, 2024-02-16T22:28:17.177 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 11 2024-02-16T22:28:17.178 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:28:17.178 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:28:17.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.176+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3523364315 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f2ea806d7e0 msgr2=0x7f2ea806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:17.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.176+0000 7f2ec3c8b700 1 --2- 172.21.15.134:0/3523364315 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f2ea806d7e0 0x7f2ea806fc90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009fd0 tx=0x7f2eac009ee0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.176+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3523364315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc0fb6c0 msgr2=0x7f2ebc111860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:17.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.176+0000 7f2ec3c8b700 1 --2- 172.21.15.134:0/3523364315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc0fb6c0 0x7f2ebc111860 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800aaf0 tx=0x7f2eb800af40 comp rx=0 tx=0).stop 2024-02-16T22:28:17.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.176+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3523364315 shutdown_connections 2024-02-16T22:28:17.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.176+0000 7f2ec3c8b700 1 --2- 172.21.15.134:0/3523364315 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f2ea806d7e0 0x7f2ea806fc90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.176+0000 7f2ec3c8b700 1 --2- 172.21.15.134:0/3523364315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ebc0fb6c0 0x7f2ebc111860 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.176+0000 7f2ec3c8b700 1 --2- 172.21.15.134:0/3523364315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ebc1016b0 0x7f2ebc111da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.176+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3523364315 >> 172.21.15.134:0/3523364315 conn(0x7f2ebc071560 msgr2=0x7f2ebc0fa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:17.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.176+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3523364315 shutdown_connections 2024-02-16T22:28:17.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.176+0000 7f2ec3c8b700 1 -- 172.21.15.134:0/3523364315 wait complete. 2024-02-16T22:28:17.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.278+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2725493463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fa01027e0 msgr2=0x7f7fa00fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:17.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.278+0000 7f7fa4b32700 1 --2- 172.21.15.134:0/2725493463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fa01027e0 0x7f7fa00fbea0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7f94004940 tx=0x7f7f94009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:17.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.278+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2725493463 shutdown_connections 2024-02-16T22:28:17.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.278+0000 7f7fa4b32700 1 --2- 172.21.15.134:0/2725493463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fa01027e0 0x7f7fa00fbea0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.278+0000 7f7fa4b32700 1 --2- 172.21.15.134:0/2725493463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fa0101e40 0x7f7fa0102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.278+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2725493463 >> 172.21.15.134:0/2725493463 conn(0x7f7fa0071d90 msgr2=0x7f7fa0072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:17.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.278+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2725493463 shutdown_connections 2024-02-16T22:28:17.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.278+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2725493463 wait complete. 2024-02-16T22:28:17.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7fa4b32700 1 Processor -- start 2024-02-16T22:28:17.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7fa4b32700 1 -- start start 2024-02-16T22:28:17.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7fa4b32700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fa0101e40 0x7f7fa010eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:17.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7fa4b32700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fa01027e0 0x7f7fa010f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:17.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7fa4b32700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa010f600 con 0x7f7fa01027e0 2024-02-16T22:28:17.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7fa4b32700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa010f770 con 0x7f7fa0101e40 2024-02-16T22:28:17.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7f9dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fa01027e0 0x7f7fa010f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:17.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7f9dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fa01027e0 0x7f7fa010f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34438/0 (socket says 172.21.15.134:34438) 2024-02-16T22:28:17.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7f9dd9b700 1 -- 172.21.15.134:0/2064450379 learned_addr learned my addr 172.21.15.134:0/2064450379 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:28:17.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7f9e59c700 1 --2- 172.21.15.134:0/2064450379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fa0101e40 0x7f7fa010eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:17.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7f9dd9b700 1 -- 172.21.15.134:0/2064450379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fa0101e40 msgr2=0x7f7fa010eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:17.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7f9dd9b700 1 --2- 172.21.15.134:0/2064450379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fa0101e40 0x7f7fa010eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7f9dd9b700 1 -- 172.21.15.134:0/2064450379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f94005040 con 0x7f7fa01027e0 2024-02-16T22:28:17.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7f9e59c700 1 --2- 172.21.15.134:0/2064450379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fa0101e40 0x7f7fa010eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:28:17.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.279+0000 7f7f9dd9b700 1 --2- 172.21.15.134:0/2064450379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fa01027e0 0x7f7fa010f050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7f940090d0 tx=0x7f7f94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:17.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.280+0000 7f7f8effd700 1 -- 172.21.15.134:0/2064450379 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f9400e040 con 0x7f7fa01027e0 2024-02-16T22:28:17.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.280+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2064450379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa0117a80 con 0x7f7fa01027e0 2024-02-16T22:28:17.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.280+0000 7f7f8effd700 1 -- 172.21.15.134:0/2064450379 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f9400bbf0 con 0x7f7fa01027e0 2024-02-16T22:28:17.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.280+0000 7f7f8effd700 1 -- 172.21.15.134:0/2064450379 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f9401c630 con 0x7f7fa01027e0 2024-02-16T22:28:17.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.280+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2064450379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa0117f90 con 0x7f7fa01027e0 2024-02-16T22:28:17.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.281+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2064450379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa0104310 con 0x7f7fa01027e0 2024-02-16T22:28:17.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.281+0000 7f7f8effd700 1 -- 172.21.15.134:0/2064450379 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f7f9400bd60 con 0x7f7fa01027e0 2024-02-16T22:28:17.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.281+0000 7f7f8effd700 1 --2- 172.21.15.134:0/2064450379 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f7f8806d7e0 0x7f7f8806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:17.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.282+0000 7f7f8effd700 1 -- 172.21.15.134:0/2064450379 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f7f9408e260 con 0x7f7fa01027e0 2024-02-16T22:28:17.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.282+0000 7f7f9e59c700 1 --2- 172.21.15.134:0/2064450379 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f7f8806d7e0 0x7f7f8806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:17.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.282+0000 7f7f9e59c700 1 --2- 172.21.15.134:0/2064450379 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f7f8806d7e0 0x7f7f8806fc90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7f98004550 tx=0x7f7f98009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:17.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.286+0000 7f7f8effd700 1 -- 172.21.15.134:0/2064450379 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7f94057ad0 con 0x7f7fa01027e0 2024-02-16T22:28:17.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:17 smithi134 ceph-mon[112514]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:17.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:17 smithi173 ceph-mon[83703]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:17.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.533+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2064450379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7fa00738b0 con 0x7f7fa01027e0 2024-02-16T22:28:17.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.534+0000 7f7f8effd700 1 -- 172.21.15.134:0/2064450379 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f7f94013e60 con 0x7f7fa01027e0 2024-02-16T22:28:17.536 INFO:teuthology.orchestra.run.smithi134.stdout:e24 2024-02-16T22:28:17.536 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:28:17.536 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:28:17.536 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-02-16T22:28:17.536 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:28:17.536 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-02-16T22:28:17.536 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-02-16T22:28:17.537 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 21 2024-02-16T22:28:17.537 INFO:teuthology.orchestra.run.smithi134.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-16T22:28:17.537 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:28:17.537 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-02-16T22:28:03.434248+0000 2024-02-16T22:28:17.537 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-02-16T22:28:17.537 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-02-16T22:28:17.537 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-02-16T22:28:17.537 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-02-16T22:28:17.537 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-02-16T22:28:17.537 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-02-16T22:28:17.537 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-02-16T22:28:17.537 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-02-16T22:28:17.537 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 81 2024-02-16T22:28:17.537 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 2 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout:in 0,1 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout:up {} 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout:failed 0,1 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:28:17.538 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-02-16T22:28:17.539 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:28:17.539 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.phstvm{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:28:17.539 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.jyajef{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6828/3228039321,v1:172.21.15.134:6829/3228039321] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:28:17.539 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.cygfxr{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/845650190,v1:172.21.15.134:6827/845650190] compat {c=[1],r=[1],i=[fff]}] 2024-02-16T22:28:17.539 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.qljqef{-1:44269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.173:6824/1069817513,v1:172.21.15.173:6825/1069817513] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:28:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.536+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2064450379 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f7f8806d7e0 msgr2=0x7f7f8806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.536+0000 7f7fa4b32700 1 --2- 172.21.15.134:0/2064450379 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f7f8806d7e0 0x7f7f8806fc90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7f98004550 tx=0x7f7f98009040 comp rx=0 tx=0).stop 2024-02-16T22:28:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.536+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2064450379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fa01027e0 msgr2=0x7f7fa010f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.536+0000 7f7fa4b32700 1 --2- 172.21.15.134:0/2064450379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fa01027e0 0x7f7fa010f050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7f940090d0 tx=0x7f7f94009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.536+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2064450379 shutdown_connections 2024-02-16T22:28:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.536+0000 7f7fa4b32700 1 --2- 172.21.15.134:0/2064450379 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f7f8806d7e0 0x7f7f8806fc90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.536+0000 7f7fa4b32700 1 --2- 172.21.15.134:0/2064450379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fa0101e40 0x7f7fa010eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.536+0000 7f7fa4b32700 1 --2- 172.21.15.134:0/2064450379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fa01027e0 0x7f7fa010f050 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.536+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2064450379 >> 172.21.15.134:0/2064450379 conn(0x7f7fa0071d90 msgr2=0x7f7fa00fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.536+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2064450379 shutdown_connections 2024-02-16T22:28:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.536+0000 7f7fa4b32700 1 -- 172.21.15.134:0/2064450379 wait complete. 2024-02-16T22:28:17.540 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 24 2024-02-16T22:28:17.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.642+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1841891844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5e4102880 msgr2=0x7fc5e40fc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:17.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.642+0000 7fc5eb1f9700 1 --2- 172.21.15.134:0/1841891844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5e4102880 0x7fc5e40fc680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0004940 tx=0x7fc5d0009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:17.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.643+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1841891844 shutdown_connections 2024-02-16T22:28:17.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.643+0000 7fc5eb1f9700 1 --2- 172.21.15.134:0/1841891844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5e4102880 0x7fc5e40fc680 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.643+0000 7fc5eb1f9700 1 --2- 172.21.15.134:0/1841891844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5e4101ee0 0x7fc5e41022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.643+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1841891844 >> 172.21.15.134:0/1841891844 conn(0x7fc5e4071560 msgr2=0x7fc5e4071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:17.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.643+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1841891844 shutdown_connections 2024-02-16T22:28:17.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.643+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1841891844 wait complete. 2024-02-16T22:28:17.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.643+0000 7fc5eb1f9700 1 Processor -- start 2024-02-16T22:28:17.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.643+0000 7fc5eb1f9700 1 -- start start 2024-02-16T22:28:17.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.644+0000 7fc5eb1f9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5e4101ee0 0x7fc5e410eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:17.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.644+0000 7fc5eb1f9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5e4102880 0x7fc5e410f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:17.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.644+0000 7fc5eb1f9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e410f680 con 0x7fc5e4101ee0 2024-02-16T22:28:17.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.644+0000 7fc5eb1f9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e410f7c0 con 0x7fc5e4102880 2024-02-16T22:28:17.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.644+0000 7fc5e8f95700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5e4101ee0 0x7fc5e410eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:17.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.644+0000 7fc5e8f95700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5e4101ee0 0x7fc5e410eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34458/0 (socket says 172.21.15.134:34458) 2024-02-16T22:28:17.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.644+0000 7fc5e8f95700 1 -- 172.21.15.134:0/1932615123 learned_addr learned my addr 172.21.15.134:0/1932615123 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:28:17.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.644+0000 7fc5e3fff700 1 --2- 172.21.15.134:0/1932615123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5e4102880 0x7fc5e410f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:17.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.644+0000 7fc5e8f95700 1 -- 172.21.15.134:0/1932615123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5e4102880 msgr2=0x7fc5e410f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:17.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.644+0000 7fc5e8f95700 1 --2- 172.21.15.134:0/1932615123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5e4102880 0x7fc5e410f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.644+0000 7fc5e8f95700 1 -- 172.21.15.134:0/1932615123 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d0005040 con 0x7fc5e4101ee0 2024-02-16T22:28:17.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.644+0000 7fc5e3fff700 1 --2- 172.21.15.134:0/1932615123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5e4102880 0x7fc5e410f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:28:17.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.644+0000 7fc5e8f95700 1 --2- 172.21.15.134:0/1932615123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5e4101ee0 0x7fc5e410eb20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800b7c0 tx=0x7fc5d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:17.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.645+0000 7fc5e17fa700 1 -- 172.21.15.134:0/1932615123 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d800f6f0 con 0x7fc5e4101ee0 2024-02-16T22:28:17.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.645+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1932615123 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e4117af0 con 0x7fc5e4101ee0 2024-02-16T22:28:17.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.645+0000 7fc5e17fa700 1 -- 172.21.15.134:0/1932615123 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5d800fd20 con 0x7fc5e4101ee0 2024-02-16T22:28:17.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.645+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1932615123 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e4118030 con 0x7fc5e4101ee0 2024-02-16T22:28:17.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.645+0000 7fc5e17fa700 1 -- 172.21.15.134:0/1932615123 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d80103a0 con 0x7fc5e4101ee0 2024-02-16T22:28:17.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.646+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1932615123 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e4073080 con 0x7fc5e4101ee0 2024-02-16T22:28:17.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.646+0000 7fc5e17fa700 1 -- 172.21.15.134:0/1932615123 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fc5d800f850 con 0x7fc5e4101ee0 2024-02-16T22:28:17.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.647+0000 7fc5e17fa700 1 --2- 172.21.15.134:0/1932615123 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc5d406d7e0 0x7fc5d406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:17.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.647+0000 7fc5e17fa700 1 -- 172.21.15.134:0/1932615123 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc5d808cd80 con 0x7fc5e4101ee0 2024-02-16T22:28:17.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.647+0000 7fc5e3fff700 1 --2- 172.21.15.134:0/1932615123 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc5d406d7e0 0x7fc5d406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:17.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.647+0000 7fc5e3fff700 1 --2- 172.21.15.134:0/1932615123 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc5d406d7e0 0x7fc5d406fc90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000b3b0 tx=0x7fc5d0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:17.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.651+0000 7fc5e17fa700 1 -- 172.21.15.134:0/1932615123 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc5d80565f0 con 0x7fc5e4101ee0 2024-02-16T22:28:17.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.877+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1932615123 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5e40fbe80 con 0x7fc5d406d7e0 2024-02-16T22:28:17.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.879+0000 7fc5e17fa700 1 -- 172.21.15.134:0/1932615123 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc5e40fbe80 con 0x7fc5d406d7e0 2024-02-16T22:28:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:28:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:28:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:28:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-16T22:28:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-02-16T22:28:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-02-16T22:28:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-02-16T22:28:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-02-16T22:28:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "osd" 2024-02-16T22:28:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-02-16T22:28:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "13/21 daemons upgraded", 2024-02-16T22:28:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mds daemons", 2024-02-16T22:28:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:28:17.881 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:28:17.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.881+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1932615123 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc5d406d7e0 msgr2=0x7fc5d406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:17.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.881+0000 7fc5eb1f9700 1 --2- 172.21.15.134:0/1932615123 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc5d406d7e0 0x7fc5d406fc90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000b3b0 tx=0x7fc5d0009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:17.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.881+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1932615123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5e4101ee0 msgr2=0x7fc5e410eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:17.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.881+0000 7fc5eb1f9700 1 --2- 172.21.15.134:0/1932615123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5e4101ee0 0x7fc5e410eb20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800b7c0 tx=0x7fc5d8009250 comp rx=0 tx=0).stop 2024-02-16T22:28:17.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.881+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1932615123 shutdown_connections 2024-02-16T22:28:17.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.881+0000 7fc5eb1f9700 1 --2- 172.21.15.134:0/1932615123 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc5d406d7e0 0x7fc5d406fc90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.881+0000 7fc5eb1f9700 1 --2- 172.21.15.134:0/1932615123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5e4101ee0 0x7fc5e410eb20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.881+0000 7fc5eb1f9700 1 --2- 172.21.15.134:0/1932615123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5e4102880 0x7fc5e410f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.881+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1932615123 >> 172.21.15.134:0/1932615123 conn(0x7fc5e4071560 msgr2=0x7fc5e40fa470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:17.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.881+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1932615123 shutdown_connections 2024-02-16T22:28:17.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.881+0000 7fc5eb1f9700 1 -- 172.21.15.134:0/1932615123 wait complete. 2024-02-16T22:28:17.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.988+0000 7f97a590a700 1 -- 172.21.15.134:0/914895817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97a0105160 msgr2=0x7f97a0105530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.988+0000 7f97a590a700 1 --2- 172.21.15.134:0/914895817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97a0105160 0x7f97a0105530 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9794004940 tx=0x7f9794009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.988+0000 7f97a590a700 1 -- 172.21.15.134:0/914895817 shutdown_connections 2024-02-16T22:28:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.988+0000 7f97a590a700 1 --2- 172.21.15.134:0/914895817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a0105b00 0x7f97a00ff170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.988+0000 7f97a590a700 1 --2- 172.21.15.134:0/914895817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97a0105160 0x7f97a0105530 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.988+0000 7f97a590a700 1 -- 172.21.15.134:0/914895817 >> 172.21.15.134:0/914895817 conn(0x7f97a00facb0 msgr2=0x7f97a00fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.988+0000 7f97a590a700 1 -- 172.21.15.134:0/914895817 shutdown_connections 2024-02-16T22:28:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.988+0000 7f97a590a700 1 -- 172.21.15.134:0/914895817 wait complete. 2024-02-16T22:28:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.989+0000 7f97a590a700 1 Processor -- start 2024-02-16T22:28:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.989+0000 7f97a590a700 1 -- start start 2024-02-16T22:28:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.989+0000 7f97a590a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a0105160 0x7f97a0115cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.989+0000 7f97a590a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97a0105b00 0x7f97a01161f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.989+0000 7f97a590a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a0116840 con 0x7f97a0105b00 2024-02-16T22:28:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.989+0000 7f97a590a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a010fb50 con 0x7f97a0105160 2024-02-16T22:28:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.989+0000 7f979e7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97a0105b00 0x7f97a01161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.989+0000 7f979e7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97a0105b00 0x7f97a01161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34462/0 (socket says 172.21.15.134:34462) 2024-02-16T22:28:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.989+0000 7f979e7fc700 1 -- 172.21.15.134:0/2721966916 learned_addr learned my addr 172.21.15.134:0/2721966916 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:28:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.989+0000 7f979effd700 1 --2- 172.21.15.134:0/2721966916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a0105160 0x7f97a0115cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.989+0000 7f979e7fc700 1 -- 172.21.15.134:0/2721966916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a0105160 msgr2=0x7f97a0115cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.989+0000 7f979e7fc700 1 --2- 172.21.15.134:0/2721966916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a0105160 0x7f97a0115cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.989+0000 7f979e7fc700 1 -- 172.21.15.134:0/2721966916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9794005040 con 0x7f97a0105b00 2024-02-16T22:28:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.990+0000 7f979e7fc700 1 --2- 172.21.15.134:0/2721966916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97a0105b00 0x7f97a01161f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9790002a50 tx=0x7f9790004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.990+0000 7f97877fe700 1 -- 172.21.15.134:0/2721966916 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9790007cc0 con 0x7f97a0105b00 2024-02-16T22:28:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.990+0000 7f97877fe700 1 -- 172.21.15.134:0/2721966916 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f979000f040 con 0x7f97a0105b00 2024-02-16T22:28:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.990+0000 7f97a590a700 1 -- 172.21.15.134:0/2721966916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a010fe30 con 0x7f97a0105b00 2024-02-16T22:28:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.990+0000 7f97877fe700 1 -- 172.21.15.134:0/2721966916 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f979000da40 con 0x7f97a0105b00 2024-02-16T22:28:17.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.990+0000 7f97a590a700 1 -- 172.21.15.134:0/2721966916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a0110370 con 0x7f97a0105b00 2024-02-16T22:28:17.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.991+0000 7f97a590a700 1 -- 172.21.15.134:0/2721966916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a0102470 con 0x7f97a0105b00 2024-02-16T22:28:17.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.992+0000 7f97877fe700 1 -- 172.21.15.134:0/2721966916 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f97900097c0 con 0x7f97a0105b00 2024-02-16T22:28:17.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.992+0000 7f97877fe700 1 --2- 172.21.15.134:0/2721966916 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f978806d7e0 0x7f978806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:17.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.992+0000 7f97877fe700 1 -- 172.21.15.134:0/2721966916 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f979008cd20 con 0x7f97a0105b00 2024-02-16T22:28:17.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.992+0000 7f979effd700 1 --2- 172.21.15.134:0/2721966916 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f978806d7e0 0x7f978806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:17.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.993+0000 7f979effd700 1 --2- 172.21.15.134:0/2721966916 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f978806d7e0 0x7f978806fc90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9794004f90 tx=0x7f9794009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:17.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:17.997+0000 7f97877fe700 1 -- 172.21.15.134:0/2721966916 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9790059db0 con 0x7f97a0105b00 2024-02-16T22:28:18.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:18.284+0000 7f97a590a700 1 -- 172.21.15.134:0/2721966916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f97a00fe8f0 con 0x7f97a0105b00 2024-02-16T22:28:18.286 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:18 smithi134 ceph-mon[112514]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:18.286 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:18 smithi134 ceph-mon[112514]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:18.286 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:18 smithi134 ceph-mon[112514]: pgmap v176: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:18.286 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:18 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/3523364315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:18.286 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:18 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:18.287 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:18 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:18.287 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:18 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2064450379' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:28:18.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:18.284+0000 7f97877fe700 1 -- 172.21.15.134:0/2721966916 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f9790059bd0 con 0x7f97a0105b00 2024-02-16T22:28:18.287 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-16T22:28:18.287 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-16T22:28:18.287 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs is degraded 2024-02-16T22:28:18.287 INFO:teuthology.orchestra.run.smithi134.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-16T22:28:18.288 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-16T22:28:18.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:18.287+0000 7f97a590a700 1 -- 172.21.15.134:0/2721966916 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f978806d7e0 msgr2=0x7f978806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:18.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:18.287+0000 7f97a590a700 1 --2- 172.21.15.134:0/2721966916 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f978806d7e0 0x7f978806fc90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9794004f90 tx=0x7f9794009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:18.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:18.287+0000 7f97a590a700 1 -- 172.21.15.134:0/2721966916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97a0105b00 msgr2=0x7f97a01161f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:18.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:18.287+0000 7f97a590a700 1 --2- 172.21.15.134:0/2721966916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97a0105b00 0x7f97a01161f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9790002a50 tx=0x7f9790004600 comp rx=0 tx=0).stop 2024-02-16T22:28:18.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:18.287+0000 7f97a590a700 1 -- 172.21.15.134:0/2721966916 shutdown_connections 2024-02-16T22:28:18.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:18.287+0000 7f97a590a700 1 --2- 172.21.15.134:0/2721966916 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f978806d7e0 0x7f978806fc90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:18.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:18.287+0000 7f97a590a700 1 --2- 172.21.15.134:0/2721966916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a0105160 0x7f97a0115cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:18.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:18.287+0000 7f97a590a700 1 --2- 172.21.15.134:0/2721966916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97a0105b00 0x7f97a01161f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:18.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:18.287+0000 7f97a590a700 1 -- 172.21.15.134:0/2721966916 >> 172.21.15.134:0/2721966916 conn(0x7f97a00facb0 msgr2=0x7f97a00fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:18.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:18.287+0000 7f97a590a700 1 -- 172.21.15.134:0/2721966916 shutdown_connections 2024-02-16T22:28:18.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:18.287+0000 7f97a590a700 1 -- 172.21.15.134:0/2721966916 wait complete. 2024-02-16T22:28:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:18 smithi173 ceph-mon[83703]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:18 smithi173 ceph-mon[83703]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:18 smithi173 ceph-mon[83703]: pgmap v176: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:18 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/3523364315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:18 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:18.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:18 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:18.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:18 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2064450379' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:28:19.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:19 smithi134 ceph-mon[112514]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:19.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:19 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2721966916' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:28:19.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:19 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:19.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:19 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:19 smithi173 ceph-mon[83703]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:19 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2721966916' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:28:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:19 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:19 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:20.393 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:20 smithi134 ceph-mon[112514]: pgmap v177: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:20 smithi173 ceph-mon[83703]: pgmap v177: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:22.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:22 smithi134 ceph-mon[112514]: pgmap v178: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:22.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:22 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:28:22.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:22 smithi173 ceph-mon[83703]: pgmap v178: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:22 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:28:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:28:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:23.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:28:23.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:23.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:23.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:23.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:23 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:23.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:23 smithi134 ceph-mon[112514]: pgmap v179: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:28:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:28:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:23 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:23.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:23 smithi173 ceph-mon[83703]: pgmap v179: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:25.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:24 smithi134 ceph-mon[112514]: Upgrade: Updating mds.cephfs.smithi134.jyajef 2024-02-16T22:28:25.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:24 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:25.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:24 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jyajef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:28:25.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:24 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:25.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:24 smithi134 ceph-mon[112514]: Deploying daemon mds.cephfs.smithi134.jyajef on smithi134 2024-02-16T22:28:25.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:24 smithi173 ceph-mon[83703]: Upgrade: Updating mds.cephfs.smithi134.jyajef 2024-02-16T22:28:25.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:24 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:25.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:24 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jyajef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:28:25.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:24 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:25.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:24 smithi173 ceph-mon[83703]: Deploying daemon mds.cephfs.smithi134.jyajef on smithi134 2024-02-16T22:28:26.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:25 smithi134 ceph-mon[112514]: pgmap v180: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:26.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:25 smithi173 ceph-mon[83703]: pgmap v180: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:28.169 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:27 smithi134 ceph-mon[112514]: osdmap e83: 6 total, 6 up, 6 in 2024-02-16T22:28:28.170 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:27 smithi134 ceph-mon[112514]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-16T22:28:28.170 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:27 smithi134 ceph-mon[112514]: pgmap v182: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:28.283 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:27 smithi173 ceph-mon[83703]: osdmap e83: 6 total, 6 up, 6 in 2024-02-16T22:28:28.283 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:27 smithi173 ceph-mon[83703]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-16T22:28:28.283 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:27 smithi173 ceph-mon[83703]: pgmap v182: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:30.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:30 smithi134 ceph-mon[112514]: pgmap v183: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:30.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:30 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:30.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:30 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:30.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:30 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:28:30.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:30 smithi173 ceph-mon[83703]: pgmap v183: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:30 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:30 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:30.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:30 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:28:31.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:31 smithi134 ceph-mon[112514]: mds.? [v2:172.21.15.134:6828/3664331772,v1:172.21.15.134:6829/3664331772] up:boot 2024-02-16T22:28:31.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:31 smithi134 ceph-mon[112514]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-16T22:28:31.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:31 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jyajef"}]: dispatch 2024-02-16T22:28:31.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:31 smithi173 ceph-mon[83703]: mds.? [v2:172.21.15.134:6828/3664331772,v1:172.21.15.134:6829/3664331772] up:boot 2024-02-16T22:28:31.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:31 smithi173 ceph-mon[83703]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-16T22:28:31.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:31 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jyajef"}]: dispatch 2024-02-16T22:28:32.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:32 smithi134 ceph-mon[112514]: pgmap v184: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:32.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:32 smithi173 ceph-mon[83703]: pgmap v184: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:34.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:34 smithi134 ceph-mon[112514]: pgmap v185: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:34.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:34 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:34.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:34 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:34.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:34 smithi173 ceph-mon[83703]: pgmap v185: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:34.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:34 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:34.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:34 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:36.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:36 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:36.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:36 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:36.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:36 smithi134 ceph-mon[112514]: pgmap v186: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:36.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:36 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:36.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:36 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:36.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:36 smithi173 ceph-mon[83703]: pgmap v186: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:37.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:28:37.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:37 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:28:38.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:38 smithi134 ceph-mon[112514]: pgmap v187: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:38.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:38 smithi173 ceph-mon[83703]: pgmap v187: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:39.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:39 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:39.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:39 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:39.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:39 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:39.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:39 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:28:39.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:39 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:39.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:39 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:28:39.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:39 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:39.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:39 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:39.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:39 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:39.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:39 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:39.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:39 smithi134 ceph-mon[112514]: pgmap v188: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:39.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:39 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:39.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:39 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:39.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:39 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:39.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:39 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:28:39.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:39 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:39.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:39 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:28:39.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:39 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:39.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:39 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:39.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:39 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:39.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:39 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:39.982 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:39 smithi173 ceph-mon[83703]: pgmap v188: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:41.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:41 smithi173 ceph-mon[83703]: Upgrade: Updating mds.cephfs.smithi173.qljqef 2024-02-16T22:28:41.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:41 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:41.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:41 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.qljqef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:28:41.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:41 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:41.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:41 smithi173 ceph-mon[83703]: Deploying daemon mds.cephfs.smithi173.qljqef on smithi173 2024-02-16T22:28:41.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:41 smithi173 ceph-mon[83703]: pgmap v189: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:41.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:41 smithi134 ceph-mon[112514]: Upgrade: Updating mds.cephfs.smithi173.qljqef 2024-02-16T22:28:41.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:41 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:41.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:41 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.qljqef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:28:41.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:41 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:41.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:41 smithi134 ceph-mon[112514]: Deploying daemon mds.cephfs.smithi173.qljqef on smithi173 2024-02-16T22:28:41.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:41 smithi134 ceph-mon[112514]: pgmap v189: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:43.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:43 smithi134 ceph-mon[112514]: osdmap e84: 6 total, 6 up, 6 in 2024-02-16T22:28:43.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:43 smithi134 ceph-mon[112514]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-16T22:28:43.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:43 smithi134 ceph-mon[112514]: pgmap v191: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:43.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:43 smithi173 ceph-mon[83703]: osdmap e84: 6 total, 6 up, 6 in 2024-02-16T22:28:43.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:43 smithi173 ceph-mon[83703]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-16T22:28:43.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:43 smithi173 ceph-mon[83703]: pgmap v191: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:46.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:46 smithi173 ceph-mon[83703]: mds.? [v2:172.21.15.173:6824/892474824,v1:172.21.15.173:6825/892474824] up:boot 2024-02-16T22:28:46.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:46 smithi173 ceph-mon[83703]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-16T22:28:46.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.qljqef"}]: dispatch 2024-02-16T22:28:46.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:46 smithi173 ceph-mon[83703]: pgmap v192: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:46.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:46.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:46.232 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:46 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:28:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:46 smithi134 ceph-mon[112514]: mds.? [v2:172.21.15.173:6824/892474824,v1:172.21.15.173:6825/892474824] up:boot 2024-02-16T22:28:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:46 smithi134 ceph-mon[112514]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-16T22:28:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.qljqef"}]: dispatch 2024-02-16T22:28:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:46 smithi134 ceph-mon[112514]: pgmap v192: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:46 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:28:48.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.403+0000 7fba8f43c700 1 -- 172.21.15.134:0/2078910733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba881027e0 msgr2=0x7fba880fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:48.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.403+0000 7fba8f43c700 1 --2- 172.21.15.134:0/2078910733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba881027e0 0x7fba880fbea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fba78004940 tx=0x7fba78009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:48.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.403+0000 7fba8f43c700 1 -- 172.21.15.134:0/2078910733 shutdown_connections 2024-02-16T22:28:48.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.403+0000 7fba8f43c700 1 --2- 172.21.15.134:0/2078910733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba881027e0 0x7fba880fbea0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:48.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.403+0000 7fba8f43c700 1 --2- 172.21.15.134:0/2078910733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba88101e40 0x7fba88102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:48.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.403+0000 7fba8f43c700 1 -- 172.21.15.134:0/2078910733 >> 172.21.15.134:0/2078910733 conn(0x7fba88071d90 msgr2=0x7fba88072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:48.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.404+0000 7fba8f43c700 1 -- 172.21.15.134:0/2078910733 shutdown_connections 2024-02-16T22:28:48.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.404+0000 7fba8f43c700 1 -- 172.21.15.134:0/2078910733 wait complete. 2024-02-16T22:28:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:48 smithi134 ceph-mon[112514]: pgmap v193: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:48 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:48 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:48.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.404+0000 7fba8f43c700 1 Processor -- start 2024-02-16T22:28:48.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.404+0000 7fba8f43c700 1 -- start start 2024-02-16T22:28:48.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.405+0000 7fba8f43c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba88101e40 0x7fba88115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:48.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.405+0000 7fba8f43c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba881027e0 0x7fba881161c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:48.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.405+0000 7fba8f43c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba88116810 con 0x7fba881027e0 2024-02-16T22:28:48.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.405+0000 7fba8f43c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8810fb40 con 0x7fba88101e40 2024-02-16T22:28:48.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.405+0000 7fba8c9d7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba881027e0 0x7fba881161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:48.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.405+0000 7fba8d1d8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba88101e40 0x7fba88115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:48.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.405+0000 7fba8c9d7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba881027e0 0x7fba881161c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49370/0 (socket says 172.21.15.134:49370) 2024-02-16T22:28:48.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.405+0000 7fba8c9d7700 1 -- 172.21.15.134:0/1909323130 learned_addr learned my addr 172.21.15.134:0/1909323130 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:28:48.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.405+0000 7fba8c9d7700 1 -- 172.21.15.134:0/1909323130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba88101e40 msgr2=0x7fba88115c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:48.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.405+0000 7fba8c9d7700 1 --2- 172.21.15.134:0/1909323130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba88101e40 0x7fba88115c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:48.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.405+0000 7fba8c9d7700 1 -- 172.21.15.134:0/1909323130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78005040 con 0x7fba881027e0 2024-02-16T22:28:48.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.405+0000 7fba8d1d8700 1 --2- 172.21.15.134:0/1909323130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba88101e40 0x7fba88115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-16T22:28:48.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.405+0000 7fba8c9d7700 1 --2- 172.21.15.134:0/1909323130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba881027e0 0x7fba881161c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fba78000c00 tx=0x7fba78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:48.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.405+0000 7fba7dffb700 1 -- 172.21.15.134:0/1909323130 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba78021070 con 0x7fba881027e0 2024-02-16T22:28:48.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.406+0000 7fba7dffb700 1 -- 172.21.15.134:0/1909323130 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba78013d00 con 0x7fba881027e0 2024-02-16T22:28:48.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.406+0000 7fba8f43c700 1 -- 172.21.15.134:0/1909323130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8810fdc0 con 0x7fba881027e0 2024-02-16T22:28:48.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.406+0000 7fba7dffb700 1 -- 172.21.15.134:0/1909323130 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba7800e070 con 0x7fba881027e0 2024-02-16T22:28:48.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.406+0000 7fba8f43c700 1 -- 172.21.15.134:0/1909323130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba881102a0 con 0x7fba881027e0 2024-02-16T22:28:48.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.407+0000 7fba8f43c700 1 -- 172.21.15.134:0/1909323130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba880738b0 con 0x7fba881027e0 2024-02-16T22:28:48.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.408+0000 7fba7dffb700 1 -- 172.21.15.134:0/1909323130 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fba7801caf0 con 0x7fba881027e0 2024-02-16T22:28:48.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.408+0000 7fba7dffb700 1 --2- 172.21.15.134:0/1909323130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fba7406d7e0 0x7fba7406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:48.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.408+0000 7fba7dffb700 1 -- 172.21.15.134:0/1909323130 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fba7808e3d0 con 0x7fba881027e0 2024-02-16T22:28:48.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.408+0000 7fba8d1d8700 1 --2- 172.21.15.134:0/1909323130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fba7406d7e0 0x7fba7406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:48.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.409+0000 7fba8d1d8700 1 --2- 172.21.15.134:0/1909323130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fba7406d7e0 0x7fba7406fc90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba84009b80 tx=0x7fba8400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:48.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.413+0000 7fba7dffb700 1 -- 172.21.15.134:0/1909323130 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fba7805b770 con 0x7fba881027e0 2024-02-16T22:28:48.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:48 smithi173 ceph-mon[83703]: pgmap v193: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:48.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:48 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:48.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:48 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:48.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.654+0000 7fba8f43c700 1 -- 172.21.15.134:0/1909323130 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba881111f0 con 0x7fba7406d7e0 2024-02-16T22:28:48.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.655+0000 7fba7dffb700 1 -- 172.21.15.134:0/1909323130 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fba881111f0 con 0x7fba7406d7e0 2024-02-16T22:28:48.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.657+0000 7fba8f43c700 1 -- 172.21.15.134:0/1909323130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fba7406d7e0 msgr2=0x7fba7406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:48.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.657+0000 7fba8f43c700 1 --2- 172.21.15.134:0/1909323130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fba7406d7e0 0x7fba7406fc90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba84009b80 tx=0x7fba8400b040 comp rx=0 tx=0).stop 2024-02-16T22:28:48.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.657+0000 7fba8f43c700 1 -- 172.21.15.134:0/1909323130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba881027e0 msgr2=0x7fba881161c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:48.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.657+0000 7fba8f43c700 1 --2- 172.21.15.134:0/1909323130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba881027e0 0x7fba881161c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fba78000c00 tx=0x7fba78009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:48.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.657+0000 7fba8f43c700 1 -- 172.21.15.134:0/1909323130 shutdown_connections 2024-02-16T22:28:48.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.657+0000 7fba8f43c700 1 --2- 172.21.15.134:0/1909323130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fba7406d7e0 0x7fba7406fc90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:48.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.657+0000 7fba8f43c700 1 --2- 172.21.15.134:0/1909323130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba88101e40 0x7fba88115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:48.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.657+0000 7fba8f43c700 1 --2- 172.21.15.134:0/1909323130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba881027e0 0x7fba881161c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:48.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.657+0000 7fba8f43c700 1 -- 172.21.15.134:0/1909323130 >> 172.21.15.134:0/1909323130 conn(0x7fba88071d90 msgr2=0x7fba88065740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:48.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.657+0000 7fba8f43c700 1 -- 172.21.15.134:0/1909323130 shutdown_connections 2024-02-16T22:28:48.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.657+0000 7fba8f43c700 1 -- 172.21.15.134:0/1909323130 wait complete. 2024-02-16T22:28:48.670 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:28:48.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.761+0000 7f279c6aa700 1 -- 172.21.15.134:0/2561153915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27941038f0 msgr2=0x7f27940fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:48.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.761+0000 7f279c6aa700 1 --2- 172.21.15.134:0/2561153915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27941038f0 0x7f27940fcf60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2784004940 tx=0x7f2784009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:48.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.761+0000 7f279c6aa700 1 -- 172.21.15.134:0/2561153915 shutdown_connections 2024-02-16T22:28:48.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.761+0000 7f279c6aa700 1 --2- 172.21.15.134:0/2561153915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27941038f0 0x7f27940fcf60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:48.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.761+0000 7f279c6aa700 1 --2- 172.21.15.134:0/2561153915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2794102f50 0x7f2794103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:48.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.761+0000 7f279c6aa700 1 -- 172.21.15.134:0/2561153915 >> 172.21.15.134:0/2561153915 conn(0x7f27940f8ae0 msgr2=0x7f27940faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:48.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.761+0000 7f279c6aa700 1 -- 172.21.15.134:0/2561153915 shutdown_connections 2024-02-16T22:28:48.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.761+0000 7f279c6aa700 1 -- 172.21.15.134:0/2561153915 wait complete. 2024-02-16T22:28:48.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.761+0000 7f279c6aa700 1 Processor -- start 2024-02-16T22:28:48.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.761+0000 7f279c6aa700 1 -- start start 2024-02-16T22:28:48.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f279c6aa700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2794102f50 0x7f2794070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:48.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f279c6aa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27941038f0 0x7f27940707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:48.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f279c6aa700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2794070dd0 con 0x7f27941038f0 2024-02-16T22:28:48.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f279c6aa700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2794070f40 con 0x7f2794102f50 2024-02-16T22:28:48.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f2799c45700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27941038f0 0x7f27940707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:48.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f2799c45700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27941038f0 0x7f27940707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49386/0 (socket says 172.21.15.134:49386) 2024-02-16T22:28:48.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f2799c45700 1 -- 172.21.15.134:0/3390001632 learned_addr learned my addr 172.21.15.134:0/3390001632 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:28:48.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f279a446700 1 --2- 172.21.15.134:0/3390001632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2794102f50 0x7f2794070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:48.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f2799c45700 1 -- 172.21.15.134:0/3390001632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2794102f50 msgr2=0x7f2794070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:48.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f2799c45700 1 --2- 172.21.15.134:0/3390001632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2794102f50 0x7f2794070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:48.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f2799c45700 1 -- 172.21.15.134:0/3390001632 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2784005040 con 0x7f27941038f0 2024-02-16T22:28:48.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f2799c45700 1 --2- 172.21.15.134:0/3390001632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27941038f0 0x7f27940707d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f27840090d0 tx=0x7f2784009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:48.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f278affd700 1 -- 172.21.15.134:0/3390001632 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f278400e040 con 0x7f27941038f0 2024-02-16T22:28:48.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f279c6aa700 1 -- 172.21.15.134:0/3390001632 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2794119c40 con 0x7f27941038f0 2024-02-16T22:28:48.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f278affd700 1 -- 172.21.15.134:0/3390001632 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2784009430 con 0x7f27941038f0 2024-02-16T22:28:48.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f278affd700 1 -- 172.21.15.134:0/3390001632 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f278401c3f0 con 0x7f27941038f0 2024-02-16T22:28:48.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.762+0000 7f279c6aa700 1 -- 172.21.15.134:0/3390001632 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279411a0a0 con 0x7f27941038f0 2024-02-16T22:28:48.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.763+0000 7f279c6aa700 1 -- 172.21.15.134:0/3390001632 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2794105420 con 0x7f27941038f0 2024-02-16T22:28:48.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.764+0000 7f278affd700 1 -- 172.21.15.134:0/3390001632 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f278400bbf0 con 0x7f27941038f0 2024-02-16T22:28:48.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.764+0000 7f278affd700 1 --2- 172.21.15.134:0/3390001632 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f278006d7e0 0x7f278006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:48.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.765+0000 7f279a446700 1 --2- 172.21.15.134:0/3390001632 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f278006d7e0 0x7f278006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:48.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.765+0000 7f278affd700 1 -- 172.21.15.134:0/3390001632 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f278408e190 con 0x7f27941038f0 2024-02-16T22:28:48.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.765+0000 7f279a446700 1 --2- 172.21.15.134:0/3390001632 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f278006d7e0 0x7f278006fc90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2790009fd0 tx=0x7f279000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:48.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.769+0000 7f278affd700 1 -- 172.21.15.134:0/3390001632 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2784057a00 con 0x7f27941038f0 2024-02-16T22:28:48.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.981+0000 7f279c6aa700 1 -- 172.21.15.134:0/3390001632 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f27940719d0 con 0x7f278006d7e0 2024-02-16T22:28:48.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.982+0000 7f278affd700 1 -- 172.21.15.134:0/3390001632 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f27940719d0 con 0x7f278006d7e0 2024-02-16T22:28:48.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.985+0000 7f279c6aa700 1 -- 172.21.15.134:0/3390001632 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f278006d7e0 msgr2=0x7f278006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:48.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.985+0000 7f279c6aa700 1 --2- 172.21.15.134:0/3390001632 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f278006d7e0 0x7f278006fc90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2790009fd0 tx=0x7f279000b040 comp rx=0 tx=0).stop 2024-02-16T22:28:48.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.985+0000 7f279c6aa700 1 -- 172.21.15.134:0/3390001632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27941038f0 msgr2=0x7f27940707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:48.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.985+0000 7f279c6aa700 1 --2- 172.21.15.134:0/3390001632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27941038f0 0x7f27940707d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f27840090d0 tx=0x7f2784009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:48.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.985+0000 7f279c6aa700 1 -- 172.21.15.134:0/3390001632 shutdown_connections 2024-02-16T22:28:48.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.985+0000 7f279c6aa700 1 --2- 172.21.15.134:0/3390001632 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f278006d7e0 0x7f278006fc90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:48.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.985+0000 7f279c6aa700 1 --2- 172.21.15.134:0/3390001632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2794102f50 0x7f2794070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:48.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.985+0000 7f279c6aa700 1 --2- 172.21.15.134:0/3390001632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27941038f0 0x7f27940707d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:48.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.985+0000 7f279c6aa700 1 -- 172.21.15.134:0/3390001632 >> 172.21.15.134:0/3390001632 conn(0x7f27940f8ae0 msgr2=0x7f27940fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:48.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.985+0000 7f279c6aa700 1 -- 172.21.15.134:0/3390001632 shutdown_connections 2024-02-16T22:28:48.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:48.985+0000 7f279c6aa700 1 -- 172.21.15.134:0/3390001632 wait complete. 2024-02-16T22:28:49.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.086+0000 7f16e64a5700 1 -- 172.21.15.134:0/1513928369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e01027e0 msgr2=0x7f16e00fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:49.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.086+0000 7f16e64a5700 1 --2- 172.21.15.134:0/1513928369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e01027e0 0x7f16e00fbea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f16d4004940 tx=0x7f16d4009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:49.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.086+0000 7f16e64a5700 1 -- 172.21.15.134:0/1513928369 shutdown_connections 2024-02-16T22:28:49.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.086+0000 7f16e64a5700 1 --2- 172.21.15.134:0/1513928369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e01027e0 0x7f16e00fbea0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.086+0000 7f16e64a5700 1 --2- 172.21.15.134:0/1513928369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16e0101e40 0x7f16e0102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.086+0000 7f16e64a5700 1 -- 172.21.15.134:0/1513928369 >> 172.21.15.134:0/1513928369 conn(0x7f16e0071d90 msgr2=0x7f16e0072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:49.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.086+0000 7f16e64a5700 1 -- 172.21.15.134:0/1513928369 shutdown_connections 2024-02-16T22:28:49.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.086+0000 7f16e64a5700 1 -- 172.21.15.134:0/1513928369 wait complete. 2024-02-16T22:28:49.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.086+0000 7f16e64a5700 1 Processor -- start 2024-02-16T22:28:49.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.087+0000 7f16e64a5700 1 -- start start 2024-02-16T22:28:49.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.087+0000 7f16e64a5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e0101e40 0x7f16e0112970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:49.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.087+0000 7f16e64a5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16e01027e0 0x7f16e0112eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:49.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.087+0000 7f16e64a5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e0113500 con 0x7f16e0101e40 2024-02-16T22:28:49.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.087+0000 7f16e64a5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e010c830 con 0x7f16e01027e0 2024-02-16T22:28:49.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.087+0000 7f16dffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e0101e40 0x7f16e0112970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:49.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.087+0000 7f16dffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e0101e40 0x7f16e0112970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49404/0 (socket says 172.21.15.134:49404) 2024-02-16T22:28:49.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.087+0000 7f16dffff700 1 -- 172.21.15.134:0/1084080297 learned_addr learned my addr 172.21.15.134:0/1084080297 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:28:49.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.087+0000 7f16df7fe700 1 --2- 172.21.15.134:0/1084080297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16e01027e0 0x7f16e0112eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:49.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.087+0000 7f16dffff700 1 -- 172.21.15.134:0/1084080297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16e01027e0 msgr2=0x7f16e0112eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:49.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.087+0000 7f16dffff700 1 --2- 172.21.15.134:0/1084080297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16e01027e0 0x7f16e0112eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.087+0000 7f16dffff700 1 -- 172.21.15.134:0/1084080297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d4005040 con 0x7f16e0101e40 2024-02-16T22:28:49.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.088+0000 7f16dffff700 1 --2- 172.21.15.134:0/1084080297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e0101e40 0x7f16e0112970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f16d0002a80 tx=0x7f16d00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:49.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.088+0000 7f16dcff9700 1 -- 172.21.15.134:0/1084080297 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d0007cc0 con 0x7f16e0101e40 2024-02-16T22:28:49.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.088+0000 7f16dcff9700 1 -- 172.21.15.134:0/1084080297 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16d000f040 con 0x7f16e0101e40 2024-02-16T22:28:49.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.088+0000 7f16e64a5700 1 -- 172.21.15.134:0/1084080297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e010cb10 con 0x7f16e0101e40 2024-02-16T22:28:49.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.088+0000 7f16dcff9700 1 -- 172.21.15.134:0/1084080297 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d000dac0 con 0x7f16e0101e40 2024-02-16T22:28:49.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.088+0000 7f16e64a5700 1 -- 172.21.15.134:0/1084080297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e010d020 con 0x7f16e0101e40 2024-02-16T22:28:49.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.089+0000 7f16e64a5700 1 -- 172.21.15.134:0/1084080297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e00738b0 con 0x7f16e0101e40 2024-02-16T22:28:49.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.089+0000 7f16dcff9700 1 -- 172.21.15.134:0/1084080297 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f16d000dcc0 con 0x7f16e0101e40 2024-02-16T22:28:49.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.089+0000 7f16dcff9700 1 --2- 172.21.15.134:0/1084080297 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f16c806d7e0 0x7f16c806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:49.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.090+0000 7f16dcff9700 1 -- 172.21.15.134:0/1084080297 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f16d008cae0 con 0x7f16e0101e40 2024-02-16T22:28:49.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.090+0000 7f16df7fe700 1 --2- 172.21.15.134:0/1084080297 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f16c806d7e0 0x7f16c806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:49.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.090+0000 7f16df7fe700 1 --2- 172.21.15.134:0/1084080297 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f16c806d7e0 0x7f16c806fc90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f16e010db60 tx=0x7f16d4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:49.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.094+0000 7f16dcff9700 1 -- 172.21.15.134:0/1084080297 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f16d0059e80 con 0x7f16e0101e40 2024-02-16T22:28:49.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.309+0000 7f16e64a5700 1 -- 172.21.15.134:0/1084080297 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f16e010df50 con 0x7f16c806d7e0 2024-02-16T22:28:49.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.321+0000 7f16dcff9700 1 -- 172.21.15.134:0/1084080297 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f16e010df50 con 0x7f16c806d7e0 2024-02-16T22:28:49.323 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:28:49.323 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (6m) 15s ago 17m 25.7M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:28:49.323 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (4m) 15s ago 18m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 429739bfee94 2024-02-16T22:28:49.323 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (4m) 1s ago 16m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 1e81cd2fd510 2024-02-16T22:28:49.323 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (6m) 15s ago 17m 91.3M - 9.4.12 a0ea5e3c46d9 29d29cf667e7 2024-02-16T22:28:49.323 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (37s) 15s ago 12m 11.7M - 19.0.0-1450-gf78a58c0 f081f847070a 9b266de8e573 2024-02-16T22:28:49.323 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (20s) 15s ago 12m 10.3M - 19.0.0-1450-gf78a58c0 f081f847070a ef64a4bb0cda 2024-02-16T22:28:49.324 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (12m) 1s ago 12m 18.0M - 17.2.7-513-gb88fae66 870a0944ccb8 21908b73a076 2024-02-16T22:28:49.324 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (4s) 1s ago 12m 13.8M - 19.0.0-1450-gf78a58c0 f081f847070a cd3e56af44dd 2024-02-16T22:28:49.324 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (8m) 15s ago 19m 506M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:28:49.324 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (7m) 1s ago 16m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:28:49.324 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (5m) 15s ago 19m 52.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2903b3988442 2024-02-16T22:28:49.324 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (4m) 1s ago 16m 43.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a dd7cf2f31226 2024-02-16T22:28:49.324 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 15s ago 17m 16.2M - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:28:49.324 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (7m) 1s ago 16m 14.7M - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:28:49.324 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (3m) 15s ago 15m 95.5M 1557M 19.0.0-1450-gf78a58c0 f081f847070a d0153b47ae7e 2024-02-16T22:28:49.324 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (3m) 15s ago 15m 95.2M 1557M 19.0.0-1450-gf78a58c0 f081f847070a dd1faac850b0 2024-02-16T22:28:49.324 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (2m) 15s ago 14m 90.4M 1557M 19.0.0-1450-gf78a58c0 f081f847070a 0e349c665c73 2024-02-16T22:28:49.325 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (2m) 1s ago 14m 100M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 1f4624a5418b 2024-02-16T22:28:49.325 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (88s) 1s ago 14m 101M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 640d021c13b0 2024-02-16T22:28:49.325 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (55s) 1s ago 13m 86.7M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 8ee59c4c4319 2024-02-16T22:28:49.325 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (6m) 15s ago 17m 61.6M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:28:49.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.323+0000 7f16e64a5700 1 -- 172.21.15.134:0/1084080297 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f16c806d7e0 msgr2=0x7f16c806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:49.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.323+0000 7f16e64a5700 1 --2- 172.21.15.134:0/1084080297 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f16c806d7e0 0x7f16c806fc90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f16e010db60 tx=0x7f16d4009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:49.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.323+0000 7f16e64a5700 1 -- 172.21.15.134:0/1084080297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e0101e40 msgr2=0x7f16e0112970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:49.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.323+0000 7f16e64a5700 1 --2- 172.21.15.134:0/1084080297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e0101e40 0x7f16e0112970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f16d0002a80 tx=0x7f16d00046b0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.323+0000 7f16e64a5700 1 -- 172.21.15.134:0/1084080297 shutdown_connections 2024-02-16T22:28:49.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.323+0000 7f16e64a5700 1 --2- 172.21.15.134:0/1084080297 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f16c806d7e0 0x7f16c806fc90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.323+0000 7f16e64a5700 1 --2- 172.21.15.134:0/1084080297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16e0101e40 0x7f16e0112970 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.323+0000 7f16e64a5700 1 --2- 172.21.15.134:0/1084080297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16e01027e0 0x7f16e0112eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.323+0000 7f16e64a5700 1 -- 172.21.15.134:0/1084080297 >> 172.21.15.134:0/1084080297 conn(0x7f16e0071d90 msgr2=0x7f16e00fad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:49.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.323+0000 7f16e64a5700 1 -- 172.21.15.134:0/1084080297 shutdown_connections 2024-02-16T22:28:49.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.323+0000 7f16e64a5700 1 -- 172.21.15.134:0/1084080297 wait complete. 2024-02-16T22:28:49.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.426+0000 7ffb1519d700 1 -- 172.21.15.134:0/3052071761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb10102640 msgr2=0x7ffb100fc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:49.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.426+0000 7ffb1519d700 1 --2- 172.21.15.134:0/3052071761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb10102640 0x7ffb100fc4b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffb04004940 tx=0x7ffb04009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:49.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.426+0000 7ffb1519d700 1 -- 172.21.15.134:0/3052071761 shutdown_connections 2024-02-16T22:28:49.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.426+0000 7ffb1519d700 1 --2- 172.21.15.134:0/3052071761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb10102640 0x7ffb100fc4b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.426+0000 7ffb1519d700 1 --2- 172.21.15.134:0/3052071761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb10101ca0 0x7ffb10102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.426+0000 7ffb1519d700 1 -- 172.21.15.134:0/3052071761 >> 172.21.15.134:0/3052071761 conn(0x7ffb10072260 msgr2=0x7ffb10072660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:49.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.426+0000 7ffb1519d700 1 -- 172.21.15.134:0/3052071761 shutdown_connections 2024-02-16T22:28:49.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.426+0000 7ffb1519d700 1 -- 172.21.15.134:0/3052071761 wait complete. 2024-02-16T22:28:49.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.427+0000 7ffb1519d700 1 Processor -- start 2024-02-16T22:28:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.427+0000 7ffb1519d700 1 -- start start 2024-02-16T22:28:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.427+0000 7ffb1519d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb10101ca0 0x7ffb10113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.427+0000 7ffb1519d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb10102640 0x7ffb10113d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.427+0000 7ffb1519d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb10114390 con 0x7ffb10102640 2024-02-16T22:28:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.427+0000 7ffb1519d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1010d6c0 con 0x7ffb10101ca0 2024-02-16T22:28:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.427+0000 7ffb0f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb10102640 0x7ffb10113d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.427+0000 7ffb0f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb10102640 0x7ffb10113d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49416/0 (socket says 172.21.15.134:49416) 2024-02-16T22:28:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.427+0000 7ffb0f7fe700 1 -- 172.21.15.134:0/93480385 learned_addr learned my addr 172.21.15.134:0/93480385 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:28:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.427+0000 7ffb0ffff700 1 --2- 172.21.15.134:0/93480385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb10101ca0 0x7ffb10113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.428+0000 7ffb0ffff700 1 -- 172.21.15.134:0/93480385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb10102640 msgr2=0x7ffb10113d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.428+0000 7ffb0ffff700 1 --2- 172.21.15.134:0/93480385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb10102640 0x7ffb10113d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.428+0000 7ffb0ffff700 1 -- 172.21.15.134:0/93480385 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb00005040 con 0x7ffb10101ca0 2024-02-16T22:28:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.428+0000 7ffb0ffff700 1 --2- 172.21.15.134:0/93480385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb10101ca0 0x7ffb10113800 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffb000094a0 tx=0x7ffb00009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.428+0000 7ffb0cff9700 1 -- 172.21.15.134:0/93480385 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb0000e600 con 0x7ffb10101ca0 2024-02-16T22:28:49.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.428+0000 7ffb1519d700 1 -- 172.21.15.134:0/93480385 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb04005040 con 0x7ffb10101ca0 2024-02-16T22:28:49.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.428+0000 7ffb0cff9700 1 -- 172.21.15.134:0/93480385 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb0000f040 con 0x7ffb10101ca0 2024-02-16T22:28:49.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.428+0000 7ffb0cff9700 1 -- 172.21.15.134:0/93480385 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb00013c40 con 0x7ffb10101ca0 2024-02-16T22:28:49.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.428+0000 7ffb1519d700 1 -- 172.21.15.134:0/93480385 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1010dcf0 con 0x7ffb10101ca0 2024-02-16T22:28:49.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.429+0000 7ffb1519d700 1 -- 172.21.15.134:0/93480385 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb10105180 con 0x7ffb10101ca0 2024-02-16T22:28:49.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.429+0000 7ffb0cff9700 1 -- 172.21.15.134:0/93480385 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ffb0000e760 con 0x7ffb10101ca0 2024-02-16T22:28:49.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.430+0000 7ffb0cff9700 1 --2- 172.21.15.134:0/93480385 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ffaf806d7e0 0x7ffaf806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:49.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.430+0000 7ffb0cff9700 1 -- 172.21.15.134:0/93480385 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ffb0008cd20 con 0x7ffb10101ca0 2024-02-16T22:28:49.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.430+0000 7ffb0f7fe700 1 --2- 172.21.15.134:0/93480385 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ffaf806d7e0 0x7ffaf806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:49.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.430+0000 7ffb0f7fe700 1 --2- 172.21.15.134:0/93480385 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ffaf806d7e0 0x7ffaf806fc90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb1010f030 tx=0x7ffb04009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:49.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.435+0000 7ffb0cff9700 1 -- 172.21.15.134:0/93480385 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffb00059fa0 con 0x7ffb10101ca0 2024-02-16T22:28:49.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.720+0000 7ffb1519d700 1 -- 172.21.15.134:0/93480385 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffb1004bed0 con 0x7ffb10101ca0 2024-02-16T22:28:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.721+0000 7ffb0cff9700 1 -- 172.21.15.134:0/93480385 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7ffb00059b30 con 0x7ffb10101ca0 2024-02-16T22:28:49.723 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:28:49.723 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:28:49.723 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:28:49.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:28:49.723 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:28:49.723 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:28:49.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:28:49.723 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:28:49.723 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-16T22:28:49.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:28:49.724 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:28:49.724 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 1, 2024-02-16T22:28:49.724 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 3 2024-02-16T22:28:49.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:28:49.724 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:28:49.724 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-513-gb88fae66 (b88fae66e6ad896087939a6bde358f026d85f561) quincy (stable)": 1, 2024-02-16T22:28:49.724 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 13 2024-02-16T22:28:49.724 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:28:49.724 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:28:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.723+0000 7ffb1519d700 1 -- 172.21.15.134:0/93480385 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ffaf806d7e0 msgr2=0x7ffaf806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.723+0000 7ffb1519d700 1 --2- 172.21.15.134:0/93480385 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ffaf806d7e0 0x7ffaf806fc90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb1010f030 tx=0x7ffb04009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.723+0000 7ffb1519d700 1 -- 172.21.15.134:0/93480385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb10101ca0 msgr2=0x7ffb10113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.723+0000 7ffb1519d700 1 --2- 172.21.15.134:0/93480385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb10101ca0 0x7ffb10113800 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffb000094a0 tx=0x7ffb00009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.723+0000 7ffb1519d700 1 -- 172.21.15.134:0/93480385 shutdown_connections 2024-02-16T22:28:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.724+0000 7ffb1519d700 1 --2- 172.21.15.134:0/93480385 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ffaf806d7e0 0x7ffaf806fc90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.724+0000 7ffb1519d700 1 --2- 172.21.15.134:0/93480385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb10101ca0 0x7ffb10113800 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.724+0000 7ffb1519d700 1 --2- 172.21.15.134:0/93480385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb10102640 0x7ffb10113d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.724+0000 7ffb1519d700 1 -- 172.21.15.134:0/93480385 >> 172.21.15.134:0/93480385 conn(0x7ffb10072260 msgr2=0x7ffb101010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.724+0000 7ffb1519d700 1 -- 172.21.15.134:0/93480385 shutdown_connections 2024-02-16T22:28:49.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.724+0000 7ffb1519d700 1 -- 172.21.15.134:0/93480385 wait complete. 2024-02-16T22:28:49.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.830+0000 7fc3a676e700 1 -- 172.21.15.134:0/2901623793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a00fdf60 msgr2=0x7fc3a00fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:49.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.830+0000 7fc3a676e700 1 --2- 172.21.15.134:0/2901623793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a00fdf60 0x7fc3a00fe330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc390004940 tx=0x7fc390009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:49.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.830+0000 7fc3a676e700 1 -- 172.21.15.134:0/2901623793 shutdown_connections 2024-02-16T22:28:49.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.830+0000 7fc3a676e700 1 --2- 172.21.15.134:0/2901623793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3a00fe900 0x7fc3a0106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.830+0000 7fc3a676e700 1 --2- 172.21.15.134:0/2901623793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a00fdf60 0x7fc3a00fe330 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.830+0000 7fc3a676e700 1 -- 172.21.15.134:0/2901623793 >> 172.21.15.134:0/2901623793 conn(0x7fc3a00f7a10 msgr2=0x7fc3a00f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:49.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.830+0000 7fc3a676e700 1 -- 172.21.15.134:0/2901623793 shutdown_connections 2024-02-16T22:28:49.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.830+0000 7fc3a676e700 1 -- 172.21.15.134:0/2901623793 wait complete. 2024-02-16T22:28:49.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.831+0000 7fc3a676e700 1 Processor -- start 2024-02-16T22:28:49.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.831+0000 7fc3a676e700 1 -- start start 2024-02-16T22:28:49.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.831+0000 7fc3a676e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a00fdf60 0x7fc3a0113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:49.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.831+0000 7fc3a676e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3a00fe900 0x7fc3a0113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:49.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.831+0000 7fc3a676e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a01145c0 con 0x7fc3a00fdf60 2024-02-16T22:28:49.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.831+0000 7fc3a676e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a010d8f0 con 0x7fc3a00fe900 2024-02-16T22:28:49.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.831+0000 7fc39ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a00fdf60 0x7fc3a0113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:49.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.831+0000 7fc39f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3a00fe900 0x7fc3a0113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:49.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.831+0000 7fc39ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a00fdf60 0x7fc3a0113a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49434/0 (socket says 172.21.15.134:49434) 2024-02-16T22:28:49.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.831+0000 7fc39f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3a00fe900 0x7fc3a0113f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.134:40472/0 (socket says 172.21.15.134:40472) 2024-02-16T22:28:49.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.831+0000 7fc39ffff700 1 -- 172.21.15.134:0/3049566131 learned_addr learned my addr 172.21.15.134:0/3049566131 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:28:49.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.832+0000 7fc39ffff700 1 -- 172.21.15.134:0/3049566131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3a00fe900 msgr2=0x7fc3a0113f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:49.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.832+0000 7fc39ffff700 1 --2- 172.21.15.134:0/3049566131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3a00fe900 0x7fc3a0113f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:49.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.832+0000 7fc39ffff700 1 -- 172.21.15.134:0/3049566131 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc390005040 con 0x7fc3a00fdf60 2024-02-16T22:28:49.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.832+0000 7fc39ffff700 1 --2- 172.21.15.134:0/3049566131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a00fdf60 0x7fc3a0113a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc390000c00 tx=0x7fc390009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:49.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.832+0000 7fc39cff9700 1 -- 172.21.15.134:0/3049566131 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc39000e040 con 0x7fc3a00fdf60 2024-02-16T22:28:49.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.832+0000 7fc3a676e700 1 -- 172.21.15.134:0/3049566131 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a010db70 con 0x7fc3a00fdf60 2024-02-16T22:28:49.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.832+0000 7fc39cff9700 1 -- 172.21.15.134:0/3049566131 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc390009af0 con 0x7fc3a00fdf60 2024-02-16T22:28:49.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.832+0000 7fc39cff9700 1 -- 172.21.15.134:0/3049566131 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc39001c630 con 0x7fc3a00fdf60 2024-02-16T22:28:49.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.832+0000 7fc3a676e700 1 -- 172.21.15.134:0/3049566131 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a010e0b0 con 0x7fc3a00fdf60 2024-02-16T22:28:49.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.833+0000 7fc3a676e700 1 -- 172.21.15.134:0/3049566131 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a0104550 con 0x7fc3a00fdf60 2024-02-16T22:28:49.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.834+0000 7fc39cff9700 1 -- 172.21.15.134:0/3049566131 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fc39000bbf0 con 0x7fc3a00fdf60 2024-02-16T22:28:49.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.835+0000 7fc39cff9700 1 --2- 172.21.15.134:0/3049566131 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc38806d7e0 0x7fc38806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:49.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.835+0000 7fc39cff9700 1 -- 172.21.15.134:0/3049566131 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc39008eda0 con 0x7fc3a00fdf60 2024-02-16T22:28:49.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.835+0000 7fc39f7fe700 1 --2- 172.21.15.134:0/3049566131 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc38806d7e0 0x7fc38806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:49.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.835+0000 7fc39f7fe700 1 --2- 172.21.15.134:0/3049566131 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc38806d7e0 0x7fc38806fc90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc3a010f260 tx=0x7fc39400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:49.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:49.840+0000 7fc39cff9700 1 -- 172.21.15.134:0/3049566131 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc39005c120 con 0x7fc3a00fdf60 2024-02-16T22:28:50.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.110+0000 7fc3a676e700 1 -- 172.21.15.134:0/3049566131 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc3a00fb610 con 0x7fc3a00fdf60 2024-02-16T22:28:50.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.110+0000 7fc39cff9700 1 -- 172.21.15.134:0/3049566131 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1841 (secure 0 0 0) 0x7fc39005bcb0 con 0x7fc3a00fdf60 2024-02-16T22:28:50.112 INFO:teuthology.orchestra.run.smithi134.stdout:e28 2024-02-16T22:28:50.112 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:28:50.112 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 21 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-02-16T22:28:03.434248+0000 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-02-16T22:28:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-02-16T22:28:50.114 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-02-16T22:28:50.114 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 81 2024-02-16T22:28:50.114 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:28:50.114 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 2 2024-02-16T22:28:50.114 INFO:teuthology.orchestra.run.smithi134.stdout:in 0,1 2024-02-16T22:28:50.114 INFO:teuthology.orchestra.run.smithi134.stdout:up {} 2024-02-16T22:28:50.114 INFO:teuthology.orchestra.run.smithi134.stdout:failed 0,1 2024-02-16T22:28:50.114 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-02-16T22:28:50.114 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-02-16T22:28:50.114 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-02-16T22:28:50.114 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-02-16T22:28:50.114 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-02-16T22:28:50.114 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-02-16T22:28:50.114 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-02-16T22:28:50.115 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-02-16T22:28:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:28:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:28:50.115 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-02-16T22:28:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:28:50.115 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.phstvm{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.173:6826/3866528665,v1:172.21.15.173:6827/3866528665] compat {c=[1],r=[1],i=[7ff]}] 2024-02-16T22:28:50.115 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.cygfxr{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/845650190,v1:172.21.15.134:6827/845650190] compat {c=[1],r=[1],i=[fff]}] 2024-02-16T22:28:50.115 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.jyajef{-1:34414} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6828/3664331772,v1:172.21.15.134:6829/3664331772] compat {c=[1],r=[1],i=[fff]}] 2024-02-16T22:28:50.115 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.qljqef{-1:44301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.173:6824/892474824,v1:172.21.15.173:6825/892474824] compat {c=[1],r=[1],i=[fff]}] 2024-02-16T22:28:50.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.112+0000 7fc3a676e700 1 -- 172.21.15.134:0/3049566131 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc38806d7e0 msgr2=0x7fc38806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:50.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.112+0000 7fc3a676e700 1 --2- 172.21.15.134:0/3049566131 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc38806d7e0 0x7fc38806fc90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc3a010f260 tx=0x7fc39400b040 comp rx=0 tx=0).stop 2024-02-16T22:28:50.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.112+0000 7fc3a676e700 1 -- 172.21.15.134:0/3049566131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a00fdf60 msgr2=0x7fc3a0113a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:50.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.112+0000 7fc3a676e700 1 --2- 172.21.15.134:0/3049566131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a00fdf60 0x7fc3a0113a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc390000c00 tx=0x7fc390009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:50.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.112+0000 7fc3a676e700 1 -- 172.21.15.134:0/3049566131 shutdown_connections 2024-02-16T22:28:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.112+0000 7fc3a676e700 1 --2- 172.21.15.134:0/3049566131 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc38806d7e0 0x7fc38806fc90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.112+0000 7fc3a676e700 1 --2- 172.21.15.134:0/3049566131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a00fdf60 0x7fc3a0113a30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.112+0000 7fc3a676e700 1 --2- 172.21.15.134:0/3049566131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3a00fe900 0x7fc3a0113f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.112+0000 7fc3a676e700 1 -- 172.21.15.134:0/3049566131 >> 172.21.15.134:0/3049566131 conn(0x7fc3a00f7a10 msgr2=0x7fc3a01016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.113+0000 7fc3a676e700 1 -- 172.21.15.134:0/3049566131 shutdown_connections 2024-02-16T22:28:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.113+0000 7fc3a676e700 1 -- 172.21.15.134:0/3049566131 wait complete. 2024-02-16T22:28:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 28 2024-02-16T22:28:50.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.218+0000 7fa49fed4700 1 -- 172.21.15.134:0/2162281798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4981027e0 msgr2=0x7fa4980fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:50.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.218+0000 7fa49fed4700 1 --2- 172.21.15.134:0/2162281798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4981027e0 0x7fa4980fbea0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa488004940 tx=0x7fa488009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:50.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.218+0000 7fa49fed4700 1 -- 172.21.15.134:0/2162281798 shutdown_connections 2024-02-16T22:28:50.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.218+0000 7fa49fed4700 1 --2- 172.21.15.134:0/2162281798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4981027e0 0x7fa4980fbea0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.218+0000 7fa49fed4700 1 --2- 172.21.15.134:0/2162281798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa498101e40 0x7fa498102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.218+0000 7fa49fed4700 1 -- 172.21.15.134:0/2162281798 >> 172.21.15.134:0/2162281798 conn(0x7fa498071d90 msgr2=0x7fa498072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:50.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.218+0000 7fa49fed4700 1 -- 172.21.15.134:0/2162281798 shutdown_connections 2024-02-16T22:28:50.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.218+0000 7fa49fed4700 1 -- 172.21.15.134:0/2162281798 wait complete. 2024-02-16T22:28:50.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.218+0000 7fa49fed4700 1 Processor -- start 2024-02-16T22:28:50.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.218+0000 7fa49fed4700 1 -- start start 2024-02-16T22:28:50.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.219+0000 7fa49fed4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa498101e40 0x7fa4980fdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:50.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.219+0000 7fa49fed4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4981027e0 0x7fa4980fe000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:50.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.219+0000 7fa49fed4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980fe600 con 0x7fa498101e40 2024-02-16T22:28:50.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.219+0000 7fa49fed4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980fe770 con 0x7fa4981027e0 2024-02-16T22:28:50.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.219+0000 7fa49dc70700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa498101e40 0x7fa4980fdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:50.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.219+0000 7fa49dc70700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa498101e40 0x7fa4980fdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49448/0 (socket says 172.21.15.134:49448) 2024-02-16T22:28:50.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.219+0000 7fa49dc70700 1 -- 172.21.15.134:0/2835034727 learned_addr learned my addr 172.21.15.134:0/2835034727 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:28:50.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.219+0000 7fa49d46f700 1 --2- 172.21.15.134:0/2835034727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4981027e0 0x7fa4980fe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:50.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.219+0000 7fa49dc70700 1 -- 172.21.15.134:0/2835034727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4981027e0 msgr2=0x7fa4980fe000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:50.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.219+0000 7fa49dc70700 1 --2- 172.21.15.134:0/2835034727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4981027e0 0x7fa4980fe000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.219+0000 7fa49dc70700 1 -- 172.21.15.134:0/2835034727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa488005040 con 0x7fa498101e40 2024-02-16T22:28:50.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.219+0000 7fa49dc70700 1 --2- 172.21.15.134:0/2835034727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa498101e40 0x7fa4980fdac0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa49000cac0 tx=0x7fa490007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:50.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.219+0000 7fa48e7fc700 1 -- 172.21.15.134:0/2835034727 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa49000a980 con 0x7fa498101e40 2024-02-16T22:28:50.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.220+0000 7fa48e7fc700 1 -- 172.21.15.134:0/2835034727 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa490012440 con 0x7fa498101e40 2024-02-16T22:28:50.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.220+0000 7fa49fed4700 1 -- 172.21.15.134:0/2835034727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa498119cb0 con 0x7fa498101e40 2024-02-16T22:28:50.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.220+0000 7fa48e7fc700 1 -- 172.21.15.134:0/2835034727 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4900115e0 con 0x7fa498101e40 2024-02-16T22:28:50.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.220+0000 7fa49fed4700 1 -- 172.21.15.134:0/2835034727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49811a160 con 0x7fa498101e40 2024-02-16T22:28:50.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.220+0000 7fa49fed4700 1 -- 172.21.15.134:0/2835034727 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4980738b0 con 0x7fa498101e40 2024-02-16T22:28:50.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.221+0000 7fa48e7fc700 1 -- 172.21.15.134:0/2835034727 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa4900125b0 con 0x7fa498101e40 2024-02-16T22:28:50.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.222+0000 7fa48e7fc700 1 --2- 172.21.15.134:0/2835034727 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa48406d7e0 0x7fa48406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:50.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.222+0000 7fa48e7fc700 1 -- 172.21.15.134:0/2835034727 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa49008d5e0 con 0x7fa498101e40 2024-02-16T22:28:50.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.222+0000 7fa49d46f700 1 --2- 172.21.15.134:0/2835034727 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa48406d7e0 0x7fa48406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:50.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.222+0000 7fa49d46f700 1 --2- 172.21.15.134:0/2835034727 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa48406d7e0 0x7fa48406fc90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa4980ffbd0 tx=0x7fa488009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:50.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.226+0000 7fa48e7fc700 1 -- 172.21.15.134:0/2835034727 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa490056dd0 con 0x7fa498101e40 2024-02-16T22:28:50.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.453+0000 7fa49fed4700 1 -- 172.21.15.134:0/2835034727 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4980ff310 con 0x7fa48406d7e0 2024-02-16T22:28:50.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:50 smithi134 ceph-mon[112514]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:50.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:50 smithi134 ceph-mon[112514]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:50.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:50 smithi134 ceph-mon[112514]: pgmap v194: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:50.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:50 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:50.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:50 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:50.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:50 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/93480385' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:50.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:50 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/3049566131' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:28:50.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.454+0000 7fa48e7fc700 1 -- 172.21.15.134:0/2835034727 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa4980ff310 con 0x7fa48406d7e0 2024-02-16T22:28:50.456 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:28:50.456 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-16T22:28:50.456 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-02-16T22:28:50.457 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-16T22:28:50.457 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-02-16T22:28:50.457 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-02-16T22:28:50.457 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-02-16T22:28:50.457 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-02-16T22:28:50.457 INFO:teuthology.orchestra.run.smithi134.stdout: "osd" 2024-02-16T22:28:50.457 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-02-16T22:28:50.457 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "15/21 daemons upgraded", 2024-02-16T22:28:50.457 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mds daemons", 2024-02-16T22:28:50.457 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:28:50.457 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:28:50.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.457+0000 7fa49fed4700 1 -- 172.21.15.134:0/2835034727 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa48406d7e0 msgr2=0x7fa48406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:50.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.457+0000 7fa49fed4700 1 --2- 172.21.15.134:0/2835034727 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa48406d7e0 0x7fa48406fc90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa4980ffbd0 tx=0x7fa488009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:50.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.457+0000 7fa49fed4700 1 -- 172.21.15.134:0/2835034727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa498101e40 msgr2=0x7fa4980fdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:50.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.457+0000 7fa49fed4700 1 --2- 172.21.15.134:0/2835034727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa498101e40 0x7fa4980fdac0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa49000cac0 tx=0x7fa490007ee0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.457+0000 7fa49fed4700 1 -- 172.21.15.134:0/2835034727 shutdown_connections 2024-02-16T22:28:50.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.457+0000 7fa49fed4700 1 --2- 172.21.15.134:0/2835034727 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa48406d7e0 0x7fa48406fc90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.457+0000 7fa49fed4700 1 --2- 172.21.15.134:0/2835034727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa498101e40 0x7fa4980fdac0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.457+0000 7fa49fed4700 1 --2- 172.21.15.134:0/2835034727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4981027e0 0x7fa4980fe000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.457+0000 7fa49fed4700 1 -- 172.21.15.134:0/2835034727 >> 172.21.15.134:0/2835034727 conn(0x7fa498071d90 msgr2=0x7fa498065760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:50.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.457+0000 7fa49fed4700 1 -- 172.21.15.134:0/2835034727 shutdown_connections 2024-02-16T22:28:50.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.457+0000 7fa49fed4700 1 -- 172.21.15.134:0/2835034727 wait complete. 2024-02-16T22:28:50.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:50 smithi173 ceph-mon[83703]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:50.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:50 smithi173 ceph-mon[83703]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:50.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:50 smithi173 ceph-mon[83703]: pgmap v194: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:50.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:50 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:50.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:50 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:50.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:50 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/93480385' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:50.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:50 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/3049566131' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:28:50.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.560+0000 7fa138b1f700 1 -- 172.21.15.134:0/1246595492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa134101e60 msgr2=0x7fa134102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:50.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.560+0000 7fa138b1f700 1 --2- 172.21.15.134:0/1246595492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa134101e60 0x7fa134102230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa124004940 tx=0x7fa124009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:50.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.560+0000 7fa138b1f700 1 -- 172.21.15.134:0/1246595492 shutdown_connections 2024-02-16T22:28:50.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.560+0000 7fa138b1f700 1 --2- 172.21.15.134:0/1246595492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa134102800 0x7fa1340fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.560+0000 7fa138b1f700 1 --2- 172.21.15.134:0/1246595492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa134101e60 0x7fa134102230 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.560+0000 7fa138b1f700 1 -- 172.21.15.134:0/1246595492 >> 172.21.15.134:0/1246595492 conn(0x7fa1340f7a10 msgr2=0x7fa1340f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:50.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.560+0000 7fa138b1f700 1 -- 172.21.15.134:0/1246595492 shutdown_connections 2024-02-16T22:28:50.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.560+0000 7fa138b1f700 1 -- 172.21.15.134:0/1246595492 wait complete. 2024-02-16T22:28:50.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa138b1f700 1 Processor -- start 2024-02-16T22:28:50.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa138b1f700 1 -- start start 2024-02-16T22:28:50.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa138b1f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa134101e60 0x7fa13410ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:50.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa138b1f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa134102800 0x7fa13410efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:50.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa138b1f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13410f530 con 0x7fa134101e60 2024-02-16T22:28:50.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa138b1f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13410f6a0 con 0x7fa134102800 2024-02-16T22:28:50.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa13259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa134101e60 0x7fa13410ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:50.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa13259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa134101e60 0x7fa13410ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49452/0 (socket says 172.21.15.134:49452) 2024-02-16T22:28:50.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa13259c700 1 -- 172.21.15.134:0/3915899384 learned_addr learned my addr 172.21.15.134:0/3915899384 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:28:50.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa131d9b700 1 --2- 172.21.15.134:0/3915899384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa134102800 0x7fa13410efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:50.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa13259c700 1 -- 172.21.15.134:0/3915899384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa134102800 msgr2=0x7fa13410efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:50.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa13259c700 1 --2- 172.21.15.134:0/3915899384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa134102800 0x7fa13410efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa13259c700 1 -- 172.21.15.134:0/3915899384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa124005040 con 0x7fa134101e60 2024-02-16T22:28:50.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa131d9b700 1 --2- 172.21.15.134:0/3915899384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa134102800 0x7fa13410efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:28:50.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.561+0000 7fa13259c700 1 --2- 172.21.15.134:0/3915899384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa134101e60 0x7fa13410ea60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa124009100 tx=0x7fa124009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:50.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.562+0000 7fa122ffd700 1 -- 172.21.15.134:0/3915899384 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa12400e040 con 0x7fa134101e60 2024-02-16T22:28:50.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.562+0000 7fa122ffd700 1 -- 172.21.15.134:0/3915899384 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa124004290 con 0x7fa134101e60 2024-02-16T22:28:50.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.562+0000 7fa122ffd700 1 -- 172.21.15.134:0/3915899384 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa12401c630 con 0x7fa134101e60 2024-02-16T22:28:50.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.562+0000 7fa138b1f700 1 -- 172.21.15.134:0/3915899384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1341179d0 con 0x7fa134101e60 2024-02-16T22:28:50.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.562+0000 7fa138b1f700 1 -- 172.21.15.134:0/3915899384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa134117e90 con 0x7fa134101e60 2024-02-16T22:28:50.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.563+0000 7fa138b1f700 1 -- 172.21.15.134:0/3915899384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1340fb610 con 0x7fa134101e60 2024-02-16T22:28:50.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.563+0000 7fa122ffd700 1 -- 172.21.15.134:0/3915899384 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa12400bbf0 con 0x7fa134101e60 2024-02-16T22:28:50.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.564+0000 7fa122ffd700 1 --2- 172.21.15.134:0/3915899384 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa11c06d7e0 0x7fa11c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:28:50.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.564+0000 7fa122ffd700 1 -- 172.21.15.134:0/3915899384 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa12408e1b0 con 0x7fa134101e60 2024-02-16T22:28:50.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.564+0000 7fa131d9b700 1 --2- 172.21.15.134:0/3915899384 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa11c06d7e0 0x7fa11c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:28:50.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.564+0000 7fa131d9b700 1 --2- 172.21.15.134:0/3915899384 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa11c06d7e0 0x7fa11c06fc90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa128009b80 tx=0x7fa12800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:28:50.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.568+0000 7fa122ffd700 1 -- 172.21.15.134:0/3915899384 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa124057ac0 con 0x7fa134101e60 2024-02-16T22:28:50.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.856+0000 7fa138b1f700 1 -- 172.21.15.134:0/3915899384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa134108f60 con 0x7fa134101e60 2024-02-16T22:28:50.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.857+0000 7fa122ffd700 1 -- 172.21.15.134:0/3915899384 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fa12405b180 con 0x7fa134101e60 2024-02-16T22:28:50.859 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-16T22:28:50.859 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-16T22:28:50.859 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs is degraded 2024-02-16T22:28:50.859 INFO:teuthology.orchestra.run.smithi134.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-16T22:28:50.860 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-16T22:28:50.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.859+0000 7fa138b1f700 1 -- 172.21.15.134:0/3915899384 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa11c06d7e0 msgr2=0x7fa11c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:50.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.859+0000 7fa138b1f700 1 --2- 172.21.15.134:0/3915899384 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa11c06d7e0 0x7fa11c06fc90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa128009b80 tx=0x7fa12800b040 comp rx=0 tx=0).stop 2024-02-16T22:28:50.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.859+0000 7fa138b1f700 1 -- 172.21.15.134:0/3915899384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa134101e60 msgr2=0x7fa13410ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:28:50.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.859+0000 7fa138b1f700 1 --2- 172.21.15.134:0/3915899384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa134101e60 0x7fa13410ea60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa124009100 tx=0x7fa124009e30 comp rx=0 tx=0).stop 2024-02-16T22:28:50.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.859+0000 7fa138b1f700 1 -- 172.21.15.134:0/3915899384 shutdown_connections 2024-02-16T22:28:50.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.859+0000 7fa138b1f700 1 --2- 172.21.15.134:0/3915899384 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa11c06d7e0 0x7fa11c06fc90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.859+0000 7fa138b1f700 1 --2- 172.21.15.134:0/3915899384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa134101e60 0x7fa13410ea60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.859+0000 7fa138b1f700 1 --2- 172.21.15.134:0/3915899384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa134102800 0x7fa13410efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:28:50.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.859+0000 7fa138b1f700 1 -- 172.21.15.134:0/3915899384 >> 172.21.15.134:0/3915899384 conn(0x7fa1340f7a10 msgr2=0x7fa1340f93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:28:50.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.859+0000 7fa138b1f700 1 -- 172.21.15.134:0/3915899384 shutdown_connections 2024-02-16T22:28:50.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:28:50.859+0000 7fa138b1f700 1 -- 172.21.15.134:0/3915899384 wait complete. 2024-02-16T22:28:51.385 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:51 smithi173 ceph-mon[83703]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:51.385 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:51 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/3915899384' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:28:51.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:51 smithi134 ceph-mon[112514]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:51.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:51 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/3915899384' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:28:52.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:52 smithi134 ceph-mon[112514]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:52.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:52 smithi134 ceph-mon[112514]: pgmap v195: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:52.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:52 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:28:52.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:52 smithi173 ceph-mon[83703]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:28:52.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:52 smithi173 ceph-mon[83703]: pgmap v195: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:52.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:52 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:28:54.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:53 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:54.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:53 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:54.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:53 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:54.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:53 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:28:54.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:53 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:54.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:53 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:28:54.297 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:53 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:54.297 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:53 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:54.297 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:53 smithi134 ceph-mon[112514]: pgmap v196: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:54.297 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:53 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:54.297 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:53 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:54.297 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:53 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:54.297 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:53 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:54.297 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:53 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:54.297 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:53 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:28:54.298 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:53 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:54.298 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:53 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:28:54.298 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:53 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:54.298 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:53 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:54.298 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:53 smithi173 ceph-mon[83703]: pgmap v196: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:54.298 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:53 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:54.298 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:53 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:28:55.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:55 smithi173 ceph-mon[83703]: Upgrade: Updating mds.cephfs.smithi173.phstvm 2024-02-16T22:28:55.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:55 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:55.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:55 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.phstvm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:28:55.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:55 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:55.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:55 smithi173 ceph-mon[83703]: Deploying daemon mds.cephfs.smithi173.phstvm on smithi173 2024-02-16T22:28:55.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:55 smithi173 ceph-mon[83703]: pgmap v197: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:55.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:55 smithi134 ceph-mon[112514]: Upgrade: Updating mds.cephfs.smithi173.phstvm 2024-02-16T22:28:55.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:55 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:28:55.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:55 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi173.phstvm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-16T22:28:55.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:55 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:28:55.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:55 smithi134 ceph-mon[112514]: Deploying daemon mds.cephfs.smithi173.phstvm on smithi173 2024-02-16T22:28:55.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:55 smithi134 ceph-mon[112514]: pgmap v197: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:58.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:57 smithi134 ceph-mon[112514]: osdmap e85: 6 total, 6 up, 6 in 2024-02-16T22:28:58.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:57 smithi134 ceph-mon[112514]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-16T22:28:58.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:57 smithi134 ceph-mon[112514]: pgmap v199: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:58.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:57 smithi173 ceph-mon[83703]: osdmap e85: 6 total, 6 up, 6 in 2024-02-16T22:28:58.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:57 smithi173 ceph-mon[83703]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-16T22:28:58.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:57 smithi173 ceph-mon[83703]: pgmap v199: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:28:59.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:58 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.phstvm"}]: dispatch 2024-02-16T22:28:59.230 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:58 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.phstvm"}]: dispatch 2024-02-16T22:29:00.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:28:59 smithi134 ceph-mon[112514]: pgmap v200: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:00.230 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:28:59 smithi173 ceph-mon[83703]: pgmap v200: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:02.412 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:02 smithi173 ceph-mon[83703]: pgmap v201: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:02.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:02 smithi134 ceph-mon[112514]: pgmap v201: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:29:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:03 smithi134 ceph-mon[112514]: pgmap v202: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:03 smithi134 ceph-mon[112514]: mds.? [v2:172.21.15.173:6826/862726270,v1:172.21.15.173:6827/862726270] up:boot 2024-02-16T22:29:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:03 smithi134 ceph-mon[112514]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-16T22:29:03.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:03 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.phstvm"}]: dispatch 2024-02-16T22:29:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:29:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:03 smithi173 ceph-mon[83703]: pgmap v202: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:03 smithi173 ceph-mon[83703]: mds.? [v2:172.21.15.173:6826/862726270,v1:172.21.15.173:6827/862726270] up:boot 2024-02-16T22:29:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:03 smithi173 ceph-mon[83703]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-16T22:29:03.731 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:03 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi173.phstvm"}]: dispatch 2024-02-16T22:29:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:05 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:05 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:05.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:05 smithi134 ceph-mon[112514]: pgmap v203: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:05.980 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:05 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:05.980 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:05 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:05.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:05 smithi173 ceph-mon[83703]: pgmap v203: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:06.974 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:06 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:06.974 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:06 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:06.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:06 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:06.976 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:06 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:07.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:07 smithi134 ceph-mon[112514]: pgmap v204: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:07.977 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:07 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:29:07.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:07 smithi173 ceph-mon[83703]: pgmap v204: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:07.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:07 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:29:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: pgmap v205: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:29:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:29:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:29:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:29:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.cygfxr"}]': finished 2024-02-16T22:29:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.jyajef"}]: dispatch 2024-02-16T22:29:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.jyajef"}]': finished 2024-02-16T22:29:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi173.phstvm"}]: dispatch 2024-02-16T22:29:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi173.phstvm"}]': finished 2024-02-16T22:29:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi173.qljqef"}]: dispatch 2024-02-16T22:29:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi173.qljqef"}]': finished 2024-02-16T22:29:10.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:10 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-16T22:29:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: pgmap v205: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:29:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:29:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:29:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:10.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.cygfxr"}]: dispatch 2024-02-16T22:29:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.cygfxr"}]': finished 2024-02-16T22:29:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.jyajef"}]: dispatch 2024-02-16T22:29:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.jyajef"}]': finished 2024-02-16T22:29:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi173.phstvm"}]: dispatch 2024-02-16T22:29:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi173.phstvm"}]': finished 2024-02-16T22:29:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi173.qljqef"}]: dispatch 2024-02-16T22:29:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi173.qljqef"}]': finished 2024-02-16T22:29:10.482 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:10 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-16T22:29:11.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: Upgrade: Setting container_image for all mds 2024-02-16T22:29:11.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: Upgrade: Setting filesystem cephfs Joinable 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: Standby daemon mds.cephfs.smithi134.cygfxr assigned to filesystem cephfs as rank 0 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: Standby daemon mds.cephfs.smithi134.jyajef assigned to filesystem cephfs as rank 1 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: fsmap cephfs:2/2 {0=cephfs.smithi134.cygfxr=up:replay,1=cephfs.smithi134.jyajef=up:replay} 2 up:standby 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-16T22:29:11.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-16T22:29:11.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-16T22:29:11.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-16T22:29:11.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-16T22:29:11.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-16T22:29:11.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-16T22:29:11.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-16T22:29:11.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:29:11.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:29:11.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:29:11.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:29:11.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:29:11.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:29:11.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: Upgrade: Setting container_image for all mds 2024-02-16T22:29:11.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: Upgrade: Setting filesystem cephfs Joinable 2024-02-16T22:29:11.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-16T22:29:11.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: Standby daemon mds.cephfs.smithi134.cygfxr assigned to filesystem cephfs as rank 0 2024-02-16T22:29:11.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: Standby daemon mds.cephfs.smithi134.jyajef assigned to filesystem cephfs as rank 1 2024-02-16T22:29:11.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-16T22:29:11.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-16T22:29:11.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: fsmap cephfs:2/2 {0=cephfs.smithi134.cygfxr=up:replay,1=cephfs.smithi134.jyajef=up:replay} 2 up:standby 2024-02-16T22:29:11.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.483 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.484 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-16T22:29:11.485 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.486 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-16T22:29:11.487 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-16T22:29:11.487 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-16T22:29:11.487 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:29:11.487 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:29:11.487 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:29:11.487 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:11.487 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:29:11.487 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:29:11.487 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:29:11.487 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:12 smithi134 ceph-mon[112514]: Upgrade: Setting container_image for all rgw 2024-02-16T22:29:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:12 smithi134 ceph-mon[112514]: Upgrade: Setting container_image for all rbd-mirror 2024-02-16T22:29:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:12 smithi134 ceph-mon[112514]: Upgrade: Setting container_image for all ceph-exporter 2024-02-16T22:29:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:12 smithi134 ceph-mon[112514]: Upgrade: Setting container_image for all iscsi 2024-02-16T22:29:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:12 smithi134 ceph-mon[112514]: Upgrade: Setting container_image for all nfs 2024-02-16T22:29:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:12 smithi134 ceph-mon[112514]: Upgrade: Setting container_image for all nvmeof 2024-02-16T22:29:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:12 smithi134 ceph-mon[112514]: Upgrade: Finalizing container_image settings 2024-02-16T22:29:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:12 smithi134 ceph-mon[112514]: Upgrade: Complete! 2024-02-16T22:29:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:12 smithi134 ceph-mon[112514]: pgmap v206: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:12 smithi173 ceph-mon[83703]: Upgrade: Setting container_image for all rgw 2024-02-16T22:29:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:12 smithi173 ceph-mon[83703]: Upgrade: Setting container_image for all rbd-mirror 2024-02-16T22:29:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:12 smithi173 ceph-mon[83703]: Upgrade: Setting container_image for all ceph-exporter 2024-02-16T22:29:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:12 smithi173 ceph-mon[83703]: Upgrade: Setting container_image for all iscsi 2024-02-16T22:29:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:12 smithi173 ceph-mon[83703]: Upgrade: Setting container_image for all nfs 2024-02-16T22:29:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:12 smithi173 ceph-mon[83703]: Upgrade: Setting container_image for all nvmeof 2024-02-16T22:29:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:12 smithi173 ceph-mon[83703]: Upgrade: Finalizing container_image settings 2024-02-16T22:29:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:12 smithi173 ceph-mon[83703]: Upgrade: Complete! 2024-02-16T22:29:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:12 smithi173 ceph-mon[83703]: pgmap v206: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:13.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:13 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:13.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:13 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:14.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:14 smithi134 ceph-mon[112514]: pgmap v207: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s rd, 1 op/s 2024-02-16T22:29:14.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:14 smithi173 ceph-mon[83703]: pgmap v207: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s rd, 1 op/s 2024-02-16T22:29:16.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:16 smithi134 ceph-mon[112514]: pgmap v208: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-16T22:29:16.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:16 smithi173 ceph-mon[83703]: pgmap v208: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-16T22:29:18.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:18 smithi134 ceph-mon[112514]: pgmap v209: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-02-16T22:29:18.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:18 smithi173 ceph-mon[83703]: pgmap v209: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-02-16T22:29:19.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:19 smithi134 ceph-mon[112514]: mds.? [v2:172.21.15.134:6826/845650190,v1:172.21.15.134:6827/845650190] up:resolve 2024-02-16T22:29:19.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:19 smithi134 ceph-mon[112514]: mds.? [v2:172.21.15.134:6828/3664331772,v1:172.21.15.134:6829/3664331772] up:resolve 2024-02-16T22:29:19.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:19 smithi134 ceph-mon[112514]: fsmap cephfs:2/2 {0=cephfs.smithi134.cygfxr=up:resolve,1=cephfs.smithi134.jyajef=up:resolve} 2 up:standby 2024-02-16T22:29:19.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:19 smithi134 ceph-mon[112514]: pgmap v210: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-02-16T22:29:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:19 smithi173 ceph-mon[83703]: mds.? [v2:172.21.15.134:6826/845650190,v1:172.21.15.134:6827/845650190] up:resolve 2024-02-16T22:29:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:19 smithi173 ceph-mon[83703]: mds.? [v2:172.21.15.134:6828/3664331772,v1:172.21.15.134:6829/3664331772] up:resolve 2024-02-16T22:29:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:19 smithi173 ceph-mon[83703]: fsmap cephfs:2/2 {0=cephfs.smithi134.cygfxr=up:resolve,1=cephfs.smithi134.jyajef=up:resolve} 2 up:standby 2024-02-16T22:29:19.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:19 smithi173 ceph-mon[83703]: pgmap v210: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-02-16T22:29:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:20 smithi134 ceph-mon[112514]: reconnect by client.14526 v1:192.168.0.1:0/1977345001 after 0 2024-02-16T22:29:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:20 smithi134 ceph-mon[112514]: reconnect by client.14526 v1:192.168.0.1:0/1977345001 after 0 2024-02-16T22:29:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:20 smithi134 ceph-mon[112514]: reconnect by client.24315 v1:192.168.0.1:0/161177360 after 0 2024-02-16T22:29:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:20 smithi134 ceph-mon[112514]: reconnect by client.24315 v1:192.168.0.1:0/161177360 after 0 2024-02-16T22:29:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:20 smithi134 ceph-mon[112514]: mds.? [v2:172.21.15.134:6826/845650190,v1:172.21.15.134:6827/845650190] up:reconnect 2024-02-16T22:29:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:20 smithi134 ceph-mon[112514]: mds.? [v2:172.21.15.134:6828/3664331772,v1:172.21.15.134:6829/3664331772] up:reconnect 2024-02-16T22:29:20.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:20 smithi134 ceph-mon[112514]: fsmap cephfs:2/2 {0=cephfs.smithi134.cygfxr=up:reconnect,1=cephfs.smithi134.jyajef=up:reconnect} 2 up:standby 2024-02-16T22:29:20.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:20 smithi173 ceph-mon[83703]: reconnect by client.14526 v1:192.168.0.1:0/1977345001 after 0 2024-02-16T22:29:20.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:20 smithi173 ceph-mon[83703]: reconnect by client.14526 v1:192.168.0.1:0/1977345001 after 0 2024-02-16T22:29:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:20 smithi173 ceph-mon[83703]: reconnect by client.24315 v1:192.168.0.1:0/161177360 after 0 2024-02-16T22:29:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:20 smithi173 ceph-mon[83703]: reconnect by client.24315 v1:192.168.0.1:0/161177360 after 0 2024-02-16T22:29:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:20 smithi173 ceph-mon[83703]: mds.? [v2:172.21.15.134:6826/845650190,v1:172.21.15.134:6827/845650190] up:reconnect 2024-02-16T22:29:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:20 smithi173 ceph-mon[83703]: mds.? [v2:172.21.15.134:6828/3664331772,v1:172.21.15.134:6829/3664331772] up:reconnect 2024-02-16T22:29:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:20 smithi173 ceph-mon[83703]: fsmap cephfs:2/2 {0=cephfs.smithi134.cygfxr=up:reconnect,1=cephfs.smithi134.jyajef=up:reconnect} 2 up:standby 2024-02-16T22:29:20.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.973+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/4146740648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e241038f0 msgr2=0x7f8e240fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:20.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.973+0000 7f8e2b4e0700 1 --2- 172.21.15.134:0/4146740648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e241038f0 0x7f8e240fcf60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8e14004940 tx=0x7f8e14009e30 comp rx=0 tx=0).stop 2024-02-16T22:29:20.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.973+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/4146740648 shutdown_connections 2024-02-16T22:29:20.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.973+0000 7f8e2b4e0700 1 --2- 172.21.15.134:0/4146740648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e241038f0 0x7f8e240fcf60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:20.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.973+0000 7f8e2b4e0700 1 --2- 172.21.15.134:0/4146740648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e24102f50 0x7f8e24103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:20.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.973+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/4146740648 >> 172.21.15.134:0/4146740648 conn(0x7f8e240f8ac0 msgr2=0x7f8e240faed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:29:20.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.974+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/4146740648 shutdown_connections 2024-02-16T22:29:20.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.974+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/4146740648 wait complete. 2024-02-16T22:29:20.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.974+0000 7f8e2b4e0700 1 Processor -- start 2024-02-16T22:29:20.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.974+0000 7f8e2b4e0700 1 -- start start 2024-02-16T22:29:20.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.974+0000 7f8e2b4e0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e24102f50 0x7f8e24070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:20.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.974+0000 7f8e2b4e0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e241038f0 0x7f8e240707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:20.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.974+0000 7f8e2b4e0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e24070dd0 con 0x7f8e24102f50 2024-02-16T22:29:20.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.974+0000 7f8e2b4e0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e24070f40 con 0x7f8e241038f0 2024-02-16T22:29:20.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.975+0000 7f8e2927c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e24102f50 0x7f8e24070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:20.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.975+0000 7f8e2927c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e24102f50 0x7f8e24070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49136/0 (socket says 172.21.15.134:49136) 2024-02-16T22:29:20.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.975+0000 7f8e2927c700 1 -- 172.21.15.134:0/647671874 learned_addr learned my addr 172.21.15.134:0/647671874 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:29:20.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.975+0000 7f8e28a7b700 1 --2- 172.21.15.134:0/647671874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e241038f0 0x7f8e240707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:20.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.975+0000 7f8e2927c700 1 -- 172.21.15.134:0/647671874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e241038f0 msgr2=0x7f8e240707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:20.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.975+0000 7f8e2927c700 1 --2- 172.21.15.134:0/647671874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e241038f0 0x7f8e240707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:20.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.975+0000 7f8e2927c700 1 -- 172.21.15.134:0/647671874 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14005040 con 0x7f8e24102f50 2024-02-16T22:29:20.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.975+0000 7f8e2927c700 1 --2- 172.21.15.134:0/647671874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e24102f50 0x7f8e24070290 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000c8c0 tx=0x7f8e200044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:29:20.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.975+0000 7f8e19ffb700 1 -- 172.21.15.134:0/647671874 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e2000a760 con 0x7f8e24102f50 2024-02-16T22:29:20.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.975+0000 7f8e19ffb700 1 -- 172.21.15.134:0/647671874 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e2000ad90 con 0x7f8e24102f50 2024-02-16T22:29:20.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.975+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/647671874 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e24119ce0 con 0x7f8e24102f50 2024-02-16T22:29:20.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.975+0000 7f8e19ffb700 1 -- 172.21.15.134:0/647671874 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e200113a0 con 0x7f8e24102f50 2024-02-16T22:29:20.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.976+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/647671874 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2411a190 con 0x7f8e24102f50 2024-02-16T22:29:20.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.976+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/647671874 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e240fc6e0 con 0x7f8e24102f50 2024-02-16T22:29:20.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.977+0000 7f8e19ffb700 1 -- 172.21.15.134:0/647671874 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f8e20012400 con 0x7f8e24102f50 2024-02-16T22:29:20.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.977+0000 7f8e19ffb700 1 --2- 172.21.15.134:0/647671874 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8e1006d7e0 0x7f8e1006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:20.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.978+0000 7f8e28a7b700 1 --2- 172.21.15.134:0/647671874 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8e1006d7e0 0x7f8e1006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:20.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.978+0000 7f8e19ffb700 1 -- 172.21.15.134:0/647671874 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f8e2008cef0 con 0x7f8e24102f50 2024-02-16T22:29:20.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.978+0000 7f8e28a7b700 1 --2- 172.21.15.134:0/647671874 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8e1006d7e0 0x7f8e1006fc90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400b3b0 tx=0x7f8e14009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:29:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:20.982+0000 7f8e19ffb700 1 -- 172.21.15.134:0/647671874 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8e20056760 con 0x7f8e24102f50 2024-02-16T22:29:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:21.204+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/647671874 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e24071ae0 con 0x7f8e1006d7e0 2024-02-16T22:29:21.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:21.205+0000 7f8e19ffb700 1 -- 172.21.15.134:0/647671874 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f8e24071ae0 con 0x7f8e1006d7e0 2024-02-16T22:29:21.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:21.208+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/647671874 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8e1006d7e0 msgr2=0x7f8e1006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:21.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:21.208+0000 7f8e2b4e0700 1 --2- 172.21.15.134:0/647671874 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8e1006d7e0 0x7f8e1006fc90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400b3b0 tx=0x7f8e14009e30 comp rx=0 tx=0).stop 2024-02-16T22:29:21.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:21.208+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/647671874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e24102f50 msgr2=0x7f8e24070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:21.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:21.208+0000 7f8e2b4e0700 1 --2- 172.21.15.134:0/647671874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e24102f50 0x7f8e24070290 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000c8c0 tx=0x7f8e200044c0 comp rx=0 tx=0).stop 2024-02-16T22:29:21.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:21.208+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/647671874 shutdown_connections 2024-02-16T22:29:21.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:21.208+0000 7f8e2b4e0700 1 --2- 172.21.15.134:0/647671874 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f8e1006d7e0 0x7f8e1006fc90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:21.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:21.208+0000 7f8e2b4e0700 1 --2- 172.21.15.134:0/647671874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e24102f50 0x7f8e24070290 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:21.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:21.208+0000 7f8e2b4e0700 1 --2- 172.21.15.134:0/647671874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e241038f0 0x7f8e240707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:21.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:21.208+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/647671874 >> 172.21.15.134:0/647671874 conn(0x7f8e240f8ac0 msgr2=0x7f8e240fa630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:29:21.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:21.208+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/647671874 shutdown_connections 2024-02-16T22:29:21.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:21.208+0000 7f8e2b4e0700 1 -- 172.21.15.134:0/647671874 wait complete. 2024-02-16T22:29:21.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:21 smithi134 ceph-mon[112514]: mds.? [v2:172.21.15.134:6826/845650190,v1:172.21.15.134:6827/845650190] up:rejoin 2024-02-16T22:29:21.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:21 smithi134 ceph-mon[112514]: mds.? [v2:172.21.15.134:6828/3664331772,v1:172.21.15.134:6829/3664331772] up:rejoin 2024-02-16T22:29:21.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:21 smithi134 ceph-mon[112514]: fsmap cephfs:2/2 {0=cephfs.smithi134.cygfxr=up:rejoin,1=cephfs.smithi134.jyajef=up:rejoin} 2 up:standby 2024-02-16T22:29:21.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:21 smithi134 ceph-mon[112514]: daemon mds.cephfs.smithi134.cygfxr is now active in filesystem cephfs as rank 0 2024-02-16T22:29:21.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:21 smithi134 ceph-mon[112514]: daemon mds.cephfs.smithi134.jyajef is now active in filesystem cephfs as rank 1 2024-02-16T22:29:21.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:21 smithi134 ceph-mon[112514]: pgmap v211: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8 op/s 2024-02-16T22:29:21.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:21 smithi173 ceph-mon[83703]: mds.? [v2:172.21.15.134:6826/845650190,v1:172.21.15.134:6827/845650190] up:rejoin 2024-02-16T22:29:21.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:21 smithi173 ceph-mon[83703]: mds.? [v2:172.21.15.134:6828/3664331772,v1:172.21.15.134:6829/3664331772] up:rejoin 2024-02-16T22:29:21.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:21 smithi173 ceph-mon[83703]: fsmap cephfs:2/2 {0=cephfs.smithi134.cygfxr=up:rejoin,1=cephfs.smithi134.jyajef=up:rejoin} 2 up:standby 2024-02-16T22:29:21.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:21 smithi173 ceph-mon[83703]: daemon mds.cephfs.smithi134.cygfxr is now active in filesystem cephfs as rank 0 2024-02-16T22:29:21.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:21 smithi173 ceph-mon[83703]: daemon mds.cephfs.smithi134.jyajef is now active in filesystem cephfs as rank 1 2024-02-16T22:29:21.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:21 smithi173 ceph-mon[83703]: pgmap v211: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8 op/s 2024-02-16T22:29:22.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:22 smithi134 ceph-mon[112514]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-16T22:29:22.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:22 smithi134 ceph-mon[112514]: Cluster is now healthy 2024-02-16T22:29:22.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:22 smithi134 ceph-mon[112514]: mds.? [v2:172.21.15.134:6826/845650190,v1:172.21.15.134:6827/845650190] up:active 2024-02-16T22:29:22.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:22 smithi134 ceph-mon[112514]: mds.? [v2:172.21.15.134:6828/3664331772,v1:172.21.15.134:6829/3664331772] up:active 2024-02-16T22:29:22.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:22 smithi134 ceph-mon[112514]: fsmap cephfs:2 {0=cephfs.smithi134.cygfxr=up:active,1=cephfs.smithi134.jyajef=up:active} 2 up:standby 2024-02-16T22:29:22.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:22 smithi134 ceph-mon[112514]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:29:22.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:22 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:22.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:22 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:29:22.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:22 smithi173 ceph-mon[83703]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-16T22:29:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:22 smithi173 ceph-mon[83703]: Cluster is now healthy 2024-02-16T22:29:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:22 smithi173 ceph-mon[83703]: mds.? [v2:172.21.15.134:6826/845650190,v1:172.21.15.134:6827/845650190] up:active 2024-02-16T22:29:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:22 smithi173 ceph-mon[83703]: mds.? [v2:172.21.15.134:6828/3664331772,v1:172.21.15.134:6829/3664331772] up:active 2024-02-16T22:29:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:22 smithi173 ceph-mon[83703]: fsmap cephfs:2 {0=cephfs.smithi134.cygfxr=up:active,1=cephfs.smithi134.jyajef=up:active} 2 up:standby 2024-02-16T22:29:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:22 smithi173 ceph-mon[83703]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:29:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:22 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:29:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:22 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:29:23.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:23 smithi134 ceph-mon[112514]: pgmap v212: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 341 B/s wr, 9 op/s 2024-02-16T22:29:23.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:23 smithi173 ceph-mon[83703]: pgmap v212: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 341 B/s wr, 9 op/s 2024-02-16T22:29:25.165 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-16T22:29:25.474 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:29:26.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:26 smithi134 ceph-mon[112514]: pgmap v213: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 597 B/s wr, 12 op/s 2024-02-16T22:29:26.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:26 smithi173 ceph-mon[83703]: pgmap v213: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 597 B/s wr, 12 op/s 2024-02-16T22:29:27.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.099+0000 7fb01d4ea700 1 -- 172.21.15.134:0/2121536531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb018102f40 msgr2=0x7fb018103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:27.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.099+0000 7fb01d4ea700 1 --2- 172.21.15.134:0/2121536531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb018102f40 0x7fb018103310 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb008004940 tx=0x7fb008009e30 comp rx=0 tx=0).stop 2024-02-16T22:29:27.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.099+0000 7fb01d4ea700 1 -- 172.21.15.134:0/2121536531 shutdown_connections 2024-02-16T22:29:27.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.099+0000 7fb01d4ea700 1 --2- 172.21.15.134:0/2121536531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0181038e0 0x7fb0180fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:27.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.099+0000 7fb01d4ea700 1 --2- 172.21.15.134:0/2121536531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb018102f40 0x7fb018103310 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:27.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.099+0000 7fb01d4ea700 1 -- 172.21.15.134:0/2121536531 >> 172.21.15.134:0/2121536531 conn(0x7fb0180f8af0 msgr2=0x7fb0180faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:29:27.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.099+0000 7fb01d4ea700 1 -- 172.21.15.134:0/2121536531 shutdown_connections 2024-02-16T22:29:27.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.099+0000 7fb01d4ea700 1 -- 172.21.15.134:0/2121536531 wait complete. 2024-02-16T22:29:27.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.100+0000 7fb01d4ea700 1 Processor -- start 2024-02-16T22:29:27.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.100+0000 7fb01d4ea700 1 -- start start 2024-02-16T22:29:27.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.100+0000 7fb01d4ea700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb018102f40 0x7fb018070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:27.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.100+0000 7fb01d4ea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0181038e0 0x7fb0180707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:27.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.100+0000 7fb01d4ea700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb018070ed0 con 0x7fb0181038e0 2024-02-16T22:29:27.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.100+0000 7fb01d4ea700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb018071040 con 0x7fb018102f40 2024-02-16T22:29:27.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.100+0000 7fb0167fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0181038e0 0x7fb0180707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:27.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.100+0000 7fb0167fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0181038e0 0x7fb0180707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38610/0 (socket says 172.21.15.134:38610) 2024-02-16T22:29:27.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.100+0000 7fb0167fc700 1 -- 172.21.15.134:0/1921915766 learned_addr learned my addr 172.21.15.134:0/1921915766 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:29:27.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.100+0000 7fb016ffd700 1 --2- 172.21.15.134:0/1921915766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb018102f40 0x7fb018070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:27.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.101+0000 7fb0167fc700 1 -- 172.21.15.134:0/1921915766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb018102f40 msgr2=0x7fb018070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:27.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.101+0000 7fb0167fc700 1 --2- 172.21.15.134:0/1921915766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb018102f40 0x7fb018070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:27.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.101+0000 7fb0167fc700 1 -- 172.21.15.134:0/1921915766 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb008005040 con 0x7fb0181038e0 2024-02-16T22:29:27.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.101+0000 7fb0167fc700 1 --2- 172.21.15.134:0/1921915766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0181038e0 0x7fb0180707f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00b790 tx=0x7fb00c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:29:27.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.101+0000 7fafff7fe700 1 -- 172.21.15.134:0/1921915766 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00c00f6f0 con 0x7fb0181038e0 2024-02-16T22:29:27.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.101+0000 7fafff7fe700 1 -- 172.21.15.134:0/1921915766 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb00c00fd20 con 0x7fb0181038e0 2024-02-16T22:29:27.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.101+0000 7fb01d4ea700 1 -- 172.21.15.134:0/1921915766 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb018119d50 con 0x7fb0181038e0 2024-02-16T22:29:27.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.101+0000 7fafff7fe700 1 -- 172.21.15.134:0/1921915766 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00c0103a0 con 0x7fb0181038e0 2024-02-16T22:29:27.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.101+0000 7fb01d4ea700 1 -- 172.21.15.134:0/1921915766 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01811a260 con 0x7fb0181038e0 2024-02-16T22:29:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.102+0000 7fb01d4ea700 1 -- 172.21.15.134:0/1921915766 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0180fc6f0 con 0x7fb0181038e0 2024-02-16T22:29:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.103+0000 7fafff7fe700 1 -- 172.21.15.134:0/1921915766 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fb00c011400 con 0x7fb0181038e0 2024-02-16T22:29:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.103+0000 7fafff7fe700 1 --2- 172.21.15.134:0/1921915766 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb00006d7e0 0x7fb00006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.103+0000 7fafff7fe700 1 -- 172.21.15.134:0/1921915766 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fb00c08ccb0 con 0x7fb0181038e0 2024-02-16T22:29:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.103+0000 7fb016ffd700 1 --2- 172.21.15.134:0/1921915766 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb00006d7e0 0x7fb00006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:27.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.103+0000 7fb016ffd700 1 --2- 172.21.15.134:0/1921915766 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb00006d7e0 0x7fb00006fc90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb008004f90 tx=0x7fb008009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:29:27.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.108+0000 7fafff7fe700 1 -- 172.21.15.134:0/1921915766 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb00c056520 con 0x7fb0181038e0 2024-02-16T22:29:27.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.314+0000 7fb01d4ea700 1 -- 172.21.15.134:0/1921915766 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb018071a40 con 0x7fb00006d7e0 2024-02-16T22:29:27.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.324+0000 7fafff7fe700 1 -- 172.21.15.134:0/1921915766 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb018071a40 con 0x7fb00006d7e0 2024-02-16T22:29:27.326 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:29:27.326 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (7m) 53s ago 18m 25.7M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:29:27.326 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (4m) 53s ago 18m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 429739bfee94 2024-02-16T22:29:27.326 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (4m) 22s ago 17m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 1e81cd2fd510 2024-02-16T22:29:27.326 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (6m) 53s ago 18m 91.3M - 9.4.12 a0ea5e3c46d9 29d29cf667e7 2024-02-16T22:29:27.326 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (75s) 53s ago 12m 11.7M - 19.0.0-1450-gf78a58c0 f081f847070a 9b266de8e573 2024-02-16T22:29:27.326 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (58s) 53s ago 12m 10.3M - 19.0.0-1450-gf78a58c0 f081f847070a ef64a4bb0cda 2024-02-16T22:29:27.326 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (25s) 22s ago 12m 12.6M - 19.0.0-1450-gf78a58c0 f081f847070a f5ae1f55f50e 2024-02-16T22:29:27.326 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (42s) 22s ago 12m 13.9M - 19.0.0-1450-gf78a58c0 f081f847070a cd3e56af44dd 2024-02-16T22:29:27.326 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (8m) 53s ago 19m 506M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:29:27.326 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (8m) 22s ago 17m 451M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:29:27.326 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (5m) 53s ago 20m 52.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2903b3988442 2024-02-16T22:29:27.327 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (5m) 22s ago 17m 45.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a dd7cf2f31226 2024-02-16T22:29:27.327 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 53s ago 18m 16.2M - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:29:27.327 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (7m) 22s ago 17m 14.7M - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:29:27.327 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (4m) 53s ago 16m 95.5M 1557M 19.0.0-1450-gf78a58c0 f081f847070a d0153b47ae7e 2024-02-16T22:29:27.327 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (3m) 53s ago 16m 95.2M 1557M 19.0.0-1450-gf78a58c0 f081f847070a dd1faac850b0 2024-02-16T22:29:27.327 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (3m) 53s ago 15m 90.4M 1557M 19.0.0-1450-gf78a58c0 f081f847070a 0e349c665c73 2024-02-16T22:29:27.327 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (2m) 22s ago 15m 100M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 1f4624a5418b 2024-02-16T22:29:27.327 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (2m) 22s ago 14m 101M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 640d021c13b0 2024-02-16T22:29:27.327 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (93s) 22s ago 14m 86.9M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 8ee59c4c4319 2024-02-16T22:29:27.327 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (7m) 53s ago 17m 61.6M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:29:27.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.326+0000 7fb01d4ea700 1 -- 172.21.15.134:0/1921915766 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb00006d7e0 msgr2=0x7fb00006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:27.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.326+0000 7fb01d4ea700 1 --2- 172.21.15.134:0/1921915766 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb00006d7e0 0x7fb00006fc90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb008004f90 tx=0x7fb008009e30 comp rx=0 tx=0).stop 2024-02-16T22:29:27.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.326+0000 7fb01d4ea700 1 -- 172.21.15.134:0/1921915766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0181038e0 msgr2=0x7fb0180707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:27.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.326+0000 7fb01d4ea700 1 --2- 172.21.15.134:0/1921915766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0181038e0 0x7fb0180707f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00b790 tx=0x7fb00c009220 comp rx=0 tx=0).stop 2024-02-16T22:29:27.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.326+0000 7fb01d4ea700 1 -- 172.21.15.134:0/1921915766 shutdown_connections 2024-02-16T22:29:27.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.326+0000 7fb01d4ea700 1 --2- 172.21.15.134:0/1921915766 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb00006d7e0 0x7fb00006fc90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:27.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.326+0000 7fb01d4ea700 1 --2- 172.21.15.134:0/1921915766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb018102f40 0x7fb018070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:27.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.326+0000 7fb01d4ea700 1 --2- 172.21.15.134:0/1921915766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0181038e0 0x7fb0180707f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:27.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.326+0000 7fb01d4ea700 1 -- 172.21.15.134:0/1921915766 >> 172.21.15.134:0/1921915766 conn(0x7fb0180f8af0 msgr2=0x7fb0180fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:29:27.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.326+0000 7fb01d4ea700 1 -- 172.21.15.134:0/1921915766 shutdown_connections 2024-02-16T22:29:27.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:27.326+0000 7fb01d4ea700 1 -- 172.21.15.134:0/1921915766 wait complete. 2024-02-16T22:29:27.966 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade status' 2024-02-16T22:29:28.224 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:29:28.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:28 smithi134 ceph-mon[112514]: pgmap v214: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8.2 MiB/s rd, 9.2 KiB/s wr, 13 op/s 2024-02-16T22:29:28.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:28 smithi173 ceph-mon[83703]: pgmap v214: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8.2 MiB/s rd, 9.2 KiB/s wr, 13 op/s 2024-02-16T22:29:29.472 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:29 smithi134 ceph-mon[112514]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:29:29.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:29 smithi173 ceph-mon[83703]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:29:29.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.842+0000 7fe4a357f700 1 -- 172.21.15.134:0/275093461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe49c101e50 msgr2=0x7fe49c102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:29.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.842+0000 7fe4a357f700 1 --2- 172.21.15.134:0/275093461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe49c101e50 0x7fe49c102220 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe498004940 tx=0x7fe498009e30 comp rx=0 tx=0).stop 2024-02-16T22:29:29.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.842+0000 7fe4a357f700 1 -- 172.21.15.134:0/275093461 shutdown_connections 2024-02-16T22:29:29.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.842+0000 7fe4a357f700 1 --2- 172.21.15.134:0/275093461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe49c1027f0 0x7fe49c0fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:29.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.842+0000 7fe4a357f700 1 --2- 172.21.15.134:0/275093461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe49c101e50 0x7fe49c102220 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:29.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.842+0000 7fe4a357f700 1 -- 172.21.15.134:0/275093461 >> 172.21.15.134:0/275093461 conn(0x7fe49c0f79e0 msgr2=0x7fe49c0f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:29:29.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.842+0000 7fe4a357f700 1 -- 172.21.15.134:0/275093461 shutdown_connections 2024-02-16T22:29:29.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.842+0000 7fe4a357f700 1 -- 172.21.15.134:0/275093461 wait complete. 2024-02-16T22:29:29.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.843+0000 7fe4a357f700 1 Processor -- start 2024-02-16T22:29:29.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.843+0000 7fe4a357f700 1 -- start start 2024-02-16T22:29:29.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.843+0000 7fe4a357f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe49c101e50 0x7fe49c113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:29.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.843+0000 7fe4a357f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe49c1027f0 0x7fe49c113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:29.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.843+0000 7fe4a357f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c1145c0 con 0x7fe49c101e50 2024-02-16T22:29:29.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.843+0000 7fe4a357f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c10d8f0 con 0x7fe49c1027f0 2024-02-16T22:29:29.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.843+0000 7fe4a131b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe49c101e50 0x7fe49c113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:29.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.843+0000 7fe4a131b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe49c101e50 0x7fe49c113a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38626/0 (socket says 172.21.15.134:38626) 2024-02-16T22:29:29.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.843+0000 7fe4a131b700 1 -- 172.21.15.134:0/1024449540 learned_addr learned my addr 172.21.15.134:0/1024449540 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:29:29.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.843+0000 7fe4a0b1a700 1 --2- 172.21.15.134:0/1024449540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe49c1027f0 0x7fe49c113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:29.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.844+0000 7fe4a131b700 1 -- 172.21.15.134:0/1024449540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe49c1027f0 msgr2=0x7fe49c113f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:29.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.844+0000 7fe4a131b700 1 --2- 172.21.15.134:0/1024449540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe49c1027f0 0x7fe49c113f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:29.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.844+0000 7fe4a131b700 1 -- 172.21.15.134:0/1024449540 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe498005040 con 0x7fe49c101e50 2024-02-16T22:29:29.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.844+0000 7fe4a131b700 1 --2- 172.21.15.134:0/1024449540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe49c101e50 0x7fe49c113a30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe498009100 tx=0x7fe498009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:29:29.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.844+0000 7fe491ffb700 1 -- 172.21.15.134:0/1024449540 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe49800e040 con 0x7fe49c101e50 2024-02-16T22:29:29.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.844+0000 7fe491ffb700 1 -- 172.21.15.134:0/1024449540 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe498013420 con 0x7fe49c101e50 2024-02-16T22:29:29.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.844+0000 7fe491ffb700 1 -- 172.21.15.134:0/1024449540 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe49800bee0 con 0x7fe49c101e50 2024-02-16T22:29:29.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.844+0000 7fe4a357f700 1 -- 172.21.15.134:0/1024449540 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c10db70 con 0x7fe49c101e50 2024-02-16T22:29:29.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.844+0000 7fe4a357f700 1 -- 172.21.15.134:0/1024449540 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c10e0b0 con 0x7fe49c101e50 2024-02-16T22:29:29.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.845+0000 7fe4a357f700 1 -- 172.21.15.134:0/1024449540 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c064b00 con 0x7fe49c101e50 2024-02-16T22:29:29.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.846+0000 7fe491ffb700 1 -- 172.21.15.134:0/1024449540 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fe49800ba10 con 0x7fe49c101e50 2024-02-16T22:29:29.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.846+0000 7fe491ffb700 1 --2- 172.21.15.134:0/1024449540 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe48806d7e0 0x7fe48806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:29.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.846+0000 7fe491ffb700 1 -- 172.21.15.134:0/1024449540 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe49808e270 con 0x7fe49c101e50 2024-02-16T22:29:29.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.846+0000 7fe4a0b1a700 1 --2- 172.21.15.134:0/1024449540 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe48806d7e0 0x7fe48806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:29.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.847+0000 7fe4a0b1a700 1 --2- 172.21.15.134:0/1024449540 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe48806d7e0 0x7fe48806fc90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe49c10f260 tx=0x7fe48c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:29:29.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:29.851+0000 7fe491ffb700 1 -- 172.21.15.134:0/1024449540 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe49805b610 con 0x7fe49c101e50 2024-02-16T22:29:30.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:30.065+0000 7fe4a357f700 1 -- 172.21.15.134:0/1024449540 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe49c0fb5b0 con 0x7fe48806d7e0 2024-02-16T22:29:30.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:30.066+0000 7fe491ffb700 1 -- 172.21.15.134:0/1024449540 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fe49c0fb5b0 con 0x7fe48806d7e0 2024-02-16T22:29:30.068 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:29:30.068 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": null, 2024-02-16T22:29:30.068 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": false, 2024-02-16T22:29:30.068 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "", 2024-02-16T22:29:30.068 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-02-16T22:29:30.068 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": null, 2024-02-16T22:29:30.068 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "", 2024-02-16T22:29:30.068 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-02-16T22:29:30.068 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:29:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:30.069+0000 7fe4a357f700 1 -- 172.21.15.134:0/1024449540 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe48806d7e0 msgr2=0x7fe48806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:30.069+0000 7fe4a357f700 1 --2- 172.21.15.134:0/1024449540 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe48806d7e0 0x7fe48806fc90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe49c10f260 tx=0x7fe48c00b040 comp rx=0 tx=0).stop 2024-02-16T22:29:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:30.069+0000 7fe4a357f700 1 -- 172.21.15.134:0/1024449540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe49c101e50 msgr2=0x7fe49c113a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:30.069+0000 7fe4a357f700 1 --2- 172.21.15.134:0/1024449540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe49c101e50 0x7fe49c113a30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe498009100 tx=0x7fe498009e30 comp rx=0 tx=0).stop 2024-02-16T22:29:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:30.069+0000 7fe4a357f700 1 -- 172.21.15.134:0/1024449540 shutdown_connections 2024-02-16T22:29:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:30.069+0000 7fe4a357f700 1 --2- 172.21.15.134:0/1024449540 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fe48806d7e0 0x7fe48806fc90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:30.069+0000 7fe4a357f700 1 --2- 172.21.15.134:0/1024449540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe49c101e50 0x7fe49c113a30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:30.069+0000 7fe4a357f700 1 --2- 172.21.15.134:0/1024449540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe49c1027f0 0x7fe49c113f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:30.069+0000 7fe4a357f700 1 -- 172.21.15.134:0/1024449540 >> 172.21.15.134:0/1024449540 conn(0x7fe49c0f79e0 msgr2=0x7fe49c0f9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:29:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:30.069+0000 7fe4a357f700 1 -- 172.21.15.134:0/1024449540 shutdown_connections 2024-02-16T22:29:30.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:30.069+0000 7fe4a357f700 1 -- 172.21.15.134:0/1024449540 wait complete. 2024-02-16T22:29:30.231 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:30 smithi173 ceph-mon[83703]: pgmap v215: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.2 MiB/s rd, 9.2 KiB/s wr, 12 op/s 2024-02-16T22:29:30.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:30 smithi134 ceph-mon[112514]: pgmap v215: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.2 MiB/s rd, 9.2 KiB/s wr, 12 op/s 2024-02-16T22:29:30.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph health detail' 2024-02-16T22:29:30.933 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:29:31.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:31 smithi134 ceph-mon[112514]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:29:31.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:31 smithi173 ceph-mon[83703]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:29:32.356 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:32 smithi134 ceph-mon[112514]: pgmap v216: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 9.2 KiB/s wr, 11 op/s 2024-02-16T22:29:32.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:32 smithi173 ceph-mon[83703]: pgmap v216: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 9.2 KiB/s wr, 11 op/s 2024-02-16T22:29:32.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.697+0000 7f28501b3700 1 -- 172.21.15.134:0/34761087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fe8f0 msgr2=0x7f2848107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:32.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.697+0000 7f28501b3700 1 --2- 172.21.15.134:0/34761087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fe8f0 0x7f2848107050 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f283c004970 tx=0x7f283c009e30 comp rx=0 tx=0).stop 2024-02-16T22:29:32.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.697+0000 7f28501b3700 1 -- 172.21.15.134:0/34761087 shutdown_connections 2024-02-16T22:29:32.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.697+0000 7f28501b3700 1 --2- 172.21.15.134:0/34761087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fe8f0 0x7f2848107050 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:32.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.697+0000 7f28501b3700 1 --2- 172.21.15.134:0/34761087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28480fdfe0 0x7f28480fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:32.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.697+0000 7f28501b3700 1 -- 172.21.15.134:0/34761087 >> 172.21.15.134:0/34761087 conn(0x7f2848071d90 msgr2=0x7f2848072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:29:32.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.697+0000 7f28501b3700 1 -- 172.21.15.134:0/34761087 shutdown_connections 2024-02-16T22:29:32.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.697+0000 7f28501b3700 1 -- 172.21.15.134:0/34761087 wait complete. 2024-02-16T22:29:32.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.697+0000 7f28501b3700 1 Processor -- start 2024-02-16T22:29:32.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.697+0000 7f28501b3700 1 -- start start 2024-02-16T22:29:32.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f28501b3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28480fdfe0 0x7f28480fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:32.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f28501b3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fe8f0 0x7f28480fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:32.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f28501b3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28480fc9e0 con 0x7f28480fe8f0 2024-02-16T22:29:32.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f28501b3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28480fcb50 con 0x7f28480fdfe0 2024-02-16T22:29:32.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f284d74e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fe8f0 0x7f28480fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:32.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f284d74e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fe8f0 0x7f28480fc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40000/0 (socket says 172.21.15.134:40000) 2024-02-16T22:29:32.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f284d74e700 1 -- 172.21.15.134:0/1640699135 learned_addr learned my addr 172.21.15.134:0/1640699135 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:29:32.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f284df4f700 1 --2- 172.21.15.134:0/1640699135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28480fdfe0 0x7f28480fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:32.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f284d74e700 1 -- 172.21.15.134:0/1640699135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28480fdfe0 msgr2=0x7f28480fbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:32.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f284d74e700 1 --2- 172.21.15.134:0/1640699135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28480fdfe0 0x7f28480fbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:32.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f284d74e700 1 -- 172.21.15.134:0/1640699135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c005040 con 0x7f28480fe8f0 2024-02-16T22:29:32.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f284df4f700 1 --2- 172.21.15.134:0/1640699135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28480fdfe0 0x7f28480fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:29:32.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f284d74e700 1 --2- 172.21.15.134:0/1640699135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fe8f0 0x7f28480fc3e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f283c009150 tx=0x7f283c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:29:32.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f28467fc700 1 -- 172.21.15.134:0/1640699135 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f283c00e040 con 0x7f28480fe8f0 2024-02-16T22:29:32.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f28467fc700 1 -- 172.21.15.134:0/1640699135 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f283c004290 con 0x7f28480fe8f0 2024-02-16T22:29:32.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f28501b3700 1 -- 172.21.15.134:0/1640699135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2848119c30 con 0x7f28480fe8f0 2024-02-16T22:29:32.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f28467fc700 1 -- 172.21.15.134:0/1640699135 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f283c01c630 con 0x7f28480fe8f0 2024-02-16T22:29:32.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.698+0000 7f28501b3700 1 -- 172.21.15.134:0/1640699135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284811a090 con 0x7f28480fe8f0 2024-02-16T22:29:32.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.699+0000 7f28501b3700 1 -- 172.21.15.134:0/1640699135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28481046c0 con 0x7f28480fe8f0 2024-02-16T22:29:32.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.700+0000 7f28467fc700 1 -- 172.21.15.134:0/1640699135 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f283c013980 con 0x7f28480fe8f0 2024-02-16T22:29:32.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.700+0000 7f28467fc700 1 --2- 172.21.15.134:0/1640699135 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f283006d7f0 0x7f283006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:32.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.701+0000 7f284df4f700 1 --2- 172.21.15.134:0/1640699135 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f283006d7f0 0x7f283006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:32.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.701+0000 7f28467fc700 1 -- 172.21.15.134:0/1640699135 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f283c08e290 con 0x7f28480fe8f0 2024-02-16T22:29:32.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.701+0000 7f284df4f700 1 --2- 172.21.15.134:0/1640699135 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f283006d7f0 0x7f283006fca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f28380041d0 tx=0x7f2838009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:29:32.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.705+0000 7f28467fc700 1 -- 172.21.15.134:0/1640699135 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f283c057b00 con 0x7f28480fe8f0 2024-02-16T22:29:32.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.975+0000 7f28501b3700 1 -- 172.21.15.134:0/1640699135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f284804bed0 con 0x7f28480fe8f0 2024-02-16T22:29:32.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.976+0000 7f28467fc700 1 -- 172.21.15.134:0/1640699135 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f283c05b1c0 con 0x7f28480fe8f0 2024-02-16T22:29:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-02-16T22:29:32.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.979+0000 7f28501b3700 1 -- 172.21.15.134:0/1640699135 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f283006d7f0 msgr2=0x7f283006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:32.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.979+0000 7f28501b3700 1 --2- 172.21.15.134:0/1640699135 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f283006d7f0 0x7f283006fca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f28380041d0 tx=0x7f2838009040 comp rx=0 tx=0).stop 2024-02-16T22:29:32.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.979+0000 7f28501b3700 1 -- 172.21.15.134:0/1640699135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fe8f0 msgr2=0x7f28480fc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:32.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.979+0000 7f28501b3700 1 --2- 172.21.15.134:0/1640699135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fe8f0 0x7f28480fc3e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f283c009150 tx=0x7f283c009e30 comp rx=0 tx=0).stop 2024-02-16T22:29:32.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.979+0000 7f28501b3700 1 -- 172.21.15.134:0/1640699135 shutdown_connections 2024-02-16T22:29:32.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.979+0000 7f28501b3700 1 --2- 172.21.15.134:0/1640699135 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f283006d7f0 0x7f283006fca0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:32.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.979+0000 7f28501b3700 1 --2- 172.21.15.134:0/1640699135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28480fdfe0 0x7f28480fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:32.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.979+0000 7f28501b3700 1 --2- 172.21.15.134:0/1640699135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28480fe8f0 0x7f28480fc3e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:32.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.979+0000 7f28501b3700 1 -- 172.21.15.134:0/1640699135 >> 172.21.15.134:0/1640699135 conn(0x7f2848071d90 msgr2=0x7f2848101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:29:32.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.979+0000 7f28501b3700 1 -- 172.21.15.134:0/1640699135 shutdown_connections 2024-02-16T22:29:32.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:32.979+0000 7f28501b3700 1 -- 172.21.15.134:0/1640699135 wait complete. 2024-02-16T22:29:33.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:33 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1640699135' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:29:33.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:33 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1640699135' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-16T22:29:33.634 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions' 2024-02-16T22:29:33.892 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:29:34.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:34 smithi134 ceph-mon[112514]: pgmap v217: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.4 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-02-16T22:29:34.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:34 smithi173 ceph-mon[83703]: pgmap v217: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.4 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-02-16T22:29:35.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.498+0000 7f92b2820700 1 -- 172.21.15.134:0/3129998187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac1027e0 msgr2=0x7f92ac0fbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:35.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.498+0000 7f92b2820700 1 --2- 172.21.15.134:0/3129998187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac1027e0 0x7f92ac0fbe50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f92a0004940 tx=0x7f92a0009e30 comp rx=0 tx=0).stop 2024-02-16T22:29:35.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.499+0000 7f92b2820700 1 -- 172.21.15.134:0/3129998187 shutdown_connections 2024-02-16T22:29:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.499+0000 7f92b2820700 1 --2- 172.21.15.134:0/3129998187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac1027e0 0x7f92ac0fbe50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.499+0000 7f92b2820700 1 --2- 172.21.15.134:0/3129998187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92ac101e40 0x7f92ac102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.499+0000 7f92b2820700 1 -- 172.21.15.134:0/3129998187 >> 172.21.15.134:0/3129998187 conn(0x7f92ac0f7990 msgr2=0x7f92ac0f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:29:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.499+0000 7f92b2820700 1 -- 172.21.15.134:0/3129998187 shutdown_connections 2024-02-16T22:29:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.499+0000 7f92b2820700 1 -- 172.21.15.134:0/3129998187 wait complete. 2024-02-16T22:29:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.499+0000 7f92b2820700 1 Processor -- start 2024-02-16T22:29:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.499+0000 7f92b2820700 1 -- start start 2024-02-16T22:29:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92b2820700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92ac101e40 0x7f92ac10c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92b2820700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac1027e0 0x7f92ac10cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92b2820700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac10d180 con 0x7f92ac1027e0 2024-02-16T22:29:35.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92b2820700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac10d2f0 con 0x7f92ac101e40 2024-02-16T22:29:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92ab7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac1027e0 0x7f92ac10cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92ab7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac1027e0 0x7f92ac10cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40010/0 (socket says 172.21.15.134:40010) 2024-02-16T22:29:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92ab7fe700 1 -- 172.21.15.134:0/273919610 learned_addr learned my addr 172.21.15.134:0/273919610 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:29:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92abfff700 1 --2- 172.21.15.134:0/273919610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92ac101e40 0x7f92ac10c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92ab7fe700 1 -- 172.21.15.134:0/273919610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92ac101e40 msgr2=0x7f92ac10c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92ab7fe700 1 --2- 172.21.15.134:0/273919610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92ac101e40 0x7f92ac10c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92ab7fe700 1 -- 172.21.15.134:0/273919610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a0005040 con 0x7f92ac1027e0 2024-02-16T22:29:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92ab7fe700 1 --2- 172.21.15.134:0/273919610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac1027e0 0x7f92ac10cc40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009150 tx=0x7f92a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:29:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92a8ff9700 1 -- 172.21.15.134:0/273919610 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92a000e040 con 0x7f92ac1027e0 2024-02-16T22:29:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92a8ff9700 1 -- 172.21.15.134:0/273919610 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92a000bbf0 con 0x7f92ac1027e0 2024-02-16T22:29:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92b2820700 1 -- 172.21.15.134:0/273919610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ac10d570 con 0x7f92ac1027e0 2024-02-16T22:29:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.500+0000 7f92a8ff9700 1 -- 172.21.15.134:0/273919610 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92a001c3f0 con 0x7f92ac1027e0 2024-02-16T22:29:35.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.501+0000 7f92b2820700 1 -- 172.21.15.134:0/273919610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ac11a120 con 0x7f92ac1027e0 2024-02-16T22:29:35.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.501+0000 7f92b2820700 1 -- 172.21.15.134:0/273919610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ac104310 con 0x7f92ac1027e0 2024-02-16T22:29:35.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.502+0000 7f92a8ff9700 1 -- 172.21.15.134:0/273919610 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f92a000bd60 con 0x7f92ac1027e0 2024-02-16T22:29:35.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.502+0000 7f92a8ff9700 1 --2- 172.21.15.134:0/273919610 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f929406d7e0 0x7f929406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:29:35.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.502+0000 7f92a8ff9700 1 -- 172.21.15.134:0/273919610 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f92a008e150 con 0x7f92ac1027e0 2024-02-16T22:29:35.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.503+0000 7f92abfff700 1 --2- 172.21.15.134:0/273919610 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f929406d7e0 0x7f929406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:29:35.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.503+0000 7f92abfff700 1 --2- 172.21.15.134:0/273919610 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f929406d7e0 0x7f929406fc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f929c004f40 tx=0x7f929c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:29:35.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.507+0000 7f92a8ff9700 1 -- 172.21.15.134:0/273919610 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f92a005b4f0 con 0x7f92ac1027e0 2024-02-16T22:29:35.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.784+0000 7f92b2820700 1 -- 172.21.15.134:0/273919610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f92ac0fb5d0 con 0x7f92ac1027e0 2024-02-16T22:29:35.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.784+0000 7f92a8ff9700 1 -- 172.21.15.134:0/273919610 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f92a005b080 con 0x7f92ac1027e0 2024-02-16T22:29:35.786 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:29:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:29:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:29:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:29:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:29:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:29:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:29:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:29:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-16T22:29:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:29:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:29:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-16T22:29:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:29:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:29:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 14 2024-02-16T22:29:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:29:35.788 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:29:35.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.786+0000 7f92b2820700 1 -- 172.21.15.134:0/273919610 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f929406d7e0 msgr2=0x7f929406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:35.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.786+0000 7f92b2820700 1 --2- 172.21.15.134:0/273919610 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f929406d7e0 0x7f929406fc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f929c004f40 tx=0x7f929c00b040 comp rx=0 tx=0).stop 2024-02-16T22:29:35.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.786+0000 7f92b2820700 1 -- 172.21.15.134:0/273919610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac1027e0 msgr2=0x7f92ac10cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:29:35.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.786+0000 7f92b2820700 1 --2- 172.21.15.134:0/273919610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac1027e0 0x7f92ac10cc40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009150 tx=0x7f92a0009e30 comp rx=0 tx=0).stop 2024-02-16T22:29:35.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.786+0000 7f92b2820700 1 -- 172.21.15.134:0/273919610 shutdown_connections 2024-02-16T22:29:35.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.786+0000 7f92b2820700 1 --2- 172.21.15.134:0/273919610 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f929406d7e0 0x7f929406fc90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:35.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.786+0000 7f92b2820700 1 --2- 172.21.15.134:0/273919610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92ac101e40 0x7f92ac10c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:35.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.786+0000 7f92b2820700 1 --2- 172.21.15.134:0/273919610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac1027e0 0x7f92ac10cc40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:29:35.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.786+0000 7f92b2820700 1 -- 172.21.15.134:0/273919610 >> 172.21.15.134:0/273919610 conn(0x7f92ac0f7990 msgr2=0x7f92ac0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:29:35.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.787+0000 7f92b2820700 1 -- 172.21.15.134:0/273919610 shutdown_connections 2024-02-16T22:29:35.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:29:35.787+0000 7f92b2820700 1 -- 172.21.15.134:0/273919610 wait complete. 2024-02-16T22:29:36.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:36 smithi134 ceph-mon[112514]: pgmap v218: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 8.9 KiB/s wr, 9 op/s 2024-02-16T22:29:36.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:36 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/273919610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:36.462 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-16T22:29:36.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:36 smithi173 ceph-mon[83703]: pgmap v218: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 8.9 KiB/s wr, 9 op/s 2024-02-16T22:29:36.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:36 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/273919610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:29:36.723 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:29:37.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:29:37.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:37 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:29:38.358 INFO:teuthology.orchestra.run.smithi134.stdout:wait for servicemap items w/ changing names to refresh 2024-02-16T22:29:38.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:38 smithi134 ceph-mon[112514]: pgmap v219: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 8.7 KiB/s wr, 4 op/s 2024-02-16T22:29:38.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:38 smithi173 ceph-mon[83703]: pgmap v219: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 8.7 KiB/s wr, 4 op/s 2024-02-16T22:29:39.039 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'sleep 60' 2024-02-16T22:29:39.299 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:29:39.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:39 smithi134 ceph-mon[112514]: pgmap v220: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:39.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:39 smithi173 ceph-mon[83703]: pgmap v220: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:42.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:42 smithi134 ceph-mon[112514]: pgmap v221: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:42.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:42 smithi173 ceph-mon[83703]: pgmap v221: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:44.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:44 smithi134 ceph-mon[112514]: pgmap v222: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:44.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:44 smithi173 ceph-mon[83703]: pgmap v222: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:46.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:46 smithi134 ceph-mon[112514]: pgmap v223: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:46.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:46 smithi173 ceph-mon[83703]: pgmap v223: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:48.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:48 smithi134 ceph-mon[112514]: pgmap v224: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:48.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:48 smithi173 ceph-mon[83703]: pgmap v224: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:50.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:50 smithi134 ceph-mon[112514]: pgmap v225: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:50.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:50 smithi173 ceph-mon[83703]: pgmap v225: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:52.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:52 smithi134 ceph-mon[112514]: pgmap v226: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:52.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:52 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:29:52.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:52 smithi173 ceph-mon[83703]: pgmap v226: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:52.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:52 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:29:54.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:54 smithi134 ceph-mon[112514]: pgmap v227: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:54.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:54 smithi173 ceph-mon[83703]: pgmap v227: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:56.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:56 smithi134 ceph-mon[112514]: pgmap v228: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:56.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:56 smithi173 ceph-mon[83703]: pgmap v228: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:58.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:29:58 smithi134 ceph-mon[112514]: pgmap v229: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:29:58.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:29:58 smithi173 ceph-mon[83703]: pgmap v229: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:00.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:00 smithi134 ceph-mon[112514]: pgmap v230: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:00.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:00 smithi134 ceph-mon[112514]: overall HEALTH_OK 2024-02-16T22:30:00.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:00 smithi173 ceph-mon[83703]: pgmap v230: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:00.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:00 smithi173 ceph-mon[83703]: overall HEALTH_OK 2024-02-16T22:30:02.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:02 smithi134 ceph-mon[112514]: pgmap v231: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:02.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:02 smithi173 ceph-mon[83703]: pgmap v231: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:03.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:03 smithi134 ceph-mon[112514]: pgmap v232: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:03.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:03 smithi173 ceph-mon[83703]: pgmap v232: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:06.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:06 smithi134 ceph-mon[112514]: pgmap v233: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:06.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:06 smithi173 ceph-mon[83703]: pgmap v233: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:07.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:07 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:30:07.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:07 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:30:08.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:08 smithi134 ceph-mon[112514]: pgmap v234: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:08.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:08 smithi173 ceph-mon[83703]: pgmap v234: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:10.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:10 smithi134 ceph-mon[112514]: pgmap v235: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:10.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:10 smithi173 ceph-mon[83703]: pgmap v235: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:11.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:11 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:30:11.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:11 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-16T22:30:12.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:12 smithi134 ceph-mon[112514]: pgmap v236: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:12 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:30:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:12 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:30:12.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:12 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:30:12.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:12 smithi173 ceph-mon[83703]: pgmap v236: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:12.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:12 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-16T22:30:12.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:12 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-16T22:30:12.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:12 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' 2024-02-16T22:30:14.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:14 smithi134 ceph-mon[112514]: pgmap v237: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:14.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:14 smithi173 ceph-mon[83703]: pgmap v237: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:16.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:16 smithi134 ceph-mon[112514]: pgmap v238: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:16.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:16 smithi173 ceph-mon[83703]: pgmap v238: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:17.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:17 smithi134 ceph-mon[112514]: pgmap v239: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:17.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:17 smithi173 ceph-mon[83703]: pgmap v239: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:20.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:20 smithi134 ceph-mon[112514]: pgmap v240: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:20.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:20 smithi173 ceph-mon[83703]: pgmap v240: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:22.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:22 smithi134 ceph-mon[112514]: pgmap v241: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:22.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:22 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:30:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:22 smithi173 ceph-mon[83703]: pgmap v241: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:22.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:22 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:30:24.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:24 smithi134 ceph-mon[112514]: pgmap v242: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:24.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:24 smithi173 ceph-mon[83703]: pgmap v242: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:26.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:26 smithi134 ceph-mon[112514]: pgmap v243: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:26.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:26 smithi173 ceph-mon[83703]: pgmap v243: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:28.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:28 smithi134 ceph-mon[112514]: pgmap v244: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:28.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:28 smithi173 ceph-mon[83703]: pgmap v244: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:30.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:30 smithi134 ceph-mon[112514]: pgmap v245: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:30.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:30 smithi173 ceph-mon[83703]: pgmap v245: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:32.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:32 smithi134 ceph-mon[112514]: pgmap v246: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:32.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:32 smithi173 ceph-mon[83703]: pgmap v246: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:34.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:34 smithi134 ceph-mon[112514]: pgmap v247: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:34.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:34 smithi173 ceph-mon[83703]: pgmap v247: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:36.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:36 smithi134 ceph-mon[112514]: pgmap v248: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:36.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:36 smithi173 ceph-mon[83703]: pgmap v248: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:37.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:37 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:30:37.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:37 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:30:38.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:38 smithi134 ceph-mon[112514]: pgmap v249: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:38.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:38 smithi173 ceph-mon[83703]: pgmap v249: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:39.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:39 smithi134 ceph-mon[112514]: pgmap v250: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:39.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:39 smithi173 ceph-mon[83703]: pgmap v250: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:41.528 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-16T22:30:41.793 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:30:42.169 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:42 smithi134 ceph-mon[112514]: pgmap v251: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:42.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:42 smithi173 ceph-mon[83703]: pgmap v251: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:43.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.412+0000 7f74f761b700 1 -- 172.21.15.134:0/3732104805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0103140 msgr2=0x7f74f0103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:43.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.412+0000 7f74f761b700 1 --2- 172.21.15.134:0/3732104805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0103140 0x7f74f0103510 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009ce0 tx=0x7f74ec004d10 comp rx=0 tx=0).stop 2024-02-16T22:30:43.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.412+0000 7f74f761b700 1 -- 172.21.15.134:0/3732104805 shutdown_connections 2024-02-16T22:30:43.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.412+0000 7f74f761b700 1 --2- 172.21.15.134:0/3732104805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74f00fb570 0x7f74f00fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:43.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.412+0000 7f74f761b700 1 --2- 172.21.15.134:0/3732104805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0103140 0x7f74f0103510 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:43.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.412+0000 7f74f761b700 1 -- 172.21.15.134:0/3732104805 >> 172.21.15.134:0/3732104805 conn(0x7f74f0071560 msgr2=0x7f74f0071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:43.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.412+0000 7f74f761b700 1 -- 172.21.15.134:0/3732104805 shutdown_connections 2024-02-16T22:30:43.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.412+0000 7f74f761b700 1 -- 172.21.15.134:0/3732104805 wait complete. 2024-02-16T22:30:43.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.413+0000 7f74f761b700 1 Processor -- start 2024-02-16T22:30:43.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.413+0000 7f74f761b700 1 -- start start 2024-02-16T22:30:43.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.413+0000 7f74f761b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74f00fb570 0x7f74f0113cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:43.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.413+0000 7f74f761b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0103140 0x7f74f01141f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:43.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.413+0000 7f74f761b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f0114840 con 0x7f74f0103140 2024-02-16T22:30:43.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.413+0000 7f74f761b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f010db50 con 0x7f74f00fb570 2024-02-16T22:30:43.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.413+0000 7f74f4bb6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0103140 0x7f74f01141f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:43.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.413+0000 7f74f4bb6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0103140 0x7f74f01141f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56988/0 (socket says 172.21.15.134:56988) 2024-02-16T22:30:43.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.413+0000 7f74f53b7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74f00fb570 0x7f74f0113cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:43.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.413+0000 7f74f4bb6700 1 -- 172.21.15.134:0/2869034096 learned_addr learned my addr 172.21.15.134:0/2869034096 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:43.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.413+0000 7f74f4bb6700 1 -- 172.21.15.134:0/2869034096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74f00fb570 msgr2=0x7f74f0113cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:43.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.413+0000 7f74f4bb6700 1 --2- 172.21.15.134:0/2869034096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74f00fb570 0x7f74f0113cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:43.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.413+0000 7f74f4bb6700 1 -- 172.21.15.134:0/2869034096 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec009940 con 0x7f74f0103140 2024-02-16T22:30:43.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.414+0000 7f74f4bb6700 1 --2- 172.21.15.134:0/2869034096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0103140 0x7f74f01141f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f74e000c830 tx=0x7f74e0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:43.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.414+0000 7f74e5ffb700 1 -- 172.21.15.134:0/2869034096 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e00106f0 con 0x7f74f0103140 2024-02-16T22:30:43.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.414+0000 7f74e5ffb700 1 -- 172.21.15.134:0/2869034096 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74e0010d20 con 0x7f74f0103140 2024-02-16T22:30:43.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.414+0000 7f74f761b700 1 -- 172.21.15.134:0/2869034096 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f010de30 con 0x7f74f0103140 2024-02-16T22:30:43.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.414+0000 7f74e5ffb700 1 -- 172.21.15.134:0/2869034096 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e00113a0 con 0x7f74f0103140 2024-02-16T22:30:43.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.414+0000 7f74f761b700 1 -- 172.21.15.134:0/2869034096 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f010e370 con 0x7f74f0103140 2024-02-16T22:30:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.415+0000 7f74f761b700 1 -- 172.21.15.134:0/2869034096 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f0100310 con 0x7f74f0103140 2024-02-16T22:30:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.415+0000 7f74e5ffb700 1 -- 172.21.15.134:0/2869034096 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f74e0012400 con 0x7f74f0103140 2024-02-16T22:30:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.416+0000 7f74e5ffb700 1 --2- 172.21.15.134:0/2869034096 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f74dc06d7e0 0x7f74dc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.416+0000 7f74e5ffb700 1 -- 172.21.15.134:0/2869034096 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f74e008ce00 con 0x7f74f0103140 2024-02-16T22:30:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.416+0000 7f74f53b7700 1 --2- 172.21.15.134:0/2869034096 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f74dc06d7e0 0x7f74dc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:43.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.416+0000 7f74f53b7700 1 --2- 172.21.15.134:0/2869034096 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f74dc06d7e0 0x7f74dc06fc90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f74ec015040 tx=0x7f74ec004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:43.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.420+0000 7f74e5ffb700 1 -- 172.21.15.134:0/2869034096 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f74e005a240 con 0x7f74f0103140 2024-02-16T22:30:43.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.628+0000 7f74f761b700 1 -- 172.21.15.134:0/2869034096 --> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f74f004bf40 con 0x7f74dc06d7e0 2024-02-16T22:30:43.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.639+0000 7f74e5ffb700 1 -- 172.21.15.134:0/2869034096 <== mgr.34104 v2:172.21.15.134:6800/2709326132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f74f004bf40 con 0x7f74dc06d7e0 2024-02-16T22:30:43.641 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (8m) 2m ago 19m 25.7M - 0.25.0 c8568f914cd2 a10f293e7ee6 2024-02-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (6m) 2m ago 19m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 429739bfee94 2024-02-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi173 smithi173 running (6m) 99s ago 18m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 1e81cd2fd510 2024-02-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (8m) 2m ago 19m 91.3M - 9.4.12 a0ea5e3c46d9 29d29cf667e7 2024-02-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.cygfxr smithi134 running (2m) 2m ago 14m 11.7M - 19.0.0-1450-gf78a58c0 f081f847070a 9b266de8e573 2024-02-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.jyajef smithi134 running (2m) 2m ago 14m 10.3M - 19.0.0-1450-gf78a58c0 f081f847070a ef64a4bb0cda 2024-02-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.phstvm smithi173 running (101s) 99s ago 13m 12.6M - 19.0.0-1450-gf78a58c0 f081f847070a f5ae1f55f50e 2024-02-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi173.qljqef smithi173 running (119s) 99s ago 14m 13.9M - 19.0.0-1450-gf78a58c0 f081f847070a cd3e56af44dd 2024-02-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.ordace smithi134 *:8443,9283,8765 running (9m) 2m ago 21m 506M - 19.0.0-1450-gf78a58c0 f081f847070a aa4154b8e585 2024-02-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi173.kbofaa smithi173 *:8443,9283,8765 running (9m) 99s ago 18m 451M - 19.0.0-1450-gf78a58c0 f081f847070a 35448a4cd4a1 2024-02-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (7m) 2m ago 21m 52.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2903b3988442 2024-02-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi173 smithi173 running (6m) 99s ago 18m 45.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a dd7cf2f31226 2024-02-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (9m) 2m ago 19m 16.2M - 1.5.0 0da6a335fe13 b95114bd6ccc 2024-02-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi173 smithi173 *:9100 running (9m) 99s ago 18m 14.7M - 1.5.0 0da6a335fe13 0ac1bbb906a0 2024-02-16T22:30:43.643 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (5m) 2m ago 17m 95.5M 1557M 19.0.0-1450-gf78a58c0 f081f847070a d0153b47ae7e 2024-02-16T22:30:43.643 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (5m) 2m ago 17m 95.2M 1557M 19.0.0-1450-gf78a58c0 f081f847070a dd1faac850b0 2024-02-16T22:30:43.643 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (4m) 2m ago 16m 90.4M 1557M 19.0.0-1450-gf78a58c0 f081f847070a 0e349c665c73 2024-02-16T22:30:43.643 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi173 running (3m) 99s ago 16m 100M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 1f4624a5418b 2024-02-16T22:30:43.643 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi173 running (3m) 99s ago 15m 101M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 640d021c13b0 2024-02-16T22:30:43.643 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi173 running (2m) 99s ago 15m 86.9M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 8ee59c4c4319 2024-02-16T22:30:43.643 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (8m) 2m ago 19m 61.6M - 2.43.0 a07b618ecd1d 1f84d27a4594 2024-02-16T22:30:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.641+0000 7f74f761b700 1 -- 172.21.15.134:0/2869034096 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f74dc06d7e0 msgr2=0x7f74dc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.641+0000 7f74f761b700 1 --2- 172.21.15.134:0/2869034096 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f74dc06d7e0 0x7f74dc06fc90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f74ec015040 tx=0x7f74ec004d10 comp rx=0 tx=0).stop 2024-02-16T22:30:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.641+0000 7f74f761b700 1 -- 172.21.15.134:0/2869034096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0103140 msgr2=0x7f74f01141f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.641+0000 7f74f761b700 1 --2- 172.21.15.134:0/2869034096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0103140 0x7f74f01141f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f74e000c830 tx=0x7f74e0004470 comp rx=0 tx=0).stop 2024-02-16T22:30:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.641+0000 7f74f761b700 1 -- 172.21.15.134:0/2869034096 shutdown_connections 2024-02-16T22:30:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.641+0000 7f74f761b700 1 --2- 172.21.15.134:0/2869034096 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f74dc06d7e0 0x7f74dc06fc90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:43.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.641+0000 7f74f761b700 1 --2- 172.21.15.134:0/2869034096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74f00fb570 0x7f74f0113cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:43.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.641+0000 7f74f761b700 1 --2- 172.21.15.134:0/2869034096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0103140 0x7f74f01141f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:43.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.641+0000 7f74f761b700 1 -- 172.21.15.134:0/2869034096 >> 172.21.15.134:0/2869034096 conn(0x7f74f0071560 msgr2=0x7f74f00fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:43.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.641+0000 7f74f761b700 1 -- 172.21.15.134:0/2869034096 shutdown_connections 2024-02-16T22:30:43.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:43.641+0000 7f74f761b700 1 -- 172.21.15.134:0/2869034096 wait complete. 2024-02-16T22:30:44.362 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions' 2024-02-16T22:30:44.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:44 smithi134 ceph-mon[112514]: pgmap v252: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:44.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:44 smithi173 ceph-mon[83703]: pgmap v252: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:44.632 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:30:45.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:45 smithi134 ceph-mon[112514]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:30:45.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:45 smithi173 ceph-mon[83703]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-16T22:30:46.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.379+0000 7f9fd29e0700 1 -- 172.21.15.134:0/361456737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0fe900 msgr2=0x7f9fcc106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.379+0000 7f9fd29e0700 1 --2- 172.21.15.134:0/361456737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0fe900 0x7f9fcc106f40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0004940 tx=0x7f9fc0009e30 comp rx=0 tx=0).stop 2024-02-16T22:30:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.379+0000 7f9fd29e0700 1 -- 172.21.15.134:0/361456737 shutdown_connections 2024-02-16T22:30:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.379+0000 7f9fd29e0700 1 --2- 172.21.15.134:0/361456737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0fe900 0x7f9fcc106f40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.379+0000 7f9fd29e0700 1 --2- 172.21.15.134:0/361456737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fcc0fdf60 0x7f9fcc0fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.379+0000 7f9fd29e0700 1 -- 172.21.15.134:0/361456737 >> 172.21.15.134:0/361456737 conn(0x7f9fcc0f7a10 msgr2=0x7f9fcc0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.379+0000 7f9fd29e0700 1 -- 172.21.15.134:0/361456737 shutdown_connections 2024-02-16T22:30:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.379+0000 7f9fd29e0700 1 -- 172.21.15.134:0/361456737 wait complete. 2024-02-16T22:30:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.379+0000 7f9fd29e0700 1 Processor -- start 2024-02-16T22:30:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.379+0000 7f9fd29e0700 1 -- start start 2024-02-16T22:30:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fd29e0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0fdf60 0x7f9fcc113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:46.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fd29e0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fcc0fe900 0x7f9fcc114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fd29e0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc1146c0 con 0x7f9fcc0fdf60 2024-02-16T22:30:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fd29e0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc10d9f0 con 0x7f9fcc0fe900 2024-02-16T22:30:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fcbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0fdf60 0x7f9fcc113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fcbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0fdf60 0x7f9fcc113b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57004/0 (socket says 172.21.15.134:57004) 2024-02-16T22:30:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fcbfff700 1 -- 172.21.15.134:0/853799130 learned_addr learned my addr 172.21.15.134:0/853799130 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fcb7fe700 1 --2- 172.21.15.134:0/853799130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fcc0fe900 0x7f9fcc114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fcbfff700 1 -- 172.21.15.134:0/853799130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fcc0fe900 msgr2=0x7f9fcc114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fcbfff700 1 --2- 172.21.15.134:0/853799130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fcc0fe900 0x7f9fcc114070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fcbfff700 1 -- 172.21.15.134:0/853799130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc0005040 con 0x7f9fcc0fdf60 2024-02-16T22:30:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fcbfff700 1 --2- 172.21.15.134:0/853799130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0fdf60 0x7f9fcc113b30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc002a50 tx=0x7f9fbc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fc8ff9700 1 -- 172.21.15.134:0/853799130 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fbc007cc0 con 0x7f9fcc0fdf60 2024-02-16T22:30:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fc8ff9700 1 -- 172.21.15.134:0/853799130 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fbc00f040 con 0x7f9fcc0fdf60 2024-02-16T22:30:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fd29e0700 1 -- 172.21.15.134:0/853799130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc10dcd0 con 0x7f9fcc0fdf60 2024-02-16T22:30:46.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fc8ff9700 1 -- 172.21.15.134:0/853799130 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fbc00da30 con 0x7f9fcc0fdf60 2024-02-16T22:30:46.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.380+0000 7f9fd29e0700 1 -- 172.21.15.134:0/853799130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc10e1e0 con 0x7f9fcc0fdf60 2024-02-16T22:30:46.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.381+0000 7f9fd29e0700 1 -- 172.21.15.134:0/853799130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fcc104550 con 0x7f9fcc0fdf60 2024-02-16T22:30:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.382+0000 7f9fc8ff9700 1 -- 172.21.15.134:0/853799130 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f9fbc00db90 con 0x7f9fcc0fdf60 2024-02-16T22:30:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.382+0000 7f9fc8ff9700 1 --2- 172.21.15.134:0/853799130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9fb406d7e0 0x7f9fb406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.382+0000 7f9fc8ff9700 1 -- 172.21.15.134:0/853799130 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9fbc08ccd0 con 0x7f9fcc0fdf60 2024-02-16T22:30:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.382+0000 7f9fcb7fe700 1 --2- 172.21.15.134:0/853799130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9fb406d7e0 0x7f9fb406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.383+0000 7f9fcb7fe700 1 --2- 172.21.15.134:0/853799130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9fb406d7e0 0x7f9fb406fc90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc10ed20 tx=0x7f9fc0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:46.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.387+0000 7f9fc8ff9700 1 -- 172.21.15.134:0/853799130 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9fbc059ff0 con 0x7f9fcc0fdf60 2024-02-16T22:30:46.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:46 smithi134 ceph-mon[112514]: pgmap v253: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:46.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:46 smithi173 ceph-mon[83703]: pgmap v253: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:46.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.662+0000 7f9fd29e0700 1 -- 172.21.15.134:0/853799130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9fcc04bed0 con 0x7f9fcc0fdf60 2024-02-16T22:30:46.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.663+0000 7f9fc8ff9700 1 -- 172.21.15.134:0/853799130 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f9fbc059b80 con 0x7f9fcc0fdf60 2024-02-16T22:30:46.665 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-16T22:30:46.665 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-02-16T22:30:46.665 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:30:46.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:30:46.665 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-02-16T22:30:46.665 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-16T22:30:46.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:30:46.665 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-02-16T22:30:46.665 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-16T22:30:46.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:30:46.665 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-02-16T22:30:46.666 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-16T22:30:46.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-16T22:30:46.666 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-02-16T22:30:46.666 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 14 2024-02-16T22:30:46.666 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-16T22:30:46.666 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-16T22:30:46.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.665+0000 7f9fd29e0700 1 -- 172.21.15.134:0/853799130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9fb406d7e0 msgr2=0x7f9fb406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:46.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.665+0000 7f9fd29e0700 1 --2- 172.21.15.134:0/853799130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9fb406d7e0 0x7f9fb406fc90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc10ed20 tx=0x7f9fc0009e30 comp rx=0 tx=0).stop 2024-02-16T22:30:46.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.665+0000 7f9fd29e0700 1 -- 172.21.15.134:0/853799130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0fdf60 msgr2=0x7f9fcc113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:46.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.665+0000 7f9fd29e0700 1 --2- 172.21.15.134:0/853799130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0fdf60 0x7f9fcc113b30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc002a50 tx=0x7f9fbc0046b0 comp rx=0 tx=0).stop 2024-02-16T22:30:46.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.665+0000 7f9fd29e0700 1 -- 172.21.15.134:0/853799130 shutdown_connections 2024-02-16T22:30:46.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.665+0000 7f9fd29e0700 1 --2- 172.21.15.134:0/853799130 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f9fb406d7e0 0x7f9fb406fc90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:46.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.665+0000 7f9fd29e0700 1 --2- 172.21.15.134:0/853799130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0fdf60 0x7f9fcc113b30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:46.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.665+0000 7f9fd29e0700 1 --2- 172.21.15.134:0/853799130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fcc0fe900 0x7f9fcc114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:46.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.665+0000 7f9fd29e0700 1 -- 172.21.15.134:0/853799130 >> 172.21.15.134:0/853799130 conn(0x7f9fcc0f7a10 msgr2=0x7f9fcc1016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:46.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.665+0000 7f9fd29e0700 1 -- 172.21.15.134:0/853799130 shutdown_connections 2024-02-16T22:30:46.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:46.665+0000 7f9fd29e0700 1 -- 172.21.15.134:0/853799130 wait complete. 2024-02-16T22:30:47.343 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-16T22:30:47.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:47 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/853799130' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:30:47.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:47 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/853799130' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:30:47.640 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:30:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:48 smithi134 ceph-mon[112514]: pgmap v254: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:48.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:48 smithi173 ceph-mon[83703]: pgmap v254: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:49.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.235+0000 7fdfb1429700 1 -- 172.21.15.134:0/783699212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfac0fdfc0 msgr2=0x7fdfac0fe390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:49.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.235+0000 7fdfb1429700 1 --2- 172.21.15.134:0/783699212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfac0fdfc0 0x7fdfac0fe390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0004940 tx=0x7fdfa0009e30 comp rx=0 tx=0).stop 2024-02-16T22:30:49.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.235+0000 7fdfb1429700 1 -- 172.21.15.134:0/783699212 shutdown_connections 2024-02-16T22:30:49.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.235+0000 7fdfb1429700 1 --2- 172.21.15.134:0/783699212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfac0fe960 0x7fdfac106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:49.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.235+0000 7fdfb1429700 1 --2- 172.21.15.134:0/783699212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfac0fdfc0 0x7fdfac0fe390 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:49.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.235+0000 7fdfb1429700 1 -- 172.21.15.134:0/783699212 >> 172.21.15.134:0/783699212 conn(0x7fdfac0f7a10 msgr2=0x7fdfac0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:49.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.235+0000 7fdfb1429700 1 -- 172.21.15.134:0/783699212 shutdown_connections 2024-02-16T22:30:49.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.235+0000 7fdfb1429700 1 -- 172.21.15.134:0/783699212 wait complete. 2024-02-16T22:30:49.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.236+0000 7fdfb1429700 1 Processor -- start 2024-02-16T22:30:49.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.236+0000 7fdfb1429700 1 -- start start 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.236+0000 7fdfb1429700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfac0fdfc0 0x7fdfac0fbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.236+0000 7fdfb1429700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfac0fe960 0x7fdfac0fc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.236+0000 7fdfb1429700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0fc930 con 0x7fdfac0fdfc0 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.236+0000 7fdfb1429700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0fcaa0 con 0x7fdfac0fe960 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.236+0000 7fdfaaffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfac0fdfc0 0x7fdfac0fbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.236+0000 7fdfaaffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfac0fdfc0 0x7fdfac0fbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57024/0 (socket says 172.21.15.134:57024) 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.236+0000 7fdfaaffd700 1 -- 172.21.15.134:0/2262635410 learned_addr learned my addr 172.21.15.134:0/2262635410 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.236+0000 7fdfaa7fc700 1 --2- 172.21.15.134:0/2262635410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfac0fe960 0x7fdfac0fc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.237+0000 7fdfaaffd700 1 -- 172.21.15.134:0/2262635410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfac0fe960 msgr2=0x7fdfac0fc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.237+0000 7fdfaaffd700 1 --2- 172.21.15.134:0/2262635410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfac0fe960 0x7fdfac0fc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.237+0000 7fdfaaffd700 1 -- 172.21.15.134:0/2262635410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa0005040 con 0x7fdfac0fdfc0 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.237+0000 7fdfaaffd700 1 --2- 172.21.15.134:0/2262635410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfac0fdfc0 0x7fdfac0fbdf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009180 tx=0x7fdfa0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.237+0000 7fdf937fe700 1 -- 172.21.15.134:0/2262635410 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfa000e040 con 0x7fdfac0fdfc0 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.237+0000 7fdfb1429700 1 -- 172.21.15.134:0/2262635410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfac119c50 con 0x7fdfac0fdfc0 2024-02-16T22:30:49.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.237+0000 7fdf937fe700 1 -- 172.21.15.134:0/2262635410 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdfa0004290 con 0x7fdfac0fdfc0 2024-02-16T22:30:49.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.237+0000 7fdf937fe700 1 -- 172.21.15.134:0/2262635410 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfa001c630 con 0x7fdfac0fdfc0 2024-02-16T22:30:49.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.237+0000 7fdfb1429700 1 -- 172.21.15.134:0/2262635410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfac11a130 con 0x7fdfac0fdfc0 2024-02-16T22:30:49.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.238+0000 7fdfb1429700 1 -- 172.21.15.134:0/2262635410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfac1045b0 con 0x7fdfac0fdfc0 2024-02-16T22:30:49.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.238+0000 7fdf937fe700 1 -- 172.21.15.134:0/2262635410 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fdfa000bbf0 con 0x7fdfac0fdfc0 2024-02-16T22:30:49.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.239+0000 7fdf937fe700 1 --2- 172.21.15.134:0/2262635410 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdf9406d7f0 0x7fdf9406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:49.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.239+0000 7fdfaa7fc700 1 --2- 172.21.15.134:0/2262635410 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdf9406d7f0 0x7fdf9406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:49.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.239+0000 7fdf937fe700 1 -- 172.21.15.134:0/2262635410 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fdfa008e1d0 con 0x7fdfac0fdfc0 2024-02-16T22:30:49.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.239+0000 7fdfaa7fc700 1 --2- 172.21.15.134:0/2262635410 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdf9406d7f0 0x7fdf9406fca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0fd7f0 tx=0x7fdf9c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.244+0000 7fdf937fe700 1 -- 172.21.15.134:0/2262635410 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdfa0057a40 con 0x7fdfac0fdfc0 2024-02-16T22:30:49.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.522+0000 7fdfb1429700 1 -- 172.21.15.134:0/2262635410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdfac04bed0 con 0x7fdfac0fdfc0 2024-02-16T22:30:49.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.522+0000 7fdf937fe700 1 -- 172.21.15.134:0/2262635410 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fdfa0004db0 con 0x7fdfac0fdfc0 2024-02-16T22:30:49.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.525+0000 7fdfb1429700 1 -- 172.21.15.134:0/2262635410 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdf9406d7f0 msgr2=0x7fdf9406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:49.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.525+0000 7fdfb1429700 1 --2- 172.21.15.134:0/2262635410 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdf9406d7f0 0x7fdf9406fca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0fd7f0 tx=0x7fdf9c00b040 comp rx=0 tx=0).stop 2024-02-16T22:30:49.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.525+0000 7fdfb1429700 1 -- 172.21.15.134:0/2262635410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfac0fdfc0 msgr2=0x7fdfac0fbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:49.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.525+0000 7fdfb1429700 1 --2- 172.21.15.134:0/2262635410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfac0fdfc0 0x7fdfac0fbdf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009180 tx=0x7fdfa0009e30 comp rx=0 tx=0).stop 2024-02-16T22:30:49.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.525+0000 7fdfb1429700 1 -- 172.21.15.134:0/2262635410 shutdown_connections 2024-02-16T22:30:49.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.525+0000 7fdfb1429700 1 --2- 172.21.15.134:0/2262635410 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fdf9406d7f0 0x7fdf9406fca0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:49.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.525+0000 7fdfb1429700 1 --2- 172.21.15.134:0/2262635410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfac0fdfc0 0x7fdfac0fbdf0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:49.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.525+0000 7fdfb1429700 1 --2- 172.21.15.134:0/2262635410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfac0fe960 0x7fdfac0fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:49.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.525+0000 7fdfb1429700 1 -- 172.21.15.134:0/2262635410 >> 172.21.15.134:0/2262635410 conn(0x7fdfac0f7a10 msgr2=0x7fdfac101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:49.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.525+0000 7fdfb1429700 1 -- 172.21.15.134:0/2262635410 shutdown_connections 2024-02-16T22:30:49.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:49.525+0000 7fdfb1429700 1 -- 172.21.15.134:0/2262635410 wait complete. 2024-02-16T22:30:49.537 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-02-16T22:30:50.178 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-16T22:30:50.476 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:30:50.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:50 smithi134 ceph-mon[112514]: pgmap v255: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:50.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:50 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2262635410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:30:50.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:50 smithi173 ceph-mon[83703]: pgmap v255: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:50.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:50 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2262635410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:30:52.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.117+0000 7f92ab969700 1 -- 172.21.15.134:0/152170322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a4101e40 msgr2=0x7f92a4102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:52.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.117+0000 7f92ab969700 1 --2- 172.21.15.134:0/152170322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a4101e40 0x7f92a4102210 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f92a0004940 tx=0x7f92a0009e30 comp rx=0 tx=0).stop 2024-02-16T22:30:52.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.117+0000 7f92ab969700 1 -- 172.21.15.134:0/152170322 shutdown_connections 2024-02-16T22:30:52.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.117+0000 7f92ab969700 1 --2- 172.21.15.134:0/152170322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92a41027e0 0x7f92a40fbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:52.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.117+0000 7f92ab969700 1 --2- 172.21.15.134:0/152170322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a4101e40 0x7f92a4102210 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:52.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.117+0000 7f92ab969700 1 -- 172.21.15.134:0/152170322 >> 172.21.15.134:0/152170322 conn(0x7f92a40f79d0 msgr2=0x7f92a40f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:52.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.117+0000 7f92ab969700 1 -- 172.21.15.134:0/152170322 shutdown_connections 2024-02-16T22:30:52.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.117+0000 7f92ab969700 1 -- 172.21.15.134:0/152170322 wait complete. 2024-02-16T22:30:52.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.118+0000 7f92ab969700 1 Processor -- start 2024-02-16T22:30:52.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.118+0000 7f92ab969700 1 -- start start 2024-02-16T22:30:52.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.118+0000 7f92ab969700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a4101e40 0x7f92a4113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:52.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.118+0000 7f92ab969700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92a41027e0 0x7f92a4113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.118+0000 7f92ab969700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a4114620 con 0x7f92a4101e40 2024-02-16T22:30:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.118+0000 7f92ab969700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a410d950 con 0x7f92a41027e0 2024-02-16T22:30:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.118+0000 7f92a9705700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a4101e40 0x7f92a4113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.118+0000 7f92a9705700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a4101e40 0x7f92a4113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38656/0 (socket says 172.21.15.134:38656) 2024-02-16T22:30:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.118+0000 7f92a9705700 1 -- 172.21.15.134:0/1991315660 learned_addr learned my addr 172.21.15.134:0/1991315660 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.118+0000 7f92a8f04700 1 --2- 172.21.15.134:0/1991315660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92a41027e0 0x7f92a4113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.118+0000 7f92a9705700 1 -- 172.21.15.134:0/1991315660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92a41027e0 msgr2=0x7f92a4113fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.118+0000 7f92a9705700 1 --2- 172.21.15.134:0/1991315660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92a41027e0 0x7f92a4113fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.118+0000 7f92a9705700 1 -- 172.21.15.134:0/1991315660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a0005040 con 0x7f92a4101e40 2024-02-16T22:30:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.119+0000 7f92a9705700 1 --2- 172.21.15.134:0/1991315660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a4101e40 0x7f92a4113a90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f92a000b3b0 tx=0x7f92a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.119+0000 7f9299ffb700 1 -- 172.21.15.134:0/1991315660 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92a000e040 con 0x7f92a4101e40 2024-02-16T22:30:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.119+0000 7f92ab969700 1 -- 172.21.15.134:0/1991315660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a410dbd0 con 0x7f92a4101e40 2024-02-16T22:30:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.119+0000 7f9299ffb700 1 -- 172.21.15.134:0/1991315660 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92a000bbf0 con 0x7f92a4101e40 2024-02-16T22:30:52.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.119+0000 7f9299ffb700 1 -- 172.21.15.134:0/1991315660 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92a001c3f0 con 0x7f92a4101e40 2024-02-16T22:30:52.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.119+0000 7f92ab969700 1 -- 172.21.15.134:0/1991315660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a410e110 con 0x7f92a4101e40 2024-02-16T22:30:52.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.120+0000 7f92ab969700 1 -- 172.21.15.134:0/1991315660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a40fb5d0 con 0x7f92a4101e40 2024-02-16T22:30:52.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.121+0000 7f9299ffb700 1 -- 172.21.15.134:0/1991315660 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f92a000bd60 con 0x7f92a4101e40 2024-02-16T22:30:52.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.121+0000 7f9299ffb700 1 --2- 172.21.15.134:0/1991315660 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f929006d7e0 0x7f929006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:52.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.121+0000 7f92a8f04700 1 --2- 172.21.15.134:0/1991315660 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f929006d7e0 0x7f929006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:52.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.121+0000 7f9299ffb700 1 -- 172.21.15.134:0/1991315660 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f92a008e280 con 0x7f92a4101e40 2024-02-16T22:30:52.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.122+0000 7f92a8f04700 1 --2- 172.21.15.134:0/1991315660 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f929006d7e0 0x7f929006fc90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f92a410f2c0 tx=0x7f929400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:52.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.126+0000 7f9299ffb700 1 -- 172.21.15.134:0/1991315660 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f92a005b620 con 0x7f92a4101e40 2024-02-16T22:30:52.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.401+0000 7f92ab969700 1 -- 172.21.15.134:0/1991315660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f92a410f070 con 0x7f92a4101e40 2024-02-16T22:30:52.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:52 smithi134 ceph-mon[112514]: pgmap v256: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:52.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:52 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:30:52.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.401+0000 7f9299ffb700 1 -- 172.21.15.134:0/1991315660 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f92a005b1b0 con 0x7f92a4101e40 2024-02-16T22:30:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.403+0000 7f92ab969700 1 -- 172.21.15.134:0/1991315660 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f929006d7e0 msgr2=0x7f929006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.403+0000 7f92ab969700 1 --2- 172.21.15.134:0/1991315660 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f929006d7e0 0x7f929006fc90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f92a410f2c0 tx=0x7f929400b040 comp rx=0 tx=0).stop 2024-02-16T22:30:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.403+0000 7f92ab969700 1 -- 172.21.15.134:0/1991315660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a4101e40 msgr2=0x7f92a4113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.403+0000 7f92ab969700 1 --2- 172.21.15.134:0/1991315660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a4101e40 0x7f92a4113a90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f92a000b3b0 tx=0x7f92a0009e30 comp rx=0 tx=0).stop 2024-02-16T22:30:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.403+0000 7f92ab969700 1 -- 172.21.15.134:0/1991315660 shutdown_connections 2024-02-16T22:30:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.403+0000 7f92ab969700 1 --2- 172.21.15.134:0/1991315660 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f929006d7e0 0x7f929006fc90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.403+0000 7f92ab969700 1 --2- 172.21.15.134:0/1991315660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a4101e40 0x7f92a4113a90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.403+0000 7f92ab969700 1 --2- 172.21.15.134:0/1991315660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92a41027e0 0x7f92a4113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.403+0000 7f92ab969700 1 -- 172.21.15.134:0/1991315660 >> 172.21.15.134:0/1991315660 conn(0x7f92a40f79d0 msgr2=0x7f92a4065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.403+0000 7f92ab969700 1 -- 172.21.15.134:0/1991315660 shutdown_connections 2024-02-16T22:30:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:52.403+0000 7f92ab969700 1 -- 172.21.15.134:0/1991315660 wait complete. 2024-02-16T22:30:52.415 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)" 2024-02-16T22:30:52.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:52 smithi173 ceph-mon[83703]: pgmap v256: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:52.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:52 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:30:53.067 DEBUG:teuthology.parallel:result is None 2024-02-16T22:30:53.068 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-16T22:30:53.079 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T22:30:53.079 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f29a5372-cd17-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-16T22:30:53.339 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/mon.smithi134/config 2024-02-16T22:30:53.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:53 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1991315660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:30:53.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:53 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1991315660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-16T22:30:54.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:54 smithi134 ceph-mon[112514]: pgmap v257: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:54.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:54 smithi173 ceph-mon[83703]: pgmap v257: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:54.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.991+0000 7fba15b63700 1 -- 172.21.15.134:0/2974524446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba100fdfe0 msgr2=0x7fba100fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:54.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.991+0000 7fba15b63700 1 --2- 172.21.15.134:0/2974524446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba100fdfe0 0x7fba100fe3b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba00004970 tx=0x7fba00009e30 comp rx=0 tx=0).stop 2024-02-16T22:30:54.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.991+0000 7fba15b63700 1 -- 172.21.15.134:0/2974524446 shutdown_connections 2024-02-16T22:30:54.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.991+0000 7fba15b63700 1 --2- 172.21.15.134:0/2974524446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba100fe8f0 0x7fba10107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:54.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.991+0000 7fba15b63700 1 --2- 172.21.15.134:0/2974524446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba100fdfe0 0x7fba100fe3b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:54.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.991+0000 7fba15b63700 1 -- 172.21.15.134:0/2974524446 >> 172.21.15.134:0/2974524446 conn(0x7fba10071d90 msgr2=0x7fba10072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:54.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.991+0000 7fba15b63700 1 -- 172.21.15.134:0/2974524446 shutdown_connections 2024-02-16T22:30:54.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.991+0000 7fba15b63700 1 -- 172.21.15.134:0/2974524446 wait complete. 2024-02-16T22:30:54.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.992+0000 7fba15b63700 1 Processor -- start 2024-02-16T22:30:54.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.992+0000 7fba15b63700 1 -- start start 2024-02-16T22:30:54.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.992+0000 7fba15b63700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba100fdfe0 0x7fba100fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.992+0000 7fba15b63700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba100fe8f0 0x7fba100fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.992+0000 7fba15b63700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba100fc9e0 con 0x7fba100fe8f0 2024-02-16T22:30:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.992+0000 7fba15b63700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba100fcb50 con 0x7fba100fdfe0 2024-02-16T22:30:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.992+0000 7fba06ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba100fe8f0 0x7fba100fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.992+0000 7fba06ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba100fe8f0 0x7fba100fc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38684/0 (socket says 172.21.15.134:38684) 2024-02-16T22:30:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.992+0000 7fba06ffd700 1 -- 172.21.15.134:0/2742353201 learned_addr learned my addr 172.21.15.134:0/2742353201 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.992+0000 7fba0f7fe700 1 --2- 172.21.15.134:0/2742353201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba100fdfe0 0x7fba100fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.992+0000 7fba06ffd700 1 -- 172.21.15.134:0/2742353201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba100fdfe0 msgr2=0x7fba100fbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.992+0000 7fba06ffd700 1 --2- 172.21.15.134:0/2742353201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba100fdfe0 0x7fba100fbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.992+0000 7fba06ffd700 1 -- 172.21.15.134:0/2742353201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba00005040 con 0x7fba100fe8f0 2024-02-16T22:30:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.992+0000 7fba0f7fe700 1 --2- 172.21.15.134:0/2742353201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba100fdfe0 0x7fba100fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:30:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.993+0000 7fba06ffd700 1 --2- 172.21.15.134:0/2742353201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba100fe8f0 0x7fba100fc3e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800eb40 tx=0x7fb9f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.993+0000 7fba0cff9700 1 -- 172.21.15.134:0/2742353201 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9f8007cc0 con 0x7fba100fe8f0 2024-02-16T22:30:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.993+0000 7fba0cff9700 1 -- 172.21.15.134:0/2742353201 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9f800f040 con 0x7fba100fe8f0 2024-02-16T22:30:54.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.993+0000 7fba15b63700 1 -- 172.21.15.134:0/2742353201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba10119c90 con 0x7fba100fe8f0 2024-02-16T22:30:54.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.993+0000 7fba0cff9700 1 -- 172.21.15.134:0/2742353201 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9f8009620 con 0x7fba100fe8f0 2024-02-16T22:30:54.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.993+0000 7fba15b63700 1 -- 172.21.15.134:0/2742353201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1011a0f0 con 0x7fba100fe8f0 2024-02-16T22:30:54.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.994+0000 7fba15b63700 1 -- 172.21.15.134:0/2742353201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba101046c0 con 0x7fba100fe8f0 2024-02-16T22:30:54.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.994+0000 7fba0cff9700 1 -- 172.21.15.134:0/2742353201 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fb9f8009780 con 0x7fba100fe8f0 2024-02-16T22:30:54.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.995+0000 7fba0cff9700 1 --2- 172.21.15.134:0/2742353201 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb9fc06d7e0 0x7fb9fc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:54.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.995+0000 7fba0cff9700 1 -- 172.21.15.134:0/2742353201 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fb9f808cb00 con 0x7fba100fe8f0 2024-02-16T22:30:54.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.995+0000 7fba0f7fe700 1 --2- 172.21.15.134:0/2742353201 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb9fc06d7e0 0x7fb9fc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:54.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:54.995+0000 7fba0f7fe700 1 --2- 172.21.15.134:0/2742353201 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb9fc06d7e0 0x7fb9fc06fc90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fba00000c00 tx=0x7fba00009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:55.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:55.000+0000 7fba0cff9700 1 -- 172.21.15.134:0/2742353201 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb9f8056420 con 0x7fba100fe8f0 2024-02-16T22:30:55.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:55.239+0000 7fba15b63700 1 -- 172.21.15.134:0/2742353201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fba100fd5e0 con 0x7fba100fe8f0 2024-02-16T22:30:55.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:55.240+0000 7fba0cff9700 1 -- 172.21.15.134:0/2742353201 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1880 (secure 0 0 0) 0x7fb9f8019770 con 0x7fba100fe8f0 2024-02-16T22:30:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:e36 2024-02-16T22:30:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-16T22:30:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-16T22:30:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-02-16T22:30:55.242 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:30:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-02-16T22:30:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-02-16T22:30:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 36 2024-02-16T22:30:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-16T22:30:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-16T22:16:31.472137+0000 2024-02-16T22:30:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-02-16T22:29:20.212270+0000 2024-02-16T22:30:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-02-16T22:30:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-02-16T22:30:55.243 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-02-16T22:30:55.243 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-02-16T22:30:55.243 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-02-16T22:30:55.243 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-02-16T22:30:55.243 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-02-16T22:30:55.243 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-02-16T22:30:55.243 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 81 2024-02-16T22:30:55.243 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-16T22:30:55.243 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 2 2024-02-16T22:30:55.243 INFO:teuthology.orchestra.run.smithi134.stdout:in 0,1 2024-02-16T22:30:55.243 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=34382,1=34414} 2024-02-16T22:30:55.243 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-02-16T22:30:55.243 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-02-16T22:30:55.243 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-02-16T22:30:55.244 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-02-16T22:30:55.244 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-02-16T22:30:55.244 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-02-16T22:30:55.244 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-02-16T22:30:55.244 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-02-16T22:30:55.244 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-02-16T22:30:55.244 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.cygfxr{0:34382} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.134:6826/845650190,v1:172.21.15.134:6827/845650190] compat {c=[1],r=[1],i=[fff]}] 2024-02-16T22:30:55.244 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.jyajef{1:34414} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.134:6828/3664331772,v1:172.21.15.134:6829/3664331772] compat {c=[1],r=[1],i=[fff]}] 2024-02-16T22:30:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:30:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:30:55.244 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-02-16T22:30:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:30:55.244 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.qljqef{-1:44301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.173:6824/892474824,v1:172.21.15.173:6825/892474824] compat {c=[1],r=[1],i=[fff]}] 2024-02-16T22:30:55.245 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi173.phstvm{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.173:6826/862726270,v1:172.21.15.173:6827/862726270] compat {c=[1],r=[1],i=[fff]}] 2024-02-16T22:30:55.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:55.242+0000 7fba15b63700 1 -- 172.21.15.134:0/2742353201 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb9fc06d7e0 msgr2=0x7fb9fc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:55.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:55.242+0000 7fba15b63700 1 --2- 172.21.15.134:0/2742353201 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb9fc06d7e0 0x7fb9fc06fc90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fba00000c00 tx=0x7fba00009e30 comp rx=0 tx=0).stop 2024-02-16T22:30:55.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:55.242+0000 7fba15b63700 1 -- 172.21.15.134:0/2742353201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba100fe8f0 msgr2=0x7fba100fc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:55.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:55.242+0000 7fba15b63700 1 --2- 172.21.15.134:0/2742353201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba100fe8f0 0x7fba100fc3e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800eb40 tx=0x7fb9f800b040 comp rx=0 tx=0).stop 2024-02-16T22:30:55.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:55.242+0000 7fba15b63700 1 -- 172.21.15.134:0/2742353201 shutdown_connections 2024-02-16T22:30:55.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:55.242+0000 7fba15b63700 1 --2- 172.21.15.134:0/2742353201 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb9fc06d7e0 0x7fb9fc06fc90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:55.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:55.242+0000 7fba15b63700 1 --2- 172.21.15.134:0/2742353201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba100fdfe0 0x7fba100fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:55.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:55.242+0000 7fba15b63700 1 --2- 172.21.15.134:0/2742353201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba100fe8f0 0x7fba100fc3e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:55.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:55.242+0000 7fba15b63700 1 -- 172.21.15.134:0/2742353201 >> 172.21.15.134:0/2742353201 conn(0x7fba10071d90 msgr2=0x7fba10101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:55.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:55.242+0000 7fba15b63700 1 -- 172.21.15.134:0/2742353201 shutdown_connections 2024-02-16T22:30:55.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:55.242+0000 7fba15b63700 1 -- 172.21.15.134:0/2742353201 wait complete. 2024-02-16T22:30:55.246 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 36 2024-02-16T22:30:55.915 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-02-16T22:30:55.930 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T22:30:56.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.029+0000 7f6f67eae640 1 -- 172.21.15.134:0/3926072257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f60102c20 msgr2=0x7f6f600fc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:56.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.029+0000 7f6f67eae640 1 --2- 172.21.15.134:0/3926072257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f60102c20 0x7f6f600fc2b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f500048d0 tx=0x7f6f50009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.029+0000 7f6f67eae640 1 -- 172.21.15.134:0/3926072257 shutdown_connections 2024-02-16T22:30:56.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.029+0000 7f6f67eae640 1 --2- 172.21.15.134:0/3926072257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f60102c20 0x7f6f600fc2b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.029+0000 7f6f67eae640 1 --2- 172.21.15.134:0/3926072257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f60102280 0x7f6f60102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.029+0000 7f6f67eae640 1 -- 172.21.15.134:0/3926072257 >> 172.21.15.134:0/3926072257 conn(0x7f6f600f7e50 msgr2=0x7f6f600fa260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:56.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.029+0000 7f6f67eae640 1 -- 172.21.15.134:0/3926072257 shutdown_connections 2024-02-16T22:30:56.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.029+0000 7f6f67eae640 1 -- 172.21.15.134:0/3926072257 wait complete. 2024-02-16T22:30:56.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.029+0000 7f6f67eae640 1 Processor -- start 2024-02-16T22:30:56.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f67eae640 1 -- start start 2024-02-16T22:30:56.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f67eae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f60102280 0x7f6f60112ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f67eae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f60102c20 0x7f6f601130e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f67eae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f601136e0 con 0x7f6f60102280 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f67eae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6010cc70 con 0x7f6f60102c20 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f65c4a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f60102280 0x7f6f60112ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f65c4a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f60102280 0x7f6f60112ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38700/0 (socket says 172.21.15.134:38700) 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f65c4a640 1 -- 172.21.15.134:0/954879321 learned_addr learned my addr 172.21.15.134:0/954879321 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f65449640 1 --2- 172.21.15.134:0/954879321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f60102c20 0x7f6f601130e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f65c4a640 1 -- 172.21.15.134:0/954879321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f60102c20 msgr2=0x7f6f601130e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f65c4a640 1 --2- 172.21.15.134:0/954879321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f60102c20 0x7f6f601130e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f65c4a640 1 -- 172.21.15.134:0/954879321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f50005040 con 0x7f6f60102280 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f65c4a640 1 --2- 172.21.15.134:0/954879321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f60102280 0x7f6f60112ba0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c002a50 tx=0x7f6f5c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f567fc640 1 -- 172.21.15.134:0/954879321 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f5c007c30 con 0x7f6f60102280 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f567fc640 1 -- 172.21.15.134:0/954879321 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f5c00f040 con 0x7f6f60102280 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f567fc640 1 -- 172.21.15.134:0/954879321 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f5c00db50 con 0x7f6f60102280 2024-02-16T22:30:56.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f67eae640 1 -- 172.21.15.134:0/954879321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6010cf50 con 0x7f6f60102280 2024-02-16T22:30:56.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.030+0000 7f6f67eae640 1 -- 172.21.15.134:0/954879321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6010d440 con 0x7f6f60102280 2024-02-16T22:30:56.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.031+0000 7f6f67eae640 1 -- 172.21.15.134:0/954879321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f60064030 con 0x7f6f60102280 2024-02-16T22:30:56.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.032+0000 7f6f567fc640 1 -- 172.21.15.134:0/954879321 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f6f5c00dcf0 con 0x7f6f60102280 2024-02-16T22:30:56.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.032+0000 7f6f567fc640 1 --2- 172.21.15.134:0/954879321 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f6f4c06d750 0x7f6f4c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:56.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.032+0000 7f6f567fc640 1 -- 172.21.15.134:0/954879321 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6f5c08c790 con 0x7f6f60102280 2024-02-16T22:30:56.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.032+0000 7f6f65449640 1 --2- 172.21.15.134:0/954879321 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f6f4c06d750 0x7f6f4c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:56.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.033+0000 7f6f65449640 1 --2- 172.21.15.134:0/954879321 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f6f4c06d750 0x7f6f4c06fc00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6f6010ddb0 tx=0x7f6f50009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:56.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.037+0000 7f6f567fc640 1 -- 172.21.15.134:0/954879321 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6f5c056000 con 0x7f6f60102280 2024-02-16T22:30:56.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.215+0000 7f6f67eae640 1 -- 172.21.15.134:0/954879321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f6010e1a0 con 0x7f6f60102280 2024-02-16T22:30:56.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.216+0000 7f6f567fc640 1 -- 172.21.15.134:0/954879321 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16714 (secure 0 0 0) 0x7f6f5c0596c0 con 0x7f6f60102280 2024-02-16T22:30:56.218 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:30:56.219 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":85,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","created":"2024-02-16T22:09:26.274039+0000","modified":"2024-02-16T22:28:56.756353+0000","last_up_change":"2024-02-16T22:28:00.750133+0000","last_in_change":"2024-02-16T22:14:56.818141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T22:14:01.182574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-16T22:16:30.037904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-16T22:16:30.699564+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8e715f3-43f6-439a-be3d-a3bbd70b412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2886656462},{"type":"v1","addr":"172.21.15.134:6803","nonce":2886656462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2886656462},{"type":"v1","addr":"172.21.15.134:6805","nonce":2886656462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2886656462},{"type":"v1","addr":"172.21.15.134:6809","nonce":2886656462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2886656462},{"type":"v1","addr":"172.21.15.134:6807","nonce":2886656462}]},"public_addr":"172.21.15.134:6803/2886656462","cluster_addr":"172.21.15.134:6805/2886656462","heartbeat_back_addr":"172.21.15.134:6809/2886656462","heartbeat_front_addr":"172.21.15.134:6807/2886656462","state":["exists","up"]},{"osd":1,"uuid":"c1fe573e-cb80-4ac7-9d3c-b7e296e86a81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":180212709},{"type":"v1","addr":"172.21.15.134:6811","nonce":180212709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":180212709},{"type":"v1","addr":"172.21.15.134:6813","nonce":180212709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":180212709},{"type":"v1","addr":"172.21.15.134:6817","nonce":180212709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":180212709},{"type":"v1","addr":"172.21.15.134:6815","nonce":180212709}]},"public_addr":"172.21.15.134:6811/180212709","cluster_addr":"172.21.15.134:6813/180212709","heartbeat_back_addr":"172.21.15.134:6817/180212709","heartbeat_front_addr":"172.21.15.134:6815/180212709","state":["exists","up"]},{"osd":2,"uuid":"036c6cf2-7373-46ff-85db-9e0898ad0677","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1465167236},{"type":"v1","addr":"172.21.15.134:6819","nonce":1465167236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1465167236},{"type":"v1","addr":"172.21.15.134:6821","nonce":1465167236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1465167236},{"type":"v1","addr":"172.21.15.134:6825","nonce":1465167236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1465167236},{"type":"v1","addr":"172.21.15.134:6823","nonce":1465167236}]},"public_addr":"172.21.15.134:6819/1465167236","cluster_addr":"172.21.15.134:6821/1465167236","heartbeat_back_addr":"172.21.15.134:6825/1465167236","heartbeat_front_addr":"172.21.15.134:6823/1465167236","state":["exists","up"]},{"osd":3,"uuid":"6a00fd47-f787-4e21-9619-9e9341420b4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1507653386},{"type":"v1","addr":"172.21.15.173:6801","nonce":1507653386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1507653386},{"type":"v1","addr":"172.21.15.173:6803","nonce":1507653386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":1507653386},{"type":"v1","addr":"172.21.15.173:6807","nonce":1507653386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1507653386},{"type":"v1","addr":"172.21.15.173:6805","nonce":1507653386}]},"public_addr":"172.21.15.173:6801/1507653386","cluster_addr":"172.21.15.173:6803/1507653386","heartbeat_back_addr":"172.21.15.173:6807/1507653386","heartbeat_front_addr":"172.21.15.173:6805/1507653386","state":["exists","up"]},{"osd":4,"uuid":"5a314e0e-0951-4462-bb9a-f3614ded4c18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":787878754},{"type":"v1","addr":"172.21.15.173:6809","nonce":787878754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":787878754},{"type":"v1","addr":"172.21.15.173:6811","nonce":787878754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":787878754},{"type":"v1","addr":"172.21.15.173:6815","nonce":787878754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":787878754},{"type":"v1","addr":"172.21.15.173:6813","nonce":787878754}]},"public_addr":"172.21.15.173:6809/787878754","cluster_addr":"172.21.15.173:6811/787878754","heartbeat_back_addr":"172.21.15.173:6815/787878754","heartbeat_front_addr":"172.21.15.173:6813/787878754","state":["exists","up"]},{"osd":5,"uuid":"9d9ce9a3-e735-4265-890c-af2aada1122d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4051147258},{"type":"v1","addr":"172.21.15.173:6817","nonce":4051147258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4051147258},{"type":"v1","addr":"172.21.15.173:6819","nonce":4051147258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4051147258},{"type":"v1","addr":"172.21.15.173:6823","nonce":4051147258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4051147258},{"type":"v1","addr":"172.21.15.173:6821","nonce":4051147258}]},"public_addr":"172.21.15.173:6817/4051147258","cluster_addr":"172.21.15.173:6819/4051147258","heartbeat_back_addr":"172.21.15.173:6823/4051147258","heartbeat_front_addr":"172.21.15.173:6821/4051147258","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:01.314144+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:30.212232+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:58.392610+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:14:22.854647+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:14:48.600782+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:15:13.932090+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6828/3374248278":"2024-02-17T22:28:03.434216+0000","172.21.15.173:6825/122132522":"2024-02-17T22:28:03.434241+0000","172.21.15.134:0/3099284737":"2024-02-17T22:10:30.766785+0000","172.21.15.173:6828/2126919483":"2024-02-17T22:20:58.105398+0000","172.21.15.134:0/3934807828":"2024-02-17T22:19:21.945934+0000","172.21.15.134:6801/2987045407":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/920183098":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/3313361224":"2024-02-17T22:09:59.839885+0000","172.21.15.134:6826/49557312":"2024-02-17T22:16:46.449488+0000","172.21.15.173:0/2291107787":"2024-02-17T22:20:58.105398+0000","172.21.15.134:6800/2987045407":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6827/49557312":"2024-02-17T22:16:46.449488+0000","172.21.15.134:0/2189745948":"2024-02-17T22:19:21.945934+0000","172.21.15.173:0/267147590":"2024-02-17T22:20:58.105398+0000","172.21.15.134:0/1938438068":"2024-02-17T22:19:21.945934+0000","172.21.15.134:0/4134305029":"2024-02-17T22:23:36.980020+0000","172.21.15.134:6801/3459537666":"2024-02-17T22:09:59.839885+0000","172.21.15.134:6801/3164225175":"2024-02-17T22:23:36.980020+0000","172.21.15.134:0/3516783507":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/3010290966":"2024-02-17T22:10:30.766785+0000","172.21.15.134:6800/2578294352":"2024-02-17T22:19:21.945934+0000","172.21.15.134:6800/3520115315":"2024-02-17T22:10:30.766785+0000","172.21.15.134:6801/2578294352":"2024-02-17T22:19:21.945934+0000","172.21.15.134:0/1394270230":"2024-02-17T22:23:36.980020+0000","172.21.15.173:6829/2126919483":"2024-02-17T22:20:58.105398+0000","172.21.15.134:6801/3520115315":"2024-02-17T22:10:30.766785+0000","172.21.15.134:6829/3374248278":"2024-02-17T22:28:03.434216+0000","172.21.15.134:0/1660938940":"2024-02-17T22:19:21.945934+0000","172.21.15.134:0/1667200782":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/3172564602":"2024-02-17T22:11:42.853761+0000","172.21.15.173:0/4220401534":"2024-02-17T22:20:58.105398+0000","172.21.15.173:0/2855616451":"2024-02-17T22:20:58.105398+0000","172.21.15.134:0/994312604":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/2419255497":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/2919414539":"2024-02-17T22:23:36.980020+0000","172.21.15.134:0/3327665682":"2024-02-17T22:23:36.980020+0000","172.21.15.134:6800/3459537666":"2024-02-17T22:09:59.839885+0000","172.21.15.134:6800/3164225175":"2024-02-17T22:23:36.980020+0000","172.21.15.173:6824/122132522":"2024-02-17T22:28:03.434241+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T22:30:56.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.218+0000 7f6f67eae640 1 -- 172.21.15.134:0/954879321 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f6f4c06d750 msgr2=0x7f6f4c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:56.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.219+0000 7f6f67eae640 1 --2- 172.21.15.134:0/954879321 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f6f4c06d750 0x7f6f4c06fc00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6f6010ddb0 tx=0x7f6f50009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.219+0000 7f6f67eae640 1 -- 172.21.15.134:0/954879321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f60102280 msgr2=0x7f6f60112ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:56.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.219+0000 7f6f67eae640 1 --2- 172.21.15.134:0/954879321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f60102280 0x7f6f60112ba0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c002a50 tx=0x7f6f5c004600 comp rx=0 tx=0).stop 2024-02-16T22:30:56.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.219+0000 7f6f67eae640 1 -- 172.21.15.134:0/954879321 shutdown_connections 2024-02-16T22:30:56.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.219+0000 7f6f67eae640 1 --2- 172.21.15.134:0/954879321 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f6f4c06d750 0x7f6f4c06fc00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.219+0000 7f6f67eae640 1 --2- 172.21.15.134:0/954879321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f60102c20 0x7f6f601130e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.219+0000 7f6f67eae640 1 --2- 172.21.15.134:0/954879321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f60102280 0x7f6f60112ba0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.219+0000 7f6f67eae640 1 -- 172.21.15.134:0/954879321 >> 172.21.15.134:0/954879321 conn(0x7f6f600f7e50 msgr2=0x7f6f600f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:56.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.219+0000 7f6f67eae640 1 -- 172.21.15.134:0/954879321 shutdown_connections 2024-02-16T22:30:56.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.219+0000 7f6f67eae640 1 -- 172.21.15.134:0/954879321 wait complete. 2024-02-16T22:30:56.232 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-16T22:14:01.182574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-16T22:16:30.037904+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-16T22:16:30.699564+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-16T22:30:56.232 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-16T22:30:56.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.332+0000 7f686c19d640 1 -- 172.21.15.134:0/4283821254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6864101240 msgr2=0x7f6864101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:56.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.332+0000 7f686c19d640 1 --2- 172.21.15.134:0/4283821254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6864101240 0x7f6864101610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f68600048d0 tx=0x7f6860009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.332+0000 7f686c19d640 1 -- 172.21.15.134:0/4283821254 shutdown_connections 2024-02-16T22:30:56.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.332+0000 7f686c19d640 1 --2- 172.21.15.134:0/4283821254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6864101be0 0x7f68640fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.332+0000 7f686c19d640 1 --2- 172.21.15.134:0/4283821254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6864101240 0x7f6864101610 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.332+0000 7f686c19d640 1 -- 172.21.15.134:0/4283821254 >> 172.21.15.134:0/4283821254 conn(0x7f68640f6e10 msgr2=0x7f68640f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:56.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.332+0000 7f686c19d640 1 -- 172.21.15.134:0/4283821254 shutdown_connections 2024-02-16T22:30:56.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.332+0000 7f686c19d640 1 -- 172.21.15.134:0/4283821254 wait complete. 2024-02-16T22:30:56.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.332+0000 7f686c19d640 1 Processor -- start 2024-02-16T22:30:56.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.332+0000 7f686c19d640 1 -- start start 2024-02-16T22:30:56.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f686c19d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6864101240 0x7f686410dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:56.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f686c19d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6864101be0 0x7f686410e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:56.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f686c19d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686410e760 con 0x7f6864101240 2024-02-16T22:30:56.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f686c19d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686410e8d0 con 0x7f6864101be0 2024-02-16T22:30:56.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f6869f39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6864101240 0x7f686410dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:56.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f6869f39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6864101240 0x7f686410dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38708/0 (socket says 172.21.15.134:38708) 2024-02-16T22:30:56.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f6869f39640 1 -- 172.21.15.134:0/1787092907 learned_addr learned my addr 172.21.15.134:0/1787092907 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:56.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f6869f39640 1 -- 172.21.15.134:0/1787092907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6864101be0 msgr2=0x7f686410e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:56.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f6869f39640 1 --2- 172.21.15.134:0/1787092907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6864101be0 0x7f686410e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f6869f39640 1 -- 172.21.15.134:0/1787092907 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6860005040 con 0x7f6864101240 2024-02-16T22:30:56.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f6869f39640 1 --2- 172.21.15.134:0/1787092907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6864101240 0x7f686410dce0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6860031720 tx=0x7f6860009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:56.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f685a7fc640 1 -- 172.21.15.134:0/1787092907 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68600094c0 con 0x7f6864101240 2024-02-16T22:30:56.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f686c19d640 1 -- 172.21.15.134:0/1787092907 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686410eb50 con 0x7f6864101240 2024-02-16T22:30:56.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f685a7fc640 1 -- 172.21.15.134:0/1787092907 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6860009620 con 0x7f6864101240 2024-02-16T22:30:56.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f685a7fc640 1 -- 172.21.15.134:0/1787092907 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f686003b640 con 0x7f6864101240 2024-02-16T22:30:56.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.333+0000 7f686c19d640 1 -- 172.21.15.134:0/1787092907 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6864117000 con 0x7f6864101240 2024-02-16T22:30:56.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.334+0000 7f686c19d640 1 -- 172.21.15.134:0/1787092907 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6864064480 con 0x7f6864101240 2024-02-16T22:30:56.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.335+0000 7f685a7fc640 1 -- 172.21.15.134:0/1787092907 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f686002f070 con 0x7f6864101240 2024-02-16T22:30:56.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.335+0000 7f685a7fc640 1 --2- 172.21.15.134:0/1787092907 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f685006d750 0x7f685006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:56.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.335+0000 7f685a7fc640 1 -- 172.21.15.134:0/1787092907 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f68600af3c0 con 0x7f6864101240 2024-02-16T22:30:56.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.335+0000 7f6869738640 1 --2- 172.21.15.134:0/1787092907 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f685006d750 0x7f685006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:56.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.335+0000 7f6869738640 1 --2- 172.21.15.134:0/1787092907 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f685006d750 0x7f685006fc00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6864065ef0 tx=0x7f6854007cb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:56.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.340+0000 7f685a7fc640 1 -- 172.21.15.134:0/1787092907 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6860078bb0 con 0x7f6864101240 2024-02-16T22:30:56.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:56 smithi134 ceph-mon[112514]: pgmap v258: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:56.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:56 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2742353201' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:30:56.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:56 smithi173 ceph-mon[83703]: pgmap v258: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:56.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:56 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2742353201' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-16T22:30:56.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.513+0000 7f686c19d640 1 -- 172.21.15.134:0/1787092907 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f686410eaf0 con 0x7f6864101240 2024-02-16T22:30:56.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.513+0000 7f685a7fc640 1 -- 172.21.15.134:0/1787092907 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f686007c270 con 0x7f6864101240 2024-02-16T22:30:56.515 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-02-16T22:30:56.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.515+0000 7f686c19d640 1 -- 172.21.15.134:0/1787092907 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f685006d750 msgr2=0x7f685006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:56.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.515+0000 7f686c19d640 1 --2- 172.21.15.134:0/1787092907 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f685006d750 0x7f685006fc00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6864065ef0 tx=0x7f6854007cb0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.515+0000 7f686c19d640 1 -- 172.21.15.134:0/1787092907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6864101240 msgr2=0x7f686410dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:56.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.515+0000 7f686c19d640 1 --2- 172.21.15.134:0/1787092907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6864101240 0x7f686410dce0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6860031720 tx=0x7f6860009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.515+0000 7f686c19d640 1 -- 172.21.15.134:0/1787092907 shutdown_connections 2024-02-16T22:30:56.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.515+0000 7f686c19d640 1 --2- 172.21.15.134:0/1787092907 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f685006d750 0x7f685006fc00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.515+0000 7f686c19d640 1 --2- 172.21.15.134:0/1787092907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6864101be0 0x7f686410e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.515+0000 7f686c19d640 1 --2- 172.21.15.134:0/1787092907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6864101240 0x7f686410dce0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.515+0000 7f686c19d640 1 -- 172.21.15.134:0/1787092907 >> 172.21.15.134:0/1787092907 conn(0x7f68640f6e10 msgr2=0x7f68640f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:56.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.515+0000 7f686c19d640 1 -- 172.21.15.134:0/1787092907 shutdown_connections 2024-02-16T22:30:56.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.515+0000 7f686c19d640 1 -- 172.21.15.134:0/1787092907 wait complete. 2024-02-16T22:30:56.528 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-16T22:30:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.627+0000 7f767122e640 1 -- 172.21.15.134:0/3509912122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c0fb2b0 msgr2=0x7f766c0fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.627+0000 7f767122e640 1 --2- 172.21.15.134:0/3509912122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c0fb2b0 0x7f766c0fb700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7660009c50 tx=0x7f7660004d10 comp rx=0 tx=0).stop 2024-02-16T22:30:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.627+0000 7f767122e640 1 -- 172.21.15.134:0/3509912122 shutdown_connections 2024-02-16T22:30:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.627+0000 7f767122e640 1 --2- 172.21.15.134:0/3509912122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c0fb2b0 0x7f766c0fb700 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.627+0000 7f767122e640 1 --2- 172.21.15.134:0/3509912122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f766c1012d0 0x7f766c1016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.627+0000 7f767122e640 1 -- 172.21.15.134:0/3509912122 >> 172.21.15.134:0/3509912122 conn(0x7f766c071230 msgr2=0x7f766c071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.627+0000 7f767122e640 1 -- 172.21.15.134:0/3509912122 shutdown_connections 2024-02-16T22:30:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.627+0000 7f767122e640 1 -- 172.21.15.134:0/3509912122 wait complete. 2024-02-16T22:30:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.628+0000 7f767122e640 1 Processor -- start 2024-02-16T22:30:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.628+0000 7f767122e640 1 -- start start 2024-02-16T22:30:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.628+0000 7f767122e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c0fb2b0 0x7f766c10dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:56.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.628+0000 7f767122e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f766c1012d0 0x7f766c10e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.628+0000 7f767122e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c10e7e0 con 0x7f766c0fb2b0 2024-02-16T22:30:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.628+0000 7f767122e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c10e920 con 0x7f766c1012d0 2024-02-16T22:30:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.628+0000 7f766ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c0fb2b0 0x7f766c10dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.628+0000 7f766ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c0fb2b0 0x7f766c10dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38722/0 (socket says 172.21.15.134:38722) 2024-02-16T22:30:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.628+0000 7f766ad9d640 1 -- 172.21.15.134:0/1149519569 learned_addr learned my addr 172.21.15.134:0/1149519569 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.628+0000 7f766ad9d640 1 -- 172.21.15.134:0/1149519569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f766c1012d0 msgr2=0x7f766c10e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.628+0000 7f766ad9d640 1 --2- 172.21.15.134:0/1149519569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f766c1012d0 0x7f766c10e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.628+0000 7f766ad9d640 1 -- 172.21.15.134:0/1149519569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600098b0 con 0x7f766c0fb2b0 2024-02-16T22:30:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.628+0000 7f766ad9d640 1 --2- 172.21.15.134:0/1149519569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c0fb2b0 0x7f766c10dd60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7664002a50 tx=0x7f7664004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.628+0000 7f76537fe640 1 -- 172.21.15.134:0/1149519569 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7664007c30 con 0x7f766c0fb2b0 2024-02-16T22:30:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.629+0000 7f76537fe640 1 -- 172.21.15.134:0/1149519569 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f766400f040 con 0x7f766c0fb2b0 2024-02-16T22:30:56.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.629+0000 7f767122e640 1 -- 172.21.15.134:0/1149519569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c116dd0 con 0x7f766c0fb2b0 2024-02-16T22:30:56.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.629+0000 7f76537fe640 1 -- 172.21.15.134:0/1149519569 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f766400db50 con 0x7f766c0fb2b0 2024-02-16T22:30:56.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.629+0000 7f767122e640 1 -- 172.21.15.134:0/1149519569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c1171b0 con 0x7f766c0fb2b0 2024-02-16T22:30:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.630+0000 7f767122e640 1 -- 172.21.15.134:0/1149519569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766c064030 con 0x7f766c0fb2b0 2024-02-16T22:30:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.630+0000 7f76537fe640 1 -- 172.21.15.134:0/1149519569 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f766401c400 con 0x7f766c0fb2b0 2024-02-16T22:30:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.630+0000 7f76537fe640 1 --2- 172.21.15.134:0/1149519569 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f765406d750 0x7f765406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.630+0000 7f76537fe640 1 -- 172.21.15.134:0/1149519569 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f766408c810 con 0x7f766c0fb2b0 2024-02-16T22:30:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.631+0000 7f766a59c640 1 --2- 172.21.15.134:0/1149519569 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f765406d750 0x7f765406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:56.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.631+0000 7f766a59c640 1 --2- 172.21.15.134:0/1149519569 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f765406d750 0x7f765406fc00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7660009c20 tx=0x7f7660004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:56.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.635+0000 7f76537fe640 1 -- 172.21.15.134:0/1149519569 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7664056000 con 0x7f766c0fb2b0 2024-02-16T22:30:56.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.806+0000 7f767122e640 1 -- 172.21.15.134:0/1149519569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f766c1083c0 con 0x7f766c0fb2b0 2024-02-16T22:30:56.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.806+0000 7f76537fe640 1 -- 172.21.15.134:0/1149519569 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f76640596c0 con 0x7f766c0fb2b0 2024-02-16T22:30:56.808 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-16T22:30:56.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.808+0000 7f767122e640 1 -- 172.21.15.134:0/1149519569 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f765406d750 msgr2=0x7f765406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:56.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.808+0000 7f767122e640 1 --2- 172.21.15.134:0/1149519569 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f765406d750 0x7f765406fc00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7660009c20 tx=0x7f7660004d10 comp rx=0 tx=0).stop 2024-02-16T22:30:56.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.808+0000 7f767122e640 1 -- 172.21.15.134:0/1149519569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c0fb2b0 msgr2=0x7f766c10dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:56.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.808+0000 7f767122e640 1 --2- 172.21.15.134:0/1149519569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c0fb2b0 0x7f766c10dd60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7664002a50 tx=0x7f7664004600 comp rx=0 tx=0).stop 2024-02-16T22:30:56.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.808+0000 7f767122e640 1 -- 172.21.15.134:0/1149519569 shutdown_connections 2024-02-16T22:30:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.808+0000 7f767122e640 1 --2- 172.21.15.134:0/1149519569 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f765406d750 0x7f765406fc00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.808+0000 7f767122e640 1 --2- 172.21.15.134:0/1149519569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f766c1012d0 0x7f766c10e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.808+0000 7f767122e640 1 --2- 172.21.15.134:0/1149519569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c0fb2b0 0x7f766c10dd60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.808+0000 7f767122e640 1 -- 172.21.15.134:0/1149519569 >> 172.21.15.134:0/1149519569 conn(0x7f766c071230 msgr2=0x7f766c0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.808+0000 7f767122e640 1 -- 172.21.15.134:0/1149519569 shutdown_connections 2024-02-16T22:30:56.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.808+0000 7f767122e640 1 -- 172.21.15.134:0/1149519569 wait complete. 2024-02-16T22:30:56.821 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-16T22:30:56.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.919+0000 7f88fb79d640 1 -- 172.21.15.134:0/2018228725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88f40fb2b0 msgr2=0x7f88f40fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:56.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.919+0000 7f88fb79d640 1 --2- 172.21.15.134:0/2018228725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88f40fb2b0 0x7f88f40fb700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f88e40048d0 tx=0x7f88e4009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.919+0000 7f88fb79d640 1 -- 172.21.15.134:0/2018228725 shutdown_connections 2024-02-16T22:30:56.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.919+0000 7f88fb79d640 1 --2- 172.21.15.134:0/2018228725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88f40fb2b0 0x7f88f40fb700 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.919+0000 7f88fb79d640 1 --2- 172.21.15.134:0/2018228725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f41012d0 0x7f88f41016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.919+0000 7f88fb79d640 1 -- 172.21.15.134:0/2018228725 >> 172.21.15.134:0/2018228725 conn(0x7f88f4071230 msgr2=0x7f88f4071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:56.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88fb79d640 1 -- 172.21.15.134:0/2018228725 shutdown_connections 2024-02-16T22:30:56.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88fb79d640 1 -- 172.21.15.134:0/2018228725 wait complete. 2024-02-16T22:30:56.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88fb79d640 1 Processor -- start 2024-02-16T22:30:56.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88fb79d640 1 -- start start 2024-02-16T22:30:56.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88fb79d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88f40fb2b0 0x7f88f4112c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:56.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88fb79d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f41012d0 0x7f88f4113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:56.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88fb79d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f4113760 con 0x7f88f40fb2b0 2024-02-16T22:30:56.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88fb79d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f410ccf0 con 0x7f88f41012d0 2024-02-16T22:30:56.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88f9539640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88f40fb2b0 0x7f88f4112c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:56.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88f9539640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88f40fb2b0 0x7f88f4112c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38744/0 (socket says 172.21.15.134:38744) 2024-02-16T22:30:56.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88f9539640 1 -- 172.21.15.134:0/909878037 learned_addr learned my addr 172.21.15.134:0/909878037 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:56.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88f8d38640 1 --2- 172.21.15.134:0/909878037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f41012d0 0x7f88f4113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:56.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88f9539640 1 -- 172.21.15.134:0/909878037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f41012d0 msgr2=0x7f88f4113160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:56.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88f9539640 1 --2- 172.21.15.134:0/909878037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f41012d0 0x7f88f4113160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:56.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88f9539640 1 -- 172.21.15.134:0/909878037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e4005040 con 0x7f88f40fb2b0 2024-02-16T22:30:56.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.920+0000 7f88f8d38640 1 --2- 172.21.15.134:0/909878037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f41012d0 0x7f88f4113160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:30:56.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.921+0000 7f88f9539640 1 --2- 172.21.15.134:0/909878037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88f40fb2b0 0x7f88f4112c20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f88f000ece0 tx=0x7f88f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:56.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.921+0000 7f88e9ffb640 1 -- 172.21.15.134:0/909878037 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88f000ee40 con 0x7f88f40fb2b0 2024-02-16T22:30:56.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.921+0000 7f88e9ffb640 1 -- 172.21.15.134:0/909878037 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88f000f040 con 0x7f88f40fb2b0 2024-02-16T22:30:56.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.921+0000 7f88fb79d640 1 -- 172.21.15.134:0/909878037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f410cfd0 con 0x7f88f40fb2b0 2024-02-16T22:30:56.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.921+0000 7f88e9ffb640 1 -- 172.21.15.134:0/909878037 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88f0009750 con 0x7f88f40fb2b0 2024-02-16T22:30:56.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.921+0000 7f88fb79d640 1 -- 172.21.15.134:0/909878037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f410d4c0 con 0x7f88f40fb2b0 2024-02-16T22:30:56.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.922+0000 7f88fb79d640 1 -- 172.21.15.134:0/909878037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f4064030 con 0x7f88f40fb2b0 2024-02-16T22:30:56.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.922+0000 7f88e9ffb640 1 -- 172.21.15.134:0/909878037 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f88f0007890 con 0x7f88f40fb2b0 2024-02-16T22:30:56.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.923+0000 7f88e9ffb640 1 --2- 172.21.15.134:0/909878037 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f88e006d750 0x7f88e006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:56.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.923+0000 7f88f8d38640 1 --2- 172.21.15.134:0/909878037 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f88e006d750 0x7f88e006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:56.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.923+0000 7f88e9ffb640 1 -- 172.21.15.134:0/909878037 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f88f008d7b0 con 0x7f88f40fb2b0 2024-02-16T22:30:56.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.923+0000 7f88f8d38640 1 --2- 172.21.15.134:0/909878037 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f88e006d750 0x7f88e006fc00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f88f410de30 tx=0x7f88e4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:56.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:56.927+0000 7f88e9ffb640 1 -- 172.21.15.134:0/909878037 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f88f0056fa0 con 0x7f88f40fb2b0 2024-02-16T22:30:57.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.100+0000 7f88fb79d640 1 -- 172.21.15.134:0/909878037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f88f410d6e0 con 0x7f88f40fb2b0 2024-02-16T22:30:57.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.100+0000 7f88e9ffb640 1 -- 172.21.15.134:0/909878037 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f88f005a660 con 0x7f88f40fb2b0 2024-02-16T22:30:57.102 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-16T22:30:57.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.103+0000 7f88fb79d640 1 -- 172.21.15.134:0/909878037 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f88e006d750 msgr2=0x7f88e006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:57.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.103+0000 7f88fb79d640 1 --2- 172.21.15.134:0/909878037 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f88e006d750 0x7f88e006fc00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f88f410de30 tx=0x7f88e4009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.103+0000 7f88fb79d640 1 -- 172.21.15.134:0/909878037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88f40fb2b0 msgr2=0x7f88f4112c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:57.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.103+0000 7f88fb79d640 1 --2- 172.21.15.134:0/909878037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88f40fb2b0 0x7f88f4112c20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f88f000ece0 tx=0x7f88f000b040 comp rx=0 tx=0).stop 2024-02-16T22:30:57.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.103+0000 7f88fb79d640 1 -- 172.21.15.134:0/909878037 shutdown_connections 2024-02-16T22:30:57.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.103+0000 7f88fb79d640 1 --2- 172.21.15.134:0/909878037 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f88e006d750 0x7f88e006fc00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.103+0000 7f88fb79d640 1 --2- 172.21.15.134:0/909878037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f41012d0 0x7f88f4113160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.103+0000 7f88fb79d640 1 --2- 172.21.15.134:0/909878037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88f40fb2b0 0x7f88f4112c20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.103+0000 7f88fb79d640 1 -- 172.21.15.134:0/909878037 >> 172.21.15.134:0/909878037 conn(0x7f88f4071230 msgr2=0x7f88f4064520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.103+0000 7f88fb79d640 1 -- 172.21.15.134:0/909878037 shutdown_connections 2024-02-16T22:30:57.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.103+0000 7f88fb79d640 1 -- 172.21.15.134:0/909878037 wait complete. 2024-02-16T22:30:57.115 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-16T22:30:57.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.211+0000 7f422866e640 1 -- 172.21.15.134:0/4087760474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42201011a0 msgr2=0x7f4220101570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:57.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.211+0000 7f422866e640 1 --2- 172.21.15.134:0/4087760474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42201011a0 0x7f4220101570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f421c0048d0 tx=0x7f421c009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422866e640 1 -- 172.21.15.134:0/4087760474 shutdown_connections 2024-02-16T22:30:57.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422866e640 1 --2- 172.21.15.134:0/4087760474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4220101b40 0x7f42200fb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422866e640 1 --2- 172.21.15.134:0/4087760474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42201011a0 0x7f4220101570 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422866e640 1 -- 172.21.15.134:0/4087760474 >> 172.21.15.134:0/4087760474 conn(0x7f4220071290 msgr2=0x7f4220071690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422866e640 1 -- 172.21.15.134:0/4087760474 shutdown_connections 2024-02-16T22:30:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422866e640 1 -- 172.21.15.134:0/4087760474 wait complete. 2024-02-16T22:30:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422866e640 1 Processor -- start 2024-02-16T22:30:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422866e640 1 -- start start 2024-02-16T22:30:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422866e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42201011a0 0x7f422010dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422866e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4220101b40 0x7f422010e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422866e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422010e720 con 0x7f42201011a0 2024-02-16T22:30:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422866e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422010e890 con 0x7f4220101b40 2024-02-16T22:30:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422640a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42201011a0 0x7f422010dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422640a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42201011a0 0x7f422010dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38762/0 (socket says 172.21.15.134:38762) 2024-02-16T22:30:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.212+0000 7f422640a640 1 -- 172.21.15.134:0/1505886833 learned_addr learned my addr 172.21.15.134:0/1505886833 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:57.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.213+0000 7f4225c09640 1 --2- 172.21.15.134:0/1505886833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4220101b40 0x7f422010e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:57.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.213+0000 7f422640a640 1 -- 172.21.15.134:0/1505886833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4220101b40 msgr2=0x7f422010e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:57.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.213+0000 7f422640a640 1 --2- 172.21.15.134:0/1505886833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4220101b40 0x7f422010e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.213+0000 7f422640a640 1 -- 172.21.15.134:0/1505886833 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c005040 con 0x7f42201011a0 2024-02-16T22:30:57.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.213+0000 7f422640a640 1 --2- 172.21.15.134:0/1505886833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42201011a0 0x7f422010dca0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f421c031720 tx=0x7f421c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:57.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.213+0000 7f4216ffd640 1 -- 172.21.15.134:0/1505886833 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f421c0094c0 con 0x7f42201011a0 2024-02-16T22:30:57.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.213+0000 7f4216ffd640 1 -- 172.21.15.134:0/1505886833 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f421c009620 con 0x7f42201011a0 2024-02-16T22:30:57.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.213+0000 7f422866e640 1 -- 172.21.15.134:0/1505886833 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422010eb10 con 0x7f42201011a0 2024-02-16T22:30:57.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.213+0000 7f4216ffd640 1 -- 172.21.15.134:0/1505886833 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f421c03b640 con 0x7f42201011a0 2024-02-16T22:30:57.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.213+0000 7f422866e640 1 -- 172.21.15.134:0/1505886833 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4220117010 con 0x7f42201011a0 2024-02-16T22:30:57.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.214+0000 7f422866e640 1 -- 172.21.15.134:0/1505886833 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4220064030 con 0x7f42201011a0 2024-02-16T22:30:57.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.214+0000 7f4216ffd640 1 -- 172.21.15.134:0/1505886833 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f421c02f070 con 0x7f42201011a0 2024-02-16T22:30:57.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.215+0000 7f4216ffd640 1 --2- 172.21.15.134:0/1505886833 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f420c06d750 0x7f420c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:57.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.215+0000 7f4216ffd640 1 -- 172.21.15.134:0/1505886833 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f421c0af1d0 con 0x7f42201011a0 2024-02-16T22:30:57.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.215+0000 7f4225c09640 1 --2- 172.21.15.134:0/1505886833 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f420c06d750 0x7f420c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:57.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.215+0000 7f4225c09640 1 --2- 172.21.15.134:0/1505886833 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f420c06d750 0x7f420c06fc00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4220064d50 tx=0x7f4210009ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:57.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.219+0000 7f4216ffd640 1 -- 172.21.15.134:0/1505886833 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f421c0789c0 con 0x7f42201011a0 2024-02-16T22:30:57.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:57 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/954879321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-16T22:30:57.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:57 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1787092907' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-16T22:30:57.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:57 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1149519569' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-16T22:30:57.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:57 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/909878037' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-16T22:30:57.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.429+0000 7f422866e640 1 -- 172.21.15.134:0/1505886833 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4220064bc0 con 0x7f42201011a0 2024-02-16T22:30:57.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.430+0000 7f4216ffd640 1 -- 172.21.15.134:0/1505886833 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+5016 (secure 0 0 0) 0x7f421c07c080 con 0x7f42201011a0 2024-02-16T22:30:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:30:57.432 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44301,"name":"cephfs.smithi173.qljqef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6825/892474824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":892474824},{"type":"v1","addr":"172.21.15.173:6825","nonce":892474824}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44329,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6827/862726270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":862726270},{"type":"v1","addr":"172.21.15.173:6827","nonce":862726270}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:29:20.212270+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34382,"mds_1":34414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi134.cygfxr","rank":0,"incarnation":32,"state":"up:active","state_seq":21,"addr":"172.21.15.134:6827/845650190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":845650190},{"type":"v1","addr":"172.21.15.134:6827","nonce":845650190}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34414":{"gid":34414,"name":"cephfs.smithi134.jyajef","rank":1,"incarnation":32,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6829/3664331772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3664331772},{"type":"v1","addr":"172.21.15.134:6829","nonce":3664331772}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:30:57.432 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 36 2024-02-16T22:30:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.432+0000 7f422866e640 1 -- 172.21.15.134:0/1505886833 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f420c06d750 msgr2=0x7f420c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.432+0000 7f422866e640 1 --2- 172.21.15.134:0/1505886833 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f420c06d750 0x7f420c06fc00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4220064d50 tx=0x7f4210009ed0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.432+0000 7f422866e640 1 -- 172.21.15.134:0/1505886833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42201011a0 msgr2=0x7f422010dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.432+0000 7f422866e640 1 --2- 172.21.15.134:0/1505886833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42201011a0 0x7f422010dca0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f421c031720 tx=0x7f421c009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.432+0000 7f422866e640 1 -- 172.21.15.134:0/1505886833 shutdown_connections 2024-02-16T22:30:57.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.432+0000 7f422866e640 1 --2- 172.21.15.134:0/1505886833 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f420c06d750 0x7f420c06fc00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.432+0000 7f422866e640 1 --2- 172.21.15.134:0/1505886833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4220101b40 0x7f422010e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.432+0000 7f422866e640 1 --2- 172.21.15.134:0/1505886833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42201011a0 0x7f422010dca0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.432+0000 7f422866e640 1 -- 172.21.15.134:0/1505886833 >> 172.21.15.134:0/1505886833 conn(0x7f4220071290 msgr2=0x7f42200fa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:57.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.432+0000 7f422866e640 1 -- 172.21.15.134:0/1505886833 shutdown_connections 2024-02-16T22:30:57.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.432+0000 7f422866e640 1 -- 172.21.15.134:0/1505886833 wait complete. 2024-02-16T22:30:57.445 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 2, 'flags': 18} 2024-02-16T22:30:57.445 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-02-16T22:30:57.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:57 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/954879321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-16T22:30:57.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:57 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1787092907' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-16T22:30:57.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:57 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1149519569' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-16T22:30:57.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:57 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/909878037' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-16T22:30:57.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.542+0000 7f05abeae640 1 -- 172.21.15.134:0/2834404495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05a4101240 msgr2=0x7f05a4101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:57.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.542+0000 7f05abeae640 1 --2- 172.21.15.134:0/2834404495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05a4101240 0x7f05a4101610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f05940048d0 tx=0x7f0594009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.542+0000 7f05abeae640 1 -- 172.21.15.134:0/2834404495 shutdown_connections 2024-02-16T22:30:57.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.542+0000 7f05abeae640 1 --2- 172.21.15.134:0/2834404495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a4101be0 0x7f05a40fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.542+0000 7f05abeae640 1 --2- 172.21.15.134:0/2834404495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05a4101240 0x7f05a4101610 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.542+0000 7f05abeae640 1 -- 172.21.15.134:0/2834404495 >> 172.21.15.134:0/2834404495 conn(0x7f05a40f6e10 msgr2=0x7f05a40f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:57.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.542+0000 7f05abeae640 1 -- 172.21.15.134:0/2834404495 shutdown_connections 2024-02-16T22:30:57.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.542+0000 7f05abeae640 1 -- 172.21.15.134:0/2834404495 wait complete. 2024-02-16T22:30:57.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.542+0000 7f05abeae640 1 Processor -- start 2024-02-16T22:30:57.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.542+0000 7f05abeae640 1 -- start start 2024-02-16T22:30:57.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.542+0000 7f05abeae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a4101240 0x7f05a4111ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:57.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f05abeae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05a4101be0 0x7f05a4112000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:57.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f05abeae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a4112600 con 0x7f05a4101be0 2024-02-16T22:30:57.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f05abeae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a410bb90 con 0x7f05a4101240 2024-02-16T22:30:57.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f05a9449640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05a4101be0 0x7f05a4112000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:57.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f05a9449640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05a4101be0 0x7f05a4112000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38774/0 (socket says 172.21.15.134:38774) 2024-02-16T22:30:57.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f05a9449640 1 -- 172.21.15.134:0/2404048300 learned_addr learned my addr 172.21.15.134:0/2404048300 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:57.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f05a9c4a640 1 --2- 172.21.15.134:0/2404048300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a4101240 0x7f05a4111ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:57.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f05a9449640 1 -- 172.21.15.134:0/2404048300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a4101240 msgr2=0x7f05a4111ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:57.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f05a9449640 1 --2- 172.21.15.134:0/2404048300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a4101240 0x7f05a4111ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f05a9449640 1 -- 172.21.15.134:0/2404048300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0594005040 con 0x7f05a4101be0 2024-02-16T22:30:57.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f05a9449640 1 --2- 172.21.15.134:0/2404048300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05a4101be0 0x7f05a4112000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c830 tx=0x7f05a0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:57.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f059a7fc640 1 -- 172.21.15.134:0/2404048300 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05a000a850 con 0x7f05a4101be0 2024-02-16T22:30:57.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f05abeae640 1 -- 172.21.15.134:0/2404048300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a410be70 con 0x7f05a4101be0 2024-02-16T22:30:57.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f059a7fc640 1 -- 172.21.15.134:0/2404048300 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05a000ae80 con 0x7f05a4101be0 2024-02-16T22:30:57.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f059a7fc640 1 -- 172.21.15.134:0/2404048300 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05a0012ea0 con 0x7f05a4101be0 2024-02-16T22:30:57.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.543+0000 7f05abeae640 1 -- 172.21.15.134:0/2404048300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a410c390 con 0x7f05a4101be0 2024-02-16T22:30:57.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.544+0000 7f05abeae640 1 -- 172.21.15.134:0/2404048300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a4064480 con 0x7f05a4101be0 2024-02-16T22:30:57.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.545+0000 7f059a7fc640 1 -- 172.21.15.134:0/2404048300 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f05a0012400 con 0x7f05a4101be0 2024-02-16T22:30:57.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.545+0000 7f059a7fc640 1 --2- 172.21.15.134:0/2404048300 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f059006d750 0x7f059006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:57.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.545+0000 7f05a9c4a640 1 --2- 172.21.15.134:0/2404048300 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f059006d750 0x7f059006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:57.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.545+0000 7f059a7fc640 1 -- 172.21.15.134:0/2404048300 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f05a008d0f0 con 0x7f05a4101be0 2024-02-16T22:30:57.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.546+0000 7f05a9c4a640 1 --2- 172.21.15.134:0/2404048300 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f059006d750 0x7f059006fc00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0594000c00 tx=0x7f0594009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:57.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.550+0000 7f059a7fc640 1 -- 172.21.15.134:0/2404048300 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f05a0056960 con 0x7f05a4101be0 2024-02-16T22:30:57.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.758+0000 7f05abeae640 1 -- 172.21.15.134:0/2404048300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f05a4108380 con 0x7f05a4101be0 2024-02-16T22:30:57.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.759+0000 7f059a7fc640 1 -- 172.21.15.134:0/2404048300 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v36) v1 ==== 107+0+4850 (secure 0 0 0) 0x7f05a00126b0 con 0x7f05a4101be0 2024-02-16T22:30:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:30:57.761 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14488,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2804816044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2804816044},{"type":"v1","addr":"172.21.15.134:6827","nonce":2804816044}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24279,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.173:6827/3866528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3866528665},{"type":"v1","addr":"172.21.15.173:6827","nonce":3866528665}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:18:27.472086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi134.jyajef","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6829/3374248278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3374248278},{"type":"v1","addr":"172.21.15.134:6829","nonce":3374248278}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi173.qljqef","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6825/122132522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":122132522},{"type":"v1","addr":"172.21.15.173:6825","nonce":122132522}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:30:57.761 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 17 2024-02-16T22:30:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.761+0000 7f05abeae640 1 -- 172.21.15.134:0/2404048300 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f059006d750 msgr2=0x7f059006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.761+0000 7f05abeae640 1 --2- 172.21.15.134:0/2404048300 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f059006d750 0x7f059006fc00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0594000c00 tx=0x7f0594009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.761+0000 7f05abeae640 1 -- 172.21.15.134:0/2404048300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05a4101be0 msgr2=0x7f05a4112000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.761+0000 7f05abeae640 1 --2- 172.21.15.134:0/2404048300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05a4101be0 0x7f05a4112000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c830 tx=0x7f05a0004430 comp rx=0 tx=0).stop 2024-02-16T22:30:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.761+0000 7f05abeae640 1 -- 172.21.15.134:0/2404048300 shutdown_connections 2024-02-16T22:30:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.761+0000 7f05abeae640 1 --2- 172.21.15.134:0/2404048300 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f059006d750 0x7f059006fc00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.761+0000 7f05abeae640 1 --2- 172.21.15.134:0/2404048300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05a4101be0 0x7f05a4112000 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.761+0000 7f05abeae640 1 --2- 172.21.15.134:0/2404048300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a4101240 0x7f05a4111ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.761+0000 7f05abeae640 1 -- 172.21.15.134:0/2404048300 >> 172.21.15.134:0/2404048300 conn(0x7f05a40f6e10 msgr2=0x7f05a40f88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.761+0000 7f05abeae640 1 -- 172.21.15.134:0/2404048300 shutdown_connections 2024-02-16T22:30:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.761+0000 7f05abeae640 1 -- 172.21.15.134:0/2404048300 wait complete. 2024-02-16T22:30:57.774 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-02-16T22:30:57.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.872+0000 7f3ae555d640 1 -- 172.21.15.134:0/3144436604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00fb2b0 msgr2=0x7f3ae00fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:57.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.872+0000 7f3ae555d640 1 --2- 172.21.15.134:0/3144436604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00fb2b0 0x7f3ae00fb700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3ad40048d0 tx=0x7f3ad4009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.872+0000 7f3ae555d640 1 -- 172.21.15.134:0/3144436604 shutdown_connections 2024-02-16T22:30:57.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.872+0000 7f3ae555d640 1 --2- 172.21.15.134:0/3144436604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00fb2b0 0x7f3ae00fb700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.872+0000 7f3ae555d640 1 --2- 172.21.15.134:0/3144436604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ae01012d0 0x7f3ae01016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.872+0000 7f3ae555d640 1 -- 172.21.15.134:0/3144436604 >> 172.21.15.134:0/3144436604 conn(0x7f3ae0071230 msgr2=0x7f3ae0071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.873+0000 7f3ae555d640 1 -- 172.21.15.134:0/3144436604 shutdown_connections 2024-02-16T22:30:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.873+0000 7f3ae555d640 1 -- 172.21.15.134:0/3144436604 wait complete. 2024-02-16T22:30:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.873+0000 7f3ae555d640 1 Processor -- start 2024-02-16T22:30:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.873+0000 7f3ae555d640 1 -- start start 2024-02-16T22:30:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.873+0000 7f3ae555d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00fb2b0 0x7f3ae0112c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.873+0000 7f3ae555d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ae01012d0 0x7f3ae01131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.873+0000 7f3ae555d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae01137b0 con 0x7f3ae00fb2b0 2024-02-16T22:30:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.873+0000 7f3ae555d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae010cd40 con 0x7f3ae01012d0 2024-02-16T22:30:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.873+0000 7f3adeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00fb2b0 0x7f3ae0112c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.873+0000 7f3adeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00fb2b0 0x7f3ae0112c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38788/0 (socket says 172.21.15.134:38788) 2024-02-16T22:30:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.874+0000 7f3adeffd640 1 -- 172.21.15.134:0/3765922195 learned_addr learned my addr 172.21.15.134:0/3765922195 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:57.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.874+0000 7f3ade7fc640 1 --2- 172.21.15.134:0/3765922195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ae01012d0 0x7f3ae01131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:57.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.874+0000 7f3adeffd640 1 -- 172.21.15.134:0/3765922195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ae01012d0 msgr2=0x7f3ae01131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:57.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.874+0000 7f3adeffd640 1 --2- 172.21.15.134:0/3765922195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ae01012d0 0x7f3ae01131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:57.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.874+0000 7f3adeffd640 1 -- 172.21.15.134:0/3765922195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad4005040 con 0x7f3ae00fb2b0 2024-02-16T22:30:57.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.874+0000 7f3adeffd640 1 --2- 172.21.15.134:0/3765922195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00fb2b0 0x7f3ae0112c70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800db00 tx=0x7f3ad8004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:57.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.874+0000 7f3ac77fe640 1 -- 172.21.15.134:0/3765922195 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad8017070 con 0x7f3ae00fb2b0 2024-02-16T22:30:57.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.874+0000 7f3ac77fe640 1 -- 172.21.15.134:0/3765922195 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ad800f040 con 0x7f3ae00fb2b0 2024-02-16T22:30:57.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.874+0000 7f3ae555d640 1 -- 172.21.15.134:0/3765922195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae010d020 con 0x7f3ae00fb2b0 2024-02-16T22:30:57.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.874+0000 7f3ac77fe640 1 -- 172.21.15.134:0/3765922195 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad8003ae0 con 0x7f3ae00fb2b0 2024-02-16T22:30:57.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.874+0000 7f3ae555d640 1 -- 172.21.15.134:0/3765922195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae010d510 con 0x7f3ae00fb2b0 2024-02-16T22:30:57.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.875+0000 7f3ae555d640 1 -- 172.21.15.134:0/3765922195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae0064030 con 0x7f3ae00fb2b0 2024-02-16T22:30:57.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.876+0000 7f3ac77fe640 1 -- 172.21.15.134:0/3765922195 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f3ad8003c40 con 0x7f3ae00fb2b0 2024-02-16T22:30:57.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.876+0000 7f3ac77fe640 1 --2- 172.21.15.134:0/3765922195 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f3ac806d750 0x7f3ac806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:57.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.876+0000 7f3ac77fe640 1 -- 172.21.15.134:0/3765922195 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3ad808cfd0 con 0x7f3ae00fb2b0 2024-02-16T22:30:57.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.876+0000 7f3ade7fc640 1 --2- 172.21.15.134:0/3765922195 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f3ac806d750 0x7f3ac806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:57.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.876+0000 7f3ade7fc640 1 --2- 172.21.15.134:0/3765922195 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f3ac806d750 0x7f3ac806fc00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3ae010de80 tx=0x7f3ad4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:57.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:57.880+0000 7f3ac77fe640 1 -- 172.21.15.134:0/3765922195 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3ad80567c0 con 0x7f3ae00fb2b0 2024-02-16T22:30:58.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.090+0000 7f3ae555d640 1 -- 172.21.15.134:0/3765922195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f3ae010e3c0 con 0x7f3ae00fb2b0 2024-02-16T22:30:58.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.091+0000 7f3ac77fe640 1 -- 172.21.15.134:0/3765922195 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v36) v1 ==== 107+0+4851 (secure 0 0 0) 0x7f3ae010e3c0 con 0x7f3ae00fb2b0 2024-02-16T22:30:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:30:58.093 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14488,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2804816044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2804816044},{"type":"v1","addr":"172.21.15.134:6827","nonce":2804816044}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24279,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.173:6827/3866528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3866528665},{"type":"v1","addr":"172.21.15.173:6827","nonce":3866528665}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:19:04.001132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi134.jyajef","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6829/3374248278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3374248278},{"type":"v1","addr":"172.21.15.134:6829","nonce":3374248278}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi173.qljqef","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6825/122132522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":122132522},{"type":"v1","addr":"172.21.15.173:6825","nonce":122132522}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:30:58.093 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 18 2024-02-16T22:30:58.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.093+0000 7f3ae555d640 1 -- 172.21.15.134:0/3765922195 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f3ac806d750 msgr2=0x7f3ac806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:58.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.093+0000 7f3ae555d640 1 --2- 172.21.15.134:0/3765922195 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f3ac806d750 0x7f3ac806fc00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3ae010de80 tx=0x7f3ad4009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.093+0000 7f3ae555d640 1 -- 172.21.15.134:0/3765922195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00fb2b0 msgr2=0x7f3ae0112c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:58.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.093+0000 7f3ae555d640 1 --2- 172.21.15.134:0/3765922195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00fb2b0 0x7f3ae0112c70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800db00 tx=0x7f3ad8004e60 comp rx=0 tx=0).stop 2024-02-16T22:30:58.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.093+0000 7f3ae555d640 1 -- 172.21.15.134:0/3765922195 shutdown_connections 2024-02-16T22:30:58.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.093+0000 7f3ae555d640 1 --2- 172.21.15.134:0/3765922195 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f3ac806d750 0x7f3ac806fc00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.093+0000 7f3ae555d640 1 --2- 172.21.15.134:0/3765922195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ae01012d0 0x7f3ae01131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.093+0000 7f3ae555d640 1 --2- 172.21.15.134:0/3765922195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00fb2b0 0x7f3ae0112c70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.093+0000 7f3ae555d640 1 -- 172.21.15.134:0/3765922195 >> 172.21.15.134:0/3765922195 conn(0x7f3ae0071230 msgr2=0x7f3ae0064560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:58.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.093+0000 7f3ae555d640 1 -- 172.21.15.134:0/3765922195 shutdown_connections 2024-02-16T22:30:58.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.093+0000 7f3ae555d640 1 -- 172.21.15.134:0/3765922195 wait complete. 2024-02-16T22:30:58.106 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-02-16T22:30:58.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.204+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1701001122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d680700d0 msgr2=0x7f1d68108710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:58.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.204+0000 7f1d6e2ae640 1 --2- 172.21.15.134:0/1701001122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d680700d0 0x7f1d68108710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0048d0 tx=0x7f1d5c009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.204+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1701001122 shutdown_connections 2024-02-16T22:30:58.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.204+0000 7f1d6e2ae640 1 --2- 172.21.15.134:0/1701001122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d680700d0 0x7f1d68108710 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.204+0000 7f1d6e2ae640 1 --2- 172.21.15.134:0/1701001122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d6806f7c0 0x7f1d6806fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.204+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1701001122 >> 172.21.15.134:0/1701001122 conn(0x7f1d680f7ef0 msgr2=0x7f1d680fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:58.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.204+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1701001122 shutdown_connections 2024-02-16T22:30:58.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.204+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1701001122 wait complete. 2024-02-16T22:30:58.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.204+0000 7f1d6e2ae640 1 Processor -- start 2024-02-16T22:30:58.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.205+0000 7f1d6e2ae640 1 -- start start 2024-02-16T22:30:58.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.205+0000 7f1d6e2ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d6806f7c0 0x7f1d68114e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:58.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.205+0000 7f1d6e2ae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d680700d0 0x7f1d68115360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:58.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.205+0000 7f1d6e2ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68115960 con 0x7f1d6806f7c0 2024-02-16T22:30:58.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.205+0000 7f1d6e2ae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6810eef0 con 0x7f1d680700d0 2024-02-16T22:30:58.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.205+0000 7f1d67fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d6806f7c0 0x7f1d68114e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:58.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.205+0000 7f1d67fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d6806f7c0 0x7f1d68114e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38804/0 (socket says 172.21.15.134:38804) 2024-02-16T22:30:58.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.205+0000 7f1d67fff640 1 -- 172.21.15.134:0/1237180484 learned_addr learned my addr 172.21.15.134:0/1237180484 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:58.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.205+0000 7f1d677fe640 1 --2- 172.21.15.134:0/1237180484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d680700d0 0x7f1d68115360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:58.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.205+0000 7f1d67fff640 1 -- 172.21.15.134:0/1237180484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d680700d0 msgr2=0x7f1d68115360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:58.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.205+0000 7f1d67fff640 1 --2- 172.21.15.134:0/1237180484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d680700d0 0x7f1d68115360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.205+0000 7f1d67fff640 1 -- 172.21.15.134:0/1237180484 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5c005040 con 0x7f1d6806f7c0 2024-02-16T22:30:58.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.205+0000 7f1d67fff640 1 --2- 172.21.15.134:0/1237180484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d6806f7c0 0x7f1d68114e20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1d58002a50 tx=0x7f1d58004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:58.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.205+0000 7f1d64ff9640 1 -- 172.21.15.134:0/1237180484 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d58007c30 con 0x7f1d6806f7c0 2024-02-16T22:30:58.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.206+0000 7f1d64ff9640 1 -- 172.21.15.134:0/1237180484 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d5800f040 con 0x7f1d6806f7c0 2024-02-16T22:30:58.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.206+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1237180484 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6810f1d0 con 0x7f1d6806f7c0 2024-02-16T22:30:58.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.206+0000 7f1d64ff9640 1 -- 172.21.15.134:0/1237180484 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d5800db50 con 0x7f1d6806f7c0 2024-02-16T22:30:58.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.206+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1237180484 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6810f6c0 con 0x7f1d6806f7c0 2024-02-16T22:30:58.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.207+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1237180484 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d68064480 con 0x7f1d6806f7c0 2024-02-16T22:30:58.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.207+0000 7f1d64ff9640 1 -- 172.21.15.134:0/1237180484 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f1d5801c400 con 0x7f1d6806f7c0 2024-02-16T22:30:58.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.207+0000 7f1d64ff9640 1 --2- 172.21.15.134:0/1237180484 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1d5006d750 0x7f1d5006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:58.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.208+0000 7f1d677fe640 1 --2- 172.21.15.134:0/1237180484 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1d5006d750 0x7f1d5006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:58.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.208+0000 7f1d64ff9640 1 -- 172.21.15.134:0/1237180484 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f1d5808c810 con 0x7f1d6806f7c0 2024-02-16T22:30:58.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.208+0000 7f1d677fe640 1 --2- 172.21.15.134:0/1237180484 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1d5006d750 0x7f1d5006fc00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1d68110030 tx=0x7f1d5c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:58.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.212+0000 7f1d64ff9640 1 -- 172.21.15.134:0/1237180484 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1d58056000 con 0x7f1d6806f7c0 2024-02-16T22:30:58.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.421+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1237180484 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f1d68110420 con 0x7f1d6806f7c0 2024-02-16T22:30:58.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.421+0000 7f1d64ff9640 1 -- 172.21.15.134:0/1237180484 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v36) v1 ==== 107+0+4850 (secure 0 0 0) 0x7f1d580596c0 con 0x7f1d6806f7c0 2024-02-16T22:30:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:30:58.423 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14488,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2804816044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2804816044},{"type":"v1","addr":"172.21.15.134:6827","nonce":2804816044}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24279,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.173:6827/3866528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3866528665},{"type":"v1","addr":"172.21.15.173:6827","nonce":3866528665}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:23:05.200331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi134.jyajef","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6829/3374248278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3374248278},{"type":"v1","addr":"172.21.15.134:6829","nonce":3374248278}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi173.qljqef","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6825/122132522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":122132522},{"type":"v1","addr":"172.21.15.173:6825","nonce":122132522}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:30:58.423 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 19 2024-02-16T22:30:58.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.423+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1237180484 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1d5006d750 msgr2=0x7f1d5006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:58.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.423+0000 7f1d6e2ae640 1 --2- 172.21.15.134:0/1237180484 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1d5006d750 0x7f1d5006fc00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1d68110030 tx=0x7f1d5c009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.423+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1237180484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d6806f7c0 msgr2=0x7f1d68114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:58.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.423+0000 7f1d6e2ae640 1 --2- 172.21.15.134:0/1237180484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d6806f7c0 0x7f1d68114e20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1d58002a50 tx=0x7f1d58004600 comp rx=0 tx=0).stop 2024-02-16T22:30:58.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.423+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1237180484 shutdown_connections 2024-02-16T22:30:58.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.423+0000 7f1d6e2ae640 1 --2- 172.21.15.134:0/1237180484 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1d5006d750 0x7f1d5006fc00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.423+0000 7f1d6e2ae640 1 --2- 172.21.15.134:0/1237180484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d680700d0 0x7f1d68115360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.423+0000 7f1d6e2ae640 1 --2- 172.21.15.134:0/1237180484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d6806f7c0 0x7f1d68114e20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.423+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1237180484 >> 172.21.15.134:0/1237180484 conn(0x7f1d680f7ef0 msgr2=0x7f1d68102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:58.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.423+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1237180484 shutdown_connections 2024-02-16T22:30:58.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.423+0000 7f1d6e2ae640 1 -- 172.21.15.134:0/1237180484 wait complete. 2024-02-16T22:30:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:58 smithi134 ceph-mon[112514]: pgmap v259: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:58 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1505886833' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-16T22:30:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:58 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2404048300' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-16T22:30:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:58 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/3765922195' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-16T22:30:58.438 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-02-16T22:30:58.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:58 smithi173 ceph-mon[83703]: pgmap v259: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:58.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:58 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1505886833' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-16T22:30:58.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:58 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2404048300' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-16T22:30:58.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:58 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/3765922195' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-16T22:30:58.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.535+0000 7fc77a02e640 1 -- 172.21.15.134:0/777652799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7741023f0 msgr2=0x7fc7741027c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:58.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.535+0000 7fc77a02e640 1 --2- 172.21.15.134:0/777652799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7741023f0 0x7fc7741027c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc7640048d0 tx=0x7fc764009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.535+0000 7fc77a02e640 1 -- 172.21.15.134:0/777652799 shutdown_connections 2024-02-16T22:30:58.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.535+0000 7fc77a02e640 1 --2- 172.21.15.134:0/777652799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7740faa60 0x7fc7740faed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.535+0000 7fc77a02e640 1 --2- 172.21.15.134:0/777652799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7741023f0 0x7fc7741027c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.535+0000 7fc77a02e640 1 -- 172.21.15.134:0/777652799 >> 172.21.15.134:0/777652799 conn(0x7fc774071880 msgr2=0x7fc774071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:58.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.535+0000 7fc77a02e640 1 -- 172.21.15.134:0/777652799 shutdown_connections 2024-02-16T22:30:58.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.535+0000 7fc77a02e640 1 -- 172.21.15.134:0/777652799 wait complete. 2024-02-16T22:30:58.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.535+0000 7fc77a02e640 1 Processor -- start 2024-02-16T22:30:58.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.535+0000 7fc77a02e640 1 -- start start 2024-02-16T22:30:58.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.536+0000 7fc77a02e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7740faa60 0x7fc774112c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:58.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.536+0000 7fc77a02e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7741023f0 0x7fc774113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:58.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.536+0000 7fc77a02e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc774113770 con 0x7fc7740faa60 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.536+0000 7fc77a02e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77410cd00 con 0x7fc7741023f0 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.536+0000 7fc7737fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7740faa60 0x7fc774112c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.536+0000 7fc7737fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7740faa60 0x7fc774112c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38824/0 (socket says 172.21.15.134:38824) 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.536+0000 7fc7737fe640 1 -- 172.21.15.134:0/977163389 learned_addr learned my addr 172.21.15.134:0/977163389 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.536+0000 7fc772ffd640 1 --2- 172.21.15.134:0/977163389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7741023f0 0x7fc774113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.536+0000 7fc7737fe640 1 -- 172.21.15.134:0/977163389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7741023f0 msgr2=0x7fc774113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.536+0000 7fc7737fe640 1 --2- 172.21.15.134:0/977163389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7741023f0 0x7fc774113170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.536+0000 7fc7737fe640 1 -- 172.21.15.134:0/977163389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764005040 con 0x7fc7740faa60 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.536+0000 7fc7737fe640 1 --2- 172.21.15.134:0/977163389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7740faa60 0x7fc774112c30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc764031720 tx=0x7fc764009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.537+0000 7fc75bfff640 1 -- 172.21.15.134:0/977163389 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7640094c0 con 0x7fc7740faa60 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.537+0000 7fc77a02e640 1 -- 172.21.15.134:0/977163389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77410cf80 con 0x7fc7740faa60 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.537+0000 7fc75bfff640 1 -- 172.21.15.134:0/977163389 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc764009620 con 0x7fc7740faa60 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.537+0000 7fc75bfff640 1 -- 172.21.15.134:0/977163389 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc76403b640 con 0x7fc7740faa60 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.537+0000 7fc77a02e640 1 -- 172.21.15.134:0/977163389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77410d4a0 con 0x7fc7740faa60 2024-02-16T22:30:58.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.537+0000 7fc77a02e640 1 -- 172.21.15.134:0/977163389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc774064480 con 0x7fc7740faa60 2024-02-16T22:30:58.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.538+0000 7fc75bfff640 1 -- 172.21.15.134:0/977163389 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fc76402f070 con 0x7fc7740faa60 2024-02-16T22:30:58.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.538+0000 7fc75bfff640 1 --2- 172.21.15.134:0/977163389 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc75c06d750 0x7fc75c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:58.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.538+0000 7fc75bfff640 1 -- 172.21.15.134:0/977163389 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc7640af330 con 0x7fc7740faa60 2024-02-16T22:30:58.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.538+0000 7fc772ffd640 1 --2- 172.21.15.134:0/977163389 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc75c06d750 0x7fc75c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:58.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.539+0000 7fc772ffd640 1 --2- 172.21.15.134:0/977163389 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc75c06d750 0x7fc75c06fc00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc77410e4f0 tx=0x7fc768004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:58.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.543+0000 7fc75bfff640 1 -- 172.21.15.134:0/977163389 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc764078ba0 con 0x7fc7740faa60 2024-02-16T22:30:58.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.754+0000 7fc77a02e640 1 -- 172.21.15.134:0/977163389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fc77410e350 con 0x7fc7740faa60 2024-02-16T22:30:58.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.755+0000 7fc75bfff640 1 -- 172.21.15.134:0/977163389 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v36) v1 ==== 107+0+4849 (secure 0 0 0) 0x7fc77410e350 con 0x7fc7740faa60 2024-02-16T22:30:58.756 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:30:58.756 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14488,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2804816044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2804816044},{"type":"v1","addr":"172.21.15.134:6827","nonce":2804816044}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24279,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.173:6827/3866528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3866528665},{"type":"v1","addr":"172.21.15.173:6827","nonce":3866528665}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:23:22.543229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi134.jyajef","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6829/3374248278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3374248278},{"type":"v1","addr":"172.21.15.134:6829","nonce":3374248278}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi173.qljqef","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6825/122132522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":122132522},{"type":"v1","addr":"172.21.15.173:6825","nonce":122132522}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:30:58.757 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 20 2024-02-16T22:30:58.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.757+0000 7fc77a02e640 1 -- 172.21.15.134:0/977163389 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc75c06d750 msgr2=0x7fc75c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:58.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.757+0000 7fc77a02e640 1 --2- 172.21.15.134:0/977163389 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc75c06d750 0x7fc75c06fc00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc77410e4f0 tx=0x7fc768004330 comp rx=0 tx=0).stop 2024-02-16T22:30:58.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.757+0000 7fc77a02e640 1 -- 172.21.15.134:0/977163389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7740faa60 msgr2=0x7fc774112c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:58.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.757+0000 7fc77a02e640 1 --2- 172.21.15.134:0/977163389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7740faa60 0x7fc774112c30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc764031720 tx=0x7fc764009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.757+0000 7fc77a02e640 1 -- 172.21.15.134:0/977163389 shutdown_connections 2024-02-16T22:30:58.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.757+0000 7fc77a02e640 1 --2- 172.21.15.134:0/977163389 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fc75c06d750 0x7fc75c06fc00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.757+0000 7fc77a02e640 1 --2- 172.21.15.134:0/977163389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7741023f0 0x7fc774113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.757+0000 7fc77a02e640 1 --2- 172.21.15.134:0/977163389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7740faa60 0x7fc774112c30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.757+0000 7fc77a02e640 1 -- 172.21.15.134:0/977163389 >> 172.21.15.134:0/977163389 conn(0x7fc774071880 msgr2=0x7fc7740f9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:58.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.757+0000 7fc77a02e640 1 -- 172.21.15.134:0/977163389 shutdown_connections 2024-02-16T22:30:58.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.757+0000 7fc77a02e640 1 -- 172.21.15.134:0/977163389 wait complete. 2024-02-16T22:30:58.769 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-02-16T22:30:58.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.866+0000 7f04118ae640 1 -- 172.21.15.134:0/3756262392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f040c101be0 msgr2=0x7f040c0fb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:58.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.866+0000 7f04118ae640 1 --2- 172.21.15.134:0/3756262392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f040c101be0 0x7f040c0fb270 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f04000048d0 tx=0x7f0400009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.866+0000 7f04118ae640 1 -- 172.21.15.134:0/3756262392 shutdown_connections 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.866+0000 7f04118ae640 1 --2- 172.21.15.134:0/3756262392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f040c101be0 0x7f040c0fb270 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.866+0000 7f04118ae640 1 --2- 172.21.15.134:0/3756262392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f040c101240 0x7f040c101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.866+0000 7f04118ae640 1 -- 172.21.15.134:0/3756262392 >> 172.21.15.134:0/3756262392 conn(0x7f040c0f6e10 msgr2=0x7f040c0f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.866+0000 7f04118ae640 1 -- 172.21.15.134:0/3756262392 shutdown_connections 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.866+0000 7f04118ae640 1 -- 172.21.15.134:0/3756262392 wait complete. 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.867+0000 7f04118ae640 1 Processor -- start 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.867+0000 7f04118ae640 1 -- start start 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.867+0000 7f04118ae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f040c101240 0x7f040c10dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.867+0000 7f04118ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f040c101be0 0x7f040c10e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.867+0000 7f04118ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c10e7b0 con 0x7f040c101be0 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.867+0000 7f04118ae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c10e920 con 0x7f040c101240 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.867+0000 7f040a7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f040c101be0 0x7f040c10e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.867+0000 7f040a7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f040c101be0 0x7f040c10e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38848/0 (socket says 172.21.15.134:38848) 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.867+0000 7f040a7fc640 1 -- 172.21.15.134:0/3483575762 learned_addr learned my addr 172.21.15.134:0/3483575762 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:58.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.868+0000 7f040affd640 1 --2- 172.21.15.134:0/3483575762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f040c101240 0x7f040c10dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:58.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.868+0000 7f040a7fc640 1 -- 172.21.15.134:0/3483575762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f040c101240 msgr2=0x7f040c10dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:58.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.868+0000 7f040a7fc640 1 --2- 172.21.15.134:0/3483575762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f040c101240 0x7f040c10dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:58.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.868+0000 7f040a7fc640 1 -- 172.21.15.134:0/3483575762 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400005040 con 0x7f040c101be0 2024-02-16T22:30:58.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.868+0000 7f040a7fc640 1 --2- 172.21.15.134:0/3483575762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f040c101be0 0x7f040c10e270 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0400031720 tx=0x7f0400009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:58.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.868+0000 7f03f37fe640 1 -- 172.21.15.134:0/3483575762 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04000094c0 con 0x7f040c101be0 2024-02-16T22:30:58.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.868+0000 7f03f37fe640 1 -- 172.21.15.134:0/3483575762 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0400009620 con 0x7f040c101be0 2024-02-16T22:30:58.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.868+0000 7f04118ae640 1 -- 172.21.15.134:0/3483575762 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040c10eba0 con 0x7f040c101be0 2024-02-16T22:30:58.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.868+0000 7f03f37fe640 1 -- 172.21.15.134:0/3483575762 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f040003b640 con 0x7f040c101be0 2024-02-16T22:30:58.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.868+0000 7f04118ae640 1 -- 172.21.15.134:0/3483575762 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040c1170a0 con 0x7f040c101be0 2024-02-16T22:30:58.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.869+0000 7f04118ae640 1 -- 172.21.15.134:0/3483575762 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040c064480 con 0x7f040c101be0 2024-02-16T22:30:58.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.869+0000 7f03f37fe640 1 -- 172.21.15.134:0/3483575762 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f040002f070 con 0x7f040c101be0 2024-02-16T22:30:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.870+0000 7f03f37fe640 1 --2- 172.21.15.134:0/3483575762 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f03f406d750 0x7f03f406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.870+0000 7f040affd640 1 --2- 172.21.15.134:0/3483575762 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f03f406d750 0x7f03f406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.870+0000 7f03f37fe640 1 -- 172.21.15.134:0/3483575762 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f04000af270 con 0x7f040c101be0 2024-02-16T22:30:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.870+0000 7f040affd640 1 --2- 172.21.15.134:0/3483575762 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f03f406d750 0x7f03f406fc00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f03fc007fa0 tx=0x7f03fc004c70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:58.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:58.875+0000 7f03f37fe640 1 -- 172.21.15.134:0/3483575762 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0400078a60 con 0x7f040c101be0 2024-02-16T22:30:59.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.083+0000 7f04118ae640 1 -- 172.21.15.134:0/3483575762 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f040c1083a0 con 0x7f040c101be0 2024-02-16T22:30:59.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.084+0000 7f03f37fe640 1 -- 172.21.15.134:0/3483575762 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v36) v1 ==== 107+0+3267 (secure 0 0 0) 0x7f0400036ce0 con 0x7f040c101be0 2024-02-16T22:30:59.086 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:30:59.086 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14488,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2804816044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2804816044},{"type":"v1","addr":"172.21.15.134:6827","nonce":2804816044}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24279,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.173:6827/3866528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3866528665},{"type":"v1","addr":"172.21.15.173:6827","nonce":3866528665}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:28:03.434248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:30:59.086 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 21 2024-02-16T22:30:59.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.086+0000 7f04118ae640 1 -- 172.21.15.134:0/3483575762 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f03f406d750 msgr2=0x7f03f406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:59.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.086+0000 7f04118ae640 1 --2- 172.21.15.134:0/3483575762 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f03f406d750 0x7f03f406fc00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f03fc007fa0 tx=0x7f03fc004c70 comp rx=0 tx=0).stop 2024-02-16T22:30:59.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.086+0000 7f04118ae640 1 -- 172.21.15.134:0/3483575762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f040c101be0 msgr2=0x7f040c10e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:59.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.086+0000 7f04118ae640 1 --2- 172.21.15.134:0/3483575762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f040c101be0 0x7f040c10e270 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0400031720 tx=0x7f0400009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.086+0000 7f04118ae640 1 -- 172.21.15.134:0/3483575762 shutdown_connections 2024-02-16T22:30:59.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.086+0000 7f04118ae640 1 --2- 172.21.15.134:0/3483575762 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f03f406d750 0x7f03f406fc00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.086+0000 7f04118ae640 1 --2- 172.21.15.134:0/3483575762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f040c101be0 0x7f040c10e270 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.086+0000 7f04118ae640 1 --2- 172.21.15.134:0/3483575762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f040c101240 0x7f040c10dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.086+0000 7f04118ae640 1 -- 172.21.15.134:0/3483575762 >> 172.21.15.134:0/3483575762 conn(0x7f040c0f6e10 msgr2=0x7f040c0f8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:59.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.086+0000 7f04118ae640 1 -- 172.21.15.134:0/3483575762 shutdown_connections 2024-02-16T22:30:59.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.086+0000 7f04118ae640 1 -- 172.21.15.134:0/3483575762 wait complete. 2024-02-16T22:30:59.099 DEBUG:tasks.fs:max_mds not reduced in epoch 21 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-16T22:30:59.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-02-16T22:30:59.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.197+0000 7f4f5879d640 1 -- 172.21.15.134:0/512972667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50102d00 msgr2=0x7f4f500fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:59.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.197+0000 7f4f5879d640 1 --2- 172.21.15.134:0/512972667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50102d00 0x7f4f500fc390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4f400048d0 tx=0x7f4f40009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.197+0000 7f4f5879d640 1 -- 172.21.15.134:0/512972667 shutdown_connections 2024-02-16T22:30:59.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.197+0000 7f4f5879d640 1 --2- 172.21.15.134:0/512972667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50102d00 0x7f4f500fc390 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.197+0000 7f4f5879d640 1 --2- 172.21.15.134:0/512972667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f50102360 0x7f4f50102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.197+0000 7f4f5879d640 1 -- 172.21.15.134:0/512972667 >> 172.21.15.134:0/512972667 conn(0x7f4f500f7ef0 msgr2=0x7f4f500fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:59.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.197+0000 7f4f5879d640 1 -- 172.21.15.134:0/512972667 shutdown_connections 2024-02-16T22:30:59.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.197+0000 7f4f5879d640 1 -- 172.21.15.134:0/512972667 wait complete. 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.197+0000 7f4f5879d640 1 Processor -- start 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f5879d640 1 -- start start 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f5879d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50102360 0x7f4f50112ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f5879d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f50102d00 0x7f4f501131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f5879d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f50113870 con 0x7f4f50102360 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f5879d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5010cdb0 con 0x7f4f50102d00 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f56539640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50102360 0x7f4f50112ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f56539640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50102360 0x7f4f50112ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38864/0 (socket says 172.21.15.134:38864) 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f56539640 1 -- 172.21.15.134:0/3227477448 learned_addr learned my addr 172.21.15.134:0/3227477448 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f56539640 1 -- 172.21.15.134:0/3227477448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f50102d00 msgr2=0x7f4f501131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f56539640 1 --2- 172.21.15.134:0/3227477448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f50102d00 0x7f4f501131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f56539640 1 -- 172.21.15.134:0/3227477448 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f40005040 con 0x7f4f50102360 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f56539640 1 --2- 172.21.15.134:0/3227477448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50102360 0x7f4f50112ca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00b790 tx=0x7f4f4c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f46ffd640 1 -- 172.21.15.134:0/3227477448 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f4c00c700 con 0x7f4f50102360 2024-02-16T22:30:59.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f46ffd640 1 -- 172.21.15.134:0/3227477448 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f4c00cd30 con 0x7f4f50102360 2024-02-16T22:30:59.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f5879d640 1 -- 172.21.15.134:0/3227477448 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5010d090 con 0x7f4f50102360 2024-02-16T22:30:59.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f46ffd640 1 -- 172.21.15.134:0/3227477448 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f4c013370 con 0x7f4f50102360 2024-02-16T22:30:59.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.198+0000 7f4f5879d640 1 -- 172.21.15.134:0/3227477448 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5010d5b0 con 0x7f4f50102360 2024-02-16T22:30:59.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.199+0000 7f4f5879d640 1 -- 172.21.15.134:0/3227477448 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f50064480 con 0x7f4f50102360 2024-02-16T22:30:59.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.200+0000 7f4f46ffd640 1 -- 172.21.15.134:0/3227477448 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f4f4c012070 con 0x7f4f50102360 2024-02-16T22:30:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.200+0000 7f4f46ffd640 1 --2- 172.21.15.134:0/3227477448 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4f3c06d750 0x7f4f3c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.200+0000 7f4f46ffd640 1 -- 172.21.15.134:0/3227477448 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4f4c08cb80 con 0x7f4f50102360 2024-02-16T22:30:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.200+0000 7f4f55d38640 1 --2- 172.21.15.134:0/3227477448 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4f3c06d750 0x7f4f3c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.201+0000 7f4f55d38640 1 --2- 172.21.15.134:0/3227477448 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4f3c06d750 0x7f4f3c06fc00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009040 tx=0x7f4f40009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:59.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.205+0000 7f4f46ffd640 1 -- 172.21.15.134:0/3227477448 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4f4c056370 con 0x7f4f50102360 2024-02-16T22:30:59.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.416+0000 7f4f5879d640 1 -- 172.21.15.134:0/3227477448 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f4f50109520 con 0x7f4f50102360 2024-02-16T22:30:59.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.417+0000 7f4f46ffd640 1 -- 172.21.15.134:0/3227477448 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v36) v1 ==== 107+0+4831 (secure 0 0 0) 0x7f4f4c059a30 con 0x7f4f50102360 2024-02-16T22:30:59.419 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:30:59.419 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14488,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2804816044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2804816044},{"type":"v1","addr":"172.21.15.134:6827","nonce":2804816044}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24279,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.173:6827/3866528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3866528665},{"type":"v1","addr":"172.21.15.173:6827","nonce":3866528665}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi134.jyajef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3228039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3228039321},{"type":"v1","addr":"172.21.15.134:6829","nonce":3228039321}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":44269,"name":"cephfs.smithi173.qljqef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6825/1069817513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1069817513},{"type":"v1","addr":"172.21.15.173:6825","nonce":1069817513}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:28:03.434248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:30:59.419 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-02-16T22:30:59.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.419+0000 7f4f5879d640 1 -- 172.21.15.134:0/3227477448 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4f3c06d750 msgr2=0x7f4f3c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:59.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.419+0000 7f4f5879d640 1 --2- 172.21.15.134:0/3227477448 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4f3c06d750 0x7f4f3c06fc00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009040 tx=0x7f4f40009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.419+0000 7f4f5879d640 1 -- 172.21.15.134:0/3227477448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50102360 msgr2=0x7f4f50112ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:59.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.419+0000 7f4f5879d640 1 --2- 172.21.15.134:0/3227477448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50102360 0x7f4f50112ca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00b790 tx=0x7f4f4c0091d0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.419+0000 7f4f5879d640 1 -- 172.21.15.134:0/3227477448 shutdown_connections 2024-02-16T22:30:59.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.419+0000 7f4f5879d640 1 --2- 172.21.15.134:0/3227477448 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4f3c06d750 0x7f4f3c06fc00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.419+0000 7f4f5879d640 1 --2- 172.21.15.134:0/3227477448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f50102d00 0x7f4f501131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.419+0000 7f4f5879d640 1 --2- 172.21.15.134:0/3227477448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50102360 0x7f4f50112ca0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.419+0000 7f4f5879d640 1 -- 172.21.15.134:0/3227477448 >> 172.21.15.134:0/3227477448 conn(0x7f4f500f7ef0 msgr2=0x7f4f500f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:59.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.419+0000 7f4f5879d640 1 -- 172.21.15.134:0/3227477448 shutdown_connections 2024-02-16T22:30:59.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.419+0000 7f4f5879d640 1 -- 172.21.15.134:0/3227477448 wait complete. 2024-02-16T22:30:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:59 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1237180484' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-16T22:30:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:59 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/977163389' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-16T22:30:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:59 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/3483575762' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-16T22:30:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:30:59 smithi134 ceph-mon[112514]: pgmap v260: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:59.432 DEBUG:tasks.fs:max_mds not reduced in epoch 22 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-16T22:30:59.432 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-02-16T22:30:59.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:59 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1237180484' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-16T22:30:59.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:59 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/977163389' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-16T22:30:59.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:59 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/3483575762' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-16T22:30:59.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:30:59 smithi173 ceph-mon[83703]: pgmap v260: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:30:59.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.528+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/1535540126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc58101bf0 msgr2=0x7fbc580fb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:59.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.528+0000 7fbc5ff5d640 1 --2- 172.21.15.134:0/1535540126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc58101bf0 0x7fbc580fb280 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc540048d0 tx=0x7fbc54009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.528+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/1535540126 shutdown_connections 2024-02-16T22:30:59.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.528+0000 7fbc5ff5d640 1 --2- 172.21.15.134:0/1535540126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc58101bf0 0x7fbc580fb280 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.528+0000 7fbc5ff5d640 1 --2- 172.21.15.134:0/1535540126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc58101250 0x7fbc58101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.528+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/1535540126 >> 172.21.15.134:0/1535540126 conn(0x7fbc580f6e00 msgr2=0x7fbc580f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:59.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.528+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/1535540126 shutdown_connections 2024-02-16T22:30:59.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.528+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/1535540126 wait complete. 2024-02-16T22:30:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5ff5d640 1 Processor -- start 2024-02-16T22:30:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5ff5d640 1 -- start start 2024-02-16T22:30:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5ff5d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc58101250 0x7fbc58111aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5ff5d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc58101bf0 0x7fbc58111fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5ff5d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc581125e0 con 0x7fbc58101bf0 2024-02-16T22:30:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5ff5d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5810bb70 con 0x7fbc58101250 2024-02-16T22:30:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5d4f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc58101bf0 0x7fbc58111fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5d4f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc58101bf0 0x7fbc58111fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38892/0 (socket says 172.21.15.134:38892) 2024-02-16T22:30:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5d4f8640 1 -- 172.21.15.134:0/2444741075 learned_addr learned my addr 172.21.15.134:0/2444741075 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5dcf9640 1 --2- 172.21.15.134:0/2444741075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc58101250 0x7fbc58111aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5d4f8640 1 -- 172.21.15.134:0/2444741075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc58101250 msgr2=0x7fbc58111aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5d4f8640 1 --2- 172.21.15.134:0/2444741075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc58101250 0x7fbc58111aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5d4f8640 1 -- 172.21.15.134:0/2444741075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc54005040 con 0x7fbc58101bf0 2024-02-16T22:30:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5d4f8640 1 --2- 172.21.15.134:0/2444741075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc58101bf0 0x7fbc58111fe0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbc5402bda0 tx=0x7fbc54009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:59.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc4e7fc640 1 -- 172.21.15.134:0/2444741075 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc540092e0 con 0x7fbc58101bf0 2024-02-16T22:30:59.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc4e7fc640 1 -- 172.21.15.134:0/2444741075 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc5403d450 con 0x7fbc58101bf0 2024-02-16T22:30:59.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.529+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/2444741075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5810bdf0 con 0x7fbc58101bf0 2024-02-16T22:30:59.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.530+0000 7fbc4e7fc640 1 -- 172.21.15.134:0/2444741075 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc5403b640 con 0x7fbc58101bf0 2024-02-16T22:30:59.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.530+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/2444741075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5810c310 con 0x7fbc58101bf0 2024-02-16T22:30:59.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.530+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/2444741075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc58064480 con 0x7fbc58101bf0 2024-02-16T22:30:59.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.531+0000 7fbc4e7fc640 1 -- 172.21.15.134:0/2444741075 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fbc5402f070 con 0x7fbc58101bf0 2024-02-16T22:30:59.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.531+0000 7fbc4e7fc640 1 --2- 172.21.15.134:0/2444741075 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fbc4406d750 0x7fbc4406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:59.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.531+0000 7fbc4e7fc640 1 -- 172.21.15.134:0/2444741075 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fbc540af290 con 0x7fbc58101bf0 2024-02-16T22:30:59.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.531+0000 7fbc5dcf9640 1 --2- 172.21.15.134:0/2444741075 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fbc4406d750 0x7fbc4406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:59.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.532+0000 7fbc5dcf9640 1 --2- 172.21.15.134:0/2444741075 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fbc4406d750 0x7fbc4406fc00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009af0 tx=0x7fbc4800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:59.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.536+0000 7fbc4e7fc640 1 -- 172.21.15.134:0/2444741075 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbc54078a80 con 0x7fbc58101bf0 2024-02-16T22:30:59.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.744+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/2444741075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fbc5810c4a0 con 0x7fbc58101bf0 2024-02-16T22:30:59.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.745+0000 7fbc4e7fc640 1 -- 172.21.15.134:0/2444741075 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v36) v1 ==== 107+0+4049 (secure 0 0 0) 0x7fbc5407c140 con 0x7fbc58101bf0 2024-02-16T22:30:59.747 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:30:59.747 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24279,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.173:6827/3866528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3866528665},{"type":"v1","addr":"172.21.15.173:6827","nonce":3866528665}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi134.jyajef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3228039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3228039321},{"type":"v1","addr":"172.21.15.134:6829","nonce":3228039321}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":44269,"name":"cephfs.smithi173.qljqef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6825/1069817513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1069817513},{"type":"v1","addr":"172.21.15.173:6825","nonce":1069817513}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:28:03.434248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:30:59.747 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 23 2024-02-16T22:30:59.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.746+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/2444741075 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fbc4406d750 msgr2=0x7fbc4406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:59.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.746+0000 7fbc5ff5d640 1 --2- 172.21.15.134:0/2444741075 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fbc4406d750 0x7fbc4406fc00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009af0 tx=0x7fbc4800b040 comp rx=0 tx=0).stop 2024-02-16T22:30:59.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.746+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/2444741075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc58101bf0 msgr2=0x7fbc58111fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:59.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.746+0000 7fbc5ff5d640 1 --2- 172.21.15.134:0/2444741075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc58101bf0 0x7fbc58111fe0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbc5402bda0 tx=0x7fbc54009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.747+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/2444741075 shutdown_connections 2024-02-16T22:30:59.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.747+0000 7fbc5ff5d640 1 --2- 172.21.15.134:0/2444741075 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fbc4406d750 0x7fbc4406fc00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.747+0000 7fbc5ff5d640 1 --2- 172.21.15.134:0/2444741075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc58101bf0 0x7fbc58111fe0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.747+0000 7fbc5ff5d640 1 --2- 172.21.15.134:0/2444741075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc58101250 0x7fbc58111aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.747+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/2444741075 >> 172.21.15.134:0/2444741075 conn(0x7fbc580f6e00 msgr2=0x7fbc580f88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:59.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.747+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/2444741075 shutdown_connections 2024-02-16T22:30:59.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.747+0000 7fbc5ff5d640 1 -- 172.21.15.134:0/2444741075 wait complete. 2024-02-16T22:30:59.759 DEBUG:tasks.fs:max_mds not reduced in epoch 23 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-16T22:30:59.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-02-16T22:30:59.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.856+0000 7fb66bf9d640 1 -- 172.21.15.134:0/4150248217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6640fb150 msgr2=0x7fb6640fb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:59.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.856+0000 7fb66bf9d640 1 --2- 172.21.15.134:0/4150248217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6640fb150 0x7fb6640fb520 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0048d0 tx=0x7fb65c009da0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.856+0000 7fb66bf9d640 1 -- 172.21.15.134:0/4150248217 shutdown_connections 2024-02-16T22:30:59.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.856+0000 7fb66bf9d640 1 --2- 172.21.15.134:0/4150248217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6640fbaf0 0x7fb664100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.856+0000 7fb66bf9d640 1 --2- 172.21.15.134:0/4150248217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6640fb150 0x7fb6640fb520 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.856+0000 7fb66bf9d640 1 -- 172.21.15.134:0/4150248217 >> 172.21.15.134:0/4150248217 conn(0x7fb6640f6e10 msgr2=0x7fb6640f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:30:59.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.856+0000 7fb66bf9d640 1 -- 172.21.15.134:0/4150248217 shutdown_connections 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.856+0000 7fb66bf9d640 1 -- 172.21.15.134:0/4150248217 wait complete. 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb66bf9d640 1 Processor -- start 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb66bf9d640 1 -- start start 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb66bf9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6640fb150 0x7fb664119250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb66bf9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6640fbaf0 0x7fb664119790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb66bf9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb664119d90 con 0x7fb6640fb150 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb66bf9d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb664113320 con 0x7fb6640fbaf0 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb669d39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6640fb150 0x7fb664119250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb669d39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6640fb150 0x7fb664119250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38924/0 (socket says 172.21.15.134:38924) 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb669d39640 1 -- 172.21.15.134:0/227551723 learned_addr learned my addr 172.21.15.134:0/227551723 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb669538640 1 --2- 172.21.15.134:0/227551723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6640fbaf0 0x7fb664119790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb669d39640 1 -- 172.21.15.134:0/227551723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6640fbaf0 msgr2=0x7fb664119790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb669d39640 1 --2- 172.21.15.134:0/227551723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6640fbaf0 0x7fb664119790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb669d39640 1 -- 172.21.15.134:0/227551723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c005040 con 0x7fb6640fb150 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb669538640 1 --2- 172.21.15.134:0/227551723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6640fbaf0 0x7fb664119790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:30:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.857+0000 7fb669d39640 1 --2- 172.21.15.134:0/227551723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6640fb150 0x7fb664119250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb65c031720 tx=0x7fb65c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:59.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.858+0000 7fb65a7fc640 1 -- 172.21.15.134:0/227551723 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb65c0094c0 con 0x7fb6640fb150 2024-02-16T22:30:59.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.858+0000 7fb65a7fc640 1 -- 172.21.15.134:0/227551723 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb65c009620 con 0x7fb6640fb150 2024-02-16T22:30:59.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.858+0000 7fb66bf9d640 1 -- 172.21.15.134:0/227551723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6641135a0 con 0x7fb6640fb150 2024-02-16T22:30:59.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.858+0000 7fb65a7fc640 1 -- 172.21.15.134:0/227551723 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb65c03b640 con 0x7fb6640fb150 2024-02-16T22:30:59.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.858+0000 7fb66bf9d640 1 -- 172.21.15.134:0/227551723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb664113ac0 con 0x7fb6640fb150 2024-02-16T22:30:59.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.859+0000 7fb66bf9d640 1 -- 172.21.15.134:0/227551723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb664064480 con 0x7fb6640fb150 2024-02-16T22:30:59.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.859+0000 7fb65a7fc640 1 -- 172.21.15.134:0/227551723 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fb65c02f070 con 0x7fb6640fb150 2024-02-16T22:30:59.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.859+0000 7fb65a7fc640 1 --2- 172.21.15.134:0/227551723 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb65006d750 0x7fb65006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:30:59.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.860+0000 7fb65a7fc640 1 -- 172.21.15.134:0/227551723 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fb65c0af420 con 0x7fb6640fb150 2024-02-16T22:30:59.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.860+0000 7fb669538640 1 --2- 172.21.15.134:0/227551723 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb65006d750 0x7fb65006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:30:59.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.860+0000 7fb669538640 1 --2- 172.21.15.134:0/227551723 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb65006d750 0x7fb65006fc00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb664114b10 tx=0x7fb65400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:30:59.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:30:59.864+0000 7fb65a7fc640 1 -- 172.21.15.134:0/227551723 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb65c078c10 con 0x7fb6640fb150 2024-02-16T22:31:00.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.071+0000 7fb66bf9d640 1 -- 172.21.15.134:0/227551723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fb6640fd870 con 0x7fb6640fb150 2024-02-16T22:31:00.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.071+0000 7fb65a7fc640 1 -- 172.21.15.134:0/227551723 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v36) v1 ==== 107+0+4862 (secure 0 0 0) 0x7fb6640fd870 con 0x7fb6640fb150 2024-02-16T22:31:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:31:00.073 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24279,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.173:6827/3866528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3866528665},{"type":"v1","addr":"172.21.15.173:6827","nonce":3866528665}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi134.jyajef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3228039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3228039321},{"type":"v1","addr":"172.21.15.134:6829","nonce":3228039321}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":34382,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/845650190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":845650190},{"type":"v1","addr":"172.21.15.134:6827","nonce":845650190}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24},{"gid":44269,"name":"cephfs.smithi173.qljqef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6825/1069817513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1069817513},{"type":"v1","addr":"172.21.15.173:6825","nonce":1069817513}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:28:03.434248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:31:00.073 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 24 2024-02-16T22:31:00.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.073+0000 7fb66bf9d640 1 -- 172.21.15.134:0/227551723 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb65006d750 msgr2=0x7fb65006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:00.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.073+0000 7fb66bf9d640 1 --2- 172.21.15.134:0/227551723 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb65006d750 0x7fb65006fc00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb664114b10 tx=0x7fb65400b040 comp rx=0 tx=0).stop 2024-02-16T22:31:00.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.073+0000 7fb66bf9d640 1 -- 172.21.15.134:0/227551723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6640fb150 msgr2=0x7fb664119250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:00.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.073+0000 7fb66bf9d640 1 --2- 172.21.15.134:0/227551723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6640fb150 0x7fb664119250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb65c031720 tx=0x7fb65c009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.073+0000 7fb66bf9d640 1 -- 172.21.15.134:0/227551723 shutdown_connections 2024-02-16T22:31:00.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.073+0000 7fb66bf9d640 1 --2- 172.21.15.134:0/227551723 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fb65006d750 0x7fb65006fc00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.073+0000 7fb66bf9d640 1 --2- 172.21.15.134:0/227551723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6640fbaf0 0x7fb664119790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.073+0000 7fb66bf9d640 1 --2- 172.21.15.134:0/227551723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6640fb150 0x7fb664119250 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.073+0000 7fb66bf9d640 1 -- 172.21.15.134:0/227551723 >> 172.21.15.134:0/227551723 conn(0x7fb6640f6e10 msgr2=0x7fb66410c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:00.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.073+0000 7fb66bf9d640 1 -- 172.21.15.134:0/227551723 shutdown_connections 2024-02-16T22:31:00.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.073+0000 7fb66bf9d640 1 -- 172.21.15.134:0/227551723 wait complete. 2024-02-16T22:31:00.086 DEBUG:tasks.fs:max_mds not reduced in epoch 24 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-16T22:31:00.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-02-16T22:31:00.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.183+0000 7f37c411d640 1 -- 172.21.15.134:0/1064334376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37bc1012d0 msgr2=0x7f37bc1016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:00.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.183+0000 7f37c411d640 1 --2- 172.21.15.134:0/1064334376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37bc1012d0 0x7f37bc1016a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f37b80048d0 tx=0x7f37b8009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.183+0000 7f37c411d640 1 -- 172.21.15.134:0/1064334376 shutdown_connections 2024-02-16T22:31:00.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.183+0000 7f37c411d640 1 --2- 172.21.15.134:0/1064334376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37bc0fb2b0 0x7f37bc0fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.183+0000 7f37c411d640 1 --2- 172.21.15.134:0/1064334376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37bc1012d0 0x7f37bc1016a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.183+0000 7f37c411d640 1 -- 172.21.15.134:0/1064334376 >> 172.21.15.134:0/1064334376 conn(0x7f37bc071230 msgr2=0x7f37bc071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:00.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.183+0000 7f37c411d640 1 -- 172.21.15.134:0/1064334376 shutdown_connections 2024-02-16T22:31:00.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.183+0000 7f37c411d640 1 -- 172.21.15.134:0/1064334376 wait complete. 2024-02-16T22:31:00.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.183+0000 7f37c411d640 1 Processor -- start 2024-02-16T22:31:00.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c411d640 1 -- start start 2024-02-16T22:31:00.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c411d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37bc0fb2b0 0x7f37bc111ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:00.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c411d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37bc1012d0 0x7f37bc1120e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:00.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c411d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc112770 con 0x7f37bc1012d0 2024-02-16T22:31:00.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c411d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc10bcb0 con 0x7f37bc0fb2b0 2024-02-16T22:31:00.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c16b8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37bc1012d0 0x7f37bc1120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:00.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c16b8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37bc1012d0 0x7f37bc1120e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38946/0 (socket says 172.21.15.134:38946) 2024-02-16T22:31:00.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c16b8640 1 -- 172.21.15.134:0/4268599543 learned_addr learned my addr 172.21.15.134:0/4268599543 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:00.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c1eb9640 1 --2- 172.21.15.134:0/4268599543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37bc0fb2b0 0x7f37bc111ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:00.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c16b8640 1 -- 172.21.15.134:0/4268599543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37bc0fb2b0 msgr2=0x7f37bc111ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:00.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c16b8640 1 --2- 172.21.15.134:0/4268599543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37bc0fb2b0 0x7f37bc111ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c16b8640 1 -- 172.21.15.134:0/4268599543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b8005040 con 0x7f37bc1012d0 2024-02-16T22:31:00.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c16b8640 1 --2- 172.21.15.134:0/4268599543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37bc1012d0 0x7f37bc1120e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00b790 tx=0x7f37ac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:00.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37b27fc640 1 -- 172.21.15.134:0/4268599543 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37ac00c700 con 0x7f37bc1012d0 2024-02-16T22:31:00.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37b27fc640 1 -- 172.21.15.134:0/4268599543 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f37ac00cd30 con 0x7f37bc1012d0 2024-02-16T22:31:00.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c411d640 1 -- 172.21.15.134:0/4268599543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc10bf90 con 0x7f37bc1012d0 2024-02-16T22:31:00.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37b27fc640 1 -- 172.21.15.134:0/4268599543 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37ac013370 con 0x7f37bc1012d0 2024-02-16T22:31:00.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.184+0000 7f37c411d640 1 -- 172.21.15.134:0/4268599543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc10c4b0 con 0x7f37bc1012d0 2024-02-16T22:31:00.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.185+0000 7f37c411d640 1 -- 172.21.15.134:0/4268599543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc064030 con 0x7f37bc1012d0 2024-02-16T22:31:00.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.186+0000 7f37b27fc640 1 -- 172.21.15.134:0/4268599543 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f37ac012070 con 0x7f37bc1012d0 2024-02-16T22:31:00.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.186+0000 7f37b27fc640 1 --2- 172.21.15.134:0/4268599543 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f37a806d750 0x7f37a806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:00.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.186+0000 7f37b27fc640 1 -- 172.21.15.134:0/4268599543 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f37ac08caf0 con 0x7f37bc1012d0 2024-02-16T22:31:00.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.186+0000 7f37c1eb9640 1 --2- 172.21.15.134:0/4268599543 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f37a806d750 0x7f37a806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:00.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.187+0000 7f37c1eb9640 1 --2- 172.21.15.134:0/4268599543 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f37a806d750 0x7f37a806fc00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f37b8004540 tx=0x7f37b8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:00.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.191+0000 7f37b27fc640 1 -- 172.21.15.134:0/4268599543 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f37ac0562e0 con 0x7f37bc1012d0 2024-02-16T22:31:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.399+0000 7f37c411d640 1 -- 172.21.15.134:0/4268599543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f37bc10c730 con 0x7f37bc1012d0 2024-02-16T22:31:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.400+0000 7f37b27fc640 1 -- 172.21.15.134:0/4268599543 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v36) v1 ==== 107+0+4080 (secure 0 0 0) 0x7f37ac0599a0 con 0x7f37bc1012d0 2024-02-16T22:31:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:31:00.402 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24279,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.173:6827/3866528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3866528665},{"type":"v1","addr":"172.21.15.173:6827","nonce":3866528665}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34382,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/845650190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":845650190},{"type":"v1","addr":"172.21.15.134:6827","nonce":845650190}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24},{"gid":44269,"name":"cephfs.smithi173.qljqef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6825/1069817513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1069817513},{"type":"v1","addr":"172.21.15.173:6825","nonce":1069817513}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:28:03.434248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:31:00.402 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 25 2024-02-16T22:31:00.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.402+0000 7f37c411d640 1 -- 172.21.15.134:0/4268599543 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f37a806d750 msgr2=0x7f37a806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:00.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.402+0000 7f37c411d640 1 --2- 172.21.15.134:0/4268599543 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f37a806d750 0x7f37a806fc00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f37b8004540 tx=0x7f37b8009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.402+0000 7f37c411d640 1 -- 172.21.15.134:0/4268599543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37bc1012d0 msgr2=0x7f37bc1120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:00.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.402+0000 7f37c411d640 1 --2- 172.21.15.134:0/4268599543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37bc1012d0 0x7f37bc1120e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00b790 tx=0x7f37ac0091d0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.402+0000 7f37c411d640 1 -- 172.21.15.134:0/4268599543 shutdown_connections 2024-02-16T22:31:00.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.402+0000 7f37c411d640 1 --2- 172.21.15.134:0/4268599543 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f37a806d750 0x7f37a806fc00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.402+0000 7f37c411d640 1 --2- 172.21.15.134:0/4268599543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37bc1012d0 0x7f37bc1120e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.402+0000 7f37c411d640 1 --2- 172.21.15.134:0/4268599543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37bc0fb2b0 0x7f37bc111ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.402+0000 7f37c411d640 1 -- 172.21.15.134:0/4268599543 >> 172.21.15.134:0/4268599543 conn(0x7f37bc071230 msgr2=0x7f37bc0fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:00.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.402+0000 7f37c411d640 1 -- 172.21.15.134:0/4268599543 shutdown_connections 2024-02-16T22:31:00.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.402+0000 7f37c411d640 1 -- 172.21.15.134:0/4268599543 wait complete. 2024-02-16T22:31:00.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:00 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/3227477448' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-16T22:31:00.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:00 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2444741075' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-16T22:31:00.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:00 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/227551723' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-16T22:31:00.415 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-16T22:31:00.415 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-02-16T22:31:00.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:00 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/3227477448' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-16T22:31:00.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:00 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2444741075' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-16T22:31:00.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:00 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/227551723' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-16T22:31:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.512+0000 7f6035a6e640 1 -- 172.21.15.134:0/2552587038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6030102360 msgr2=0x7f6030102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.512+0000 7f6035a6e640 1 --2- 172.21.15.134:0/2552587038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6030102360 0x7f6030102730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f60240048d0 tx=0x7f6024009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.512+0000 7f6035a6e640 1 -- 172.21.15.134:0/2552587038 shutdown_connections 2024-02-16T22:31:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.512+0000 7f6035a6e640 1 --2- 172.21.15.134:0/2552587038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6030102d00 0x7f60300fc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.512+0000 7f6035a6e640 1 --2- 172.21.15.134:0/2552587038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6030102360 0x7f6030102730 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.512+0000 7f6035a6e640 1 -- 172.21.15.134:0/2552587038 >> 172.21.15.134:0/2552587038 conn(0x7f60300f7ef0 msgr2=0x7f60300fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.512+0000 7f6035a6e640 1 -- 172.21.15.134:0/2552587038 shutdown_connections 2024-02-16T22:31:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.512+0000 7f6035a6e640 1 -- 172.21.15.134:0/2552587038 wait complete. 2024-02-16T22:31:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.512+0000 7f6035a6e640 1 Processor -- start 2024-02-16T22:31:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f6035a6e640 1 -- start start 2024-02-16T22:31:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f6035a6e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6030102360 0x7f603006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f6035a6e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6030102d00 0x7f603006fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f6035a6e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6030070220 con 0x7f6030102d00 2024-02-16T22:31:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f6035a6e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6030070390 con 0x7f6030102360 2024-02-16T22:31:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f602effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6030102d00 0x7f603006fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f602effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6030102d00 0x7f603006fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38964/0 (socket says 172.21.15.134:38964) 2024-02-16T22:31:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f602effd640 1 -- 172.21.15.134:0/3651540422 learned_addr learned my addr 172.21.15.134:0/3651540422 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f602f7fe640 1 --2- 172.21.15.134:0/3651540422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6030102360 0x7f603006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f602effd640 1 -- 172.21.15.134:0/3651540422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6030102360 msgr2=0x7f603006f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f602effd640 1 --2- 172.21.15.134:0/3651540422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6030102360 0x7f603006f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f602effd640 1 -- 172.21.15.134:0/3651540422 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024005040 con 0x7f6030102d00 2024-02-16T22:31:00.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f602f7fe640 1 --2- 172.21.15.134:0/3651540422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6030102360 0x7f603006f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:31:00.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f602effd640 1 --2- 172.21.15.134:0/3651540422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6030102d00 0x7f603006fce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6020002a50 tx=0x7f6020004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:00.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f6017fff640 1 -- 172.21.15.134:0/3651540422 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6020007c30 con 0x7f6030102d00 2024-02-16T22:31:00.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f6017fff640 1 -- 172.21.15.134:0/3651540422 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f602000f040 con 0x7f6030102d00 2024-02-16T22:31:00.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f6035a6e640 1 -- 172.21.15.134:0/3651540422 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60301191a0 con 0x7f6030102d00 2024-02-16T22:31:00.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.513+0000 7f6017fff640 1 -- 172.21.15.134:0/3651540422 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f602000db50 con 0x7f6030102d00 2024-02-16T22:31:00.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.514+0000 7f6035a6e640 1 -- 172.21.15.134:0/3651540422 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60301194d0 con 0x7f6030102d00 2024-02-16T22:31:00.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.515+0000 7f6035a6e640 1 -- 172.21.15.134:0/3651540422 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6030064480 con 0x7f6030102d00 2024-02-16T22:31:00.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.515+0000 7f6017fff640 1 -- 172.21.15.134:0/3651540422 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f602001c400 con 0x7f6030102d00 2024-02-16T22:31:00.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.515+0000 7f6017fff640 1 --2- 172.21.15.134:0/3651540422 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f601806d760 0x7f601806fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:00.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.515+0000 7f6017fff640 1 -- 172.21.15.134:0/3651540422 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f602008c810 con 0x7f6030102d00 2024-02-16T22:31:00.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.515+0000 7f602f7fe640 1 --2- 172.21.15.134:0/3651540422 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f601806d760 0x7f601806fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:00.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.516+0000 7f602f7fe640 1 --2- 172.21.15.134:0/3651540422 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f601806d760 0x7f601806fc10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6024034040 tx=0x7f6024009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:00.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.520+0000 7f6017fff640 1 -- 172.21.15.134:0/3651540422 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6020056000 con 0x7f6030102d00 2024-02-16T22:31:00.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.730+0000 7f6035a6e640 1 -- 172.21.15.134:0/3651540422 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f6030070d00 con 0x7f6030102d00 2024-02-16T22:31:00.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.731+0000 7f6017fff640 1 -- 172.21.15.134:0/3651540422 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v36) v1 ==== 107+0+4896 (secure 0 0 0) 0x7f60200596c0 con 0x7f6030102d00 2024-02-16T22:31:00.732 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:31:00.733 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24279,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.173:6827/3866528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3866528665},{"type":"v1","addr":"172.21.15.173:6827","nonce":3866528665}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34382,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/845650190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":845650190},{"type":"v1","addr":"172.21.15.134:6827","nonce":845650190}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24},{"gid":34414,"name":"cephfs.smithi134.jyajef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3664331772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3664331772},{"type":"v1","addr":"172.21.15.134:6829","nonce":3664331772}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":44269,"name":"cephfs.smithi173.qljqef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6825/1069817513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1069817513},{"type":"v1","addr":"172.21.15.173:6825","nonce":1069817513}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:28:03.434248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:31:00.733 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 26 2024-02-16T22:31:00.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.733+0000 7f6035a6e640 1 -- 172.21.15.134:0/3651540422 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f601806d760 msgr2=0x7f601806fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:00.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.733+0000 7f6035a6e640 1 --2- 172.21.15.134:0/3651540422 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f601806d760 0x7f601806fc10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6024034040 tx=0x7f6024009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.733+0000 7f6035a6e640 1 -- 172.21.15.134:0/3651540422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6030102d00 msgr2=0x7f603006fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:00.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.733+0000 7f6035a6e640 1 --2- 172.21.15.134:0/3651540422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6030102d00 0x7f603006fce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6020002a50 tx=0x7f6020004600 comp rx=0 tx=0).stop 2024-02-16T22:31:00.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.733+0000 7f6035a6e640 1 -- 172.21.15.134:0/3651540422 shutdown_connections 2024-02-16T22:31:00.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.733+0000 7f6035a6e640 1 --2- 172.21.15.134:0/3651540422 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f601806d760 0x7f601806fc10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.733+0000 7f6035a6e640 1 --2- 172.21.15.134:0/3651540422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6030102d00 0x7f603006fce0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.733+0000 7f6035a6e640 1 --2- 172.21.15.134:0/3651540422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6030102360 0x7f603006f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.733+0000 7f6035a6e640 1 -- 172.21.15.134:0/3651540422 >> 172.21.15.134:0/3651540422 conn(0x7f60300f7ef0 msgr2=0x7f60300f9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:00.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.733+0000 7f6035a6e640 1 -- 172.21.15.134:0/3651540422 shutdown_connections 2024-02-16T22:31:00.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.733+0000 7f6035a6e640 1 -- 172.21.15.134:0/3651540422 wait complete. 2024-02-16T22:31:00.745 DEBUG:tasks.fs:max_mds not reduced in epoch 26 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-16T22:31:00.746 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-02-16T22:31:00.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.843+0000 7f69b3eae640 1 -- 172.21.15.134:0/3965673498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ac101bf0 msgr2=0x7f69ac0fb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:00.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.843+0000 7f69b3eae640 1 --2- 172.21.15.134:0/3965673498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ac101bf0 0x7f69ac0fb280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f699c0048d0 tx=0x7f699c009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.843+0000 7f69b3eae640 1 -- 172.21.15.134:0/3965673498 shutdown_connections 2024-02-16T22:31:00.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.843+0000 7f69b3eae640 1 --2- 172.21.15.134:0/3965673498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ac101bf0 0x7f69ac0fb280 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.843+0000 7f69b3eae640 1 --2- 172.21.15.134:0/3965673498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69ac101250 0x7f69ac101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.843+0000 7f69b3eae640 1 -- 172.21.15.134:0/3965673498 >> 172.21.15.134:0/3965673498 conn(0x7f69ac0f6e00 msgr2=0x7f69ac0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:00.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.843+0000 7f69b3eae640 1 -- 172.21.15.134:0/3965673498 shutdown_connections 2024-02-16T22:31:00.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.843+0000 7f69b3eae640 1 -- 172.21.15.134:0/3965673498 wait complete. 2024-02-16T22:31:00.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.843+0000 7f69b3eae640 1 Processor -- start 2024-02-16T22:31:00.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.843+0000 7f69b3eae640 1 -- start start 2024-02-16T22:31:00.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.843+0000 7f69b3eae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ac101250 0x7f69ac112ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:00.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.843+0000 7f69b3eae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69ac101bf0 0x7f69ac1130e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:00.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.843+0000 7f69b3eae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac1136e0 con 0x7f69ac101250 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.843+0000 7f69b3eae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac10cc70 con 0x7f69ac101bf0 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.844+0000 7f69b1c4a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ac101250 0x7f69ac112ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.844+0000 7f69b1c4a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ac101250 0x7f69ac112ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38982/0 (socket says 172.21.15.134:38982) 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.844+0000 7f69b1c4a640 1 -- 172.21.15.134:0/2430418659 learned_addr learned my addr 172.21.15.134:0/2430418659 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.844+0000 7f69b1449640 1 --2- 172.21.15.134:0/2430418659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69ac101bf0 0x7f69ac1130e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.844+0000 7f69b1c4a640 1 -- 172.21.15.134:0/2430418659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69ac101bf0 msgr2=0x7f69ac1130e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.844+0000 7f69b1c4a640 1 --2- 172.21.15.134:0/2430418659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69ac101bf0 0x7f69ac1130e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.844+0000 7f69b1c4a640 1 -- 172.21.15.134:0/2430418659 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c005040 con 0x7f69ac101250 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.844+0000 7f69b1c4a640 1 --2- 172.21.15.134:0/2430418659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ac101250 0x7f69ac112ba0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f69a8002a50 tx=0x7f69a8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.844+0000 7f69a27fc640 1 -- 172.21.15.134:0/2430418659 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69a8007c30 con 0x7f69ac101250 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.844+0000 7f69b3eae640 1 -- 172.21.15.134:0/2430418659 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ac10cf50 con 0x7f69ac101250 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.844+0000 7f69a27fc640 1 -- 172.21.15.134:0/2430418659 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f69a800f040 con 0x7f69ac101250 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.844+0000 7f69a27fc640 1 -- 172.21.15.134:0/2430418659 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69a800db50 con 0x7f69ac101250 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.844+0000 7f69b3eae640 1 -- 172.21.15.134:0/2430418659 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ac10d440 con 0x7f69ac101250 2024-02-16T22:31:00.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.845+0000 7f69b3eae640 1 -- 172.21.15.134:0/2430418659 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ac064480 con 0x7f69ac101250 2024-02-16T22:31:00.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.845+0000 7f69a27fc640 1 -- 172.21.15.134:0/2430418659 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f69a801c400 con 0x7f69ac101250 2024-02-16T22:31:00.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.846+0000 7f69a27fc640 1 --2- 172.21.15.134:0/2430418659 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f699806d750 0x7f699806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:00.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.846+0000 7f69a27fc640 1 -- 172.21.15.134:0/2430418659 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f69a808c760 con 0x7f69ac101250 2024-02-16T22:31:00.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.846+0000 7f69b1449640 1 --2- 172.21.15.134:0/2430418659 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f699806d750 0x7f699806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:00.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.846+0000 7f69b1449640 1 --2- 172.21.15.134:0/2430418659 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f699806d750 0x7f699806fc00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f69ac10ddb0 tx=0x7f699c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:00.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:00.850+0000 7f69a27fc640 1 -- 172.21.15.134:0/2430418659 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f69a8056000 con 0x7f69ac101250 2024-02-16T22:31:01.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.062+0000 7f69b3eae640 1 -- 172.21.15.134:0/2430418659 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f69ac10d660 con 0x7f69ac101250 2024-02-16T22:31:01.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.063+0000 7f69a27fc640 1 -- 172.21.15.134:0/2430418659 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v36) v1 ==== 107+0+4114 (secure 0 0 0) 0x7f69a80596c0 con 0x7f69ac101250 2024-02-16T22:31:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:31:01.065 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24279,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.173:6827/3866528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3866528665},{"type":"v1","addr":"172.21.15.173:6827","nonce":3866528665}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34382,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/845650190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":845650190},{"type":"v1","addr":"172.21.15.134:6827","nonce":845650190}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24},{"gid":34414,"name":"cephfs.smithi134.jyajef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3664331772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3664331772},{"type":"v1","addr":"172.21.15.134:6829","nonce":3664331772}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:28:03.434248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:31:01.065 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 27 2024-02-16T22:31:01.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.065+0000 7f69b3eae640 1 -- 172.21.15.134:0/2430418659 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f699806d750 msgr2=0x7f699806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:01.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.065+0000 7f69b3eae640 1 --2- 172.21.15.134:0/2430418659 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f699806d750 0x7f699806fc00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f69ac10ddb0 tx=0x7f699c009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.065+0000 7f69b3eae640 1 -- 172.21.15.134:0/2430418659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ac101250 msgr2=0x7f69ac112ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:01.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.065+0000 7f69b3eae640 1 --2- 172.21.15.134:0/2430418659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ac101250 0x7f69ac112ba0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f69a8002a50 tx=0x7f69a8004600 comp rx=0 tx=0).stop 2024-02-16T22:31:01.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.065+0000 7f69b3eae640 1 -- 172.21.15.134:0/2430418659 shutdown_connections 2024-02-16T22:31:01.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.065+0000 7f69b3eae640 1 --2- 172.21.15.134:0/2430418659 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f699806d750 0x7f699806fc00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.065+0000 7f69b3eae640 1 --2- 172.21.15.134:0/2430418659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69ac101bf0 0x7f69ac1130e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.065+0000 7f69b3eae640 1 --2- 172.21.15.134:0/2430418659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ac101250 0x7f69ac112ba0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.065+0000 7f69b3eae640 1 -- 172.21.15.134:0/2430418659 >> 172.21.15.134:0/2430418659 conn(0x7f69ac0f6e00 msgr2=0x7f69ac0656d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:01.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.065+0000 7f69b3eae640 1 -- 172.21.15.134:0/2430418659 shutdown_connections 2024-02-16T22:31:01.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.065+0000 7f69b3eae640 1 -- 172.21.15.134:0/2430418659 wait complete. 2024-02-16T22:31:01.078 DEBUG:tasks.fs:max_mds not reduced in epoch 27 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-16T22:31:01.078 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-02-16T22:31:01.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.174+0000 7fd05379d640 1 -- 172.21.15.134:0/2930986896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd04c0fb2b0 msgr2=0x7fd04c0fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:01.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.174+0000 7fd05379d640 1 --2- 172.21.15.134:0/2930986896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd04c0fb2b0 0x7fd04c0fb700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0048d0 tx=0x7fd03c009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.174+0000 7fd05379d640 1 -- 172.21.15.134:0/2930986896 shutdown_connections 2024-02-16T22:31:01.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.174+0000 7fd05379d640 1 --2- 172.21.15.134:0/2930986896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd04c0fb2b0 0x7fd04c0fb700 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.174+0000 7fd05379d640 1 --2- 172.21.15.134:0/2930986896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd04c1012d0 0x7fd04c1016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.174+0000 7fd05379d640 1 -- 172.21.15.134:0/2930986896 >> 172.21.15.134:0/2930986896 conn(0x7fd04c071230 msgr2=0x7fd04c071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:01.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.175+0000 7fd05379d640 1 -- 172.21.15.134:0/2930986896 shutdown_connections 2024-02-16T22:31:01.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.175+0000 7fd05379d640 1 -- 172.21.15.134:0/2930986896 wait complete. 2024-02-16T22:31:01.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.175+0000 7fd05379d640 1 Processor -- start 2024-02-16T22:31:01.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.175+0000 7fd05379d640 1 -- start start 2024-02-16T22:31:01.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.175+0000 7fd05379d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd04c0fb2b0 0x7fd04c112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:01.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.175+0000 7fd05379d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd04c1012d0 0x7fd04c1130b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:01.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.175+0000 7fd05379d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c1136b0 con 0x7fd04c0fb2b0 2024-02-16T22:31:01.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.175+0000 7fd05379d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c113820 con 0x7fd04c1012d0 2024-02-16T22:31:01.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.175+0000 7fd051539640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd04c0fb2b0 0x7fd04c112b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:01.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.175+0000 7fd051539640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd04c0fb2b0 0x7fd04c112b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39004/0 (socket says 172.21.15.134:39004) 2024-02-16T22:31:01.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.175+0000 7fd051539640 1 -- 172.21.15.134:0/1314824983 learned_addr learned my addr 172.21.15.134:0/1314824983 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:01.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.175+0000 7fd050d38640 1 --2- 172.21.15.134:0/1314824983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd04c1012d0 0x7fd04c1130b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:01.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.176+0000 7fd051539640 1 -- 172.21.15.134:0/1314824983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd04c1012d0 msgr2=0x7fd04c1130b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:01.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.176+0000 7fd051539640 1 --2- 172.21.15.134:0/1314824983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd04c1012d0 0x7fd04c1130b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.176+0000 7fd051539640 1 -- 172.21.15.134:0/1314824983 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c005040 con 0x7fd04c0fb2b0 2024-02-16T22:31:01.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.176+0000 7fd050d38640 1 --2- 172.21.15.134:0/1314824983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd04c1012d0 0x7fd04c1130b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:31:01.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.176+0000 7fd051539640 1 --2- 172.21.15.134:0/1314824983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd04c0fb2b0 0x7fd04c112b70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd04800db00 tx=0x7fd048004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:01.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.176+0000 7fd041ffb640 1 -- 172.21.15.134:0/1314824983 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd048017070 con 0x7fd04c0fb2b0 2024-02-16T22:31:01.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.176+0000 7fd041ffb640 1 -- 172.21.15.134:0/1314824983 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd04800f040 con 0x7fd04c0fb2b0 2024-02-16T22:31:01.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.176+0000 7fd041ffb640 1 -- 172.21.15.134:0/1314824983 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd048003ae0 con 0x7fd04c0fb2b0 2024-02-16T22:31:01.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.176+0000 7fd05379d640 1 -- 172.21.15.134:0/1314824983 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04c10cdf0 con 0x7fd04c0fb2b0 2024-02-16T22:31:01.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.176+0000 7fd05379d640 1 -- 172.21.15.134:0/1314824983 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04c10d310 con 0x7fd04c0fb2b0 2024-02-16T22:31:01.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.177+0000 7fd05379d640 1 -- 172.21.15.134:0/1314824983 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04c064030 con 0x7fd04c0fb2b0 2024-02-16T22:31:01.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.177+0000 7fd041ffb640 1 -- 172.21.15.134:0/1314824983 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fd048003c40 con 0x7fd04c0fb2b0 2024-02-16T22:31:01.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.178+0000 7fd041ffb640 1 --2- 172.21.15.134:0/1314824983 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd03806d750 0x7fd03806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:01.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.178+0000 7fd041ffb640 1 -- 172.21.15.134:0/1314824983 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd04808d0b0 con 0x7fd04c0fb2b0 2024-02-16T22:31:01.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.178+0000 7fd050d38640 1 --2- 172.21.15.134:0/1314824983 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd03806d750 0x7fd03806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:01.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.178+0000 7fd050d38640 1 --2- 172.21.15.134:0/1314824983 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd03806d750 0x7fd03806fc00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd04c10e470 tx=0x7fd03c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.182+0000 7fd041ffb640 1 -- 172.21.15.134:0/1314824983 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd0480568a0 con 0x7fd04c0fb2b0 2024-02-16T22:31:01.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.392+0000 7fd05379d640 1 -- 172.21.15.134:0/1314824983 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fd04c10d530 con 0x7fd04c0fb2b0 2024-02-16T22:31:01.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.392+0000 7fd041ffb640 1 -- 172.21.15.134:0/1314824983 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v36) v1 ==== 107+0+4927 (secure 0 0 0) 0x7fd048056020 con 0x7fd04c0fb2b0 2024-02-16T22:31:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:31:01.394 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24279,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.173:6827/3866528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3866528665},{"type":"v1","addr":"172.21.15.173:6827","nonce":3866528665}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34382,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/845650190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":845650190},{"type":"v1","addr":"172.21.15.134:6827","nonce":845650190}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24},{"gid":34414,"name":"cephfs.smithi134.jyajef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3664331772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3664331772},{"type":"v1","addr":"172.21.15.134:6829","nonce":3664331772}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":44301,"name":"cephfs.smithi173.qljqef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6825/892474824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":892474824},{"type":"v1","addr":"172.21.15.173:6825","nonce":892474824}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:28:03.434248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:31:01.394 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 28 2024-02-16T22:31:01.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.394+0000 7fd05379d640 1 -- 172.21.15.134:0/1314824983 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd03806d750 msgr2=0x7fd03806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:01.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.394+0000 7fd05379d640 1 --2- 172.21.15.134:0/1314824983 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd03806d750 0x7fd03806fc00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd04c10e470 tx=0x7fd03c009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.394+0000 7fd05379d640 1 -- 172.21.15.134:0/1314824983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd04c0fb2b0 msgr2=0x7fd04c112b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:01.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.394+0000 7fd05379d640 1 --2- 172.21.15.134:0/1314824983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd04c0fb2b0 0x7fd04c112b70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd04800db00 tx=0x7fd048004e60 comp rx=0 tx=0).stop 2024-02-16T22:31:01.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.394+0000 7fd05379d640 1 -- 172.21.15.134:0/1314824983 shutdown_connections 2024-02-16T22:31:01.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.394+0000 7fd05379d640 1 --2- 172.21.15.134:0/1314824983 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fd03806d750 0x7fd03806fc00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.394+0000 7fd05379d640 1 --2- 172.21.15.134:0/1314824983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd04c1012d0 0x7fd04c1130b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.394+0000 7fd05379d640 1 --2- 172.21.15.134:0/1314824983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd04c0fb2b0 0x7fd04c112b70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.394+0000 7fd05379d640 1 -- 172.21.15.134:0/1314824983 >> 172.21.15.134:0/1314824983 conn(0x7fd04c071230 msgr2=0x7fd04c0ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:01.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.394+0000 7fd05379d640 1 -- 172.21.15.134:0/1314824983 shutdown_connections 2024-02-16T22:31:01.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.394+0000 7fd05379d640 1 -- 172.21.15.134:0/1314824983 wait complete. 2024-02-16T22:31:01.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:01 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/4268599543' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-16T22:31:01.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:01 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/3651540422' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-16T22:31:01.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:01 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2430418659' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-16T22:31:01.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:01 smithi134 ceph-mon[112514]: pgmap v261: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:31:01.407 DEBUG:tasks.fs:max_mds not reduced in epoch 28 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-16T22:31:01.407 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-02-16T22:31:01.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:01 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/4268599543' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-16T22:31:01.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:01 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/3651540422' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-16T22:31:01.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:01 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2430418659' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-16T22:31:01.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:01 smithi173 ceph-mon[83703]: pgmap v261: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:31:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.504+0000 7ff3326ae640 1 -- 172.21.15.134:0/222817711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0fdd10 msgr2=0x7ff32c106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.504+0000 7ff3326ae640 1 --2- 172.21.15.134:0/222817711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0fdd10 0x7ff32c106350 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3200048d0 tx=0x7ff320009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.504+0000 7ff3326ae640 1 -- 172.21.15.134:0/222817711 shutdown_connections 2024-02-16T22:31:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.504+0000 7ff3326ae640 1 --2- 172.21.15.134:0/222817711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0fdd10 0x7ff32c106350 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.504+0000 7ff3326ae640 1 --2- 172.21.15.134:0/222817711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff32c0fd370 0x7ff32c0fd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.504+0000 7ff3326ae640 1 -- 172.21.15.134:0/222817711 >> 172.21.15.134:0/222817711 conn(0x7ff32c0f6e00 msgr2=0x7ff32c0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.504+0000 7ff3326ae640 1 -- 172.21.15.134:0/222817711 shutdown_connections 2024-02-16T22:31:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.504+0000 7ff3326ae640 1 -- 172.21.15.134:0/222817711 wait complete. 2024-02-16T22:31:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.505+0000 7ff3326ae640 1 Processor -- start 2024-02-16T22:31:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.505+0000 7ff3326ae640 1 -- start start 2024-02-16T22:31:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.505+0000 7ff3326ae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff32c0fd370 0x7ff32c112c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.505+0000 7ff3326ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0fdd10 0x7ff32c113140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.505+0000 7ff3326ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c113740 con 0x7ff32c0fdd10 2024-02-16T22:31:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.505+0000 7ff3326ae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c10ccd0 con 0x7ff32c0fd370 2024-02-16T22:31:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.505+0000 7ff32b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0fdd10 0x7ff32c113140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.505+0000 7ff32b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0fdd10 0x7ff32c113140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55378/0 (socket says 172.21.15.134:55378) 2024-02-16T22:31:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.505+0000 7ff32b7fe640 1 -- 172.21.15.134:0/1669202251 learned_addr learned my addr 172.21.15.134:0/1669202251 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.506+0000 7ff32b7fe640 1 -- 172.21.15.134:0/1669202251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff32c0fd370 msgr2=0x7ff32c112c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.506+0000 7ff32bfff640 1 --2- 172.21.15.134:0/1669202251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff32c0fd370 0x7ff32c112c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.506+0000 7ff32b7fe640 1 --2- 172.21.15.134:0/1669202251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff32c0fd370 0x7ff32c112c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.506+0000 7ff32b7fe640 1 -- 172.21.15.134:0/1669202251 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff320005040 con 0x7ff32c0fdd10 2024-02-16T22:31:01.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.506+0000 7ff32b7fe640 1 --2- 172.21.15.134:0/1669202251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0fdd10 0x7ff32c113140 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff320031720 tx=0x7ff320009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:01.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.506+0000 7ff328ff9640 1 -- 172.21.15.134:0/1669202251 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3200094c0 con 0x7ff32c0fdd10 2024-02-16T22:31:01.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.506+0000 7ff328ff9640 1 -- 172.21.15.134:0/1669202251 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff320009620 con 0x7ff32c0fdd10 2024-02-16T22:31:01.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.506+0000 7ff328ff9640 1 -- 172.21.15.134:0/1669202251 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff32003b640 con 0x7ff32c0fdd10 2024-02-16T22:31:01.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.506+0000 7ff3326ae640 1 -- 172.21.15.134:0/1669202251 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c10cf50 con 0x7ff32c0fdd10 2024-02-16T22:31:01.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.506+0000 7ff3326ae640 1 -- 172.21.15.134:0/1669202251 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32c10d470 con 0x7ff32c0fdd10 2024-02-16T22:31:01.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.507+0000 7ff3326ae640 1 -- 172.21.15.134:0/1669202251 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32c064480 con 0x7ff32c0fdd10 2024-02-16T22:31:01.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.507+0000 7ff328ff9640 1 -- 172.21.15.134:0/1669202251 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff32002f070 con 0x7ff32c0fdd10 2024-02-16T22:31:01.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.508+0000 7ff328ff9640 1 --2- 172.21.15.134:0/1669202251 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff31406d750 0x7ff31406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:01.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.508+0000 7ff328ff9640 1 -- 172.21.15.134:0/1669202251 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff3200af400 con 0x7ff32c0fdd10 2024-02-16T22:31:01.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.508+0000 7ff32bfff640 1 --2- 172.21.15.134:0/1669202251 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff31406d750 0x7ff31406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:01.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.508+0000 7ff32bfff640 1 --2- 172.21.15.134:0/1669202251 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff31406d750 0x7ff31406fc00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff31c007fd0 tx=0x7ff31c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:01.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.512+0000 7ff328ff9640 1 -- 172.21.15.134:0/1669202251 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff320078c70 con 0x7ff32c0fdd10 2024-02-16T22:31:01.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.722+0000 7ff3326ae640 1 -- 172.21.15.134:0/1669202251 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7ff32c10e200 con 0x7ff32c0fdd10 2024-02-16T22:31:01.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.722+0000 7ff328ff9640 1 -- 172.21.15.134:0/1669202251 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v36) v1 ==== 107+0+4145 (secure 0 0 0) 0x7ff32007c330 con 0x7ff32c0fdd10 2024-02-16T22:31:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:31:01.724 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/845650190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":845650190},{"type":"v1","addr":"172.21.15.134:6827","nonce":845650190}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24},{"gid":34414,"name":"cephfs.smithi134.jyajef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3664331772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3664331772},{"type":"v1","addr":"172.21.15.134:6829","nonce":3664331772}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":44301,"name":"cephfs.smithi173.qljqef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6825/892474824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":892474824},{"type":"v1","addr":"172.21.15.173:6825","nonce":892474824}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:28:03.434248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:31:01.724 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 29 2024-02-16T22:31:01.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.724+0000 7ff3326ae640 1 -- 172.21.15.134:0/1669202251 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff31406d750 msgr2=0x7ff31406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:01.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.724+0000 7ff3326ae640 1 --2- 172.21.15.134:0/1669202251 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff31406d750 0x7ff31406fc00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff31c007fd0 tx=0x7ff31c009040 comp rx=0 tx=0).stop 2024-02-16T22:31:01.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.724+0000 7ff3326ae640 1 -- 172.21.15.134:0/1669202251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0fdd10 msgr2=0x7ff32c113140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:01.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.724+0000 7ff3326ae640 1 --2- 172.21.15.134:0/1669202251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0fdd10 0x7ff32c113140 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff320031720 tx=0x7ff320009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.724+0000 7ff3326ae640 1 -- 172.21.15.134:0/1669202251 shutdown_connections 2024-02-16T22:31:01.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.724+0000 7ff3326ae640 1 --2- 172.21.15.134:0/1669202251 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff31406d750 0x7ff31406fc00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.724+0000 7ff3326ae640 1 --2- 172.21.15.134:0/1669202251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0fdd10 0x7ff32c113140 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.724+0000 7ff3326ae640 1 --2- 172.21.15.134:0/1669202251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff32c0fd370 0x7ff32c112c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.724+0000 7ff3326ae640 1 -- 172.21.15.134:0/1669202251 >> 172.21.15.134:0/1669202251 conn(0x7ff32c0f6e00 msgr2=0x7ff32c100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:01.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.725+0000 7ff3326ae640 1 -- 172.21.15.134:0/1669202251 shutdown_connections 2024-02-16T22:31:01.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.725+0000 7ff3326ae640 1 -- 172.21.15.134:0/1669202251 wait complete. 2024-02-16T22:31:01.737 DEBUG:tasks.fs:max_mds not reduced in epoch 29 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-16T22:31:01.737 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-02-16T22:31:01.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.834+0000 7f36b619d640 1 -- 172.21.15.134:0/1587470105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b0102d10 msgr2=0x7f36b00644a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:01.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.834+0000 7f36b619d640 1 --2- 172.21.15.134:0/1587470105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b0102d10 0x7f36b00644a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f36a40048d0 tx=0x7f36a4009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.834+0000 7f36b619d640 1 -- 172.21.15.134:0/1587470105 shutdown_connections 2024-02-16T22:31:01.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.834+0000 7f36b619d640 1 --2- 172.21.15.134:0/1587470105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b0102d10 0x7f36b00644a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.834+0000 7f36b619d640 1 --2- 172.21.15.134:0/1587470105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36b0102370 0x7f36b0102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.834+0000 7f36b619d640 1 -- 172.21.15.134:0/1587470105 >> 172.21.15.134:0/1587470105 conn(0x7f36b0071230 msgr2=0x7f36b0071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:01.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.834+0000 7f36b619d640 1 -- 172.21.15.134:0/1587470105 shutdown_connections 2024-02-16T22:31:01.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.834+0000 7f36b619d640 1 -- 172.21.15.134:0/1587470105 wait complete. 2024-02-16T22:31:01.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.835+0000 7f36b619d640 1 Processor -- start 2024-02-16T22:31:01.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.835+0000 7f36b619d640 1 -- start start 2024-02-16T22:31:01.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.835+0000 7f36b619d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36b0102370 0x7f36b0112cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:01.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.835+0000 7f36b619d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b0102d10 0x7f36b0113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:01.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.835+0000 7f36b619d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b0113800 con 0x7f36b0102d10 2024-02-16T22:31:01.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.835+0000 7f36b619d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b0113970 con 0x7f36b0102370 2024-02-16T22:31:01.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.835+0000 7f36aeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b0102d10 0x7f36b0113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:01.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.835+0000 7f36aeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b0102d10 0x7f36b0113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55398/0 (socket says 172.21.15.134:55398) 2024-02-16T22:31:01.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.835+0000 7f36aeffd640 1 -- 172.21.15.134:0/3976816919 learned_addr learned my addr 172.21.15.134:0/3976816919 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:01.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.835+0000 7f36af7fe640 1 --2- 172.21.15.134:0/3976816919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36b0102370 0x7f36b0112cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:01.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.835+0000 7f36aeffd640 1 -- 172.21.15.134:0/3976816919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36b0102370 msgr2=0x7f36b0112cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:01.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.835+0000 7f36aeffd640 1 --2- 172.21.15.134:0/3976816919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36b0102370 0x7f36b0112cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:01.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.835+0000 7f36aeffd640 1 -- 172.21.15.134:0/3976816919 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a4005040 con 0x7f36b0102d10 2024-02-16T22:31:01.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.836+0000 7f36aeffd640 1 --2- 172.21.15.134:0/3976816919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b0102d10 0x7f36b0113200 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f36a402bda0 tx=0x7f36a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:01.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.836+0000 7f3697fff640 1 -- 172.21.15.134:0/3976816919 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36a40092b0 con 0x7f36b0102d10 2024-02-16T22:31:01.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.836+0000 7f36b619d640 1 -- 172.21.15.134:0/3976816919 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b010cee0 con 0x7f36b0102d10 2024-02-16T22:31:01.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.836+0000 7f3697fff640 1 -- 172.21.15.134:0/3976816919 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f36a403d450 con 0x7f36b0102d10 2024-02-16T22:31:01.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.836+0000 7f3697fff640 1 -- 172.21.15.134:0/3976816919 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36a403b640 con 0x7f36b0102d10 2024-02-16T22:31:01.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.836+0000 7f36b619d640 1 -- 172.21.15.134:0/3976816919 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b010d400 con 0x7f36b0102d10 2024-02-16T22:31:01.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.837+0000 7f36b619d640 1 -- 172.21.15.134:0/3976816919 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b0064030 con 0x7f36b0102d10 2024-02-16T22:31:01.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.837+0000 7f3697fff640 1 -- 172.21.15.134:0/3976816919 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f36a402f070 con 0x7f36b0102d10 2024-02-16T22:31:01.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.838+0000 7f3697fff640 1 --2- 172.21.15.134:0/3976816919 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f369806d750 0x7f369806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:01.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.838+0000 7f3697fff640 1 -- 172.21.15.134:0/3976816919 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f36a40af220 con 0x7f36b0102d10 2024-02-16T22:31:01.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.838+0000 7f36af7fe640 1 --2- 172.21.15.134:0/3976816919 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f369806d750 0x7f369806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:01.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.838+0000 7f36af7fe640 1 --2- 172.21.15.134:0/3976816919 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f369806d750 0x7f369806fc00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f36a0004a70 tx=0x7f36a000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:01.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:01.842+0000 7f3697fff640 1 -- 172.21.15.134:0/3976816919 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f36a4078a10 con 0x7f36b0102d10 2024-02-16T22:31:02.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.059+0000 7f36b619d640 1 -- 172.21.15.134:0/3976816919 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f36b00ff0d0 con 0x7f36b0102d10 2024-02-16T22:31:02.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.060+0000 7f3697fff640 1 -- 172.21.15.134:0/3976816919 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v36) v1 ==== 107+0+4958 (secure 0 0 0) 0x7f36a407c0d0 con 0x7f36b0102d10 2024-02-16T22:31:02.062 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:31:02.062 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/845650190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":845650190},{"type":"v1","addr":"172.21.15.134:6827","nonce":845650190}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24},{"gid":34414,"name":"cephfs.smithi134.jyajef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3664331772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3664331772},{"type":"v1","addr":"172.21.15.134:6829","nonce":3664331772}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":44301,"name":"cephfs.smithi173.qljqef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6825/892474824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":892474824},{"type":"v1","addr":"172.21.15.173:6825","nonce":892474824}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44329,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6827/862726270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":862726270},{"type":"v1","addr":"172.21.15.173:6827","nonce":862726270}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:28:03.434248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:31:02.062 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 30 2024-02-16T22:31:02.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.062+0000 7f36b619d640 1 -- 172.21.15.134:0/3976816919 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f369806d750 msgr2=0x7f369806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:02.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.062+0000 7f36b619d640 1 --2- 172.21.15.134:0/3976816919 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f369806d750 0x7f369806fc00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f36a0004a70 tx=0x7f36a000b040 comp rx=0 tx=0).stop 2024-02-16T22:31:02.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.062+0000 7f36b619d640 1 -- 172.21.15.134:0/3976816919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b0102d10 msgr2=0x7f36b0113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:02.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.062+0000 7f36b619d640 1 --2- 172.21.15.134:0/3976816919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b0102d10 0x7f36b0113200 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f36a402bda0 tx=0x7f36a4009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.062+0000 7f36b619d640 1 -- 172.21.15.134:0/3976816919 shutdown_connections 2024-02-16T22:31:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.062+0000 7f36b619d640 1 --2- 172.21.15.134:0/3976816919 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f369806d750 0x7f369806fc00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.062+0000 7f36b619d640 1 --2- 172.21.15.134:0/3976816919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b0102d10 0x7f36b0113200 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.062+0000 7f36b619d640 1 --2- 172.21.15.134:0/3976816919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36b0102370 0x7f36b0112cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.062+0000 7f36b619d640 1 -- 172.21.15.134:0/3976816919 >> 172.21.15.134:0/3976816919 conn(0x7f36b0071230 msgr2=0x7f36b00fa310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.062+0000 7f36b619d640 1 -- 172.21.15.134:0/3976816919 shutdown_connections 2024-02-16T22:31:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.062+0000 7f36b619d640 1 -- 172.21.15.134:0/3976816919 wait complete. 2024-02-16T22:31:02.075 DEBUG:tasks.fs:max_mds not reduced in epoch 30 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-16T22:31:02.075 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-02-16T22:31:02.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.172+0000 7f6e0302e640 1 -- 172.21.15.134:0/1768914251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc0644b0 msgr2=0x7f6dfc0648e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:02.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.172+0000 7f6e0302e640 1 --2- 172.21.15.134:0/1768914251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc0644b0 0x7f6dfc0648e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6de80048d0 tx=0x7f6de8009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.172+0000 7f6e0302e640 1 -- 172.21.15.134:0/1768914251 shutdown_connections 2024-02-16T22:31:02.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.172+0000 7f6e0302e640 1 --2- 172.21.15.134:0/1768914251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc0644b0 0x7f6dfc0648e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.172+0000 7f6e0302e640 1 --2- 172.21.15.134:0/1768914251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dfc1023e0 0x7f6dfc1027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.172+0000 7f6e0302e640 1 -- 172.21.15.134:0/1768914251 >> 172.21.15.134:0/1768914251 conn(0x7f6dfc071230 msgr2=0x7f6dfc071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:02.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.172+0000 7f6e0302e640 1 -- 172.21.15.134:0/1768914251 shutdown_connections 2024-02-16T22:31:02.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.172+0000 7f6e0302e640 1 -- 172.21.15.134:0/1768914251 wait complete. 2024-02-16T22:31:02.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.172+0000 7f6e0302e640 1 Processor -- start 2024-02-16T22:31:02.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.172+0000 7f6e0302e640 1 -- start start 2024-02-16T22:31:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.173+0000 7f6e0302e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dfc0644b0 0x7f6dfc112c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.173+0000 7f6e0302e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc1023e0 0x7f6dfc113140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.173+0000 7f6e0302e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc113740 con 0x7f6dfc1023e0 2024-02-16T22:31:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.173+0000 7f6e0302e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc1138b0 con 0x7f6dfc0644b0 2024-02-16T22:31:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.173+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc1023e0 0x7f6dfc113140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.173+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc1023e0 0x7f6dfc113140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55412/0 (socket says 172.21.15.134:55412) 2024-02-16T22:31:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.173+0000 7f6dfbfff640 1 -- 172.21.15.134:0/61437248 learned_addr learned my addr 172.21.15.134:0/61437248 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.173+0000 7f6e00dca640 1 --2- 172.21.15.134:0/61437248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dfc0644b0 0x7f6dfc112c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.173+0000 7f6dfbfff640 1 -- 172.21.15.134:0/61437248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dfc0644b0 msgr2=0x7f6dfc112c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.173+0000 7f6dfbfff640 1 --2- 172.21.15.134:0/61437248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dfc0644b0 0x7f6dfc112c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.173+0000 7f6dfbfff640 1 -- 172.21.15.134:0/61437248 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de8005040 con 0x7f6dfc1023e0 2024-02-16T22:31:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.174+0000 7f6dfbfff640 1 --2- 172.21.15.134:0/61437248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc1023e0 0x7f6dfc113140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6de8031720 tx=0x7f6de8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.174+0000 7f6df97fa640 1 -- 172.21.15.134:0/61437248 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6de80094c0 con 0x7f6dfc1023e0 2024-02-16T22:31:02.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.174+0000 7f6df97fa640 1 -- 172.21.15.134:0/61437248 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6de8009620 con 0x7f6dfc1023e0 2024-02-16T22:31:02.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.174+0000 7f6e0302e640 1 -- 172.21.15.134:0/61437248 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dfc10ce20 con 0x7f6dfc1023e0 2024-02-16T22:31:02.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.174+0000 7f6df97fa640 1 -- 172.21.15.134:0/61437248 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6de803b640 con 0x7f6dfc1023e0 2024-02-16T22:31:02.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.174+0000 7f6e0302e640 1 -- 172.21.15.134:0/61437248 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dfc10d340 con 0x7f6dfc1023e0 2024-02-16T22:31:02.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.175+0000 7f6e0302e640 1 -- 172.21.15.134:0/61437248 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dfc064030 con 0x7f6dfc1023e0 2024-02-16T22:31:02.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.175+0000 7f6df97fa640 1 -- 172.21.15.134:0/61437248 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f6de802f070 con 0x7f6dfc1023e0 2024-02-16T22:31:02.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.176+0000 7f6df97fa640 1 --2- 172.21.15.134:0/61437248 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f6dec06d750 0x7f6dec06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:02.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.176+0000 7f6df97fa640 1 -- 172.21.15.134:0/61437248 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6de80af380 con 0x7f6dfc1023e0 2024-02-16T22:31:02.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.176+0000 7f6e00dca640 1 --2- 172.21.15.134:0/61437248 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f6dec06d750 0x7f6dec06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:02.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.176+0000 7f6e00dca640 1 --2- 172.21.15.134:0/61437248 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f6dec06d750 0x7f6dec06fc00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6df0004eb0 tx=0x7f6df000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:02.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.180+0000 7f6df97fa640 1 -- 172.21.15.134:0/61437248 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6de8078b70 con 0x7f6dfc1023e0 2024-02-16T22:31:02.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.398+0000 7f6e0302e640 1 -- 172.21.15.134:0/61437248 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f6dfc10d4d0 con 0x7f6dfc1023e0 2024-02-16T22:31:02.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.399+0000 7f6df97fa640 1 -- 172.21.15.134:0/61437248 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v36) v1 ==== 107+0+4957 (secure 0 0 0) 0x7f6de807c230 con 0x7f6dfc1023e0 2024-02-16T22:31:02.401 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:31:02.401 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi134.cygfxr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/845650190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":845650190},{"type":"v1","addr":"172.21.15.134:6827","nonce":845650190}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24},{"gid":34414,"name":"cephfs.smithi134.jyajef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3664331772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3664331772},{"type":"v1","addr":"172.21.15.134:6829","nonce":3664331772}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":44301,"name":"cephfs.smithi173.qljqef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6825/892474824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":892474824},{"type":"v1","addr":"172.21.15.173:6825","nonce":892474824}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44329,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6827/862726270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":862726270},{"type":"v1","addr":"172.21.15.173:6827","nonce":862726270}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:29:09.563432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:31:02.401 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 31 2024-02-16T22:31:02.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.401+0000 7f6e0302e640 1 -- 172.21.15.134:0/61437248 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f6dec06d750 msgr2=0x7f6dec06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:02.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.401+0000 7f6e0302e640 1 --2- 172.21.15.134:0/61437248 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f6dec06d750 0x7f6dec06fc00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6df0004eb0 tx=0x7f6df000b040 comp rx=0 tx=0).stop 2024-02-16T22:31:02.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.401+0000 7f6e0302e640 1 -- 172.21.15.134:0/61437248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc1023e0 msgr2=0x7f6dfc113140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:02.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.401+0000 7f6e0302e640 1 --2- 172.21.15.134:0/61437248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc1023e0 0x7f6dfc113140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6de8031720 tx=0x7f6de8009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.401+0000 7f6e0302e640 1 -- 172.21.15.134:0/61437248 shutdown_connections 2024-02-16T22:31:02.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.401+0000 7f6e0302e640 1 --2- 172.21.15.134:0/61437248 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f6dec06d750 0x7f6dec06fc00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.401+0000 7f6e0302e640 1 --2- 172.21.15.134:0/61437248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc1023e0 0x7f6dfc113140 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.401+0000 7f6e0302e640 1 --2- 172.21.15.134:0/61437248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dfc0644b0 0x7f6dfc112c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.401+0000 7f6e0302e640 1 -- 172.21.15.134:0/61437248 >> 172.21.15.134:0/61437248 conn(0x7f6dfc071230 msgr2=0x7f6dfc0fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:02.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.401+0000 7f6e0302e640 1 -- 172.21.15.134:0/61437248 shutdown_connections 2024-02-16T22:31:02.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.401+0000 7f6e0302e640 1 -- 172.21.15.134:0/61437248 wait complete. 2024-02-16T22:31:02.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:02 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1314824983' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-16T22:31:02.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:02 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1669202251' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-16T22:31:02.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:02 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/3976816919' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-16T22:31:02.414 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-02-16T22:31:02.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:02 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1314824983' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-16T22:31:02.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:02 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1669202251' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-16T22:31:02.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:02 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/3976816919' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-16T22:31:02.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.511+0000 7f984d35d640 1 -- 172.21.15.134:0/3025569732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98480fd390 msgr2=0x7f98480fd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:02.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.511+0000 7f984d35d640 1 --2- 172.21.15.134:0/3025569732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98480fd390 0x7f98480fd760 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f98380048d0 tx=0x7f9838009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.511+0000 7f984d35d640 1 -- 172.21.15.134:0/3025569732 shutdown_connections 2024-02-16T22:31:02.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.511+0000 7f984d35d640 1 --2- 172.21.15.134:0/3025569732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98480fdd30 0x7f9848106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.511+0000 7f984d35d640 1 --2- 172.21.15.134:0/3025569732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98480fd390 0x7f98480fd760 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.511+0000 7f984d35d640 1 -- 172.21.15.134:0/3025569732 >> 172.21.15.134:0/3025569732 conn(0x7f98480f6de0 msgr2=0x7f98480f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:02.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.511+0000 7f984d35d640 1 -- 172.21.15.134:0/3025569732 shutdown_connections 2024-02-16T22:31:02.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.511+0000 7f984d35d640 1 -- 172.21.15.134:0/3025569732 wait complete. 2024-02-16T22:31:02.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.512+0000 7f984d35d640 1 Processor -- start 2024-02-16T22:31:02.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.512+0000 7f984d35d640 1 -- start start 2024-02-16T22:31:02.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.512+0000 7f984d35d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98480fd390 0x7f9848112c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:02.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.512+0000 7f984d35d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98480fdd30 0x7f9848113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:02.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.512+0000 7f984d35d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9848113790 con 0x7f98480fdd30 2024-02-16T22:31:02.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.512+0000 7f984d35d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984810cd20 con 0x7f98480fd390 2024-02-16T22:31:02.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.512+0000 7f98467fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98480fdd30 0x7f9848113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:02.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.512+0000 7f98467fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98480fdd30 0x7f9848113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55438/0 (socket says 172.21.15.134:55438) 2024-02-16T22:31:02.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.512+0000 7f98467fc640 1 -- 172.21.15.134:0/4041914441 learned_addr learned my addr 172.21.15.134:0/4041914441 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:02.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.512+0000 7f98467fc640 1 -- 172.21.15.134:0/4041914441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98480fd390 msgr2=0x7f9848112c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:02.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.512+0000 7f98467fc640 1 --2- 172.21.15.134:0/4041914441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98480fd390 0x7f9848112c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.512+0000 7f98467fc640 1 -- 172.21.15.134:0/4041914441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9838005040 con 0x7f98480fdd30 2024-02-16T22:31:02.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.512+0000 7f98467fc640 1 --2- 172.21.15.134:0/4041914441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98480fdd30 0x7f9848113190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f983c00c810 tx=0x7f983c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:02.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.512+0000 7f982f7fe640 1 -- 172.21.15.134:0/4041914441 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f983c00a820 con 0x7f98480fdd30 2024-02-16T22:31:02.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.513+0000 7f982f7fe640 1 -- 172.21.15.134:0/4041914441 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f983c00ae50 con 0x7f98480fdd30 2024-02-16T22:31:02.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.513+0000 7f984d35d640 1 -- 172.21.15.134:0/4041914441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984810d000 con 0x7f98480fdd30 2024-02-16T22:31:02.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.513+0000 7f982f7fe640 1 -- 172.21.15.134:0/4041914441 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f983c0115c0 con 0x7f98480fdd30 2024-02-16T22:31:02.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.513+0000 7f984d35d640 1 -- 172.21.15.134:0/4041914441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984810d520 con 0x7f98480fdd30 2024-02-16T22:31:02.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.513+0000 7f984d35d640 1 -- 172.21.15.134:0/4041914441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9848064480 con 0x7f98480fdd30 2024-02-16T22:31:02.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.514+0000 7f982f7fe640 1 -- 172.21.15.134:0/4041914441 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f983c00a980 con 0x7f98480fdd30 2024-02-16T22:31:02.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.514+0000 7f982f7fe640 1 --2- 172.21.15.134:0/4041914441 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f983006d750 0x7f983006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:02.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.514+0000 7f982f7fe640 1 -- 172.21.15.134:0/4041914441 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f983c08d4b0 con 0x7f98480fdd30 2024-02-16T22:31:02.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.514+0000 7f9846ffd640 1 --2- 172.21.15.134:0/4041914441 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f983006d750 0x7f983006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:02.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.515+0000 7f9846ffd640 1 --2- 172.21.15.134:0/4041914441 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f983006d750 0x7f983006fc00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9838034040 tx=0x7f9838009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:02.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.519+0000 7f982f7fe640 1 -- 172.21.15.134:0/4041914441 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f983c056ca0 con 0x7f98480fdd30 2024-02-16T22:31:02.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.729+0000 7f984d35d640 1 -- 172.21.15.134:0/4041914441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f984810e250 con 0x7f98480fdd30 2024-02-16T22:31:02.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.730+0000 7f982f7fe640 1 -- 172.21.15.134:0/4041914441 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v36) v1 ==== 107+0+5014 (secure 0 0 0) 0x7f983c05a360 con 0x7f98480fdd30 2024-02-16T22:31:02.732 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:31:02.732 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44301,"name":"cephfs.smithi173.qljqef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6825/892474824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":892474824},{"type":"v1","addr":"172.21.15.173:6825","nonce":892474824}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44329,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6827/862726270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":862726270},{"type":"v1","addr":"172.21.15.173:6827","nonce":862726270}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:29:10.564592+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34382,"mds_1":34414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi134.cygfxr","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.134:6827/845650190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":845650190},{"type":"v1","addr":"172.21.15.134:6827","nonce":845650190}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34414":{"gid":34414,"name":"cephfs.smithi134.jyajef","rank":1,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.134:6829/3664331772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3664331772},{"type":"v1","addr":"172.21.15.134:6829","nonce":3664331772}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:31:02.732 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 32 2024-02-16T22:31:02.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.732+0000 7f984d35d640 1 -- 172.21.15.134:0/4041914441 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f983006d750 msgr2=0x7f983006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:02.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.732+0000 7f984d35d640 1 --2- 172.21.15.134:0/4041914441 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f983006d750 0x7f983006fc00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9838034040 tx=0x7f9838009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.732+0000 7f984d35d640 1 -- 172.21.15.134:0/4041914441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98480fdd30 msgr2=0x7f9848113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:02.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.732+0000 7f984d35d640 1 --2- 172.21.15.134:0/4041914441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98480fdd30 0x7f9848113190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f983c00c810 tx=0x7f983c0043c0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.732+0000 7f984d35d640 1 -- 172.21.15.134:0/4041914441 shutdown_connections 2024-02-16T22:31:02.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.732+0000 7f984d35d640 1 --2- 172.21.15.134:0/4041914441 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f983006d750 0x7f983006fc00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.732+0000 7f984d35d640 1 --2- 172.21.15.134:0/4041914441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98480fdd30 0x7f9848113190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.732+0000 7f984d35d640 1 --2- 172.21.15.134:0/4041914441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98480fd390 0x7f9848112c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.732+0000 7f984d35d640 1 -- 172.21.15.134:0/4041914441 >> 172.21.15.134:0/4041914441 conn(0x7f98480f6de0 msgr2=0x7f9848100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:02.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.732+0000 7f984d35d640 1 -- 172.21.15.134:0/4041914441 shutdown_connections 2024-02-16T22:31:02.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.732+0000 7f984d35d640 1 -- 172.21.15.134:0/4041914441 wait complete. 2024-02-16T22:31:02.745 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-02-16T22:31:02.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.843+0000 7f57b659d640 1 -- 172.21.15.134:0/4292551619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b00faa60 msgr2=0x7f57b00faed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:02.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.843+0000 7f57b659d640 1 --2- 172.21.15.134:0/4292551619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b00faa60 0x7f57b00faed0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f57a40048d0 tx=0x7f57a4009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.843+0000 7f57b659d640 1 -- 172.21.15.134:0/4292551619 shutdown_connections 2024-02-16T22:31:02.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.843+0000 7f57b659d640 1 --2- 172.21.15.134:0/4292551619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b00faa60 0x7f57b00faed0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.843+0000 7f57b659d640 1 --2- 172.21.15.134:0/4292551619 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57b01023f0 0x7f57b01027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.843+0000 7f57b659d640 1 -- 172.21.15.134:0/4292551619 >> 172.21.15.134:0/4292551619 conn(0x7f57b0071880 msgr2=0x7f57b0071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:02.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.843+0000 7f57b659d640 1 -- 172.21.15.134:0/4292551619 shutdown_connections 2024-02-16T22:31:02.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.843+0000 7f57b659d640 1 -- 172.21.15.134:0/4292551619 wait complete. 2024-02-16T22:31:02.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.843+0000 7f57b659d640 1 Processor -- start 2024-02-16T22:31:02.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57b659d640 1 -- start start 2024-02-16T22:31:02.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57b659d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57b00faa60 0x7f57b0112c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:02.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57b659d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b01023f0 0x7f57b01131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:02.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57b659d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b01137c0 con 0x7f57b01023f0 2024-02-16T22:31:02.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57b659d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0113930 con 0x7f57b00faa60 2024-02-16T22:31:02.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57af7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b01023f0 0x7f57b01131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:02.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57af7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b01023f0 0x7f57b01131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55454/0 (socket says 172.21.15.134:55454) 2024-02-16T22:31:02.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57af7fe640 1 -- 172.21.15.134:0/2246359485 learned_addr learned my addr 172.21.15.134:0/2246359485 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:02.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57affff640 1 --2- 172.21.15.134:0/2246359485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57b00faa60 0x7f57b0112c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:02.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57af7fe640 1 -- 172.21.15.134:0/2246359485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57b00faa60 msgr2=0x7f57b0112c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:02.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57af7fe640 1 --2- 172.21.15.134:0/2246359485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57b00faa60 0x7f57b0112c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:02.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57af7fe640 1 -- 172.21.15.134:0/2246359485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a4005040 con 0x7f57b01023f0 2024-02-16T22:31:02.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57affff640 1 --2- 172.21.15.134:0/2246359485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57b00faa60 0x7f57b0112c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:31:02.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57af7fe640 1 --2- 172.21.15.134:0/2246359485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b01023f0 0x7f57b01131c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f57a4031720 tx=0x7f57a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:02.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57acff9640 1 -- 172.21.15.134:0/2246359485 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57a40094c0 con 0x7f57b01023f0 2024-02-16T22:31:02.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57acff9640 1 -- 172.21.15.134:0/2246359485 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57a4009620 con 0x7f57b01023f0 2024-02-16T22:31:02.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57b659d640 1 -- 172.21.15.134:0/2246359485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b010cea0 con 0x7f57b01023f0 2024-02-16T22:31:02.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57acff9640 1 -- 172.21.15.134:0/2246359485 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57a403b640 con 0x7f57b01023f0 2024-02-16T22:31:02.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.844+0000 7f57b659d640 1 -- 172.21.15.134:0/2246359485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b010d3c0 con 0x7f57b01023f0 2024-02-16T22:31:02.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.845+0000 7f57b659d640 1 -- 172.21.15.134:0/2246359485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b0064480 con 0x7f57b01023f0 2024-02-16T22:31:02.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.846+0000 7f57acff9640 1 -- 172.21.15.134:0/2246359485 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f57a402f070 con 0x7f57b01023f0 2024-02-16T22:31:02.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.846+0000 7f57acff9640 1 --2- 172.21.15.134:0/2246359485 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f579806d750 0x7f579806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:02.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.846+0000 7f57affff640 1 --2- 172.21.15.134:0/2246359485 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f579806d750 0x7f579806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:02.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.846+0000 7f57acff9640 1 -- 172.21.15.134:0/2246359485 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f57a40af330 con 0x7f57b01023f0 2024-02-16T22:31:02.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.847+0000 7f57affff640 1 --2- 172.21.15.134:0/2246359485 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f579806d750 0x7f579806fc00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f57a0007fd0 tx=0x7f57a0009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:02.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:02.851+0000 7f57acff9640 1 -- 172.21.15.134:0/2246359485 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f57a4078ba0 con 0x7f57b01023f0 2024-02-16T22:31:03.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.058+0000 7f57b659d640 1 -- 172.21.15.134:0/2246359485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f57b00ff6b0 con 0x7f57b01023f0 2024-02-16T22:31:03.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.059+0000 7f57acff9640 1 -- 172.21.15.134:0/2246359485 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v36) v1 ==== 107+0+5018 (secure 0 0 0) 0x7f57a407c260 con 0x7f57b01023f0 2024-02-16T22:31:03.061 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:31:03.061 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44301,"name":"cephfs.smithi173.qljqef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6825/892474824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":892474824},{"type":"v1","addr":"172.21.15.173:6825","nonce":892474824}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44329,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6827/862726270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":862726270},{"type":"v1","addr":"172.21.15.173:6827","nonce":862726270}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:29:17.329991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34382,"mds_1":34414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi134.cygfxr","rank":0,"incarnation":32,"state":"up:resolve","state_seq":18,"addr":"172.21.15.134:6827/845650190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":845650190},{"type":"v1","addr":"172.21.15.134:6827","nonce":845650190}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34414":{"gid":34414,"name":"cephfs.smithi134.jyajef","rank":1,"incarnation":32,"state":"up:resolve","state_seq":14,"addr":"172.21.15.134:6829/3664331772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3664331772},{"type":"v1","addr":"172.21.15.134:6829","nonce":3664331772}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:31:03.061 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 33 2024-02-16T22:31:03.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.061+0000 7f57b659d640 1 -- 172.21.15.134:0/2246359485 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f579806d750 msgr2=0x7f579806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:03.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.061+0000 7f57b659d640 1 --2- 172.21.15.134:0/2246359485 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f579806d750 0x7f579806fc00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f57a0007fd0 tx=0x7f57a0009e90 comp rx=0 tx=0).stop 2024-02-16T22:31:03.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.061+0000 7f57b659d640 1 -- 172.21.15.134:0/2246359485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b01023f0 msgr2=0x7f57b01131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:03.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.061+0000 7f57b659d640 1 --2- 172.21.15.134:0/2246359485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b01023f0 0x7f57b01131c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f57a4031720 tx=0x7f57a4009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.061+0000 7f57b659d640 1 -- 172.21.15.134:0/2246359485 shutdown_connections 2024-02-16T22:31:03.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.061+0000 7f57b659d640 1 --2- 172.21.15.134:0/2246359485 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f579806d750 0x7f579806fc00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.061+0000 7f57b659d640 1 --2- 172.21.15.134:0/2246359485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b01023f0 0x7f57b01131c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.061+0000 7f57b659d640 1 --2- 172.21.15.134:0/2246359485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57b00faa60 0x7f57b0112c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.061+0000 7f57b659d640 1 -- 172.21.15.134:0/2246359485 >> 172.21.15.134:0/2246359485 conn(0x7f57b0071880 msgr2=0x7f57b0105930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:03.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.061+0000 7f57b659d640 1 -- 172.21.15.134:0/2246359485 shutdown_connections 2024-02-16T22:31:03.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.061+0000 7f57b659d640 1 -- 172.21.15.134:0/2246359485 wait complete. 2024-02-16T22:31:03.074 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-02-16T22:31:03.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.170+0000 7f93d559d640 1 -- 172.21.15.134:0/835913336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93d0102370 msgr2=0x7f93d0102740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:03.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.170+0000 7f93d559d640 1 --2- 172.21.15.134:0/835913336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93d0102370 0x7f93d0102740 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009c50 tx=0x7f93c0004d10 comp rx=0 tx=0).stop 2024-02-16T22:31:03.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.170+0000 7f93d559d640 1 -- 172.21.15.134:0/835913336 shutdown_connections 2024-02-16T22:31:03.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.170+0000 7f93d559d640 1 --2- 172.21.15.134:0/835913336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93d0102d10 0x7f93d00644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.170+0000 7f93d559d640 1 --2- 172.21.15.134:0/835913336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93d0102370 0x7f93d0102740 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.170+0000 7f93d559d640 1 -- 172.21.15.134:0/835913336 >> 172.21.15.134:0/835913336 conn(0x7f93d0071230 msgr2=0x7f93d0071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:03.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.170+0000 7f93d559d640 1 -- 172.21.15.134:0/835913336 shutdown_connections 2024-02-16T22:31:03.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.170+0000 7f93d559d640 1 -- 172.21.15.134:0/835913336 wait complete. 2024-02-16T22:31:03.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.171+0000 7f93d559d640 1 Processor -- start 2024-02-16T22:31:03.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.171+0000 7f93d559d640 1 -- start start 2024-02-16T22:31:03.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.171+0000 7f93d559d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93d0102370 0x7f93d0112ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:03.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.171+0000 7f93d559d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93d0102d10 0x7f93d01131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.171+0000 7f93d559d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d01137e0 con 0x7f93d0102370 2024-02-16T22:31:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.171+0000 7f93d559d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d010cd70 con 0x7f93d0102d10 2024-02-16T22:31:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.171+0000 7f93ceffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93d0102370 0x7f93d0112ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.171+0000 7f93ceffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93d0102370 0x7f93d0112ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55472/0 (socket says 172.21.15.134:55472) 2024-02-16T22:31:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.171+0000 7f93ceffd640 1 -- 172.21.15.134:0/662690061 learned_addr learned my addr 172.21.15.134:0/662690061 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.171+0000 7f93ce7fc640 1 --2- 172.21.15.134:0/662690061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93d0102d10 0x7f93d01131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.172+0000 7f93ceffd640 1 -- 172.21.15.134:0/662690061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93d0102d10 msgr2=0x7f93d01131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.172+0000 7f93ceffd640 1 --2- 172.21.15.134:0/662690061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93d0102d10 0x7f93d01131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.172+0000 7f93ceffd640 1 -- 172.21.15.134:0/662690061 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c00098b0 con 0x7f93d0102370 2024-02-16T22:31:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.172+0000 7f93ceffd640 1 --2- 172.21.15.134:0/662690061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93d0102370 0x7f93d0112ca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f93c0004750 tx=0x7f93c0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.172+0000 7f93b77fe640 1 -- 172.21.15.134:0/662690061 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c003a070 con 0x7f93d0102370 2024-02-16T22:31:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.172+0000 7f93b77fe640 1 -- 172.21.15.134:0/662690061 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93c0035b20 con 0x7f93d0102370 2024-02-16T22:31:03.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.172+0000 7f93d559d640 1 -- 172.21.15.134:0/662690061 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d010cff0 con 0x7f93d0102370 2024-02-16T22:31:03.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.172+0000 7f93b77fe640 1 -- 172.21.15.134:0/662690061 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c003ea80 con 0x7f93d0102370 2024-02-16T22:31:03.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.172+0000 7f93d559d640 1 -- 172.21.15.134:0/662690061 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d010d510 con 0x7f93d0102370 2024-02-16T22:31:03.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.173+0000 7f93d559d640 1 -- 172.21.15.134:0/662690061 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d0064030 con 0x7f93d0102370 2024-02-16T22:31:03.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.173+0000 7f93b77fe640 1 -- 172.21.15.134:0/662690061 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f93c0032070 con 0x7f93d0102370 2024-02-16T22:31:03.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.174+0000 7f93b77fe640 1 --2- 172.21.15.134:0/662690061 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f93b806d750 0x7f93b806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:03.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.174+0000 7f93b77fe640 1 -- 172.21.15.134:0/662690061 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f93c00af230 con 0x7f93d0102370 2024-02-16T22:31:03.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.174+0000 7f93ce7fc640 1 --2- 172.21.15.134:0/662690061 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f93b806d750 0x7f93b806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:03.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.174+0000 7f93ce7fc640 1 --2- 172.21.15.134:0/662690061 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f93b806d750 0x7f93b806fc00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f93d010e560 tx=0x7f93c400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:03.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.178+0000 7f93b77fe640 1 -- 172.21.15.134:0/662690061 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f93c0078a20 con 0x7f93d0102370 2024-02-16T22:31:03.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.389+0000 7f93d559d640 1 -- 172.21.15.134:0/662690061 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f93d00ff650 con 0x7f93d0102370 2024-02-16T22:31:03.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.389+0000 7f93b77fe640 1 -- 172.21.15.134:0/662690061 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v36) v1 ==== 107+0+5022 (secure 0 0 0) 0x7f93c009ae60 con 0x7f93d0102370 2024-02-16T22:31:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:31:03.391 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44301,"name":"cephfs.smithi173.qljqef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6825/892474824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":892474824},{"type":"v1","addr":"172.21.15.173:6825","nonce":892474824}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44329,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6827/862726270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":862726270},{"type":"v1","addr":"172.21.15.173:6827","nonce":862726270}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:29:18.186099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34382,"mds_1":34414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi134.cygfxr","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":19,"addr":"172.21.15.134:6827/845650190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":845650190},{"type":"v1","addr":"172.21.15.134:6827","nonce":845650190}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34414":{"gid":34414,"name":"cephfs.smithi134.jyajef","rank":1,"incarnation":32,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.134:6829/3664331772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3664331772},{"type":"v1","addr":"172.21.15.134:6829","nonce":3664331772}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:31:03.391 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 34 2024-02-16T22:31:03.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.391+0000 7f93d559d640 1 -- 172.21.15.134:0/662690061 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f93b806d750 msgr2=0x7f93b806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:03.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.391+0000 7f93d559d640 1 --2- 172.21.15.134:0/662690061 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f93b806d750 0x7f93b806fc00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f93d010e560 tx=0x7f93c400b040 comp rx=0 tx=0).stop 2024-02-16T22:31:03.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.391+0000 7f93d559d640 1 -- 172.21.15.134:0/662690061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93d0102370 msgr2=0x7f93d0112ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:03.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.391+0000 7f93d559d640 1 --2- 172.21.15.134:0/662690061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93d0102370 0x7f93d0112ca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f93c0004750 tx=0x7f93c0004d10 comp rx=0 tx=0).stop 2024-02-16T22:31:03.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.391+0000 7f93d559d640 1 -- 172.21.15.134:0/662690061 shutdown_connections 2024-02-16T22:31:03.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.391+0000 7f93d559d640 1 --2- 172.21.15.134:0/662690061 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f93b806d750 0x7f93b806fc00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.391+0000 7f93d559d640 1 --2- 172.21.15.134:0/662690061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93d0102d10 0x7f93d01131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.391+0000 7f93d559d640 1 --2- 172.21.15.134:0/662690061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93d0102370 0x7f93d0112ca0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.391+0000 7f93d559d640 1 -- 172.21.15.134:0/662690061 >> 172.21.15.134:0/662690061 conn(0x7f93d0071230 msgr2=0x7f93d00fa340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:03.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.391+0000 7f93d559d640 1 -- 172.21.15.134:0/662690061 shutdown_connections 2024-02-16T22:31:03.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.391+0000 7f93d559d640 1 -- 172.21.15.134:0/662690061 wait complete. 2024-02-16T22:31:03.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:03 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/61437248' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-16T22:31:03.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:03 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/4041914441' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-16T22:31:03.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:03 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2246359485' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-16T22:31:03.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:03 smithi134 ceph-mon[112514]: pgmap v262: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:31:03.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-02-16T22:31:03.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:03 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/61437248' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-16T22:31:03.480 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:03 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/4041914441' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-16T22:31:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:03 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2246359485' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-16T22:31:03.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:03 smithi173 ceph-mon[83703]: pgmap v262: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:31:03.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f399d640 1 -- 172.21.15.134:0/485846566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73ec102350 msgr2=0x7f73ec102720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f399d640 1 --2- 172.21.15.134:0/485846566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73ec102350 0x7f73ec102720 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f73e80048d0 tx=0x7f73e8009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f399d640 1 -- 172.21.15.134:0/485846566 shutdown_connections 2024-02-16T22:31:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f399d640 1 --2- 172.21.15.134:0/485846566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73ec102cf0 0x7f73ec0fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f399d640 1 --2- 172.21.15.134:0/485846566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73ec102350 0x7f73ec102720 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f399d640 1 -- 172.21.15.134:0/485846566 >> 172.21.15.134:0/485846566 conn(0x7f73ec0f7ee0 msgr2=0x7f73ec0fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f399d640 1 -- 172.21.15.134:0/485846566 shutdown_connections 2024-02-16T22:31:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f399d640 1 -- 172.21.15.134:0/485846566 wait complete. 2024-02-16T22:31:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f399d640 1 Processor -- start 2024-02-16T22:31:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f399d640 1 -- start start 2024-02-16T22:31:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f399d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73ec102350 0x7f73ec06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f399d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73ec102cf0 0x7f73ec06fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:03.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f399d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec070220 con 0x7f73ec102cf0 2024-02-16T22:31:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f399d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec070390 con 0x7f73ec102350 2024-02-16T22:31:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.501+0000 7f73f0f38640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73ec102cf0 0x7f73ec06fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.502+0000 7f73f0f38640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73ec102cf0 0x7f73ec06fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55480/0 (socket says 172.21.15.134:55480) 2024-02-16T22:31:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.502+0000 7f73f0f38640 1 -- 172.21.15.134:0/3138130670 learned_addr learned my addr 172.21.15.134:0/3138130670 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.502+0000 7f73f1739640 1 --2- 172.21.15.134:0/3138130670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73ec102350 0x7f73ec06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.502+0000 7f73f0f38640 1 -- 172.21.15.134:0/3138130670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73ec102350 msgr2=0x7f73ec06f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.502+0000 7f73f0f38640 1 --2- 172.21.15.134:0/3138130670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73ec102350 0x7f73ec06f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.502+0000 7f73f0f38640 1 -- 172.21.15.134:0/3138130670 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e8005040 con 0x7f73ec102cf0 2024-02-16T22:31:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.502+0000 7f73f1739640 1 --2- 172.21.15.134:0/3138130670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73ec102350 0x7f73ec06f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-16T22:31:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.502+0000 7f73f0f38640 1 --2- 172.21.15.134:0/3138130670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73ec102cf0 0x7f73ec06fce0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00b790 tx=0x7f73dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:03.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.502+0000 7f73e1ffb640 1 -- 172.21.15.134:0/3138130670 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73dc00c700 con 0x7f73ec102cf0 2024-02-16T22:31:03.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.502+0000 7f73f399d640 1 -- 172.21.15.134:0/3138130670 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ec119170 con 0x7f73ec102cf0 2024-02-16T22:31:03.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.502+0000 7f73e1ffb640 1 -- 172.21.15.134:0/3138130670 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f73dc00cd30 con 0x7f73ec102cf0 2024-02-16T22:31:03.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.502+0000 7f73e1ffb640 1 -- 172.21.15.134:0/3138130670 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73dc013370 con 0x7f73ec102cf0 2024-02-16T22:31:03.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.502+0000 7f73f399d640 1 -- 172.21.15.134:0/3138130670 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec1194a0 con 0x7f73ec102cf0 2024-02-16T22:31:03.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.503+0000 7f73f399d640 1 -- 172.21.15.134:0/3138130670 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ec064480 con 0x7f73ec102cf0 2024-02-16T22:31:03.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.504+0000 7f73e1ffb640 1 -- 172.21.15.134:0/3138130670 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f73dc012070 con 0x7f73ec102cf0 2024-02-16T22:31:03.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.504+0000 7f73e1ffb640 1 --2- 172.21.15.134:0/3138130670 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f73d806d750 0x7f73d806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:03.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.504+0000 7f73e1ffb640 1 -- 172.21.15.134:0/3138130670 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f73dc08cb80 con 0x7f73ec102cf0 2024-02-16T22:31:03.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.504+0000 7f73f1739640 1 --2- 172.21.15.134:0/3138130670 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f73d806d750 0x7f73d806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:03.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.505+0000 7f73f1739640 1 --2- 172.21.15.134:0/3138130670 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f73d806d750 0x7f73d806fc00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f73e8000c00 tx=0x7f73e8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.509+0000 7f73e1ffb640 1 -- 172.21.15.134:0/3138130670 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f73dc056370 con 0x7f73ec102cf0 2024-02-16T22:31:03.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.719+0000 7f73f399d640 1 -- 172.21.15.134:0/3138130670 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f73ec109510 con 0x7f73ec102cf0 2024-02-16T22:31:03.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.719+0000 7f73e1ffb640 1 -- 172.21.15.134:0/3138130670 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v36) v1 ==== 107+0+5016 (secure 0 0 0) 0x7f73dc059a30 con 0x7f73ec102cf0 2024-02-16T22:31:03.721 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:31:03.721 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44301,"name":"cephfs.smithi173.qljqef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6825/892474824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":892474824},{"type":"v1","addr":"172.21.15.173:6825","nonce":892474824}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44329,"name":"cephfs.smithi173.phstvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6827/862726270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":862726270},{"type":"v1","addr":"172.21.15.173:6827","nonce":862726270}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-16T22:16:31.472137+0000","modified":"2024-02-16T22:29:19.166689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34382,"mds_1":34414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi134.cygfxr","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":20,"addr":"172.21.15.134:6827/845650190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":845650190},{"type":"v1","addr":"172.21.15.134:6827","nonce":845650190}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34414":{"gid":34414,"name":"cephfs.smithi134.jyajef","rank":1,"incarnation":32,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.134:6829/3664331772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3664331772},{"type":"v1","addr":"172.21.15.134:6829","nonce":3664331772}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-16T22:31:03.721 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 35 2024-02-16T22:31:03.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.721+0000 7f73f399d640 1 -- 172.21.15.134:0/3138130670 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f73d806d750 msgr2=0x7f73d806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:03.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.721+0000 7f73f399d640 1 --2- 172.21.15.134:0/3138130670 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f73d806d750 0x7f73d806fc00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f73e8000c00 tx=0x7f73e8009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.721+0000 7f73f399d640 1 -- 172.21.15.134:0/3138130670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73ec102cf0 msgr2=0x7f73ec06fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:03.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.721+0000 7f73f399d640 1 --2- 172.21.15.134:0/3138130670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73ec102cf0 0x7f73ec06fce0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00b790 tx=0x7f73dc0091d0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.722+0000 7f73f399d640 1 -- 172.21.15.134:0/3138130670 shutdown_connections 2024-02-16T22:31:03.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.722+0000 7f73f399d640 1 --2- 172.21.15.134:0/3138130670 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f73d806d750 0x7f73d806fc00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.722+0000 7f73f399d640 1 --2- 172.21.15.134:0/3138130670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73ec102cf0 0x7f73ec06fce0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.722+0000 7f73f399d640 1 --2- 172.21.15.134:0/3138130670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73ec102350 0x7f73ec06f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.722+0000 7f73f399d640 1 -- 172.21.15.134:0/3138130670 >> 172.21.15.134:0/3138130670 conn(0x7f73ec0f7ee0 msgr2=0x7f73ec0f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:03.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.722+0000 7f73f399d640 1 -- 172.21.15.134:0/3138130670 shutdown_connections 2024-02-16T22:31:03.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.722+0000 7f73f399d640 1 -- 172.21.15.134:0/3138130670 wait complete. 2024-02-16T22:31:03.734 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-16T22:31:03.747 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-16T22:31:03.748 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:31:03.748 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-16T22:31:03.765 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-16T22:31:03.765 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-16T22:31:03.822 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T22:31:03.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.957+0000 7f85b16ae640 1 -- 172.21.15.134:0/1678566382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85ac1022c0 msgr2=0x7f85ac102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:03.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.957+0000 7f85b16ae640 1 --2- 172.21.15.134:0/1678566382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85ac1022c0 0x7f85ac102690 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f859c009c50 tx=0x7f859c004d10 comp rx=0 tx=0).stop 2024-02-16T22:31:03.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.957+0000 7f85b16ae640 1 -- 172.21.15.134:0/1678566382 shutdown_connections 2024-02-16T22:31:03.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.957+0000 7f85b16ae640 1 --2- 172.21.15.134:0/1678566382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85ac102c60 0x7f85ac0fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.957+0000 7f85b16ae640 1 --2- 172.21.15.134:0/1678566382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85ac1022c0 0x7f85ac102690 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.957+0000 7f85b16ae640 1 -- 172.21.15.134:0/1678566382 >> 172.21.15.134:0/1678566382 conn(0x7f85ac0f7ed0 msgr2=0x7f85ac0fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:03.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.957+0000 7f85b16ae640 1 -- 172.21.15.134:0/1678566382 shutdown_connections 2024-02-16T22:31:03.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.957+0000 7f85b16ae640 1 -- 172.21.15.134:0/1678566382 wait complete. 2024-02-16T22:31:03.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.958+0000 7f85b16ae640 1 Processor -- start 2024-02-16T22:31:03.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.958+0000 7f85b16ae640 1 -- start start 2024-02-16T22:31:03.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.958+0000 7f85b16ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85ac1022c0 0x7f85ac112b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:03.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.958+0000 7f85b16ae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85ac102c60 0x7f85ac113050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:03.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.958+0000 7f85b16ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac113650 con 0x7f85ac1022c0 2024-02-16T22:31:03.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.958+0000 7f85b16ae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac10cbe0 con 0x7f85ac102c60 2024-02-16T22:31:03.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.958+0000 7f85aaffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85ac1022c0 0x7f85ac112b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:03.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.958+0000 7f85aaffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85ac1022c0 0x7f85ac112b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55504/0 (socket says 172.21.15.134:55504) 2024-02-16T22:31:03.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.958+0000 7f85aaffd640 1 -- 172.21.15.134:0/1304862543 learned_addr learned my addr 172.21.15.134:0/1304862543 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:03.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.958+0000 7f85aa7fc640 1 --2- 172.21.15.134:0/1304862543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85ac102c60 0x7f85ac113050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:03.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.959+0000 7f85aaffd640 1 -- 172.21.15.134:0/1304862543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85ac102c60 msgr2=0x7f85ac113050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:03.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.959+0000 7f85aaffd640 1 --2- 172.21.15.134:0/1304862543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85ac102c60 0x7f85ac113050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:03.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.959+0000 7f85aaffd640 1 -- 172.21.15.134:0/1304862543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c0098b0 con 0x7f85ac1022c0 2024-02-16T22:31:03.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.959+0000 7f85aaffd640 1 --2- 172.21.15.134:0/1304862543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85ac1022c0 0x7f85ac112b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f859c004a30 tx=0x7f859c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:03.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.959+0000 7f85937fe640 1 -- 172.21.15.134:0/1304862543 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f859c03a070 con 0x7f85ac1022c0 2024-02-16T22:31:03.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.959+0000 7f85937fe640 1 -- 172.21.15.134:0/1304862543 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f859c035b20 con 0x7f85ac1022c0 2024-02-16T22:31:03.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.959+0000 7f85b16ae640 1 -- 172.21.15.134:0/1304862543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac10ce60 con 0x7f85ac1022c0 2024-02-16T22:31:03.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.959+0000 7f85937fe640 1 -- 172.21.15.134:0/1304862543 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f859c03ea70 con 0x7f85ac1022c0 2024-02-16T22:31:03.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.959+0000 7f85b16ae640 1 -- 172.21.15.134:0/1304862543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac10d3a0 con 0x7f85ac1022c0 2024-02-16T22:31:03.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.960+0000 7f85b16ae640 1 -- 172.21.15.134:0/1304862543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ac064030 con 0x7f85ac1022c0 2024-02-16T22:31:03.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.960+0000 7f85937fe640 1 -- 172.21.15.134:0/1304862543 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f859c032070 con 0x7f85ac1022c0 2024-02-16T22:31:03.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.961+0000 7f85937fe640 1 --2- 172.21.15.134:0/1304862543 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f859406d750 0x7f859406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:03.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.961+0000 7f85937fe640 1 -- 172.21.15.134:0/1304862543 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f859c0af0a0 con 0x7f85ac1022c0 2024-02-16T22:31:03.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.961+0000 7f85aa7fc640 1 --2- 172.21.15.134:0/1304862543 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f859406d750 0x7f859406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:03.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.961+0000 7f85aa7fc640 1 --2- 172.21.15.134:0/1304862543 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f859406d750 0x7f859406fc00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f85ac10e3d0 tx=0x7f85a000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:03.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:03.965+0000 7f85937fe640 1 -- 172.21.15.134:0/1304862543 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f859c0789c0 con 0x7f85ac1022c0 2024-02-16T22:31:04.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.139+0000 7f85b16ae640 1 -- 172.21.15.134:0/1304862543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85ac109420 con 0x7f85ac1022c0 2024-02-16T22:31:04.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.140+0000 7f85937fe640 1 -- 172.21.15.134:0/1304862543 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16714 (secure 0 0 0) 0x7f859c07c080 con 0x7f85ac1022c0 2024-02-16T22:31:04.142 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:31:04.142 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":85,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","created":"2024-02-16T22:09:26.274039+0000","modified":"2024-02-16T22:28:56.756353+0000","last_up_change":"2024-02-16T22:28:00.750133+0000","last_in_change":"2024-02-16T22:14:56.818141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T22:14:01.182574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-16T22:16:30.037904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-16T22:16:30.699564+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8e715f3-43f6-439a-be3d-a3bbd70b412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2886656462},{"type":"v1","addr":"172.21.15.134:6803","nonce":2886656462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2886656462},{"type":"v1","addr":"172.21.15.134:6805","nonce":2886656462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2886656462},{"type":"v1","addr":"172.21.15.134:6809","nonce":2886656462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2886656462},{"type":"v1","addr":"172.21.15.134:6807","nonce":2886656462}]},"public_addr":"172.21.15.134:6803/2886656462","cluster_addr":"172.21.15.134:6805/2886656462","heartbeat_back_addr":"172.21.15.134:6809/2886656462","heartbeat_front_addr":"172.21.15.134:6807/2886656462","state":["exists","up"]},{"osd":1,"uuid":"c1fe573e-cb80-4ac7-9d3c-b7e296e86a81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":180212709},{"type":"v1","addr":"172.21.15.134:6811","nonce":180212709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":180212709},{"type":"v1","addr":"172.21.15.134:6813","nonce":180212709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":180212709},{"type":"v1","addr":"172.21.15.134:6817","nonce":180212709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":180212709},{"type":"v1","addr":"172.21.15.134:6815","nonce":180212709}]},"public_addr":"172.21.15.134:6811/180212709","cluster_addr":"172.21.15.134:6813/180212709","heartbeat_back_addr":"172.21.15.134:6817/180212709","heartbeat_front_addr":"172.21.15.134:6815/180212709","state":["exists","up"]},{"osd":2,"uuid":"036c6cf2-7373-46ff-85db-9e0898ad0677","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1465167236},{"type":"v1","addr":"172.21.15.134:6819","nonce":1465167236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1465167236},{"type":"v1","addr":"172.21.15.134:6821","nonce":1465167236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1465167236},{"type":"v1","addr":"172.21.15.134:6825","nonce":1465167236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1465167236},{"type":"v1","addr":"172.21.15.134:6823","nonce":1465167236}]},"public_addr":"172.21.15.134:6819/1465167236","cluster_addr":"172.21.15.134:6821/1465167236","heartbeat_back_addr":"172.21.15.134:6825/1465167236","heartbeat_front_addr":"172.21.15.134:6823/1465167236","state":["exists","up"]},{"osd":3,"uuid":"6a00fd47-f787-4e21-9619-9e9341420b4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1507653386},{"type":"v1","addr":"172.21.15.173:6801","nonce":1507653386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1507653386},{"type":"v1","addr":"172.21.15.173:6803","nonce":1507653386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":1507653386},{"type":"v1","addr":"172.21.15.173:6807","nonce":1507653386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1507653386},{"type":"v1","addr":"172.21.15.173:6805","nonce":1507653386}]},"public_addr":"172.21.15.173:6801/1507653386","cluster_addr":"172.21.15.173:6803/1507653386","heartbeat_back_addr":"172.21.15.173:6807/1507653386","heartbeat_front_addr":"172.21.15.173:6805/1507653386","state":["exists","up"]},{"osd":4,"uuid":"5a314e0e-0951-4462-bb9a-f3614ded4c18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":787878754},{"type":"v1","addr":"172.21.15.173:6809","nonce":787878754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":787878754},{"type":"v1","addr":"172.21.15.173:6811","nonce":787878754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":787878754},{"type":"v1","addr":"172.21.15.173:6815","nonce":787878754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":787878754},{"type":"v1","addr":"172.21.15.173:6813","nonce":787878754}]},"public_addr":"172.21.15.173:6809/787878754","cluster_addr":"172.21.15.173:6811/787878754","heartbeat_back_addr":"172.21.15.173:6815/787878754","heartbeat_front_addr":"172.21.15.173:6813/787878754","state":["exists","up"]},{"osd":5,"uuid":"9d9ce9a3-e735-4265-890c-af2aada1122d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4051147258},{"type":"v1","addr":"172.21.15.173:6817","nonce":4051147258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4051147258},{"type":"v1","addr":"172.21.15.173:6819","nonce":4051147258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4051147258},{"type":"v1","addr":"172.21.15.173:6823","nonce":4051147258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4051147258},{"type":"v1","addr":"172.21.15.173:6821","nonce":4051147258}]},"public_addr":"172.21.15.173:6817/4051147258","cluster_addr":"172.21.15.173:6819/4051147258","heartbeat_back_addr":"172.21.15.173:6823/4051147258","heartbeat_front_addr":"172.21.15.173:6821/4051147258","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:01.314144+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:30.212232+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:58.392610+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:14:22.854647+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:14:48.600782+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:15:13.932090+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6828/3374248278":"2024-02-17T22:28:03.434216+0000","172.21.15.173:6825/122132522":"2024-02-17T22:28:03.434241+0000","172.21.15.134:0/3099284737":"2024-02-17T22:10:30.766785+0000","172.21.15.173:6828/2126919483":"2024-02-17T22:20:58.105398+0000","172.21.15.134:0/3934807828":"2024-02-17T22:19:21.945934+0000","172.21.15.134:6801/2987045407":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/920183098":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/3313361224":"2024-02-17T22:09:59.839885+0000","172.21.15.134:6826/49557312":"2024-02-17T22:16:46.449488+0000","172.21.15.173:0/2291107787":"2024-02-17T22:20:58.105398+0000","172.21.15.134:6800/2987045407":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6827/49557312":"2024-02-17T22:16:46.449488+0000","172.21.15.134:0/2189745948":"2024-02-17T22:19:21.945934+0000","172.21.15.173:0/267147590":"2024-02-17T22:20:58.105398+0000","172.21.15.134:0/1938438068":"2024-02-17T22:19:21.945934+0000","172.21.15.134:0/4134305029":"2024-02-17T22:23:36.980020+0000","172.21.15.134:6801/3459537666":"2024-02-17T22:09:59.839885+0000","172.21.15.134:6801/3164225175":"2024-02-17T22:23:36.980020+0000","172.21.15.134:0/3516783507":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/3010290966":"2024-02-17T22:10:30.766785+0000","172.21.15.134:6800/2578294352":"2024-02-17T22:19:21.945934+0000","172.21.15.134:6800/3520115315":"2024-02-17T22:10:30.766785+0000","172.21.15.134:6801/2578294352":"2024-02-17T22:19:21.945934+0000","172.21.15.134:0/1394270230":"2024-02-17T22:23:36.980020+0000","172.21.15.173:6829/2126919483":"2024-02-17T22:20:58.105398+0000","172.21.15.134:6801/3520115315":"2024-02-17T22:10:30.766785+0000","172.21.15.134:6829/3374248278":"2024-02-17T22:28:03.434216+0000","172.21.15.134:0/1660938940":"2024-02-17T22:19:21.945934+0000","172.21.15.134:0/1667200782":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/3172564602":"2024-02-17T22:11:42.853761+0000","172.21.15.173:0/4220401534":"2024-02-17T22:20:58.105398+0000","172.21.15.173:0/2855616451":"2024-02-17T22:20:58.105398+0000","172.21.15.134:0/994312604":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/2419255497":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/2919414539":"2024-02-17T22:23:36.980020+0000","172.21.15.134:0/3327665682":"2024-02-17T22:23:36.980020+0000","172.21.15.134:6800/3459537666":"2024-02-17T22:09:59.839885+0000","172.21.15.134:6800/3164225175":"2024-02-17T22:23:36.980020+0000","172.21.15.173:6824/122132522":"2024-02-17T22:28:03.434241+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T22:31:04.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.142+0000 7f85b16ae640 1 -- 172.21.15.134:0/1304862543 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f859406d750 msgr2=0x7f859406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:04.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.142+0000 7f85b16ae640 1 --2- 172.21.15.134:0/1304862543 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f859406d750 0x7f859406fc00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f85ac10e3d0 tx=0x7f85a000b040 comp rx=0 tx=0).stop 2024-02-16T22:31:04.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.142+0000 7f85b16ae640 1 -- 172.21.15.134:0/1304862543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85ac1022c0 msgr2=0x7f85ac112b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:04.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.142+0000 7f85b16ae640 1 --2- 172.21.15.134:0/1304862543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85ac1022c0 0x7f85ac112b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f859c004a30 tx=0x7f859c004d10 comp rx=0 tx=0).stop 2024-02-16T22:31:04.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.142+0000 7f85b16ae640 1 -- 172.21.15.134:0/1304862543 shutdown_connections 2024-02-16T22:31:04.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.142+0000 7f85b16ae640 1 --2- 172.21.15.134:0/1304862543 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f859406d750 0x7f859406fc00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.142+0000 7f85b16ae640 1 --2- 172.21.15.134:0/1304862543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85ac102c60 0x7f85ac113050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.142+0000 7f85b16ae640 1 --2- 172.21.15.134:0/1304862543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85ac1022c0 0x7f85ac112b10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.142+0000 7f85b16ae640 1 -- 172.21.15.134:0/1304862543 >> 172.21.15.134:0/1304862543 conn(0x7f85ac0f7ed0 msgr2=0x7f85ac0f97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:04.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.143+0000 7f85b16ae640 1 -- 172.21.15.134:0/1304862543 shutdown_connections 2024-02-16T22:31:04.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.143+0000 7f85b16ae640 1 -- 172.21.15.134:0/1304862543 wait complete. 2024-02-16T22:31:04.155 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-16T22:14:01.182574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-16T22:16:30.037904+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-16T22:16:30.699564+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-16T22:31:04.156 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-16T22:31:04.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.255+0000 7f1caf59d640 1 -- 172.21.15.134:0/1243451911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca8101240 msgr2=0x7f1ca8101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:04.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.255+0000 7f1caf59d640 1 --2- 172.21.15.134:0/1243451911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca8101240 0x7f1ca8101610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40048d0 tx=0x7f1ca4009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.255+0000 7f1caf59d640 1 -- 172.21.15.134:0/1243451911 shutdown_connections 2024-02-16T22:31:04.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.255+0000 7f1caf59d640 1 --2- 172.21.15.134:0/1243451911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ca8101be0 0x7f1ca80fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.255+0000 7f1caf59d640 1 --2- 172.21.15.134:0/1243451911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca8101240 0x7f1ca8101610 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.255+0000 7f1caf59d640 1 -- 172.21.15.134:0/1243451911 >> 172.21.15.134:0/1243451911 conn(0x7f1ca80f6e30 msgr2=0x7f1ca80f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:04.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.255+0000 7f1caf59d640 1 -- 172.21.15.134:0/1243451911 shutdown_connections 2024-02-16T22:31:04.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.255+0000 7f1caf59d640 1 -- 172.21.15.134:0/1243451911 wait complete. 2024-02-16T22:31:04.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.255+0000 7f1caf59d640 1 Processor -- start 2024-02-16T22:31:04.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.255+0000 7f1caf59d640 1 -- start start 2024-02-16T22:31:04.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1caf59d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca8101240 0x7f1ca8111af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:04.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1caf59d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ca8101be0 0x7f1ca8112030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:04.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1caf59d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca8112630 con 0x7f1ca8101240 2024-02-16T22:31:04.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1caf59d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca810bbc0 con 0x7f1ca8101be0 2024-02-16T22:31:04.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1cad339640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca8101240 0x7f1ca8111af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:04.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1cad339640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca8101240 0x7f1ca8111af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55522/0 (socket says 172.21.15.134:55522) 2024-02-16T22:31:04.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1cad339640 1 -- 172.21.15.134:0/1097589527 learned_addr learned my addr 172.21.15.134:0/1097589527 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:04.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1cacb38640 1 --2- 172.21.15.134:0/1097589527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ca8101be0 0x7f1ca8112030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:04.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1cad339640 1 -- 172.21.15.134:0/1097589527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ca8101be0 msgr2=0x7f1ca8112030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:04.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1cad339640 1 --2- 172.21.15.134:0/1097589527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ca8101be0 0x7f1ca8112030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1cad339640 1 -- 172.21.15.134:0/1097589527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca4005040 con 0x7f1ca8101240 2024-02-16T22:31:04.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1cad339640 1 --2- 172.21.15.134:0/1097589527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca8101240 0x7f1ca8111af0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4031720 tx=0x7f1ca4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:04.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1c9dffb640 1 -- 172.21.15.134:0/1097589527 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ca40094c0 con 0x7f1ca8101240 2024-02-16T22:31:04.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1c9dffb640 1 -- 172.21.15.134:0/1097589527 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ca4009620 con 0x7f1ca8101240 2024-02-16T22:31:04.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1caf59d640 1 -- 172.21.15.134:0/1097589527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca810be40 con 0x7f1ca8101240 2024-02-16T22:31:04.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.256+0000 7f1c9dffb640 1 -- 172.21.15.134:0/1097589527 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ca403b640 con 0x7f1ca8101240 2024-02-16T22:31:04.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.257+0000 7f1caf59d640 1 -- 172.21.15.134:0/1097589527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca810c360 con 0x7f1ca8101240 2024-02-16T22:31:04.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.258+0000 7f1caf59d640 1 -- 172.21.15.134:0/1097589527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca8064480 con 0x7f1ca8101240 2024-02-16T22:31:04.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.258+0000 7f1c9dffb640 1 -- 172.21.15.134:0/1097589527 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f1ca402f070 con 0x7f1ca8101240 2024-02-16T22:31:04.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.258+0000 7f1c9dffb640 1 --2- 172.21.15.134:0/1097589527 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1c9406d750 0x7f1c9406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:04.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.258+0000 7f1c9dffb640 1 -- 172.21.15.134:0/1097589527 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f1ca40af4d0 con 0x7f1ca8101240 2024-02-16T22:31:04.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.258+0000 7f1cacb38640 1 --2- 172.21.15.134:0/1097589527 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1c9406d750 0x7f1c9406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:04.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.259+0000 7f1cacb38640 1 --2- 172.21.15.134:0/1097589527 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1c9406d750 0x7f1c9406fc00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1c98007fd0 tx=0x7f1c98009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:04.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.263+0000 7f1c9dffb640 1 -- 172.21.15.134:0/1097589527 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1ca4078cc0 con 0x7f1ca8101240 2024-02-16T22:31:04.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.437+0000 7f1caf59d640 1 -- 172.21.15.134:0/1097589527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ca810d210 con 0x7f1ca8101240 2024-02-16T22:31:04.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.437+0000 7f1c9dffb640 1 -- 172.21.15.134:0/1097589527 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ca810d210 con 0x7f1ca8101240 2024-02-16T22:31:04.439 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-02-16T22:31:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.439+0000 7f1caf59d640 1 -- 172.21.15.134:0/1097589527 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1c9406d750 msgr2=0x7f1c9406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.439+0000 7f1caf59d640 1 --2- 172.21.15.134:0/1097589527 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1c9406d750 0x7f1c9406fc00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1c98007fd0 tx=0x7f1c98009e90 comp rx=0 tx=0).stop 2024-02-16T22:31:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.439+0000 7f1caf59d640 1 -- 172.21.15.134:0/1097589527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca8101240 msgr2=0x7f1ca8111af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.439+0000 7f1caf59d640 1 --2- 172.21.15.134:0/1097589527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca8101240 0x7f1ca8111af0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4031720 tx=0x7f1ca4009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.439+0000 7f1caf59d640 1 -- 172.21.15.134:0/1097589527 shutdown_connections 2024-02-16T22:31:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.439+0000 7f1caf59d640 1 --2- 172.21.15.134:0/1097589527 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f1c9406d750 0x7f1c9406fc00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.439+0000 7f1caf59d640 1 --2- 172.21.15.134:0/1097589527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ca8101be0 0x7f1ca8112030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.439+0000 7f1caf59d640 1 --2- 172.21.15.134:0/1097589527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca8101240 0x7f1ca8111af0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.439+0000 7f1caf59d640 1 -- 172.21.15.134:0/1097589527 >> 172.21.15.134:0/1097589527 conn(0x7f1ca80f6e30 msgr2=0x7f1ca80f8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.439+0000 7f1caf59d640 1 -- 172.21.15.134:0/1097589527 shutdown_connections 2024-02-16T22:31:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.439+0000 7f1caf59d640 1 -- 172.21.15.134:0/1097589527 wait complete. 2024-02-16T22:31:04.450 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:04 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/662690061' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-16T22:31:04.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:04 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/3138130670' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-16T22:31:04.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:04 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1304862543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-16T22:31:04.452 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-16T22:31:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:04 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/662690061' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-16T22:31:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:04 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/3138130670' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-16T22:31:04.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:04 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1304862543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-16T22:31:04.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.550+0000 7ff0a651d640 1 -- 172.21.15.134:0/2475707465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a0101240 msgr2=0x7ff0a0101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:04.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.550+0000 7ff0a651d640 1 --2- 172.21.15.134:0/2475707465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a0101240 0x7ff0a0101610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff0900048d0 tx=0x7ff090009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.550+0000 7ff0a651d640 1 -- 172.21.15.134:0/2475707465 shutdown_connections 2024-02-16T22:31:04.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.550+0000 7ff0a651d640 1 --2- 172.21.15.134:0/2475707465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0a0101be0 0x7ff0a00fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.550+0000 7ff0a651d640 1 --2- 172.21.15.134:0/2475707465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a0101240 0x7ff0a0101610 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.550+0000 7ff0a651d640 1 -- 172.21.15.134:0/2475707465 >> 172.21.15.134:0/2475707465 conn(0x7ff0a00f6e10 msgr2=0x7ff0a00f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:04.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.550+0000 7ff0a651d640 1 -- 172.21.15.134:0/2475707465 shutdown_connections 2024-02-16T22:31:04.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.550+0000 7ff0a651d640 1 -- 172.21.15.134:0/2475707465 wait complete. 2024-02-16T22:31:04.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.550+0000 7ff0a651d640 1 Processor -- start 2024-02-16T22:31:04.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.550+0000 7ff0a651d640 1 -- start start 2024-02-16T22:31:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff0a651d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0a0101240 0x7ff0a010dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff0a651d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a0101be0 0x7ff0a010e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff0a651d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a010e740 con 0x7ff0a0101be0 2024-02-16T22:31:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff0a651d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a010e8b0 con 0x7ff0a0101240 2024-02-16T22:31:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff09f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a0101be0 0x7ff0a010e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff09f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a0101be0 0x7ff0a010e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55534/0 (socket says 172.21.15.134:55534) 2024-02-16T22:31:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff09f7fe640 1 -- 172.21.15.134:0/2664518912 learned_addr learned my addr 172.21.15.134:0/2664518912 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff09ffff640 1 --2- 172.21.15.134:0/2664518912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0a0101240 0x7ff0a010dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff09f7fe640 1 -- 172.21.15.134:0/2664518912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0a0101240 msgr2=0x7ff0a010dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff09f7fe640 1 --2- 172.21.15.134:0/2664518912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0a0101240 0x7ff0a010dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff09f7fe640 1 -- 172.21.15.134:0/2664518912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff090005040 con 0x7ff0a0101be0 2024-02-16T22:31:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff09f7fe640 1 --2- 172.21.15.134:0/2664518912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a0101be0 0x7ff0a010e200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff094002a50 tx=0x7ff094004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff09cff9640 1 -- 172.21.15.134:0/2664518912 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff094007c30 con 0x7ff0a0101be0 2024-02-16T22:31:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff0a651d640 1 -- 172.21.15.134:0/2664518912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a0116d30 con 0x7ff0a0101be0 2024-02-16T22:31:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff09cff9640 1 -- 172.21.15.134:0/2664518912 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff09400f040 con 0x7ff0a0101be0 2024-02-16T22:31:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff09cff9640 1 -- 172.21.15.134:0/2664518912 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff09400db50 con 0x7ff0a0101be0 2024-02-16T22:31:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.551+0000 7ff0a651d640 1 -- 172.21.15.134:0/2664518912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a01170b0 con 0x7ff0a0101be0 2024-02-16T22:31:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.552+0000 7ff0a651d640 1 -- 172.21.15.134:0/2664518912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a0064480 con 0x7ff0a0101be0 2024-02-16T22:31:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.553+0000 7ff09cff9640 1 -- 172.21.15.134:0/2664518912 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff09401c400 con 0x7ff0a0101be0 2024-02-16T22:31:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.553+0000 7ff09cff9640 1 --2- 172.21.15.134:0/2664518912 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff08806d750 0x7ff08806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.553+0000 7ff09cff9640 1 -- 172.21.15.134:0/2664518912 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff09408c760 con 0x7ff0a0101be0 2024-02-16T22:31:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.553+0000 7ff09ffff640 1 --2- 172.21.15.134:0/2664518912 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff08806d750 0x7ff08806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.554+0000 7ff09ffff640 1 --2- 172.21.15.134:0/2664518912 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff08806d750 0x7ff08806fc00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff090000c00 tx=0x7ff090009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:04.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.558+0000 7ff09cff9640 1 -- 172.21.15.134:0/2664518912 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff094056000 con 0x7ff0a0101be0 2024-02-16T22:31:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.730+0000 7ff0a651d640 1 -- 172.21.15.134:0/2664518912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7ff0a01172a0 con 0x7ff0a0101be0 2024-02-16T22:31:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.730+0000 7ff09cff9640 1 -- 172.21.15.134:0/2664518912 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff0940596c0 con 0x7ff0a0101be0 2024-02-16T22:31:04.732 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-16T22:31:04.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.733+0000 7ff0a651d640 1 -- 172.21.15.134:0/2664518912 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff08806d750 msgr2=0x7ff08806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:04.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.733+0000 7ff0a651d640 1 --2- 172.21.15.134:0/2664518912 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff08806d750 0x7ff08806fc00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff090000c00 tx=0x7ff090009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.733+0000 7ff0a651d640 1 -- 172.21.15.134:0/2664518912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a0101be0 msgr2=0x7ff0a010e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:04.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.733+0000 7ff0a651d640 1 --2- 172.21.15.134:0/2664518912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a0101be0 0x7ff0a010e200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff094002a50 tx=0x7ff094004600 comp rx=0 tx=0).stop 2024-02-16T22:31:04.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.733+0000 7ff0a651d640 1 -- 172.21.15.134:0/2664518912 shutdown_connections 2024-02-16T22:31:04.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.733+0000 7ff0a651d640 1 --2- 172.21.15.134:0/2664518912 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7ff08806d750 0x7ff08806fc00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.733+0000 7ff0a651d640 1 --2- 172.21.15.134:0/2664518912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a0101be0 0x7ff0a010e200 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.733+0000 7ff0a651d640 1 --2- 172.21.15.134:0/2664518912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0a0101240 0x7ff0a010dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.733+0000 7ff0a651d640 1 -- 172.21.15.134:0/2664518912 >> 172.21.15.134:0/2664518912 conn(0x7ff0a00f6e10 msgr2=0x7ff0a00f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:04.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.733+0000 7ff0a651d640 1 -- 172.21.15.134:0/2664518912 shutdown_connections 2024-02-16T22:31:04.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.733+0000 7ff0a651d640 1 -- 172.21.15.134:0/2664518912 wait complete. 2024-02-16T22:31:04.745 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-16T22:31:04.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.844+0000 7fee7b75d640 1 -- 172.21.15.134:0/1903851092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee741023e0 msgr2=0x7fee741027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:04.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.844+0000 7fee7b75d640 1 --2- 172.21.15.134:0/1903851092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee741023e0 0x7fee741027b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fee70009c50 tx=0x7fee70004d10 comp rx=0 tx=0).stop 2024-02-16T22:31:04.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.844+0000 7fee7b75d640 1 -- 172.21.15.134:0/1903851092 shutdown_connections 2024-02-16T22:31:04.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.844+0000 7fee7b75d640 1 --2- 172.21.15.134:0/1903851092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee740644b0 0x7fee740648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.844+0000 7fee7b75d640 1 --2- 172.21.15.134:0/1903851092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee741023e0 0x7fee741027b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.844+0000 7fee7b75d640 1 -- 172.21.15.134:0/1903851092 >> 172.21.15.134:0/1903851092 conn(0x7fee74071230 msgr2=0x7fee74071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:04.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.844+0000 7fee7b75d640 1 -- 172.21.15.134:0/1903851092 shutdown_connections 2024-02-16T22:31:04.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.845+0000 7fee7b75d640 1 -- 172.21.15.134:0/1903851092 wait complete. 2024-02-16T22:31:04.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.845+0000 7fee7b75d640 1 Processor -- start 2024-02-16T22:31:04.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.845+0000 7fee7b75d640 1 -- start start 2024-02-16T22:31:04.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.845+0000 7fee7b75d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee740644b0 0x7fee74112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:04.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.845+0000 7fee7b75d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee741023e0 0x7fee741130f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.845+0000 7fee7b75d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee741136f0 con 0x7fee741023e0 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.845+0000 7fee7b75d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7410cc80 con 0x7fee740644b0 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.845+0000 7fee78cf8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee741023e0 0x7fee741130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.845+0000 7fee78cf8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee741023e0 0x7fee741130f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55550/0 (socket says 172.21.15.134:55550) 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.845+0000 7fee78cf8640 1 -- 172.21.15.134:0/2680905521 learned_addr learned my addr 172.21.15.134:0/2680905521 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.845+0000 7fee794f9640 1 --2- 172.21.15.134:0/2680905521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee740644b0 0x7fee74112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.846+0000 7fee78cf8640 1 -- 172.21.15.134:0/2680905521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee740644b0 msgr2=0x7fee74112bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.846+0000 7fee78cf8640 1 --2- 172.21.15.134:0/2680905521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee740644b0 0x7fee74112bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.846+0000 7fee78cf8640 1 -- 172.21.15.134:0/2680905521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee700098b0 con 0x7fee741023e0 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.846+0000 7fee78cf8640 1 --2- 172.21.15.134:0/2680905521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee741023e0 0x7fee741130f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fee6400eb70 tx=0x7fee6400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.846+0000 7fee69ffb640 1 -- 172.21.15.134:0/2680905521 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee64007c30 con 0x7fee741023e0 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.846+0000 7fee7b75d640 1 -- 172.21.15.134:0/2680905521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7410cf00 con 0x7fee741023e0 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.846+0000 7fee69ffb640 1 -- 172.21.15.134:0/2680905521 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee6400f040 con 0x7fee741023e0 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.846+0000 7fee69ffb640 1 -- 172.21.15.134:0/2680905521 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee640095b0 con 0x7fee741023e0 2024-02-16T22:31:04.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.846+0000 7fee7b75d640 1 -- 172.21.15.134:0/2680905521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7410d4a0 con 0x7fee741023e0 2024-02-16T22:31:04.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.847+0000 7fee7b75d640 1 -- 172.21.15.134:0/2680905521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee74064030 con 0x7fee741023e0 2024-02-16T22:31:04.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.847+0000 7fee69ffb640 1 -- 172.21.15.134:0/2680905521 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fee64009730 con 0x7fee741023e0 2024-02-16T22:31:04.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.848+0000 7fee69ffb640 1 --2- 172.21.15.134:0/2680905521 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fee6006d750 0x7fee6006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:04.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.848+0000 7fee69ffb640 1 -- 172.21.15.134:0/2680905521 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fee6408cc10 con 0x7fee741023e0 2024-02-16T22:31:04.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.848+0000 7fee794f9640 1 --2- 172.21.15.134:0/2680905521 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fee6006d750 0x7fee6006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:04.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.848+0000 7fee794f9640 1 --2- 172.21.15.134:0/2680905521 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fee6006d750 0x7fee6006fc00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee70004a30 tx=0x7fee70037040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:04.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:04.852+0000 7fee69ffb640 1 -- 172.21.15.134:0/2680905521 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fee640564b0 con 0x7fee741023e0 2024-02-16T22:31:05.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.023+0000 7fee7b75d640 1 -- 172.21.15.134:0/2680905521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fee7410d6c0 con 0x7fee741023e0 2024-02-16T22:31:05.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.024+0000 7fee69ffb640 1 -- 172.21.15.134:0/2680905521 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fee64059b70 con 0x7fee741023e0 2024-02-16T22:31:05.025 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-16T22:31:05.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.025+0000 7fee7b75d640 1 -- 172.21.15.134:0/2680905521 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fee6006d750 msgr2=0x7fee6006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:05.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.025+0000 7fee7b75d640 1 --2- 172.21.15.134:0/2680905521 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fee6006d750 0x7fee6006fc00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee70004a30 tx=0x7fee70037040 comp rx=0 tx=0).stop 2024-02-16T22:31:05.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.026+0000 7fee7b75d640 1 -- 172.21.15.134:0/2680905521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee741023e0 msgr2=0x7fee741130f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:05.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.026+0000 7fee7b75d640 1 --2- 172.21.15.134:0/2680905521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee741023e0 0x7fee741130f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fee6400eb70 tx=0x7fee6400b040 comp rx=0 tx=0).stop 2024-02-16T22:31:05.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.026+0000 7fee7b75d640 1 -- 172.21.15.134:0/2680905521 shutdown_connections 2024-02-16T22:31:05.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.026+0000 7fee7b75d640 1 --2- 172.21.15.134:0/2680905521 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fee6006d750 0x7fee6006fc00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.026+0000 7fee7b75d640 1 --2- 172.21.15.134:0/2680905521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee741023e0 0x7fee741130f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.026+0000 7fee7b75d640 1 --2- 172.21.15.134:0/2680905521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee740644b0 0x7fee74112bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.026+0000 7fee7b75d640 1 -- 172.21.15.134:0/2680905521 >> 172.21.15.134:0/2680905521 conn(0x7fee74071230 msgr2=0x7fee740fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:05.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.026+0000 7fee7b75d640 1 -- 172.21.15.134:0/2680905521 shutdown_connections 2024-02-16T22:31:05.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.026+0000 7fee7b75d640 1 -- 172.21.15.134:0/2680905521 wait complete. 2024-02-16T22:31:05.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-16T22:31:05.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.135+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1072747765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f4101250 msgr2=0x7fa1f4101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:05.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1fb99d640 1 --2- 172.21.15.134:0/1072747765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f4101250 0x7fa1f4101620 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80048d0 tx=0x7fa1e8009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1072747765 shutdown_connections 2024-02-16T22:31:05.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1fb99d640 1 --2- 172.21.15.134:0/1072747765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1f4101bf0 0x7fa1f40fb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1fb99d640 1 --2- 172.21.15.134:0/1072747765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f4101250 0x7fa1f4101620 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1072747765 >> 172.21.15.134:0/1072747765 conn(0x7fa1f40f6e00 msgr2=0x7fa1f40f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:05.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1072747765 shutdown_connections 2024-02-16T22:31:05.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1072747765 wait complete. 2024-02-16T22:31:05.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1fb99d640 1 Processor -- start 2024-02-16T22:31:05.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1fb99d640 1 -- start start 2024-02-16T22:31:05.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1fb99d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1f4101250 0x7fa1f4112bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:05.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1fb99d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f4101bf0 0x7fa1f4113100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:05.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1fb99d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f4113700 con 0x7fa1f4101bf0 2024-02-16T22:31:05.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1fb99d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f410cc90 con 0x7fa1f4101250 2024-02-16T22:31:05.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1f8f38640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f4101bf0 0x7fa1f4113100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:05.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.136+0000 7fa1f8f38640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f4101bf0 0x7fa1f4113100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55572/0 (socket says 172.21.15.134:55572) 2024-02-16T22:31:05.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.137+0000 7fa1f8f38640 1 -- 172.21.15.134:0/1779834834 learned_addr learned my addr 172.21.15.134:0/1779834834 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:05.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.137+0000 7fa1f9739640 1 --2- 172.21.15.134:0/1779834834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1f4101250 0x7fa1f4112bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:05.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.137+0000 7fa1f8f38640 1 -- 172.21.15.134:0/1779834834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1f4101250 msgr2=0x7fa1f4112bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:05.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.137+0000 7fa1f8f38640 1 --2- 172.21.15.134:0/1779834834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1f4101250 0x7fa1f4112bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.137+0000 7fa1f8f38640 1 -- 172.21.15.134:0/1779834834 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e8005040 con 0x7fa1f4101bf0 2024-02-16T22:31:05.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.137+0000 7fa1f8f38640 1 --2- 172.21.15.134:0/1779834834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f4101bf0 0x7fa1f4113100 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000c830 tx=0x7fa1f0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:05.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.137+0000 7fa1e5ffb640 1 -- 172.21.15.134:0/1779834834 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f000a850 con 0x7fa1f4101bf0 2024-02-16T22:31:05.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.137+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1779834834 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f410cf70 con 0x7fa1f4101bf0 2024-02-16T22:31:05.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.137+0000 7fa1e5ffb640 1 -- 172.21.15.134:0/1779834834 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1f000ae80 con 0x7fa1f4101bf0 2024-02-16T22:31:05.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.137+0000 7fa1e5ffb640 1 -- 172.21.15.134:0/1779834834 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f0012ea0 con 0x7fa1f4101bf0 2024-02-16T22:31:05.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.137+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1779834834 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f410d490 con 0x7fa1f4101bf0 2024-02-16T22:31:05.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.138+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1779834834 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f4064480 con 0x7fa1f4101bf0 2024-02-16T22:31:05.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.139+0000 7fa1e5ffb640 1 -- 172.21.15.134:0/1779834834 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa1f0012400 con 0x7fa1f4101bf0 2024-02-16T22:31:05.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.139+0000 7fa1e5ffb640 1 --2- 172.21.15.134:0/1779834834 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa1e006d750 0x7fa1e006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:05.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.139+0000 7fa1e5ffb640 1 -- 172.21.15.134:0/1779834834 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa1f008d0f0 con 0x7fa1f4101bf0 2024-02-16T22:31:05.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.139+0000 7fa1f9739640 1 --2- 172.21.15.134:0/1779834834 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa1e006d750 0x7fa1e006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:05.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.140+0000 7fa1f9739640 1 --2- 172.21.15.134:0/1779834834 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa1e006d750 0x7fa1e006fc00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8000c00 tx=0x7fa1e8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.144+0000 7fa1e5ffb640 1 -- 172.21.15.134:0/1779834834 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa1f0056960 con 0x7fa1f4101bf0 2024-02-16T22:31:05.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.330+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1779834834 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa1f410e290 con 0x7fa1f4101bf0 2024-02-16T22:31:05.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.331+0000 7fa1e5ffb640 1 -- 172.21.15.134:0/1779834834 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v85) v1 ==== 81+0+2346 (secure 0 0 0) 0x7fa1f00126b0 con 0x7fa1f4101bf0 2024-02-16T22:31:05.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6828/3374248278 2024-02-17T22:28:03.434216+0000 2024-02-16T22:31:05.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:6825/122132522 2024-02-17T22:28:03.434241+0000 2024-02-16T22:31:05.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3099284737 2024-02-17T22:10:30.766785+0000 2024-02-16T22:31:05.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:6828/2126919483 2024-02-17T22:20:58.105398+0000 2024-02-16T22:31:05.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3934807828 2024-02-17T22:19:21.945934+0000 2024-02-16T22:31:05.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/2987045407 2024-02-17T22:11:42.853761+0000 2024-02-16T22:31:05.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/920183098 2024-02-17T22:09:59.839885+0000 2024-02-16T22:31:05.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3313361224 2024-02-17T22:09:59.839885+0000 2024-02-16T22:31:05.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6826/49557312 2024-02-17T22:16:46.449488+0000 2024-02-16T22:31:05.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:0/2291107787 2024-02-17T22:20:58.105398+0000 2024-02-16T22:31:05.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/2987045407 2024-02-17T22:11:42.853761+0000 2024-02-16T22:31:05.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6827/49557312 2024-02-17T22:16:46.449488+0000 2024-02-16T22:31:05.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2189745948 2024-02-17T22:19:21.945934+0000 2024-02-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:0/267147590 2024-02-17T22:20:58.105398+0000 2024-02-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1938438068 2024-02-17T22:19:21.945934+0000 2024-02-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/4134305029 2024-02-17T22:23:36.980020+0000 2024-02-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/3459537666 2024-02-17T22:09:59.839885+0000 2024-02-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/3164225175 2024-02-17T22:23:36.980020+0000 2024-02-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3516783507 2024-02-17T22:11:42.853761+0000 2024-02-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3010290966 2024-02-17T22:10:30.766785+0000 2024-02-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/2578294352 2024-02-17T22:19:21.945934+0000 2024-02-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/3520115315 2024-02-17T22:10:30.766785+0000 2024-02-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/2578294352 2024-02-17T22:19:21.945934+0000 2024-02-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1394270230 2024-02-17T22:23:36.980020+0000 2024-02-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:6829/2126919483 2024-02-17T22:20:58.105398+0000 2024-02-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/3520115315 2024-02-17T22:10:30.766785+0000 2024-02-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6829/3374248278 2024-02-17T22:28:03.434216+0000 2024-02-16T22:31:05.335 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1660938940 2024-02-17T22:19:21.945934+0000 2024-02-16T22:31:05.335 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1667200782 2024-02-17T22:11:42.853761+0000 2024-02-16T22:31:05.335 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3172564602 2024-02-17T22:11:42.853761+0000 2024-02-16T22:31:05.335 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:0/4220401534 2024-02-17T22:20:58.105398+0000 2024-02-16T22:31:05.335 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:0/2855616451 2024-02-17T22:20:58.105398+0000 2024-02-16T22:31:05.335 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/994312604 2024-02-17T22:10:30.766785+0000 2024-02-16T22:31:05.335 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2419255497 2024-02-17T22:09:59.839885+0000 2024-02-16T22:31:05.335 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2919414539 2024-02-17T22:23:36.980020+0000 2024-02-16T22:31:05.335 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3327665682 2024-02-17T22:23:36.980020+0000 2024-02-16T22:31:05.335 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/3459537666 2024-02-17T22:09:59.839885+0000 2024-02-16T22:31:05.335 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/3164225175 2024-02-17T22:23:36.980020+0000 2024-02-16T22:31:05.335 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:6824/122132522 2024-02-17T22:28:03.434241+0000 2024-02-16T22:31:05.336 INFO:teuthology.orchestra.run.smithi134.stderr:listed 39 entries 2024-02-16T22:31:05.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.333+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1779834834 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa1e006d750 msgr2=0x7fa1e006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:05.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.333+0000 7fa1fb99d640 1 --2- 172.21.15.134:0/1779834834 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa1e006d750 0x7fa1e006fc00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8000c00 tx=0x7fa1e8009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.333+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1779834834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f4101bf0 msgr2=0x7fa1f4113100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.333+0000 7fa1fb99d640 1 --2- 172.21.15.134:0/1779834834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f4101bf0 0x7fa1f4113100 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000c830 tx=0x7fa1f0004430 comp rx=0 tx=0).stop 2024-02-16T22:31:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.333+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1779834834 shutdown_connections 2024-02-16T22:31:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.333+0000 7fa1fb99d640 1 --2- 172.21.15.134:0/1779834834 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7fa1e006d750 0x7fa1e006fc00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.333+0000 7fa1fb99d640 1 --2- 172.21.15.134:0/1779834834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f4101bf0 0x7fa1f4113100 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.333+0000 7fa1fb99d640 1 --2- 172.21.15.134:0/1779834834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1f4101250 0x7fa1f4112bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.333+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1779834834 >> 172.21.15.134:0/1779834834 conn(0x7fa1f40f6e00 msgr2=0x7fa1f40656d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.333+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1779834834 shutdown_connections 2024-02-16T22:31:05.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.333+0000 7fa1fb99d640 1 -- 172.21.15.134:0/1779834834 wait complete. 2024-02-16T22:31:05.345 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:05 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1097589527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-16T22:31:05.345 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:05 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2664518912' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-16T22:31:05.345 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:05 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/2680905521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-16T22:31:05.345 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:05 smithi134 ceph-mon[112514]: pgmap v263: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:31:05.346 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-16T22:31:05.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:31:05.346 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-16T22:31:05.373 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T22:31:05.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:31:05.374 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-16T22:31:05.435 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:31:05.435 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-16T22:31:05.456 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-02-16T22:31:05.456 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-16T22:31:05.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:05 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1097589527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-16T22:31:05.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:05 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2664518912' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-16T22:31:05.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:05 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/2680905521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-16T22:31:05.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:05 smithi173 ceph-mon[83703]: pgmap v263: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:31:05.499 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T22:31:05.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.596+0000 7f68056ae640 1 -- 172.21.15.134:0/2695658950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6800101390 msgr2=0x7f6800101760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:05.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.596+0000 7f68056ae640 1 --2- 172.21.15.134:0/2695658950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6800101390 0x7f6800101760 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f67f00048d0 tx=0x7f67f0009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.596+0000 7f68056ae640 1 -- 172.21.15.134:0/2695658950 shutdown_connections 2024-02-16T22:31:05.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.596+0000 7f68056ae640 1 --2- 172.21.15.134:0/2695658950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6800101d30 0x7f68000fb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.596+0000 7f68056ae640 1 --2- 172.21.15.134:0/2695658950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6800101390 0x7f6800101760 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.596+0000 7f68056ae640 1 -- 172.21.15.134:0/2695658950 >> 172.21.15.134:0/2695658950 conn(0x7f68000f6f40 msgr2=0x7f68000f9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:05.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.596+0000 7f68056ae640 1 -- 172.21.15.134:0/2695658950 shutdown_connections 2024-02-16T22:31:05.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.596+0000 7f68056ae640 1 -- 172.21.15.134:0/2695658950 wait complete. 2024-02-16T22:31:05.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.597+0000 7f68056ae640 1 Processor -- start 2024-02-16T22:31:05.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.597+0000 7f68056ae640 1 -- start start 2024-02-16T22:31:05.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.597+0000 7f68056ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6800101390 0x7f680010ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:05.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.597+0000 7f68056ae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6800101d30 0x7f680010e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:05.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.597+0000 7f68056ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680010e870 con 0x7f6800101390 2024-02-16T22:31:05.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.597+0000 7f68056ae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680010e9e0 con 0x7f6800101d30 2024-02-16T22:31:05.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.597+0000 7f67feffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6800101390 0x7f680010ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:05.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.597+0000 7f67feffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6800101390 0x7f680010ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55590/0 (socket says 172.21.15.134:55590) 2024-02-16T22:31:05.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.597+0000 7f67feffd640 1 -- 172.21.15.134:0/233206270 learned_addr learned my addr 172.21.15.134:0/233206270 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:05.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.597+0000 7f67feffd640 1 -- 172.21.15.134:0/233206270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6800101d30 msgr2=0x7f680010e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:05.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.598+0000 7f67feffd640 1 --2- 172.21.15.134:0/233206270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6800101d30 0x7f680010e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.598+0000 7f67feffd640 1 -- 172.21.15.134:0/233206270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0005040 con 0x7f6800101390 2024-02-16T22:31:05.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.598+0000 7f67feffd640 1 --2- 172.21.15.134:0/233206270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6800101390 0x7f680010ddf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f67f0031720 tx=0x7f67f0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:05.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.598+0000 7f67e77fe640 1 -- 172.21.15.134:0/233206270 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67f00094c0 con 0x7f6800101390 2024-02-16T22:31:05.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.598+0000 7f67e77fe640 1 -- 172.21.15.134:0/233206270 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f67f0009620 con 0x7f6800101390 2024-02-16T22:31:05.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.598+0000 7f68056ae640 1 -- 172.21.15.134:0/233206270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680010ec10 con 0x7f6800101390 2024-02-16T22:31:05.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.598+0000 7f67e77fe640 1 -- 172.21.15.134:0/233206270 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67f003b640 con 0x7f6800101390 2024-02-16T22:31:05.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.598+0000 7f68056ae640 1 -- 172.21.15.134:0/233206270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6800117190 con 0x7f6800101390 2024-02-16T22:31:05.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.599+0000 7f68056ae640 1 -- 172.21.15.134:0/233206270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6800064480 con 0x7f6800101390 2024-02-16T22:31:05.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.599+0000 7f67e77fe640 1 -- 172.21.15.134:0/233206270 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f67f002f070 con 0x7f6800101390 2024-02-16T22:31:05.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.600+0000 7f67e77fe640 1 --2- 172.21.15.134:0/233206270 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f67e806d750 0x7f67e806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:05.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.600+0000 7f67fe7fc640 1 --2- 172.21.15.134:0/233206270 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f67e806d750 0x7f67e806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:05.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.600+0000 7f67e77fe640 1 -- 172.21.15.134:0/233206270 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f67f00af390 con 0x7f6800101390 2024-02-16T22:31:05.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.600+0000 7f67fe7fc640 1 --2- 172.21.15.134:0/233206270 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f67e806d750 0x7f67e806fc00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6800066020 tx=0x7f67f4009c50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:05.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.604+0000 7f67e77fe640 1 -- 172.21.15.134:0/233206270 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f67f0078c00 con 0x7f6800101390 2024-02-16T22:31:05.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.782+0000 7f68056ae640 1 -- 172.21.15.134:0/233206270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6800117370 con 0x7f6800101390 2024-02-16T22:31:05.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.783+0000 7f67e77fe640 1 -- 172.21.15.134:0/233206270 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16714 (secure 0 0 0) 0x7f67f007c2c0 con 0x7f6800101390 2024-02-16T22:31:05.785 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-16T22:31:05.785 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":85,"fsid":"f29a5372-cd17-11ee-95ba-87774f69a715","created":"2024-02-16T22:09:26.274039+0000","modified":"2024-02-16T22:28:56.756353+0000","last_up_change":"2024-02-16T22:28:00.750133+0000","last_in_change":"2024-02-16T22:14:56.818141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T22:14:01.182574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-16T22:16:30.037904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-16T22:16:30.699564+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8e715f3-43f6-439a-be3d-a3bbd70b412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2886656462},{"type":"v1","addr":"172.21.15.134:6803","nonce":2886656462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2886656462},{"type":"v1","addr":"172.21.15.134:6805","nonce":2886656462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2886656462},{"type":"v1","addr":"172.21.15.134:6809","nonce":2886656462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2886656462},{"type":"v1","addr":"172.21.15.134:6807","nonce":2886656462}]},"public_addr":"172.21.15.134:6803/2886656462","cluster_addr":"172.21.15.134:6805/2886656462","heartbeat_back_addr":"172.21.15.134:6809/2886656462","heartbeat_front_addr":"172.21.15.134:6807/2886656462","state":["exists","up"]},{"osd":1,"uuid":"c1fe573e-cb80-4ac7-9d3c-b7e296e86a81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":180212709},{"type":"v1","addr":"172.21.15.134:6811","nonce":180212709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":180212709},{"type":"v1","addr":"172.21.15.134:6813","nonce":180212709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":180212709},{"type":"v1","addr":"172.21.15.134:6817","nonce":180212709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":180212709},{"type":"v1","addr":"172.21.15.134:6815","nonce":180212709}]},"public_addr":"172.21.15.134:6811/180212709","cluster_addr":"172.21.15.134:6813/180212709","heartbeat_back_addr":"172.21.15.134:6817/180212709","heartbeat_front_addr":"172.21.15.134:6815/180212709","state":["exists","up"]},{"osd":2,"uuid":"036c6cf2-7373-46ff-85db-9e0898ad0677","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1465167236},{"type":"v1","addr":"172.21.15.134:6819","nonce":1465167236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1465167236},{"type":"v1","addr":"172.21.15.134:6821","nonce":1465167236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1465167236},{"type":"v1","addr":"172.21.15.134:6825","nonce":1465167236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1465167236},{"type":"v1","addr":"172.21.15.134:6823","nonce":1465167236}]},"public_addr":"172.21.15.134:6819/1465167236","cluster_addr":"172.21.15.134:6821/1465167236","heartbeat_back_addr":"172.21.15.134:6825/1465167236","heartbeat_front_addr":"172.21.15.134:6823/1465167236","state":["exists","up"]},{"osd":3,"uuid":"6a00fd47-f787-4e21-9619-9e9341420b4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1507653386},{"type":"v1","addr":"172.21.15.173:6801","nonce":1507653386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1507653386},{"type":"v1","addr":"172.21.15.173:6803","nonce":1507653386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":1507653386},{"type":"v1","addr":"172.21.15.173:6807","nonce":1507653386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1507653386},{"type":"v1","addr":"172.21.15.173:6805","nonce":1507653386}]},"public_addr":"172.21.15.173:6801/1507653386","cluster_addr":"172.21.15.173:6803/1507653386","heartbeat_back_addr":"172.21.15.173:6807/1507653386","heartbeat_front_addr":"172.21.15.173:6805/1507653386","state":["exists","up"]},{"osd":4,"uuid":"5a314e0e-0951-4462-bb9a-f3614ded4c18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":787878754},{"type":"v1","addr":"172.21.15.173:6809","nonce":787878754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":787878754},{"type":"v1","addr":"172.21.15.173:6811","nonce":787878754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":787878754},{"type":"v1","addr":"172.21.15.173:6815","nonce":787878754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":787878754},{"type":"v1","addr":"172.21.15.173:6813","nonce":787878754}]},"public_addr":"172.21.15.173:6809/787878754","cluster_addr":"172.21.15.173:6811/787878754","heartbeat_back_addr":"172.21.15.173:6815/787878754","heartbeat_front_addr":"172.21.15.173:6813/787878754","state":["exists","up"]},{"osd":5,"uuid":"9d9ce9a3-e735-4265-890c-af2aada1122d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4051147258},{"type":"v1","addr":"172.21.15.173:6817","nonce":4051147258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4051147258},{"type":"v1","addr":"172.21.15.173:6819","nonce":4051147258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4051147258},{"type":"v1","addr":"172.21.15.173:6823","nonce":4051147258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4051147258},{"type":"v1","addr":"172.21.15.173:6821","nonce":4051147258}]},"public_addr":"172.21.15.173:6817/4051147258","cluster_addr":"172.21.15.173:6819/4051147258","heartbeat_back_addr":"172.21.15.173:6823/4051147258","heartbeat_front_addr":"172.21.15.173:6821/4051147258","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:01.314144+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:30.212232+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:13:58.392610+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:14:22.854647+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:14:48.600782+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T22:15:13.932090+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6828/3374248278":"2024-02-17T22:28:03.434216+0000","172.21.15.173:6825/122132522":"2024-02-17T22:28:03.434241+0000","172.21.15.134:0/3099284737":"2024-02-17T22:10:30.766785+0000","172.21.15.173:6828/2126919483":"2024-02-17T22:20:58.105398+0000","172.21.15.134:0/3934807828":"2024-02-17T22:19:21.945934+0000","172.21.15.134:6801/2987045407":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/920183098":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/3313361224":"2024-02-17T22:09:59.839885+0000","172.21.15.134:6826/49557312":"2024-02-17T22:16:46.449488+0000","172.21.15.173:0/2291107787":"2024-02-17T22:20:58.105398+0000","172.21.15.134:6800/2987045407":"2024-02-17T22:11:42.853761+0000","172.21.15.134:6827/49557312":"2024-02-17T22:16:46.449488+0000","172.21.15.134:0/2189745948":"2024-02-17T22:19:21.945934+0000","172.21.15.173:0/267147590":"2024-02-17T22:20:58.105398+0000","172.21.15.134:0/1938438068":"2024-02-17T22:19:21.945934+0000","172.21.15.134:0/4134305029":"2024-02-17T22:23:36.980020+0000","172.21.15.134:6801/3459537666":"2024-02-17T22:09:59.839885+0000","172.21.15.134:6801/3164225175":"2024-02-17T22:23:36.980020+0000","172.21.15.134:0/3516783507":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/3010290966":"2024-02-17T22:10:30.766785+0000","172.21.15.134:6800/2578294352":"2024-02-17T22:19:21.945934+0000","172.21.15.134:6800/3520115315":"2024-02-17T22:10:30.766785+0000","172.21.15.134:6801/2578294352":"2024-02-17T22:19:21.945934+0000","172.21.15.134:0/1394270230":"2024-02-17T22:23:36.980020+0000","172.21.15.173:6829/2126919483":"2024-02-17T22:20:58.105398+0000","172.21.15.134:6801/3520115315":"2024-02-17T22:10:30.766785+0000","172.21.15.134:6829/3374248278":"2024-02-17T22:28:03.434216+0000","172.21.15.134:0/1660938940":"2024-02-17T22:19:21.945934+0000","172.21.15.134:0/1667200782":"2024-02-17T22:11:42.853761+0000","172.21.15.134:0/3172564602":"2024-02-17T22:11:42.853761+0000","172.21.15.173:0/4220401534":"2024-02-17T22:20:58.105398+0000","172.21.15.173:0/2855616451":"2024-02-17T22:20:58.105398+0000","172.21.15.134:0/994312604":"2024-02-17T22:10:30.766785+0000","172.21.15.134:0/2419255497":"2024-02-17T22:09:59.839885+0000","172.21.15.134:0/2919414539":"2024-02-17T22:23:36.980020+0000","172.21.15.134:0/3327665682":"2024-02-17T22:23:36.980020+0000","172.21.15.134:6800/3459537666":"2024-02-17T22:09:59.839885+0000","172.21.15.134:6800/3164225175":"2024-02-17T22:23:36.980020+0000","172.21.15.173:6824/122132522":"2024-02-17T22:28:03.434241+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T22:31:05.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.785+0000 7f68056ae640 1 -- 172.21.15.134:0/233206270 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f67e806d750 msgr2=0x7f67e806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:05.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.785+0000 7f68056ae640 1 --2- 172.21.15.134:0/233206270 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f67e806d750 0x7f67e806fc00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6800066020 tx=0x7f67f4009c50 comp rx=0 tx=0).stop 2024-02-16T22:31:05.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.785+0000 7f68056ae640 1 -- 172.21.15.134:0/233206270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6800101390 msgr2=0x7f680010ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:05.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.785+0000 7f68056ae640 1 --2- 172.21.15.134:0/233206270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6800101390 0x7f680010ddf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f67f0031720 tx=0x7f67f0009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.785+0000 7f68056ae640 1 -- 172.21.15.134:0/233206270 shutdown_connections 2024-02-16T22:31:05.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.785+0000 7f68056ae640 1 --2- 172.21.15.134:0/233206270 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f67e806d750 0x7f67e806fc00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.785+0000 7f68056ae640 1 --2- 172.21.15.134:0/233206270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6800101d30 0x7f680010e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.785+0000 7f68056ae640 1 --2- 172.21.15.134:0/233206270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6800101390 0x7f680010ddf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.785+0000 7f68056ae640 1 -- 172.21.15.134:0/233206270 >> 172.21.15.134:0/233206270 conn(0x7f68000f6f40 msgr2=0x7f68000f8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:05.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.785+0000 7f68056ae640 1 -- 172.21.15.134:0/233206270 shutdown_connections 2024-02-16T22:31:05.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.786+0000 7f68056ae640 1 -- 172.21.15.134:0/233206270 wait complete. 2024-02-16T22:31:05.799 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-16T22:14:01.182574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-16T22:16:30.037904+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-16T22:16:30.699564+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-16T22:31:05.799 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-16T22:31:05.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.899+0000 7f811ba25640 1 -- 172.21.15.134:0/3529095678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81140fb2b0 msgr2=0x7f81140fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:05.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.899+0000 7f811ba25640 1 --2- 172.21.15.134:0/3529095678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81140fb2b0 0x7f81140fb700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f81040048d0 tx=0x7f8104009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.899+0000 7f811ba25640 1 -- 172.21.15.134:0/3529095678 shutdown_connections 2024-02-16T22:31:05.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.899+0000 7f811ba25640 1 --2- 172.21.15.134:0/3529095678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81140fb2b0 0x7f81140fb700 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.899+0000 7f811ba25640 1 --2- 172.21.15.134:0/3529095678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81141012d0 0x7f81141016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.899+0000 7f811ba25640 1 -- 172.21.15.134:0/3529095678 >> 172.21.15.134:0/3529095678 conn(0x7f8114071230 msgr2=0x7f8114071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:05.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.900+0000 7f811ba25640 1 -- 172.21.15.134:0/3529095678 shutdown_connections 2024-02-16T22:31:05.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.900+0000 7f811ba25640 1 -- 172.21.15.134:0/3529095678 wait complete. 2024-02-16T22:31:05.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.900+0000 7f811ba25640 1 Processor -- start 2024-02-16T22:31:05.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.900+0000 7f811ba25640 1 -- start start 2024-02-16T22:31:05.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.900+0000 7f811ba25640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81140fb2b0 0x7f811410dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:05.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.900+0000 7f811ba25640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81141012d0 0x7f811410e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:05.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.900+0000 7f811ba25640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811410e810 con 0x7f81140fb2b0 2024-02-16T22:31:05.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.900+0000 7f811ba25640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811410e980 con 0x7f81141012d0 2024-02-16T22:31:05.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.900+0000 7f81197c1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81140fb2b0 0x7f811410dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:05.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.900+0000 7f81197c1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81140fb2b0 0x7f811410dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55600/0 (socket says 172.21.15.134:55600) 2024-02-16T22:31:05.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.900+0000 7f81197c1640 1 -- 172.21.15.134:0/3265529552 learned_addr learned my addr 172.21.15.134:0/3265529552 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:05.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.901+0000 7f8118fc0640 1 --2- 172.21.15.134:0/3265529552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81141012d0 0x7f811410e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:05.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.901+0000 7f81197c1640 1 -- 172.21.15.134:0/3265529552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81141012d0 msgr2=0x7f811410e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:05.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.901+0000 7f81197c1640 1 --2- 172.21.15.134:0/3265529552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81141012d0 0x7f811410e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:05.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.901+0000 7f81197c1640 1 -- 172.21.15.134:0/3265529552 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8104005040 con 0x7f81140fb2b0 2024-02-16T22:31:05.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.901+0000 7f8118fc0640 1 --2- 172.21.15.134:0/3265529552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81141012d0 0x7f811410e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-16T22:31:05.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.901+0000 7f81197c1640 1 --2- 172.21.15.134:0/3265529552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81140fb2b0 0x7f811410dd00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f811000b790 tx=0x7f81100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:05.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.901+0000 7f8109ffb640 1 -- 172.21.15.134:0/3265529552 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f811000c700 con 0x7f81140fb2b0 2024-02-16T22:31:05.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.901+0000 7f8109ffb640 1 -- 172.21.15.134:0/3265529552 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f811000cd30 con 0x7f81140fb2b0 2024-02-16T22:31:05.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.901+0000 7f811ba25640 1 -- 172.21.15.134:0/3265529552 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8114116d70 con 0x7f81140fb2b0 2024-02-16T22:31:05.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.901+0000 7f8109ffb640 1 -- 172.21.15.134:0/3265529552 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8110013370 con 0x7f81140fb2b0 2024-02-16T22:31:05.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.901+0000 7f811ba25640 1 -- 172.21.15.134:0/3265529552 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81141171b0 con 0x7f81140fb2b0 2024-02-16T22:31:05.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.902+0000 7f811ba25640 1 -- 172.21.15.134:0/3265529552 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8114064030 con 0x7f81140fb2b0 2024-02-16T22:31:05.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.902+0000 7f8109ffb640 1 -- 172.21.15.134:0/3265529552 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f8110012070 con 0x7f81140fb2b0 2024-02-16T22:31:05.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.903+0000 7f8109ffb640 1 --2- 172.21.15.134:0/3265529552 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f810006d750 0x7f810006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:05.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.903+0000 7f8109ffb640 1 -- 172.21.15.134:0/3265529552 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f811008cb20 con 0x7f81140fb2b0 2024-02-16T22:31:05.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.903+0000 7f8118fc0640 1 --2- 172.21.15.134:0/3265529552 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f810006d750 0x7f810006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:05.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.903+0000 7f8118fc0640 1 --2- 172.21.15.134:0/3265529552 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f810006d750 0x7f810006fc00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f810402bda0 tx=0x7f8104009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:05.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:05.907+0000 7f8109ffb640 1 -- 172.21.15.134:0/3265529552 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8110056310 con 0x7f81140fb2b0 2024-02-16T22:31:06.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.079+0000 7f811ba25640 1 -- 172.21.15.134:0/3265529552 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8114117400 con 0x7f81140fb2b0 2024-02-16T22:31:06.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.079+0000 7f8109ffb640 1 -- 172.21.15.134:0/3265529552 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81100599d0 con 0x7f81140fb2b0 2024-02-16T22:31:06.081 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-02-16T22:31:06.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.081+0000 7f811ba25640 1 -- 172.21.15.134:0/3265529552 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f810006d750 msgr2=0x7f810006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:06.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.081+0000 7f811ba25640 1 --2- 172.21.15.134:0/3265529552 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f810006d750 0x7f810006fc00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f810402bda0 tx=0x7f8104009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.081+0000 7f811ba25640 1 -- 172.21.15.134:0/3265529552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81140fb2b0 msgr2=0x7f811410dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:06.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.081+0000 7f811ba25640 1 --2- 172.21.15.134:0/3265529552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81140fb2b0 0x7f811410dd00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f811000b790 tx=0x7f81100091d0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.081+0000 7f811ba25640 1 -- 172.21.15.134:0/3265529552 shutdown_connections 2024-02-16T22:31:06.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.081+0000 7f811ba25640 1 --2- 172.21.15.134:0/3265529552 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f810006d750 0x7f810006fc00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.081+0000 7f811ba25640 1 --2- 172.21.15.134:0/3265529552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81141012d0 0x7f811410e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.081+0000 7f811ba25640 1 --2- 172.21.15.134:0/3265529552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81140fb2b0 0x7f811410dd00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.081+0000 7f811ba25640 1 -- 172.21.15.134:0/3265529552 >> 172.21.15.134:0/3265529552 conn(0x7f8114071230 msgr2=0x7f81140fa070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:06.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.081+0000 7f811ba25640 1 -- 172.21.15.134:0/3265529552 shutdown_connections 2024-02-16T22:31:06.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.081+0000 7f811ba25640 1 -- 172.21.15.134:0/3265529552 wait complete. 2024-02-16T22:31:06.094 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-16T22:31:06.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.193+0000 7f0fdc11d640 1 -- 172.21.15.134:0/3112703337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd4101250 msgr2=0x7f0fd4101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:06.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.193+0000 7f0fdc11d640 1 --2- 172.21.15.134:0/3112703337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd4101250 0x7f0fd4101620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00048d0 tx=0x7f0fd0009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.193+0000 7f0fdc11d640 1 -- 172.21.15.134:0/3112703337 shutdown_connections 2024-02-16T22:31:06.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.193+0000 7f0fdc11d640 1 --2- 172.21.15.134:0/3112703337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fd4101bf0 0x7f0fd40fb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.193+0000 7f0fdc11d640 1 --2- 172.21.15.134:0/3112703337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd4101250 0x7f0fd4101620 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.193+0000 7f0fdc11d640 1 -- 172.21.15.134:0/3112703337 >> 172.21.15.134:0/3112703337 conn(0x7f0fd40f6e00 msgr2=0x7f0fd40f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:06.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.193+0000 7f0fdc11d640 1 -- 172.21.15.134:0/3112703337 shutdown_connections 2024-02-16T22:31:06.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.193+0000 7f0fdc11d640 1 -- 172.21.15.134:0/3112703337 wait complete. 2024-02-16T22:31:06.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.193+0000 7f0fdc11d640 1 Processor -- start 2024-02-16T22:31:06.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.193+0000 7f0fdc11d640 1 -- start start 2024-02-16T22:31:06.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fdc11d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fd4101250 0x7f0fd4111b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:06.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fdc11d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd4101bf0 0x7f0fd4112060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:06.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fdc11d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd4112660 con 0x7f0fd4101bf0 2024-02-16T22:31:06.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fdc11d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd410bbf0 con 0x7f0fd4101250 2024-02-16T22:31:06.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fd96b8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd4101bf0 0x7f0fd4112060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:06.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fd96b8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd4101bf0 0x7f0fd4112060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55618/0 (socket says 172.21.15.134:55618) 2024-02-16T22:31:06.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fd96b8640 1 -- 172.21.15.134:0/1780304326 learned_addr learned my addr 172.21.15.134:0/1780304326 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:06.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fd9eb9640 1 --2- 172.21.15.134:0/1780304326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fd4101250 0x7f0fd4111b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:06.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fd96b8640 1 -- 172.21.15.134:0/1780304326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fd4101250 msgr2=0x7f0fd4111b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:06.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fd96b8640 1 --2- 172.21.15.134:0/1780304326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fd4101250 0x7f0fd4111b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fd96b8640 1 -- 172.21.15.134:0/1780304326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd0005040 con 0x7f0fd4101bf0 2024-02-16T22:31:06.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fd96b8640 1 --2- 172.21.15.134:0/1780304326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd4101bf0 0x7f0fd4112060 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400c830 tx=0x7f0fc4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:06.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fca7fc640 1 -- 172.21.15.134:0/1780304326 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fc400a850 con 0x7f0fd4101bf0 2024-02-16T22:31:06.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fca7fc640 1 -- 172.21.15.134:0/1780304326 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0fc400ae80 con 0x7f0fd4101bf0 2024-02-16T22:31:06.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fdc11d640 1 -- 172.21.15.134:0/1780304326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd410bed0 con 0x7f0fd4101bf0 2024-02-16T22:31:06.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fca7fc640 1 -- 172.21.15.134:0/1780304326 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fc4012ea0 con 0x7f0fd4101bf0 2024-02-16T22:31:06.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.194+0000 7f0fdc11d640 1 -- 172.21.15.134:0/1780304326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd410c3f0 con 0x7f0fd4101bf0 2024-02-16T22:31:06.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.195+0000 7f0fdc11d640 1 -- 172.21.15.134:0/1780304326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd4064480 con 0x7f0fd4101bf0 2024-02-16T22:31:06.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.196+0000 7f0fca7fc640 1 -- 172.21.15.134:0/1780304326 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f0fc4012400 con 0x7f0fd4101bf0 2024-02-16T22:31:06.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.196+0000 7f0fca7fc640 1 --2- 172.21.15.134:0/1780304326 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0fc006d750 0x7f0fc006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:06.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.196+0000 7f0fca7fc640 1 -- 172.21.15.134:0/1780304326 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f0fc408d1a0 con 0x7f0fd4101bf0 2024-02-16T22:31:06.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.196+0000 7f0fd9eb9640 1 --2- 172.21.15.134:0/1780304326 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0fc006d750 0x7f0fc006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:06.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.197+0000 7f0fd9eb9640 1 --2- 172.21.15.134:0/1780304326 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0fc006d750 0x7f0fc006fc00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0000c00 tx=0x7f0fd0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:06.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.201+0000 7f0fca7fc640 1 -- 172.21.15.134:0/1780304326 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0fc4056a10 con 0x7f0fd4101bf0 2024-02-16T22:31:06.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.372+0000 7f0fdc11d640 1 -- 172.21.15.134:0/1780304326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f0fd410d1b0 con 0x7f0fd4101bf0 2024-02-16T22:31:06.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.373+0000 7f0fca7fc640 1 -- 172.21.15.134:0/1780304326 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f0fc40126b0 con 0x7f0fd4101bf0 2024-02-16T22:31:06.375 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-16T22:31:06.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.375+0000 7f0fdc11d640 1 -- 172.21.15.134:0/1780304326 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0fc006d750 msgr2=0x7f0fc006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:06.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.375+0000 7f0fdc11d640 1 --2- 172.21.15.134:0/1780304326 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0fc006d750 0x7f0fc006fc00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0000c00 tx=0x7f0fd0009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.375+0000 7f0fdc11d640 1 -- 172.21.15.134:0/1780304326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd4101bf0 msgr2=0x7f0fd4112060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:06.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.375+0000 7f0fdc11d640 1 --2- 172.21.15.134:0/1780304326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd4101bf0 0x7f0fd4112060 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400c830 tx=0x7f0fc4004430 comp rx=0 tx=0).stop 2024-02-16T22:31:06.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.375+0000 7f0fdc11d640 1 -- 172.21.15.134:0/1780304326 shutdown_connections 2024-02-16T22:31:06.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.375+0000 7f0fdc11d640 1 --2- 172.21.15.134:0/1780304326 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f0fc006d750 0x7f0fc006fc00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.375+0000 7f0fdc11d640 1 --2- 172.21.15.134:0/1780304326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd4101bf0 0x7f0fd4112060 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.375+0000 7f0fdc11d640 1 --2- 172.21.15.134:0/1780304326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fd4101250 0x7f0fd4111b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.375+0000 7f0fdc11d640 1 -- 172.21.15.134:0/1780304326 >> 172.21.15.134:0/1780304326 conn(0x7f0fd40f6e00 msgr2=0x7f0fd40f8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:06.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.375+0000 7f0fdc11d640 1 -- 172.21.15.134:0/1780304326 shutdown_connections 2024-02-16T22:31:06.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.375+0000 7f0fdc11d640 1 -- 172.21.15.134:0/1780304326 wait complete. 2024-02-16T22:31:06.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:06 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1779834834' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-16T22:31:06.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:06 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/233206270' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-16T22:31:06.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:06 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/3265529552' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-16T22:31:06.387 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-16T22:31:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:06 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1779834834' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-16T22:31:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:06 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/233206270' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-16T22:31:06.481 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:06 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/3265529552' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-16T22:31:06.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.486+0000 7f4f0239d640 1 -- 172.21.15.134:0/3138015922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4efc101be0 msgr2=0x7f4efc0fb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:06.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.486+0000 7f4f0239d640 1 --2- 172.21.15.134:0/3138015922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4efc101be0 0x7f4efc0fb270 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0048d0 tx=0x7f4eec009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.486+0000 7f4f0239d640 1 -- 172.21.15.134:0/3138015922 shutdown_connections 2024-02-16T22:31:06.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.486+0000 7f4f0239d640 1 --2- 172.21.15.134:0/3138015922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4efc101be0 0x7f4efc0fb270 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.486+0000 7f4f0239d640 1 --2- 172.21.15.134:0/3138015922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4efc101240 0x7f4efc101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.486+0000 7f4f0239d640 1 -- 172.21.15.134:0/3138015922 >> 172.21.15.134:0/3138015922 conn(0x7f4efc0f6e10 msgr2=0x7f4efc0f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:06.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.486+0000 7f4f0239d640 1 -- 172.21.15.134:0/3138015922 shutdown_connections 2024-02-16T22:31:06.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.486+0000 7f4f0239d640 1 -- 172.21.15.134:0/3138015922 wait complete. 2024-02-16T22:31:06.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.486+0000 7f4f0239d640 1 Processor -- start 2024-02-16T22:31:06.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.486+0000 7f4f0239d640 1 -- start start 2024-02-16T22:31:06.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4f0239d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4efc101240 0x7f4efc111b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:06.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4f0239d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4efc101be0 0x7f4efc112080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:06.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4f0239d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc112680 con 0x7f4efc101be0 2024-02-16T22:31:06.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4f0239d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc10bc10 con 0x7f4efc101240 2024-02-16T22:31:06.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4efb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4efc101be0 0x7f4efc112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:06.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4efb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4efc101be0 0x7f4efc112080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55634/0 (socket says 172.21.15.134:55634) 2024-02-16T22:31:06.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4efb7fe640 1 -- 172.21.15.134:0/3187500776 learned_addr learned my addr 172.21.15.134:0/3187500776 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:06.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4efbfff640 1 --2- 172.21.15.134:0/3187500776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4efc101240 0x7f4efc111b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:06.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4efb7fe640 1 -- 172.21.15.134:0/3187500776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4efc101240 msgr2=0x7f4efc111b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:06.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4efb7fe640 1 --2- 172.21.15.134:0/3187500776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4efc101240 0x7f4efc111b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4efb7fe640 1 -- 172.21.15.134:0/3187500776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec005040 con 0x7f4efc101be0 2024-02-16T22:31:06.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4efb7fe640 1 --2- 172.21.15.134:0/3187500776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4efc101be0 0x7f4efc112080 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4eec031720 tx=0x7f4eec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:06.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4ef8ff9640 1 -- 172.21.15.134:0/3187500776 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eec0094c0 con 0x7f4efc101be0 2024-02-16T22:31:06.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4ef8ff9640 1 -- 172.21.15.134:0/3187500776 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4eec009620 con 0x7f4efc101be0 2024-02-16T22:31:06.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4f0239d640 1 -- 172.21.15.134:0/3187500776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4efc10be90 con 0x7f4efc101be0 2024-02-16T22:31:06.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4ef8ff9640 1 -- 172.21.15.134:0/3187500776 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eec03b640 con 0x7f4efc101be0 2024-02-16T22:31:06.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.487+0000 7f4f0239d640 1 -- 172.21.15.134:0/3187500776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc10c3b0 con 0x7f4efc101be0 2024-02-16T22:31:06.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.488+0000 7f4f0239d640 1 -- 172.21.15.134:0/3187500776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4efc064480 con 0x7f4efc101be0 2024-02-16T22:31:06.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.489+0000 7f4ef8ff9640 1 -- 172.21.15.134:0/3187500776 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f4eec02f070 con 0x7f4efc101be0 2024-02-16T22:31:06.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.489+0000 7f4ef8ff9640 1 --2- 172.21.15.134:0/3187500776 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4ee406d750 0x7f4ee406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:06.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.489+0000 7f4efbfff640 1 --2- 172.21.15.134:0/3187500776 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4ee406d750 0x7f4ee406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:06.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.489+0000 7f4ef8ff9640 1 -- 172.21.15.134:0/3187500776 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4eec0af420 con 0x7f4efc101be0 2024-02-16T22:31:06.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.490+0000 7f4efbfff640 1 --2- 172.21.15.134:0/3187500776 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4ee406d750 0x7f4ee406fc00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0007fd0 tx=0x7f4ef0009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:06.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.494+0000 7f4ef8ff9640 1 -- 172.21.15.134:0/3187500776 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4eec078c10 con 0x7f4efc101be0 2024-02-16T22:31:06.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.666+0000 7f4f0239d640 1 -- 172.21.15.134:0/3187500776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f4efc10d140 con 0x7f4efc101be0 2024-02-16T22:31:06.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.666+0000 7f4ef8ff9640 1 -- 172.21.15.134:0/3187500776 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4eec07c2d0 con 0x7f4efc101be0 2024-02-16T22:31:06.668 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-16T22:31:06.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.668+0000 7f4f0239d640 1 -- 172.21.15.134:0/3187500776 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4ee406d750 msgr2=0x7f4ee406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:06.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.668+0000 7f4f0239d640 1 --2- 172.21.15.134:0/3187500776 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4ee406d750 0x7f4ee406fc00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0007fd0 tx=0x7f4ef0009e90 comp rx=0 tx=0).stop 2024-02-16T22:31:06.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.668+0000 7f4f0239d640 1 -- 172.21.15.134:0/3187500776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4efc101be0 msgr2=0x7f4efc112080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:06.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.668+0000 7f4f0239d640 1 --2- 172.21.15.134:0/3187500776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4efc101be0 0x7f4efc112080 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4eec031720 tx=0x7f4eec009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.668+0000 7f4f0239d640 1 -- 172.21.15.134:0/3187500776 shutdown_connections 2024-02-16T22:31:06.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.668+0000 7f4f0239d640 1 --2- 172.21.15.134:0/3187500776 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f4ee406d750 0x7f4ee406fc00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.668+0000 7f4f0239d640 1 --2- 172.21.15.134:0/3187500776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4efc101be0 0x7f4efc112080 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.668+0000 7f4f0239d640 1 --2- 172.21.15.134:0/3187500776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4efc101240 0x7f4efc111b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.668+0000 7f4f0239d640 1 -- 172.21.15.134:0/3187500776 >> 172.21.15.134:0/3187500776 conn(0x7f4efc0f6e10 msgr2=0x7f4efc0f8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:06.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.668+0000 7f4f0239d640 1 -- 172.21.15.134:0/3187500776 shutdown_connections 2024-02-16T22:31:06.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.668+0000 7f4f0239d640 1 -- 172.21.15.134:0/3187500776 wait complete. 2024-02-16T22:31:06.681 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-16T22:31:06.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.778+0000 7f2f7706e640 1 -- 172.21.15.134:0/1672735037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f700fe300 msgr2=0x7f2f700fe6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:06.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.778+0000 7f2f7706e640 1 --2- 172.21.15.134:0/1672735037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f700fe300 0x7f2f700fe6d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2f640048d0 tx=0x7f2f64009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.778+0000 7f2f7706e640 1 -- 172.21.15.134:0/1672735037 shutdown_connections 2024-02-16T22:31:06.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.778+0000 7f2f7706e640 1 --2- 172.21.15.134:0/1672735037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f700faa70 0x7f2f700faee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.778+0000 7f2f7706e640 1 --2- 172.21.15.134:0/1672735037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f700fe300 0x7f2f700fe6d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.778+0000 7f2f7706e640 1 -- 172.21.15.134:0/1672735037 >> 172.21.15.134:0/1672735037 conn(0x7f2f70071950 msgr2=0x7f2f70071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:06.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.778+0000 7f2f7706e640 1 -- 172.21.15.134:0/1672735037 shutdown_connections 2024-02-16T22:31:06.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.778+0000 7f2f7706e640 1 -- 172.21.15.134:0/1672735037 wait complete. 2024-02-16T22:31:06.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.778+0000 7f2f7706e640 1 Processor -- start 2024-02-16T22:31:06.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.779+0000 7f2f7706e640 1 -- start start 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.779+0000 7f2f7706e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f700faa70 0x7f2f70112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.779+0000 7f2f7706e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f700fe300 0x7f2f70113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.779+0000 7f2f7706e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f701138c0 con 0x7f2f700fe300 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.779+0000 7f2f7706e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7010cdc0 con 0x7f2f700faa70 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.779+0000 7f2f6ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f700fe300 0x7f2f70113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.779+0000 7f2f6ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f700fe300 0x7f2f70113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55642/0 (socket says 172.21.15.134:55642) 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.779+0000 7f2f6ffff640 1 -- 172.21.15.134:0/146233303 learned_addr learned my addr 172.21.15.134:0/146233303 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.779+0000 7f2f6ffff640 1 -- 172.21.15.134:0/146233303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f700faa70 msgr2=0x7f2f70112cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.779+0000 7f2f74e0a640 1 --2- 172.21.15.134:0/146233303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f700faa70 0x7f2f70112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.779+0000 7f2f6ffff640 1 --2- 172.21.15.134:0/146233303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f700faa70 0x7f2f70112cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.779+0000 7f2f6ffff640 1 -- 172.21.15.134:0/146233303 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f64005040 con 0x7f2f700fe300 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.779+0000 7f2f6ffff640 1 --2- 172.21.15.134:0/146233303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f700fe300 0x7f2f70113230 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00b790 tx=0x7f2f5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.780+0000 7f2f6d7fa640 1 -- 172.21.15.134:0/146233303 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f5c00c700 con 0x7f2f700fe300 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.780+0000 7f2f6d7fa640 1 -- 172.21.15.134:0/146233303 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f5c00cd30 con 0x7f2f700fe300 2024-02-16T22:31:06.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.780+0000 7f2f6d7fa640 1 -- 172.21.15.134:0/146233303 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f5c013370 con 0x7f2f700fe300 2024-02-16T22:31:06.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.780+0000 7f2f7706e640 1 -- 172.21.15.134:0/146233303 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7010d0a0 con 0x7f2f700fe300 2024-02-16T22:31:06.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.780+0000 7f2f7706e640 1 -- 172.21.15.134:0/146233303 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7010d5c0 con 0x7f2f700fe300 2024-02-16T22:31:06.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.781+0000 7f2f7706e640 1 -- 172.21.15.134:0/146233303 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f70064480 con 0x7f2f700fe300 2024-02-16T22:31:06.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.781+0000 7f2f6d7fa640 1 -- 172.21.15.134:0/146233303 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2f5c012070 con 0x7f2f700fe300 2024-02-16T22:31:06.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.781+0000 7f2f6d7fa640 1 --2- 172.21.15.134:0/146233303 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f2f6006d750 0x7f2f6006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T22:31:06.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.781+0000 7f2f6d7fa640 1 -- 172.21.15.134:0/146233303 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2f5c08cb80 con 0x7f2f700fe300 2024-02-16T22:31:06.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.781+0000 7f2f74e0a640 1 --2- 172.21.15.134:0/146233303 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f2f6006d750 0x7f2f6006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T22:31:06.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.782+0000 7f2f74e0a640 1 --2- 172.21.15.134:0/146233303 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f2f6006d750 0x7f2f6006fc00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2f6402bda0 tx=0x7f2f64009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T22:31:06.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.786+0000 7f2f6d7fa640 1 -- 172.21.15.134:0/146233303 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2f5c056370 con 0x7f2f700fe300 2024-02-16T22:31:06.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.968+0000 7f2f7706e640 1 -- 172.21.15.134:0/146233303 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2f7010e2f0 con 0x7f2f700fe300 2024-02-16T22:31:06.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.968+0000 7f2f6d7fa640 1 -- 172.21.15.134:0/146233303 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v85) v1 ==== 81+0+2346 (secure 0 0 0) 0x7f2f5c059a30 con 0x7f2f700fe300 2024-02-16T22:31:06.970 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6828/3374248278 2024-02-17T22:28:03.434216+0000 2024-02-16T22:31:06.970 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:6825/122132522 2024-02-17T22:28:03.434241+0000 2024-02-16T22:31:06.970 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3099284737 2024-02-17T22:10:30.766785+0000 2024-02-16T22:31:06.971 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:6828/2126919483 2024-02-17T22:20:58.105398+0000 2024-02-16T22:31:06.971 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3934807828 2024-02-17T22:19:21.945934+0000 2024-02-16T22:31:06.971 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/2987045407 2024-02-17T22:11:42.853761+0000 2024-02-16T22:31:06.971 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/920183098 2024-02-17T22:09:59.839885+0000 2024-02-16T22:31:06.971 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3313361224 2024-02-17T22:09:59.839885+0000 2024-02-16T22:31:06.971 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6826/49557312 2024-02-17T22:16:46.449488+0000 2024-02-16T22:31:06.971 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:0/2291107787 2024-02-17T22:20:58.105398+0000 2024-02-16T22:31:06.971 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/2987045407 2024-02-17T22:11:42.853761+0000 2024-02-16T22:31:06.971 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6827/49557312 2024-02-17T22:16:46.449488+0000 2024-02-16T22:31:06.971 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2189745948 2024-02-17T22:19:21.945934+0000 2024-02-16T22:31:06.971 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:0/267147590 2024-02-17T22:20:58.105398+0000 2024-02-16T22:31:06.971 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1938438068 2024-02-17T22:19:21.945934+0000 2024-02-16T22:31:06.971 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/4134305029 2024-02-17T22:23:36.980020+0000 2024-02-16T22:31:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/3459537666 2024-02-17T22:09:59.839885+0000 2024-02-16T22:31:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/3164225175 2024-02-17T22:23:36.980020+0000 2024-02-16T22:31:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3516783507 2024-02-17T22:11:42.853761+0000 2024-02-16T22:31:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3010290966 2024-02-17T22:10:30.766785+0000 2024-02-16T22:31:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/2578294352 2024-02-17T22:19:21.945934+0000 2024-02-16T22:31:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/3520115315 2024-02-17T22:10:30.766785+0000 2024-02-16T22:31:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/2578294352 2024-02-17T22:19:21.945934+0000 2024-02-16T22:31:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1394270230 2024-02-17T22:23:36.980020+0000 2024-02-16T22:31:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:6829/2126919483 2024-02-17T22:20:58.105398+0000 2024-02-16T22:31:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/3520115315 2024-02-17T22:10:30.766785+0000 2024-02-16T22:31:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6829/3374248278 2024-02-17T22:28:03.434216+0000 2024-02-16T22:31:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1660938940 2024-02-17T22:19:21.945934+0000 2024-02-16T22:31:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1667200782 2024-02-17T22:11:42.853761+0000 2024-02-16T22:31:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3172564602 2024-02-17T22:11:42.853761+0000 2024-02-16T22:31:06.973 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:0/4220401534 2024-02-17T22:20:58.105398+0000 2024-02-16T22:31:06.973 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:0/2855616451 2024-02-17T22:20:58.105398+0000 2024-02-16T22:31:06.973 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/994312604 2024-02-17T22:10:30.766785+0000 2024-02-16T22:31:06.973 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2419255497 2024-02-17T22:09:59.839885+0000 2024-02-16T22:31:06.973 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2919414539 2024-02-17T22:23:36.980020+0000 2024-02-16T22:31:06.973 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3327665682 2024-02-17T22:23:36.980020+0000 2024-02-16T22:31:06.973 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/3459537666 2024-02-17T22:09:59.839885+0000 2024-02-16T22:31:06.973 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/3164225175 2024-02-17T22:23:36.980020+0000 2024-02-16T22:31:06.973 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.173:6824/122132522 2024-02-17T22:28:03.434241+0000 2024-02-16T22:31:06.974 INFO:teuthology.orchestra.run.smithi134.stderr:listed 39 entries 2024-02-16T22:31:06.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.970+0000 7f2f7706e640 1 -- 172.21.15.134:0/146233303 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f2f6006d750 msgr2=0x7f2f6006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:06.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.970+0000 7f2f7706e640 1 --2- 172.21.15.134:0/146233303 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f2f6006d750 0x7f2f6006fc00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2f6402bda0 tx=0x7f2f64009da0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.970+0000 7f2f7706e640 1 -- 172.21.15.134:0/146233303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f700fe300 msgr2=0x7f2f70113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T22:31:06.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.970+0000 7f2f7706e640 1 --2- 172.21.15.134:0/146233303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f700fe300 0x7f2f70113230 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00b790 tx=0x7f2f5c0091d0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.970+0000 7f2f7706e640 1 -- 172.21.15.134:0/146233303 shutdown_connections 2024-02-16T22:31:06.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.971+0000 7f2f7706e640 1 --2- 172.21.15.134:0/146233303 >> [v2:172.21.15.134:6800/2709326132,v1:172.21.15.134:6801/2709326132] conn(0x7f2f6006d750 0x7f2f6006fc00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.971+0000 7f2f7706e640 1 --2- 172.21.15.134:0/146233303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f700fe300 0x7f2f70113230 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.971+0000 7f2f7706e640 1 --2- 172.21.15.134:0/146233303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f700faa70 0x7f2f70112cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T22:31:06.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.971+0000 7f2f7706e640 1 -- 172.21.15.134:0/146233303 >> 172.21.15.134:0/146233303 conn(0x7f2f70071950 msgr2=0x7f2f700f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T22:31:06.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.971+0000 7f2f7706e640 1 -- 172.21.15.134:0/146233303 shutdown_connections 2024-02-16T22:31:06.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-16T22:31:06.971+0000 7f2f7706e640 1 -- 172.21.15.134:0/146233303 wait complete. 2024-02-16T22:31:06.983 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-16T22:31:06.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:31:06.984 DEBUG:teuthology.orchestra.run.smithi173:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-16T22:31:07.020 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-02-16T22:31:07.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:31:07.020 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-16T22:31:07.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:31:07.091 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-02-16T22:31:07.106 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-16T22:31:07.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:31:07.107 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-16T22:31:07.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:31:07.174 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-02-16T22:31:07.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:07 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/1780304326' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-16T22:31:07.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:07 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/3187500776' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-16T22:31:07.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:07 smithi134 ceph-mon[112514]: from='client.? 172.21.15.134:0/146233303' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-16T22:31:07.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:07 smithi134 ceph-mon[112514]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:31:07.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:07 smithi134 ceph-mon[112514]: pgmap v264: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:31:07.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:31:07.273 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-02-16T22:31:07.292 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-16T22:31:07.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:31:07.293 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-16T22:31:07.360 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:07 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/1780304326' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-16T22:31:07.361 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:07 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/3187500776' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-16T22:31:07.361 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:07 smithi173 ceph-mon[83703]: from='client.? 172.21.15.134:0/146233303' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-16T22:31:07.361 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:07 smithi173 ceph-mon[83703]: from='mgr.34104 172.21.15.134:0/3602887879' entity='mgr.smithi134.ordace' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-16T22:31:07.361 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:07 smithi173 ceph-mon[83703]: pgmap v264: 65 pgs: 65 active+clean; 302 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-16T22:31:07.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-16T22:31:07.365 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link delete ceph-brx 2024-02-16T22:31:07.468 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-02-16T22:31:07.479 ERROR:teuthology.run_tasks:Manager failed: full_sequential_finally Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/full_sequential_finally.py", line 43, in task ((taskname, confg),) = entry.items() ValueError: too many values to unpack (expected 1) 2024-02-16T22:31:07.480 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-16T22:31:07.494 INFO:tasks.cephadm:Teardown begin 2024-02-16T22:31:07.494 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_ed7ab725e1a43615009dfb74a42bf33d80081bc8/qa/tasks/cephadm.py", line 1807, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/full_sequential_finally.py", line 43, in task ((taskname, confg),) = entry.items() ValueError: too many values to unpack (expected 1) 2024-02-16T22:31:07.495 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-16T22:31:07.523 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-16T22:31:07.554 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-16T22:31:07.554 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-16T22:31:07.578 DEBUG:teuthology.orchestra.run.smithi173:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-16T22:31:07.609 INFO:tasks.cephadm:Stopping all daemons... 2024-02-16T22:31:07.610 INFO:tasks.cephadm.mon.smithi134:Stopping mon.smithi134... 2024-02-16T22:31:07.610 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi134 2024-02-16T22:31:07.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:07 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:31:08.226 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:07 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134[112510]: 2024-02-16T22:31:07.952+0000 7ffa01fa0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:31:08.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:07 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134[112510]: 2024-02-16T22:31:07.952+0000 7ffa01fa0700 -1 mon.smithi134@0(leader) e3 *** Got Signal Terminated *** 2024-02-16T22:31:08.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:08 smithi134 podman[153571]: 2024-02-16 22:31:08.004299054 +0000 UTC m=+0.203063362 container died 2903b3988442cf5c0bc6558ed26b4ab10bcce04f0fe1e4677991099afb33bb9b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-16T22:31:08.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:08 smithi134 podman[153571]: 2024-02-16 22:31:08.445400957 +0000 UTC m=+0.644165261 container cleanup 2903b3988442cf5c0bc6558ed26b4ab10bcce04f0fe1e4677991099afb33bb9b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-02-16T22:31:08.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Feb 16 22:31:08 smithi134 bash[153571]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi134 2024-02-16T22:31:08.919 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi134.service' 2024-02-16T22:31:08.966 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-16T22:31:08.967 INFO:tasks.cephadm.mon.smithi134:Stopped mon.smithi134 2024-02-16T22:31:08.967 INFO:tasks.cephadm.mon.smithi173:Stopping mon.smithi173... 2024-02-16T22:31:08.967 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi173 2024-02-16T22:31:09.289 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:09 smithi173 systemd[1]: Stopping Ceph mon.smithi173 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:31:09.671 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:09 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173[83699]: 2024-02-16T22:31:09.285+0000 7f2dccfd9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi173 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:31:09.671 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:09 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173[83699]: 2024-02-16T22:31:09.285+0000 7f2dccfd9700 -1 mon.smithi173@1(peon) e3 *** Got Signal Terminated *** 2024-02-16T22:31:09.672 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:09 smithi173 podman[115414]: 2024-02-16 22:31:09.39926158 +0000 UTC m=+0.239417438 container died dd7cf2f31226861e276dcbe1b73025354ff34eb8380a21eb7f0a2caf7ca7bfde (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:31:09.980 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:09 smithi173 podman[115414]: 2024-02-16 22:31:09.870500302 +0000 UTC m=+0.710656169 container cleanup dd7cf2f31226861e276dcbe1b73025354ff34eb8380a21eb7f0a2caf7ca7bfde (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-16T22:31:09.981 INFO:journalctl@ceph.mon.smithi173.smithi173.stdout:Feb 16 22:31:09 smithi173 bash[115414]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-mon-smithi173 2024-02-16T22:31:10.302 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@mon.smithi173.service' 2024-02-16T22:31:10.350 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-16T22:31:10.350 INFO:tasks.cephadm.mon.smithi173:Stopped mon.smithi173 2024-02-16T22:31:10.350 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-16T22:31:10.350 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.0 2024-02-16T22:31:10.677 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:10 smithi134 systemd[1]: Stopping Ceph osd.0 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:31:10.977 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:10 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0[124038]: 2024-02-16T22:31:10.674+0000 7f1bd406e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:31:10.977 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:10 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0[124038]: 2024-02-16T22:31:10.674+0000 7f1bd406e700 -1 osd.0 85 *** Got signal Terminated *** 2024-02-16T22:31:10.977 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:10 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0[124038]: 2024-02-16T22:31:10.674+0000 7f1bd406e700 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-16T22:31:16.319 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:16 smithi134 podman[153790]: 2024-02-16 22:31:16.0532604 +0000 UTC m=+5.506538821 container died d0153b47ae7ea82550d847dc804cba182c6b6d801ca6c43167ad136ce25c79c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-16T22:31:16.686 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:16 smithi134 podman[153790]: 2024-02-16 22:31:16.475527187 +0000 UTC m=+5.928805653 container cleanup d0153b47ae7ea82550d847dc804cba182c6b6d801ca6c43167ad136ce25c79c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-16T22:31:16.686 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:16 smithi134 bash[153790]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0 2024-02-16T22:31:16.976 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:16 smithi134 podman[153808]: 2024-02-16 22:31:16.685395173 +0000 UTC m=+0.631353199 container remove d0153b47ae7ea82550d847dc804cba182c6b6d801ca6c43167ad136ce25c79c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS) 2024-02-16T22:31:17.376 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:17 smithi134 podman[153897]: 2024-02-16 22:31:16.994287064 +0000 UTC m=+0.018137682 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:31:17.376 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:17 smithi134 podman[153897]: 2024-02-16 22:31:17.120173068 +0000 UTC m=+0.144023724 container create a9cbc3ef8150ed6856ebed91c53c410c4b7b793f764eff619191ee5deb987475 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-16T22:31:17.706 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:17 smithi134 podman[153897]: 2024-02-16 22:31:17.409237113 +0000 UTC m=+0.433087728 container init a9cbc3ef8150ed6856ebed91c53c410c4b7b793f764eff619191ee5deb987475 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:31:17.706 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:17 smithi134 podman[153897]: 2024-02-16 22:31:17.412459652 +0000 UTC m=+0.436310268 container start a9cbc3ef8150ed6856ebed91c53c410c4b7b793f764eff619191ee5deb987475 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-02-16T22:31:17.706 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:17 smithi134 podman[153897]: 2024-02-16 22:31:17.489468335 +0000 UTC m=+0.513318955 container attach a9cbc3ef8150ed6856ebed91c53c410c4b7b793f764eff619191ee5deb987475 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-02-16T22:31:17.706 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:17 smithi134 podman[153897]: 2024-02-16 22:31:17.70440548 +0000 UTC m=+0.728256104 container died a9cbc3ef8150ed6856ebed91c53c410c4b7b793f764eff619191ee5deb987475 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, io.buildah.version=1.33.5) 2024-02-16T22:31:18.252 INFO:journalctl@ceph.osd.0.smithi134.stdout:Feb 16 22:31:18 smithi134 podman[153923]: 2024-02-16 22:31:18.234974144 +0000 UTC m=+0.524829639 container remove a9cbc3ef8150ed6856ebed91c53c410c4b7b793f764eff619191ee5deb987475 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-0-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240214) 2024-02-16T22:31:18.258 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.0.service' 2024-02-16T22:31:18.300 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-16T22:31:18.300 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-16T22:31:18.301 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-16T22:31:18.301 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.1 2024-02-16T22:31:18.534 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:31:18 smithi134 systemd[1]: Stopping Ceph osd.1 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:31:18.976 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:31:18 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1[130032]: 2024-02-16T22:31:18.671+0000 7ff432f52700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:31:18.977 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:31:18 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1[130032]: 2024-02-16T22:31:18.671+0000 7ff432f52700 -1 osd.1 85 *** Got signal Terminated *** 2024-02-16T22:31:18.977 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:31:18 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1[130032]: 2024-02-16T22:31:18.671+0000 7ff432f52700 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-16T22:31:24.285 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:31:24 smithi134 podman[154004]: 2024-02-16 22:31:24.028160751 +0000 UTC m=+5.471769447 container died dd1faac850b0b84abddb203369e862d934c91d11c36107ef4dd870fae858de13 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:31:24.539 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:31:24 smithi134 podman[154004]: 2024-02-16 22:31:24.522155477 +0000 UTC m=+5.965764184 container cleanup dd1faac850b0b84abddb203369e862d934c91d11c36107ef4dd870fae858de13 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0) 2024-02-16T22:31:24.539 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:31:24 smithi134 bash[154004]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1 2024-02-16T22:31:25.059 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:31:24 smithi134 podman[154032]: 2024-02-16 22:31:24.748803084 +0000 UTC m=+0.709862264 container remove dd1faac850b0b84abddb203369e862d934c91d11c36107ef4dd870fae858de13 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-02-16T22:31:25.370 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:31:25 smithi134 podman[154126]: 2024-02-16 22:31:25.058196325 +0000 UTC m=+0.107416689 container create 947eaa38d5d42b3b9d0a79239186c11c1d9310235ae1fd65a2a2856003b57794 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-02-16T22:31:25.370 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:31:25 smithi134 podman[154126]: 2024-02-16 22:31:24.968510264 +0000 UTC m=+0.017730639 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:31:25.370 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:31:25 smithi134 podman[154126]: 2024-02-16 22:31:25.285832187 +0000 UTC m=+0.335052556 container init 947eaa38d5d42b3b9d0a79239186c11c1d9310235ae1fd65a2a2856003b57794 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-02-16T22:31:25.370 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:31:25 smithi134 podman[154126]: 2024-02-16 22:31:25.289087245 +0000 UTC m=+0.338307611 container start 947eaa38d5d42b3b9d0a79239186c11c1d9310235ae1fd65a2a2856003b57794 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-16T22:31:25.370 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:31:25 smithi134 podman[154126]: 2024-02-16 22:31:25.369282777 +0000 UTC m=+0.418503162 container attach 947eaa38d5d42b3b9d0a79239186c11c1d9310235ae1fd65a2a2856003b57794 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-deactivate, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214) 2024-02-16T22:31:25.727 INFO:journalctl@ceph.osd.1.smithi134.stdout:Feb 16 22:31:25 smithi134 podman[154126]: 2024-02-16 22:31:25.584832296 +0000 UTC m=+0.634052661 container died 947eaa38d5d42b3b9d0a79239186c11c1d9310235ae1fd65a2a2856003b57794 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-02-16T22:31:26.228 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.1.service' 2024-02-16T22:31:26.276 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-16T22:31:26.276 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-16T22:31:26.276 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-16T22:31:26.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.2 2024-02-16T22:31:26.477 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:31:26 smithi134 systemd[1]: Stopping Ceph osd.2 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:31:26.977 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:31:26 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2[135861]: 2024-02-16T22:31:26.574+0000 7f2025faf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:31:26.977 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:31:26 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2[135861]: 2024-02-16T22:31:26.574+0000 7f2025faf700 -1 osd.2 85 *** Got signal Terminated *** 2024-02-16T22:31:26.977 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:31:26 smithi134 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2[135861]: 2024-02-16T22:31:26.574+0000 7f2025faf700 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-16T22:31:32.253 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:31:31 smithi134 podman[154233]: 2024-02-16 22:31:31.991370252 +0000 UTC m=+5.537790177 container died 0e349c665c734993ae31e2c89ca84a3c7ea4ef429a3a9a9ebec3325255a05b66 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2, GIT_CLEAN=True, org.label-schema.build-date=20240214, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-02-16T22:31:32.528 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:31:32 smithi134 podman[154233]: 2024-02-16 22:31:32.33410543 +0000 UTC m=+5.880525372 container cleanup 0e349c665c734993ae31e2c89ca84a3c7ea4ef429a3a9a9ebec3325255a05b66 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-02-16T22:31:32.528 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:31:32 smithi134 bash[154233]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2 2024-02-16T22:31:32.947 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:31:32 smithi134 podman[154250]: 2024-02-16 22:31:32.527249012 +0000 UTC m=+0.534310941 container remove 0e349c665c734993ae31e2c89ca84a3c7ea4ef429a3a9a9ebec3325255a05b66 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-02-16T22:31:33.227 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:31:32 smithi134 podman[154341]: 2024-02-16 22:31:32.849236164 +0000 UTC m=+0.018078598 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:31:33.227 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:31:32 smithi134 podman[154341]: 2024-02-16 22:31:32.953159872 +0000 UTC m=+0.122002389 container create 6ce31108cff9fdd42ac1b3d95b935255b41b3a94f802fe1f7a827a07162c3520 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True) 2024-02-16T22:31:33.227 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:31:33 smithi134 podman[154341]: 2024-02-16 22:31:33.189042351 +0000 UTC m=+0.357884786 container init 6ce31108cff9fdd42ac1b3d95b935255b41b3a94f802fe1f7a827a07162c3520 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2) 2024-02-16T22:31:33.227 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:31:33 smithi134 podman[154341]: 2024-02-16 22:31:33.192270849 +0000 UTC m=+0.361113293 container start 6ce31108cff9fdd42ac1b3d95b935255b41b3a94f802fe1f7a827a07162c3520 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-02-16T22:31:33.727 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:31:33 smithi134 podman[154341]: 2024-02-16 22:31:33.28096852 +0000 UTC m=+0.449810966 container attach 6ce31108cff9fdd42ac1b3d95b935255b41b3a94f802fe1f7a827a07162c3520 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-deactivate, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-02-16T22:31:33.727 INFO:journalctl@ceph.osd.2.smithi134.stdout:Feb 16 22:31:33 smithi134 podman[154341]: 2024-02-16 22:31:33.487646089 +0000 UTC m=+0.656488529 container died 6ce31108cff9fdd42ac1b3d95b935255b41b3a94f802fe1f7a827a07162c3520 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:31:34.102 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.2.service' 2024-02-16T22:31:34.145 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-16T22:31:34.146 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-16T22:31:34.146 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-16T22:31:34.146 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.3 2024-02-16T22:31:34.432 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:31:34 smithi173 systemd[1]: Stopping Ceph osd.3 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:31:34.731 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:31:34 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3[93416]: 2024-02-16T22:31:34.430+0000 7f9bb8f3c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:31:34.731 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:31:34 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3[93416]: 2024-02-16T22:31:34.430+0000 7f9bb8f3c700 -1 osd.3 85 *** Got signal Terminated *** 2024-02-16T22:31:34.731 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:31:34 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3[93416]: 2024-02-16T22:31:34.430+0000 7f9bb8f3c700 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-16T22:31:39.481 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:39 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:31:39.066+0000 7f3760cf2700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.926395+0000 front 2024-02-16T22:31:14.926522+0000 (oldest deadline 2024-02-16T22:31:39.026454+0000) 2024-02-16T22:31:40.024 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:31:39 smithi173 podman[115539]: 2024-02-16 22:31:39.756543541 +0000 UTC m=+5.418010553 container died 1f4624a5418b8fed6f1107151cc928a2b3533d41545822964f6b86df91a3d4ce (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5) 2024-02-16T22:31:40.375 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:40 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:31:40.103+0000 7f3760cf2700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.926395+0000 front 2024-02-16T22:31:14.926522+0000 (oldest deadline 2024-02-16T22:31:39.026454+0000) 2024-02-16T22:31:40.375 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:31:40 smithi173 podman[115539]: 2024-02-16 22:31:40.189876404 +0000 UTC m=+5.851343416 container cleanup 1f4624a5418b8fed6f1107151cc928a2b3533d41545822964f6b86df91a3d4ce (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:31:40.375 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:31:40 smithi173 bash[115539]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3 2024-02-16T22:31:40.730 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:31:40 smithi173 podman[115569]: 2024-02-16 22:31:40.374428836 +0000 UTC m=+0.607531772 container remove 1f4624a5418b8fed6f1107151cc928a2b3533d41545822964f6b86df91a3d4ce (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:31:40.731 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:40 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:40.547+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:41.055 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:31:40 smithi173 podman[115661]: 2024-02-16 22:31:40.70624533 +0000 UTC m=+0.018268125 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:31:41.056 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:31:40 smithi173 podman[115661]: 2024-02-16 22:31:40.816918926 +0000 UTC m=+0.128941719 container create d06e888b3bcebd2d5d40fc570a6445968190134ee5d6be10a303d3d510e5190c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-02-16T22:31:41.056 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:31:41 smithi173 podman[115661]: 2024-02-16 22:31:41.055169032 +0000 UTC m=+0.367191822 container init d06e888b3bcebd2d5d40fc570a6445968190134ee5d6be10a303d3d510e5190c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-16T22:31:41.354 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:41 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:31:41.122+0000 7f3760cf2700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.926395+0000 front 2024-02-16T22:31:14.926522+0000 (oldest deadline 2024-02-16T22:31:39.026454+0000) 2024-02-16T22:31:41.354 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:31:41 smithi173 podman[115661]: 2024-02-16 22:31:41.058522772 +0000 UTC m=+0.370545573 container start d06e888b3bcebd2d5d40fc570a6445968190134ee5d6be10a303d3d510e5190c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:31:41.354 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:31:41 smithi173 podman[115661]: 2024-02-16 22:31:41.136296322 +0000 UTC m=+0.448319122 container attach d06e888b3bcebd2d5d40fc570a6445968190134ee5d6be10a303d3d510e5190c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-02-16T22:31:41.731 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:41 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:41.563+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:41.731 INFO:journalctl@ceph.osd.3.smithi173.stdout:Feb 16 22:31:41 smithi173 podman[115661]: 2024-02-16 22:31:41.35362262 +0000 UTC m=+0.665645425 container died d06e888b3bcebd2d5d40fc570a6445968190134ee5d6be10a303d3d510e5190c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-3-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-02-16T22:31:42.231 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:42 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:31:42.111+0000 7f3760cf2700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.926395+0000 front 2024-02-16T22:31:14.926522+0000 (oldest deadline 2024-02-16T22:31:39.026454+0000) 2024-02-16T22:31:42.329 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.3.service' 2024-02-16T22:31:42.377 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-16T22:31:42.378 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-16T22:31:42.378 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-16T22:31:42.378 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.4 2024-02-16T22:31:42.601 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:42 smithi173 systemd[1]: Stopping Ceph osd.4 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:31:42.980 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:42 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:42.599+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:42.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:42 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:31:42.726+0000 7f3767f05700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:31:42.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:42 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:31:42.726+0000 7f3767f05700 -1 osd.4 85 *** Got signal Terminated *** 2024-02-16T22:31:42.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:42 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:31:42.726+0000 7f3767f05700 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-16T22:31:43.481 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:43 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:31:43.157+0000 7f3760cf2700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.926395+0000 front 2024-02-16T22:31:14.926522+0000 (oldest deadline 2024-02-16T22:31:39.026454+0000) 2024-02-16T22:31:43.980 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:43 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:43.646+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:44.481 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:44 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:31:44.129+0000 7f3760cf2700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.926395+0000 front 2024-02-16T22:31:14.926522+0000 (oldest deadline 2024-02-16T22:31:39.026454+0000) 2024-02-16T22:31:44.980 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:44 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:44.660+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:45.480 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:45 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:31:45.131+0000 7f3760cf2700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.926395+0000 front 2024-02-16T22:31:14.926522+0000 (oldest deadline 2024-02-16T22:31:39.026454+0000) 2024-02-16T22:31:45.980 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:45 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:45.629+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:45.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:45 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:45.629+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-02-16T22:31:19.558505+0000 front 2024-02-16T22:31:19.558574+0000 (oldest deadline 2024-02-16T22:31:45.458409+0000) 2024-02-16T22:31:46.481 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:46 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:31:46.174+0000 7f3760cf2700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.926395+0000 front 2024-02-16T22:31:14.926522+0000 (oldest deadline 2024-02-16T22:31:39.026454+0000) 2024-02-16T22:31:46.980 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:46 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:46.617+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:46.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:46 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:46.617+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-02-16T22:31:19.558505+0000 front 2024-02-16T22:31:19.558574+0000 (oldest deadline 2024-02-16T22:31:45.458409+0000) 2024-02-16T22:31:47.480 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:47 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4[98298]: 2024-02-16T22:31:47.153+0000 7f3760cf2700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.926395+0000 front 2024-02-16T22:31:14.926522+0000 (oldest deadline 2024-02-16T22:31:39.026454+0000) 2024-02-16T22:31:47.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:47 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:47.569+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:47.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:47 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:47.569+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-02-16T22:31:19.558505+0000 front 2024-02-16T22:31:19.558574+0000 (oldest deadline 2024-02-16T22:31:45.458409+0000) 2024-02-16T22:31:48.346 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:48 smithi173 podman[115766]: 2024-02-16 22:31:48.06278749 +0000 UTC m=+5.458039744 container died 640d021c13b09ed634bff3adfd54c9dedd6528e4cd1909471a972467c5a0ddbe (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:31:48.604 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:48 smithi173 podman[115766]: 2024-02-16 22:31:48.510490609 +0000 UTC m=+5.905742861 container cleanup 640d021c13b09ed634bff3adfd54c9dedd6528e4cd1909471a972467c5a0ddbe (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-02-16T22:31:48.604 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:48 smithi173 bash[115766]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4 2024-02-16T22:31:48.981 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:48 smithi173 podman[115783]: 2024-02-16 22:31:48.70352947 +0000 UTC m=+0.632539280 container remove 640d021c13b09ed634bff3adfd54c9dedd6528e4cd1909471a972467c5a0ddbe (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-02-16T22:31:48.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:48 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:48.602+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:48.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:48 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:48.602+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-02-16T22:31:19.558505+0000 front 2024-02-16T22:31:19.558574+0000 (oldest deadline 2024-02-16T22:31:45.458409+0000) 2024-02-16T22:31:49.407 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:49 smithi173 podman[115873]: 2024-02-16 22:31:49.022675698 +0000 UTC m=+0.017088679 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:31:49.407 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:49 smithi173 podman[115873]: 2024-02-16 22:31:49.129288201 +0000 UTC m=+0.123701182 container create f592ad31075495a14e9a632135c0a838a82021fa2e7b5eddd688d2350cc19ab1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:31:49.407 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:49 smithi173 podman[115873]: 2024-02-16 22:31:49.331940783 +0000 UTC m=+0.326353774 container init f592ad31075495a14e9a632135c0a838a82021fa2e7b5eddd688d2350cc19ab1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:31:49.407 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:49 smithi173 podman[115873]: 2024-02-16 22:31:49.335271048 +0000 UTC m=+0.329684032 container start f592ad31075495a14e9a632135c0a838a82021fa2e7b5eddd688d2350cc19ab1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:31:49.407 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:49 smithi173 podman[115873]: 2024-02-16 22:31:49.406525746 +0000 UTC m=+0.400938736 container attach f592ad31075495a14e9a632135c0a838a82021fa2e7b5eddd688d2350cc19ab1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-16T22:31:49.731 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:49 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:49.600+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:49.731 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:49 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:49.600+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-02-16T22:31:19.558505+0000 front 2024-02-16T22:31:19.558574+0000 (oldest deadline 2024-02-16T22:31:45.458409+0000) 2024-02-16T22:31:49.731 INFO:journalctl@ceph.osd.4.smithi173.stdout:Feb 16 22:31:49 smithi173 podman[115873]: 2024-02-16 22:31:49.624139626 +0000 UTC m=+0.618552602 container died f592ad31075495a14e9a632135c0a838a82021fa2e7b5eddd688d2350cc19ab1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-16T22:31:50.187 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.4.service' 2024-02-16T22:31:50.227 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-16T22:31:50.227 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-16T22:31:50.227 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-16T22:31:50.227 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.5 2024-02-16T22:31:50.480 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:50 smithi173 systemd[1]: Stopping Ceph osd.5 for f29a5372-cd17-11ee-95ba-87774f69a715... 2024-02-16T22:31:50.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:50 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:50.576+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:50.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:50 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:50.576+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-02-16T22:31:19.558505+0000 front 2024-02-16T22:31:19.558574+0000 (oldest deadline 2024-02-16T22:31:45.458409+0000) 2024-02-16T22:31:50.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:50 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:50.580+0000 7fac15ca5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-16T22:31:50.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:50 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:50.580+0000 7fac15ca5700 -1 osd.5 85 *** Got signal Terminated *** 2024-02-16T22:31:50.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:50 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:50.580+0000 7fac15ca5700 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-16T22:31:51.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:51 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:51.588+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:51.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:51 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:51.588+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-02-16T22:31:19.558505+0000 front 2024-02-16T22:31:19.558574+0000 (oldest deadline 2024-02-16T22:31:45.458409+0000) 2024-02-16T22:31:52.980 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:52 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:52.605+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:52.983 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:52 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:52.605+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-02-16T22:31:19.558505+0000 front 2024-02-16T22:31:19.558574+0000 (oldest deadline 2024-02-16T22:31:45.458409+0000) 2024-02-16T22:31:53.980 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:53 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:53.621+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:53.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:53 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:53.621+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-02-16T22:31:19.558505+0000 front 2024-02-16T22:31:19.558574+0000 (oldest deadline 2024-02-16T22:31:45.458409+0000) 2024-02-16T22:31:54.980 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:54 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:54.634+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-02-16T22:31:14.858256+0000 front 2024-02-16T22:31:14.858181+0000 (oldest deadline 2024-02-16T22:31:39.558099+0000) 2024-02-16T22:31:54.981 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:54 smithi173 ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5[103190]: 2024-02-16T22:31:54.634+0000 7fac12a9a700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-02-16T22:31:19.558505+0000 front 2024-02-16T22:31:19.558574+0000 (oldest deadline 2024-02-16T22:31:45.458409+0000) 2024-02-16T22:31:56.364 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:56 smithi173 podman[115980]: 2024-02-16 22:31:56.100696863 +0000 UTC m=+5.651370115 container died 8ee59c4c43194ae02c75a9f49f1c695a277737a481e61fcc64f770c9ee89e6be (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-02-16T22:31:56.731 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:56 smithi173 podman[115980]: 2024-02-16 22:31:56.513112278 +0000 UTC m=+6.063785584 container cleanup 8ee59c4c43194ae02c75a9f49f1c695a277737a481e61fcc64f770c9ee89e6be (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:31:56.731 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:56 smithi173 bash[115980]: ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5 2024-02-16T22:31:57.070 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:56 smithi173 podman[115999]: 2024-02-16 22:31:56.730857286 +0000 UTC m=+0.623675338 container remove 8ee59c4c43194ae02c75a9f49f1c695a277737a481e61fcc64f770c9ee89e6be (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-16T22:31:57.360 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:57 smithi173 podman[116087]: 2024-02-16 22:31:56.972227792 +0000 UTC m=+0.019350691 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-16T22:31:57.360 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:57 smithi173 podman[116087]: 2024-02-16 22:31:57.081753865 +0000 UTC m=+0.128876798 container create d429e45986bdd1cf698b53449b3e3fd35e18001c3fb74bf84e1dc8f358f28f85 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-02-16T22:31:57.360 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:57 smithi173 podman[116087]: 2024-02-16 22:31:57.276419114 +0000 UTC m=+0.323542015 container init d429e45986bdd1cf698b53449b3e3fd35e18001c3fb74bf84e1dc8f358f28f85 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-deactivate, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214) 2024-02-16T22:31:57.360 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:57 smithi173 podman[116087]: 2024-02-16 22:31:57.279723248 +0000 UTC m=+0.326846139 container start d429e45986bdd1cf698b53449b3e3fd35e18001c3fb74bf84e1dc8f358f28f85 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-16T22:31:57.360 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:57 smithi173 podman[116087]: 2024-02-16 22:31:57.359275 +0000 UTC m=+0.406397900 container attach d429e45986bdd1cf698b53449b3e3fd35e18001c3fb74bf84e1dc8f358f28f85 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-16T22:31:57.731 INFO:journalctl@ceph.osd.5.smithi173.stdout:Feb 16 22:31:57 smithi173 podman[116087]: 2024-02-16 22:31:57.571355981 +0000 UTC m=+0.618478870 container died d429e45986bdd1cf698b53449b3e3fd35e18001c3fb74bf84e1dc8f358f28f85 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-f29a5372-cd17-11ee-95ba-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux ) 2024-02-16T22:31:58.152 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f29a5372-cd17-11ee-95ba-87774f69a715@osd.5.service' 2024-02-16T22:31:58.192 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-16T22:31:58.192 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-16T22:31:58.192 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f29a5372-cd17-11ee-95ba-87774f69a715 --force --keep-logs 2024-02-16T22:32:18.757 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f29a5372-cd17-11ee-95ba-87774f69a715 --force --keep-logs 2024-02-16T22:32:31.684 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-16T22:32:31.719 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-16T22:32:31.748 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-16T22:32:31.750 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562719/remote/smithi134/crash 2024-02-16T22:32:31.751 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/crash -- . 2024-02-16T22:32:31.789 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/crash: Cannot open: No such file or directory 2024-02-16T22:32:31.789 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now 2024-02-16T22:32:31.791 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562719/remote/smithi173/crash 2024-02-16T22:32:31.792 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/crash -- . 2024-02-16T22:32:31.817 INFO:teuthology.orchestra.run.smithi173.stderr:tar: /var/lib/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/crash: Cannot open: No such file or directory 2024-02-16T22:32:31.817 INFO:teuthology.orchestra.run.smithi173.stderr:tar: Error is not recoverable: exiting now 2024-02-16T22:32:31.818 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-16T22:32:31.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-16T22:32:31.872 INFO:tasks.cephadm:Compressing logs... 2024-02-16T22:32:31.872 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-16T22:32:31.915 DEBUG:teuthology.orchestra.run.smithi173:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-16T22:32:31.939 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory -- 2024-02-16T22:32:31.940 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/cephadm.log 2024-02-16T22:32:31.940 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi134.jyajef.log 2024-02-16T22:32:31.940 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.audit.log 2024-02-16T22:32:31.940 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi134.jyajef.log: gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mgr.smithi134.ordace.log 2024-02-16T22:32:31.941 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mon.smithi134.log 2024-02-16T22:32:31.941 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.1.log 2024-02-16T22:32:31.942 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mgr.smithi134.ordace.log: /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mon.smithi134.log: gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi134.cygfxr.log 2024-02-16T22:32:31.943 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.0.log 2024-02-16T22:32:31.943 INFO:teuthology.orchestra.run.smithi173.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-16T22:32:31.944 INFO:teuthology.orchestra.run.smithi173.stderr:: No such file or directory 2024-02-16T22:32:31.944 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi173.phstvm.log 2024-02-16T22:32:31.944 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.audit.log 2024-02-16T22:32:31.944 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi173.phstvm.log: gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.4.log 2024-02-16T22:32:31.948 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mgr.smithi173.kbofaa.log 2024-02-16T22:32:31.948 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi173.qljqef.log 2024-02-16T22:32:31.948 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mgr.smithi173.kbofaa.log: gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.5.log 2024-02-16T22:32:31.948 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi173.qljqef.log: gzip -5 --verbose 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-16T22:32:31.948 INFO:teuthology.orchestra.run.smithi173.stderr: -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.3.log 2024-02-16T22:32:31.948 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mon.smithi173.log 2024-02-16T22:32:31.948 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.cephadm.log 2024-02-16T22:32:31.948 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mon.smithi173.log: 93.9% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi173.phstvm.log.gz 91.2% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.audit.log.gz 2024-02-16T22:32:31.949 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-02-16T22:32:31.949 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.log 2024-02-16T22:32:31.949 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-volume.log 2024-02-16T22:32:31.949 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.log: 85.2% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.cephadm.log.gz 2024-02-16T22:32:31.949 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi134.cygfxr.log: 91.0% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.audit.log.gz 2024-02-16T22:32:31.950 INFO:teuthology.orchestra.run.smithi173.stderr: 87.6% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.log.gz 2024-02-16T22:32:31.951 INFO:teuthology.orchestra.run.smithi134.stderr: 90.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-16T22:32:31.952 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.cephadm.log 2024-02-16T22:32:31.952 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.log 2024-02-16T22:32:31.953 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.cephadm.log: 85.2% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.cephadm.log.gz 2024-02-16T22:32:31.954 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.2.log 2024-02-16T22:32:31.957 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.log: 87.5% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph.log.gz 2024-02-16T22:32:31.957 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-volume.log 2024-02-16T22:32:31.971 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-volume.log.gz 2024-02-16T22:32:31.981 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mgr.smithi173.kbofaa.log.gz 2024-02-16T22:32:32.026 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.2.log: /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-volume.log.gz 2024-02-16T22:32:32.296 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mgr.smithi134.ordace.log.gz 2024-02-16T22:32:32.344 INFO:teuthology.orchestra.run.smithi173.stderr: 92.5% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mon.smithi173.log.gz 2024-02-16T22:32:33.010 INFO:teuthology.orchestra.run.smithi134.stderr: 90.7% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mon.smithi134.log.gz 2024-02-16T22:32:35.940 INFO:teuthology.orchestra.run.smithi173.stderr: 93.3% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.4.log.gz 2024-02-16T22:32:36.194 INFO:teuthology.orchestra.run.smithi134.stderr: 95.1% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi134.cygfxr.log.gz 2024-02-16T22:32:37.107 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.2.log.gz 2024-02-16T22:32:37.125 INFO:teuthology.orchestra.run.smithi173.stderr: 93.4% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.5.log.gz 2024-02-16T22:32:37.243 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.1.log.gz 2024-02-16T22:32:37.702 INFO:teuthology.orchestra.run.smithi173.stderr: 93.3% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.3.log.gz 2024-02-16T22:32:37.871 INFO:teuthology.orchestra.run.smithi134.stderr: 93.3% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-osd.0.log.gz 2024-02-16T22:33:17.650 INFO:teuthology.orchestra.run.smithi134.stderr: 93.3% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi134.jyajef.log.gz 2024-02-16T22:33:17.652 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-02-16T22:33:17.652 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m45.725s 2024-02-16T22:33:17.652 INFO:teuthology.orchestra.run.smithi134.stderr:user 1m5.427s 2024-02-16T22:33:17.652 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m2.238s 2024-02-16T22:33:18.068 INFO:teuthology.orchestra.run.smithi173.stderr: 93.3% -- replaced with /var/log/ceph/f29a5372-cd17-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi173.qljqef.log.gz 2024-02-16T22:33:18.069 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-02-16T22:33:18.070 INFO:teuthology.orchestra.run.smithi173.stderr:real 0m46.141s 2024-02-16T22:33:18.070 INFO:teuthology.orchestra.run.smithi173.stderr:user 0m59.468s 2024-02-16T22:33:18.070 INFO:teuthology.orchestra.run.smithi173.stderr:sys 0m1.996s 2024-02-16T22:33:18.070 INFO:tasks.cephadm:Archiving logs... 2024-02-16T22:33:18.070 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562719/remote/smithi134/log 2024-02-16T22:33:18.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-16T22:33:26.999 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562719/remote/smithi173/log 2024-02-16T22:33:27.000 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-16T22:33:35.705 INFO:tasks.cephadm:Removing cluster... 2024-02-16T22:33:35.706 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f29a5372-cd17-11ee-95ba-87774f69a715 --force 2024-02-16T22:33:36.366 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f29a5372-cd17-11ee-95ba-87774f69a715 --force 2024-02-16T22:33:36.918 INFO:tasks.cephadm:Removing cephadm ... 2024-02-16T22:33:36.918 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-16T22:33:36.935 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-16T22:33:36.950 INFO:tasks.cephadm:Teardown complete 2024-02-16T22:33:36.951 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-16T22:33:36.963 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/full_sequential_finally.py", line 43, in task ((taskname, confg),) = entry.items() ValueError: too many values to unpack (expected 1) 2024-02-16T22:33:36.964 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-16T22:33:36.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-16T22:33:36.977 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-16T22:33:37.072 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-16T22:33:37.085 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-16T22:33:37.085 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T22:33:37.088 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T22:33:37.100 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-02-16T22:33:37.101 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-02-16T22:33:37.104 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-16T22:33:37.105 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-02-16T22:33:37.105 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 11 +561us[ +561us] +/- 97ms 2024-02-16T22:33:37.105 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv02.front.sepia.ceph.com 3 6 377 15 -1108us[-1147us] +/- 68ms 2024-02-16T22:33:37.105 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +949us[ +910us] +/- 85ms 2024-02-16T22:33:37.105 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T22:33:37.106 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-16T22:33:37.106 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-02-16T22:33:37.106 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 +569us[ +588us] +/- 97ms 2024-02-16T22:33:37.106 INFO:teuthology.orchestra.run.smithi173.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -1101us[-1082us] +/- 68ms 2024-02-16T22:33:37.106 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +956us[ +974us] +/- 85ms 2024-02-16T22:33:37.106 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T22:33:37.106 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-16T22:33:37.119 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-16T22:33:37.119 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-16T22:33:37.202 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-16T22:33:37.290 DEBUG:teuthology.orchestra.run.smithi173:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-16T22:33:37.367 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-16T22:33:37.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T22:33:37.398 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-16T22:33:37.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T22:33:37.427 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-16T22:33:37.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-16T22:33:37.501 INFO:teuthology.task.internal:Duration was 1890.622322 seconds 2024-02-16T22:33:37.502 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-16T22:33:37.518 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-16T22:33:37.518 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-16T22:33:37.521 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-16T22:33:37.561 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-16T22:33:37.564 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-16T22:33:37.771 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-16T22:33:37.771 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-02-16T22:33:37.771 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-16T22:33:37.831 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2024-02-16T22:33:37.831 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-16T22:33:37.861 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-16T22:33:37.861 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-16T22:33:37.873 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-16T22:33:37.930 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-16T22:33:37.930 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-16T22:33:37.942 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-16T22:33:38.539 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-16T22:33:38.552 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-16T22:33:38.552 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-16T22:33:38.578 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-16T22:33:38.606 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-16T22:33:38.619 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-16T22:33:38.621 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-16T22:33:38.643 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-02-16T22:33:38.671 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2024-02-16T22:33:38.687 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-16T22:33:38.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T22:33:38.711 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-16T22:33:38.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T22:33:38.741 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-16T22:33:38.755 INFO:teuthology.task.internal:Transferring archived files... 2024-02-16T22:33:38.755 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562719/remote/smithi134 2024-02-16T22:33:38.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-16T22:33:38.805 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562719/remote/smithi173 2024-02-16T22:33:38.805 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-16T22:33:38.844 INFO:teuthology.task.internal:Removing archive directory... 2024-02-16T22:33:38.844 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-16T22:33:38.847 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-16T22:33:38.892 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-16T22:33:38.905 INFO:teuthology.task.internal:Not uploading archives. 2024-02-16T22:33:38.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-16T22:33:38.938 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-16T22:33:38.938 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-16T22:33:38.941 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-16T22:33:38.953 INFO:teuthology.orchestra.run.smithi134.stdout: 265838 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 16 22:33 /home/ubuntu/cephtest 2024-02-16T22:33:38.955 INFO:teuthology.orchestra.run.smithi173.stdout: 265307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 16 22:33 /home/ubuntu/cephtest 2024-02-16T22:33:38.956 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-16T22:33:38.990 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-16T22:33:39.021 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: ValueError: too many values to unpack (expected 1) 2024-02-16T22:33:39.021 INFO:teuthology.nuke:Checking targets against current locks 2024-02-16T22:33:39.049 DEBUG:teuthology.nuke:shortname: smithi134 2024-02-16T22:33:39.050 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-16T22:33:39.072 DEBUG:teuthology.nuke:shortname: smithi173 2024-02-16T22:33:39.073 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-16T22:33:39.075 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562719', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-16 21:53:54.369129', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPRm2oJqRrbnMVwWaX3HCwSiw4m0MzyfVmBtelYYWJx6EUtjBfIiLyeiNal6oxcGtXsSUWq8e20/7FBntd0uhGM='} 2024-02-16T22:33:39.101 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562719', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-16 21:53:54.367225', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIUwCJGUGQpkimg0vp1x4XCE+YrSPSYnbzqRZfbgiwp4sd8cFwdg10kAkB9x3w739p5AcVMYPMj4C01ghy54tNo='} 2024-02-16T22:33:39.127 INFO:teuthology.orchestra.console.smithi134:Power off 2024-02-16T22:33:39.127 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-16T22:33:39.152 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2024-02-16T22:33:39.152 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T22:33:39.165 INFO:teuthology.orchestra.console.smithi173:Power off 2024-02-16T22:33:39.165 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-16T22:33:39.174 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-02-16T22:33:39.187 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2024-02-16T22:33:39.188 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T22:33:39.213 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-02-16T22:33:43.175 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T22:33:43.213 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T22:33:43.287 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-02-16T22:33:43.323 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-02-16T22:33:47.292 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T22:33:47.324 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T22:33:47.402 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-02-16T22:33:47.432 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-02-16T22:33:47.533 INFO:teuthology.orchestra.console.smithi173:Power off completed 2024-02-16T22:33:51.407 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T22:33:51.517 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2024-02-16T22:33:51.617 INFO:teuthology.orchestra.console.smithi134:Power off completed 2024-02-16T22:33:51.722 INFO:teuthology.run:Summary data: description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1890.6223216056824 failure_reason: too many values to unpack (expected 1) flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-02-16T22:33:51.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:33:51.813 INFO:teuthology.run:FAIL